[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:07:24.109822 29364 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.28.173.62:35903
I20260709 13:07:24.111383 29364 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:07:24.112497 29364 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:24.129295 29370 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:24.129474 29371 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:24.129668 29373 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:24.131742 29364 server_base.cc:1061] running on GCE node
I20260709 13:07:25.319990 29364 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:25.320235 29364 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:25.320387 29364 hybrid_clock.cc:648] HybridClock initialized: now 1783602445320371 us; error 0 us; skew 500 ppm
I20260709 13:07:25.321177 29364 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:25.327138 29364 webserver.cc:533] Webserver started at http://127.28.173.62:37551/ using document root <none> and password file <none>
I20260709 13:07:25.328033 29364 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:25.328234 29364 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:25.328632 29364 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:25.334501 29364 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602443945700-29364-0/minicluster-data/master-0-root/instance:
uuid: "78161957112549caa5d50e2c302f9947"
format_stamp: "Formatted at 2026-07-09 13:07:25 on dist-test-slave-x62b"
I20260709 13:07:25.342147 29364 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:07:25.347385 29379 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:25.348693 29364 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:07:25.349006 29364 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602443945700-29364-0/minicluster-data/master-0-root
uuid: "78161957112549caa5d50e2c302f9947"
format_stamp: "Formatted at 2026-07-09 13:07:25 on dist-test-slave-x62b"
I20260709 13:07:25.349325 29364 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602443945700-29364-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602443945700-29364-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602443945700-29364-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:25.401892 29364 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:25.403321 29364 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:07:25.403723 29364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:25.473882 29364 rpc_server.cc:307] RPC server started. Bound to: 127.28.173.62:35903
I20260709 13:07:25.473954 29430 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.173.62:35903 every 8 connection(s)
I20260709 13:07:25.481592 29431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.503072 29431 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78161957112549caa5d50e2c302f9947: Bootstrap starting.
I20260709 13:07:25.509112 29431 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 78161957112549caa5d50e2c302f9947: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:25.511021 29431 log.cc:826] T 00000000000000000000000000000000 P 78161957112549caa5d50e2c302f9947: Log is configured to *not* fsync() on all Append() calls
I20260709 13:07:25.515532 29431 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78161957112549caa5d50e2c302f9947: No bootstrap required, opened a new log
I20260709 13:07:25.536357 29431 raft_consensus.cc:359] T 00000000000000000000000000000000 P 78161957112549caa5d50e2c302f9947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78161957112549caa5d50e2c302f9947" member_type: VOTER }
I20260709 13:07:25.536877 29431 raft_consensus.cc:385] T 00000000000000000000000000000000 P 78161957112549caa5d50e2c302f9947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:25.537073 29431 raft_consensus.cc:740] T 00000000000000000000000000000000 P 78161957112549caa5d50e2c302f9947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78161957112549caa5d50e2c302f9947, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.537981 29431 consensus_queue.cc:260] T 00000000000000000000000000000000 P 78161957112549caa5d50e2c302f9947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78161957112549caa5d50e2c302f9947" member_type: VOTER }
I20260709 13:07:25.538435 29431 raft_consensus.cc:399] T 00000000000000000000000000000000 P 78161957112549caa5d50e2c302f9947 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:07:25.538676 29431 raft_consensus.cc:493] T 00000000000000000000000000000000 P 78161957112549caa5d50e2c302f9947 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:07:25.538949 29431 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 78161957112549caa5d50e2c302f9947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:25.542884 29431 raft_consensus.cc:515] T 00000000000000000000000000000000 P 78161957112549caa5d50e2c302f9947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78161957112549caa5d50e2c302f9947" member_type: VOTER }
I20260709 13:07:25.543535 29431 leader_election.cc:304] T 00000000000000000000000000000000 P 78161957112549caa5d50e2c302f9947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 78161957112549caa5d50e2c302f9947; no voters: 
I20260709 13:07:25.545225 29431 leader_election.cc:290] T 00000000000000000000000000000000 P 78161957112549caa5d50e2c302f9947 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:07:25.545579 29434 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 78161957112549caa5d50e2c302f9947 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:25.547857 29434 raft_consensus.cc:697] T 00000000000000000000000000000000 P 78161957112549caa5d50e2c302f9947 [term 1 LEADER]: Becoming Leader. State: Replica: 78161957112549caa5d50e2c302f9947, State: Running, Role: LEADER
I20260709 13:07:25.548806 29434 consensus_queue.cc:237] T 00000000000000000000000000000000 P 78161957112549caa5d50e2c302f9947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78161957112549caa5d50e2c302f9947" member_type: VOTER }
I20260709 13:07:25.549798 29431 sys_catalog.cc:565] T 00000000000000000000000000000000 P 78161957112549caa5d50e2c302f9947 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:07:25.560436 29435 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78161957112549caa5d50e2c302f9947 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "78161957112549caa5d50e2c302f9947" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78161957112549caa5d50e2c302f9947" member_type: VOTER } }
I20260709 13:07:25.560329 29436 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78161957112549caa5d50e2c302f9947 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 78161957112549caa5d50e2c302f9947. Latest consensus state: current_term: 1 leader_uuid: "78161957112549caa5d50e2c302f9947" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78161957112549caa5d50e2c302f9947" member_type: VOTER } }
I20260709 13:07:25.561174 29435 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78161957112549caa5d50e2c302f9947 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:25.561254 29436 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78161957112549caa5d50e2c302f9947 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:25.563903 29444 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:07:25.576825 29444 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:07:25.579011 29364 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:07:25.591842 29444 catalog_manager.cc:1383] Generated new cluster ID: eb749ba59b2943f5a4d7b574d0252c9e
I20260709 13:07:25.592154 29444 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:07:25.607944 29444 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:07:25.609967 29444 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:07:25.625697 29444 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 78161957112549caa5d50e2c302f9947: Generated new TSK 0
I20260709 13:07:25.626597 29444 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:07:25.645885 29364 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:25.655037 29453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:25.656293 29454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:25.660499 29364 server_base.cc:1061] running on GCE node
W20260709 13:07:25.661023 29457 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:25.661943 29364 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:25.662166 29364 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:25.662348 29364 hybrid_clock.cc:648] HybridClock initialized: now 1783602445662331 us; error 0 us; skew 500 ppm
I20260709 13:07:25.662964 29364 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:25.667021 29364 webserver.cc:533] Webserver started at http://127.28.173.1:45513/ using document root <none> and password file <none>
I20260709 13:07:25.667724 29364 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:25.668001 29364 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:25.668339 29364 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:25.669852 29364 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602443945700-29364-0/minicluster-data/ts-0-root/instance:
uuid: "e28ca864e4c848b59d8b018ac4169c32"
format_stamp: "Formatted at 2026-07-09 13:07:25 on dist-test-slave-x62b"
I20260709 13:07:25.676970 29364 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.003s
I20260709 13:07:25.682144 29461 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:25.683104 29364 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:07:25.683449 29364 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602443945700-29364-0/minicluster-data/ts-0-root
uuid: "e28ca864e4c848b59d8b018ac4169c32"
format_stamp: "Formatted at 2026-07-09 13:07:25 on dist-test-slave-x62b"
I20260709 13:07:25.683883 29364 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602443945700-29364-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602443945700-29364-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602443945700-29364-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:25.724056 29364 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:25.725860 29364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:25.728675 29364 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:25.734095 29364 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:25.734395 29364 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:25.734717 29364 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:25.734939 29364 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:25.825351 29364 rpc_server.cc:307] RPC server started. Bound to: 127.28.173.1:44833
I20260709 13:07:25.825430 29523 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.173.1:44833 every 8 connection(s)
I20260709 13:07:25.833294 29364 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:25.844595 29528 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:25.846287 29529 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:25.856317 29364 server_base.cc:1061] running on GCE node
W20260709 13:07:25.856009 29531 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:25.857676 29364 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:25.857955 29364 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:25.858174 29364 hybrid_clock.cc:648] HybridClock initialized: now 1783602445858151 us; error 0 us; skew 500 ppm
I20260709 13:07:25.859011 29364 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:25.864889 29524 heartbeater.cc:344] Connected to a master server at 127.28.173.62:35903
I20260709 13:07:25.865362 29524 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:25.866153 29364 webserver.cc:533] Webserver started at http://127.28.173.2:39415/ using document root <none> and password file <none>
I20260709 13:07:25.866638 29524 heartbeater.cc:507] Master 127.28.173.62:35903 requested a full tablet report, sending...
I20260709 13:07:25.866859 29364 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:25.867111 29364 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:25.867597 29364 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:25.869366 29364 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602443945700-29364-0/minicluster-data/ts-1-root/instance:
uuid: "bc0a9840c02a4c279170b1c5fe560370"
format_stamp: "Formatted at 2026-07-09 13:07:25 on dist-test-slave-x62b"
I20260709 13:07:25.870617 29396 ts_manager.cc:194] Registered new tserver with Master: e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1:44833)
I20260709 13:07:25.873652 29396 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37290
I20260709 13:07:25.876685 29364 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:07:25.881444 29536 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:25.882297 29364 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.003s
I20260709 13:07:25.882568 29364 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602443945700-29364-0/minicluster-data/ts-1-root
uuid: "bc0a9840c02a4c279170b1c5fe560370"
format_stamp: "Formatted at 2026-07-09 13:07:25 on dist-test-slave-x62b"
I20260709 13:07:25.882836 29364 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602443945700-29364-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602443945700-29364-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602443945700-29364-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:25.899116 29364 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:25.900375 29364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:25.902907 29364 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:25.906370 29364 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:25.906543 29364 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:25.906836 29364 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:25.906978 29364 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:26.011785 29364 rpc_server.cc:307] RPC server started. Bound to: 127.28.173.2:40589
I20260709 13:07:26.011929 29598 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.173.2:40589 every 8 connection(s)
I20260709 13:07:26.017652 29364 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:26.026274 29602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:26.028801 29603 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:26.032487 29599 heartbeater.cc:344] Connected to a master server at 127.28.173.62:35903
I20260709 13:07:26.033000 29599 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:26.034250 29599 heartbeater.cc:507] Master 127.28.173.62:35903 requested a full tablet report, sending...
I20260709 13:07:26.037241 29396 ts_manager.cc:194] Registered new tserver with Master: bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2:40589)
I20260709 13:07:26.037417 29364 server_base.cc:1061] running on GCE node
W20260709 13:07:26.038589 29605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:26.039152 29396 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37298
I20260709 13:07:26.039703 29364 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:26.039991 29364 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:26.040197 29364 hybrid_clock.cc:648] HybridClock initialized: now 1783602446040176 us; error 0 us; skew 500 ppm
I20260709 13:07:26.040951 29364 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:26.043529 29364 webserver.cc:533] Webserver started at http://127.28.173.3:42101/ using document root <none> and password file <none>
I20260709 13:07:26.044014 29364 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:26.044175 29364 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:26.044368 29364 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:26.045380 29364 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602443945700-29364-0/minicluster-data/ts-2-root/instance:
uuid: "5481e9936dfb479fa0dd925db3daff07"
format_stamp: "Formatted at 2026-07-09 13:07:26 on dist-test-slave-x62b"
I20260709 13:07:26.049971 29364 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:07:26.053364 29610 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:26.054155 29364 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:07:26.054450 29364 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602443945700-29364-0/minicluster-data/ts-2-root
uuid: "5481e9936dfb479fa0dd925db3daff07"
format_stamp: "Formatted at 2026-07-09 13:07:26 on dist-test-slave-x62b"
I20260709 13:07:26.054750 29364 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602443945700-29364-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602443945700-29364-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602443945700-29364-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:26.077905 29364 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:26.079427 29364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:26.081051 29364 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:26.083175 29364 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:26.083401 29364 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:26.083652 29364 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:26.083844 29364 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:26.177539 29364 rpc_server.cc:307] RPC server started. Bound to: 127.28.173.3:42061
I20260709 13:07:26.177711 29672 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.173.3:42061 every 8 connection(s)
I20260709 13:07:26.194820 29673 heartbeater.cc:344] Connected to a master server at 127.28.173.62:35903
I20260709 13:07:26.195250 29673 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:26.196033 29673 heartbeater.cc:507] Master 127.28.173.62:35903 requested a full tablet report, sending...
I20260709 13:07:26.197921 29396 ts_manager.cc:194] Registered new tserver with Master: 5481e9936dfb479fa0dd925db3daff07 (127.28.173.3:42061)
I20260709 13:07:26.198527 29364 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017008635s
I20260709 13:07:26.199539 29396 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37314
I20260709 13:07:26.249145 29396 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37320:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:07:26.252681 29396 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:07:26.357839 29564 tablet_service.cc:1511] Processing CreateTablet for tablet 2af14a7828dc4808aa8fdc9c1c758b85 (DEFAULT_TABLE table=test-workload [id=461b8b32e7994c95a68d9e63ba86c646]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:26.359514 29564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2af14a7828dc4808aa8fdc9c1c758b85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.364887 29563 tablet_service.cc:1511] Processing CreateTablet for tablet a5df53243d4c4e27bef57ad8f51bcb6e (DEFAULT_TABLE table=test-workload [id=461b8b32e7994c95a68d9e63ba86c646]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:26.366189 29563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5df53243d4c4e27bef57ad8f51bcb6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.382634 29690 tablet_bootstrap.cc:492] T 2af14a7828dc4808aa8fdc9c1c758b85 P bc0a9840c02a4c279170b1c5fe560370: Bootstrap starting.
I20260709 13:07:26.383599 29562 tablet_service.cc:1511] Processing CreateTablet for tablet e01ba93272b5460a8e453d93659b85ae (DEFAULT_TABLE table=test-workload [id=461b8b32e7994c95a68d9e63ba86c646]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:26.385016 29562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e01ba93272b5460a8e453d93659b85ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.390399 29690 tablet_bootstrap.cc:654] T 2af14a7828dc4808aa8fdc9c1c758b85 P bc0a9840c02a4c279170b1c5fe560370: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.397557 29564 tablet_service.cc:1511] Processing CreateTablet for tablet 4f69e2661ba745b09237e4ce0494087b (DEFAULT_TABLE table=test-workload [id=461b8b32e7994c95a68d9e63ba86c646]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:26.398190 29561 tablet_service.cc:1511] Processing CreateTablet for tablet dbc21554b6344107baedcec570f26b37 (DEFAULT_TABLE table=test-workload [id=461b8b32e7994c95a68d9e63ba86c646]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:26.398847 29564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f69e2661ba745b09237e4ce0494087b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.399498 29561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbc21554b6344107baedcec570f26b37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.414067 29560 tablet_service.cc:1511] Processing CreateTablet for tablet d4d2f00fadd04bdd91d3c97ebc76f005 (DEFAULT_TABLE table=test-workload [id=461b8b32e7994c95a68d9e63ba86c646]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:26.415727 29560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4d2f00fadd04bdd91d3c97ebc76f005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.419448 29690 tablet_bootstrap.cc:492] T 2af14a7828dc4808aa8fdc9c1c758b85 P bc0a9840c02a4c279170b1c5fe560370: No bootstrap required, opened a new log
I20260709 13:07:26.419960 29690 ts_tablet_manager.cc:1403] T 2af14a7828dc4808aa8fdc9c1c758b85 P bc0a9840c02a4c279170b1c5fe560370: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.004s
I20260709 13:07:26.422999 29690 raft_consensus.cc:359] T 2af14a7828dc4808aa8fdc9c1c758b85 P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } } peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } }
I20260709 13:07:26.423765 29690 raft_consensus.cc:385] T 2af14a7828dc4808aa8fdc9c1c758b85 P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.424081 29690 raft_consensus.cc:740] T 2af14a7828dc4808aa8fdc9c1c758b85 P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc0a9840c02a4c279170b1c5fe560370, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.425168 29690 consensus_queue.cc:260] T 2af14a7828dc4808aa8fdc9c1c758b85 P bc0a9840c02a4c279170b1c5fe560370 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } } peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } }
I20260709 13:07:26.425595 29559 tablet_service.cc:1511] Processing CreateTablet for tablet 8d25bbcb97f44813aa8241e230434f74 (DEFAULT_TABLE table=test-workload [id=461b8b32e7994c95a68d9e63ba86c646]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:26.427014 29559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d25bbcb97f44813aa8241e230434f74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.442201 29564 tablet_service.cc:1511] Processing CreateTablet for tablet ca6f74116b244bc0929c39ea3913a184 (DEFAULT_TABLE table=test-workload [id=461b8b32e7994c95a68d9e63ba86c646]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:26.443542 29564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca6f74116b244bc0929c39ea3913a184. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.443542 29558 tablet_service.cc:1511] Processing CreateTablet for tablet 2ef4ec98706b46e2a2ff852dca7ee48e (DEFAULT_TABLE table=test-workload [id=461b8b32e7994c95a68d9e63ba86c646]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:26.445099 29558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ef4ec98706b46e2a2ff852dca7ee48e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.470072 29635 tablet_service.cc:1511] Processing CreateTablet for tablet 4f69e2661ba745b09237e4ce0494087b (DEFAULT_TABLE table=test-workload [id=461b8b32e7994c95a68d9e63ba86c646]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:26.470661 29634 tablet_service.cc:1511] Processing CreateTablet for tablet dbc21554b6344107baedcec570f26b37 (DEFAULT_TABLE table=test-workload [id=461b8b32e7994c95a68d9e63ba86c646]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:26.471488 29635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f69e2661ba745b09237e4ce0494087b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.471861 29633 tablet_service.cc:1511] Processing CreateTablet for tablet d4d2f00fadd04bdd91d3c97ebc76f005 (DEFAULT_TABLE table=test-workload [id=461b8b32e7994c95a68d9e63ba86c646]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:26.473320 29633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4d2f00fadd04bdd91d3c97ebc76f005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.473060 29636 tablet_service.cc:1511] Processing CreateTablet for tablet e01ba93272b5460a8e453d93659b85ae (DEFAULT_TABLE table=test-workload [id=461b8b32e7994c95a68d9e63ba86c646]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:26.474545 29636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e01ba93272b5460a8e453d93659b85ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.475678 29632 tablet_service.cc:1511] Processing CreateTablet for tablet 8d25bbcb97f44813aa8241e230434f74 (DEFAULT_TABLE table=test-workload [id=461b8b32e7994c95a68d9e63ba86c646]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:26.477046 29632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d25bbcb97f44813aa8241e230434f74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.477131 29637 tablet_service.cc:1511] Processing CreateTablet for tablet a5df53243d4c4e27bef57ad8f51bcb6e (DEFAULT_TABLE table=test-workload [id=461b8b32e7994c95a68d9e63ba86c646]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:26.477818 29489 tablet_service.cc:1511] Processing CreateTablet for tablet 2af14a7828dc4808aa8fdc9c1c758b85 (DEFAULT_TABLE table=test-workload [id=461b8b32e7994c95a68d9e63ba86c646]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:26.478513 29487 tablet_service.cc:1511] Processing CreateTablet for tablet e01ba93272b5460a8e453d93659b85ae (DEFAULT_TABLE table=test-workload [id=461b8b32e7994c95a68d9e63ba86c646]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:26.479166 29489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2af14a7828dc4808aa8fdc9c1c758b85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.478535 29637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5df53243d4c4e27bef57ad8f51bcb6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.485985 29486 tablet_service.cc:1511] Processing CreateTablet for tablet 4f69e2661ba745b09237e4ce0494087b (DEFAULT_TABLE table=test-workload [id=461b8b32e7994c95a68d9e63ba86c646]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:26.491010 29487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e01ba93272b5460a8e453d93659b85ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.489639 29631 tablet_service.cc:1511] Processing CreateTablet for tablet ca6f74116b244bc0929c39ea3913a184 (DEFAULT_TABLE table=test-workload [id=461b8b32e7994c95a68d9e63ba86c646]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:26.489569 29638 tablet_service.cc:1511] Processing CreateTablet for tablet 2af14a7828dc4808aa8fdc9c1c758b85 (DEFAULT_TABLE table=test-workload [id=461b8b32e7994c95a68d9e63ba86c646]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:26.511662 29485 tablet_service.cc:1511] Processing CreateTablet for tablet dbc21554b6344107baedcec570f26b37 (DEFAULT_TABLE table=test-workload [id=461b8b32e7994c95a68d9e63ba86c646]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:26.511207 29634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbc21554b6344107baedcec570f26b37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.492951 29630 tablet_service.cc:1511] Processing CreateTablet for tablet 2ef4ec98706b46e2a2ff852dca7ee48e (DEFAULT_TABLE table=test-workload [id=461b8b32e7994c95a68d9e63ba86c646]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:26.523332 29484 tablet_service.cc:1511] Processing CreateTablet for tablet d4d2f00fadd04bdd91d3c97ebc76f005 (DEFAULT_TABLE table=test-workload [id=461b8b32e7994c95a68d9e63ba86c646]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:26.519896 29486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f69e2661ba745b09237e4ce0494087b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.529155 29485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbc21554b6344107baedcec570f26b37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.526901 29631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca6f74116b244bc0929c39ea3913a184. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.521304 29488 tablet_service.cc:1511] Processing CreateTablet for tablet a5df53243d4c4e27bef57ad8f51bcb6e (DEFAULT_TABLE table=test-workload [id=461b8b32e7994c95a68d9e63ba86c646]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:26.524251 29483 tablet_service.cc:1511] Processing CreateTablet for tablet 8d25bbcb97f44813aa8241e230434f74 (DEFAULT_TABLE table=test-workload [id=461b8b32e7994c95a68d9e63ba86c646]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:26.532910 29690 ts_tablet_manager.cc:1434] T 2af14a7828dc4808aa8fdc9c1c758b85 P bc0a9840c02a4c279170b1c5fe560370: Time spent starting tablet: real 0.113s	user 0.041s	sys 0.020s
I20260709 13:07:26.533838 29482 tablet_service.cc:1511] Processing CreateTablet for tablet ca6f74116b244bc0929c39ea3913a184 (DEFAULT_TABLE table=test-workload [id=461b8b32e7994c95a68d9e63ba86c646]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:26.536710 29484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4d2f00fadd04bdd91d3c97ebc76f005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.536842 29599 heartbeater.cc:499] Master 127.28.173.62:35903 was elected leader, sending a full tablet report...
I20260709 13:07:26.540030 29690 tablet_bootstrap.cc:492] T 4f69e2661ba745b09237e4ce0494087b P bc0a9840c02a4c279170b1c5fe560370: Bootstrap starting.
I20260709 13:07:26.543782 29483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d25bbcb97f44813aa8241e230434f74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.545150 29481 tablet_service.cc:1511] Processing CreateTablet for tablet 2ef4ec98706b46e2a2ff852dca7ee48e (DEFAULT_TABLE table=test-workload [id=461b8b32e7994c95a68d9e63ba86c646]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:26.545773 29482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca6f74116b244bc0929c39ea3913a184. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.547796 29488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5df53243d4c4e27bef57ad8f51bcb6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.549073 29638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2af14a7828dc4808aa8fdc9c1c758b85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.550961 29481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ef4ec98706b46e2a2ff852dca7ee48e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.560122 29630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ef4ec98706b46e2a2ff852dca7ee48e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.610107 29692 raft_consensus.cc:493] T 2af14a7828dc4808aa8fdc9c1c758b85 P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.611766 29692 raft_consensus.cc:515] T 2af14a7828dc4808aa8fdc9c1c758b85 P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } } peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } }
W20260709 13:07:26.634318 29443 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:26.648952 29692 leader_election.cc:290] T 2af14a7828dc4808aa8fdc9c1c758b85 P bc0a9840c02a4c279170b1c5fe560370 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5481e9936dfb479fa0dd925db3daff07 (127.28.173.3:42061), e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1:44833)
I20260709 13:07:26.701313 29693 tablet_bootstrap.cc:492] T d4d2f00fadd04bdd91d3c97ebc76f005 P 5481e9936dfb479fa0dd925db3daff07: Bootstrap starting.
I20260709 13:07:26.703155 29694 tablet_bootstrap.cc:492] T ca6f74116b244bc0929c39ea3913a184 P e28ca864e4c848b59d8b018ac4169c32: Bootstrap starting.
I20260709 13:07:26.730870 29693 tablet_bootstrap.cc:654] T d4d2f00fadd04bdd91d3c97ebc76f005 P 5481e9936dfb479fa0dd925db3daff07: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.731307 29690 tablet_bootstrap.cc:654] T 4f69e2661ba745b09237e4ce0494087b P bc0a9840c02a4c279170b1c5fe560370: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.737493 29694 tablet_bootstrap.cc:654] T ca6f74116b244bc0929c39ea3913a184 P e28ca864e4c848b59d8b018ac4169c32: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.755543 29499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af14a7828dc4808aa8fdc9c1c758b85" candidate_uuid: "bc0a9840c02a4c279170b1c5fe560370" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e28ca864e4c848b59d8b018ac4169c32" is_pre_election: true
W20260709 13:07:26.758430 29538 leader_election.cc:343] T 2af14a7828dc4808aa8fdc9c1c758b85 P bc0a9840c02a4c279170b1c5fe560370 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1:44833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:26.760154 29693 tablet_bootstrap.cc:492] T d4d2f00fadd04bdd91d3c97ebc76f005 P 5481e9936dfb479fa0dd925db3daff07: No bootstrap required, opened a new log
I20260709 13:07:26.760637 29693 ts_tablet_manager.cc:1403] T d4d2f00fadd04bdd91d3c97ebc76f005 P 5481e9936dfb479fa0dd925db3daff07: Time spent bootstrapping tablet: real 0.092s	user 0.012s	sys 0.004s
W20260709 13:07:26.767285 29538 leader_election.cc:343] T 2af14a7828dc4808aa8fdc9c1c758b85 P bc0a9840c02a4c279170b1c5fe560370 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5481e9936dfb479fa0dd925db3daff07 (127.28.173.3:42061): Not found: Tablet not found: 2af14a7828dc4808aa8fdc9c1c758b85
W20260709 13:07:26.768338 29600 tablet.cc:2406] T 2af14a7828dc4808aa8fdc9c1c758b85 P bc0a9840c02a4c279170b1c5fe560370: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:07:26.768426 29538 leader_election.cc:304] T 2af14a7828dc4808aa8fdc9c1c758b85 P bc0a9840c02a4c279170b1c5fe560370 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc0a9840c02a4c279170b1c5fe560370; no voters: 5481e9936dfb479fa0dd925db3daff07, e28ca864e4c848b59d8b018ac4169c32
I20260709 13:07:26.770272 29692 raft_consensus.cc:2749] T 2af14a7828dc4808aa8fdc9c1c758b85 P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:26.776355 29694 tablet_bootstrap.cc:492] T ca6f74116b244bc0929c39ea3913a184 P e28ca864e4c848b59d8b018ac4169c32: No bootstrap required, opened a new log
I20260709 13:07:26.776819 29694 ts_tablet_manager.cc:1403] T ca6f74116b244bc0929c39ea3913a184 P e28ca864e4c848b59d8b018ac4169c32: Time spent bootstrapping tablet: real 0.079s	user 0.014s	sys 0.015s
I20260709 13:07:26.774354 29693 raft_consensus.cc:359] T d4d2f00fadd04bdd91d3c97ebc76f005 P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:26.777510 29693 raft_consensus.cc:385] T d4d2f00fadd04bdd91d3c97ebc76f005 P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.777937 29693 raft_consensus.cc:740] T d4d2f00fadd04bdd91d3c97ebc76f005 P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5481e9936dfb479fa0dd925db3daff07, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.779135 29693 consensus_queue.cc:260] T d4d2f00fadd04bdd91d3c97ebc76f005 P 5481e9936dfb479fa0dd925db3daff07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:26.781921 29694 raft_consensus.cc:359] T ca6f74116b244bc0929c39ea3913a184 P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:26.782655 29694 raft_consensus.cc:385] T ca6f74116b244bc0929c39ea3913a184 P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.782940 29694 raft_consensus.cc:740] T ca6f74116b244bc0929c39ea3913a184 P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e28ca864e4c848b59d8b018ac4169c32, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.783671 29690 tablet_bootstrap.cc:492] T 4f69e2661ba745b09237e4ce0494087b P bc0a9840c02a4c279170b1c5fe560370: No bootstrap required, opened a new log
I20260709 13:07:26.784467 29690 ts_tablet_manager.cc:1403] T 4f69e2661ba745b09237e4ce0494087b P bc0a9840c02a4c279170b1c5fe560370: Time spent bootstrapping tablet: real 0.245s	user 0.017s	sys 0.019s
I20260709 13:07:26.785699 29673 heartbeater.cc:499] Master 127.28.173.62:35903 was elected leader, sending a full tablet report...
I20260709 13:07:26.786058 29693 ts_tablet_manager.cc:1434] T d4d2f00fadd04bdd91d3c97ebc76f005 P 5481e9936dfb479fa0dd925db3daff07: Time spent starting tablet: real 0.025s	user 0.012s	sys 0.000s
I20260709 13:07:26.786943 29693 tablet_bootstrap.cc:492] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07: Bootstrap starting.
I20260709 13:07:26.783769 29694 consensus_queue.cc:260] T ca6f74116b244bc0929c39ea3913a184 P e28ca864e4c848b59d8b018ac4169c32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:26.793581 29693 tablet_bootstrap.cc:654] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.793402 29690 raft_consensus.cc:359] T 4f69e2661ba745b09237e4ce0494087b P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:26.794157 29690 raft_consensus.cc:385] T 4f69e2661ba745b09237e4ce0494087b P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.794489 29690 raft_consensus.cc:740] T 4f69e2661ba745b09237e4ce0494087b P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc0a9840c02a4c279170b1c5fe560370, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.795275 29690 consensus_queue.cc:260] T 4f69e2661ba745b09237e4ce0494087b P bc0a9840c02a4c279170b1c5fe560370 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:26.799445 29690 ts_tablet_manager.cc:1434] T 4f69e2661ba745b09237e4ce0494087b P bc0a9840c02a4c279170b1c5fe560370: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:07:26.800835 29690 tablet_bootstrap.cc:492] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370: Bootstrap starting.
I20260709 13:07:26.806017 29693 tablet_bootstrap.cc:492] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07: No bootstrap required, opened a new log
I20260709 13:07:26.806165 29524 heartbeater.cc:499] Master 127.28.173.62:35903 was elected leader, sending a full tablet report...
I20260709 13:07:26.806474 29693 ts_tablet_manager.cc:1403] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.003s
I20260709 13:07:26.807183 29694 ts_tablet_manager.cc:1434] T ca6f74116b244bc0929c39ea3913a184 P e28ca864e4c848b59d8b018ac4169c32: Time spent starting tablet: real 0.030s	user 0.000s	sys 0.010s
I20260709 13:07:26.808610 29694 tablet_bootstrap.cc:492] T dbc21554b6344107baedcec570f26b37 P e28ca864e4c848b59d8b018ac4169c32: Bootstrap starting.
I20260709 13:07:26.820220 29690 tablet_bootstrap.cc:654] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.819942 29693 raft_consensus.cc:359] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:26.821802 29693 raft_consensus.cc:385] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.821362 29694 tablet_bootstrap.cc:654] T dbc21554b6344107baedcec570f26b37 P e28ca864e4c848b59d8b018ac4169c32: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.823169 29701 raft_consensus.cc:493] T ca6f74116b244bc0929c39ea3913a184 P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.823666 29701 raft_consensus.cc:515] T ca6f74116b244bc0929c39ea3913a184 P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:26.822129 29693 raft_consensus.cc:740] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5481e9936dfb479fa0dd925db3daff07, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.825740 29693 consensus_queue.cc:260] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:26.826576 29701 leader_election.cc:290] T ca6f74116b244bc0929c39ea3913a184 P e28ca864e4c848b59d8b018ac4169c32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2:40589), 5481e9936dfb479fa0dd925db3daff07 (127.28.173.3:42061)
I20260709 13:07:26.828135 29693 ts_tablet_manager.cc:1434] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.004s
I20260709 13:07:26.829088 29693 tablet_bootstrap.cc:492] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07: Bootstrap starting.
I20260709 13:07:26.835521 29693 tablet_bootstrap.cc:654] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.851074 29694 tablet_bootstrap.cc:492] T dbc21554b6344107baedcec570f26b37 P e28ca864e4c848b59d8b018ac4169c32: No bootstrap required, opened a new log
I20260709 13:07:26.851603 29694 ts_tablet_manager.cc:1403] T dbc21554b6344107baedcec570f26b37 P e28ca864e4c848b59d8b018ac4169c32: Time spent bootstrapping tablet: real 0.043s	user 0.004s	sys 0.017s
I20260709 13:07:26.852795 29690 tablet_bootstrap.cc:492] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370: No bootstrap required, opened a new log
I20260709 13:07:26.853304 29690 ts_tablet_manager.cc:1403] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370: Time spent bootstrapping tablet: real 0.053s	user 0.017s	sys 0.000s
I20260709 13:07:26.854487 29694 raft_consensus.cc:359] T dbc21554b6344107baedcec570f26b37 P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:26.855237 29694 raft_consensus.cc:385] T dbc21554b6344107baedcec570f26b37 P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.855552 29694 raft_consensus.cc:740] T dbc21554b6344107baedcec570f26b37 P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e28ca864e4c848b59d8b018ac4169c32, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.855266 29574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6f74116b244bc0929c39ea3913a184" candidate_uuid: "e28ca864e4c848b59d8b018ac4169c32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc0a9840c02a4c279170b1c5fe560370" is_pre_election: true
I20260709 13:07:26.856251 29694 consensus_queue.cc:260] T dbc21554b6344107baedcec570f26b37 P e28ca864e4c848b59d8b018ac4169c32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
W20260709 13:07:26.857117 29463 leader_election.cc:343] T ca6f74116b244bc0929c39ea3913a184 P e28ca864e4c848b59d8b018ac4169c32 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2:40589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:26.858359 29694 ts_tablet_manager.cc:1434] T dbc21554b6344107baedcec570f26b37 P e28ca864e4c848b59d8b018ac4169c32: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:07:26.859278 29694 tablet_bootstrap.cc:492] T 2af14a7828dc4808aa8fdc9c1c758b85 P e28ca864e4c848b59d8b018ac4169c32: Bootstrap starting.
I20260709 13:07:26.864723 29694 tablet_bootstrap.cc:654] T 2af14a7828dc4808aa8fdc9c1c758b85 P e28ca864e4c848b59d8b018ac4169c32: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.864647 29690 raft_consensus.cc:359] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:26.867834 29693 tablet_bootstrap.cc:492] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07: No bootstrap required, opened a new log
I20260709 13:07:26.868561 29693 ts_tablet_manager.cc:1403] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07: Time spent bootstrapping tablet: real 0.040s	user 0.005s	sys 0.010s
I20260709 13:07:26.872522 29693 raft_consensus.cc:359] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:26.865391 29690 raft_consensus.cc:385] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.873550 29693 raft_consensus.cc:385] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.874257 29693 raft_consensus.cc:740] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5481e9936dfb479fa0dd925db3daff07, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.873646 29690 raft_consensus.cc:740] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc0a9840c02a4c279170b1c5fe560370, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.875489 29693 consensus_queue.cc:260] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:26.876293 29690 consensus_queue.cc:260] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:26.880168 29648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6f74116b244bc0929c39ea3913a184" candidate_uuid: "e28ca864e4c848b59d8b018ac4169c32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5481e9936dfb479fa0dd925db3daff07" is_pre_election: true
I20260709 13:07:26.880910 29693 ts_tablet_manager.cc:1434] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
W20260709 13:07:26.881632 29463 leader_election.cc:343] T ca6f74116b244bc0929c39ea3913a184 P e28ca864e4c848b59d8b018ac4169c32 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5481e9936dfb479fa0dd925db3daff07 (127.28.173.3:42061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:26.881909 29693 tablet_bootstrap.cc:492] T 4f69e2661ba745b09237e4ce0494087b P 5481e9936dfb479fa0dd925db3daff07: Bootstrap starting.
I20260709 13:07:26.882083 29463 leader_election.cc:304] T ca6f74116b244bc0929c39ea3913a184 P e28ca864e4c848b59d8b018ac4169c32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28ca864e4c848b59d8b018ac4169c32; no voters: 5481e9936dfb479fa0dd925db3daff07, bc0a9840c02a4c279170b1c5fe560370
I20260709 13:07:26.882905 29701 raft_consensus.cc:2749] T ca6f74116b244bc0929c39ea3913a184 P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:26.891567 29693 tablet_bootstrap.cc:654] T 4f69e2661ba745b09237e4ce0494087b P 5481e9936dfb479fa0dd925db3daff07: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.897408 29690 ts_tablet_manager.cc:1434] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370: Time spent starting tablet: real 0.042s	user 0.001s	sys 0.005s
I20260709 13:07:26.904348 29690 tablet_bootstrap.cc:492] T d4d2f00fadd04bdd91d3c97ebc76f005 P bc0a9840c02a4c279170b1c5fe560370: Bootstrap starting.
I20260709 13:07:26.905277 29693 tablet_bootstrap.cc:492] T 4f69e2661ba745b09237e4ce0494087b P 5481e9936dfb479fa0dd925db3daff07: No bootstrap required, opened a new log
I20260709 13:07:26.905947 29693 ts_tablet_manager.cc:1403] T 4f69e2661ba745b09237e4ce0494087b P 5481e9936dfb479fa0dd925db3daff07: Time spent bootstrapping tablet: real 0.024s	user 0.019s	sys 0.003s
I20260709 13:07:26.910013 29693 raft_consensus.cc:359] T 4f69e2661ba745b09237e4ce0494087b P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:26.911077 29693 raft_consensus.cc:385] T 4f69e2661ba745b09237e4ce0494087b P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.911567 29693 raft_consensus.cc:740] T 4f69e2661ba745b09237e4ce0494087b P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5481e9936dfb479fa0dd925db3daff07, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.912606 29693 consensus_queue.cc:260] T 4f69e2661ba745b09237e4ce0494087b P 5481e9936dfb479fa0dd925db3daff07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:26.913542 29690 tablet_bootstrap.cc:654] T d4d2f00fadd04bdd91d3c97ebc76f005 P bc0a9840c02a4c279170b1c5fe560370: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.915630 29693 ts_tablet_manager.cc:1434] T 4f69e2661ba745b09237e4ce0494087b P 5481e9936dfb479fa0dd925db3daff07: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:07:26.917080 29693 tablet_bootstrap.cc:492] T 2ef4ec98706b46e2a2ff852dca7ee48e P 5481e9936dfb479fa0dd925db3daff07: Bootstrap starting.
I20260709 13:07:26.925796 29693 tablet_bootstrap.cc:654] T 2ef4ec98706b46e2a2ff852dca7ee48e P 5481e9936dfb479fa0dd925db3daff07: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.929168 29694 tablet_bootstrap.cc:492] T 2af14a7828dc4808aa8fdc9c1c758b85 P e28ca864e4c848b59d8b018ac4169c32: No bootstrap required, opened a new log
I20260709 13:07:26.929764 29694 ts_tablet_manager.cc:1403] T 2af14a7828dc4808aa8fdc9c1c758b85 P e28ca864e4c848b59d8b018ac4169c32: Time spent bootstrapping tablet: real 0.071s	user 0.029s	sys 0.034s
I20260709 13:07:26.932751 29692 raft_consensus.cc:493] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.933233 29692 raft_consensus.cc:515] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:26.933511 29694 raft_consensus.cc:359] T 2af14a7828dc4808aa8fdc9c1c758b85 P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } } peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } }
I20260709 13:07:26.934476 29694 raft_consensus.cc:385] T 2af14a7828dc4808aa8fdc9c1c758b85 P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.934854 29694 raft_consensus.cc:740] T 2af14a7828dc4808aa8fdc9c1c758b85 P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e28ca864e4c848b59d8b018ac4169c32, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.935168 29692 leader_election.cc:290] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1:44833), 5481e9936dfb479fa0dd925db3daff07 (127.28.173.3:42061)
I20260709 13:07:26.935977 29694 consensus_queue.cc:260] T 2af14a7828dc4808aa8fdc9c1c758b85 P e28ca864e4c848b59d8b018ac4169c32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } } peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } }
I20260709 13:07:26.937445 29499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6f74116b244bc0929c39ea3913a184" candidate_uuid: "bc0a9840c02a4c279170b1c5fe560370" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e28ca864e4c848b59d8b018ac4169c32" is_pre_election: true
I20260709 13:07:26.938012 29700 raft_consensus.cc:493] T 4f69e2661ba745b09237e4ce0494087b P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.938886 29648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6f74116b244bc0929c39ea3913a184" candidate_uuid: "bc0a9840c02a4c279170b1c5fe560370" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5481e9936dfb479fa0dd925db3daff07" is_pre_election: true
I20260709 13:07:26.938783 29700 raft_consensus.cc:515] T 4f69e2661ba745b09237e4ce0494087b P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:26.942399 29700 leader_election.cc:290] T 4f69e2661ba745b09237e4ce0494087b P 5481e9936dfb479fa0dd925db3daff07 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1:44833), bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2:40589)
I20260709 13:07:26.943964 29694 ts_tablet_manager.cc:1434] T 2af14a7828dc4808aa8fdc9c1c758b85 P e28ca864e4c848b59d8b018ac4169c32: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:07:26.944900 29694 tablet_bootstrap.cc:492] T 2ef4ec98706b46e2a2ff852dca7ee48e P e28ca864e4c848b59d8b018ac4169c32: Bootstrap starting.
W20260709 13:07:26.945580 29538 leader_election.cc:343] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5481e9936dfb479fa0dd925db3daff07 (127.28.173.3:42061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:26.938097 29499 raft_consensus.cc:2468] T ca6f74116b244bc0929c39ea3913a184 P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc0a9840c02a4c279170b1c5fe560370 in term 0.
I20260709 13:07:26.947214 29538 leader_election.cc:304] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc0a9840c02a4c279170b1c5fe560370, e28ca864e4c848b59d8b018ac4169c32; no voters: 5481e9936dfb479fa0dd925db3daff07
I20260709 13:07:26.953634 29692 raft_consensus.cc:2804] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:26.953972 29692 raft_consensus.cc:493] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.954319 29694 tablet_bootstrap.cc:654] T 2ef4ec98706b46e2a2ff852dca7ee48e P e28ca864e4c848b59d8b018ac4169c32: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.954296 29692 raft_consensus.cc:3060] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:26.955133 29693 tablet_bootstrap.cc:492] T 2ef4ec98706b46e2a2ff852dca7ee48e P 5481e9936dfb479fa0dd925db3daff07: No bootstrap required, opened a new log
I20260709 13:07:26.956171 29693 ts_tablet_manager.cc:1403] T 2ef4ec98706b46e2a2ff852dca7ee48e P 5481e9936dfb479fa0dd925db3daff07: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.015s
I20260709 13:07:26.960817 29690 tablet_bootstrap.cc:492] T d4d2f00fadd04bdd91d3c97ebc76f005 P bc0a9840c02a4c279170b1c5fe560370: No bootstrap required, opened a new log
I20260709 13:07:26.961251 29690 ts_tablet_manager.cc:1403] T d4d2f00fadd04bdd91d3c97ebc76f005 P bc0a9840c02a4c279170b1c5fe560370: Time spent bootstrapping tablet: real 0.057s	user 0.006s	sys 0.011s
I20260709 13:07:26.961661 29692 raft_consensus.cc:515] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:26.964286 29499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6f74116b244bc0929c39ea3913a184" candidate_uuid: "bc0a9840c02a4c279170b1c5fe560370" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e28ca864e4c848b59d8b018ac4169c32"
I20260709 13:07:26.964826 29499 raft_consensus.cc:3060] T ca6f74116b244bc0929c39ea3913a184 P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:26.969367 29690 raft_consensus.cc:359] T d4d2f00fadd04bdd91d3c97ebc76f005 P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:26.970206 29690 raft_consensus.cc:385] T d4d2f00fadd04bdd91d3c97ebc76f005 P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.970468 29690 raft_consensus.cc:740] T d4d2f00fadd04bdd91d3c97ebc76f005 P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc0a9840c02a4c279170b1c5fe560370, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.971138 29690 consensus_queue.cc:260] T d4d2f00fadd04bdd91d3c97ebc76f005 P bc0a9840c02a4c279170b1c5fe560370 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:26.959739 29693 raft_consensus.cc:359] T 2ef4ec98706b46e2a2ff852dca7ee48e P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:26.972625 29693 raft_consensus.cc:385] T 2ef4ec98706b46e2a2ff852dca7ee48e P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.972891 29693 raft_consensus.cc:740] T 2ef4ec98706b46e2a2ff852dca7ee48e P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5481e9936dfb479fa0dd925db3daff07, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.973598 29693 consensus_queue.cc:260] T 2ef4ec98706b46e2a2ff852dca7ee48e P 5481e9936dfb479fa0dd925db3daff07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:26.974584 29499 raft_consensus.cc:2468] T ca6f74116b244bc0929c39ea3913a184 P e28ca864e4c848b59d8b018ac4169c32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc0a9840c02a4c279170b1c5fe560370 in term 1.
I20260709 13:07:26.975886 29538 leader_election.cc:304] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc0a9840c02a4c279170b1c5fe560370, e28ca864e4c848b59d8b018ac4169c32; no voters: 
I20260709 13:07:26.983331 29693 ts_tablet_manager.cc:1434] T 2ef4ec98706b46e2a2ff852dca7ee48e P 5481e9936dfb479fa0dd925db3daff07: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 13:07:26.995261 29693 tablet_bootstrap.cc:492] T e01ba93272b5460a8e453d93659b85ae P 5481e9936dfb479fa0dd925db3daff07: Bootstrap starting.
I20260709 13:07:27.001444 29690 ts_tablet_manager.cc:1434] T d4d2f00fadd04bdd91d3c97ebc76f005 P bc0a9840c02a4c279170b1c5fe560370: Time spent starting tablet: real 0.040s	user 0.009s	sys 0.001s
I20260709 13:07:26.977766 29692 leader_election.cc:290] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [CANDIDATE]: Term 1 election: Requested vote from peers e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1:44833), 5481e9936dfb479fa0dd925db3daff07 (127.28.173.3:42061)
I20260709 13:07:27.002358 29694 tablet_bootstrap.cc:492] T 2ef4ec98706b46e2a2ff852dca7ee48e P e28ca864e4c848b59d8b018ac4169c32: No bootstrap required, opened a new log
I20260709 13:07:27.002707 29690 tablet_bootstrap.cc:492] T dbc21554b6344107baedcec570f26b37 P bc0a9840c02a4c279170b1c5fe560370: Bootstrap starting.
I20260709 13:07:27.002800 29694 ts_tablet_manager.cc:1403] T 2ef4ec98706b46e2a2ff852dca7ee48e P e28ca864e4c848b59d8b018ac4169c32: Time spent bootstrapping tablet: real 0.058s	user 0.021s	sys 0.022s
I20260709 13:07:27.001530 29693 tablet_bootstrap.cc:654] T e01ba93272b5460a8e453d93659b85ae P 5481e9936dfb479fa0dd925db3daff07: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.005793 29694 raft_consensus.cc:359] T 2ef4ec98706b46e2a2ff852dca7ee48e P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.006522 29694 raft_consensus.cc:385] T 2ef4ec98706b46e2a2ff852dca7ee48e P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.006809 29694 raft_consensus.cc:740] T 2ef4ec98706b46e2a2ff852dca7ee48e P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e28ca864e4c848b59d8b018ac4169c32, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.007524 29694 consensus_queue.cc:260] T 2ef4ec98706b46e2a2ff852dca7ee48e P e28ca864e4c848b59d8b018ac4169c32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.013480 29648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6f74116b244bc0929c39ea3913a184" candidate_uuid: "bc0a9840c02a4c279170b1c5fe560370" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5481e9936dfb479fa0dd925db3daff07"
I20260709 13:07:27.014048 29574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f69e2661ba745b09237e4ce0494087b" candidate_uuid: "5481e9936dfb479fa0dd925db3daff07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc0a9840c02a4c279170b1c5fe560370" is_pre_election: true
I20260709 13:07:27.014289 29690 tablet_bootstrap.cc:654] T dbc21554b6344107baedcec570f26b37 P bc0a9840c02a4c279170b1c5fe560370: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.014688 29574 raft_consensus.cc:2468] T 4f69e2661ba745b09237e4ce0494087b P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5481e9936dfb479fa0dd925db3daff07 in term 0.
W20260709 13:07:27.015865 29538 leader_election.cc:343] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5481e9936dfb479fa0dd925db3daff07 (127.28.173.3:42061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:26.988722 29715 raft_consensus.cc:2804] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:27.017055 29612 leader_election.cc:304] T 4f69e2661ba745b09237e4ce0494087b P 5481e9936dfb479fa0dd925db3daff07 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5481e9936dfb479fa0dd925db3daff07, bc0a9840c02a4c279170b1c5fe560370; no voters: 
I20260709 13:07:27.017874 29715 raft_consensus.cc:697] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [term 1 LEADER]: Becoming Leader. State: Replica: bc0a9840c02a4c279170b1c5fe560370, State: Running, Role: LEADER
I20260709 13:07:27.018675 29700 raft_consensus.cc:2804] T 4f69e2661ba745b09237e4ce0494087b P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:27.019064 29700 raft_consensus.cc:493] T 4f69e2661ba745b09237e4ce0494087b P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.019431 29700 raft_consensus.cc:3060] T 4f69e2661ba745b09237e4ce0494087b P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.021278 29694 ts_tablet_manager.cc:1434] T 2ef4ec98706b46e2a2ff852dca7ee48e P e28ca864e4c848b59d8b018ac4169c32: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.001s
I20260709 13:07:27.022348 29694 tablet_bootstrap.cc:492] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32: Bootstrap starting.
I20260709 13:07:27.030025 29499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f69e2661ba745b09237e4ce0494087b" candidate_uuid: "5481e9936dfb479fa0dd925db3daff07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e28ca864e4c848b59d8b018ac4169c32" is_pre_election: true
I20260709 13:07:27.019433 29715 consensus_queue.cc:237] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.029907 29700 raft_consensus.cc:515] T 4f69e2661ba745b09237e4ce0494087b P 5481e9936dfb479fa0dd925db3daff07 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.034124 29701 raft_consensus.cc:493] T 2af14a7828dc4808aa8fdc9c1c758b85 P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.034708 29701 raft_consensus.cc:515] T 2af14a7828dc4808aa8fdc9c1c758b85 P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } } peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } }
W20260709 13:07:27.047672 29612 leader_election.cc:343] T 4f69e2661ba745b09237e4ce0494087b P 5481e9936dfb479fa0dd925db3daff07 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1:44833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:27.051545 29701 leader_election.cc:290] T 2af14a7828dc4808aa8fdc9c1c758b85 P e28ca864e4c848b59d8b018ac4169c32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2:40589), 5481e9936dfb479fa0dd925db3daff07 (127.28.173.3:42061)
I20260709 13:07:27.053176 29694 tablet_bootstrap.cc:654] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.054118 29499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f69e2661ba745b09237e4ce0494087b" candidate_uuid: "5481e9936dfb479fa0dd925db3daff07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e28ca864e4c848b59d8b018ac4169c32"
I20260709 13:07:27.056279 29573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f69e2661ba745b09237e4ce0494087b" candidate_uuid: "5481e9936dfb479fa0dd925db3daff07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc0a9840c02a4c279170b1c5fe560370"
I20260709 13:07:27.057125 29573 raft_consensus.cc:3060] T 4f69e2661ba745b09237e4ce0494087b P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.048228 29700 leader_election.cc:290] T 4f69e2661ba745b09237e4ce0494087b P 5481e9936dfb479fa0dd925db3daff07 [CANDIDATE]: Term 1 election: Requested vote from peers e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1:44833), bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2:40589)
I20260709 13:07:27.048920 29574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af14a7828dc4808aa8fdc9c1c758b85" candidate_uuid: "e28ca864e4c848b59d8b018ac4169c32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc0a9840c02a4c279170b1c5fe560370" is_pre_election: true
I20260709 13:07:27.050973 29693 tablet_bootstrap.cc:492] T e01ba93272b5460a8e453d93659b85ae P 5481e9936dfb479fa0dd925db3daff07: No bootstrap required, opened a new log
I20260709 13:07:27.060699 29574 raft_consensus.cc:2468] T 2af14a7828dc4808aa8fdc9c1c758b85 P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28ca864e4c848b59d8b018ac4169c32 in term 0.
I20260709 13:07:27.060797 29693 ts_tablet_manager.cc:1403] T e01ba93272b5460a8e453d93659b85ae P 5481e9936dfb479fa0dd925db3daff07: Time spent bootstrapping tablet: real 0.066s	user 0.016s	sys 0.005s
I20260709 13:07:27.051117 29648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af14a7828dc4808aa8fdc9c1c758b85" candidate_uuid: "e28ca864e4c848b59d8b018ac4169c32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5481e9936dfb479fa0dd925db3daff07" is_pre_election: true
W20260709 13:07:27.062719 29463 leader_election.cc:343] T 2af14a7828dc4808aa8fdc9c1c758b85 P e28ca864e4c848b59d8b018ac4169c32 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5481e9936dfb479fa0dd925db3daff07 (127.28.173.3:42061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:27.063391 29463 leader_election.cc:304] T 2af14a7828dc4808aa8fdc9c1c758b85 P e28ca864e4c848b59d8b018ac4169c32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc0a9840c02a4c279170b1c5fe560370, e28ca864e4c848b59d8b018ac4169c32; no voters: 5481e9936dfb479fa0dd925db3daff07
I20260709 13:07:27.064451 29701 raft_consensus.cc:2804] T 2af14a7828dc4808aa8fdc9c1c758b85 P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:27.064265 29693 raft_consensus.cc:359] T e01ba93272b5460a8e453d93659b85ae P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.064822 29701 raft_consensus.cc:493] T 2af14a7828dc4808aa8fdc9c1c758b85 P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.065171 29693 raft_consensus.cc:385] T e01ba93272b5460a8e453d93659b85ae P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.065198 29701 raft_consensus.cc:3060] T 2af14a7828dc4808aa8fdc9c1c758b85 P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.065696 29693 raft_consensus.cc:740] T e01ba93272b5460a8e453d93659b85ae P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5481e9936dfb479fa0dd925db3daff07, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.066344 29573 raft_consensus.cc:2468] T 4f69e2661ba745b09237e4ce0494087b P bc0a9840c02a4c279170b1c5fe560370 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5481e9936dfb479fa0dd925db3daff07 in term 1.
I20260709 13:07:27.066408 29694 tablet_bootstrap.cc:492] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32: No bootstrap required, opened a new log
I20260709 13:07:27.067121 29694 ts_tablet_manager.cc:1403] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32: Time spent bootstrapping tablet: real 0.045s	user 0.006s	sys 0.016s
I20260709 13:07:27.066540 29693 consensus_queue.cc:260] T e01ba93272b5460a8e453d93659b85ae P 5481e9936dfb479fa0dd925db3daff07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.067677 29612 leader_election.cc:304] T 4f69e2661ba745b09237e4ce0494087b P 5481e9936dfb479fa0dd925db3daff07 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5481e9936dfb479fa0dd925db3daff07, bc0a9840c02a4c279170b1c5fe560370; no voters: 
I20260709 13:07:27.068663 29700 raft_consensus.cc:2804] T 4f69e2661ba745b09237e4ce0494087b P 5481e9936dfb479fa0dd925db3daff07 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:27.070749 29694 raft_consensus.cc:359] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.071502 29694 raft_consensus.cc:385] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.071799 29694 raft_consensus.cc:740] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e28ca864e4c848b59d8b018ac4169c32, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.072539 29694 consensus_queue.cc:260] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
W20260709 13:07:27.068785 29612 leader_election.cc:343] T 4f69e2661ba745b09237e4ce0494087b P 5481e9936dfb479fa0dd925db3daff07 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1:44833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:27.070645 29690 tablet_bootstrap.cc:492] T dbc21554b6344107baedcec570f26b37 P bc0a9840c02a4c279170b1c5fe560370: No bootstrap required, opened a new log
I20260709 13:07:27.075183 29690 ts_tablet_manager.cc:1403] T dbc21554b6344107baedcec570f26b37 P bc0a9840c02a4c279170b1c5fe560370: Time spent bootstrapping tablet: real 0.073s	user 0.012s	sys 0.004s
I20260709 13:07:27.075117 29701 raft_consensus.cc:515] T 2af14a7828dc4808aa8fdc9c1c758b85 P e28ca864e4c848b59d8b018ac4169c32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } } peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } }
I20260709 13:07:27.077299 29694 ts_tablet_manager.cc:1434] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.002s
I20260709 13:07:27.078182 29690 raft_consensus.cc:359] T dbc21554b6344107baedcec570f26b37 P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.081916 29690 raft_consensus.cc:385] T dbc21554b6344107baedcec570f26b37 P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.082288 29690 raft_consensus.cc:740] T dbc21554b6344107baedcec570f26b37 P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc0a9840c02a4c279170b1c5fe560370, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.082473 29694 tablet_bootstrap.cc:492] T d4d2f00fadd04bdd91d3c97ebc76f005 P e28ca864e4c848b59d8b018ac4169c32: Bootstrap starting.
I20260709 13:07:27.079367 29693 ts_tablet_manager.cc:1434] T e01ba93272b5460a8e453d93659b85ae P 5481e9936dfb479fa0dd925db3daff07: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.005s
I20260709 13:07:27.083838 29693 tablet_bootstrap.cc:492] T 8d25bbcb97f44813aa8241e230434f74 P 5481e9936dfb479fa0dd925db3daff07: Bootstrap starting.
I20260709 13:07:27.084239 29573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af14a7828dc4808aa8fdc9c1c758b85" candidate_uuid: "e28ca864e4c848b59d8b018ac4169c32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc0a9840c02a4c279170b1c5fe560370"
I20260709 13:07:27.085044 29648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af14a7828dc4808aa8fdc9c1c758b85" candidate_uuid: "e28ca864e4c848b59d8b018ac4169c32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5481e9936dfb479fa0dd925db3daff07"
I20260709 13:07:27.085552 29701 leader_election.cc:290] T 2af14a7828dc4808aa8fdc9c1c758b85 P e28ca864e4c848b59d8b018ac4169c32 [CANDIDATE]: Term 1 election: Requested vote from peers bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2:40589), 5481e9936dfb479fa0dd925db3daff07 (127.28.173.3:42061)
I20260709 13:07:27.084303 29690 consensus_queue.cc:260] T dbc21554b6344107baedcec570f26b37 P bc0a9840c02a4c279170b1c5fe560370 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
W20260709 13:07:27.089696 29463 leader_election.cc:343] T 2af14a7828dc4808aa8fdc9c1c758b85 P e28ca864e4c848b59d8b018ac4169c32 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5481e9936dfb479fa0dd925db3daff07 (127.28.173.3:42061): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:27.090728 29573 raft_consensus.cc:3060] T 2af14a7828dc4808aa8fdc9c1c758b85 P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.091459 29690 ts_tablet_manager.cc:1434] T dbc21554b6344107baedcec570f26b37 P bc0a9840c02a4c279170b1c5fe560370: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.002s
I20260709 13:07:27.095769 29694 tablet_bootstrap.cc:654] T d4d2f00fadd04bdd91d3c97ebc76f005 P e28ca864e4c848b59d8b018ac4169c32: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.096768 29690 tablet_bootstrap.cc:492] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370: Bootstrap starting.
I20260709 13:07:27.097234 29700 raft_consensus.cc:697] T 4f69e2661ba745b09237e4ce0494087b P 5481e9936dfb479fa0dd925db3daff07 [term 1 LEADER]: Becoming Leader. State: Replica: 5481e9936dfb479fa0dd925db3daff07, State: Running, Role: LEADER
I20260709 13:07:27.102746 29700 consensus_queue.cc:237] T 4f69e2661ba745b09237e4ce0494087b P 5481e9936dfb479fa0dd925db3daff07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.103292 29573 raft_consensus.cc:2468] T 2af14a7828dc4808aa8fdc9c1c758b85 P bc0a9840c02a4c279170b1c5fe560370 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28ca864e4c848b59d8b018ac4169c32 in term 1.
I20260709 13:07:27.090392 29723 raft_consensus.cc:493] T 2ef4ec98706b46e2a2ff852dca7ee48e P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.105105 29463 leader_election.cc:304] T 2af14a7828dc4808aa8fdc9c1c758b85 P e28ca864e4c848b59d8b018ac4169c32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc0a9840c02a4c279170b1c5fe560370, e28ca864e4c848b59d8b018ac4169c32; no voters: 5481e9936dfb479fa0dd925db3daff07
I20260709 13:07:27.104120 29723 raft_consensus.cc:515] T 2ef4ec98706b46e2a2ff852dca7ee48e P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.106441 29701 raft_consensus.cc:2804] T 2af14a7828dc4808aa8fdc9c1c758b85 P e28ca864e4c848b59d8b018ac4169c32 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:27.107405 29701 raft_consensus.cc:697] T 2af14a7828dc4808aa8fdc9c1c758b85 P e28ca864e4c848b59d8b018ac4169c32 [term 1 LEADER]: Becoming Leader. State: Replica: e28ca864e4c848b59d8b018ac4169c32, State: Running, Role: LEADER
I20260709 13:07:27.108395 29701 consensus_queue.cc:237] T 2af14a7828dc4808aa8fdc9c1c758b85 P e28ca864e4c848b59d8b018ac4169c32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } } peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } }
I20260709 13:07:27.109104 29723 leader_election.cc:290] T 2ef4ec98706b46e2a2ff852dca7ee48e P 5481e9936dfb479fa0dd925db3daff07 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1:44833), bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2:40589)
I20260709 13:07:27.109789 29499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef4ec98706b46e2a2ff852dca7ee48e" candidate_uuid: "5481e9936dfb479fa0dd925db3daff07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e28ca864e4c848b59d8b018ac4169c32" is_pre_election: true
I20260709 13:07:27.110613 29499 raft_consensus.cc:2468] T 2ef4ec98706b46e2a2ff852dca7ee48e P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5481e9936dfb479fa0dd925db3daff07 in term 0.
I20260709 13:07:27.104631 29394 catalog_manager.cc:5697] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2). New cstate: current_term: 1 leader_uuid: "bc0a9840c02a4c279170b1c5fe560370" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:27.112331 29612 leader_election.cc:304] T 2ef4ec98706b46e2a2ff852dca7ee48e P 5481e9936dfb479fa0dd925db3daff07 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5481e9936dfb479fa0dd925db3daff07, e28ca864e4c848b59d8b018ac4169c32; no voters: 
I20260709 13:07:27.113404 29723 raft_consensus.cc:2804] T 2ef4ec98706b46e2a2ff852dca7ee48e P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:27.113909 29723 raft_consensus.cc:493] T 2ef4ec98706b46e2a2ff852dca7ee48e P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.114351 29721 raft_consensus.cc:493] T d4d2f00fadd04bdd91d3c97ebc76f005 P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.114567 29723 raft_consensus.cc:3060] T 2ef4ec98706b46e2a2ff852dca7ee48e P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.111924 29573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef4ec98706b46e2a2ff852dca7ee48e" candidate_uuid: "5481e9936dfb479fa0dd925db3daff07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc0a9840c02a4c279170b1c5fe560370" is_pre_election: true
I20260709 13:07:27.114830 29721 raft_consensus.cc:515] T d4d2f00fadd04bdd91d3c97ebc76f005 P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
W20260709 13:07:27.117797 29612 leader_election.cc:343] T 2ef4ec98706b46e2a2ff852dca7ee48e P 5481e9936dfb479fa0dd925db3daff07 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2:40589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:27.125723 29715 raft_consensus.cc:493] T d4d2f00fadd04bdd91d3c97ebc76f005 P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.126912 29715 raft_consensus.cc:515] T d4d2f00fadd04bdd91d3c97ebc76f005 P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.128253 29723 raft_consensus.cc:515] T 2ef4ec98706b46e2a2ff852dca7ee48e P 5481e9936dfb479fa0dd925db3daff07 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.129799 29715 leader_election.cc:290] T d4d2f00fadd04bdd91d3c97ebc76f005 P bc0a9840c02a4c279170b1c5fe560370 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1:44833), 5481e9936dfb479fa0dd925db3daff07 (127.28.173.3:42061)
I20260709 13:07:27.125540 29690 tablet_bootstrap.cc:654] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.130522 29395 catalog_manager.cc:5697] T 4f69e2661ba745b09237e4ce0494087b P 5481e9936dfb479fa0dd925db3daff07 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5481e9936dfb479fa0dd925db3daff07 (127.28.173.3). New cstate: current_term: 1 leader_uuid: "5481e9936dfb479fa0dd925db3daff07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:27.131745 29648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d2f00fadd04bdd91d3c97ebc76f005" candidate_uuid: "bc0a9840c02a4c279170b1c5fe560370" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5481e9936dfb479fa0dd925db3daff07" is_pre_election: true
I20260709 13:07:27.132488 29648 raft_consensus.cc:2468] T d4d2f00fadd04bdd91d3c97ebc76f005 P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc0a9840c02a4c279170b1c5fe560370 in term 0.
I20260709 13:07:27.133298 29499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d2f00fadd04bdd91d3c97ebc76f005" candidate_uuid: "bc0a9840c02a4c279170b1c5fe560370" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e28ca864e4c848b59d8b018ac4169c32" is_pre_election: true
I20260709 13:07:27.133541 29721 leader_election.cc:290] T d4d2f00fadd04bdd91d3c97ebc76f005 P 5481e9936dfb479fa0dd925db3daff07 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1:44833), bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2:40589)
I20260709 13:07:27.132591 29693 tablet_bootstrap.cc:654] T 8d25bbcb97f44813aa8241e230434f74 P 5481e9936dfb479fa0dd925db3daff07: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.134583 29573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d2f00fadd04bdd91d3c97ebc76f005" candidate_uuid: "5481e9936dfb479fa0dd925db3daff07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc0a9840c02a4c279170b1c5fe560370" is_pre_election: true
W20260709 13:07:27.134864 29538 leader_election.cc:343] T d4d2f00fadd04bdd91d3c97ebc76f005 P bc0a9840c02a4c279170b1c5fe560370 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1:44833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:27.135350 29573 raft_consensus.cc:2468] T d4d2f00fadd04bdd91d3c97ebc76f005 P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5481e9936dfb479fa0dd925db3daff07 in term 0.
I20260709 13:07:27.135519 29499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d2f00fadd04bdd91d3c97ebc76f005" candidate_uuid: "5481e9936dfb479fa0dd925db3daff07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e28ca864e4c848b59d8b018ac4169c32" is_pre_election: true
I20260709 13:07:27.135842 29538 leader_election.cc:304] T d4d2f00fadd04bdd91d3c97ebc76f005 P bc0a9840c02a4c279170b1c5fe560370 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5481e9936dfb479fa0dd925db3daff07, bc0a9840c02a4c279170b1c5fe560370; no voters: e28ca864e4c848b59d8b018ac4169c32
I20260709 13:07:27.137217 29715 raft_consensus.cc:2804] T d4d2f00fadd04bdd91d3c97ebc76f005 P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:27.140043 29715 raft_consensus.cc:493] T d4d2f00fadd04bdd91d3c97ebc76f005 P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.141598 29715 raft_consensus.cc:3060] T d4d2f00fadd04bdd91d3c97ebc76f005 P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:27.140406 29612 leader_election.cc:343] T d4d2f00fadd04bdd91d3c97ebc76f005 P 5481e9936dfb479fa0dd925db3daff07 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1:44833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:27.145679 29612 leader_election.cc:304] T d4d2f00fadd04bdd91d3c97ebc76f005 P 5481e9936dfb479fa0dd925db3daff07 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5481e9936dfb479fa0dd925db3daff07, bc0a9840c02a4c279170b1c5fe560370; no voters: e28ca864e4c848b59d8b018ac4169c32
I20260709 13:07:27.147558 29721 raft_consensus.cc:2804] T d4d2f00fadd04bdd91d3c97ebc76f005 P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:27.148020 29721 raft_consensus.cc:493] T d4d2f00fadd04bdd91d3c97ebc76f005 P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.148064 29700 raft_consensus.cc:493] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.148501 29721 raft_consensus.cc:3060] T d4d2f00fadd04bdd91d3c97ebc76f005 P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.148681 29700 raft_consensus.cc:515] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.158946 29700 leader_election.cc:290] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1:44833), bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2:40589)
I20260709 13:07:27.158591 29396 catalog_manager.cc:5697] T 2af14a7828dc4808aa8fdc9c1c758b85 P e28ca864e4c848b59d8b018ac4169c32 reported cstate change: term changed from 0 to 1, leader changed from <none> to e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "e28ca864e4c848b59d8b018ac4169c32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:27.165481 29694 tablet_bootstrap.cc:492] T d4d2f00fadd04bdd91d3c97ebc76f005 P e28ca864e4c848b59d8b018ac4169c32: No bootstrap required, opened a new log
I20260709 13:07:27.165838 29723 leader_election.cc:290] T 2ef4ec98706b46e2a2ff852dca7ee48e P 5481e9936dfb479fa0dd925db3daff07 [CANDIDATE]: Term 1 election: Requested vote from peers e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1:44833), bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2:40589)
I20260709 13:07:27.165958 29694 ts_tablet_manager.cc:1403] T d4d2f00fadd04bdd91d3c97ebc76f005 P e28ca864e4c848b59d8b018ac4169c32: Time spent bootstrapping tablet: real 0.084s	user 0.010s	sys 0.010s
I20260709 13:07:27.167141 29715 raft_consensus.cc:515] T d4d2f00fadd04bdd91d3c97ebc76f005 P bc0a9840c02a4c279170b1c5fe560370 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.169606 29574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef4ec98706b46e2a2ff852dca7ee48e" candidate_uuid: "5481e9936dfb479fa0dd925db3daff07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc0a9840c02a4c279170b1c5fe560370"
I20260709 13:07:27.170181 29499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef4ec98706b46e2a2ff852dca7ee48e" candidate_uuid: "5481e9936dfb479fa0dd925db3daff07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e28ca864e4c848b59d8b018ac4169c32"
I20260709 13:07:27.171058 29499 raft_consensus.cc:3060] T 2ef4ec98706b46e2a2ff852dca7ee48e P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:27.171706 29612 leader_election.cc:343] T 2ef4ec98706b46e2a2ff852dca7ee48e P 5481e9936dfb479fa0dd925db3daff07 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2:40589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:27.170181 29573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5df53243d4c4e27bef57ad8f51bcb6e" candidate_uuid: "5481e9936dfb479fa0dd925db3daff07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc0a9840c02a4c279170b1c5fe560370" is_pre_election: true
I20260709 13:07:27.171983 29498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5df53243d4c4e27bef57ad8f51bcb6e" candidate_uuid: "5481e9936dfb479fa0dd925db3daff07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e28ca864e4c848b59d8b018ac4169c32" is_pre_election: true
I20260709 13:07:27.172154 29721 raft_consensus.cc:515] T d4d2f00fadd04bdd91d3c97ebc76f005 P 5481e9936dfb479fa0dd925db3daff07 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
W20260709 13:07:27.173840 29612 leader_election.cc:343] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2:40589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:27.176043 29721 leader_election.cc:290] T d4d2f00fadd04bdd91d3c97ebc76f005 P 5481e9936dfb479fa0dd925db3daff07 [CANDIDATE]: Term 1 election: Requested vote from peers e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1:44833), bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2:40589)
W20260709 13:07:27.176966 29612 leader_election.cc:343] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1:44833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:27.169592 29694 raft_consensus.cc:359] T d4d2f00fadd04bdd91d3c97ebc76f005 P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.177380 29612 leader_election.cc:304] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5481e9936dfb479fa0dd925db3daff07; no voters: bc0a9840c02a4c279170b1c5fe560370, e28ca864e4c848b59d8b018ac4169c32
I20260709 13:07:27.177470 29694 raft_consensus.cc:385] T d4d2f00fadd04bdd91d3c97ebc76f005 P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.177495 29498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d2f00fadd04bdd91d3c97ebc76f005" candidate_uuid: "bc0a9840c02a4c279170b1c5fe560370" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e28ca864e4c848b59d8b018ac4169c32"
I20260709 13:07:27.177920 29694 raft_consensus.cc:740] T d4d2f00fadd04bdd91d3c97ebc76f005 P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e28ca864e4c848b59d8b018ac4169c32, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.178653 29694 consensus_queue.cc:260] T d4d2f00fadd04bdd91d3c97ebc76f005 P e28ca864e4c848b59d8b018ac4169c32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.179548 29497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d2f00fadd04bdd91d3c97ebc76f005" candidate_uuid: "5481e9936dfb479fa0dd925db3daff07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e28ca864e4c848b59d8b018ac4169c32"
I20260709 13:07:27.181592 29648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d2f00fadd04bdd91d3c97ebc76f005" candidate_uuid: "bc0a9840c02a4c279170b1c5fe560370" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5481e9936dfb479fa0dd925db3daff07"
I20260709 13:07:27.180195 29715 leader_election.cc:290] T d4d2f00fadd04bdd91d3c97ebc76f005 P bc0a9840c02a4c279170b1c5fe560370 [CANDIDATE]: Term 1 election: Requested vote from peers e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1:44833), 5481e9936dfb479fa0dd925db3daff07 (127.28.173.3:42061)
I20260709 13:07:27.182708 29648 raft_consensus.cc:2393] T d4d2f00fadd04bdd91d3c97ebc76f005 P 5481e9936dfb479fa0dd925db3daff07 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bc0a9840c02a4c279170b1c5fe560370 in current term 1: Already voted for candidate 5481e9936dfb479fa0dd925db3daff07 in this term.
I20260709 13:07:27.180544 29498 raft_consensus.cc:3060] T d4d2f00fadd04bdd91d3c97ebc76f005 P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.180189 29721 raft_consensus.cc:2749] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:27.185103 29499 raft_consensus.cc:2468] T 2ef4ec98706b46e2a2ff852dca7ee48e P e28ca864e4c848b59d8b018ac4169c32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5481e9936dfb479fa0dd925db3daff07 in term 1.
I20260709 13:07:27.185689 29573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4d2f00fadd04bdd91d3c97ebc76f005" candidate_uuid: "5481e9936dfb479fa0dd925db3daff07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc0a9840c02a4c279170b1c5fe560370"
I20260709 13:07:27.186776 29573 raft_consensus.cc:2393] T d4d2f00fadd04bdd91d3c97ebc76f005 P bc0a9840c02a4c279170b1c5fe560370 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5481e9936dfb479fa0dd925db3daff07 in current term 1: Already voted for candidate bc0a9840c02a4c279170b1c5fe560370 in this term.
I20260709 13:07:27.187661 29694 ts_tablet_manager.cc:1434] T d4d2f00fadd04bdd91d3c97ebc76f005 P e28ca864e4c848b59d8b018ac4169c32: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 13:07:27.188695 29694 tablet_bootstrap.cc:492] T 8d25bbcb97f44813aa8241e230434f74 P e28ca864e4c848b59d8b018ac4169c32: Bootstrap starting.
I20260709 13:07:27.200840 29694 tablet_bootstrap.cc:654] T 8d25bbcb97f44813aa8241e230434f74 P e28ca864e4c848b59d8b018ac4169c32: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.192010 29612 leader_election.cc:304] T 2ef4ec98706b46e2a2ff852dca7ee48e P 5481e9936dfb479fa0dd925db3daff07 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5481e9936dfb479fa0dd925db3daff07, e28ca864e4c848b59d8b018ac4169c32; no voters: bc0a9840c02a4c279170b1c5fe560370
I20260709 13:07:27.201896 29721 raft_consensus.cc:2804] T 2ef4ec98706b46e2a2ff852dca7ee48e P 5481e9936dfb479fa0dd925db3daff07 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:27.202446 29721 raft_consensus.cc:697] T 2ef4ec98706b46e2a2ff852dca7ee48e P 5481e9936dfb479fa0dd925db3daff07 [term 1 LEADER]: Becoming Leader. State: Replica: 5481e9936dfb479fa0dd925db3daff07, State: Running, Role: LEADER
I20260709 13:07:27.203337 29721 consensus_queue.cc:237] T 2ef4ec98706b46e2a2ff852dca7ee48e P 5481e9936dfb479fa0dd925db3daff07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.207454 29498 raft_consensus.cc:2468] T d4d2f00fadd04bdd91d3c97ebc76f005 P e28ca864e4c848b59d8b018ac4169c32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc0a9840c02a4c279170b1c5fe560370 in term 1.
I20260709 13:07:27.207924 29612 leader_election.cc:304] T d4d2f00fadd04bdd91d3c97ebc76f005 P 5481e9936dfb479fa0dd925db3daff07 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5481e9936dfb479fa0dd925db3daff07; no voters: bc0a9840c02a4c279170b1c5fe560370, e28ca864e4c848b59d8b018ac4169c32
I20260709 13:07:27.208854 29723 raft_consensus.cc:2749] T d4d2f00fadd04bdd91d3c97ebc76f005 P 5481e9936dfb479fa0dd925db3daff07 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:27.210826 29538 leader_election.cc:304] T d4d2f00fadd04bdd91d3c97ebc76f005 P bc0a9840c02a4c279170b1c5fe560370 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc0a9840c02a4c279170b1c5fe560370, e28ca864e4c848b59d8b018ac4169c32; no voters: 5481e9936dfb479fa0dd925db3daff07
I20260709 13:07:27.211998 29715 raft_consensus.cc:2804] T d4d2f00fadd04bdd91d3c97ebc76f005 P bc0a9840c02a4c279170b1c5fe560370 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:27.212558 29715 raft_consensus.cc:697] T d4d2f00fadd04bdd91d3c97ebc76f005 P bc0a9840c02a4c279170b1c5fe560370 [term 1 LEADER]: Becoming Leader. State: Replica: bc0a9840c02a4c279170b1c5fe560370, State: Running, Role: LEADER
I20260709 13:07:27.213553 29715 consensus_queue.cc:237] T d4d2f00fadd04bdd91d3c97ebc76f005 P bc0a9840c02a4c279170b1c5fe560370 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.220608 29693 tablet_bootstrap.cc:492] T 8d25bbcb97f44813aa8241e230434f74 P 5481e9936dfb479fa0dd925db3daff07: No bootstrap required, opened a new log
I20260709 13:07:27.221342 29693 ts_tablet_manager.cc:1403] T 8d25bbcb97f44813aa8241e230434f74 P 5481e9936dfb479fa0dd925db3daff07: Time spent bootstrapping tablet: real 0.138s	user 0.015s	sys 0.003s
I20260709 13:07:27.224932 29693 raft_consensus.cc:359] T 8d25bbcb97f44813aa8241e230434f74 P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.225728 29693 raft_consensus.cc:385] T 8d25bbcb97f44813aa8241e230434f74 P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.226084 29693 raft_consensus.cc:740] T 8d25bbcb97f44813aa8241e230434f74 P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5481e9936dfb479fa0dd925db3daff07, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.226926 29693 consensus_queue.cc:260] T 8d25bbcb97f44813aa8241e230434f74 P 5481e9936dfb479fa0dd925db3daff07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.234424 29723 raft_consensus.cc:493] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.234910 29723 raft_consensus.cc:515] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.235677 29693 ts_tablet_manager.cc:1434] T 8d25bbcb97f44813aa8241e230434f74 P 5481e9936dfb479fa0dd925db3daff07: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:07:27.236704 29693 tablet_bootstrap.cc:492] T ca6f74116b244bc0929c39ea3913a184 P 5481e9936dfb479fa0dd925db3daff07: Bootstrap starting.
I20260709 13:07:27.236850 29723 leader_election.cc:290] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1:44833), bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2:40589)
I20260709 13:07:27.239006 29573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc21554b6344107baedcec570f26b37" candidate_uuid: "5481e9936dfb479fa0dd925db3daff07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc0a9840c02a4c279170b1c5fe560370" is_pre_election: true
I20260709 13:07:27.239687 29573 raft_consensus.cc:2468] T dbc21554b6344107baedcec570f26b37 P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5481e9936dfb479fa0dd925db3daff07 in term 0.
I20260709 13:07:27.241751 29612 leader_election.cc:304] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5481e9936dfb479fa0dd925db3daff07, bc0a9840c02a4c279170b1c5fe560370; no voters: 
I20260709 13:07:27.246275 29723 raft_consensus.cc:2804] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:27.246652 29723 raft_consensus.cc:493] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.246812 29693 tablet_bootstrap.cc:654] T ca6f74116b244bc0929c39ea3913a184 P 5481e9936dfb479fa0dd925db3daff07: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.247037 29723 raft_consensus.cc:3060] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.252269 29498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc21554b6344107baedcec570f26b37" candidate_uuid: "5481e9936dfb479fa0dd925db3daff07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e28ca864e4c848b59d8b018ac4169c32" is_pre_election: true
I20260709 13:07:27.252902 29498 raft_consensus.cc:2468] T dbc21554b6344107baedcec570f26b37 P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5481e9936dfb479fa0dd925db3daff07 in term 0.
I20260709 13:07:27.260083 29393 catalog_manager.cc:5697] T d4d2f00fadd04bdd91d3c97ebc76f005 P bc0a9840c02a4c279170b1c5fe560370 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2). New cstate: current_term: 1 leader_uuid: "bc0a9840c02a4c279170b1c5fe560370" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:27.261196 29690 tablet_bootstrap.cc:492] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370: No bootstrap required, opened a new log
I20260709 13:07:27.260849 29395 catalog_manager.cc:5697] T 2ef4ec98706b46e2a2ff852dca7ee48e P 5481e9936dfb479fa0dd925db3daff07 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5481e9936dfb479fa0dd925db3daff07 (127.28.173.3). New cstate: current_term: 1 leader_uuid: "5481e9936dfb479fa0dd925db3daff07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:27.261859 29690 ts_tablet_manager.cc:1403] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370: Time spent bootstrapping tablet: real 0.165s	user 0.010s	sys 0.020s
I20260709 13:07:27.263105 29723 raft_consensus.cc:515] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.265829 29498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc21554b6344107baedcec570f26b37" candidate_uuid: "5481e9936dfb479fa0dd925db3daff07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e28ca864e4c848b59d8b018ac4169c32"
I20260709 13:07:27.266361 29498 raft_consensus.cc:3060] T dbc21554b6344107baedcec570f26b37 P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.270116 29693 tablet_bootstrap.cc:492] T ca6f74116b244bc0929c39ea3913a184 P 5481e9936dfb479fa0dd925db3daff07: No bootstrap required, opened a new log
I20260709 13:07:27.270539 29693 ts_tablet_manager.cc:1403] T ca6f74116b244bc0929c39ea3913a184 P 5481e9936dfb479fa0dd925db3daff07: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.007s
I20260709 13:07:27.272746 29498 raft_consensus.cc:2468] T dbc21554b6344107baedcec570f26b37 P e28ca864e4c848b59d8b018ac4169c32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5481e9936dfb479fa0dd925db3daff07 in term 1.
I20260709 13:07:27.273286 29690 raft_consensus.cc:359] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.273903 29612 leader_election.cc:304] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5481e9936dfb479fa0dd925db3daff07, e28ca864e4c848b59d8b018ac4169c32; no voters: 
I20260709 13:07:27.274029 29690 raft_consensus.cc:385] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.275614 29690 raft_consensus.cc:740] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc0a9840c02a4c279170b1c5fe560370, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.276312 29721 raft_consensus.cc:2804] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:27.276772 29721 raft_consensus.cc:697] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07 [term 1 LEADER]: Becoming Leader. State: Replica: 5481e9936dfb479fa0dd925db3daff07, State: Running, Role: LEADER
I20260709 13:07:27.277169 29694 tablet_bootstrap.cc:492] T 8d25bbcb97f44813aa8241e230434f74 P e28ca864e4c848b59d8b018ac4169c32: No bootstrap required, opened a new log
I20260709 13:07:27.277621 29694 ts_tablet_manager.cc:1403] T 8d25bbcb97f44813aa8241e230434f74 P e28ca864e4c848b59d8b018ac4169c32: Time spent bootstrapping tablet: real 0.089s	user 0.019s	sys 0.002s
I20260709 13:07:27.277582 29721 consensus_queue.cc:237] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.278010 29690 consensus_queue.cc:260] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.280968 29573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc21554b6344107baedcec570f26b37" candidate_uuid: "5481e9936dfb479fa0dd925db3daff07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc0a9840c02a4c279170b1c5fe560370"
I20260709 13:07:27.281512 29573 raft_consensus.cc:3060] T dbc21554b6344107baedcec570f26b37 P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.282029 29693 raft_consensus.cc:359] T ca6f74116b244bc0929c39ea3913a184 P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.282892 29693 raft_consensus.cc:385] T ca6f74116b244bc0929c39ea3913a184 P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.283228 29693 raft_consensus.cc:740] T ca6f74116b244bc0929c39ea3913a184 P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5481e9936dfb479fa0dd925db3daff07, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.291749 29690 ts_tablet_manager.cc:1434] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370: Time spent starting tablet: real 0.030s	user 0.002s	sys 0.005s
I20260709 13:07:27.293066 29690 tablet_bootstrap.cc:492] T 8d25bbcb97f44813aa8241e230434f74 P bc0a9840c02a4c279170b1c5fe560370: Bootstrap starting.
I20260709 13:07:27.284137 29693 consensus_queue.cc:260] T ca6f74116b244bc0929c39ea3913a184 P 5481e9936dfb479fa0dd925db3daff07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.291770 29573 raft_consensus.cc:2468] T dbc21554b6344107baedcec570f26b37 P bc0a9840c02a4c279170b1c5fe560370 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5481e9936dfb479fa0dd925db3daff07 in term 1.
I20260709 13:07:27.301808 29690 tablet_bootstrap.cc:654] T 8d25bbcb97f44813aa8241e230434f74 P bc0a9840c02a4c279170b1c5fe560370: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.301985 29723 leader_election.cc:290] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07 [CANDIDATE]: Term 1 election: Requested vote from peers e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1:44833), bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2:40589)
I20260709 13:07:27.309216 29693 ts_tablet_manager.cc:1434] T ca6f74116b244bc0929c39ea3913a184 P 5481e9936dfb479fa0dd925db3daff07: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.001s
I20260709 13:07:27.309167 29393 catalog_manager.cc:5697] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5481e9936dfb479fa0dd925db3daff07 (127.28.173.3). New cstate: current_term: 1 leader_uuid: "5481e9936dfb479fa0dd925db3daff07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:27.310177 29693 tablet_bootstrap.cc:492] T 2af14a7828dc4808aa8fdc9c1c758b85 P 5481e9936dfb479fa0dd925db3daff07: Bootstrap starting.
I20260709 13:07:27.303642 29694 raft_consensus.cc:359] T 8d25bbcb97f44813aa8241e230434f74 P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.311980 29694 raft_consensus.cc:385] T 8d25bbcb97f44813aa8241e230434f74 P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.312323 29694 raft_consensus.cc:740] T 8d25bbcb97f44813aa8241e230434f74 P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e28ca864e4c848b59d8b018ac4169c32, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.313458 29690 tablet_bootstrap.cc:492] T 8d25bbcb97f44813aa8241e230434f74 P bc0a9840c02a4c279170b1c5fe560370: No bootstrap required, opened a new log
I20260709 13:07:27.313133 29694 consensus_queue.cc:260] T 8d25bbcb97f44813aa8241e230434f74 P e28ca864e4c848b59d8b018ac4169c32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.313858 29690 ts_tablet_manager.cc:1403] T 8d25bbcb97f44813aa8241e230434f74 P bc0a9840c02a4c279170b1c5fe560370: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.006s
I20260709 13:07:27.316048 29693 tablet_bootstrap.cc:654] T 2af14a7828dc4808aa8fdc9c1c758b85 P 5481e9936dfb479fa0dd925db3daff07: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.316011 29694 ts_tablet_manager.cc:1434] T 8d25bbcb97f44813aa8241e230434f74 P e28ca864e4c848b59d8b018ac4169c32: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.000s
I20260709 13:07:27.317116 29694 tablet_bootstrap.cc:492] T a5df53243d4c4e27bef57ad8f51bcb6e P e28ca864e4c848b59d8b018ac4169c32: Bootstrap starting.
I20260709 13:07:27.323347 29694 tablet_bootstrap.cc:654] T a5df53243d4c4e27bef57ad8f51bcb6e P e28ca864e4c848b59d8b018ac4169c32: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.329808 29693 tablet_bootstrap.cc:492] T 2af14a7828dc4808aa8fdc9c1c758b85 P 5481e9936dfb479fa0dd925db3daff07: No bootstrap required, opened a new log
I20260709 13:07:27.330328 29693 ts_tablet_manager.cc:1403] T 2af14a7828dc4808aa8fdc9c1c758b85 P 5481e9936dfb479fa0dd925db3daff07: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.001s
I20260709 13:07:27.332888 29690 raft_consensus.cc:359] T 8d25bbcb97f44813aa8241e230434f74 P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.333133 29693 raft_consensus.cc:359] T 2af14a7828dc4808aa8fdc9c1c758b85 P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } } peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } }
I20260709 13:07:27.333621 29690 raft_consensus.cc:385] T 8d25bbcb97f44813aa8241e230434f74 P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.333820 29693 raft_consensus.cc:385] T 2af14a7828dc4808aa8fdc9c1c758b85 P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.333941 29690 raft_consensus.cc:740] T 8d25bbcb97f44813aa8241e230434f74 P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc0a9840c02a4c279170b1c5fe560370, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.334259 29693 raft_consensus.cc:740] T 2af14a7828dc4808aa8fdc9c1c758b85 P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5481e9936dfb479fa0dd925db3daff07, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.334431 29694 tablet_bootstrap.cc:492] T a5df53243d4c4e27bef57ad8f51bcb6e P e28ca864e4c848b59d8b018ac4169c32: No bootstrap required, opened a new log
I20260709 13:07:27.334995 29694 ts_tablet_manager.cc:1403] T a5df53243d4c4e27bef57ad8f51bcb6e P e28ca864e4c848b59d8b018ac4169c32: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 13:07:27.334877 29690 consensus_queue.cc:260] T 8d25bbcb97f44813aa8241e230434f74 P bc0a9840c02a4c279170b1c5fe560370 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.335268 29693 consensus_queue.cc:260] T 2af14a7828dc4808aa8fdc9c1c758b85 P 5481e9936dfb479fa0dd925db3daff07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } } peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } }
I20260709 13:07:27.337283 29693 ts_tablet_manager.cc:1434] T 2af14a7828dc4808aa8fdc9c1c758b85 P 5481e9936dfb479fa0dd925db3daff07: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:07:27.339423 29690 ts_tablet_manager.cc:1434] T 8d25bbcb97f44813aa8241e230434f74 P bc0a9840c02a4c279170b1c5fe560370: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:07:27.340400 29690 tablet_bootstrap.cc:492] T 2ef4ec98706b46e2a2ff852dca7ee48e P bc0a9840c02a4c279170b1c5fe560370: Bootstrap starting.
I20260709 13:07:27.347267 29690 tablet_bootstrap.cc:654] T 2ef4ec98706b46e2a2ff852dca7ee48e P bc0a9840c02a4c279170b1c5fe560370: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.353057 29694 raft_consensus.cc:359] T a5df53243d4c4e27bef57ad8f51bcb6e P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.353586 29690 tablet_bootstrap.cc:492] T 2ef4ec98706b46e2a2ff852dca7ee48e P bc0a9840c02a4c279170b1c5fe560370: No bootstrap required, opened a new log
I20260709 13:07:27.353581 29694 raft_consensus.cc:385] T a5df53243d4c4e27bef57ad8f51bcb6e P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.354094 29694 raft_consensus.cc:740] T a5df53243d4c4e27bef57ad8f51bcb6e P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e28ca864e4c848b59d8b018ac4169c32, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.354180 29690 ts_tablet_manager.cc:1403] T 2ef4ec98706b46e2a2ff852dca7ee48e P bc0a9840c02a4c279170b1c5fe560370: Time spent bootstrapping tablet: real 0.014s	user 0.004s	sys 0.005s
I20260709 13:07:27.354765 29694 consensus_queue.cc:260] T a5df53243d4c4e27bef57ad8f51bcb6e P e28ca864e4c848b59d8b018ac4169c32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.356652 29694 ts_tablet_manager.cc:1434] T a5df53243d4c4e27bef57ad8f51bcb6e P e28ca864e4c848b59d8b018ac4169c32: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:07:27.357451 29690 raft_consensus.cc:359] T 2ef4ec98706b46e2a2ff852dca7ee48e P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.357908 29694 tablet_bootstrap.cc:492] T 4f69e2661ba745b09237e4ce0494087b P e28ca864e4c848b59d8b018ac4169c32: Bootstrap starting.
I20260709 13:07:27.358081 29690 raft_consensus.cc:385] T 2ef4ec98706b46e2a2ff852dca7ee48e P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.358397 29690 raft_consensus.cc:740] T 2ef4ec98706b46e2a2ff852dca7ee48e P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc0a9840c02a4c279170b1c5fe560370, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.359027 29690 consensus_queue.cc:260] T 2ef4ec98706b46e2a2ff852dca7ee48e P bc0a9840c02a4c279170b1c5fe560370 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.360947 29690 ts_tablet_manager.cc:1434] T 2ef4ec98706b46e2a2ff852dca7ee48e P bc0a9840c02a4c279170b1c5fe560370: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:07:27.363992 29694 tablet_bootstrap.cc:654] T 4f69e2661ba745b09237e4ce0494087b P e28ca864e4c848b59d8b018ac4169c32: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.373828 29690 tablet_bootstrap.cc:492] T e01ba93272b5460a8e453d93659b85ae P bc0a9840c02a4c279170b1c5fe560370: Bootstrap starting.
I20260709 13:07:27.374581 29694 tablet_bootstrap.cc:492] T 4f69e2661ba745b09237e4ce0494087b P e28ca864e4c848b59d8b018ac4169c32: No bootstrap required, opened a new log
I20260709 13:07:27.375090 29694 ts_tablet_manager.cc:1403] T 4f69e2661ba745b09237e4ce0494087b P e28ca864e4c848b59d8b018ac4169c32: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.010s
I20260709 13:07:27.377055 29694 raft_consensus.cc:359] T 4f69e2661ba745b09237e4ce0494087b P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.377552 29694 raft_consensus.cc:385] T 4f69e2661ba745b09237e4ce0494087b P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.377785 29694 raft_consensus.cc:740] T 4f69e2661ba745b09237e4ce0494087b P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e28ca864e4c848b59d8b018ac4169c32, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.378374 29694 consensus_queue.cc:260] T 4f69e2661ba745b09237e4ce0494087b P e28ca864e4c848b59d8b018ac4169c32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.380157 29694 ts_tablet_manager.cc:1434] T 4f69e2661ba745b09237e4ce0494087b P e28ca864e4c848b59d8b018ac4169c32: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:07:27.382712 29690 tablet_bootstrap.cc:654] T e01ba93272b5460a8e453d93659b85ae P bc0a9840c02a4c279170b1c5fe560370: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.384173 29723 raft_consensus.cc:493] T 8d25bbcb97f44813aa8241e230434f74 P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.384652 29723 raft_consensus.cc:515] T 8d25bbcb97f44813aa8241e230434f74 P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.386885 29723 leader_election.cc:290] T 8d25bbcb97f44813aa8241e230434f74 P 5481e9936dfb479fa0dd925db3daff07 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1:44833), bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2:40589)
I20260709 13:07:27.387792 29498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d25bbcb97f44813aa8241e230434f74" candidate_uuid: "5481e9936dfb479fa0dd925db3daff07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e28ca864e4c848b59d8b018ac4169c32" is_pre_election: true
I20260709 13:07:27.389954 29498 raft_consensus.cc:2468] T 8d25bbcb97f44813aa8241e230434f74 P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5481e9936dfb479fa0dd925db3daff07 in term 0.
I20260709 13:07:27.388078 29690 tablet_bootstrap.cc:492] T e01ba93272b5460a8e453d93659b85ae P bc0a9840c02a4c279170b1c5fe560370: No bootstrap required, opened a new log
I20260709 13:07:27.390725 29573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d25bbcb97f44813aa8241e230434f74" candidate_uuid: "5481e9936dfb479fa0dd925db3daff07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc0a9840c02a4c279170b1c5fe560370" is_pre_election: true
I20260709 13:07:27.391072 29690 ts_tablet_manager.cc:1403] T e01ba93272b5460a8e453d93659b85ae P bc0a9840c02a4c279170b1c5fe560370: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.001s
I20260709 13:07:27.390964 29612 leader_election.cc:304] T 8d25bbcb97f44813aa8241e230434f74 P 5481e9936dfb479fa0dd925db3daff07 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5481e9936dfb479fa0dd925db3daff07, e28ca864e4c848b59d8b018ac4169c32; no voters: 
I20260709 13:07:27.391340 29573 raft_consensus.cc:2468] T 8d25bbcb97f44813aa8241e230434f74 P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5481e9936dfb479fa0dd925db3daff07 in term 0.
I20260709 13:07:27.392321 29701 raft_consensus.cc:493] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.392766 29701 raft_consensus.cc:515] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.393625 29690 raft_consensus.cc:359] T e01ba93272b5460a8e453d93659b85ae P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.394260 29690 raft_consensus.cc:385] T e01ba93272b5460a8e453d93659b85ae P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.394320 29701 leader_election.cc:290] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2:40589), 5481e9936dfb479fa0dd925db3daff07 (127.28.173.3:42061)
I20260709 13:07:27.394563 29690 raft_consensus.cc:740] T e01ba93272b5460a8e453d93659b85ae P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc0a9840c02a4c279170b1c5fe560370, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.395156 29573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e01ba93272b5460a8e453d93659b85ae" candidate_uuid: "e28ca864e4c848b59d8b018ac4169c32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc0a9840c02a4c279170b1c5fe560370" is_pre_election: true
I20260709 13:07:27.395255 29690 consensus_queue.cc:260] T e01ba93272b5460a8e453d93659b85ae P bc0a9840c02a4c279170b1c5fe560370 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.396183 29573 raft_consensus.cc:2468] T e01ba93272b5460a8e453d93659b85ae P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28ca864e4c848b59d8b018ac4169c32 in term 0.
I20260709 13:07:27.396121 29648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e01ba93272b5460a8e453d93659b85ae" candidate_uuid: "e28ca864e4c848b59d8b018ac4169c32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5481e9936dfb479fa0dd925db3daff07" is_pre_election: true
I20260709 13:07:27.397064 29648 raft_consensus.cc:2468] T e01ba93272b5460a8e453d93659b85ae P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28ca864e4c848b59d8b018ac4169c32 in term 0.
I20260709 13:07:27.397230 29690 ts_tablet_manager.cc:1434] T e01ba93272b5460a8e453d93659b85ae P bc0a9840c02a4c279170b1c5fe560370: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:07:27.397487 29463 leader_election.cc:304] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc0a9840c02a4c279170b1c5fe560370, e28ca864e4c848b59d8b018ac4169c32; no voters: 
I20260709 13:07:27.398226 29701 raft_consensus.cc:2804] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:27.398576 29701 raft_consensus.cc:493] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.398927 29701 raft_consensus.cc:3060] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.399780 29723 raft_consensus.cc:2804] T 8d25bbcb97f44813aa8241e230434f74 P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:27.400158 29723 raft_consensus.cc:493] T 8d25bbcb97f44813aa8241e230434f74 P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.400467 29723 raft_consensus.cc:3060] T 8d25bbcb97f44813aa8241e230434f74 P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.405224 29701 raft_consensus.cc:515] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.406855 29701 leader_election.cc:290] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32 [CANDIDATE]: Term 1 election: Requested vote from peers bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2:40589), 5481e9936dfb479fa0dd925db3daff07 (127.28.173.3:42061)
I20260709 13:07:27.407903 29573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e01ba93272b5460a8e453d93659b85ae" candidate_uuid: "e28ca864e4c848b59d8b018ac4169c32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc0a9840c02a4c279170b1c5fe560370"
I20260709 13:07:27.408469 29573 raft_consensus.cc:3060] T e01ba93272b5460a8e453d93659b85ae P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.408522 29648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e01ba93272b5460a8e453d93659b85ae" candidate_uuid: "e28ca864e4c848b59d8b018ac4169c32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5481e9936dfb479fa0dd925db3daff07"
I20260709 13:07:27.409073 29648 raft_consensus.cc:3060] T e01ba93272b5460a8e453d93659b85ae P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.410030 29723 raft_consensus.cc:515] T 8d25bbcb97f44813aa8241e230434f74 P 5481e9936dfb479fa0dd925db3daff07 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.412581 29498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d25bbcb97f44813aa8241e230434f74" candidate_uuid: "5481e9936dfb479fa0dd925db3daff07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e28ca864e4c848b59d8b018ac4169c32"
I20260709 13:07:27.413096 29498 raft_consensus.cc:3060] T 8d25bbcb97f44813aa8241e230434f74 P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.414956 29573 raft_consensus.cc:2468] T e01ba93272b5460a8e453d93659b85ae P bc0a9840c02a4c279170b1c5fe560370 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28ca864e4c848b59d8b018ac4169c32 in term 1.
I20260709 13:07:27.415436 29648 raft_consensus.cc:2468] T e01ba93272b5460a8e453d93659b85ae P 5481e9936dfb479fa0dd925db3daff07 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28ca864e4c848b59d8b018ac4169c32 in term 1.
I20260709 13:07:27.416098 29463 leader_election.cc:304] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc0a9840c02a4c279170b1c5fe560370, e28ca864e4c848b59d8b018ac4169c32; no voters: 
I20260709 13:07:27.416851 29701 raft_consensus.cc:2804] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:27.417634 29701 raft_consensus.cc:697] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32 [term 1 LEADER]: Becoming Leader. State: Replica: e28ca864e4c848b59d8b018ac4169c32, State: Running, Role: LEADER
I20260709 13:07:27.418383 29701 consensus_queue.cc:237] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.419210 29498 raft_consensus.cc:2468] T 8d25bbcb97f44813aa8241e230434f74 P e28ca864e4c848b59d8b018ac4169c32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5481e9936dfb479fa0dd925db3daff07 in term 1.
I20260709 13:07:27.421144 29612 leader_election.cc:304] T 8d25bbcb97f44813aa8241e230434f74 P 5481e9936dfb479fa0dd925db3daff07 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5481e9936dfb479fa0dd925db3daff07, e28ca864e4c848b59d8b018ac4169c32; no voters: 
I20260709 13:07:27.421908 29721 raft_consensus.cc:2804] T 8d25bbcb97f44813aa8241e230434f74 P 5481e9936dfb479fa0dd925db3daff07 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:27.422360 29721 raft_consensus.cc:697] T 8d25bbcb97f44813aa8241e230434f74 P 5481e9936dfb479fa0dd925db3daff07 [term 1 LEADER]: Becoming Leader. State: Replica: 5481e9936dfb479fa0dd925db3daff07, State: Running, Role: LEADER
I20260709 13:07:27.422530 29573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d25bbcb97f44813aa8241e230434f74" candidate_uuid: "5481e9936dfb479fa0dd925db3daff07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc0a9840c02a4c279170b1c5fe560370"
I20260709 13:07:27.423096 29573 raft_consensus.cc:3060] T 8d25bbcb97f44813aa8241e230434f74 P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.423170 29721 consensus_queue.cc:237] T 8d25bbcb97f44813aa8241e230434f74 P 5481e9936dfb479fa0dd925db3daff07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.427914 29723 leader_election.cc:290] T 8d25bbcb97f44813aa8241e230434f74 P 5481e9936dfb479fa0dd925db3daff07 [CANDIDATE]: Term 1 election: Requested vote from peers e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1:44833), bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2:40589)
I20260709 13:07:27.426435 29395 catalog_manager.cc:5697] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32 reported cstate change: term changed from 0 to 1, leader changed from <none> to e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "e28ca864e4c848b59d8b018ac4169c32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:27.430218 29573 raft_consensus.cc:2468] T 8d25bbcb97f44813aa8241e230434f74 P bc0a9840c02a4c279170b1c5fe560370 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5481e9936dfb479fa0dd925db3daff07 in term 1.
I20260709 13:07:27.440287 29396 catalog_manager.cc:5697] T 8d25bbcb97f44813aa8241e230434f74 P 5481e9936dfb479fa0dd925db3daff07 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5481e9936dfb479fa0dd925db3daff07 (127.28.173.3). New cstate: current_term: 1 leader_uuid: "5481e9936dfb479fa0dd925db3daff07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:27.445444 29715 raft_consensus.cc:493] T 2ef4ec98706b46e2a2ff852dca7ee48e P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.445921 29715 raft_consensus.cc:515] T 2ef4ec98706b46e2a2ff852dca7ee48e P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.447710 29715 leader_election.cc:290] T 2ef4ec98706b46e2a2ff852dca7ee48e P bc0a9840c02a4c279170b1c5fe560370 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1:44833), 5481e9936dfb479fa0dd925db3daff07 (127.28.173.3:42061)
I20260709 13:07:27.448452 29498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef4ec98706b46e2a2ff852dca7ee48e" candidate_uuid: "bc0a9840c02a4c279170b1c5fe560370" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e28ca864e4c848b59d8b018ac4169c32" is_pre_election: true
I20260709 13:07:27.448776 29648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef4ec98706b46e2a2ff852dca7ee48e" candidate_uuid: "bc0a9840c02a4c279170b1c5fe560370" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5481e9936dfb479fa0dd925db3daff07" is_pre_election: true
I20260709 13:07:27.449259 29498 raft_consensus.cc:2393] T 2ef4ec98706b46e2a2ff852dca7ee48e P e28ca864e4c848b59d8b018ac4169c32 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc0a9840c02a4c279170b1c5fe560370 in current term 1: Already voted for candidate 5481e9936dfb479fa0dd925db3daff07 in this term.
I20260709 13:07:27.450462 29538 leader_election.cc:304] T 2ef4ec98706b46e2a2ff852dca7ee48e P bc0a9840c02a4c279170b1c5fe560370 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc0a9840c02a4c279170b1c5fe560370; no voters: 5481e9936dfb479fa0dd925db3daff07, e28ca864e4c848b59d8b018ac4169c32
I20260709 13:07:27.451072 29715 raft_consensus.cc:3060] T 2ef4ec98706b46e2a2ff852dca7ee48e P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.456725 29715 raft_consensus.cc:2749] T 2ef4ec98706b46e2a2ff852dca7ee48e P bc0a9840c02a4c279170b1c5fe560370 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:27.548496 29721 raft_consensus.cc:493] T 2af14a7828dc4808aa8fdc9c1c758b85 P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.549048 29721 raft_consensus.cc:515] T 2af14a7828dc4808aa8fdc9c1c758b85 P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } } peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } }
I20260709 13:07:27.551173 29721 leader_election.cc:290] T 2af14a7828dc4808aa8fdc9c1c758b85 P 5481e9936dfb479fa0dd925db3daff07 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2:40589), e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1:44833)
I20260709 13:07:27.551988 29573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af14a7828dc4808aa8fdc9c1c758b85" candidate_uuid: "5481e9936dfb479fa0dd925db3daff07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc0a9840c02a4c279170b1c5fe560370" is_pre_election: true
I20260709 13:07:27.552359 29498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af14a7828dc4808aa8fdc9c1c758b85" candidate_uuid: "5481e9936dfb479fa0dd925db3daff07" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e28ca864e4c848b59d8b018ac4169c32" is_pre_election: true
I20260709 13:07:27.552610 29573 raft_consensus.cc:2393] T 2af14a7828dc4808aa8fdc9c1c758b85 P bc0a9840c02a4c279170b1c5fe560370 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5481e9936dfb479fa0dd925db3daff07 in current term 1: Already voted for candidate e28ca864e4c848b59d8b018ac4169c32 in this term.
I20260709 13:07:27.553922 29612 leader_election.cc:304] T 2af14a7828dc4808aa8fdc9c1c758b85 P 5481e9936dfb479fa0dd925db3daff07 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5481e9936dfb479fa0dd925db3daff07; no voters: bc0a9840c02a4c279170b1c5fe560370, e28ca864e4c848b59d8b018ac4169c32
I20260709 13:07:27.554540 29721 raft_consensus.cc:3060] T 2af14a7828dc4808aa8fdc9c1c758b85 P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.560911 29721 raft_consensus.cc:2749] T 2af14a7828dc4808aa8fdc9c1c758b85 P 5481e9936dfb479fa0dd925db3daff07 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:27.594908 29648 raft_consensus.cc:3060] T ca6f74116b244bc0929c39ea3913a184 P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.603272 29715 consensus_queue.cc:1048] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:27.616520 29715 consensus_queue.cc:1048] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:27.629014 29715 raft_consensus.cc:493] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.629491 29715 raft_consensus.cc:515] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.631769 29498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5df53243d4c4e27bef57ad8f51bcb6e" candidate_uuid: "bc0a9840c02a4c279170b1c5fe560370" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e28ca864e4c848b59d8b018ac4169c32" is_pre_election: true
I20260709 13:07:27.632158 29648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5df53243d4c4e27bef57ad8f51bcb6e" candidate_uuid: "bc0a9840c02a4c279170b1c5fe560370" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5481e9936dfb479fa0dd925db3daff07" is_pre_election: true
I20260709 13:07:27.632462 29498 raft_consensus.cc:2468] T a5df53243d4c4e27bef57ad8f51bcb6e P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc0a9840c02a4c279170b1c5fe560370 in term 0.
I20260709 13:07:27.632727 29648 raft_consensus.cc:2468] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc0a9840c02a4c279170b1c5fe560370 in term 0.
I20260709 13:07:27.633231 29715 leader_election.cc:290] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1:44833), 5481e9936dfb479fa0dd925db3daff07 (127.28.173.3:42061)
I20260709 13:07:27.633868 29538 leader_election.cc:304] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5481e9936dfb479fa0dd925db3daff07, bc0a9840c02a4c279170b1c5fe560370; no voters: 
I20260709 13:07:27.634609 29715 raft_consensus.cc:2804] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:27.636098 29715 raft_consensus.cc:493] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.636482 29715 raft_consensus.cc:3060] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:27.637387 29443 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:27.641158 29715 raft_consensus.cc:515] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.643426 29715 leader_election.cc:290] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [CANDIDATE]: Term 1 election: Requested vote from peers e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1:44833), 5481e9936dfb479fa0dd925db3daff07 (127.28.173.3:42061)
I20260709 13:07:27.643339 29498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5df53243d4c4e27bef57ad8f51bcb6e" candidate_uuid: "bc0a9840c02a4c279170b1c5fe560370" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e28ca864e4c848b59d8b018ac4169c32"
I20260709 13:07:27.644065 29498 raft_consensus.cc:3060] T a5df53243d4c4e27bef57ad8f51bcb6e P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.643999 29648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5df53243d4c4e27bef57ad8f51bcb6e" candidate_uuid: "bc0a9840c02a4c279170b1c5fe560370" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5481e9936dfb479fa0dd925db3daff07"
I20260709 13:07:27.644630 29648 raft_consensus.cc:3060] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.648358 29498 raft_consensus.cc:2468] T a5df53243d4c4e27bef57ad8f51bcb6e P e28ca864e4c848b59d8b018ac4169c32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc0a9840c02a4c279170b1c5fe560370 in term 1.
I20260709 13:07:27.649313 29538 leader_election.cc:304] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc0a9840c02a4c279170b1c5fe560370, e28ca864e4c848b59d8b018ac4169c32; no voters: 
I20260709 13:07:27.649952 29715 raft_consensus.cc:2804] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:27.650379 29715 raft_consensus.cc:697] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [term 1 LEADER]: Becoming Leader. State: Replica: bc0a9840c02a4c279170b1c5fe560370, State: Running, Role: LEADER
I20260709 13:07:27.650836 29648 raft_consensus.cc:2468] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc0a9840c02a4c279170b1c5fe560370 in term 1.
I20260709 13:07:27.651175 29715 consensus_queue.cc:237] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.659246 29396 catalog_manager.cc:5697] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2). New cstate: current_term: 1 leader_uuid: "bc0a9840c02a4c279170b1c5fe560370" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:27.660377 29701 consensus_queue.cc:1048] T 2af14a7828dc4808aa8fdc9c1c758b85 P e28ca864e4c848b59d8b018ac4169c32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:27.660709 29721 consensus_queue.cc:1048] T 4f69e2661ba745b09237e4ce0494087b P 5481e9936dfb479fa0dd925db3daff07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:27.670461 29498 raft_consensus.cc:3060] T 4f69e2661ba745b09237e4ce0494087b P e28ca864e4c848b59d8b018ac4169c32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.691248 29716 consensus_queue.cc:1048] T d4d2f00fadd04bdd91d3c97ebc76f005 P bc0a9840c02a4c279170b1c5fe560370 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:27.702852 29723 consensus_queue.cc:1048] T 4f69e2661ba745b09237e4ce0494087b P 5481e9936dfb479fa0dd925db3daff07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:27.702575 29721 consensus_queue.cc:1048] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:07:27.706584 29722 consensus_queue.cc:1048] T 2af14a7828dc4808aa8fdc9c1c758b85 P e28ca864e4c848b59d8b018ac4169c32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:27.733739 29700 consensus_queue.cc:1048] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:27.748049 29715 consensus_queue.cc:1048] T d4d2f00fadd04bdd91d3c97ebc76f005 P bc0a9840c02a4c279170b1c5fe560370 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:27.787341 29574 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5df53243d4c4e27bef57ad8f51bcb6e"
dest_uuid: "bc0a9840c02a4c279170b1c5fe560370"
mode: GRACEFUL
new_leader_uuid: "e28ca864e4c848b59d8b018ac4169c32"
 from {username='slave'} at 127.0.0.1:33726
I20260709 13:07:27.787976 29574 raft_consensus.cc:606] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [term 1 LEADER]: Received request to transfer leadership to TS e28ca864e4c848b59d8b018ac4169c32
I20260709 13:07:27.796494 29721 consensus_queue.cc:1048] T 2ef4ec98706b46e2a2ff852dca7ee48e P 5481e9936dfb479fa0dd925db3daff07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:27.812206 29721 consensus_queue.cc:1048] T 2ef4ec98706b46e2a2ff852dca7ee48e P 5481e9936dfb479fa0dd925db3daff07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:27.823457 29648 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f69e2661ba745b09237e4ce0494087b"
dest_uuid: "5481e9936dfb479fa0dd925db3daff07"
mode: GRACEFUL
new_leader_uuid: "e28ca864e4c848b59d8b018ac4169c32"
 from {username='slave'} at 127.0.0.1:52382
I20260709 13:07:27.824113 29648 raft_consensus.cc:606] T 4f69e2661ba745b09237e4ce0494087b P 5481e9936dfb479fa0dd925db3daff07 [term 1 LEADER]: Received request to transfer leadership to TS e28ca864e4c848b59d8b018ac4169c32
I20260709 13:07:27.830013 29648 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbc21554b6344107baedcec570f26b37"
dest_uuid: "5481e9936dfb479fa0dd925db3daff07"
mode: GRACEFUL
new_leader_uuid: "bc0a9840c02a4c279170b1c5fe560370"
 from {username='slave'} at 127.0.0.1:52382
I20260709 13:07:27.830601 29648 raft_consensus.cc:606] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07 [term 1 LEADER]: Received request to transfer leadership to TS bc0a9840c02a4c279170b1c5fe560370
I20260709 13:07:27.839625 29648 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d25bbcb97f44813aa8241e230434f74"
dest_uuid: "5481e9936dfb479fa0dd925db3daff07"
mode: GRACEFUL
new_leader_uuid: "bc0a9840c02a4c279170b1c5fe560370"
 from {username='slave'} at 127.0.0.1:52382
I20260709 13:07:27.840226 29648 raft_consensus.cc:606] T 8d25bbcb97f44813aa8241e230434f74 P 5481e9936dfb479fa0dd925db3daff07 [term 1 LEADER]: Received request to transfer leadership to TS bc0a9840c02a4c279170b1c5fe560370
I20260709 13:07:27.862931 29722 consensus_queue.cc:1048] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:27.874146 29701 consensus_queue.cc:1048] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:27.904012 29721 consensus_queue.cc:1048] T 8d25bbcb97f44813aa8241e230434f74 P 5481e9936dfb479fa0dd925db3daff07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:27.916118 29700 consensus_queue.cc:1048] T 8d25bbcb97f44813aa8241e230434f74 P 5481e9936dfb479fa0dd925db3daff07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:27.924496 29723 raft_consensus.cc:993] T 8d25bbcb97f44813aa8241e230434f74 P 5481e9936dfb479fa0dd925db3daff07: : Instructing follower bc0a9840c02a4c279170b1c5fe560370 to start an election
I20260709 13:07:27.924985 29700 raft_consensus.cc:1081] T 8d25bbcb97f44813aa8241e230434f74 P 5481e9936dfb479fa0dd925db3daff07 [term 1 LEADER]: Signalling peer bc0a9840c02a4c279170b1c5fe560370 to start an election
I20260709 13:07:27.926836 29574 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d25bbcb97f44813aa8241e230434f74"
dest_uuid: "bc0a9840c02a4c279170b1c5fe560370"
 from {username='slave'} at 127.0.0.1:33718
I20260709 13:07:27.928246 29574 raft_consensus.cc:493] T 8d25bbcb97f44813aa8241e230434f74 P bc0a9840c02a4c279170b1c5fe560370 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:27.928570 29574 raft_consensus.cc:3060] T 8d25bbcb97f44813aa8241e230434f74 P bc0a9840c02a4c279170b1c5fe560370 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:27.934479 29574 raft_consensus.cc:515] T 8d25bbcb97f44813aa8241e230434f74 P bc0a9840c02a4c279170b1c5fe560370 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.936067 29574 leader_election.cc:290] T 8d25bbcb97f44813aa8241e230434f74 P bc0a9840c02a4c279170b1c5fe560370 [CANDIDATE]: Term 2 election: Requested vote from peers e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1:44833), 5481e9936dfb479fa0dd925db3daff07 (127.28.173.3:42061)
I20260709 13:07:27.936808 29497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d25bbcb97f44813aa8241e230434f74" candidate_uuid: "bc0a9840c02a4c279170b1c5fe560370" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e28ca864e4c848b59d8b018ac4169c32"
I20260709 13:07:27.937078 29648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d25bbcb97f44813aa8241e230434f74" candidate_uuid: "bc0a9840c02a4c279170b1c5fe560370" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5481e9936dfb479fa0dd925db3daff07"
I20260709 13:07:27.937418 29497 raft_consensus.cc:3060] T 8d25bbcb97f44813aa8241e230434f74 P e28ca864e4c848b59d8b018ac4169c32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:27.937651 29648 raft_consensus.cc:3055] T 8d25bbcb97f44813aa8241e230434f74 P 5481e9936dfb479fa0dd925db3daff07 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:27.938007 29648 raft_consensus.cc:740] T 8d25bbcb97f44813aa8241e230434f74 P 5481e9936dfb479fa0dd925db3daff07 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5481e9936dfb479fa0dd925db3daff07, State: Running, Role: LEADER
I20260709 13:07:27.938730 29648 consensus_queue.cc:260] T 8d25bbcb97f44813aa8241e230434f74 P 5481e9936dfb479fa0dd925db3daff07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.939710 29648 raft_consensus.cc:3060] T 8d25bbcb97f44813aa8241e230434f74 P 5481e9936dfb479fa0dd925db3daff07 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:27.943643 29648 raft_consensus.cc:2468] T 8d25bbcb97f44813aa8241e230434f74 P 5481e9936dfb479fa0dd925db3daff07 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc0a9840c02a4c279170b1c5fe560370 in term 2.
I20260709 13:07:27.943943 29497 raft_consensus.cc:2468] T 8d25bbcb97f44813aa8241e230434f74 P e28ca864e4c848b59d8b018ac4169c32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc0a9840c02a4c279170b1c5fe560370 in term 2.
I20260709 13:07:27.944690 29538 leader_election.cc:304] T 8d25bbcb97f44813aa8241e230434f74 P bc0a9840c02a4c279170b1c5fe560370 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5481e9936dfb479fa0dd925db3daff07, bc0a9840c02a4c279170b1c5fe560370; no voters: 
I20260709 13:07:27.945477 29762 raft_consensus.cc:2804] T 8d25bbcb97f44813aa8241e230434f74 P bc0a9840c02a4c279170b1c5fe560370 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:27.945961 29762 raft_consensus.cc:697] T 8d25bbcb97f44813aa8241e230434f74 P bc0a9840c02a4c279170b1c5fe560370 [term 2 LEADER]: Becoming Leader. State: Replica: bc0a9840c02a4c279170b1c5fe560370, State: Running, Role: LEADER
I20260709 13:07:27.946633 29762 consensus_queue.cc:237] T 8d25bbcb97f44813aa8241e230434f74 P bc0a9840c02a4c279170b1c5fe560370 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:27.952490 29395 catalog_manager.cc:5697] T 8d25bbcb97f44813aa8241e230434f74 P bc0a9840c02a4c279170b1c5fe560370 reported cstate change: term changed from 1 to 2, leader changed from 5481e9936dfb479fa0dd925db3daff07 (127.28.173.3) to bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2). New cstate: current_term: 2 leader_uuid: "bc0a9840c02a4c279170b1c5fe560370" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:28.164281 29721 raft_consensus.cc:993] T 4f69e2661ba745b09237e4ce0494087b P 5481e9936dfb479fa0dd925db3daff07: : Instructing follower e28ca864e4c848b59d8b018ac4169c32 to start an election
I20260709 13:07:28.164772 29721 raft_consensus.cc:1081] T 4f69e2661ba745b09237e4ce0494087b P 5481e9936dfb479fa0dd925db3daff07 [term 1 LEADER]: Signalling peer e28ca864e4c848b59d8b018ac4169c32 to start an election
I20260709 13:07:28.166430 29497 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4f69e2661ba745b09237e4ce0494087b"
dest_uuid: "e28ca864e4c848b59d8b018ac4169c32"
 from {username='slave'} at 127.0.0.1:42968
I20260709 13:07:28.166996 29497 raft_consensus.cc:493] T 4f69e2661ba745b09237e4ce0494087b P e28ca864e4c848b59d8b018ac4169c32 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:28.167402 29497 raft_consensus.cc:3060] T 4f69e2661ba745b09237e4ce0494087b P e28ca864e4c848b59d8b018ac4169c32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:28.173050 29497 raft_consensus.cc:515] T 4f69e2661ba745b09237e4ce0494087b P e28ca864e4c848b59d8b018ac4169c32 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:28.174822 29497 leader_election.cc:290] T 4f69e2661ba745b09237e4ce0494087b P e28ca864e4c848b59d8b018ac4169c32 [CANDIDATE]: Term 2 election: Requested vote from peers bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2:40589), 5481e9936dfb479fa0dd925db3daff07 (127.28.173.3:42061)
I20260709 13:07:28.176011 29648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f69e2661ba745b09237e4ce0494087b" candidate_uuid: "e28ca864e4c848b59d8b018ac4169c32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5481e9936dfb479fa0dd925db3daff07"
I20260709 13:07:28.176514 29648 raft_consensus.cc:3055] T 4f69e2661ba745b09237e4ce0494087b P 5481e9936dfb479fa0dd925db3daff07 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:28.176384 29574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f69e2661ba745b09237e4ce0494087b" candidate_uuid: "e28ca864e4c848b59d8b018ac4169c32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc0a9840c02a4c279170b1c5fe560370"
I20260709 13:07:28.176846 29648 raft_consensus.cc:740] T 4f69e2661ba745b09237e4ce0494087b P 5481e9936dfb479fa0dd925db3daff07 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5481e9936dfb479fa0dd925db3daff07, State: Running, Role: LEADER
I20260709 13:07:28.177011 29574 raft_consensus.cc:3060] T 4f69e2661ba745b09237e4ce0494087b P bc0a9840c02a4c279170b1c5fe560370 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:28.177582 29648 consensus_queue.cc:260] T 4f69e2661ba745b09237e4ce0494087b P 5481e9936dfb479fa0dd925db3daff07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:28.178560 29648 raft_consensus.cc:3060] T 4f69e2661ba745b09237e4ce0494087b P 5481e9936dfb479fa0dd925db3daff07 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:28.182780 29648 raft_consensus.cc:2468] T 4f69e2661ba745b09237e4ce0494087b P 5481e9936dfb479fa0dd925db3daff07 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28ca864e4c848b59d8b018ac4169c32 in term 2.
I20260709 13:07:28.183743 29463 leader_election.cc:304] T 4f69e2661ba745b09237e4ce0494087b P e28ca864e4c848b59d8b018ac4169c32 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5481e9936dfb479fa0dd925db3daff07, e28ca864e4c848b59d8b018ac4169c32; no voters: 
I20260709 13:07:28.183902 29574 raft_consensus.cc:2468] T 4f69e2661ba745b09237e4ce0494087b P bc0a9840c02a4c279170b1c5fe560370 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28ca864e4c848b59d8b018ac4169c32 in term 2.
I20260709 13:07:28.184577 29768 raft_consensus.cc:2804] T 4f69e2661ba745b09237e4ce0494087b P e28ca864e4c848b59d8b018ac4169c32 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:28.185217 29768 raft_consensus.cc:697] T 4f69e2661ba745b09237e4ce0494087b P e28ca864e4c848b59d8b018ac4169c32 [term 2 LEADER]: Becoming Leader. State: Replica: e28ca864e4c848b59d8b018ac4169c32, State: Running, Role: LEADER
I20260709 13:07:28.186148 29768 consensus_queue.cc:237] T 4f69e2661ba745b09237e4ce0494087b P e28ca864e4c848b59d8b018ac4169c32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:28.194602 29395 catalog_manager.cc:5697] T 4f69e2661ba745b09237e4ce0494087b P e28ca864e4c848b59d8b018ac4169c32 reported cstate change: term changed from 1 to 2, leader changed from 5481e9936dfb479fa0dd925db3daff07 (127.28.173.3) to e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1). New cstate: current_term: 2 leader_uuid: "e28ca864e4c848b59d8b018ac4169c32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:28.214629 29762 consensus_queue.cc:1048] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:28.233896 29756 consensus_queue.cc:1048] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:28.243893 29756 raft_consensus.cc:993] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370: : Instructing follower e28ca864e4c848b59d8b018ac4169c32 to start an election
I20260709 13:07:28.244321 29756 raft_consensus.cc:1081] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [term 1 LEADER]: Signalling peer e28ca864e4c848b59d8b018ac4169c32 to start an election
I20260709 13:07:28.245972 29498 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5df53243d4c4e27bef57ad8f51bcb6e"
dest_uuid: "e28ca864e4c848b59d8b018ac4169c32"
 from {username='slave'} at 127.0.0.1:42958
I20260709 13:07:28.246527 29498 raft_consensus.cc:493] T a5df53243d4c4e27bef57ad8f51bcb6e P e28ca864e4c848b59d8b018ac4169c32 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:28.246891 29498 raft_consensus.cc:3060] T a5df53243d4c4e27bef57ad8f51bcb6e P e28ca864e4c848b59d8b018ac4169c32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:28.253436 29498 raft_consensus.cc:515] T a5df53243d4c4e27bef57ad8f51bcb6e P e28ca864e4c848b59d8b018ac4169c32 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:28.256057 29574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5df53243d4c4e27bef57ad8f51bcb6e" candidate_uuid: "e28ca864e4c848b59d8b018ac4169c32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc0a9840c02a4c279170b1c5fe560370"
I20260709 13:07:28.256651 29647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5df53243d4c4e27bef57ad8f51bcb6e" candidate_uuid: "e28ca864e4c848b59d8b018ac4169c32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5481e9936dfb479fa0dd925db3daff07"
I20260709 13:07:28.255316 29498 leader_election.cc:290] T a5df53243d4c4e27bef57ad8f51bcb6e P e28ca864e4c848b59d8b018ac4169c32 [CANDIDATE]: Term 2 election: Requested vote from peers bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2:40589), 5481e9936dfb479fa0dd925db3daff07 (127.28.173.3:42061)
I20260709 13:07:28.256664 29574 raft_consensus.cc:3055] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:28.257792 29574 raft_consensus.cc:740] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc0a9840c02a4c279170b1c5fe560370, State: Running, Role: LEADER
I20260709 13:07:28.257269 29647 raft_consensus.cc:3060] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:28.258618 29574 consensus_queue.cc:260] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:28.259968 29574 raft_consensus.cc:3060] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:28.264472 29574 raft_consensus.cc:2468] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28ca864e4c848b59d8b018ac4169c32 in term 2.
I20260709 13:07:28.265019 29647 raft_consensus.cc:2468] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28ca864e4c848b59d8b018ac4169c32 in term 2.
I20260709 13:07:28.265486 29463 leader_election.cc:304] T a5df53243d4c4e27bef57ad8f51bcb6e P e28ca864e4c848b59d8b018ac4169c32 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc0a9840c02a4c279170b1c5fe560370, e28ca864e4c848b59d8b018ac4169c32; no voters: 
I20260709 13:07:28.266271 29768 raft_consensus.cc:2804] T a5df53243d4c4e27bef57ad8f51bcb6e P e28ca864e4c848b59d8b018ac4169c32 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:28.266741 29768 raft_consensus.cc:697] T a5df53243d4c4e27bef57ad8f51bcb6e P e28ca864e4c848b59d8b018ac4169c32 [term 2 LEADER]: Becoming Leader. State: Replica: e28ca864e4c848b59d8b018ac4169c32, State: Running, Role: LEADER
I20260709 13:07:28.267516 29768 consensus_queue.cc:237] T a5df53243d4c4e27bef57ad8f51bcb6e P e28ca864e4c848b59d8b018ac4169c32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:28.273080 29395 catalog_manager.cc:5697] T a5df53243d4c4e27bef57ad8f51bcb6e P e28ca864e4c848b59d8b018ac4169c32 reported cstate change: term changed from 1 to 2, leader changed from bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2) to e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1). New cstate: current_term: 2 leader_uuid: "e28ca864e4c848b59d8b018ac4169c32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:28.314630 29723 raft_consensus.cc:993] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07: : Instructing follower bc0a9840c02a4c279170b1c5fe560370 to start an election
I20260709 13:07:28.315104 29700 raft_consensus.cc:1081] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07 [term 1 LEADER]: Signalling peer bc0a9840c02a4c279170b1c5fe560370 to start an election
I20260709 13:07:28.316524 29574 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dbc21554b6344107baedcec570f26b37"
dest_uuid: "bc0a9840c02a4c279170b1c5fe560370"
 from {username='slave'} at 127.0.0.1:33718
I20260709 13:07:28.317018 29574 raft_consensus.cc:493] T dbc21554b6344107baedcec570f26b37 P bc0a9840c02a4c279170b1c5fe560370 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:28.317340 29574 raft_consensus.cc:3060] T dbc21554b6344107baedcec570f26b37 P bc0a9840c02a4c279170b1c5fe560370 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:28.321772 29574 raft_consensus.cc:515] T dbc21554b6344107baedcec570f26b37 P bc0a9840c02a4c279170b1c5fe560370 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:28.323531 29574 leader_election.cc:290] T dbc21554b6344107baedcec570f26b37 P bc0a9840c02a4c279170b1c5fe560370 [CANDIDATE]: Term 2 election: Requested vote from peers e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1:44833), 5481e9936dfb479fa0dd925db3daff07 (127.28.173.3:42061)
I20260709 13:07:28.324577 29647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc21554b6344107baedcec570f26b37" candidate_uuid: "bc0a9840c02a4c279170b1c5fe560370" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5481e9936dfb479fa0dd925db3daff07"
I20260709 13:07:28.324651 29498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc21554b6344107baedcec570f26b37" candidate_uuid: "bc0a9840c02a4c279170b1c5fe560370" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e28ca864e4c848b59d8b018ac4169c32"
I20260709 13:07:28.325237 29647 raft_consensus.cc:3055] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:28.325366 29498 raft_consensus.cc:3060] T dbc21554b6344107baedcec570f26b37 P e28ca864e4c848b59d8b018ac4169c32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:28.325593 29647 raft_consensus.cc:740] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5481e9936dfb479fa0dd925db3daff07, State: Running, Role: LEADER
I20260709 13:07:28.326426 29647 consensus_queue.cc:260] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:28.327590 29647 raft_consensus.cc:3060] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:28.330082 29498 raft_consensus.cc:2468] T dbc21554b6344107baedcec570f26b37 P e28ca864e4c848b59d8b018ac4169c32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc0a9840c02a4c279170b1c5fe560370 in term 2.
I20260709 13:07:28.331017 29538 leader_election.cc:304] T dbc21554b6344107baedcec570f26b37 P bc0a9840c02a4c279170b1c5fe560370 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc0a9840c02a4c279170b1c5fe560370, e28ca864e4c848b59d8b018ac4169c32; no voters: 
I20260709 13:07:28.331671 29756 raft_consensus.cc:2804] T dbc21554b6344107baedcec570f26b37 P bc0a9840c02a4c279170b1c5fe560370 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:28.332165 29756 raft_consensus.cc:697] T dbc21554b6344107baedcec570f26b37 P bc0a9840c02a4c279170b1c5fe560370 [term 2 LEADER]: Becoming Leader. State: Replica: bc0a9840c02a4c279170b1c5fe560370, State: Running, Role: LEADER
I20260709 13:07:28.332949 29756 consensus_queue.cc:237] T dbc21554b6344107baedcec570f26b37 P bc0a9840c02a4c279170b1c5fe560370 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:28.333906 29647 raft_consensus.cc:2468] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc0a9840c02a4c279170b1c5fe560370 in term 2.
I20260709 13:07:28.339425 29395 catalog_manager.cc:5697] T dbc21554b6344107baedcec570f26b37 P bc0a9840c02a4c279170b1c5fe560370 reported cstate change: term changed from 1 to 2, leader changed from 5481e9936dfb479fa0dd925db3daff07 (127.28.173.3) to bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2). New cstate: current_term: 2 leader_uuid: "bc0a9840c02a4c279170b1c5fe560370" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:28.402971 29498 raft_consensus.cc:1275] T 8d25bbcb97f44813aa8241e230434f74 P e28ca864e4c848b59d8b018ac4169c32 [term 2 FOLLOWER]: Refusing update from remote peer bc0a9840c02a4c279170b1c5fe560370: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:28.404189 29715 consensus_queue.cc:1048] T 8d25bbcb97f44813aa8241e230434f74 P bc0a9840c02a4c279170b1c5fe560370 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:28.411290 29647 raft_consensus.cc:1275] T 8d25bbcb97f44813aa8241e230434f74 P 5481e9936dfb479fa0dd925db3daff07 [term 2 FOLLOWER]: Refusing update from remote peer bc0a9840c02a4c279170b1c5fe560370: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:28.412663 29715 consensus_queue.cc:1048] T 8d25bbcb97f44813aa8241e230434f74 P bc0a9840c02a4c279170b1c5fe560370 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:28.682238 29647 raft_consensus.cc:1275] T 4f69e2661ba745b09237e4ce0494087b P 5481e9936dfb479fa0dd925db3daff07 [term 2 FOLLOWER]: Refusing update from remote peer e28ca864e4c848b59d8b018ac4169c32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:28.683853 29768 consensus_queue.cc:1048] T 4f69e2661ba745b09237e4ce0494087b P e28ca864e4c848b59d8b018ac4169c32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:28.685720 29574 raft_consensus.cc:1275] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [term 2 FOLLOWER]: Refusing update from remote peer e28ca864e4c848b59d8b018ac4169c32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:28.687074 29768 consensus_queue.cc:1048] T a5df53243d4c4e27bef57ad8f51bcb6e P e28ca864e4c848b59d8b018ac4169c32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:28.691538 29572 raft_consensus.cc:1275] T 4f69e2661ba745b09237e4ce0494087b P bc0a9840c02a4c279170b1c5fe560370 [term 2 FOLLOWER]: Refusing update from remote peer e28ca864e4c848b59d8b018ac4169c32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:28.693081 29768 consensus_queue.cc:1048] T 4f69e2661ba745b09237e4ce0494087b P e28ca864e4c848b59d8b018ac4169c32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:28.700974 29647 raft_consensus.cc:1275] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [term 2 FOLLOWER]: Refusing update from remote peer e28ca864e4c848b59d8b018ac4169c32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:28.702929 29774 consensus_queue.cc:1048] T a5df53243d4c4e27bef57ad8f51bcb6e P e28ca864e4c848b59d8b018ac4169c32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:28.828102 29647 raft_consensus.cc:1275] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07 [term 2 FOLLOWER]: Refusing update from remote peer bc0a9840c02a4c279170b1c5fe560370: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:28.829288 29715 consensus_queue.cc:1048] T dbc21554b6344107baedcec570f26b37 P bc0a9840c02a4c279170b1c5fe560370 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:28.837253 29498 raft_consensus.cc:1275] T dbc21554b6344107baedcec570f26b37 P e28ca864e4c848b59d8b018ac4169c32 [term 2 FOLLOWER]: Refusing update from remote peer bc0a9840c02a4c279170b1c5fe560370: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:28.838610 29715 consensus_queue.cc:1048] T dbc21554b6344107baedcec570f26b37 P bc0a9840c02a4c279170b1c5fe560370 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:30.874588 29364 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:07:30.875385 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:30.903604 29498 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5df53243d4c4e27bef57ad8f51bcb6e"
dest_uuid: "e28ca864e4c848b59d8b018ac4169c32"
mode: GRACEFUL
new_leader_uuid: "5481e9936dfb479fa0dd925db3daff07"
 from {username='slave'} at 127.0.0.1:44200
I20260709 13:07:30.904197 29498 raft_consensus.cc:606] T a5df53243d4c4e27bef57ad8f51bcb6e P e28ca864e4c848b59d8b018ac4169c32 [term 2 LEADER]: Received request to transfer leadership to TS 5481e9936dfb479fa0dd925db3daff07
I20260709 13:07:30.913787 29574 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca6f74116b244bc0929c39ea3913a184"
dest_uuid: "bc0a9840c02a4c279170b1c5fe560370"
mode: GRACEFUL
new_leader_uuid: "5481e9936dfb479fa0dd925db3daff07"
 from {username='slave'} at 127.0.0.1:52614
I20260709 13:07:30.914286 29574 raft_consensus.cc:606] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [term 1 LEADER]: Received request to transfer leadership to TS 5481e9936dfb479fa0dd925db3daff07
I20260709 13:07:30.915274 29364 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:07:30.915709 29364 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:31.112160 29774 raft_consensus.cc:993] T a5df53243d4c4e27bef57ad8f51bcb6e P e28ca864e4c848b59d8b018ac4169c32: : Instructing follower 5481e9936dfb479fa0dd925db3daff07 to start an election
I20260709 13:07:31.112715 29781 raft_consensus.cc:1081] T a5df53243d4c4e27bef57ad8f51bcb6e P e28ca864e4c848b59d8b018ac4169c32 [term 2 LEADER]: Signalling peer 5481e9936dfb479fa0dd925db3daff07 to start an election
I20260709 13:07:31.114197 29647 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5df53243d4c4e27bef57ad8f51bcb6e"
dest_uuid: "5481e9936dfb479fa0dd925db3daff07"
 from {username='slave'} at 127.0.0.1:52366
I20260709 13:07:31.114650 29647 raft_consensus.cc:493] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:31.114959 29647 raft_consensus.cc:3060] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:31.119140 29647 raft_consensus.cc:515] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:31.120645 29647 leader_election.cc:290] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [CANDIDATE]: Term 3 election: Requested vote from peers e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1:44833), bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2:40589)
I20260709 13:07:31.121477 29498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5df53243d4c4e27bef57ad8f51bcb6e" candidate_uuid: "5481e9936dfb479fa0dd925db3daff07" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e28ca864e4c848b59d8b018ac4169c32"
I20260709 13:07:31.121670 29574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5df53243d4c4e27bef57ad8f51bcb6e" candidate_uuid: "5481e9936dfb479fa0dd925db3daff07" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bc0a9840c02a4c279170b1c5fe560370"
I20260709 13:07:31.122089 29498 raft_consensus.cc:3055] T a5df53243d4c4e27bef57ad8f51bcb6e P e28ca864e4c848b59d8b018ac4169c32 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:31.122182 29574 raft_consensus.cc:3060] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:31.122403 29498 raft_consensus.cc:740] T a5df53243d4c4e27bef57ad8f51bcb6e P e28ca864e4c848b59d8b018ac4169c32 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e28ca864e4c848b59d8b018ac4169c32, State: Running, Role: LEADER
I20260709 13:07:31.123157 29498 consensus_queue.cc:260] T a5df53243d4c4e27bef57ad8f51bcb6e P e28ca864e4c848b59d8b018ac4169c32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:31.124090 29498 raft_consensus.cc:3060] T a5df53243d4c4e27bef57ad8f51bcb6e P e28ca864e4c848b59d8b018ac4169c32 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:31.126791 29574 raft_consensus.cc:2468] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5481e9936dfb479fa0dd925db3daff07 in term 3.
I20260709 13:07:31.127884 29612 leader_election.cc:304] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5481e9936dfb479fa0dd925db3daff07, bc0a9840c02a4c279170b1c5fe560370; no voters: 
I20260709 13:07:31.128562 29700 raft_consensus.cc:2804] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:31.129078 29498 raft_consensus.cc:2468] T a5df53243d4c4e27bef57ad8f51bcb6e P e28ca864e4c848b59d8b018ac4169c32 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5481e9936dfb479fa0dd925db3daff07 in term 3.
I20260709 13:07:31.129814 29700 raft_consensus.cc:697] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [term 3 LEADER]: Becoming Leader. State: Replica: 5481e9936dfb479fa0dd925db3daff07, State: Running, Role: LEADER
I20260709 13:07:31.130695 29700 consensus_queue.cc:237] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:31.137579 29393 catalog_manager.cc:5697] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 reported cstate change: term changed from 2 to 3, leader changed from e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1) to 5481e9936dfb479fa0dd925db3daff07 (127.28.173.3). New cstate: current_term: 3 leader_uuid: "5481e9936dfb479fa0dd925db3daff07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:31.297626 29788 raft_consensus.cc:993] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370: : Instructing follower 5481e9936dfb479fa0dd925db3daff07 to start an election
I20260709 13:07:31.298105 29715 raft_consensus.cc:1081] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [term 1 LEADER]: Signalling peer 5481e9936dfb479fa0dd925db3daff07 to start an election
I20260709 13:07:31.299590 29647 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca6f74116b244bc0929c39ea3913a184"
dest_uuid: "5481e9936dfb479fa0dd925db3daff07"
 from {username='slave'} at 127.0.0.1:52356
I20260709 13:07:31.300194 29647 raft_consensus.cc:493] T ca6f74116b244bc0929c39ea3913a184 P 5481e9936dfb479fa0dd925db3daff07 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:31.300513 29647 raft_consensus.cc:3060] T ca6f74116b244bc0929c39ea3913a184 P 5481e9936dfb479fa0dd925db3daff07 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:31.304983 29647 raft_consensus.cc:515] T ca6f74116b244bc0929c39ea3913a184 P 5481e9936dfb479fa0dd925db3daff07 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:31.306495 29647 leader_election.cc:290] T ca6f74116b244bc0929c39ea3913a184 P 5481e9936dfb479fa0dd925db3daff07 [CANDIDATE]: Term 2 election: Requested vote from peers e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1:44833), bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2:40589)
I20260709 13:07:31.307264 29498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6f74116b244bc0929c39ea3913a184" candidate_uuid: "5481e9936dfb479fa0dd925db3daff07" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e28ca864e4c848b59d8b018ac4169c32"
I20260709 13:07:31.307462 29574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6f74116b244bc0929c39ea3913a184" candidate_uuid: "5481e9936dfb479fa0dd925db3daff07" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc0a9840c02a4c279170b1c5fe560370"
I20260709 13:07:31.307899 29498 raft_consensus.cc:3060] T ca6f74116b244bc0929c39ea3913a184 P e28ca864e4c848b59d8b018ac4169c32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:31.308001 29574 raft_consensus.cc:3055] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:31.308416 29574 raft_consensus.cc:740] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc0a9840c02a4c279170b1c5fe560370, State: Running, Role: LEADER
I20260709 13:07:31.309221 29574 consensus_queue.cc:260] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:31.310413 29574 raft_consensus.cc:3060] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:31.314723 29498 raft_consensus.cc:2468] T ca6f74116b244bc0929c39ea3913a184 P e28ca864e4c848b59d8b018ac4169c32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5481e9936dfb479fa0dd925db3daff07 in term 2.
I20260709 13:07:31.315840 29612 leader_election.cc:304] T ca6f74116b244bc0929c39ea3913a184 P 5481e9936dfb479fa0dd925db3daff07 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5481e9936dfb479fa0dd925db3daff07, e28ca864e4c848b59d8b018ac4169c32; no voters: 
I20260709 13:07:31.316603 29700 raft_consensus.cc:2804] T ca6f74116b244bc0929c39ea3913a184 P 5481e9936dfb479fa0dd925db3daff07 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:31.316865 29574 raft_consensus.cc:2468] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5481e9936dfb479fa0dd925db3daff07 in term 2.
I20260709 13:07:31.317018 29700 raft_consensus.cc:697] T ca6f74116b244bc0929c39ea3913a184 P 5481e9936dfb479fa0dd925db3daff07 [term 2 LEADER]: Becoming Leader. State: Replica: 5481e9936dfb479fa0dd925db3daff07, State: Running, Role: LEADER
I20260709 13:07:31.317842 29700 consensus_queue.cc:237] T ca6f74116b244bc0929c39ea3913a184 P 5481e9936dfb479fa0dd925db3daff07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:31.326524 29393 catalog_manager.cc:5697] T ca6f74116b244bc0929c39ea3913a184 P 5481e9936dfb479fa0dd925db3daff07 reported cstate change: term changed from 1 to 2, leader changed from bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2) to 5481e9936dfb479fa0dd925db3daff07 (127.28.173.3). New cstate: current_term: 2 leader_uuid: "5481e9936dfb479fa0dd925db3daff07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:31.740399 29574 raft_consensus.cc:1275] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [term 3 FOLLOWER]: Refusing update from remote peer 5481e9936dfb479fa0dd925db3daff07: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:31.741556 29700 consensus_queue.cc:1048] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:31.750576 29498 raft_consensus.cc:1275] T a5df53243d4c4e27bef57ad8f51bcb6e P e28ca864e4c848b59d8b018ac4169c32 [term 3 FOLLOWER]: Refusing update from remote peer 5481e9936dfb479fa0dd925db3daff07: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:31.752455 29782 consensus_queue.cc:1048] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:31.776337 29574 raft_consensus.cc:1275] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [term 2 FOLLOWER]: Refusing update from remote peer 5481e9936dfb479fa0dd925db3daff07: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:31.777499 29792 consensus_queue.cc:1048] T ca6f74116b244bc0929c39ea3913a184 P 5481e9936dfb479fa0dd925db3daff07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:31.785665 29497 raft_consensus.cc:1275] T ca6f74116b244bc0929c39ea3913a184 P e28ca864e4c848b59d8b018ac4169c32 [term 2 FOLLOWER]: Refusing update from remote peer 5481e9936dfb479fa0dd925db3daff07: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:31.787611 29700 consensus_queue.cc:1048] T ca6f74116b244bc0929c39ea3913a184 P 5481e9936dfb479fa0dd925db3daff07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:31.916559 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:31.933843 29497 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2af14a7828dc4808aa8fdc9c1c758b85"
dest_uuid: "e28ca864e4c848b59d8b018ac4169c32"
mode: GRACEFUL
new_leader_uuid: "bc0a9840c02a4c279170b1c5fe560370"
 from {username='slave'} at 127.0.0.1:44216
I20260709 13:07:31.934293 29497 raft_consensus.cc:606] T 2af14a7828dc4808aa8fdc9c1c758b85 P e28ca864e4c848b59d8b018ac4169c32 [term 1 LEADER]: Received request to transfer leadership to TS bc0a9840c02a4c279170b1c5fe560370
I20260709 13:07:31.938670 29647 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5df53243d4c4e27bef57ad8f51bcb6e"
dest_uuid: "5481e9936dfb479fa0dd925db3daff07"
mode: GRACEFUL
new_leader_uuid: "bc0a9840c02a4c279170b1c5fe560370"
 from {username='slave'} at 127.0.0.1:52382
I20260709 13:07:31.939090 29647 raft_consensus.cc:606] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [term 3 LEADER]: Received request to transfer leadership to TS bc0a9840c02a4c279170b1c5fe560370
I20260709 13:07:31.943435 29497 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e01ba93272b5460a8e453d93659b85ae"
dest_uuid: "e28ca864e4c848b59d8b018ac4169c32"
mode: GRACEFUL
new_leader_uuid: "bc0a9840c02a4c279170b1c5fe560370"
 from {username='slave'} at 127.0.0.1:44216
I20260709 13:07:31.943909 29497 raft_consensus.cc:606] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32 [term 1 LEADER]: Received request to transfer leadership to TS bc0a9840c02a4c279170b1c5fe560370
I20260709 13:07:31.948338 29497 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f69e2661ba745b09237e4ce0494087b"
dest_uuid: "e28ca864e4c848b59d8b018ac4169c32"
mode: GRACEFUL
new_leader_uuid: "bc0a9840c02a4c279170b1c5fe560370"
 from {username='slave'} at 127.0.0.1:44216
I20260709 13:07:31.948797 29497 raft_consensus.cc:606] T 4f69e2661ba745b09237e4ce0494087b P e28ca864e4c848b59d8b018ac4169c32 [term 2 LEADER]: Received request to transfer leadership to TS bc0a9840c02a4c279170b1c5fe560370
I20260709 13:07:31.959733 29647 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca6f74116b244bc0929c39ea3913a184"
dest_uuid: "5481e9936dfb479fa0dd925db3daff07"
mode: GRACEFUL
new_leader_uuid: "bc0a9840c02a4c279170b1c5fe560370"
 from {username='slave'} at 127.0.0.1:52382
I20260709 13:07:31.960242 29647 raft_consensus.cc:606] T ca6f74116b244bc0929c39ea3913a184 P 5481e9936dfb479fa0dd925db3daff07 [term 2 LEADER]: Received request to transfer leadership to TS bc0a9840c02a4c279170b1c5fe560370
I20260709 13:07:32.016129 29800 raft_consensus.cc:993] T 2af14a7828dc4808aa8fdc9c1c758b85 P e28ca864e4c848b59d8b018ac4169c32: : Instructing follower bc0a9840c02a4c279170b1c5fe560370 to start an election
I20260709 13:07:32.016562 29781 raft_consensus.cc:1081] T 2af14a7828dc4808aa8fdc9c1c758b85 P e28ca864e4c848b59d8b018ac4169c32 [term 1 LEADER]: Signalling peer bc0a9840c02a4c279170b1c5fe560370 to start an election
I20260709 13:07:32.017966 29574 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2af14a7828dc4808aa8fdc9c1c758b85"
dest_uuid: "bc0a9840c02a4c279170b1c5fe560370"
 from {username='slave'} at 127.0.0.1:33708
I20260709 13:07:32.018414 29574 raft_consensus.cc:493] T 2af14a7828dc4808aa8fdc9c1c758b85 P bc0a9840c02a4c279170b1c5fe560370 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:32.018661 29574 raft_consensus.cc:3060] T 2af14a7828dc4808aa8fdc9c1c758b85 P bc0a9840c02a4c279170b1c5fe560370 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:32.022838 29574 raft_consensus.cc:515] T 2af14a7828dc4808aa8fdc9c1c758b85 P bc0a9840c02a4c279170b1c5fe560370 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } } peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } }
I20260709 13:07:32.024353 29574 leader_election.cc:290] T 2af14a7828dc4808aa8fdc9c1c758b85 P bc0a9840c02a4c279170b1c5fe560370 [CANDIDATE]: Term 2 election: Requested vote from peers 5481e9936dfb479fa0dd925db3daff07 (127.28.173.3:42061), e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1:44833)
I20260709 13:07:32.025286 29647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af14a7828dc4808aa8fdc9c1c758b85" candidate_uuid: "bc0a9840c02a4c279170b1c5fe560370" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5481e9936dfb479fa0dd925db3daff07"
I20260709 13:07:32.025568 29497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2af14a7828dc4808aa8fdc9c1c758b85" candidate_uuid: "bc0a9840c02a4c279170b1c5fe560370" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e28ca864e4c848b59d8b018ac4169c32"
I20260709 13:07:32.025916 29647 raft_consensus.cc:3060] T 2af14a7828dc4808aa8fdc9c1c758b85 P 5481e9936dfb479fa0dd925db3daff07 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:32.026098 29497 raft_consensus.cc:3055] T 2af14a7828dc4808aa8fdc9c1c758b85 P e28ca864e4c848b59d8b018ac4169c32 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:32.026433 29497 raft_consensus.cc:740] T 2af14a7828dc4808aa8fdc9c1c758b85 P e28ca864e4c848b59d8b018ac4169c32 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e28ca864e4c848b59d8b018ac4169c32, State: Running, Role: LEADER
I20260709 13:07:32.027240 29497 consensus_queue.cc:260] T 2af14a7828dc4808aa8fdc9c1c758b85 P e28ca864e4c848b59d8b018ac4169c32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } } peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } }
I20260709 13:07:32.028417 29497 raft_consensus.cc:3060] T 2af14a7828dc4808aa8fdc9c1c758b85 P e28ca864e4c848b59d8b018ac4169c32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:32.032596 29647 raft_consensus.cc:2468] T 2af14a7828dc4808aa8fdc9c1c758b85 P 5481e9936dfb479fa0dd925db3daff07 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc0a9840c02a4c279170b1c5fe560370 in term 2.
I20260709 13:07:32.033896 29538 leader_election.cc:304] T 2af14a7828dc4808aa8fdc9c1c758b85 P bc0a9840c02a4c279170b1c5fe560370 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5481e9936dfb479fa0dd925db3daff07, bc0a9840c02a4c279170b1c5fe560370; no voters: 
I20260709 13:07:32.034559 29715 raft_consensus.cc:2804] T 2af14a7828dc4808aa8fdc9c1c758b85 P bc0a9840c02a4c279170b1c5fe560370 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:32.034547 29497 raft_consensus.cc:2468] T 2af14a7828dc4808aa8fdc9c1c758b85 P e28ca864e4c848b59d8b018ac4169c32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc0a9840c02a4c279170b1c5fe560370 in term 2.
I20260709 13:07:32.035764 29715 raft_consensus.cc:697] T 2af14a7828dc4808aa8fdc9c1c758b85 P bc0a9840c02a4c279170b1c5fe560370 [term 2 LEADER]: Becoming Leader. State: Replica: bc0a9840c02a4c279170b1c5fe560370, State: Running, Role: LEADER
I20260709 13:07:32.036561 29715 consensus_queue.cc:237] T 2af14a7828dc4808aa8fdc9c1c758b85 P bc0a9840c02a4c279170b1c5fe560370 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } } peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } }
I20260709 13:07:32.042531 29393 catalog_manager.cc:5697] T 2af14a7828dc4808aa8fdc9c1c758b85 P bc0a9840c02a4c279170b1c5fe560370 reported cstate change: term changed from 1 to 2, leader changed from e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1) to bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2). New cstate: current_term: 2 leader_uuid: "bc0a9840c02a4c279170b1c5fe560370" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:32.147877 29800 raft_consensus.cc:993] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32: : Instructing follower bc0a9840c02a4c279170b1c5fe560370 to start an election
I20260709 13:07:32.148478 29800 raft_consensus.cc:1081] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32 [term 1 LEADER]: Signalling peer bc0a9840c02a4c279170b1c5fe560370 to start an election
I20260709 13:07:32.150127 29574 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e01ba93272b5460a8e453d93659b85ae"
dest_uuid: "bc0a9840c02a4c279170b1c5fe560370"
 from {username='slave'} at 127.0.0.1:33708
I20260709 13:07:32.150660 29574 raft_consensus.cc:493] T e01ba93272b5460a8e453d93659b85ae P bc0a9840c02a4c279170b1c5fe560370 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:32.150969 29574 raft_consensus.cc:3060] T e01ba93272b5460a8e453d93659b85ae P bc0a9840c02a4c279170b1c5fe560370 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:32.155216 29574 raft_consensus.cc:515] T e01ba93272b5460a8e453d93659b85ae P bc0a9840c02a4c279170b1c5fe560370 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:32.156770 29574 leader_election.cc:290] T e01ba93272b5460a8e453d93659b85ae P bc0a9840c02a4c279170b1c5fe560370 [CANDIDATE]: Term 2 election: Requested vote from peers e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1:44833), 5481e9936dfb479fa0dd925db3daff07 (127.28.173.3:42061)
I20260709 13:07:32.157389 29497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e01ba93272b5460a8e453d93659b85ae" candidate_uuid: "bc0a9840c02a4c279170b1c5fe560370" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e28ca864e4c848b59d8b018ac4169c32"
I20260709 13:07:32.157994 29497 raft_consensus.cc:3055] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:32.158200 29647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e01ba93272b5460a8e453d93659b85ae" candidate_uuid: "bc0a9840c02a4c279170b1c5fe560370" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5481e9936dfb479fa0dd925db3daff07"
I20260709 13:07:32.158336 29497 raft_consensus.cc:740] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e28ca864e4c848b59d8b018ac4169c32, State: Running, Role: LEADER
I20260709 13:07:32.158793 29647 raft_consensus.cc:3060] T e01ba93272b5460a8e453d93659b85ae P 5481e9936dfb479fa0dd925db3daff07 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:32.159193 29497 consensus_queue.cc:260] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:32.160384 29497 raft_consensus.cc:3060] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:32.165172 29647 raft_consensus.cc:2468] T e01ba93272b5460a8e453d93659b85ae P 5481e9936dfb479fa0dd925db3daff07 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc0a9840c02a4c279170b1c5fe560370 in term 2.
I20260709 13:07:32.166229 29538 leader_election.cc:304] T e01ba93272b5460a8e453d93659b85ae P bc0a9840c02a4c279170b1c5fe560370 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5481e9936dfb479fa0dd925db3daff07, bc0a9840c02a4c279170b1c5fe560370; no voters: 
I20260709 13:07:32.166494 29497 raft_consensus.cc:2468] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc0a9840c02a4c279170b1c5fe560370 in term 2.
I20260709 13:07:32.166877 29715 raft_consensus.cc:2804] T e01ba93272b5460a8e453d93659b85ae P bc0a9840c02a4c279170b1c5fe560370 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:32.167364 29715 raft_consensus.cc:697] T e01ba93272b5460a8e453d93659b85ae P bc0a9840c02a4c279170b1c5fe560370 [term 2 LEADER]: Becoming Leader. State: Replica: bc0a9840c02a4c279170b1c5fe560370, State: Running, Role: LEADER
I20260709 13:07:32.168109 29715 consensus_queue.cc:237] T e01ba93272b5460a8e453d93659b85ae P bc0a9840c02a4c279170b1c5fe560370 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:32.174432 29393 catalog_manager.cc:5697] T e01ba93272b5460a8e453d93659b85ae P bc0a9840c02a4c279170b1c5fe560370 reported cstate change: term changed from 1 to 2, leader changed from e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1) to bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2). New cstate: current_term: 2 leader_uuid: "bc0a9840c02a4c279170b1c5fe560370" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:32.324997 29700 raft_consensus.cc:993] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07: : Instructing follower bc0a9840c02a4c279170b1c5fe560370 to start an election
I20260709 13:07:32.325464 29782 raft_consensus.cc:1081] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [term 3 LEADER]: Signalling peer bc0a9840c02a4c279170b1c5fe560370 to start an election
I20260709 13:07:32.326822 29574 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5df53243d4c4e27bef57ad8f51bcb6e"
dest_uuid: "bc0a9840c02a4c279170b1c5fe560370"
 from {username='slave'} at 127.0.0.1:33718
I20260709 13:07:32.327235 29574 raft_consensus.cc:493] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:32.327484 29574 raft_consensus.cc:3060] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:32.331202 29574 raft_consensus.cc:515] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:32.332476 29574 leader_election.cc:290] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [CANDIDATE]: Term 4 election: Requested vote from peers e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1:44833), 5481e9936dfb479fa0dd925db3daff07 (127.28.173.3:42061)
I20260709 13:07:32.333259 29497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5df53243d4c4e27bef57ad8f51bcb6e" candidate_uuid: "bc0a9840c02a4c279170b1c5fe560370" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e28ca864e4c848b59d8b018ac4169c32"
I20260709 13:07:32.333582 29647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5df53243d4c4e27bef57ad8f51bcb6e" candidate_uuid: "bc0a9840c02a4c279170b1c5fe560370" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5481e9936dfb479fa0dd925db3daff07"
I20260709 13:07:32.333822 29497 raft_consensus.cc:3060] T a5df53243d4c4e27bef57ad8f51bcb6e P e28ca864e4c848b59d8b018ac4169c32 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:32.334108 29647 raft_consensus.cc:3055] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:32.334429 29647 raft_consensus.cc:740] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5481e9936dfb479fa0dd925db3daff07, State: Running, Role: LEADER
I20260709 13:07:32.335206 29647 consensus_queue.cc:260] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:32.336390 29647 raft_consensus.cc:3060] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:32.340062 29497 raft_consensus.cc:2468] T a5df53243d4c4e27bef57ad8f51bcb6e P e28ca864e4c848b59d8b018ac4169c32 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc0a9840c02a4c279170b1c5fe560370 in term 4.
I20260709 13:07:32.341245 29538 leader_election.cc:304] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc0a9840c02a4c279170b1c5fe560370, e28ca864e4c848b59d8b018ac4169c32; no voters: 
I20260709 13:07:32.341871 29715 raft_consensus.cc:2804] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:32.342298 29715 raft_consensus.cc:697] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [term 4 LEADER]: Becoming Leader. State: Replica: bc0a9840c02a4c279170b1c5fe560370, State: Running, Role: LEADER
I20260709 13:07:32.342348 29647 raft_consensus.cc:2468] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc0a9840c02a4c279170b1c5fe560370 in term 4.
I20260709 13:07:32.343104 29715 consensus_queue.cc:237] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:32.349752 29781 raft_consensus.cc:993] T 4f69e2661ba745b09237e4ce0494087b P e28ca864e4c848b59d8b018ac4169c32: : Instructing follower bc0a9840c02a4c279170b1c5fe560370 to start an election
I20260709 13:07:32.349316 29393 catalog_manager.cc:5697] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 reported cstate change: term changed from 3 to 4, leader changed from 5481e9936dfb479fa0dd925db3daff07 (127.28.173.3) to bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2). New cstate: current_term: 4 leader_uuid: "bc0a9840c02a4c279170b1c5fe560370" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:32.350183 29800 raft_consensus.cc:1081] T 4f69e2661ba745b09237e4ce0494087b P e28ca864e4c848b59d8b018ac4169c32 [term 2 LEADER]: Signalling peer bc0a9840c02a4c279170b1c5fe560370 to start an election
I20260709 13:07:32.351845 29574 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4f69e2661ba745b09237e4ce0494087b"
dest_uuid: "bc0a9840c02a4c279170b1c5fe560370"
 from {username='slave'} at 127.0.0.1:33708
I20260709 13:07:32.352288 29574 raft_consensus.cc:493] T 4f69e2661ba745b09237e4ce0494087b P bc0a9840c02a4c279170b1c5fe560370 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:32.352563 29574 raft_consensus.cc:3060] T 4f69e2661ba745b09237e4ce0494087b P bc0a9840c02a4c279170b1c5fe560370 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:32.356691 29574 raft_consensus.cc:515] T 4f69e2661ba745b09237e4ce0494087b P bc0a9840c02a4c279170b1c5fe560370 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:32.358174 29574 leader_election.cc:290] T 4f69e2661ba745b09237e4ce0494087b P bc0a9840c02a4c279170b1c5fe560370 [CANDIDATE]: Term 3 election: Requested vote from peers e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1:44833), 5481e9936dfb479fa0dd925db3daff07 (127.28.173.3:42061)
I20260709 13:07:32.358759 29497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f69e2661ba745b09237e4ce0494087b" candidate_uuid: "bc0a9840c02a4c279170b1c5fe560370" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e28ca864e4c848b59d8b018ac4169c32"
I20260709 13:07:32.359213 29647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f69e2661ba745b09237e4ce0494087b" candidate_uuid: "bc0a9840c02a4c279170b1c5fe560370" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5481e9936dfb479fa0dd925db3daff07"
I20260709 13:07:32.359297 29497 raft_consensus.cc:3055] T 4f69e2661ba745b09237e4ce0494087b P e28ca864e4c848b59d8b018ac4169c32 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:32.359694 29647 raft_consensus.cc:3060] T 4f69e2661ba745b09237e4ce0494087b P 5481e9936dfb479fa0dd925db3daff07 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:32.359716 29497 raft_consensus.cc:740] T 4f69e2661ba745b09237e4ce0494087b P e28ca864e4c848b59d8b018ac4169c32 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e28ca864e4c848b59d8b018ac4169c32, State: Running, Role: LEADER
I20260709 13:07:32.360517 29497 consensus_queue.cc:260] T 4f69e2661ba745b09237e4ce0494087b P e28ca864e4c848b59d8b018ac4169c32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:32.361368 29497 raft_consensus.cc:3060] T 4f69e2661ba745b09237e4ce0494087b P e28ca864e4c848b59d8b018ac4169c32 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:32.363946 29647 raft_consensus.cc:2468] T 4f69e2661ba745b09237e4ce0494087b P 5481e9936dfb479fa0dd925db3daff07 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc0a9840c02a4c279170b1c5fe560370 in term 3.
I20260709 13:07:32.364746 29538 leader_election.cc:304] T 4f69e2661ba745b09237e4ce0494087b P bc0a9840c02a4c279170b1c5fe560370 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5481e9936dfb479fa0dd925db3daff07, bc0a9840c02a4c279170b1c5fe560370; no voters: 
I20260709 13:07:32.365353 29715 raft_consensus.cc:2804] T 4f69e2661ba745b09237e4ce0494087b P bc0a9840c02a4c279170b1c5fe560370 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:32.365680 29715 raft_consensus.cc:697] T 4f69e2661ba745b09237e4ce0494087b P bc0a9840c02a4c279170b1c5fe560370 [term 3 LEADER]: Becoming Leader. State: Replica: bc0a9840c02a4c279170b1c5fe560370, State: Running, Role: LEADER
I20260709 13:07:32.366161 29497 raft_consensus.cc:2468] T 4f69e2661ba745b09237e4ce0494087b P e28ca864e4c848b59d8b018ac4169c32 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc0a9840c02a4c279170b1c5fe560370 in term 3.
I20260709 13:07:32.366281 29715 consensus_queue.cc:237] T 4f69e2661ba745b09237e4ce0494087b P bc0a9840c02a4c279170b1c5fe560370 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:32.371577 29393 catalog_manager.cc:5697] T 4f69e2661ba745b09237e4ce0494087b P bc0a9840c02a4c279170b1c5fe560370 reported cstate change: term changed from 2 to 3, leader changed from e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1) to bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2). New cstate: current_term: 3 leader_uuid: "bc0a9840c02a4c279170b1c5fe560370" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:32.385758 29700 raft_consensus.cc:993] T ca6f74116b244bc0929c39ea3913a184 P 5481e9936dfb479fa0dd925db3daff07: : Instructing follower bc0a9840c02a4c279170b1c5fe560370 to start an election
I20260709 13:07:32.386196 29782 raft_consensus.cc:1081] T ca6f74116b244bc0929c39ea3913a184 P 5481e9936dfb479fa0dd925db3daff07 [term 2 LEADER]: Signalling peer bc0a9840c02a4c279170b1c5fe560370 to start an election
I20260709 13:07:32.387471 29574 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca6f74116b244bc0929c39ea3913a184"
dest_uuid: "bc0a9840c02a4c279170b1c5fe560370"
 from {username='slave'} at 127.0.0.1:33718
I20260709 13:07:32.387930 29574 raft_consensus.cc:493] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:32.388183 29574 raft_consensus.cc:3060] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:32.391758 29574 raft_consensus.cc:515] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:32.393049 29574 leader_election.cc:290] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [CANDIDATE]: Term 3 election: Requested vote from peers e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1:44833), 5481e9936dfb479fa0dd925db3daff07 (127.28.173.3:42061)
I20260709 13:07:32.393812 29497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6f74116b244bc0929c39ea3913a184" candidate_uuid: "bc0a9840c02a4c279170b1c5fe560370" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e28ca864e4c848b59d8b018ac4169c32"
I20260709 13:07:32.394104 29647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6f74116b244bc0929c39ea3913a184" candidate_uuid: "bc0a9840c02a4c279170b1c5fe560370" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5481e9936dfb479fa0dd925db3daff07"
I20260709 13:07:32.394295 29497 raft_consensus.cc:3060] T ca6f74116b244bc0929c39ea3913a184 P e28ca864e4c848b59d8b018ac4169c32 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:32.394552 29647 raft_consensus.cc:3055] T ca6f74116b244bc0929c39ea3913a184 P 5481e9936dfb479fa0dd925db3daff07 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:32.394840 29647 raft_consensus.cc:740] T ca6f74116b244bc0929c39ea3913a184 P 5481e9936dfb479fa0dd925db3daff07 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5481e9936dfb479fa0dd925db3daff07, State: Running, Role: LEADER
I20260709 13:07:32.395426 29647 consensus_queue.cc:260] T ca6f74116b244bc0929c39ea3913a184 P 5481e9936dfb479fa0dd925db3daff07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:32.396207 29647 raft_consensus.cc:3060] T ca6f74116b244bc0929c39ea3913a184 P 5481e9936dfb479fa0dd925db3daff07 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:32.399561 29497 raft_consensus.cc:2468] T ca6f74116b244bc0929c39ea3913a184 P e28ca864e4c848b59d8b018ac4169c32 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc0a9840c02a4c279170b1c5fe560370 in term 3.
I20260709 13:07:32.400755 29538 leader_election.cc:304] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc0a9840c02a4c279170b1c5fe560370, e28ca864e4c848b59d8b018ac4169c32; no voters: 
I20260709 13:07:32.401266 29647 raft_consensus.cc:2468] T ca6f74116b244bc0929c39ea3913a184 P 5481e9936dfb479fa0dd925db3daff07 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc0a9840c02a4c279170b1c5fe560370 in term 3.
I20260709 13:07:32.401507 29715 raft_consensus.cc:2804] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:32.401994 29715 raft_consensus.cc:697] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [term 3 LEADER]: Becoming Leader. State: Replica: bc0a9840c02a4c279170b1c5fe560370, State: Running, Role: LEADER
I20260709 13:07:32.402644 29715 consensus_queue.cc:237] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:32.407639 29393 catalog_manager.cc:5697] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 reported cstate change: term changed from 2 to 3, leader changed from 5481e9936dfb479fa0dd925db3daff07 (127.28.173.3) to bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2). New cstate: current_term: 3 leader_uuid: "bc0a9840c02a4c279170b1c5fe560370" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:32.573937 29497 raft_consensus.cc:1275] T 2af14a7828dc4808aa8fdc9c1c758b85 P e28ca864e4c848b59d8b018ac4169c32 [term 2 FOLLOWER]: Refusing update from remote peer bc0a9840c02a4c279170b1c5fe560370: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:32.575138 29715 consensus_queue.cc:1048] T 2af14a7828dc4808aa8fdc9c1c758b85 P bc0a9840c02a4c279170b1c5fe560370 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:32.584024 29647 raft_consensus.cc:1275] T 2af14a7828dc4808aa8fdc9c1c758b85 P 5481e9936dfb479fa0dd925db3daff07 [term 2 FOLLOWER]: Refusing update from remote peer bc0a9840c02a4c279170b1c5fe560370: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:32.586040 29715 consensus_queue.cc:1048] T 2af14a7828dc4808aa8fdc9c1c758b85 P bc0a9840c02a4c279170b1c5fe560370 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:32.615926 29497 raft_consensus.cc:1275] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32 [term 2 FOLLOWER]: Refusing update from remote peer bc0a9840c02a4c279170b1c5fe560370: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:32.617125 29715 consensus_queue.cc:1048] T e01ba93272b5460a8e453d93659b85ae P bc0a9840c02a4c279170b1c5fe560370 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:32.625506 29647 raft_consensus.cc:1275] T e01ba93272b5460a8e453d93659b85ae P 5481e9936dfb479fa0dd925db3daff07 [term 2 FOLLOWER]: Refusing update from remote peer bc0a9840c02a4c279170b1c5fe560370: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:32.626807 29801 consensus_queue.cc:1048] T e01ba93272b5460a8e453d93659b85ae P bc0a9840c02a4c279170b1c5fe560370 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:32.827999 29647 raft_consensus.cc:1275] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [term 4 FOLLOWER]: Refusing update from remote peer bc0a9840c02a4c279170b1c5fe560370: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:32.829324 29801 consensus_queue.cc:1048] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:32.834934 29497 raft_consensus.cc:1275] T 4f69e2661ba745b09237e4ce0494087b P e28ca864e4c848b59d8b018ac4169c32 [term 3 FOLLOWER]: Refusing update from remote peer bc0a9840c02a4c279170b1c5fe560370: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:32.838131 29497 raft_consensus.cc:1275] T a5df53243d4c4e27bef57ad8f51bcb6e P e28ca864e4c848b59d8b018ac4169c32 [term 4 FOLLOWER]: Refusing update from remote peer bc0a9840c02a4c279170b1c5fe560370: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:32.838213 29801 consensus_queue.cc:1048] T 4f69e2661ba745b09237e4ce0494087b P bc0a9840c02a4c279170b1c5fe560370 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:32.839713 29801 consensus_queue.cc:1048] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:32.848654 29648 raft_consensus.cc:1275] T 4f69e2661ba745b09237e4ce0494087b P 5481e9936dfb479fa0dd925db3daff07 [term 3 FOLLOWER]: Refusing update from remote peer bc0a9840c02a4c279170b1c5fe560370: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:32.851004 29715 consensus_queue.cc:1048] T 4f69e2661ba745b09237e4ce0494087b P bc0a9840c02a4c279170b1c5fe560370 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:32.903955 29647 raft_consensus.cc:1275] T ca6f74116b244bc0929c39ea3913a184 P 5481e9936dfb479fa0dd925db3daff07 [term 3 FOLLOWER]: Refusing update from remote peer bc0a9840c02a4c279170b1c5fe560370: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:32.905076 29811 consensus_queue.cc:1048] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:32.912928 29497 raft_consensus.cc:1275] T ca6f74116b244bc0929c39ea3913a184 P e28ca864e4c848b59d8b018ac4169c32 [term 3 FOLLOWER]: Refusing update from remote peer bc0a9840c02a4c279170b1c5fe560370: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:32.914613 29818 consensus_queue.cc:1048] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:34.964519 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:34.971498 29574 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d25bbcb97f44813aa8241e230434f74"
dest_uuid: "bc0a9840c02a4c279170b1c5fe560370"
mode: GRACEFUL
new_leader_uuid: "e28ca864e4c848b59d8b018ac4169c32"
 from {username='slave'} at 127.0.0.1:52614
I20260709 13:07:34.972205 29574 raft_consensus.cc:606] T 8d25bbcb97f44813aa8241e230434f74 P bc0a9840c02a4c279170b1c5fe560370 [term 2 LEADER]: Received request to transfer leadership to TS e28ca864e4c848b59d8b018ac4169c32
I20260709 13:07:34.974793 29574 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5df53243d4c4e27bef57ad8f51bcb6e"
dest_uuid: "bc0a9840c02a4c279170b1c5fe560370"
mode: GRACEFUL
new_leader_uuid: "5481e9936dfb479fa0dd925db3daff07"
 from {username='slave'} at 127.0.0.1:52614
I20260709 13:07:34.975243 29574 raft_consensus.cc:606] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [term 4 LEADER]: Received request to transfer leadership to TS 5481e9936dfb479fa0dd925db3daff07
I20260709 13:07:34.977479 29574 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca6f74116b244bc0929c39ea3913a184"
dest_uuid: "bc0a9840c02a4c279170b1c5fe560370"
mode: GRACEFUL
new_leader_uuid: "e28ca864e4c848b59d8b018ac4169c32"
 from {username='slave'} at 127.0.0.1:52614
I20260709 13:07:34.977939 29574 raft_consensus.cc:606] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [term 3 LEADER]: Received request to transfer leadership to TS e28ca864e4c848b59d8b018ac4169c32
I20260709 13:07:34.980311 29574 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbc21554b6344107baedcec570f26b37"
dest_uuid: "bc0a9840c02a4c279170b1c5fe560370"
mode: GRACEFUL
new_leader_uuid: "5481e9936dfb479fa0dd925db3daff07"
 from {username='slave'} at 127.0.0.1:52614
I20260709 13:07:34.980726 29574 raft_consensus.cc:606] T dbc21554b6344107baedcec570f26b37 P bc0a9840c02a4c279170b1c5fe560370 [term 2 LEADER]: Received request to transfer leadership to TS 5481e9936dfb479fa0dd925db3daff07
I20260709 13:07:34.982913 29574 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e01ba93272b5460a8e453d93659b85ae"
dest_uuid: "bc0a9840c02a4c279170b1c5fe560370"
mode: GRACEFUL
new_leader_uuid: "e28ca864e4c848b59d8b018ac4169c32"
 from {username='slave'} at 127.0.0.1:52614
I20260709 13:07:34.983351 29574 raft_consensus.cc:606] T e01ba93272b5460a8e453d93659b85ae P bc0a9840c02a4c279170b1c5fe560370 [term 2 LEADER]: Received request to transfer leadership to TS e28ca864e4c848b59d8b018ac4169c32
I20260709 13:07:34.984413 29364 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:34.984913 29364 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:35.038070 29801 raft_consensus.cc:993] T dbc21554b6344107baedcec570f26b37 P bc0a9840c02a4c279170b1c5fe560370: : Instructing follower 5481e9936dfb479fa0dd925db3daff07 to start an election
I20260709 13:07:35.038609 29825 raft_consensus.cc:1081] T dbc21554b6344107baedcec570f26b37 P bc0a9840c02a4c279170b1c5fe560370 [term 2 LEADER]: Signalling peer 5481e9936dfb479fa0dd925db3daff07 to start an election
I20260709 13:07:35.040144 29648 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dbc21554b6344107baedcec570f26b37"
dest_uuid: "5481e9936dfb479fa0dd925db3daff07"
 from {username='slave'} at 127.0.0.1:52356
I20260709 13:07:35.040656 29648 raft_consensus.cc:493] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:35.041026 29648 raft_consensus.cc:3060] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:35.046015 29648 raft_consensus.cc:515] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:35.047821 29648 leader_election.cc:290] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07 [CANDIDATE]: Term 3 election: Requested vote from peers e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1:44833), bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2:40589)
I20260709 13:07:35.048820 29574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc21554b6344107baedcec570f26b37" candidate_uuid: "5481e9936dfb479fa0dd925db3daff07" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bc0a9840c02a4c279170b1c5fe560370"
I20260709 13:07:35.048826 29497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc21554b6344107baedcec570f26b37" candidate_uuid: "5481e9936dfb479fa0dd925db3daff07" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e28ca864e4c848b59d8b018ac4169c32"
I20260709 13:07:35.049554 29574 raft_consensus.cc:3055] T dbc21554b6344107baedcec570f26b37 P bc0a9840c02a4c279170b1c5fe560370 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:35.049690 29497 raft_consensus.cc:3060] T dbc21554b6344107baedcec570f26b37 P e28ca864e4c848b59d8b018ac4169c32 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:35.049885 29574 raft_consensus.cc:740] T dbc21554b6344107baedcec570f26b37 P bc0a9840c02a4c279170b1c5fe560370 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bc0a9840c02a4c279170b1c5fe560370, State: Running, Role: LEADER
I20260709 13:07:35.050745 29574 consensus_queue.cc:260] T dbc21554b6344107baedcec570f26b37 P bc0a9840c02a4c279170b1c5fe560370 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:35.051920 29574 raft_consensus.cc:3060] T dbc21554b6344107baedcec570f26b37 P bc0a9840c02a4c279170b1c5fe560370 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:35.055402 29497 raft_consensus.cc:2468] T dbc21554b6344107baedcec570f26b37 P e28ca864e4c848b59d8b018ac4169c32 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5481e9936dfb479fa0dd925db3daff07 in term 3.
I20260709 13:07:35.056799 29612 leader_election.cc:304] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5481e9936dfb479fa0dd925db3daff07, e28ca864e4c848b59d8b018ac4169c32; no voters: 
I20260709 13:07:35.057696 29782 raft_consensus.cc:2804] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:35.059790 29574 raft_consensus.cc:2468] T dbc21554b6344107baedcec570f26b37 P bc0a9840c02a4c279170b1c5fe560370 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5481e9936dfb479fa0dd925db3daff07 in term 3.
I20260709 13:07:35.061033 29782 raft_consensus.cc:697] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07 [term 3 LEADER]: Becoming Leader. State: Replica: 5481e9936dfb479fa0dd925db3daff07, State: Running, Role: LEADER
I20260709 13:07:35.062361 29782 consensus_queue.cc:237] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:35.069067 29395 catalog_manager.cc:5697] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07 reported cstate change: term changed from 2 to 3, leader changed from bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2) to 5481e9936dfb479fa0dd925db3daff07 (127.28.173.3). New cstate: current_term: 3 leader_uuid: "5481e9936dfb479fa0dd925db3daff07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:35.128332 29801 raft_consensus.cc:993] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370: : Instructing follower e28ca864e4c848b59d8b018ac4169c32 to start an election
I20260709 13:07:35.128790 29801 raft_consensus.cc:1081] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [term 3 LEADER]: Signalling peer e28ca864e4c848b59d8b018ac4169c32 to start an election
I20260709 13:07:35.130383 29497 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca6f74116b244bc0929c39ea3913a184"
dest_uuid: "e28ca864e4c848b59d8b018ac4169c32"
 from {username='slave'} at 127.0.0.1:42958
I20260709 13:07:35.130833 29497 raft_consensus.cc:493] T ca6f74116b244bc0929c39ea3913a184 P e28ca864e4c848b59d8b018ac4169c32 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:35.131141 29497 raft_consensus.cc:3060] T ca6f74116b244bc0929c39ea3913a184 P e28ca864e4c848b59d8b018ac4169c32 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:35.134979 29497 raft_consensus.cc:515] T ca6f74116b244bc0929c39ea3913a184 P e28ca864e4c848b59d8b018ac4169c32 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:35.136526 29497 leader_election.cc:290] T ca6f74116b244bc0929c39ea3913a184 P e28ca864e4c848b59d8b018ac4169c32 [CANDIDATE]: Term 4 election: Requested vote from peers bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2:40589), 5481e9936dfb479fa0dd925db3daff07 (127.28.173.3:42061)
I20260709 13:07:35.137338 29574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6f74116b244bc0929c39ea3913a184" candidate_uuid: "e28ca864e4c848b59d8b018ac4169c32" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bc0a9840c02a4c279170b1c5fe560370"
I20260709 13:07:35.137883 29574 raft_consensus.cc:3055] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:35.137744 29648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6f74116b244bc0929c39ea3913a184" candidate_uuid: "e28ca864e4c848b59d8b018ac4169c32" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5481e9936dfb479fa0dd925db3daff07"
I20260709 13:07:35.138157 29574 raft_consensus.cc:740] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bc0a9840c02a4c279170b1c5fe560370, State: Running, Role: LEADER
I20260709 13:07:35.138358 29648 raft_consensus.cc:3060] T ca6f74116b244bc0929c39ea3913a184 P 5481e9936dfb479fa0dd925db3daff07 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:35.138870 29574 consensus_queue.cc:260] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:35.139683 29574 raft_consensus.cc:3060] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:35.142767 29648 raft_consensus.cc:2468] T ca6f74116b244bc0929c39ea3913a184 P 5481e9936dfb479fa0dd925db3daff07 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28ca864e4c848b59d8b018ac4169c32 in term 4.
I20260709 13:07:35.143499 29574 raft_consensus.cc:2468] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28ca864e4c848b59d8b018ac4169c32 in term 4.
I20260709 13:07:35.144047 29463 leader_election.cc:304] T ca6f74116b244bc0929c39ea3913a184 P e28ca864e4c848b59d8b018ac4169c32 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5481e9936dfb479fa0dd925db3daff07, e28ca864e4c848b59d8b018ac4169c32; no voters: 
I20260709 13:07:35.145505 29833 raft_consensus.cc:2804] T ca6f74116b244bc0929c39ea3913a184 P e28ca864e4c848b59d8b018ac4169c32 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:35.146420 29833 raft_consensus.cc:697] T ca6f74116b244bc0929c39ea3913a184 P e28ca864e4c848b59d8b018ac4169c32 [term 4 LEADER]: Becoming Leader. State: Replica: e28ca864e4c848b59d8b018ac4169c32, State: Running, Role: LEADER
I20260709 13:07:35.147141 29833 consensus_queue.cc:237] T ca6f74116b244bc0929c39ea3913a184 P e28ca864e4c848b59d8b018ac4169c32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:35.153908 29395 catalog_manager.cc:5697] T ca6f74116b244bc0929c39ea3913a184 P e28ca864e4c848b59d8b018ac4169c32 reported cstate change: term changed from 3 to 4, leader changed from bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2) to e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1). New cstate: current_term: 4 leader_uuid: "e28ca864e4c848b59d8b018ac4169c32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:35.205971 29825 raft_consensus.cc:993] T e01ba93272b5460a8e453d93659b85ae P bc0a9840c02a4c279170b1c5fe560370: : Instructing follower e28ca864e4c848b59d8b018ac4169c32 to start an election
I20260709 13:07:35.206415 29801 raft_consensus.cc:1081] T e01ba93272b5460a8e453d93659b85ae P bc0a9840c02a4c279170b1c5fe560370 [term 2 LEADER]: Signalling peer e28ca864e4c848b59d8b018ac4169c32 to start an election
I20260709 13:07:35.207733 29497 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e01ba93272b5460a8e453d93659b85ae"
dest_uuid: "e28ca864e4c848b59d8b018ac4169c32"
 from {username='slave'} at 127.0.0.1:42958
I20260709 13:07:35.208217 29497 raft_consensus.cc:493] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:35.208532 29497 raft_consensus.cc:3060] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:35.212781 29497 raft_consensus.cc:515] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:35.214191 29497 leader_election.cc:290] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32 [CANDIDATE]: Term 3 election: Requested vote from peers bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2:40589), 5481e9936dfb479fa0dd925db3daff07 (127.28.173.3:42061)
I20260709 13:07:35.214746 29574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e01ba93272b5460a8e453d93659b85ae" candidate_uuid: "e28ca864e4c848b59d8b018ac4169c32" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bc0a9840c02a4c279170b1c5fe560370"
I20260709 13:07:35.215284 29574 raft_consensus.cc:3055] T e01ba93272b5460a8e453d93659b85ae P bc0a9840c02a4c279170b1c5fe560370 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:35.215206 29648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e01ba93272b5460a8e453d93659b85ae" candidate_uuid: "e28ca864e4c848b59d8b018ac4169c32" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5481e9936dfb479fa0dd925db3daff07"
I20260709 13:07:35.215647 29574 raft_consensus.cc:740] T e01ba93272b5460a8e453d93659b85ae P bc0a9840c02a4c279170b1c5fe560370 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bc0a9840c02a4c279170b1c5fe560370, State: Running, Role: LEADER
I20260709 13:07:35.215833 29648 raft_consensus.cc:3060] T e01ba93272b5460a8e453d93659b85ae P 5481e9936dfb479fa0dd925db3daff07 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:35.216421 29574 consensus_queue.cc:260] T e01ba93272b5460a8e453d93659b85ae P bc0a9840c02a4c279170b1c5fe560370 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:35.217468 29574 raft_consensus.cc:3060] T e01ba93272b5460a8e453d93659b85ae P bc0a9840c02a4c279170b1c5fe560370 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:35.222096 29648 raft_consensus.cc:2468] T e01ba93272b5460a8e453d93659b85ae P 5481e9936dfb479fa0dd925db3daff07 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28ca864e4c848b59d8b018ac4169c32 in term 3.
I20260709 13:07:35.223178 29574 raft_consensus.cc:2468] T e01ba93272b5460a8e453d93659b85ae P bc0a9840c02a4c279170b1c5fe560370 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28ca864e4c848b59d8b018ac4169c32 in term 3.
I20260709 13:07:35.223140 29463 leader_election.cc:304] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5481e9936dfb479fa0dd925db3daff07, e28ca864e4c848b59d8b018ac4169c32; no voters: 
I20260709 13:07:35.224027 29833 raft_consensus.cc:2804] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:35.224484 29833 raft_consensus.cc:697] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32 [term 3 LEADER]: Becoming Leader. State: Replica: e28ca864e4c848b59d8b018ac4169c32, State: Running, Role: LEADER
I20260709 13:07:35.225234 29833 consensus_queue.cc:237] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:35.231333 29395 catalog_manager.cc:5697] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32 reported cstate change: term changed from 2 to 3, leader changed from bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2) to e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1). New cstate: current_term: 3 leader_uuid: "e28ca864e4c848b59d8b018ac4169c32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:35.306739 29825 raft_consensus.cc:993] T 8d25bbcb97f44813aa8241e230434f74 P bc0a9840c02a4c279170b1c5fe560370: : Instructing follower e28ca864e4c848b59d8b018ac4169c32 to start an election
I20260709 13:07:35.307195 29801 raft_consensus.cc:1081] T 8d25bbcb97f44813aa8241e230434f74 P bc0a9840c02a4c279170b1c5fe560370 [term 2 LEADER]: Signalling peer e28ca864e4c848b59d8b018ac4169c32 to start an election
I20260709 13:07:35.308653 29497 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d25bbcb97f44813aa8241e230434f74"
dest_uuid: "e28ca864e4c848b59d8b018ac4169c32"
 from {username='slave'} at 127.0.0.1:42958
I20260709 13:07:35.309163 29497 raft_consensus.cc:493] T 8d25bbcb97f44813aa8241e230434f74 P e28ca864e4c848b59d8b018ac4169c32 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:35.309471 29497 raft_consensus.cc:3060] T 8d25bbcb97f44813aa8241e230434f74 P e28ca864e4c848b59d8b018ac4169c32 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:35.313779 29497 raft_consensus.cc:515] T 8d25bbcb97f44813aa8241e230434f74 P e28ca864e4c848b59d8b018ac4169c32 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:35.315101 29497 leader_election.cc:290] T 8d25bbcb97f44813aa8241e230434f74 P e28ca864e4c848b59d8b018ac4169c32 [CANDIDATE]: Term 3 election: Requested vote from peers bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2:40589), 5481e9936dfb479fa0dd925db3daff07 (127.28.173.3:42061)
I20260709 13:07:35.315949 29574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d25bbcb97f44813aa8241e230434f74" candidate_uuid: "e28ca864e4c848b59d8b018ac4169c32" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bc0a9840c02a4c279170b1c5fe560370"
I20260709 13:07:35.316236 29648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d25bbcb97f44813aa8241e230434f74" candidate_uuid: "e28ca864e4c848b59d8b018ac4169c32" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5481e9936dfb479fa0dd925db3daff07"
I20260709 13:07:35.316484 29574 raft_consensus.cc:3055] T 8d25bbcb97f44813aa8241e230434f74 P bc0a9840c02a4c279170b1c5fe560370 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:35.316756 29648 raft_consensus.cc:3060] T 8d25bbcb97f44813aa8241e230434f74 P 5481e9936dfb479fa0dd925db3daff07 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:35.316779 29574 raft_consensus.cc:740] T 8d25bbcb97f44813aa8241e230434f74 P bc0a9840c02a4c279170b1c5fe560370 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bc0a9840c02a4c279170b1c5fe560370, State: Running, Role: LEADER
I20260709 13:07:35.317647 29574 consensus_queue.cc:260] T 8d25bbcb97f44813aa8241e230434f74 P bc0a9840c02a4c279170b1c5fe560370 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:35.318792 29574 raft_consensus.cc:3060] T 8d25bbcb97f44813aa8241e230434f74 P bc0a9840c02a4c279170b1c5fe560370 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:35.323093 29648 raft_consensus.cc:2468] T 8d25bbcb97f44813aa8241e230434f74 P 5481e9936dfb479fa0dd925db3daff07 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28ca864e4c848b59d8b018ac4169c32 in term 3.
I20260709 13:07:35.324103 29463 leader_election.cc:304] T 8d25bbcb97f44813aa8241e230434f74 P e28ca864e4c848b59d8b018ac4169c32 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5481e9936dfb479fa0dd925db3daff07, e28ca864e4c848b59d8b018ac4169c32; no voters: 
I20260709 13:07:35.324527 29574 raft_consensus.cc:2468] T 8d25bbcb97f44813aa8241e230434f74 P bc0a9840c02a4c279170b1c5fe560370 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28ca864e4c848b59d8b018ac4169c32 in term 3.
I20260709 13:07:35.324800 29833 raft_consensus.cc:2804] T 8d25bbcb97f44813aa8241e230434f74 P e28ca864e4c848b59d8b018ac4169c32 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:35.325233 29833 raft_consensus.cc:697] T 8d25bbcb97f44813aa8241e230434f74 P e28ca864e4c848b59d8b018ac4169c32 [term 3 LEADER]: Becoming Leader. State: Replica: e28ca864e4c848b59d8b018ac4169c32, State: Running, Role: LEADER
I20260709 13:07:35.326098 29833 consensus_queue.cc:237] T 8d25bbcb97f44813aa8241e230434f74 P e28ca864e4c848b59d8b018ac4169c32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:35.332202 29395 catalog_manager.cc:5697] T 8d25bbcb97f44813aa8241e230434f74 P e28ca864e4c848b59d8b018ac4169c32 reported cstate change: term changed from 2 to 3, leader changed from bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2) to e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1). New cstate: current_term: 3 leader_uuid: "e28ca864e4c848b59d8b018ac4169c32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:35.335027 29825 raft_consensus.cc:993] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370: : Instructing follower 5481e9936dfb479fa0dd925db3daff07 to start an election
I20260709 13:07:35.335434 29801 raft_consensus.cc:1081] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [term 4 LEADER]: Signalling peer 5481e9936dfb479fa0dd925db3daff07 to start an election
I20260709 13:07:35.336967 29648 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5df53243d4c4e27bef57ad8f51bcb6e"
dest_uuid: "5481e9936dfb479fa0dd925db3daff07"
 from {username='slave'} at 127.0.0.1:52356
I20260709 13:07:35.337487 29648 raft_consensus.cc:493] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:35.337832 29648 raft_consensus.cc:3060] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:35.342458 29648 raft_consensus.cc:515] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:35.343680 29648 leader_election.cc:290] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [CANDIDATE]: Term 5 election: Requested vote from peers e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1:44833), bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2:40589)
I20260709 13:07:35.344422 29497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5df53243d4c4e27bef57ad8f51bcb6e" candidate_uuid: "5481e9936dfb479fa0dd925db3daff07" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "e28ca864e4c848b59d8b018ac4169c32"
I20260709 13:07:35.344885 29497 raft_consensus.cc:3060] T a5df53243d4c4e27bef57ad8f51bcb6e P e28ca864e4c848b59d8b018ac4169c32 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:35.344877 29574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5df53243d4c4e27bef57ad8f51bcb6e" candidate_uuid: "5481e9936dfb479fa0dd925db3daff07" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "bc0a9840c02a4c279170b1c5fe560370"
I20260709 13:07:35.345345 29574 raft_consensus.cc:3055] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:35.345592 29574 raft_consensus.cc:740] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bc0a9840c02a4c279170b1c5fe560370, State: Running, Role: LEADER
I20260709 13:07:35.346244 29574 consensus_queue.cc:260] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:35.346978 29574 raft_consensus.cc:3060] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:35.348769 29497 raft_consensus.cc:2468] T a5df53243d4c4e27bef57ad8f51bcb6e P e28ca864e4c848b59d8b018ac4169c32 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5481e9936dfb479fa0dd925db3daff07 in term 5.
I20260709 13:07:35.349539 29612 leader_election.cc:304] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5481e9936dfb479fa0dd925db3daff07, e28ca864e4c848b59d8b018ac4169c32; no voters: 
I20260709 13:07:35.350184 29782 raft_consensus.cc:2804] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:35.350565 29782 raft_consensus.cc:697] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [term 5 LEADER]: Becoming Leader. State: Replica: 5481e9936dfb479fa0dd925db3daff07, State: Running, Role: LEADER
I20260709 13:07:35.351094 29574 raft_consensus.cc:2468] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5481e9936dfb479fa0dd925db3daff07 in term 5.
I20260709 13:07:35.351358 29782 consensus_queue.cc:237] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } }
I20260709 13:07:35.358376 29395 catalog_manager.cc:5697] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 reported cstate change: term changed from 4 to 5, leader changed from bc0a9840c02a4c279170b1c5fe560370 (127.28.173.2) to 5481e9936dfb479fa0dd925db3daff07 (127.28.173.3). New cstate: current_term: 5 leader_uuid: "5481e9936dfb479fa0dd925db3daff07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:35.511520 29574 raft_consensus.cc:1275] T dbc21554b6344107baedcec570f26b37 P bc0a9840c02a4c279170b1c5fe560370 [term 3 FOLLOWER]: Refusing update from remote peer 5481e9936dfb479fa0dd925db3daff07: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:35.512961 29782 consensus_queue.cc:1048] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:35.523358 29497 raft_consensus.cc:1275] T dbc21554b6344107baedcec570f26b37 P e28ca864e4c848b59d8b018ac4169c32 [term 3 FOLLOWER]: Refusing update from remote peer 5481e9936dfb479fa0dd925db3daff07: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:35.524801 29826 consensus_queue.cc:1048] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:35.649912 29648 raft_consensus.cc:1275] T e01ba93272b5460a8e453d93659b85ae P 5481e9936dfb479fa0dd925db3daff07 [term 3 FOLLOWER]: Refusing update from remote peer e28ca864e4c848b59d8b018ac4169c32: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:35.651154 29833 consensus_queue.cc:1048] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:35.659812 29574 raft_consensus.cc:1275] T e01ba93272b5460a8e453d93659b85ae P bc0a9840c02a4c279170b1c5fe560370 [term 3 FOLLOWER]: Refusing update from remote peer e28ca864e4c848b59d8b018ac4169c32: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:35.661221 29845 consensus_queue.cc:1048] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:35.733759 29574 raft_consensus.cc:1275] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [term 5 FOLLOWER]: Refusing update from remote peer 5481e9936dfb479fa0dd925db3daff07: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:07:35.734997 29826 consensus_queue.cc:1048] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:35.746212 29497 raft_consensus.cc:1275] T a5df53243d4c4e27bef57ad8f51bcb6e P e28ca864e4c848b59d8b018ac4169c32 [term 5 FOLLOWER]: Refusing update from remote peer 5481e9936dfb479fa0dd925db3daff07: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:07:35.746212 29648 raft_consensus.cc:1275] T ca6f74116b244bc0929c39ea3913a184 P 5481e9936dfb479fa0dd925db3daff07 [term 4 FOLLOWER]: Refusing update from remote peer e28ca864e4c848b59d8b018ac4169c32: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:35.748163 29834 consensus_queue.cc:1048] T ca6f74116b244bc0929c39ea3913a184 P e28ca864e4c848b59d8b018ac4169c32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:35.749136 29827 consensus_queue.cc:1048] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28ca864e4c848b59d8b018ac4169c32" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:35.762122 29574 raft_consensus.cc:1275] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [term 4 FOLLOWER]: Refusing update from remote peer e28ca864e4c848b59d8b018ac4169c32: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:35.763923 29845 consensus_queue.cc:1048] T ca6f74116b244bc0929c39ea3913a184 P e28ca864e4c848b59d8b018ac4169c32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:35.773044 29647 raft_consensus.cc:1275] T 8d25bbcb97f44813aa8241e230434f74 P 5481e9936dfb479fa0dd925db3daff07 [term 3 FOLLOWER]: Refusing update from remote peer e28ca864e4c848b59d8b018ac4169c32: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:35.774149 29845 consensus_queue.cc:1048] T 8d25bbcb97f44813aa8241e230434f74 P e28ca864e4c848b59d8b018ac4169c32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5481e9936dfb479fa0dd925db3daff07" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 42061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:35.783895 29574 raft_consensus.cc:1275] T 8d25bbcb97f44813aa8241e230434f74 P bc0a9840c02a4c279170b1c5fe560370 [term 3 FOLLOWER]: Refusing update from remote peer e28ca864e4c848b59d8b018ac4169c32: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:35.785096 29845 consensus_queue.cc:1048] T 8d25bbcb97f44813aa8241e230434f74 P e28ca864e4c848b59d8b018ac4169c32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc0a9840c02a4c279170b1c5fe560370" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:35.985759 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:35.991171 29364 tablet_server.cc:179] TabletServer@127.28.173.1:0 shutting down...
I20260709 13:07:36.015290 29364 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:36.016067 29364 tablet_replica.cc:333] T a5df53243d4c4e27bef57ad8f51bcb6e P e28ca864e4c848b59d8b018ac4169c32: stopping tablet replica
I20260709 13:07:36.016738 29364 raft_consensus.cc:2243] T a5df53243d4c4e27bef57ad8f51bcb6e P e28ca864e4c848b59d8b018ac4169c32 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.017269 29364 raft_consensus.cc:2272] T a5df53243d4c4e27bef57ad8f51bcb6e P e28ca864e4c848b59d8b018ac4169c32 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.020363 29364 tablet_replica.cc:333] T 8d25bbcb97f44813aa8241e230434f74 P e28ca864e4c848b59d8b018ac4169c32: stopping tablet replica
I20260709 13:07:36.020920 29364 raft_consensus.cc:2243] T 8d25bbcb97f44813aa8241e230434f74 P e28ca864e4c848b59d8b018ac4169c32 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:36.021620 29364 raft_consensus.cc:2272] T 8d25bbcb97f44813aa8241e230434f74 P e28ca864e4c848b59d8b018ac4169c32 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.023684 29364 tablet_replica.cc:333] T d4d2f00fadd04bdd91d3c97ebc76f005 P e28ca864e4c848b59d8b018ac4169c32: stopping tablet replica
I20260709 13:07:36.024196 29364 raft_consensus.cc:2243] T d4d2f00fadd04bdd91d3c97ebc76f005 P e28ca864e4c848b59d8b018ac4169c32 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.024573 29364 raft_consensus.cc:2272] T d4d2f00fadd04bdd91d3c97ebc76f005 P e28ca864e4c848b59d8b018ac4169c32 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.026034 29364 tablet_replica.cc:333] T 4f69e2661ba745b09237e4ce0494087b P e28ca864e4c848b59d8b018ac4169c32: stopping tablet replica
I20260709 13:07:36.026481 29364 raft_consensus.cc:2243] T 4f69e2661ba745b09237e4ce0494087b P e28ca864e4c848b59d8b018ac4169c32 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.026867 29364 raft_consensus.cc:2272] T 4f69e2661ba745b09237e4ce0494087b P e28ca864e4c848b59d8b018ac4169c32 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.028347 29364 tablet_replica.cc:333] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32: stopping tablet replica
I20260709 13:07:36.028800 29364 raft_consensus.cc:2243] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:36.029449 29364 raft_consensus.cc:2272] T e01ba93272b5460a8e453d93659b85ae P e28ca864e4c848b59d8b018ac4169c32 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.031279 29364 tablet_replica.cc:333] T 2ef4ec98706b46e2a2ff852dca7ee48e P e28ca864e4c848b59d8b018ac4169c32: stopping tablet replica
I20260709 13:07:36.031757 29364 raft_consensus.cc:2243] T 2ef4ec98706b46e2a2ff852dca7ee48e P e28ca864e4c848b59d8b018ac4169c32 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.032272 29364 raft_consensus.cc:2272] T 2ef4ec98706b46e2a2ff852dca7ee48e P e28ca864e4c848b59d8b018ac4169c32 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.033895 29364 tablet_replica.cc:333] T 2af14a7828dc4808aa8fdc9c1c758b85 P e28ca864e4c848b59d8b018ac4169c32: stopping tablet replica
I20260709 13:07:36.034379 29364 raft_consensus.cc:2243] T 2af14a7828dc4808aa8fdc9c1c758b85 P e28ca864e4c848b59d8b018ac4169c32 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.034777 29364 raft_consensus.cc:2272] T 2af14a7828dc4808aa8fdc9c1c758b85 P e28ca864e4c848b59d8b018ac4169c32 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.036366 29364 tablet_replica.cc:333] T dbc21554b6344107baedcec570f26b37 P e28ca864e4c848b59d8b018ac4169c32: stopping tablet replica
I20260709 13:07:36.036792 29364 raft_consensus.cc:2243] T dbc21554b6344107baedcec570f26b37 P e28ca864e4c848b59d8b018ac4169c32 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.037170 29364 raft_consensus.cc:2272] T dbc21554b6344107baedcec570f26b37 P e28ca864e4c848b59d8b018ac4169c32 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.038975 29364 tablet_replica.cc:333] T ca6f74116b244bc0929c39ea3913a184 P e28ca864e4c848b59d8b018ac4169c32: stopping tablet replica
I20260709 13:07:36.039417 29364 raft_consensus.cc:2243] T ca6f74116b244bc0929c39ea3913a184 P e28ca864e4c848b59d8b018ac4169c32 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:07:36.040246 29364 raft_consensus.cc:2272] T ca6f74116b244bc0929c39ea3913a184 P e28ca864e4c848b59d8b018ac4169c32 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:36.135123 29538 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.173.1:44833: connect: Connection refused (error 111)
I20260709 13:07:36.136072 29364 tablet_server.cc:196] TabletServer@127.28.173.1:0 shutdown complete.
W20260709 13:07:36.138654 29538 consensus_peers.cc:597] T d4d2f00fadd04bdd91d3c97ebc76f005 P bc0a9840c02a4c279170b1c5fe560370 -> Peer e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1:44833): Couldn't send request to peer e28ca864e4c848b59d8b018ac4169c32. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:44833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:36.154829 29364 tablet_server.cc:179] TabletServer@127.28.173.2:0 shutting down...
I20260709 13:07:36.178354 29364 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:07:36.178707 29538 consensus_peers.cc:597] T 4f69e2661ba745b09237e4ce0494087b P bc0a9840c02a4c279170b1c5fe560370 -> Peer e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1:44833): Couldn't send request to peer e28ca864e4c848b59d8b018ac4169c32. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:44833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:36.179116 29364 tablet_replica.cc:333] T 2ef4ec98706b46e2a2ff852dca7ee48e P bc0a9840c02a4c279170b1c5fe560370: stopping tablet replica
I20260709 13:07:36.179797 29364 raft_consensus.cc:2243] T 2ef4ec98706b46e2a2ff852dca7ee48e P bc0a9840c02a4c279170b1c5fe560370 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.180300 29364 raft_consensus.cc:2272] T 2ef4ec98706b46e2a2ff852dca7ee48e P bc0a9840c02a4c279170b1c5fe560370 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.182344 29364 tablet_replica.cc:333] T 8d25bbcb97f44813aa8241e230434f74 P bc0a9840c02a4c279170b1c5fe560370: stopping tablet replica
I20260709 13:07:36.182827 29364 raft_consensus.cc:2243] T 8d25bbcb97f44813aa8241e230434f74 P bc0a9840c02a4c279170b1c5fe560370 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.183207 29364 raft_consensus.cc:2272] T 8d25bbcb97f44813aa8241e230434f74 P bc0a9840c02a4c279170b1c5fe560370 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.185535 29364 tablet_replica.cc:333] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370: stopping tablet replica
W20260709 13:07:36.185497 29612 consensus_peers.cc:597] T 2ef4ec98706b46e2a2ff852dca7ee48e P 5481e9936dfb479fa0dd925db3daff07 -> Peer e28ca864e4c848b59d8b018ac4169c32 (127.28.173.1:44833): Couldn't send request to peer e28ca864e4c848b59d8b018ac4169c32. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:44833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:36.186164 29364 raft_consensus.cc:2243] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.186550 29364 raft_consensus.cc:2272] T a5df53243d4c4e27bef57ad8f51bcb6e P bc0a9840c02a4c279170b1c5fe560370 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.188931 29364 tablet_replica.cc:333] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370: stopping tablet replica
I20260709 13:07:36.189378 29364 raft_consensus.cc:2243] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.189742 29364 raft_consensus.cc:2272] T ca6f74116b244bc0929c39ea3913a184 P bc0a9840c02a4c279170b1c5fe560370 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.191464 29364 tablet_replica.cc:333] T e01ba93272b5460a8e453d93659b85ae P bc0a9840c02a4c279170b1c5fe560370: stopping tablet replica
I20260709 13:07:36.192037 29364 raft_consensus.cc:2243] T e01ba93272b5460a8e453d93659b85ae P bc0a9840c02a4c279170b1c5fe560370 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.192682 29364 raft_consensus.cc:2272] T e01ba93272b5460a8e453d93659b85ae P bc0a9840c02a4c279170b1c5fe560370 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.194416 29364 tablet_replica.cc:333] T 4f69e2661ba745b09237e4ce0494087b P bc0a9840c02a4c279170b1c5fe560370: stopping tablet replica
I20260709 13:07:36.194856 29364 raft_consensus.cc:2243] T 4f69e2661ba745b09237e4ce0494087b P bc0a9840c02a4c279170b1c5fe560370 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:36.195649 29364 raft_consensus.cc:2272] T 4f69e2661ba745b09237e4ce0494087b P bc0a9840c02a4c279170b1c5fe560370 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.197367 29364 tablet_replica.cc:333] T dbc21554b6344107baedcec570f26b37 P bc0a9840c02a4c279170b1c5fe560370: stopping tablet replica
I20260709 13:07:36.197773 29364 raft_consensus.cc:2243] T dbc21554b6344107baedcec570f26b37 P bc0a9840c02a4c279170b1c5fe560370 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.198086 29364 raft_consensus.cc:2272] T dbc21554b6344107baedcec570f26b37 P bc0a9840c02a4c279170b1c5fe560370 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.199697 29364 tablet_replica.cc:333] T d4d2f00fadd04bdd91d3c97ebc76f005 P bc0a9840c02a4c279170b1c5fe560370: stopping tablet replica
I20260709 13:07:36.200155 29364 raft_consensus.cc:2243] T d4d2f00fadd04bdd91d3c97ebc76f005 P bc0a9840c02a4c279170b1c5fe560370 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:36.200778 29364 raft_consensus.cc:2272] T d4d2f00fadd04bdd91d3c97ebc76f005 P bc0a9840c02a4c279170b1c5fe560370 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.202180 29364 tablet_replica.cc:333] T 2af14a7828dc4808aa8fdc9c1c758b85 P bc0a9840c02a4c279170b1c5fe560370: stopping tablet replica
I20260709 13:07:36.202517 29364 raft_consensus.cc:2243] T 2af14a7828dc4808aa8fdc9c1c758b85 P bc0a9840c02a4c279170b1c5fe560370 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:36.203071 29364 raft_consensus.cc:2272] T 2af14a7828dc4808aa8fdc9c1c758b85 P bc0a9840c02a4c279170b1c5fe560370 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.229063 29364 tablet_server.cc:196] TabletServer@127.28.173.2:0 shutdown complete.
I20260709 13:07:36.244454 29364 tablet_server.cc:179] TabletServer@127.28.173.3:0 shutting down...
I20260709 13:07:36.269255 29364 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:36.269958 29364 tablet_replica.cc:333] T 2af14a7828dc4808aa8fdc9c1c758b85 P 5481e9936dfb479fa0dd925db3daff07: stopping tablet replica
I20260709 13:07:36.270560 29364 raft_consensus.cc:2243] T 2af14a7828dc4808aa8fdc9c1c758b85 P 5481e9936dfb479fa0dd925db3daff07 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.271018 29364 raft_consensus.cc:2272] T 2af14a7828dc4808aa8fdc9c1c758b85 P 5481e9936dfb479fa0dd925db3daff07 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.272688 29364 tablet_replica.cc:333] T ca6f74116b244bc0929c39ea3913a184 P 5481e9936dfb479fa0dd925db3daff07: stopping tablet replica
I20260709 13:07:36.273176 29364 raft_consensus.cc:2243] T ca6f74116b244bc0929c39ea3913a184 P 5481e9936dfb479fa0dd925db3daff07 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.273573 29364 raft_consensus.cc:2272] T ca6f74116b244bc0929c39ea3913a184 P 5481e9936dfb479fa0dd925db3daff07 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.276088 29364 tablet_replica.cc:333] T 8d25bbcb97f44813aa8241e230434f74 P 5481e9936dfb479fa0dd925db3daff07: stopping tablet replica
I20260709 13:07:36.276559 29364 raft_consensus.cc:2243] T 8d25bbcb97f44813aa8241e230434f74 P 5481e9936dfb479fa0dd925db3daff07 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.276952 29364 raft_consensus.cc:2272] T 8d25bbcb97f44813aa8241e230434f74 P 5481e9936dfb479fa0dd925db3daff07 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.278641 29364 tablet_replica.cc:333] T e01ba93272b5460a8e453d93659b85ae P 5481e9936dfb479fa0dd925db3daff07: stopping tablet replica
I20260709 13:07:36.279137 29364 raft_consensus.cc:2243] T e01ba93272b5460a8e453d93659b85ae P 5481e9936dfb479fa0dd925db3daff07 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.279506 29364 raft_consensus.cc:2272] T e01ba93272b5460a8e453d93659b85ae P 5481e9936dfb479fa0dd925db3daff07 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.281281 29364 tablet_replica.cc:333] T 4f69e2661ba745b09237e4ce0494087b P 5481e9936dfb479fa0dd925db3daff07: stopping tablet replica
I20260709 13:07:36.281736 29364 raft_consensus.cc:2243] T 4f69e2661ba745b09237e4ce0494087b P 5481e9936dfb479fa0dd925db3daff07 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.282191 29364 raft_consensus.cc:2272] T 4f69e2661ba745b09237e4ce0494087b P 5481e9936dfb479fa0dd925db3daff07 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.284016 29364 tablet_replica.cc:333] T 2ef4ec98706b46e2a2ff852dca7ee48e P 5481e9936dfb479fa0dd925db3daff07: stopping tablet replica
I20260709 13:07:36.284539 29364 raft_consensus.cc:2243] T 2ef4ec98706b46e2a2ff852dca7ee48e P 5481e9936dfb479fa0dd925db3daff07 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:36.285239 29364 raft_consensus.cc:2272] T 2ef4ec98706b46e2a2ff852dca7ee48e P 5481e9936dfb479fa0dd925db3daff07 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.286795 29364 tablet_replica.cc:333] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07: stopping tablet replica
I20260709 13:07:36.287241 29364 raft_consensus.cc:2243] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:36.287922 29364 raft_consensus.cc:2272] T dbc21554b6344107baedcec570f26b37 P 5481e9936dfb479fa0dd925db3daff07 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.289584 29364 tablet_replica.cc:333] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07: stopping tablet replica
I20260709 13:07:36.290038 29364 raft_consensus.cc:2243] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:07:36.290705 29364 raft_consensus.cc:2272] T a5df53243d4c4e27bef57ad8f51bcb6e P 5481e9936dfb479fa0dd925db3daff07 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.292708 29364 tablet_replica.cc:333] T d4d2f00fadd04bdd91d3c97ebc76f005 P 5481e9936dfb479fa0dd925db3daff07: stopping tablet replica
I20260709 13:07:36.293211 29364 raft_consensus.cc:2243] T d4d2f00fadd04bdd91d3c97ebc76f005 P 5481e9936dfb479fa0dd925db3daff07 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.293586 29364 raft_consensus.cc:2272] T d4d2f00fadd04bdd91d3c97ebc76f005 P 5481e9936dfb479fa0dd925db3daff07 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.318528 29364 tablet_server.cc:196] TabletServer@127.28.173.3:0 shutdown complete.
I20260709 13:07:36.334165 29364 master.cc:562] Master@127.28.173.62:35903 shutting down...
I20260709 13:07:36.374655 29451 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 13:07:36.524593 29364 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 78161957112549caa5d50e2c302f9947 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:36.525167 29364 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 78161957112549caa5d50e2c302f9947 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.525502 29364 tablet_replica.cc:333] T 00000000000000000000000000000000 P 78161957112549caa5d50e2c302f9947: stopping tablet replica
I20260709 13:07:36.544657 29364 master.cc:584] Master@127.28.173.62:35903 shutdown complete.
5481e9936dfb479fa0dd925db3daff07  1
bc0a9840c02a4c279170b1c5fe560370  4
e28ca864e4c848b59d8b018ac4169c32  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12476 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:07:36.583117 29364 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.28.173.62:38359
I20260709 13:07:36.584242 29364 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:36.589411 29858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:36.589733 29859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:36.591250 29364 server_base.cc:1061] running on GCE node
W20260709 13:07:36.591439 29861 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:36.592278 29364 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:36.592451 29364 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:36.592650 29364 hybrid_clock.cc:648] HybridClock initialized: now 1783602456592633 us; error 0 us; skew 500 ppm
I20260709 13:07:36.593209 29364 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:36.595541 29364 webserver.cc:533] Webserver started at http://127.28.173.62:33845/ using document root <none> and password file <none>
I20260709 13:07:36.596129 29364 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:36.596354 29364 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:36.596665 29364 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:36.597770 29364 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602443945700-29364-0/minicluster-data/master-0-root/instance:
uuid: "6007cf9605be4294a2628ee3c0db7601"
format_stamp: "Formatted at 2026-07-09 13:07:36 on dist-test-slave-x62b"
I20260709 13:07:36.601928 29364 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:07:36.605109 29866 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:36.605834 29364 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:07:36.606120 29364 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602443945700-29364-0/minicluster-data/master-0-root
uuid: "6007cf9605be4294a2628ee3c0db7601"
format_stamp: "Formatted at 2026-07-09 13:07:36 on dist-test-slave-x62b"
I20260709 13:07:36.606424 29364 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602443945700-29364-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602443945700-29364-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602443945700-29364-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:36.637827 29364 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:36.639158 29364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:36.675004 29364 rpc_server.cc:307] RPC server started. Bound to: 127.28.173.62:38359
I20260709 13:07:36.675136 29917 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.173.62:38359 every 8 connection(s)
I20260709 13:07:36.678726 29918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:36.687786 29918 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6007cf9605be4294a2628ee3c0db7601: Bootstrap starting.
I20260709 13:07:36.692191 29918 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6007cf9605be4294a2628ee3c0db7601: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:36.696059 29918 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6007cf9605be4294a2628ee3c0db7601: No bootstrap required, opened a new log
I20260709 13:07:36.698101 29918 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6007cf9605be4294a2628ee3c0db7601 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6007cf9605be4294a2628ee3c0db7601" member_type: VOTER }
I20260709 13:07:36.698477 29918 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6007cf9605be4294a2628ee3c0db7601 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:36.698704 29918 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6007cf9605be4294a2628ee3c0db7601 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6007cf9605be4294a2628ee3c0db7601, State: Initialized, Role: FOLLOWER
I20260709 13:07:36.699307 29918 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6007cf9605be4294a2628ee3c0db7601 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6007cf9605be4294a2628ee3c0db7601" member_type: VOTER }
I20260709 13:07:36.699744 29918 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6007cf9605be4294a2628ee3c0db7601 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:07:36.699980 29918 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6007cf9605be4294a2628ee3c0db7601 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:07:36.700265 29918 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6007cf9605be4294a2628ee3c0db7601 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:36.703961 29918 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6007cf9605be4294a2628ee3c0db7601 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6007cf9605be4294a2628ee3c0db7601" member_type: VOTER }
I20260709 13:07:36.704478 29918 leader_election.cc:304] T 00000000000000000000000000000000 P 6007cf9605be4294a2628ee3c0db7601 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6007cf9605be4294a2628ee3c0db7601; no voters: 
I20260709 13:07:36.705506 29918 leader_election.cc:290] T 00000000000000000000000000000000 P 6007cf9605be4294a2628ee3c0db7601 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:07:36.705801 29921 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6007cf9605be4294a2628ee3c0db7601 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:36.707050 29921 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6007cf9605be4294a2628ee3c0db7601 [term 1 LEADER]: Becoming Leader. State: Replica: 6007cf9605be4294a2628ee3c0db7601, State: Running, Role: LEADER
I20260709 13:07:36.707767 29921 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6007cf9605be4294a2628ee3c0db7601 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6007cf9605be4294a2628ee3c0db7601" member_type: VOTER }
I20260709 13:07:36.708423 29918 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6007cf9605be4294a2628ee3c0db7601 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:07:36.712853 29923 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6007cf9605be4294a2628ee3c0db7601 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6007cf9605be4294a2628ee3c0db7601. Latest consensus state: current_term: 1 leader_uuid: "6007cf9605be4294a2628ee3c0db7601" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6007cf9605be4294a2628ee3c0db7601" member_type: VOTER } }
I20260709 13:07:36.712891 29922 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6007cf9605be4294a2628ee3c0db7601 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6007cf9605be4294a2628ee3c0db7601" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6007cf9605be4294a2628ee3c0db7601" member_type: VOTER } }
I20260709 13:07:36.713718 29923 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6007cf9605be4294a2628ee3c0db7601 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:36.713752 29922 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6007cf9605be4294a2628ee3c0db7601 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:36.723219 29928 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:07:36.727928 29928 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:07:36.728895 29364 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:07:36.736302 29928 catalog_manager.cc:1383] Generated new cluster ID: 02f90a84d7ae452c982d848298ba266a
I20260709 13:07:36.736573 29928 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:07:36.753410 29928 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:07:36.754568 29928 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:07:36.766659 29928 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6007cf9605be4294a2628ee3c0db7601: Generated new TSK 0
I20260709 13:07:36.767210 29928 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:07:36.795421 29364 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:36.801113 29939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:36.802282 29940 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:36.803800 29942 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:36.804129 29364 server_base.cc:1061] running on GCE node
I20260709 13:07:36.804971 29364 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:36.805191 29364 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:36.805401 29364 hybrid_clock.cc:648] HybridClock initialized: now 1783602456805367 us; error 0 us; skew 500 ppm
I20260709 13:07:36.805923 29364 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:36.808477 29364 webserver.cc:533] Webserver started at http://127.28.173.1:43369/ using document root <none> and password file <none>
I20260709 13:07:36.808951 29364 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:36.809145 29364 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:36.809419 29364 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:36.810451 29364 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602443945700-29364-0/minicluster-data/ts-0-root/instance:
uuid: "4a1d35e9bdf14f44a53c9a1984d04629"
format_stamp: "Formatted at 2026-07-09 13:07:36 on dist-test-slave-x62b"
I20260709 13:07:36.814692 29364 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:07:36.817754 29947 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:36.818405 29364 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:07:36.818689 29364 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602443945700-29364-0/minicluster-data/ts-0-root
uuid: "4a1d35e9bdf14f44a53c9a1984d04629"
format_stamp: "Formatted at 2026-07-09 13:07:36 on dist-test-slave-x62b"
I20260709 13:07:36.818957 29364 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602443945700-29364-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602443945700-29364-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602443945700-29364-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:36.834444 29364 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:36.835686 29364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:36.837224 29364 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:36.839386 29364 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:36.839598 29364 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:36.839865 29364 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:36.840056 29364 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:36.877955 29364 rpc_server.cc:307] RPC server started. Bound to: 127.28.173.1:36133
I20260709 13:07:36.878062 30009 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.173.1:36133 every 8 connection(s)
I20260709 13:07:36.882743 29364 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:36.889539 30014 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:36.889847 30015 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:36.893369 29364 server_base.cc:1061] running on GCE node
W20260709 13:07:36.893514 30017 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:36.894773 29364 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:36.894977 29364 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:36.895164 29364 hybrid_clock.cc:648] HybridClock initialized: now 1783602456895146 us; error 0 us; skew 500 ppm
I20260709 13:07:36.895679 29364 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:36.898507 29364 webserver.cc:533] Webserver started at http://127.28.173.2:33375/ using document root <none> and password file <none>
I20260709 13:07:36.898984 29364 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:36.899173 29364 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:36.899458 29364 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:36.901014 29364 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602443945700-29364-0/minicluster-data/ts-1-root/instance:
uuid: "02f386f6c1ab419f8c7922092b04a1b0"
format_stamp: "Formatted at 2026-07-09 13:07:36 on dist-test-slave-x62b"
I20260709 13:07:36.903405 30010 heartbeater.cc:344] Connected to a master server at 127.28.173.62:38359
I20260709 13:07:36.903764 30010 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:36.904497 30010 heartbeater.cc:507] Master 127.28.173.62:38359 requested a full tablet report, sending...
I20260709 13:07:36.906232 29364 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.002s
I20260709 13:07:36.906721 29883 ts_manager.cc:194] Registered new tserver with Master: 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1:36133)
I20260709 13:07:36.908632 29883 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43226
I20260709 13:07:36.910135 30022 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:36.910969 29364 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:07:36.911278 29364 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602443945700-29364-0/minicluster-data/ts-1-root
uuid: "02f386f6c1ab419f8c7922092b04a1b0"
format_stamp: "Formatted at 2026-07-09 13:07:36 on dist-test-slave-x62b"
I20260709 13:07:36.911559 29364 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602443945700-29364-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602443945700-29364-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602443945700-29364-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:36.936625 29364 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:36.937809 29364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:36.939239 29364 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:36.941336 29364 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:36.941558 29364 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:36.941807 29364 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:36.941972 29364 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:36.979282 29364 rpc_server.cc:307] RPC server started. Bound to: 127.28.173.2:44093
I20260709 13:07:36.979367 30084 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.173.2:44093 every 8 connection(s)
I20260709 13:07:36.983788 29364 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:36.990268 30088 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:36.991856 30089 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:36.994022 30091 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:36.994714 29364 server_base.cc:1061] running on GCE node
I20260709 13:07:36.995438 30085 heartbeater.cc:344] Connected to a master server at 127.28.173.62:38359
I20260709 13:07:36.995597 29364 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:07:36.995781 30085 heartbeater.cc:461] Registering TS with master...
W20260709 13:07:36.995918 29364 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:36.996187 29364 hybrid_clock.cc:648] HybridClock initialized: now 1783602456996169 us; error 0 us; skew 500 ppm
I20260709 13:07:36.996637 30085 heartbeater.cc:507] Master 127.28.173.62:38359 requested a full tablet report, sending...
I20260709 13:07:36.996737 29364 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:36.998618 29883 ts_manager.cc:194] Registered new tserver with Master: 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2:44093)
I20260709 13:07:36.999420 29364 webserver.cc:533] Webserver started at http://127.28.173.3:43207/ using document root <none> and password file <none>
I20260709 13:07:37.000005 29364 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:37.000196 29364 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:37.000102 29883 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43232
I20260709 13:07:37.000537 29364 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:37.001754 29364 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602443945700-29364-0/minicluster-data/ts-2-root/instance:
uuid: "6c5f1932e9134824a0f7823dccf6273e"
format_stamp: "Formatted at 2026-07-09 13:07:36 on dist-test-slave-x62b"
I20260709 13:07:37.006006 29364 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:07:37.009758 30096 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:37.010562 29364 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:07:37.010861 29364 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602443945700-29364-0/minicluster-data/ts-2-root
uuid: "6c5f1932e9134824a0f7823dccf6273e"
format_stamp: "Formatted at 2026-07-09 13:07:36 on dist-test-slave-x62b"
I20260709 13:07:37.011117 29364 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602443945700-29364-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602443945700-29364-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602443945700-29364-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:37.029969 29364 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:37.031248 29364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:37.032760 29364 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:37.034837 29364 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:37.035007 29364 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:37.035341 29364 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:37.035507 29364 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:37.073112 29364 rpc_server.cc:307] RPC server started. Bound to: 127.28.173.3:43375
I20260709 13:07:37.073207 30158 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.173.3:43375 every 8 connection(s)
I20260709 13:07:37.085884 30159 heartbeater.cc:344] Connected to a master server at 127.28.173.62:38359
I20260709 13:07:37.086241 30159 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:37.086925 30159 heartbeater.cc:507] Master 127.28.173.62:38359 requested a full tablet report, sending...
I20260709 13:07:37.088824 29883 ts_manager.cc:194] Registered new tserver with Master: 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3:43375)
I20260709 13:07:37.089650 29364 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013442307s
I20260709 13:07:37.090147 29883 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43242
I20260709 13:07:37.113144 29883 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43248:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:07:37.116015 29883 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:07:37.196368 29974 tablet_service.cc:1511] Processing CreateTablet for tablet 2418e193a92a4d36a4149de5f38be171 (DEFAULT_TABLE table=test-workload [id=65e927499bf04be3aa4377125763a63b]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:07:37.197247 29972 tablet_service.cc:1511] Processing CreateTablet for tablet 4e48e4ede2b9419c805b7d9bcd1e2fb0 (DEFAULT_TABLE table=test-workload [id=65e927499bf04be3aa4377125763a63b]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:07:37.197880 29974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2418e193a92a4d36a4149de5f38be171. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.197980 29973 tablet_service.cc:1511] Processing CreateTablet for tablet c218ddfeb78c4cfa98f71f681c807503 (DEFAULT_TABLE table=test-workload [id=65e927499bf04be3aa4377125763a63b]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:07:37.198553 29972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e48e4ede2b9419c805b7d9bcd1e2fb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.195549 29975 tablet_service.cc:1511] Processing CreateTablet for tablet 8dfa5968812443d28f2c148c6768f51f (DEFAULT_TABLE table=test-workload [id=65e927499bf04be3aa4377125763a63b]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:07:37.199667 30121 tablet_service.cc:1511] Processing CreateTablet for tablet 4e48e4ede2b9419c805b7d9bcd1e2fb0 (DEFAULT_TABLE table=test-workload [id=65e927499bf04be3aa4377125763a63b]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:07:37.200970 30121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e48e4ede2b9419c805b7d9bcd1e2fb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.200974 30123 tablet_service.cc:1511] Processing CreateTablet for tablet 2418e193a92a4d36a4149de5f38be171 (DEFAULT_TABLE table=test-workload [id=65e927499bf04be3aa4377125763a63b]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:07:37.202418 30123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2418e193a92a4d36a4149de5f38be171. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.202474 30122 tablet_service.cc:1511] Processing CreateTablet for tablet c218ddfeb78c4cfa98f71f681c807503 (DEFAULT_TABLE table=test-workload [id=65e927499bf04be3aa4377125763a63b]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:07:37.203790 30122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c218ddfeb78c4cfa98f71f681c807503. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.205691 30124 tablet_service.cc:1511] Processing CreateTablet for tablet 8dfa5968812443d28f2c148c6768f51f (DEFAULT_TABLE table=test-workload [id=65e927499bf04be3aa4377125763a63b]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:07:37.206859 30124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dfa5968812443d28f2c148c6768f51f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.207178 29971 tablet_service.cc:1511] Processing CreateTablet for tablet 9398eeffa5504937973ba568bce7b4c2 (DEFAULT_TABLE table=test-workload [id=65e927499bf04be3aa4377125763a63b]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:07:37.208845 30049 tablet_service.cc:1511] Processing CreateTablet for tablet 2418e193a92a4d36a4149de5f38be171 (DEFAULT_TABLE table=test-workload [id=65e927499bf04be3aa4377125763a63b]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:07:37.210124 30049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2418e193a92a4d36a4149de5f38be171. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.212863 30048 tablet_service.cc:1511] Processing CreateTablet for tablet c218ddfeb78c4cfa98f71f681c807503 (DEFAULT_TABLE table=test-workload [id=65e927499bf04be3aa4377125763a63b]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:07:37.214138 30048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c218ddfeb78c4cfa98f71f681c807503. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.217872 30047 tablet_service.cc:1511] Processing CreateTablet for tablet 4e48e4ede2b9419c805b7d9bcd1e2fb0 (DEFAULT_TABLE table=test-workload [id=65e927499bf04be3aa4377125763a63b]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:07:37.218039 30050 tablet_service.cc:1511] Processing CreateTablet for tablet 8dfa5968812443d28f2c148c6768f51f (DEFAULT_TABLE table=test-workload [id=65e927499bf04be3aa4377125763a63b]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:07:37.218242 30046 tablet_service.cc:1511] Processing CreateTablet for tablet 9398eeffa5504937973ba568bce7b4c2 (DEFAULT_TABLE table=test-workload [id=65e927499bf04be3aa4377125763a63b]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:07:37.220924 30047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e48e4ede2b9419c805b7d9bcd1e2fb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.220625 30045 tablet_service.cc:1511] Processing CreateTablet for tablet c61e62ccbc434482b70daf1670495174 (DEFAULT_TABLE table=test-workload [id=65e927499bf04be3aa4377125763a63b]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:07:37.221349 29970 tablet_service.cc:1511] Processing CreateTablet for tablet c61e62ccbc434482b70daf1670495174 (DEFAULT_TABLE table=test-workload [id=65e927499bf04be3aa4377125763a63b]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:07:37.221925 30045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c61e62ccbc434482b70daf1670495174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.221733 29969 tablet_service.cc:1511] Processing CreateTablet for tablet 22b91a84b0d244f987c2625faa04ecce (DEFAULT_TABLE table=test-workload [id=65e927499bf04be3aa4377125763a63b]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:07:37.222524 30050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dfa5968812443d28f2c148c6768f51f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.223063 29975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dfa5968812443d28f2c148c6768f51f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.223593 30046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9398eeffa5504937973ba568bce7b4c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.225181 29971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9398eeffa5504937973ba568bce7b4c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.226811 29970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c61e62ccbc434482b70daf1670495174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.232924 29973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c218ddfeb78c4cfa98f71f681c807503. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.234241 29969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22b91a84b0d244f987c2625faa04ecce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.237262 30120 tablet_service.cc:1511] Processing CreateTablet for tablet 9398eeffa5504937973ba568bce7b4c2 (DEFAULT_TABLE table=test-workload [id=65e927499bf04be3aa4377125763a63b]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:07:37.238538 30120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9398eeffa5504937973ba568bce7b4c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.240911 30119 tablet_service.cc:1511] Processing CreateTablet for tablet c61e62ccbc434482b70daf1670495174 (DEFAULT_TABLE table=test-workload [id=65e927499bf04be3aa4377125763a63b]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:07:37.242202 30119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c61e62ccbc434482b70daf1670495174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.272719 30044 tablet_service.cc:1511] Processing CreateTablet for tablet 22b91a84b0d244f987c2625faa04ecce (DEFAULT_TABLE table=test-workload [id=65e927499bf04be3aa4377125763a63b]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:07:37.274044 30044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22b91a84b0d244f987c2625faa04ecce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.275630 30174 tablet_bootstrap.cc:492] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 6c5f1932e9134824a0f7823dccf6273e: Bootstrap starting.
I20260709 13:07:37.294202 30174 tablet_bootstrap.cc:654] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 6c5f1932e9134824a0f7823dccf6273e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.296823 30121 tablet_service.cc:1511] Processing CreateTablet for tablet 22b91a84b0d244f987c2625faa04ecce (DEFAULT_TABLE table=test-workload [id=65e927499bf04be3aa4377125763a63b]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:07:37.297257 29968 tablet_service.cc:1511] Processing CreateTablet for tablet bdc7f4487d69425da272a9c59e5e3c54 (DEFAULT_TABLE table=test-workload [id=65e927499bf04be3aa4377125763a63b]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:07:37.303629 29968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdc7f4487d69425da272a9c59e5e3c54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.297449 30043 tablet_service.cc:1511] Processing CreateTablet for tablet bdc7f4487d69425da272a9c59e5e3c54 (DEFAULT_TABLE table=test-workload [id=65e927499bf04be3aa4377125763a63b]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:07:37.303629 30121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22b91a84b0d244f987c2625faa04ecce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.309010 30043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdc7f4487d69425da272a9c59e5e3c54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.314390 29967 tablet_service.cc:1511] Processing CreateTablet for tablet 4430e39586c24524bffd80447f2999be (DEFAULT_TABLE table=test-workload [id=65e927499bf04be3aa4377125763a63b]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:07:37.315693 29967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4430e39586c24524bffd80447f2999be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.328943 30119 tablet_service.cc:1511] Processing CreateTablet for tablet 4430e39586c24524bffd80447f2999be (DEFAULT_TABLE table=test-workload [id=65e927499bf04be3aa4377125763a63b]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:07:37.330296 30119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4430e39586c24524bffd80447f2999be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.336612 30046 tablet_service.cc:1511] Processing CreateTablet for tablet 0242b20a350c42c9978239cd1ec620d2 (DEFAULT_TABLE table=test-workload [id=65e927499bf04be3aa4377125763a63b]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:07:37.337872 30120 tablet_service.cc:1511] Processing CreateTablet for tablet 0242b20a350c42c9978239cd1ec620d2 (DEFAULT_TABLE table=test-workload [id=65e927499bf04be3aa4377125763a63b]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:07:37.339042 30046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0242b20a350c42c9978239cd1ec620d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.337785 29971 tablet_service.cc:1511] Processing CreateTablet for tablet 0242b20a350c42c9978239cd1ec620d2 (DEFAULT_TABLE table=test-workload [id=65e927499bf04be3aa4377125763a63b]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:07:37.339180 30120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0242b20a350c42c9978239cd1ec620d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.339978 29971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0242b20a350c42c9978239cd1ec620d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.361294 30176 tablet_bootstrap.cc:492] T 2418e193a92a4d36a4149de5f38be171 P 02f386f6c1ab419f8c7922092b04a1b0: Bootstrap starting.
I20260709 13:07:37.361377 30175 tablet_bootstrap.cc:492] T 22b91a84b0d244f987c2625faa04ecce P 4a1d35e9bdf14f44a53c9a1984d04629: Bootstrap starting.
I20260709 13:07:37.369338 30176 tablet_bootstrap.cc:654] T 2418e193a92a4d36a4149de5f38be171 P 02f386f6c1ab419f8c7922092b04a1b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.372099 30123 tablet_service.cc:1511] Processing CreateTablet for tablet bdc7f4487d69425da272a9c59e5e3c54 (DEFAULT_TABLE table=test-workload [id=65e927499bf04be3aa4377125763a63b]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:07:37.372458 30050 tablet_service.cc:1511] Processing CreateTablet for tablet 4430e39586c24524bffd80447f2999be (DEFAULT_TABLE table=test-workload [id=65e927499bf04be3aa4377125763a63b]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:07:37.373500 30123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdc7f4487d69425da272a9c59e5e3c54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.373663 30174 tablet_bootstrap.cc:492] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 6c5f1932e9134824a0f7823dccf6273e: No bootstrap required, opened a new log
I20260709 13:07:37.374274 30174 ts_tablet_manager.cc:1403] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 6c5f1932e9134824a0f7823dccf6273e: Time spent bootstrapping tablet: real 0.099s	user 0.010s	sys 0.011s
I20260709 13:07:37.381153 30174 raft_consensus.cc:359] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.381881 30174 raft_consensus.cc:385] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.382191 30174 raft_consensus.cc:740] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5f1932e9134824a0f7823dccf6273e, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.373696 30050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4430e39586c24524bffd80447f2999be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.382933 30174 consensus_queue.cc:260] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 6c5f1932e9134824a0f7823dccf6273e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.399178 30174 ts_tablet_manager.cc:1434] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 6c5f1932e9134824a0f7823dccf6273e: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 13:07:37.400418 30159 heartbeater.cc:499] Master 127.28.173.62:38359 was elected leader, sending a full tablet report...
I20260709 13:07:37.400586 30175 tablet_bootstrap.cc:654] T 22b91a84b0d244f987c2625faa04ecce P 4a1d35e9bdf14f44a53c9a1984d04629: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.401746 30174 tablet_bootstrap.cc:492] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e: Bootstrap starting.
I20260709 13:07:37.405179 30176 tablet_bootstrap.cc:492] T 2418e193a92a4d36a4149de5f38be171 P 02f386f6c1ab419f8c7922092b04a1b0: No bootstrap required, opened a new log
I20260709 13:07:37.405665 30176 ts_tablet_manager.cc:1403] T 2418e193a92a4d36a4149de5f38be171 P 02f386f6c1ab419f8c7922092b04a1b0: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.000s
I20260709 13:07:37.408346 30176 raft_consensus.cc:359] T 2418e193a92a4d36a4149de5f38be171 P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.408973 30176 raft_consensus.cc:385] T 2418e193a92a4d36a4149de5f38be171 P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.413301 30176 raft_consensus.cc:740] T 2418e193a92a4d36a4149de5f38be171 P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02f386f6c1ab419f8c7922092b04a1b0, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.414063 30176 consensus_queue.cc:260] T 2418e193a92a4d36a4149de5f38be171 P 02f386f6c1ab419f8c7922092b04a1b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.414376 30174 tablet_bootstrap.cc:654] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.415970 30085 heartbeater.cc:499] Master 127.28.173.62:38359 was elected leader, sending a full tablet report...
I20260709 13:07:37.416502 30176 ts_tablet_manager.cc:1434] T 2418e193a92a4d36a4149de5f38be171 P 02f386f6c1ab419f8c7922092b04a1b0: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:07:37.417387 30176 tablet_bootstrap.cc:492] T 8dfa5968812443d28f2c148c6768f51f P 02f386f6c1ab419f8c7922092b04a1b0: Bootstrap starting.
I20260709 13:07:37.421132 30175 tablet_bootstrap.cc:492] T 22b91a84b0d244f987c2625faa04ecce P 4a1d35e9bdf14f44a53c9a1984d04629: No bootstrap required, opened a new log
I20260709 13:07:37.421761 30175 ts_tablet_manager.cc:1403] T 22b91a84b0d244f987c2625faa04ecce P 4a1d35e9bdf14f44a53c9a1984d04629: Time spent bootstrapping tablet: real 0.061s	user 0.012s	sys 0.006s
I20260709 13:07:37.423864 30176 tablet_bootstrap.cc:654] T 8dfa5968812443d28f2c148c6768f51f P 02f386f6c1ab419f8c7922092b04a1b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.425606 30175 raft_consensus.cc:359] T 22b91a84b0d244f987c2625faa04ecce P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.426609 30175 raft_consensus.cc:385] T 22b91a84b0d244f987c2625faa04ecce P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.427055 30175 raft_consensus.cc:740] T 22b91a84b0d244f987c2625faa04ecce P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a1d35e9bdf14f44a53c9a1984d04629, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.428164 30175 consensus_queue.cc:260] T 22b91a84b0d244f987c2625faa04ecce P 4a1d35e9bdf14f44a53c9a1984d04629 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.435313 30176 tablet_bootstrap.cc:492] T 8dfa5968812443d28f2c148c6768f51f P 02f386f6c1ab419f8c7922092b04a1b0: No bootstrap required, opened a new log
I20260709 13:07:37.435875 30176 ts_tablet_manager.cc:1403] T 8dfa5968812443d28f2c148c6768f51f P 02f386f6c1ab419f8c7922092b04a1b0: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.005s
I20260709 13:07:37.438165 30175 ts_tablet_manager.cc:1434] T 22b91a84b0d244f987c2625faa04ecce P 4a1d35e9bdf14f44a53c9a1984d04629: Time spent starting tablet: real 0.016s	user 0.012s	sys 0.002s
I20260709 13:07:37.438891 30010 heartbeater.cc:499] Master 127.28.173.62:38359 was elected leader, sending a full tablet report...
I20260709 13:07:37.438709 30176 raft_consensus.cc:359] T 8dfa5968812443d28f2c148c6768f51f P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } } peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } }
I20260709 13:07:37.439406 30174 tablet_bootstrap.cc:492] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e: No bootstrap required, opened a new log
I20260709 13:07:37.439424 30176 raft_consensus.cc:385] T 8dfa5968812443d28f2c148c6768f51f P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.439951 30174 ts_tablet_manager.cc:1403] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e: Time spent bootstrapping tablet: real 0.039s	user 0.004s	sys 0.023s
I20260709 13:07:37.439874 30176 raft_consensus.cc:740] T 8dfa5968812443d28f2c148c6768f51f P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02f386f6c1ab419f8c7922092b04a1b0, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.440834 30176 consensus_queue.cc:260] T 8dfa5968812443d28f2c148c6768f51f P 02f386f6c1ab419f8c7922092b04a1b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } } peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } }
I20260709 13:07:37.443068 30176 ts_tablet_manager.cc:1434] T 8dfa5968812443d28f2c148c6768f51f P 02f386f6c1ab419f8c7922092b04a1b0: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:07:37.442768 30174 raft_consensus.cc:359] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.443429 30174 raft_consensus.cc:385] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.443701 30174 raft_consensus.cc:740] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5f1932e9134824a0f7823dccf6273e, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.443955 30176 tablet_bootstrap.cc:492] T 9398eeffa5504937973ba568bce7b4c2 P 02f386f6c1ab419f8c7922092b04a1b0: Bootstrap starting.
I20260709 13:07:37.444445 30174 consensus_queue.cc:260] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.446558 30174 ts_tablet_manager.cc:1434] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 13:07:37.447461 30174 tablet_bootstrap.cc:492] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e: Bootstrap starting.
I20260709 13:07:37.450299 30176 tablet_bootstrap.cc:654] T 9398eeffa5504937973ba568bce7b4c2 P 02f386f6c1ab419f8c7922092b04a1b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.452394 30175 tablet_bootstrap.cc:492] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629: Bootstrap starting.
I20260709 13:07:37.454005 30174 tablet_bootstrap.cc:654] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.455737 30176 tablet_bootstrap.cc:492] T 9398eeffa5504937973ba568bce7b4c2 P 02f386f6c1ab419f8c7922092b04a1b0: No bootstrap required, opened a new log
I20260709 13:07:37.456243 30176 ts_tablet_manager.cc:1403] T 9398eeffa5504937973ba568bce7b4c2 P 02f386f6c1ab419f8c7922092b04a1b0: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 13:07:37.459681 30175 tablet_bootstrap.cc:654] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.459934 30176 raft_consensus.cc:359] T 9398eeffa5504937973ba568bce7b4c2 P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.460935 30176 raft_consensus.cc:385] T 9398eeffa5504937973ba568bce7b4c2 P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.461359 30176 raft_consensus.cc:740] T 9398eeffa5504937973ba568bce7b4c2 P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02f386f6c1ab419f8c7922092b04a1b0, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.462453 30176 consensus_queue.cc:260] T 9398eeffa5504937973ba568bce7b4c2 P 02f386f6c1ab419f8c7922092b04a1b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.465571 30176 ts_tablet_manager.cc:1434] T 9398eeffa5504937973ba568bce7b4c2 P 02f386f6c1ab419f8c7922092b04a1b0: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 13:07:37.466835 30176 tablet_bootstrap.cc:492] T 22b91a84b0d244f987c2625faa04ecce P 02f386f6c1ab419f8c7922092b04a1b0: Bootstrap starting.
I20260709 13:07:37.469702 30174 tablet_bootstrap.cc:492] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e: No bootstrap required, opened a new log
I20260709 13:07:37.470222 30174 ts_tablet_manager.cc:1403] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.009s
I20260709 13:07:37.473258 30174 raft_consensus.cc:359] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.473771 30176 tablet_bootstrap.cc:654] T 22b91a84b0d244f987c2625faa04ecce P 02f386f6c1ab419f8c7922092b04a1b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.474058 30174 raft_consensus.cc:385] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.474372 30175 tablet_bootstrap.cc:492] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629: No bootstrap required, opened a new log
I20260709 13:07:37.474411 30174 raft_consensus.cc:740] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5f1932e9134824a0f7823dccf6273e, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.475031 30175 ts_tablet_manager.cc:1403] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629: Time spent bootstrapping tablet: real 0.023s	user 0.004s	sys 0.007s
I20260709 13:07:37.475526 30174 consensus_queue.cc:260] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.478120 30174 ts_tablet_manager.cc:1434] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:07:37.477903 30175 raft_consensus.cc:359] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.478853 30175 raft_consensus.cc:385] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.479234 30175 raft_consensus.cc:740] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a1d35e9bdf14f44a53c9a1984d04629, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.479449 30174 tablet_bootstrap.cc:492] T 9398eeffa5504937973ba568bce7b4c2 P 6c5f1932e9134824a0f7823dccf6273e: Bootstrap starting.
I20260709 13:07:37.480099 30175 consensus_queue.cc:260] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.485131 30176 tablet_bootstrap.cc:492] T 22b91a84b0d244f987c2625faa04ecce P 02f386f6c1ab419f8c7922092b04a1b0: No bootstrap required, opened a new log
I20260709 13:07:37.485651 30176 ts_tablet_manager.cc:1403] T 22b91a84b0d244f987c2625faa04ecce P 02f386f6c1ab419f8c7922092b04a1b0: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.007s
I20260709 13:07:37.488158 30174 tablet_bootstrap.cc:654] T 9398eeffa5504937973ba568bce7b4c2 P 6c5f1932e9134824a0f7823dccf6273e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.488956 30175 ts_tablet_manager.cc:1434] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:07:37.488550 30176 raft_consensus.cc:359] T 22b91a84b0d244f987c2625faa04ecce P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.489382 30176 raft_consensus.cc:385] T 22b91a84b0d244f987c2625faa04ecce P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.489735 30176 raft_consensus.cc:740] T 22b91a84b0d244f987c2625faa04ecce P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02f386f6c1ab419f8c7922092b04a1b0, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.489851 30175 tablet_bootstrap.cc:492] T 9398eeffa5504937973ba568bce7b4c2 P 4a1d35e9bdf14f44a53c9a1984d04629: Bootstrap starting.
I20260709 13:07:37.490666 30176 consensus_queue.cc:260] T 22b91a84b0d244f987c2625faa04ecce P 02f386f6c1ab419f8c7922092b04a1b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.493683 30176 ts_tablet_manager.cc:1434] T 22b91a84b0d244f987c2625faa04ecce P 02f386f6c1ab419f8c7922092b04a1b0: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:07:37.494747 30176 tablet_bootstrap.cc:492] T 0242b20a350c42c9978239cd1ec620d2 P 02f386f6c1ab419f8c7922092b04a1b0: Bootstrap starting.
I20260709 13:07:37.500170 30175 tablet_bootstrap.cc:654] T 9398eeffa5504937973ba568bce7b4c2 P 4a1d35e9bdf14f44a53c9a1984d04629: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.502861 30176 tablet_bootstrap.cc:654] T 0242b20a350c42c9978239cd1ec620d2 P 02f386f6c1ab419f8c7922092b04a1b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.505859 30174 tablet_bootstrap.cc:492] T 9398eeffa5504937973ba568bce7b4c2 P 6c5f1932e9134824a0f7823dccf6273e: No bootstrap required, opened a new log
I20260709 13:07:37.506412 30174 ts_tablet_manager.cc:1403] T 9398eeffa5504937973ba568bce7b4c2 P 6c5f1932e9134824a0f7823dccf6273e: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.009s
I20260709 13:07:37.506453 30175 tablet_bootstrap.cc:492] T 9398eeffa5504937973ba568bce7b4c2 P 4a1d35e9bdf14f44a53c9a1984d04629: No bootstrap required, opened a new log
I20260709 13:07:37.507205 30175 ts_tablet_manager.cc:1403] T 9398eeffa5504937973ba568bce7b4c2 P 4a1d35e9bdf14f44a53c9a1984d04629: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.004s
I20260709 13:07:37.508980 30176 tablet_bootstrap.cc:492] T 0242b20a350c42c9978239cd1ec620d2 P 02f386f6c1ab419f8c7922092b04a1b0: No bootstrap required, opened a new log
I20260709 13:07:37.509490 30176 ts_tablet_manager.cc:1403] T 0242b20a350c42c9978239cd1ec620d2 P 02f386f6c1ab419f8c7922092b04a1b0: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.005s
I20260709 13:07:37.509624 30174 raft_consensus.cc:359] T 9398eeffa5504937973ba568bce7b4c2 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.509847 30175 raft_consensus.cc:359] T 9398eeffa5504937973ba568bce7b4c2 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.510388 30174 raft_consensus.cc:385] T 9398eeffa5504937973ba568bce7b4c2 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.510509 30175 raft_consensus.cc:385] T 9398eeffa5504937973ba568bce7b4c2 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.510758 30174 raft_consensus.cc:740] T 9398eeffa5504937973ba568bce7b4c2 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5f1932e9134824a0f7823dccf6273e, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.510843 30175 raft_consensus.cc:740] T 9398eeffa5504937973ba568bce7b4c2 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a1d35e9bdf14f44a53c9a1984d04629, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.511791 30175 consensus_queue.cc:260] T 9398eeffa5504937973ba568bce7b4c2 P 4a1d35e9bdf14f44a53c9a1984d04629 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.511617 30174 consensus_queue.cc:260] T 9398eeffa5504937973ba568bce7b4c2 P 6c5f1932e9134824a0f7823dccf6273e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.512733 30178 raft_consensus.cc:493] T 9398eeffa5504937973ba568bce7b4c2 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.512343 30176 raft_consensus.cc:359] T 0242b20a350c42c9978239cd1ec620d2 P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.513309 30176 raft_consensus.cc:385] T 0242b20a350c42c9978239cd1ec620d2 P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.513131 30178 raft_consensus.cc:515] T 9398eeffa5504937973ba568bce7b4c2 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.513600 30176 raft_consensus.cc:740] T 0242b20a350c42c9978239cd1ec620d2 P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02f386f6c1ab419f8c7922092b04a1b0, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.514545 30176 consensus_queue.cc:260] T 0242b20a350c42c9978239cd1ec620d2 P 02f386f6c1ab419f8c7922092b04a1b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.520705 30176 ts_tablet_manager.cc:1434] T 0242b20a350c42c9978239cd1ec620d2 P 02f386f6c1ab419f8c7922092b04a1b0: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:07:37.521251 30178 leader_election.cc:290] T 9398eeffa5504937973ba568bce7b4c2 P 6c5f1932e9134824a0f7823dccf6273e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1:36133), 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2:44093)
I20260709 13:07:37.521900 30176 tablet_bootstrap.cc:492] T c61e62ccbc434482b70daf1670495174 P 02f386f6c1ab419f8c7922092b04a1b0: Bootstrap starting.
I20260709 13:07:37.530326 30176 tablet_bootstrap.cc:654] T c61e62ccbc434482b70daf1670495174 P 02f386f6c1ab419f8c7922092b04a1b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.542946 30174 ts_tablet_manager.cc:1434] T 9398eeffa5504937973ba568bce7b4c2 P 6c5f1932e9134824a0f7823dccf6273e: Time spent starting tablet: real 0.036s	user 0.015s	sys 0.019s
I20260709 13:07:37.542858 29985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9398eeffa5504937973ba568bce7b4c2" candidate_uuid: "6c5f1932e9134824a0f7823dccf6273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" is_pre_election: true
I20260709 13:07:37.543661 29985 raft_consensus.cc:2468] T 9398eeffa5504937973ba568bce7b4c2 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c5f1932e9134824a0f7823dccf6273e in term 0.
I20260709 13:07:37.545002 30176 tablet_bootstrap.cc:492] T c61e62ccbc434482b70daf1670495174 P 02f386f6c1ab419f8c7922092b04a1b0: No bootstrap required, opened a new log
I20260709 13:07:37.545074 30097 leader_election.cc:304] T 9398eeffa5504937973ba568bce7b4c2 P 6c5f1932e9134824a0f7823dccf6273e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a1d35e9bdf14f44a53c9a1984d04629, 6c5f1932e9134824a0f7823dccf6273e; no voters: 
I20260709 13:07:37.545609 30176 ts_tablet_manager.cc:1403] T c61e62ccbc434482b70daf1670495174 P 02f386f6c1ab419f8c7922092b04a1b0: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.004s
I20260709 13:07:37.545732 30174 tablet_bootstrap.cc:492] T c218ddfeb78c4cfa98f71f681c807503 P 6c5f1932e9134824a0f7823dccf6273e: Bootstrap starting.
I20260709 13:07:37.545995 30175 ts_tablet_manager.cc:1434] T 9398eeffa5504937973ba568bce7b4c2 P 4a1d35e9bdf14f44a53c9a1984d04629: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.000s
I20260709 13:07:37.548712 30176 raft_consensus.cc:359] T c61e62ccbc434482b70daf1670495174 P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.549439 30176 raft_consensus.cc:385] T c61e62ccbc434482b70daf1670495174 P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.549881 30176 raft_consensus.cc:740] T c61e62ccbc434482b70daf1670495174 P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02f386f6c1ab419f8c7922092b04a1b0, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.550755 30192 raft_consensus.cc:2804] T 9398eeffa5504937973ba568bce7b4c2 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:37.551295 30192 raft_consensus.cc:493] T 9398eeffa5504937973ba568bce7b4c2 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.550767 30176 consensus_queue.cc:260] T c61e62ccbc434482b70daf1670495174 P 02f386f6c1ab419f8c7922092b04a1b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.551754 30192 raft_consensus.cc:3060] T 9398eeffa5504937973ba568bce7b4c2 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.552377 30174 tablet_bootstrap.cc:654] T c218ddfeb78c4cfa98f71f681c807503 P 6c5f1932e9134824a0f7823dccf6273e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.557081 30175 tablet_bootstrap.cc:492] T c61e62ccbc434482b70daf1670495174 P 4a1d35e9bdf14f44a53c9a1984d04629: Bootstrap starting.
I20260709 13:07:37.558702 30192 raft_consensus.cc:515] T 9398eeffa5504937973ba568bce7b4c2 P 6c5f1932e9134824a0f7823dccf6273e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.559873 30176 ts_tablet_manager.cc:1434] T c61e62ccbc434482b70daf1670495174 P 02f386f6c1ab419f8c7922092b04a1b0: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:07:37.561494 29985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9398eeffa5504937973ba568bce7b4c2" candidate_uuid: "6c5f1932e9134824a0f7823dccf6273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a1d35e9bdf14f44a53c9a1984d04629"
I20260709 13:07:37.562057 29985 raft_consensus.cc:3060] T 9398eeffa5504937973ba568bce7b4c2 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.563853 30174 tablet_bootstrap.cc:492] T c218ddfeb78c4cfa98f71f681c807503 P 6c5f1932e9134824a0f7823dccf6273e: No bootstrap required, opened a new log
I20260709 13:07:37.564340 30174 ts_tablet_manager.cc:1403] T c218ddfeb78c4cfa98f71f681c807503 P 6c5f1932e9134824a0f7823dccf6273e: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 13:07:37.564646 30175 tablet_bootstrap.cc:654] T c61e62ccbc434482b70daf1670495174 P 4a1d35e9bdf14f44a53c9a1984d04629: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.566875 30176 tablet_bootstrap.cc:492] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 02f386f6c1ab419f8c7922092b04a1b0: Bootstrap starting.
I20260709 13:07:37.567481 30174 raft_consensus.cc:359] T c218ddfeb78c4cfa98f71f681c807503 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.568230 30174 raft_consensus.cc:385] T c218ddfeb78c4cfa98f71f681c807503 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.568578 30174 raft_consensus.cc:740] T c218ddfeb78c4cfa98f71f681c807503 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5f1932e9134824a0f7823dccf6273e, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.569418 30174 consensus_queue.cc:260] T c218ddfeb78c4cfa98f71f681c807503 P 6c5f1932e9134824a0f7823dccf6273e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.570148 29985 raft_consensus.cc:2468] T 9398eeffa5504937973ba568bce7b4c2 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5f1932e9134824a0f7823dccf6273e in term 1.
I20260709 13:07:37.572011 30060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9398eeffa5504937973ba568bce7b4c2" candidate_uuid: "6c5f1932e9134824a0f7823dccf6273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02f386f6c1ab419f8c7922092b04a1b0" is_pre_election: true
I20260709 13:07:37.576062 30060 raft_consensus.cc:2468] T 9398eeffa5504937973ba568bce7b4c2 P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c5f1932e9134824a0f7823dccf6273e in term 0.
I20260709 13:07:37.573587 30176 tablet_bootstrap.cc:654] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 02f386f6c1ab419f8c7922092b04a1b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.574054 30174 ts_tablet_manager.cc:1434] T c218ddfeb78c4cfa98f71f681c807503 P 6c5f1932e9134824a0f7823dccf6273e: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:07:37.576656 30097 leader_election.cc:304] T 9398eeffa5504937973ba568bce7b4c2 P 6c5f1932e9134824a0f7823dccf6273e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a1d35e9bdf14f44a53c9a1984d04629, 6c5f1932e9134824a0f7823dccf6273e; no voters: 
I20260709 13:07:37.576823 30192 leader_election.cc:290] T 9398eeffa5504937973ba568bce7b4c2 P 6c5f1932e9134824a0f7823dccf6273e [CANDIDATE]: Term 1 election: Requested vote from peers 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1:36133), 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2:44093)
I20260709 13:07:37.577096 30175 tablet_bootstrap.cc:492] T c61e62ccbc434482b70daf1670495174 P 4a1d35e9bdf14f44a53c9a1984d04629: No bootstrap required, opened a new log
I20260709 13:07:37.577509 30175 ts_tablet_manager.cc:1403] T c61e62ccbc434482b70daf1670495174 P 4a1d35e9bdf14f44a53c9a1984d04629: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.002s
I20260709 13:07:37.577458 30192 raft_consensus.cc:2804] T 9398eeffa5504937973ba568bce7b4c2 P 6c5f1932e9134824a0f7823dccf6273e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:37.577618 30174 tablet_bootstrap.cc:492] T 8dfa5968812443d28f2c148c6768f51f P 6c5f1932e9134824a0f7823dccf6273e: Bootstrap starting.
I20260709 13:07:37.578045 30192 raft_consensus.cc:697] T 9398eeffa5504937973ba568bce7b4c2 P 6c5f1932e9134824a0f7823dccf6273e [term 1 LEADER]: Becoming Leader. State: Replica: 6c5f1932e9134824a0f7823dccf6273e, State: Running, Role: LEADER
I20260709 13:07:37.578881 30192 consensus_queue.cc:237] T 9398eeffa5504937973ba568bce7b4c2 P 6c5f1932e9134824a0f7823dccf6273e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.580454 30175 raft_consensus.cc:359] T c61e62ccbc434482b70daf1670495174 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.581159 30175 raft_consensus.cc:385] T c61e62ccbc434482b70daf1670495174 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.581429 30175 raft_consensus.cc:740] T c61e62ccbc434482b70daf1670495174 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a1d35e9bdf14f44a53c9a1984d04629, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.581792 30178 raft_consensus.cc:493] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.582233 30178 raft_consensus.cc:515] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.582438 30175 consensus_queue.cc:260] T c61e62ccbc434482b70daf1670495174 P 4a1d35e9bdf14f44a53c9a1984d04629 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.584879 30174 tablet_bootstrap.cc:654] T 8dfa5968812443d28f2c148c6768f51f P 6c5f1932e9134824a0f7823dccf6273e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.585059 30060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9398eeffa5504937973ba568bce7b4c2" candidate_uuid: "6c5f1932e9134824a0f7823dccf6273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02f386f6c1ab419f8c7922092b04a1b0"
I20260709 13:07:37.585773 30060 raft_consensus.cc:3060] T 9398eeffa5504937973ba568bce7b4c2 P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.590291 30059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e62ccbc434482b70daf1670495174" candidate_uuid: "6c5f1932e9134824a0f7823dccf6273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02f386f6c1ab419f8c7922092b04a1b0" is_pre_election: true
I20260709 13:07:37.591200 30059 raft_consensus.cc:2468] T c61e62ccbc434482b70daf1670495174 P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c5f1932e9134824a0f7823dccf6273e in term 0.
I20260709 13:07:37.592564 30175 ts_tablet_manager.cc:1434] T c61e62ccbc434482b70daf1670495174 P 4a1d35e9bdf14f44a53c9a1984d04629: Time spent starting tablet: real 0.015s	user 0.001s	sys 0.007s
I20260709 13:07:37.592882 29985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e62ccbc434482b70daf1670495174" candidate_uuid: "6c5f1932e9134824a0f7823dccf6273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" is_pre_election: true
I20260709 13:07:37.593669 29985 raft_consensus.cc:2468] T c61e62ccbc434482b70daf1670495174 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c5f1932e9134824a0f7823dccf6273e in term 0.
I20260709 13:07:37.594573 30175 tablet_bootstrap.cc:492] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629: Bootstrap starting.
I20260709 13:07:37.598173 30097 leader_election.cc:304] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a1d35e9bdf14f44a53c9a1984d04629, 6c5f1932e9134824a0f7823dccf6273e; no voters: 
I20260709 13:07:37.584226 30178 leader_election.cc:290] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1:36133), 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2:44093)
I20260709 13:07:37.600195 30178 raft_consensus.cc:2804] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:37.600625 30178 raft_consensus.cc:493] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.601042 30178 raft_consensus.cc:3060] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.611706 30184 raft_consensus.cc:493] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.612406 30184 raft_consensus.cc:515] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.617358 30184 leader_election.cc:290] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2:44093), 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3:43375)
I20260709 13:07:37.623180 30175 tablet_bootstrap.cc:654] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.627416 29882 catalog_manager.cc:5697] T 9398eeffa5504937973ba568bce7b4c2 P 6c5f1932e9134824a0f7823dccf6273e reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3). New cstate: current_term: 1 leader_uuid: "6c5f1932e9134824a0f7823dccf6273e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:37.634428 30060 raft_consensus.cc:2468] T 9398eeffa5504937973ba568bce7b4c2 P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5f1932e9134824a0f7823dccf6273e in term 1.
I20260709 13:07:37.649103 30184 raft_consensus.cc:493] T 22b91a84b0d244f987c2625faa04ecce P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.638832 30178 raft_consensus.cc:515] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.642081 30200 raft_consensus.cc:493] T c218ddfeb78c4cfa98f71f681c807503 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.649780 30184 raft_consensus.cc:515] T 22b91a84b0d244f987c2625faa04ecce P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.650038 30200 raft_consensus.cc:515] T c218ddfeb78c4cfa98f71f681c807503 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.652576 30184 leader_election.cc:290] T 22b91a84b0d244f987c2625faa04ecce P 4a1d35e9bdf14f44a53c9a1984d04629 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2:44093), 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3:43375)
I20260709 13:07:37.652832 30200 leader_election.cc:290] T c218ddfeb78c4cfa98f71f681c807503 P 6c5f1932e9134824a0f7823dccf6273e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1:36133), 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2:44093)
I20260709 13:07:37.655854 29985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c218ddfeb78c4cfa98f71f681c807503" candidate_uuid: "6c5f1932e9134824a0f7823dccf6273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" is_pre_election: true
W20260709 13:07:37.657774 30097 leader_election.cc:343] T c218ddfeb78c4cfa98f71f681c807503 P 6c5f1932e9134824a0f7823dccf6273e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:37.668826 29985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e62ccbc434482b70daf1670495174" candidate_uuid: "6c5f1932e9134824a0f7823dccf6273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a1d35e9bdf14f44a53c9a1984d04629"
I20260709 13:07:37.669559 29985 raft_consensus.cc:3060] T c61e62ccbc434482b70daf1670495174 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.678013 30059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e62ccbc434482b70daf1670495174" candidate_uuid: "6c5f1932e9134824a0f7823dccf6273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02f386f6c1ab419f8c7922092b04a1b0"
I20260709 13:07:37.678860 30059 raft_consensus.cc:3060] T c61e62ccbc434482b70daf1670495174 P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.687929 30178 leader_election.cc:290] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e [CANDIDATE]: Term 1 election: Requested vote from peers 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1:36133), 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2:44093)
I20260709 13:07:37.695869 30178 raft_consensus.cc:493] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.697345 30178 raft_consensus.cc:515] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.697636 30060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c218ddfeb78c4cfa98f71f681c807503" candidate_uuid: "6c5f1932e9134824a0f7823dccf6273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02f386f6c1ab419f8c7922092b04a1b0" is_pre_election: true
W20260709 13:07:37.698953 30097 leader_election.cc:343] T c218ddfeb78c4cfa98f71f681c807503 P 6c5f1932e9134824a0f7823dccf6273e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2:44093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:37.699321 30178 leader_election.cc:290] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 6c5f1932e9134824a0f7823dccf6273e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1:36133), 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2:44093)
I20260709 13:07:37.699380 30097 leader_election.cc:304] T c218ddfeb78c4cfa98f71f681c807503 P 6c5f1932e9134824a0f7823dccf6273e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c5f1932e9134824a0f7823dccf6273e; no voters: 02f386f6c1ab419f8c7922092b04a1b0, 4a1d35e9bdf14f44a53c9a1984d04629
I20260709 13:07:37.701949 29984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e48e4ede2b9419c805b7d9bcd1e2fb0" candidate_uuid: "6c5f1932e9134824a0f7823dccf6273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" is_pre_election: true
I20260709 13:07:37.702404 30178 raft_consensus.cc:2749] T c218ddfeb78c4cfa98f71f681c807503 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:37.704402 30058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e48e4ede2b9419c805b7d9bcd1e2fb0" candidate_uuid: "6c5f1932e9134824a0f7823dccf6273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02f386f6c1ab419f8c7922092b04a1b0" is_pre_election: true
W20260709 13:07:37.704555 30097 leader_election.cc:343] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 6c5f1932e9134824a0f7823dccf6273e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1:36133): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:37.707121 30097 leader_election.cc:343] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 6c5f1932e9134824a0f7823dccf6273e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2:44093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:37.710285 30097 leader_election.cc:304] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 6c5f1932e9134824a0f7823dccf6273e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c5f1932e9134824a0f7823dccf6273e; no voters: 02f386f6c1ab419f8c7922092b04a1b0, 4a1d35e9bdf14f44a53c9a1984d04629
I20260709 13:07:37.728694 30178 raft_consensus.cc:2749] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:37.707602 30059 raft_consensus.cc:2468] T c61e62ccbc434482b70daf1670495174 P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5f1932e9134824a0f7823dccf6273e in term 1.
I20260709 13:07:37.735486 30174 tablet_bootstrap.cc:492] T 8dfa5968812443d28f2c148c6768f51f P 6c5f1932e9134824a0f7823dccf6273e: No bootstrap required, opened a new log
I20260709 13:07:37.736096 30174 ts_tablet_manager.cc:1403] T 8dfa5968812443d28f2c148c6768f51f P 6c5f1932e9134824a0f7823dccf6273e: Time spent bootstrapping tablet: real 0.159s	user 0.051s	sys 0.079s
I20260709 13:07:37.740870 30174 raft_consensus.cc:359] T 8dfa5968812443d28f2c148c6768f51f P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } } peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } }
I20260709 13:07:37.741642 30174 raft_consensus.cc:385] T 8dfa5968812443d28f2c148c6768f51f P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.741967 30174 raft_consensus.cc:740] T 8dfa5968812443d28f2c148c6768f51f P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5f1932e9134824a0f7823dccf6273e, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.742707 30174 consensus_queue.cc:260] T 8dfa5968812443d28f2c148c6768f51f P 6c5f1932e9134824a0f7823dccf6273e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } } peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } }
I20260709 13:07:37.744962 30174 ts_tablet_manager.cc:1434] T 8dfa5968812443d28f2c148c6768f51f P 6c5f1932e9134824a0f7823dccf6273e: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:07:37.745985 30174 tablet_bootstrap.cc:492] T 0242b20a350c42c9978239cd1ec620d2 P 6c5f1932e9134824a0f7823dccf6273e: Bootstrap starting.
I20260709 13:07:37.746089 30134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2418e193a92a4d36a4149de5f38be171" candidate_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5f1932e9134824a0f7823dccf6273e" is_pre_election: true
I20260709 13:07:37.746738 30134 raft_consensus.cc:2468] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a1d35e9bdf14f44a53c9a1984d04629 in term 0.
I20260709 13:07:37.748003 30133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b91a84b0d244f987c2625faa04ecce" candidate_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5f1932e9134824a0f7823dccf6273e" is_pre_election: true
I20260709 13:07:37.749703 30176 tablet_bootstrap.cc:492] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 02f386f6c1ab419f8c7922092b04a1b0: No bootstrap required, opened a new log
I20260709 13:07:37.750298 30176 ts_tablet_manager.cc:1403] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 02f386f6c1ab419f8c7922092b04a1b0: Time spent bootstrapping tablet: real 0.184s	user 0.063s	sys 0.065s
I20260709 13:07:37.752905 30174 tablet_bootstrap.cc:654] T 0242b20a350c42c9978239cd1ec620d2 P 6c5f1932e9134824a0f7823dccf6273e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.753458 30176 raft_consensus.cc:359] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.754267 30176 raft_consensus.cc:385] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.754640 30176 raft_consensus.cc:740] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02f386f6c1ab419f8c7922092b04a1b0, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.755602 30176 consensus_queue.cc:260] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 02f386f6c1ab419f8c7922092b04a1b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.758013 30176 ts_tablet_manager.cc:1434] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 02f386f6c1ab419f8c7922092b04a1b0: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:07:37.758992 30176 tablet_bootstrap.cc:492] T c218ddfeb78c4cfa98f71f681c807503 P 02f386f6c1ab419f8c7922092b04a1b0: Bootstrap starting.
I20260709 13:07:37.749719 30175 tablet_bootstrap.cc:492] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629: No bootstrap required, opened a new log
I20260709 13:07:37.759991 30175 ts_tablet_manager.cc:1403] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629: Time spent bootstrapping tablet: real 0.166s	user 0.023s	sys 0.014s
I20260709 13:07:37.765713 30176 tablet_bootstrap.cc:654] T c218ddfeb78c4cfa98f71f681c807503 P 02f386f6c1ab419f8c7922092b04a1b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.771634 30175 raft_consensus.cc:359] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.774885 30175 raft_consensus.cc:385] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.775197 30175 raft_consensus.cc:740] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a1d35e9bdf14f44a53c9a1984d04629, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.775990 30175 consensus_queue.cc:260] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.778100 30175 ts_tablet_manager.cc:1434] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:07:37.778867 30175 tablet_bootstrap.cc:492] T c218ddfeb78c4cfa98f71f681c807503 P 4a1d35e9bdf14f44a53c9a1984d04629: Bootstrap starting.
I20260709 13:07:37.782959 30176 tablet_bootstrap.cc:492] T c218ddfeb78c4cfa98f71f681c807503 P 02f386f6c1ab419f8c7922092b04a1b0: No bootstrap required, opened a new log
I20260709 13:07:37.783699 30176 ts_tablet_manager.cc:1403] T c218ddfeb78c4cfa98f71f681c807503 P 02f386f6c1ab419f8c7922092b04a1b0: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.003s
I20260709 13:07:37.787209 30176 raft_consensus.cc:359] T c218ddfeb78c4cfa98f71f681c807503 P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.787978 29950 leader_election.cc:304] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a1d35e9bdf14f44a53c9a1984d04629, 6c5f1932e9134824a0f7823dccf6273e; no voters: 
I20260709 13:07:37.788257 30176 raft_consensus.cc:385] T c218ddfeb78c4cfa98f71f681c807503 P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.788661 30176 raft_consensus.cc:740] T c218ddfeb78c4cfa98f71f681c807503 P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02f386f6c1ab419f8c7922092b04a1b0, State: Initialized, Role: FOLLOWER
W20260709 13:07:37.789095 29950 leader_election.cc:343] T 22b91a84b0d244f987c2625faa04ecce P 4a1d35e9bdf14f44a53c9a1984d04629 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3:43375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:37.789326 30176 consensus_queue.cc:260] T c218ddfeb78c4cfa98f71f681c807503 P 02f386f6c1ab419f8c7922092b04a1b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.791062 30175 tablet_bootstrap.cc:654] T c218ddfeb78c4cfa98f71f681c807503 P 4a1d35e9bdf14f44a53c9a1984d04629: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.789899 30184 raft_consensus.cc:2804] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:37.792145 30184 raft_consensus.cc:493] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.792125 30176 ts_tablet_manager.cc:1434] T c218ddfeb78c4cfa98f71f681c807503 P 02f386f6c1ab419f8c7922092b04a1b0: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:07:37.792706 30184 raft_consensus.cc:3060] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.793772 30176 tablet_bootstrap.cc:492] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0: Bootstrap starting.
I20260709 13:07:37.794983 30181 raft_consensus.cc:493] T 0242b20a350c42c9978239cd1ec620d2 P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.795419 30181 raft_consensus.cc:515] T 0242b20a350c42c9978239cd1ec620d2 P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.796408 30174 tablet_bootstrap.cc:492] T 0242b20a350c42c9978239cd1ec620d2 P 6c5f1932e9134824a0f7823dccf6273e: No bootstrap required, opened a new log
I20260709 13:07:37.796891 30174 ts_tablet_manager.cc:1403] T 0242b20a350c42c9978239cd1ec620d2 P 6c5f1932e9134824a0f7823dccf6273e: Time spent bootstrapping tablet: real 0.051s	user 0.019s	sys 0.019s
I20260709 13:07:37.801146 30176 tablet_bootstrap.cc:654] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.806435 30181 leader_election.cc:290] T 0242b20a350c42c9978239cd1ec620d2 P 02f386f6c1ab419f8c7922092b04a1b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1:36133), 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3:43375)
I20260709 13:07:37.812496 30184 raft_consensus.cc:515] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.815495 30184 leader_election.cc:290] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [CANDIDATE]: Term 1 election: Requested vote from peers 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2:44093), 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3:43375)
I20260709 13:07:37.817356 30175 tablet_bootstrap.cc:492] T c218ddfeb78c4cfa98f71f681c807503 P 4a1d35e9bdf14f44a53c9a1984d04629: No bootstrap required, opened a new log
I20260709 13:07:37.817974 30175 ts_tablet_manager.cc:1403] T c218ddfeb78c4cfa98f71f681c807503 P 4a1d35e9bdf14f44a53c9a1984d04629: Time spent bootstrapping tablet: real 0.039s	user 0.016s	sys 0.008s
I20260709 13:07:37.820602 30133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2418e193a92a4d36a4149de5f38be171" candidate_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5f1932e9134824a0f7823dccf6273e"
I20260709 13:07:37.821234 30133 raft_consensus.cc:3060] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.824842 30174 raft_consensus.cc:359] T 0242b20a350c42c9978239cd1ec620d2 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.826315 30174 raft_consensus.cc:385] T 0242b20a350c42c9978239cd1ec620d2 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.826611 30174 raft_consensus.cc:740] T 0242b20a350c42c9978239cd1ec620d2 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5f1932e9134824a0f7823dccf6273e, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.828902 30174 consensus_queue.cc:260] T 0242b20a350c42c9978239cd1ec620d2 P 6c5f1932e9134824a0f7823dccf6273e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.831502 30133 raft_consensus.cc:2468] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a1d35e9bdf14f44a53c9a1984d04629 in term 1.
I20260709 13:07:37.832398 30174 ts_tablet_manager.cc:1434] T 0242b20a350c42c9978239cd1ec620d2 P 6c5f1932e9134824a0f7823dccf6273e: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.002s
I20260709 13:07:37.833444 30174 tablet_bootstrap.cc:492] T 22b91a84b0d244f987c2625faa04ecce P 6c5f1932e9134824a0f7823dccf6273e: Bootstrap starting.
I20260709 13:07:37.834591 30176 tablet_bootstrap.cc:492] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0: No bootstrap required, opened a new log
I20260709 13:07:37.835171 30176 ts_tablet_manager.cc:1403] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0: Time spent bootstrapping tablet: real 0.042s	user 0.021s	sys 0.008s
I20260709 13:07:37.836717 29950 leader_election.cc:304] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a1d35e9bdf14f44a53c9a1984d04629, 6c5f1932e9134824a0f7823dccf6273e; no voters: 
I20260709 13:07:37.837864 30184 raft_consensus.cc:2804] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:37.838896 30176 raft_consensus.cc:359] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.839671 30176 raft_consensus.cc:385] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.840193 30176 raft_consensus.cc:740] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02f386f6c1ab419f8c7922092b04a1b0, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.840714 30174 tablet_bootstrap.cc:654] T 22b91a84b0d244f987c2625faa04ecce P 6c5f1932e9134824a0f7823dccf6273e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.841151 30176 consensus_queue.cc:260] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.842595 30175 raft_consensus.cc:359] T c218ddfeb78c4cfa98f71f681c807503 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.843276 30175 raft_consensus.cc:385] T c218ddfeb78c4cfa98f71f681c807503 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.843560 30175 raft_consensus.cc:740] T c218ddfeb78c4cfa98f71f681c807503 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a1d35e9bdf14f44a53c9a1984d04629, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.844717 30176 ts_tablet_manager.cc:1434] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:07:37.845901 30176 tablet_bootstrap.cc:492] T 4430e39586c24524bffd80447f2999be P 02f386f6c1ab419f8c7922092b04a1b0: Bootstrap starting.
I20260709 13:07:37.847144 30175 consensus_queue.cc:260] T c218ddfeb78c4cfa98f71f681c807503 P 4a1d35e9bdf14f44a53c9a1984d04629 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.852744 30176 tablet_bootstrap.cc:654] T 4430e39586c24524bffd80447f2999be P 02f386f6c1ab419f8c7922092b04a1b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.857132 30175 ts_tablet_manager.cc:1434] T c218ddfeb78c4cfa98f71f681c807503 P 4a1d35e9bdf14f44a53c9a1984d04629: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.003s
I20260709 13:07:37.857931 30175 tablet_bootstrap.cc:492] T 4430e39586c24524bffd80447f2999be P 4a1d35e9bdf14f44a53c9a1984d04629: Bootstrap starting.
I20260709 13:07:37.864912 30176 tablet_bootstrap.cc:492] T 4430e39586c24524bffd80447f2999be P 02f386f6c1ab419f8c7922092b04a1b0: No bootstrap required, opened a new log
I20260709 13:07:37.865360 30176 ts_tablet_manager.cc:1403] T 4430e39586c24524bffd80447f2999be P 02f386f6c1ab419f8c7922092b04a1b0: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.004s
I20260709 13:07:37.867270 30184 raft_consensus.cc:697] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 1 LEADER]: Becoming Leader. State: Replica: 4a1d35e9bdf14f44a53c9a1984d04629, State: Running, Role: LEADER
I20260709 13:07:37.867923 30176 raft_consensus.cc:359] T 4430e39586c24524bffd80447f2999be P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.868620 30176 raft_consensus.cc:385] T 4430e39586c24524bffd80447f2999be P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.868307 30184 consensus_queue.cc:237] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.873839 30175 tablet_bootstrap.cc:654] T 4430e39586c24524bffd80447f2999be P 4a1d35e9bdf14f44a53c9a1984d04629: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.868893 30176 raft_consensus.cc:740] T 4430e39586c24524bffd80447f2999be P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02f386f6c1ab419f8c7922092b04a1b0, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.877369 30176 consensus_queue.cc:260] T 4430e39586c24524bffd80447f2999be P 02f386f6c1ab419f8c7922092b04a1b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.879467 30176 ts_tablet_manager.cc:1434] T 4430e39586c24524bffd80447f2999be P 02f386f6c1ab419f8c7922092b04a1b0: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:07:37.881446 30134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0242b20a350c42c9978239cd1ec620d2" candidate_uuid: "02f386f6c1ab419f8c7922092b04a1b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5f1932e9134824a0f7823dccf6273e" is_pre_election: true
I20260709 13:07:37.881846 30175 tablet_bootstrap.cc:492] T 4430e39586c24524bffd80447f2999be P 4a1d35e9bdf14f44a53c9a1984d04629: No bootstrap required, opened a new log
I20260709 13:07:37.882145 30134 raft_consensus.cc:2468] T 0242b20a350c42c9978239cd1ec620d2 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02f386f6c1ab419f8c7922092b04a1b0 in term 0.
I20260709 13:07:37.882372 30175 ts_tablet_manager.cc:1403] T 4430e39586c24524bffd80447f2999be P 4a1d35e9bdf14f44a53c9a1984d04629: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.000s
I20260709 13:07:37.883579 30025 leader_election.cc:304] T 0242b20a350c42c9978239cd1ec620d2 P 02f386f6c1ab419f8c7922092b04a1b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02f386f6c1ab419f8c7922092b04a1b0, 6c5f1932e9134824a0f7823dccf6273e; no voters: 
I20260709 13:07:37.884451 30181 raft_consensus.cc:2804] T 0242b20a350c42c9978239cd1ec620d2 P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:37.884817 30181 raft_consensus.cc:493] T 0242b20a350c42c9978239cd1ec620d2 P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.884886 30175 raft_consensus.cc:359] T 4430e39586c24524bffd80447f2999be P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.885602 30175 raft_consensus.cc:385] T 4430e39586c24524bffd80447f2999be P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.885896 30175 raft_consensus.cc:740] T 4430e39586c24524bffd80447f2999be P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a1d35e9bdf14f44a53c9a1984d04629, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.886593 30175 consensus_queue.cc:260] T 4430e39586c24524bffd80447f2999be P 4a1d35e9bdf14f44a53c9a1984d04629 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.885224 30181 raft_consensus.cc:3060] T 0242b20a350c42c9978239cd1ec620d2 P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.889071 30175 ts_tablet_manager.cc:1434] T 4430e39586c24524bffd80447f2999be P 4a1d35e9bdf14f44a53c9a1984d04629: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:07:37.890036 30175 tablet_bootstrap.cc:492] T 0242b20a350c42c9978239cd1ec620d2 P 4a1d35e9bdf14f44a53c9a1984d04629: Bootstrap starting.
I20260709 13:07:37.894896 30181 raft_consensus.cc:515] T 0242b20a350c42c9978239cd1ec620d2 P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.896795 30175 tablet_bootstrap.cc:654] T 0242b20a350c42c9978239cd1ec620d2 P 4a1d35e9bdf14f44a53c9a1984d04629: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.897397 30181 leader_election.cc:290] T 0242b20a350c42c9978239cd1ec620d2 P 02f386f6c1ab419f8c7922092b04a1b0 [CANDIDATE]: Term 1 election: Requested vote from peers 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1:36133), 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3:43375)
I20260709 13:07:37.902204 29983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0242b20a350c42c9978239cd1ec620d2" candidate_uuid: "02f386f6c1ab419f8c7922092b04a1b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a1d35e9bdf14f44a53c9a1984d04629"
I20260709 13:07:37.902567 30175 tablet_bootstrap.cc:492] T 0242b20a350c42c9978239cd1ec620d2 P 4a1d35e9bdf14f44a53c9a1984d04629: No bootstrap required, opened a new log
I20260709 13:07:37.903136 30175 ts_tablet_manager.cc:1403] T 0242b20a350c42c9978239cd1ec620d2 P 4a1d35e9bdf14f44a53c9a1984d04629: Time spent bootstrapping tablet: real 0.013s	user 0.004s	sys 0.008s
W20260709 13:07:37.903859 30023 leader_election.cc:343] T 0242b20a350c42c9978239cd1ec620d2 P 02f386f6c1ab419f8c7922092b04a1b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:37.918149 29984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0242b20a350c42c9978239cd1ec620d2" candidate_uuid: "02f386f6c1ab419f8c7922092b04a1b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" is_pre_election: true
I20260709 13:07:37.929391 30217 raft_consensus.cc:493] T 8dfa5968812443d28f2c148c6768f51f P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.930033 30217 raft_consensus.cc:515] T 8dfa5968812443d28f2c148c6768f51f P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } } peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } }
I20260709 13:07:37.932541 30134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0242b20a350c42c9978239cd1ec620d2" candidate_uuid: "02f386f6c1ab419f8c7922092b04a1b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5f1932e9134824a0f7823dccf6273e"
I20260709 13:07:37.934204 30134 raft_consensus.cc:3060] T 0242b20a350c42c9978239cd1ec620d2 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.934379 30132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dfa5968812443d28f2c148c6768f51f" candidate_uuid: "02f386f6c1ab419f8c7922092b04a1b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5f1932e9134824a0f7823dccf6273e" is_pre_election: true
I20260709 13:07:37.934428 29983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dfa5968812443d28f2c148c6768f51f" candidate_uuid: "02f386f6c1ab419f8c7922092b04a1b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" is_pre_election: true
I20260709 13:07:37.935098 30132 raft_consensus.cc:2468] T 8dfa5968812443d28f2c148c6768f51f P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02f386f6c1ab419f8c7922092b04a1b0 in term 0.
I20260709 13:07:37.932542 30217 leader_election.cc:290] T 8dfa5968812443d28f2c148c6768f51f P 02f386f6c1ab419f8c7922092b04a1b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3:43375), 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1:36133)
I20260709 13:07:37.935889 30217 raft_consensus.cc:493] T 4430e39586c24524bffd80447f2999be P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.936158 30025 leader_election.cc:304] T 8dfa5968812443d28f2c148c6768f51f P 02f386f6c1ab419f8c7922092b04a1b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02f386f6c1ab419f8c7922092b04a1b0, 6c5f1932e9134824a0f7823dccf6273e; no voters: 
I20260709 13:07:37.936390 30217 raft_consensus.cc:515] T 4430e39586c24524bffd80447f2999be P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
W20260709 13:07:37.937764 30023 leader_election.cc:343] T 8dfa5968812443d28f2c148c6768f51f P 02f386f6c1ab419f8c7922092b04a1b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:37.938978 29985 raft_consensus.cc:2468] T c61e62ccbc434482b70daf1670495174 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5f1932e9134824a0f7823dccf6273e in term 1.
I20260709 13:07:37.939731 30132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430e39586c24524bffd80447f2999be" candidate_uuid: "02f386f6c1ab419f8c7922092b04a1b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5f1932e9134824a0f7823dccf6273e" is_pre_election: true
I20260709 13:07:37.940111 30097 leader_election.cc:304] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a1d35e9bdf14f44a53c9a1984d04629, 6c5f1932e9134824a0f7823dccf6273e; no voters: 
W20260709 13:07:37.941047 30025 leader_election.cc:343] T 4430e39586c24524bffd80447f2999be P 02f386f6c1ab419f8c7922092b04a1b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3:43375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:37.941224 30217 leader_election.cc:290] T 4430e39586c24524bffd80447f2999be P 02f386f6c1ab419f8c7922092b04a1b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1:36133), 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3:43375)
I20260709 13:07:37.941813 30217 raft_consensus.cc:2804] T 8dfa5968812443d28f2c148c6768f51f P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:37.942200 30217 raft_consensus.cc:493] T 8dfa5968812443d28f2c148c6768f51f P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.942555 30217 raft_consensus.cc:3060] T 8dfa5968812443d28f2c148c6768f51f P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.942600 29985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430e39586c24524bffd80447f2999be" candidate_uuid: "02f386f6c1ab419f8c7922092b04a1b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" is_pre_election: true
I20260709 13:07:37.943753 29985 raft_consensus.cc:2468] T 4430e39586c24524bffd80447f2999be P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02f386f6c1ab419f8c7922092b04a1b0 in term 0.
I20260709 13:07:37.945137 30023 leader_election.cc:304] T 4430e39586c24524bffd80447f2999be P 02f386f6c1ab419f8c7922092b04a1b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02f386f6c1ab419f8c7922092b04a1b0, 4a1d35e9bdf14f44a53c9a1984d04629; no voters: 6c5f1932e9134824a0f7823dccf6273e
I20260709 13:07:37.945364 30134 raft_consensus.cc:2468] T 0242b20a350c42c9978239cd1ec620d2 P 6c5f1932e9134824a0f7823dccf6273e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02f386f6c1ab419f8c7922092b04a1b0 in term 1.
I20260709 13:07:37.946475 30025 leader_election.cc:304] T 0242b20a350c42c9978239cd1ec620d2 P 02f386f6c1ab419f8c7922092b04a1b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02f386f6c1ab419f8c7922092b04a1b0, 6c5f1932e9134824a0f7823dccf6273e; no voters: 4a1d35e9bdf14f44a53c9a1984d04629
I20260709 13:07:37.949666 30218 raft_consensus.cc:2804] T 4430e39586c24524bffd80447f2999be P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:37.949994 30218 raft_consensus.cc:493] T 4430e39586c24524bffd80447f2999be P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.950286 30218 raft_consensus.cc:3060] T 4430e39586c24524bffd80447f2999be P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.950327 30217 raft_consensus.cc:515] T 8dfa5968812443d28f2c148c6768f51f P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } } peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } }
I20260709 13:07:37.952775 30217 leader_election.cc:290] T 8dfa5968812443d28f2c148c6768f51f P 02f386f6c1ab419f8c7922092b04a1b0 [CANDIDATE]: Term 1 election: Requested vote from peers 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3:43375), 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1:36133)
I20260709 13:07:37.953321 30217 raft_consensus.cc:2804] T 0242b20a350c42c9978239cd1ec620d2 P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:37.953707 30134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dfa5968812443d28f2c148c6768f51f" candidate_uuid: "02f386f6c1ab419f8c7922092b04a1b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5f1932e9134824a0f7823dccf6273e"
I20260709 13:07:37.953830 30217 raft_consensus.cc:697] T 0242b20a350c42c9978239cd1ec620d2 P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 LEADER]: Becoming Leader. State: Replica: 02f386f6c1ab419f8c7922092b04a1b0, State: Running, Role: LEADER
I20260709 13:07:37.954378 30134 raft_consensus.cc:3060] T 8dfa5968812443d28f2c148c6768f51f P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.954684 29985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dfa5968812443d28f2c148c6768f51f" candidate_uuid: "02f386f6c1ab419f8c7922092b04a1b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a1d35e9bdf14f44a53c9a1984d04629"
I20260709 13:07:37.954864 30217 consensus_queue.cc:237] T 0242b20a350c42c9978239cd1ec620d2 P 02f386f6c1ab419f8c7922092b04a1b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
W20260709 13:07:37.956099 30023 leader_election.cc:343] T 8dfa5968812443d28f2c148c6768f51f P 02f386f6c1ab419f8c7922092b04a1b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:37.956290 30174 tablet_bootstrap.cc:492] T 22b91a84b0d244f987c2625faa04ecce P 6c5f1932e9134824a0f7823dccf6273e: No bootstrap required, opened a new log
I20260709 13:07:37.956923 30174 ts_tablet_manager.cc:1403] T 22b91a84b0d244f987c2625faa04ecce P 6c5f1932e9134824a0f7823dccf6273e: Time spent bootstrapping tablet: real 0.124s	user 0.013s	sys 0.000s
I20260709 13:07:37.960693 30174 raft_consensus.cc:359] T 22b91a84b0d244f987c2625faa04ecce P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.961408 30134 raft_consensus.cc:2468] T 8dfa5968812443d28f2c148c6768f51f P 6c5f1932e9134824a0f7823dccf6273e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02f386f6c1ab419f8c7922092b04a1b0 in term 1.
I20260709 13:07:37.961637 30174 raft_consensus.cc:385] T 22b91a84b0d244f987c2625faa04ecce P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.962117 30174 raft_consensus.cc:740] T 22b91a84b0d244f987c2625faa04ecce P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5f1932e9134824a0f7823dccf6273e, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.962702 30025 leader_election.cc:304] T 8dfa5968812443d28f2c148c6768f51f P 02f386f6c1ab419f8c7922092b04a1b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02f386f6c1ab419f8c7922092b04a1b0, 6c5f1932e9134824a0f7823dccf6273e; no voters: 4a1d35e9bdf14f44a53c9a1984d04629
I20260709 13:07:37.963284 30174 consensus_queue.cc:260] T 22b91a84b0d244f987c2625faa04ecce P 6c5f1932e9134824a0f7823dccf6273e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.965941 30174 ts_tablet_manager.cc:1434] T 22b91a84b0d244f987c2625faa04ecce P 6c5f1932e9134824a0f7823dccf6273e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:07:37.966861 30174 tablet_bootstrap.cc:492] T bdc7f4487d69425da272a9c59e5e3c54 P 6c5f1932e9134824a0f7823dccf6273e: Bootstrap starting.
I20260709 13:07:37.978612 30217 raft_consensus.cc:493] T 22b91a84b0d244f987c2625faa04ecce P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.979173 30217 raft_consensus.cc:515] T 22b91a84b0d244f987c2625faa04ecce P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.980481 30174 tablet_bootstrap.cc:654] T bdc7f4487d69425da272a9c59e5e3c54 P 6c5f1932e9134824a0f7823dccf6273e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.981069 30218 raft_consensus.cc:515] T 4430e39586c24524bffd80447f2999be P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:37.986743 29985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b91a84b0d244f987c2625faa04ecce" candidate_uuid: "02f386f6c1ab419f8c7922092b04a1b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" is_pre_election: true
I20260709 13:07:37.987421 29985 raft_consensus.cc:2468] T 22b91a84b0d244f987c2625faa04ecce P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02f386f6c1ab419f8c7922092b04a1b0 in term 0.
I20260709 13:07:37.987699 30218 leader_election.cc:290] T 4430e39586c24524bffd80447f2999be P 02f386f6c1ab419f8c7922092b04a1b0 [CANDIDATE]: Term 1 election: Requested vote from peers 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1:36133), 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3:43375)
I20260709 13:07:37.988440 30218 raft_consensus.cc:2804] T 8dfa5968812443d28f2c148c6768f51f P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:37.988915 30218 raft_consensus.cc:697] T 8dfa5968812443d28f2c148c6768f51f P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 LEADER]: Becoming Leader. State: Replica: 02f386f6c1ab419f8c7922092b04a1b0, State: Running, Role: LEADER
I20260709 13:07:37.997745 30023 leader_election.cc:304] T 22b91a84b0d244f987c2625faa04ecce P 02f386f6c1ab419f8c7922092b04a1b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02f386f6c1ab419f8c7922092b04a1b0, 4a1d35e9bdf14f44a53c9a1984d04629; no voters: 
I20260709 13:07:37.999167 30181 raft_consensus.cc:493] T 2418e193a92a4d36a4149de5f38be171 P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.999598 30181 raft_consensus.cc:515] T 2418e193a92a4d36a4149de5f38be171 P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:38.001125 30134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430e39586c24524bffd80447f2999be" candidate_uuid: "02f386f6c1ab419f8c7922092b04a1b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5f1932e9134824a0f7823dccf6273e"
I20260709 13:07:38.001617 30181 leader_election.cc:290] T 2418e193a92a4d36a4149de5f38be171 P 02f386f6c1ab419f8c7922092b04a1b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1:36133), 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3:43375)
I20260709 13:07:38.002092 30181 raft_consensus.cc:2804] T 22b91a84b0d244f987c2625faa04ecce P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:37.990653 30218 consensus_queue.cc:237] T 8dfa5968812443d28f2c148c6768f51f P 02f386f6c1ab419f8c7922092b04a1b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } } peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } }
I20260709 13:07:38.002391 30181 raft_consensus.cc:493] T 22b91a84b0d244f987c2625faa04ecce P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.002714 30181 raft_consensus.cc:3060] T 22b91a84b0d244f987c2625faa04ecce P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.003293 29985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430e39586c24524bffd80447f2999be" candidate_uuid: "02f386f6c1ab419f8c7922092b04a1b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a1d35e9bdf14f44a53c9a1984d04629"
I20260709 13:07:38.006628 30217 leader_election.cc:290] T 22b91a84b0d244f987c2625faa04ecce P 02f386f6c1ab419f8c7922092b04a1b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1:36133), 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3:43375)
I20260709 13:07:38.006547 29985 raft_consensus.cc:3060] T 4430e39586c24524bffd80447f2999be P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.012598 30134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2418e193a92a4d36a4149de5f38be171" candidate_uuid: "02f386f6c1ab419f8c7922092b04a1b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5f1932e9134824a0f7823dccf6273e" is_pre_election: true
I20260709 13:07:38.013103 30175 raft_consensus.cc:359] T 0242b20a350c42c9978239cd1ec620d2 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:38.013522 30059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2418e193a92a4d36a4149de5f38be171" candidate_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02f386f6c1ab419f8c7922092b04a1b0" is_pre_election: true
I20260709 13:07:38.013927 30134 raft_consensus.cc:2393] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 02f386f6c1ab419f8c7922092b04a1b0 in current term 1: Already voted for candidate 4a1d35e9bdf14f44a53c9a1984d04629 in this term.
I20260709 13:07:38.014175 30059 raft_consensus.cc:2468] T 2418e193a92a4d36a4149de5f38be171 P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a1d35e9bdf14f44a53c9a1984d04629 in term 0.
I20260709 13:07:38.013936 30175 raft_consensus.cc:385] T 0242b20a350c42c9978239cd1ec620d2 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:38.016242 30178 raft_consensus.cc:493] T 8dfa5968812443d28f2c148c6768f51f P 6c5f1932e9134824a0f7823dccf6273e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.018013 30178 raft_consensus.cc:515] T 8dfa5968812443d28f2c148c6768f51f P 6c5f1932e9134824a0f7823dccf6273e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } } peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } }
I20260709 13:07:38.019110 30175 raft_consensus.cc:740] T 0242b20a350c42c9978239cd1ec620d2 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a1d35e9bdf14f44a53c9a1984d04629, State: Initialized, Role: FOLLOWER
I20260709 13:07:38.022285 30174 tablet_bootstrap.cc:492] T bdc7f4487d69425da272a9c59e5e3c54 P 6c5f1932e9134824a0f7823dccf6273e: No bootstrap required, opened a new log
I20260709 13:07:38.022855 30174 ts_tablet_manager.cc:1403] T bdc7f4487d69425da272a9c59e5e3c54 P 6c5f1932e9134824a0f7823dccf6273e: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.011s
I20260709 13:07:38.014664 29983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2418e193a92a4d36a4149de5f38be171" candidate_uuid: "02f386f6c1ab419f8c7922092b04a1b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" is_pre_election: true
I20260709 13:07:38.024631 30059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b91a84b0d244f987c2625faa04ecce" candidate_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02f386f6c1ab419f8c7922092b04a1b0" is_pre_election: true
I20260709 13:07:38.026296 30178 leader_election.cc:290] T 8dfa5968812443d28f2c148c6768f51f P 6c5f1932e9134824a0f7823dccf6273e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2:44093), 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1:36133)
I20260709 13:07:38.026945 30178 raft_consensus.cc:2804] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:38.027526 30178 raft_consensus.cc:697] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e [term 1 LEADER]: Becoming Leader. State: Replica: 6c5f1932e9134824a0f7823dccf6273e, State: Running, Role: LEADER
I20260709 13:07:38.029387 30184 raft_consensus.cc:493] T c218ddfeb78c4cfa98f71f681c807503 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.029870 30184 raft_consensus.cc:515] T c218ddfeb78c4cfa98f71f681c807503 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:38.030097 30178 consensus_queue.cc:237] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:38.034849 30175 consensus_queue.cc:260] T 0242b20a350c42c9978239cd1ec620d2 P 4a1d35e9bdf14f44a53c9a1984d04629 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
W20260709 13:07:38.037214 30025 leader_election.cc:343] T 4430e39586c24524bffd80447f2999be P 02f386f6c1ab419f8c7922092b04a1b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3:43375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:38.037938 30025 leader_election.cc:304] T 2418e193a92a4d36a4149de5f38be171 P 02f386f6c1ab419f8c7922092b04a1b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02f386f6c1ab419f8c7922092b04a1b0; no voters: 4a1d35e9bdf14f44a53c9a1984d04629, 6c5f1932e9134824a0f7823dccf6273e
I20260709 13:07:38.038260 30134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b91a84b0d244f987c2625faa04ecce" candidate_uuid: "02f386f6c1ab419f8c7922092b04a1b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5f1932e9134824a0f7823dccf6273e" is_pre_election: true
I20260709 13:07:38.038811 30134 raft_consensus.cc:2468] T 22b91a84b0d244f987c2625faa04ecce P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02f386f6c1ab419f8c7922092b04a1b0 in term 0.
I20260709 13:07:38.028175 29982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dfa5968812443d28f2c148c6768f51f" candidate_uuid: "6c5f1932e9134824a0f7823dccf6273e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" is_pre_election: true
I20260709 13:07:38.039723 30133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c218ddfeb78c4cfa98f71f681c807503" candidate_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5f1932e9134824a0f7823dccf6273e" is_pre_election: true
I20260709 13:07:38.040367 29985 raft_consensus.cc:2468] T 4430e39586c24524bffd80447f2999be P 4a1d35e9bdf14f44a53c9a1984d04629 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02f386f6c1ab419f8c7922092b04a1b0 in term 1.
W20260709 13:07:38.040773 30097 leader_election.cc:343] T 8dfa5968812443d28f2c148c6768f51f P 6c5f1932e9134824a0f7823dccf6273e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1:36133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:38.040333 30133 raft_consensus.cc:2468] T c218ddfeb78c4cfa98f71f681c807503 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a1d35e9bdf14f44a53c9a1984d04629 in term 0.
I20260709 13:07:38.041591 29984 raft_consensus.cc:2468] T 0242b20a350c42c9978239cd1ec620d2 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02f386f6c1ab419f8c7922092b04a1b0 in term 0.
I20260709 13:07:38.043393 30060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2418e193a92a4d36a4149de5f38be171" candidate_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02f386f6c1ab419f8c7922092b04a1b0"
I20260709 13:07:38.043567 29950 leader_election.cc:304] T c218ddfeb78c4cfa98f71f681c807503 P 4a1d35e9bdf14f44a53c9a1984d04629 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a1d35e9bdf14f44a53c9a1984d04629, 6c5f1932e9134824a0f7823dccf6273e; no voters: 
I20260709 13:07:38.043980 30058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dfa5968812443d28f2c148c6768f51f" candidate_uuid: "6c5f1932e9134824a0f7823dccf6273e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02f386f6c1ab419f8c7922092b04a1b0" is_pre_election: true
I20260709 13:07:38.034559 30184 leader_election.cc:290] T c218ddfeb78c4cfa98f71f681c807503 P 4a1d35e9bdf14f44a53c9a1984d04629 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2:44093), 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3:43375)
I20260709 13:07:38.045554 30058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c218ddfeb78c4cfa98f71f681c807503" candidate_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02f386f6c1ab419f8c7922092b04a1b0" is_pre_election: true
I20260709 13:07:38.045449 30174 raft_consensus.cc:359] T bdc7f4487d69425da272a9c59e5e3c54 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:38.046147 30058 raft_consensus.cc:2468] T c218ddfeb78c4cfa98f71f681c807503 P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a1d35e9bdf14f44a53c9a1984d04629 in term 0.
I20260709 13:07:38.046569 30097 leader_election.cc:304] T 8dfa5968812443d28f2c148c6768f51f P 6c5f1932e9134824a0f7823dccf6273e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c5f1932e9134824a0f7823dccf6273e; no voters: 02f386f6c1ab419f8c7922092b04a1b0, 4a1d35e9bdf14f44a53c9a1984d04629
I20260709 13:07:38.046124 30174 raft_consensus.cc:385] T bdc7f4487d69425da272a9c59e5e3c54 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:38.047742 30174 raft_consensus.cc:740] T bdc7f4487d69425da272a9c59e5e3c54 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5f1932e9134824a0f7823dccf6273e, State: Initialized, Role: FOLLOWER
I20260709 13:07:38.048410 30174 consensus_queue.cc:260] T bdc7f4487d69425da272a9c59e5e3c54 P 6c5f1932e9134824a0f7823dccf6273e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:38.042308 30218 raft_consensus.cc:3060] T 2418e193a92a4d36a4149de5f38be171 P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.054126 30175 ts_tablet_manager.cc:1434] T 0242b20a350c42c9978239cd1ec620d2 P 4a1d35e9bdf14f44a53c9a1984d04629: Time spent starting tablet: real 0.151s	user 0.007s	sys 0.005s
I20260709 13:07:38.054751 30174 ts_tablet_manager.cc:1434] T bdc7f4487d69425da272a9c59e5e3c54 P 6c5f1932e9134824a0f7823dccf6273e: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 13:07:38.055564 30174 tablet_bootstrap.cc:492] T 4430e39586c24524bffd80447f2999be P 6c5f1932e9134824a0f7823dccf6273e: Bootstrap starting.
I20260709 13:07:38.056211 30023 leader_election.cc:304] T 4430e39586c24524bffd80447f2999be P 02f386f6c1ab419f8c7922092b04a1b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02f386f6c1ab419f8c7922092b04a1b0, 4a1d35e9bdf14f44a53c9a1984d04629; no voters: 6c5f1932e9134824a0f7823dccf6273e
I20260709 13:07:38.057627 30217 raft_consensus.cc:2804] T 4430e39586c24524bffd80447f2999be P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:38.058542 30175 tablet_bootstrap.cc:492] T 8dfa5968812443d28f2c148c6768f51f P 4a1d35e9bdf14f44a53c9a1984d04629: Bootstrap starting.
I20260709 13:07:38.049670 30200 raft_consensus.cc:2749] T 8dfa5968812443d28f2c148c6768f51f P 6c5f1932e9134824a0f7823dccf6273e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:38.058220 30217 raft_consensus.cc:697] T 4430e39586c24524bffd80447f2999be P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 LEADER]: Becoming Leader. State: Replica: 02f386f6c1ab419f8c7922092b04a1b0, State: Running, Role: LEADER
I20260709 13:07:38.053339 30210 raft_consensus.cc:2804] T c218ddfeb78c4cfa98f71f681c807503 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:38.064536 30210 raft_consensus.cc:493] T c218ddfeb78c4cfa98f71f681c807503 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.064877 30210 raft_consensus.cc:3060] T c218ddfeb78c4cfa98f71f681c807503 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.065449 30181 raft_consensus.cc:515] T 22b91a84b0d244f987c2625faa04ecce P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:38.067288 30217 consensus_queue.cc:237] T 4430e39586c24524bffd80447f2999be P 02f386f6c1ab419f8c7922092b04a1b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:38.072291 30059 raft_consensus.cc:2393] T 22b91a84b0d244f987c2625faa04ecce P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a1d35e9bdf14f44a53c9a1984d04629 in current term 1: Already voted for candidate 02f386f6c1ab419f8c7922092b04a1b0 in this term.
I20260709 13:07:38.073908 30212 raft_consensus.cc:493] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.074345 30212 raft_consensus.cc:515] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
W20260709 13:07:38.077229 29931 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:38.088311 29948 leader_election.cc:304] T 22b91a84b0d244f987c2625faa04ecce P 4a1d35e9bdf14f44a53c9a1984d04629 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a1d35e9bdf14f44a53c9a1984d04629; no voters: 02f386f6c1ab419f8c7922092b04a1b0, 6c5f1932e9134824a0f7823dccf6273e
I20260709 13:07:38.089692 30184 raft_consensus.cc:3060] T 22b91a84b0d244f987c2625faa04ecce P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.095419 30059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc7f4487d69425da272a9c59e5e3c54" candidate_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02f386f6c1ab419f8c7922092b04a1b0" is_pre_election: true
I20260709 13:07:38.096122 30133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc7f4487d69425da272a9c59e5e3c54" candidate_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5f1932e9134824a0f7823dccf6273e" is_pre_election: true
I20260709 13:07:38.096284 30059 raft_consensus.cc:2468] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a1d35e9bdf14f44a53c9a1984d04629 in term 0.
I20260709 13:07:38.097990 30133 raft_consensus.cc:2468] T bdc7f4487d69425da272a9c59e5e3c54 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a1d35e9bdf14f44a53c9a1984d04629 in term 0.
I20260709 13:07:38.098469 29948 leader_election.cc:304] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02f386f6c1ab419f8c7922092b04a1b0, 4a1d35e9bdf14f44a53c9a1984d04629; no voters: 
I20260709 13:07:38.098307 29881 catalog_manager.cc:5697] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:38.095834 30212 leader_election.cc:290] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2:44093), 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3:43375)
I20260709 13:07:38.103322 30184 raft_consensus.cc:2749] T 22b91a84b0d244f987c2625faa04ecce P 4a1d35e9bdf14f44a53c9a1984d04629 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:38.103906 30218 raft_consensus.cc:2749] T 2418e193a92a4d36a4149de5f38be171 P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:38.104693 30212 raft_consensus.cc:2804] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:38.106437 30212 raft_consensus.cc:493] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.106750 30212 raft_consensus.cc:3060] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.110857 30174 tablet_bootstrap.cc:654] T 4430e39586c24524bffd80447f2999be P 6c5f1932e9134824a0f7823dccf6273e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:38.113286 30060 raft_consensus.cc:2468] T 2418e193a92a4d36a4149de5f38be171 P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a1d35e9bdf14f44a53c9a1984d04629 in term 1.
I20260709 13:07:38.114078 30212 raft_consensus.cc:515] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:38.113668 29882 catalog_manager.cc:5697] T 0242b20a350c42c9978239cd1ec620d2 P 02f386f6c1ab419f8c7922092b04a1b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2). New cstate: current_term: 1 leader_uuid: "02f386f6c1ab419f8c7922092b04a1b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:38.114385 30210 raft_consensus.cc:515] T c218ddfeb78c4cfa98f71f681c807503 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:38.115675 29882 catalog_manager.cc:5697] T 8dfa5968812443d28f2c148c6768f51f P 02f386f6c1ab419f8c7922092b04a1b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2). New cstate: current_term: 1 leader_uuid: "02f386f6c1ab419f8c7922092b04a1b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:38.116621 30212 leader_election.cc:290] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [CANDIDATE]: Term 1 election: Requested vote from peers 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2:44093), 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3:43375)
I20260709 13:07:38.117071 30181 leader_election.cc:290] T 22b91a84b0d244f987c2625faa04ecce P 02f386f6c1ab419f8c7922092b04a1b0 [CANDIDATE]: Term 1 election: Requested vote from peers 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1:36133), 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3:43375)
I20260709 13:07:38.117419 29983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b91a84b0d244f987c2625faa04ecce" candidate_uuid: "02f386f6c1ab419f8c7922092b04a1b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a1d35e9bdf14f44a53c9a1984d04629"
I20260709 13:07:38.117772 30133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc7f4487d69425da272a9c59e5e3c54" candidate_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5f1932e9134824a0f7823dccf6273e"
I20260709 13:07:38.134564 30059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c218ddfeb78c4cfa98f71f681c807503" candidate_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02f386f6c1ab419f8c7922092b04a1b0"
I20260709 13:07:38.130429 30060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc7f4487d69425da272a9c59e5e3c54" candidate_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02f386f6c1ab419f8c7922092b04a1b0"
I20260709 13:07:38.131390 30175 tablet_bootstrap.cc:654] T 8dfa5968812443d28f2c148c6768f51f P 4a1d35e9bdf14f44a53c9a1984d04629: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:38.128455 30132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c218ddfeb78c4cfa98f71f681c807503" candidate_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5f1932e9134824a0f7823dccf6273e"
I20260709 13:07:38.136426 30060 raft_consensus.cc:3060] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.137137 30132 raft_consensus.cc:3060] T c218ddfeb78c4cfa98f71f681c807503 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.136368 30059 raft_consensus.cc:3060] T c218ddfeb78c4cfa98f71f681c807503 P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.119980 30134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b91a84b0d244f987c2625faa04ecce" candidate_uuid: "02f386f6c1ab419f8c7922092b04a1b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5f1932e9134824a0f7823dccf6273e"
I20260709 13:07:38.143728 30132 raft_consensus.cc:2468] T c218ddfeb78c4cfa98f71f681c807503 P 6c5f1932e9134824a0f7823dccf6273e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a1d35e9bdf14f44a53c9a1984d04629 in term 1.
I20260709 13:07:38.143805 30060 raft_consensus.cc:2468] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a1d35e9bdf14f44a53c9a1984d04629 in term 1.
I20260709 13:07:38.144209 30134 raft_consensus.cc:3060] T 22b91a84b0d244f987c2625faa04ecce P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.149365 30174 tablet_bootstrap.cc:492] T 4430e39586c24524bffd80447f2999be P 6c5f1932e9134824a0f7823dccf6273e: No bootstrap required, opened a new log
I20260709 13:07:38.149739 30174 ts_tablet_manager.cc:1403] T 4430e39586c24524bffd80447f2999be P 6c5f1932e9134824a0f7823dccf6273e: Time spent bootstrapping tablet: real 0.094s	user 0.010s	sys 0.002s
I20260709 13:07:38.150233 29983 raft_consensus.cc:2468] T 22b91a84b0d244f987c2625faa04ecce P 4a1d35e9bdf14f44a53c9a1984d04629 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02f386f6c1ab419f8c7922092b04a1b0 in term 1.
I20260709 13:07:38.151409 30023 leader_election.cc:304] T 22b91a84b0d244f987c2625faa04ecce P 02f386f6c1ab419f8c7922092b04a1b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02f386f6c1ab419f8c7922092b04a1b0, 4a1d35e9bdf14f44a53c9a1984d04629; no voters: 
I20260709 13:07:38.152024 30174 raft_consensus.cc:359] T 4430e39586c24524bffd80447f2999be P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:38.152350 30181 raft_consensus.cc:2804] T 22b91a84b0d244f987c2625faa04ecce P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:38.152675 30174 raft_consensus.cc:385] T 4430e39586c24524bffd80447f2999be P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:38.152966 30174 raft_consensus.cc:740] T 4430e39586c24524bffd80447f2999be P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5f1932e9134824a0f7823dccf6273e, State: Initialized, Role: FOLLOWER
I20260709 13:07:38.153170 30181 raft_consensus.cc:697] T 22b91a84b0d244f987c2625faa04ecce P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 LEADER]: Becoming Leader. State: Replica: 02f386f6c1ab419f8c7922092b04a1b0, State: Running, Role: LEADER
I20260709 13:07:38.154536 30181 consensus_queue.cc:237] T 22b91a84b0d244f987c2625faa04ecce P 02f386f6c1ab419f8c7922092b04a1b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:38.154881 30175 tablet_bootstrap.cc:492] T 8dfa5968812443d28f2c148c6768f51f P 4a1d35e9bdf14f44a53c9a1984d04629: No bootstrap required, opened a new log
I20260709 13:07:38.145394 29950 leader_election.cc:304] T c218ddfeb78c4cfa98f71f681c807503 P 4a1d35e9bdf14f44a53c9a1984d04629 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a1d35e9bdf14f44a53c9a1984d04629, 6c5f1932e9134824a0f7823dccf6273e; no voters: 
I20260709 13:07:38.156296 30175 ts_tablet_manager.cc:1403] T 8dfa5968812443d28f2c148c6768f51f P 4a1d35e9bdf14f44a53c9a1984d04629: Time spent bootstrapping tablet: real 0.101s	user 0.014s	sys 0.001s
I20260709 13:07:38.155803 30174 consensus_queue.cc:260] T 4430e39586c24524bffd80447f2999be P 6c5f1932e9134824a0f7823dccf6273e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:38.144290 30210 leader_election.cc:290] T c218ddfeb78c4cfa98f71f681c807503 P 4a1d35e9bdf14f44a53c9a1984d04629 [CANDIDATE]: Term 1 election: Requested vote from peers 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2:44093), 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3:43375)
I20260709 13:07:38.157207 30210 raft_consensus.cc:2804] T c218ddfeb78c4cfa98f71f681c807503 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:38.157788 30210 raft_consensus.cc:697] T c218ddfeb78c4cfa98f71f681c807503 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 1 LEADER]: Becoming Leader. State: Replica: 4a1d35e9bdf14f44a53c9a1984d04629, State: Running, Role: LEADER
I20260709 13:07:38.158360 30174 ts_tablet_manager.cc:1434] T 4430e39586c24524bffd80447f2999be P 6c5f1932e9134824a0f7823dccf6273e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:07:38.158595 30210 consensus_queue.cc:237] T c218ddfeb78c4cfa98f71f681c807503 P 4a1d35e9bdf14f44a53c9a1984d04629 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:38.158816 30175 raft_consensus.cc:359] T 8dfa5968812443d28f2c148c6768f51f P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } } peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } }
I20260709 13:07:38.146098 30133 raft_consensus.cc:3060] T bdc7f4487d69425da272a9c59e5e3c54 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.146974 30178 consensus_queue.cc:1048] T 9398eeffa5504937973ba568bce7b4c2 P 6c5f1932e9134824a0f7823dccf6273e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:07:38.164867 29883 catalog_manager.cc:5697] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3). New cstate: current_term: 1 leader_uuid: "6c5f1932e9134824a0f7823dccf6273e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:38.167573 30225 raft_consensus.cc:493] T 4430e39586c24524bffd80447f2999be P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.168037 30225 raft_consensus.cc:515] T 4430e39586c24524bffd80447f2999be P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:38.169441 30178 consensus_queue.cc:1048] T 9398eeffa5504937973ba568bce7b4c2 P 6c5f1932e9134824a0f7823dccf6273e [LEADER]: Connected to new peer: Peer: permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:38.145980 30059 raft_consensus.cc:2468] T c218ddfeb78c4cfa98f71f681c807503 P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a1d35e9bdf14f44a53c9a1984d04629 in term 1.
I20260709 13:07:38.160344 29948 leader_election.cc:304] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02f386f6c1ab419f8c7922092b04a1b0, 4a1d35e9bdf14f44a53c9a1984d04629; no voters: 
I20260709 13:07:38.154786 30134 raft_consensus.cc:2468] T 22b91a84b0d244f987c2625faa04ecce P 6c5f1932e9134824a0f7823dccf6273e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02f386f6c1ab419f8c7922092b04a1b0 in term 1.
I20260709 13:07:38.171900 29984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430e39586c24524bffd80447f2999be" candidate_uuid: "6c5f1932e9134824a0f7823dccf6273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" is_pre_election: true
I20260709 13:07:38.172694 29984 raft_consensus.cc:2393] T 4430e39586c24524bffd80447f2999be P 4a1d35e9bdf14f44a53c9a1984d04629 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c5f1932e9134824a0f7823dccf6273e in current term 1: Already voted for candidate 02f386f6c1ab419f8c7922092b04a1b0 in this term.
I20260709 13:07:38.175720 30212 raft_consensus.cc:2804] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:38.175956 30225 leader_election.cc:290] T 4430e39586c24524bffd80447f2999be P 6c5f1932e9134824a0f7823dccf6273e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1:36133), 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2:44093)
I20260709 13:07:38.176729 30212 raft_consensus.cc:697] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 1 LEADER]: Becoming Leader. State: Replica: 4a1d35e9bdf14f44a53c9a1984d04629, State: Running, Role: LEADER
I20260709 13:07:38.177578 30175 raft_consensus.cc:385] T 8dfa5968812443d28f2c148c6768f51f P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:38.177891 30175 raft_consensus.cc:740] T 8dfa5968812443d28f2c148c6768f51f P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a1d35e9bdf14f44a53c9a1984d04629, State: Initialized, Role: FOLLOWER
I20260709 13:07:38.176757 30060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4430e39586c24524bffd80447f2999be" candidate_uuid: "6c5f1932e9134824a0f7823dccf6273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02f386f6c1ab419f8c7922092b04a1b0" is_pre_election: true
I20260709 13:07:38.178545 30175 consensus_queue.cc:260] T 8dfa5968812443d28f2c148c6768f51f P 4a1d35e9bdf14f44a53c9a1984d04629 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } } peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } }
I20260709 13:07:38.179492 30097 leader_election.cc:304] T 4430e39586c24524bffd80447f2999be P 6c5f1932e9134824a0f7823dccf6273e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c5f1932e9134824a0f7823dccf6273e; no voters: 02f386f6c1ab419f8c7922092b04a1b0, 4a1d35e9bdf14f44a53c9a1984d04629
I20260709 13:07:38.179293 30212 consensus_queue.cc:237] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:38.180608 30175 ts_tablet_manager.cc:1434] T 8dfa5968812443d28f2c148c6768f51f P 4a1d35e9bdf14f44a53c9a1984d04629: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 13:07:38.180974 30225 raft_consensus.cc:3060] T 4430e39586c24524bffd80447f2999be P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.181565 30175 tablet_bootstrap.cc:492] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629: Bootstrap starting.
I20260709 13:07:38.185678 30133 raft_consensus.cc:2468] T bdc7f4487d69425da272a9c59e5e3c54 P 6c5f1932e9134824a0f7823dccf6273e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a1d35e9bdf14f44a53c9a1984d04629 in term 1.
I20260709 13:07:38.188522 30175 tablet_bootstrap.cc:654] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:38.201277 29881 catalog_manager.cc:5697] T c218ddfeb78c4cfa98f71f681c807503 P 4a1d35e9bdf14f44a53c9a1984d04629 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:38.202865 29881 catalog_manager.cc:5697] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:38.204200 30225 raft_consensus.cc:2749] T 4430e39586c24524bffd80447f2999be P 6c5f1932e9134824a0f7823dccf6273e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:38.209308 30175 tablet_bootstrap.cc:492] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629: No bootstrap required, opened a new log
I20260709 13:07:38.211851 30175 ts_tablet_manager.cc:1403] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.003s
I20260709 13:07:38.214494 30175 raft_consensus.cc:359] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:38.215147 30175 raft_consensus.cc:385] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:38.215399 30175 raft_consensus.cc:740] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a1d35e9bdf14f44a53c9a1984d04629, State: Initialized, Role: FOLLOWER
I20260709 13:07:38.216531 30175 consensus_queue.cc:260] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:38.216452 29883 catalog_manager.cc:5697] T 4430e39586c24524bffd80447f2999be P 02f386f6c1ab419f8c7922092b04a1b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2). New cstate: current_term: 1 leader_uuid: "02f386f6c1ab419f8c7922092b04a1b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:38.218863 30175 ts_tablet_manager.cc:1434] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:07:38.218336 29883 catalog_manager.cc:5697] T 22b91a84b0d244f987c2625faa04ecce P 02f386f6c1ab419f8c7922092b04a1b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2). New cstate: current_term: 1 leader_uuid: "02f386f6c1ab419f8c7922092b04a1b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:38.224757 30181 raft_consensus.cc:493] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.225274 30181 raft_consensus.cc:515] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:38.229096 30181 leader_election.cc:290] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 02f386f6c1ab419f8c7922092b04a1b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1:36133), 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3:43375)
I20260709 13:07:38.229899 29983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e48e4ede2b9419c805b7d9bcd1e2fb0" candidate_uuid: "02f386f6c1ab419f8c7922092b04a1b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" is_pre_election: true
I20260709 13:07:38.230576 29983 raft_consensus.cc:2468] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02f386f6c1ab419f8c7922092b04a1b0 in term 0.
I20260709 13:07:38.231776 30023 leader_election.cc:304] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 02f386f6c1ab419f8c7922092b04a1b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02f386f6c1ab419f8c7922092b04a1b0, 4a1d35e9bdf14f44a53c9a1984d04629; no voters: 
I20260709 13:07:38.233553 30181 raft_consensus.cc:2804] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:38.233983 30181 raft_consensus.cc:493] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.234388 30181 raft_consensus.cc:3060] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 02f386f6c1ab419f8c7922092b04a1b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.244252 30133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e48e4ede2b9419c805b7d9bcd1e2fb0" candidate_uuid: "02f386f6c1ab419f8c7922092b04a1b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5f1932e9134824a0f7823dccf6273e" is_pre_election: true
I20260709 13:07:38.244830 30133 raft_consensus.cc:2468] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02f386f6c1ab419f8c7922092b04a1b0 in term 0.
I20260709 13:07:38.244625 30181 raft_consensus.cc:515] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:38.246490 30181 leader_election.cc:290] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 02f386f6c1ab419f8c7922092b04a1b0 [CANDIDATE]: Term 1 election: Requested vote from peers 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1:36133), 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3:43375)
I20260709 13:07:38.247212 29983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e48e4ede2b9419c805b7d9bcd1e2fb0" candidate_uuid: "02f386f6c1ab419f8c7922092b04a1b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a1d35e9bdf14f44a53c9a1984d04629"
I20260709 13:07:38.247383 30133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e48e4ede2b9419c805b7d9bcd1e2fb0" candidate_uuid: "02f386f6c1ab419f8c7922092b04a1b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5f1932e9134824a0f7823dccf6273e"
I20260709 13:07:38.247653 29983 raft_consensus.cc:3060] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.247963 30133 raft_consensus.cc:3060] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 6c5f1932e9134824a0f7823dccf6273e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.252434 30133 raft_consensus.cc:2468] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 6c5f1932e9134824a0f7823dccf6273e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02f386f6c1ab419f8c7922092b04a1b0 in term 1.
I20260709 13:07:38.252434 29983 raft_consensus.cc:2468] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02f386f6c1ab419f8c7922092b04a1b0 in term 1.
I20260709 13:07:38.253542 30025 leader_election.cc:304] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 02f386f6c1ab419f8c7922092b04a1b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02f386f6c1ab419f8c7922092b04a1b0, 6c5f1932e9134824a0f7823dccf6273e; no voters: 
I20260709 13:07:38.254314 30181 raft_consensus.cc:2804] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:38.254726 30181 raft_consensus.cc:697] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 LEADER]: Becoming Leader. State: Replica: 02f386f6c1ab419f8c7922092b04a1b0, State: Running, Role: LEADER
I20260709 13:07:38.255463 30181 consensus_queue.cc:237] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 02f386f6c1ab419f8c7922092b04a1b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:38.262019 29880 catalog_manager.cc:5697] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 02f386f6c1ab419f8c7922092b04a1b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2). New cstate: current_term: 1 leader_uuid: "02f386f6c1ab419f8c7922092b04a1b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:38.285283 30210 consensus_queue.cc:1048] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:38.296094 30210 consensus_queue.cc:1048] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:38.385722 30210 raft_consensus.cc:493] T 8dfa5968812443d28f2c148c6768f51f P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.386235 30210 raft_consensus.cc:515] T 8dfa5968812443d28f2c148c6768f51f P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } } peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } }
I20260709 13:07:38.387871 30210 leader_election.cc:290] T 8dfa5968812443d28f2c148c6768f51f P 4a1d35e9bdf14f44a53c9a1984d04629 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2:44093), 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3:43375)
I20260709 13:07:38.388724 30059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dfa5968812443d28f2c148c6768f51f" candidate_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02f386f6c1ab419f8c7922092b04a1b0" is_pre_election: true
I20260709 13:07:38.388875 30133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dfa5968812443d28f2c148c6768f51f" candidate_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c5f1932e9134824a0f7823dccf6273e" is_pre_election: true
I20260709 13:07:38.389588 30133 raft_consensus.cc:2393] T 8dfa5968812443d28f2c148c6768f51f P 6c5f1932e9134824a0f7823dccf6273e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a1d35e9bdf14f44a53c9a1984d04629 in current term 1: Already voted for candidate 02f386f6c1ab419f8c7922092b04a1b0 in this term.
I20260709 13:07:38.390563 29950 leader_election.cc:304] T 8dfa5968812443d28f2c148c6768f51f P 4a1d35e9bdf14f44a53c9a1984d04629 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a1d35e9bdf14f44a53c9a1984d04629; no voters: 02f386f6c1ab419f8c7922092b04a1b0, 6c5f1932e9134824a0f7823dccf6273e
I20260709 13:07:38.391335 30210 raft_consensus.cc:3060] T 8dfa5968812443d28f2c148c6768f51f P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.396942 30210 raft_consensus.cc:2749] T 8dfa5968812443d28f2c148c6768f51f P 4a1d35e9bdf14f44a53c9a1984d04629 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:38.407209 30059 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8dfa5968812443d28f2c148c6768f51f"
dest_uuid: "02f386f6c1ab419f8c7922092b04a1b0"
mode: GRACEFUL
new_leader_uuid: "4a1d35e9bdf14f44a53c9a1984d04629"
 from {username='slave'} at 127.0.0.1:38626
I20260709 13:07:38.407778 30059 raft_consensus.cc:606] T 8dfa5968812443d28f2c148c6768f51f P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 LEADER]: Received request to transfer leadership to TS 4a1d35e9bdf14f44a53c9a1984d04629
I20260709 13:07:38.417552 30059 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e48e4ede2b9419c805b7d9bcd1e2fb0"
dest_uuid: "02f386f6c1ab419f8c7922092b04a1b0"
mode: GRACEFUL
new_leader_uuid: "4a1d35e9bdf14f44a53c9a1984d04629"
 from {username='slave'} at 127.0.0.1:38626
I20260709 13:07:38.418030 30059 raft_consensus.cc:606] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 LEADER]: Received request to transfer leadership to TS 4a1d35e9bdf14f44a53c9a1984d04629
I20260709 13:07:38.424872 30181 consensus_queue.cc:1048] T 8dfa5968812443d28f2c148c6768f51f P 02f386f6c1ab419f8c7922092b04a1b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:38.431548 30217 raft_consensus.cc:993] T 8dfa5968812443d28f2c148c6768f51f P 02f386f6c1ab419f8c7922092b04a1b0: : Instructing follower 4a1d35e9bdf14f44a53c9a1984d04629 to start an election
I20260709 13:07:38.431672 30133 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9398eeffa5504937973ba568bce7b4c2"
dest_uuid: "6c5f1932e9134824a0f7823dccf6273e"
mode: GRACEFUL
new_leader_uuid: "4a1d35e9bdf14f44a53c9a1984d04629"
 from {username='slave'} at 127.0.0.1:58436
I20260709 13:07:38.432009 30217 raft_consensus.cc:1081] T 8dfa5968812443d28f2c148c6768f51f P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 LEADER]: Signalling peer 4a1d35e9bdf14f44a53c9a1984d04629 to start an election
I20260709 13:07:38.432298 30133 raft_consensus.cc:606] T 9398eeffa5504937973ba568bce7b4c2 P 6c5f1932e9134824a0f7823dccf6273e [term 1 LEADER]: Received request to transfer leadership to TS 4a1d35e9bdf14f44a53c9a1984d04629
I20260709 13:07:38.433902 29984 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8dfa5968812443d28f2c148c6768f51f"
dest_uuid: "4a1d35e9bdf14f44a53c9a1984d04629"
 from {username='slave'} at 127.0.0.1:38300
I20260709 13:07:38.434424 29984 raft_consensus.cc:493] T 8dfa5968812443d28f2c148c6768f51f P 4a1d35e9bdf14f44a53c9a1984d04629 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:38.434788 29984 raft_consensus.cc:3060] T 8dfa5968812443d28f2c148c6768f51f P 4a1d35e9bdf14f44a53c9a1984d04629 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.437160 30217 consensus_queue.cc:1048] T 8dfa5968812443d28f2c148c6768f51f P 02f386f6c1ab419f8c7922092b04a1b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:38.439913 30134 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c61e62ccbc434482b70daf1670495174"
dest_uuid: "6c5f1932e9134824a0f7823dccf6273e"
mode: GRACEFUL
new_leader_uuid: "02f386f6c1ab419f8c7922092b04a1b0"
 from {username='slave'} at 127.0.0.1:58436
I20260709 13:07:38.440459 30134 raft_consensus.cc:606] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e [term 1 LEADER]: Received request to transfer leadership to TS 02f386f6c1ab419f8c7922092b04a1b0
I20260709 13:07:38.441941 29984 raft_consensus.cc:515] T 8dfa5968812443d28f2c148c6768f51f P 4a1d35e9bdf14f44a53c9a1984d04629 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } } peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } }
I20260709 13:07:38.443121 29983 raft_consensus.cc:1240] T 8dfa5968812443d28f2c148c6768f51f P 4a1d35e9bdf14f44a53c9a1984d04629 [term 2 FOLLOWER]: Rejecting Update request from peer 02f386f6c1ab419f8c7922092b04a1b0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:38.445631 30059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dfa5968812443d28f2c148c6768f51f" candidate_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "02f386f6c1ab419f8c7922092b04a1b0"
I20260709 13:07:38.445933 30134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dfa5968812443d28f2c148c6768f51f" candidate_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6c5f1932e9134824a0f7823dccf6273e"
I20260709 13:07:38.446245 30059 raft_consensus.cc:3055] T 8dfa5968812443d28f2c148c6768f51f P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:38.446729 30059 raft_consensus.cc:740] T 8dfa5968812443d28f2c148c6768f51f P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 02f386f6c1ab419f8c7922092b04a1b0, State: Running, Role: LEADER
I20260709 13:07:38.447059 29984 leader_election.cc:290] T 8dfa5968812443d28f2c148c6768f51f P 4a1d35e9bdf14f44a53c9a1984d04629 [CANDIDATE]: Term 2 election: Requested vote from peers 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2:44093), 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3:43375)
I20260709 13:07:38.447669 30059 consensus_queue.cc:260] T 8dfa5968812443d28f2c148c6768f51f P 02f386f6c1ab419f8c7922092b04a1b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } } peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } }
I20260709 13:07:38.449797 30059 raft_consensus.cc:3060] T 8dfa5968812443d28f2c148c6768f51f P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.457883 30059 raft_consensus.cc:2468] T 8dfa5968812443d28f2c148c6768f51f P 02f386f6c1ab419f8c7922092b04a1b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a1d35e9bdf14f44a53c9a1984d04629 in term 2.
W20260709 13:07:38.449692 30217 consensus_queue.cc:1175] T 8dfa5968812443d28f2c148c6768f51f P 02f386f6c1ab419f8c7922092b04a1b0 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 0 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 02f386f6c1ab419f8c7922092b04a1b0 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:07:38.459543 29948 leader_election.cc:304] T 8dfa5968812443d28f2c148c6768f51f P 4a1d35e9bdf14f44a53c9a1984d04629 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02f386f6c1ab419f8c7922092b04a1b0, 4a1d35e9bdf14f44a53c9a1984d04629; no voters: 6c5f1932e9134824a0f7823dccf6273e
I20260709 13:07:38.460389 30210 raft_consensus.cc:2804] T 8dfa5968812443d28f2c148c6768f51f P 4a1d35e9bdf14f44a53c9a1984d04629 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:38.460840 30210 raft_consensus.cc:697] T 8dfa5968812443d28f2c148c6768f51f P 4a1d35e9bdf14f44a53c9a1984d04629 [term 2 LEADER]: Becoming Leader. State: Replica: 4a1d35e9bdf14f44a53c9a1984d04629, State: Running, Role: LEADER
I20260709 13:07:38.461627 30210 consensus_queue.cc:237] T 8dfa5968812443d28f2c148c6768f51f P 4a1d35e9bdf14f44a53c9a1984d04629 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } } peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } }
I20260709 13:07:38.464460 29984 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bdc7f4487d69425da272a9c59e5e3c54"
dest_uuid: "4a1d35e9bdf14f44a53c9a1984d04629"
mode: GRACEFUL
new_leader_uuid: "02f386f6c1ab419f8c7922092b04a1b0"
 from {username='slave'} at 127.0.0.1:38310
I20260709 13:07:38.465029 29984 raft_consensus.cc:606] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 1 LEADER]: Received request to transfer leadership to TS 02f386f6c1ab419f8c7922092b04a1b0
I20260709 13:07:38.469215 29883 catalog_manager.cc:5697] T 8dfa5968812443d28f2c148c6768f51f P 4a1d35e9bdf14f44a53c9a1984d04629 reported cstate change: term changed from 1 to 2, leader changed from 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2) to 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1). New cstate: current_term: 2 leader_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:38.472785 30059 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0242b20a350c42c9978239cd1ec620d2"
dest_uuid: "02f386f6c1ab419f8c7922092b04a1b0"
mode: GRACEFUL
new_leader_uuid: "6c5f1932e9134824a0f7823dccf6273e"
 from {username='slave'} at 127.0.0.1:38626
I20260709 13:07:38.473242 30059 raft_consensus.cc:606] T 0242b20a350c42c9978239cd1ec620d2 P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 LEADER]: Received request to transfer leadership to TS 6c5f1932e9134824a0f7823dccf6273e
I20260709 13:07:38.489331 30225 consensus_queue.cc:1048] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e [LEADER]: Connected to new peer: Peer: permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:38.495311 30192 raft_consensus.cc:993] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e: : Instructing follower 02f386f6c1ab419f8c7922092b04a1b0 to start an election
I20260709 13:07:38.495774 30200 raft_consensus.cc:1081] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e [term 1 LEADER]: Signalling peer 02f386f6c1ab419f8c7922092b04a1b0 to start an election
I20260709 13:07:38.497473 30060 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c61e62ccbc434482b70daf1670495174"
dest_uuid: "02f386f6c1ab419f8c7922092b04a1b0"
 from {username='slave'} at 127.0.0.1:38610
I20260709 13:07:38.499533 30060 raft_consensus.cc:493] T c61e62ccbc434482b70daf1670495174 P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:38.499949 30060 raft_consensus.cc:3060] T c61e62ccbc434482b70daf1670495174 P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.500833 30200 consensus_queue.cc:1048] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:38.507443 30060 raft_consensus.cc:515] T c61e62ccbc434482b70daf1670495174 P 02f386f6c1ab419f8c7922092b04a1b0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:38.510252 30217 consensus_queue.cc:1048] T 4430e39586c24524bffd80447f2999be P 02f386f6c1ab419f8c7922092b04a1b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:38.514748 30060 leader_election.cc:290] T c61e62ccbc434482b70daf1670495174 P 02f386f6c1ab419f8c7922092b04a1b0 [CANDIDATE]: Term 2 election: Requested vote from peers 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1:36133), 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3:43375)
I20260709 13:07:38.515424 29983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e62ccbc434482b70daf1670495174" candidate_uuid: "02f386f6c1ab419f8c7922092b04a1b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a1d35e9bdf14f44a53c9a1984d04629"
I20260709 13:07:38.516076 29983 raft_consensus.cc:3060] T c61e62ccbc434482b70daf1670495174 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.519138 30133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e62ccbc434482b70daf1670495174" candidate_uuid: "02f386f6c1ab419f8c7922092b04a1b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6c5f1932e9134824a0f7823dccf6273e"
I20260709 13:07:38.519330 29985 raft_consensus.cc:3060] T 0242b20a350c42c9978239cd1ec620d2 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.519722 30133 raft_consensus.cc:3055] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:38.520092 30133 raft_consensus.cc:740] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6c5f1932e9134824a0f7823dccf6273e, State: Running, Role: LEADER
I20260709 13:07:38.520933 30133 consensus_queue.cc:260] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:38.522181 30133 raft_consensus.cc:3060] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.528930 30133 raft_consensus.cc:2468] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02f386f6c1ab419f8c7922092b04a1b0 in term 2.
I20260709 13:07:38.528937 30181 consensus_queue.cc:1048] T 4430e39586c24524bffd80447f2999be P 02f386f6c1ab419f8c7922092b04a1b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:38.530220 30025 leader_election.cc:304] T c61e62ccbc434482b70daf1670495174 P 02f386f6c1ab419f8c7922092b04a1b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02f386f6c1ab419f8c7922092b04a1b0, 6c5f1932e9134824a0f7823dccf6273e; no voters: 
I20260709 13:07:38.530853 29983 raft_consensus.cc:2468] T c61e62ccbc434482b70daf1670495174 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02f386f6c1ab419f8c7922092b04a1b0 in term 2.
I20260709 13:07:38.530939 30181 raft_consensus.cc:2804] T c61e62ccbc434482b70daf1670495174 P 02f386f6c1ab419f8c7922092b04a1b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:38.530233 30217 consensus_queue.cc:1048] T 0242b20a350c42c9978239cd1ec620d2 P 02f386f6c1ab419f8c7922092b04a1b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:38.531783 30181 raft_consensus.cc:697] T c61e62ccbc434482b70daf1670495174 P 02f386f6c1ab419f8c7922092b04a1b0 [term 2 LEADER]: Becoming Leader. State: Replica: 02f386f6c1ab419f8c7922092b04a1b0, State: Running, Role: LEADER
I20260709 13:07:38.533428 30218 consensus_queue.cc:1048] T 0242b20a350c42c9978239cd1ec620d2 P 02f386f6c1ab419f8c7922092b04a1b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:38.532691 30181 consensus_queue.cc:237] T c61e62ccbc434482b70daf1670495174 P 02f386f6c1ab419f8c7922092b04a1b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:38.545373 29880 catalog_manager.cc:5697] T c61e62ccbc434482b70daf1670495174 P 02f386f6c1ab419f8c7922092b04a1b0 reported cstate change: term changed from 1 to 2, leader changed from 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3) to 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2). New cstate: current_term: 2 leader_uuid: "02f386f6c1ab419f8c7922092b04a1b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:38.564502 30217 raft_consensus.cc:993] T 0242b20a350c42c9978239cd1ec620d2 P 02f386f6c1ab419f8c7922092b04a1b0: : Instructing follower 6c5f1932e9134824a0f7823dccf6273e to start an election
I20260709 13:07:38.564945 30217 raft_consensus.cc:1081] T 0242b20a350c42c9978239cd1ec620d2 P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 LEADER]: Signalling peer 6c5f1932e9134824a0f7823dccf6273e to start an election
I20260709 13:07:38.566512 30133 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0242b20a350c42c9978239cd1ec620d2"
dest_uuid: "6c5f1932e9134824a0f7823dccf6273e"
 from {username='slave'} at 127.0.0.1:58422
I20260709 13:07:38.567027 30133 raft_consensus.cc:493] T 0242b20a350c42c9978239cd1ec620d2 P 6c5f1932e9134824a0f7823dccf6273e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:38.567411 30133 raft_consensus.cc:3060] T 0242b20a350c42c9978239cd1ec620d2 P 6c5f1932e9134824a0f7823dccf6273e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.574072 30133 raft_consensus.cc:515] T 0242b20a350c42c9978239cd1ec620d2 P 6c5f1932e9134824a0f7823dccf6273e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:38.576056 30133 leader_election.cc:290] T 0242b20a350c42c9978239cd1ec620d2 P 6c5f1932e9134824a0f7823dccf6273e [CANDIDATE]: Term 2 election: Requested vote from peers 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1:36133), 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2:44093)
I20260709 13:07:38.577569 30060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0242b20a350c42c9978239cd1ec620d2" candidate_uuid: "6c5f1932e9134824a0f7823dccf6273e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "02f386f6c1ab419f8c7922092b04a1b0"
I20260709 13:07:38.578151 30060 raft_consensus.cc:3055] T 0242b20a350c42c9978239cd1ec620d2 P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:38.578397 30060 raft_consensus.cc:740] T 0242b20a350c42c9978239cd1ec620d2 P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 02f386f6c1ab419f8c7922092b04a1b0, State: Running, Role: LEADER
I20260709 13:07:38.577313 29985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0242b20a350c42c9978239cd1ec620d2" candidate_uuid: "6c5f1932e9134824a0f7823dccf6273e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a1d35e9bdf14f44a53c9a1984d04629"
I20260709 13:07:38.579401 29985 raft_consensus.cc:3060] T 0242b20a350c42c9978239cd1ec620d2 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.579103 30060 consensus_queue.cc:260] T 0242b20a350c42c9978239cd1ec620d2 P 02f386f6c1ab419f8c7922092b04a1b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:38.580224 30060 raft_consensus.cc:3060] T 0242b20a350c42c9978239cd1ec620d2 P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.584832 30060 raft_consensus.cc:2468] T 0242b20a350c42c9978239cd1ec620d2 P 02f386f6c1ab419f8c7922092b04a1b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5f1932e9134824a0f7823dccf6273e in term 2.
I20260709 13:07:38.585289 30210 consensus_queue.cc:1048] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:38.585848 30097 leader_election.cc:304] T 0242b20a350c42c9978239cd1ec620d2 P 6c5f1932e9134824a0f7823dccf6273e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02f386f6c1ab419f8c7922092b04a1b0, 6c5f1932e9134824a0f7823dccf6273e; no voters: 
I20260709 13:07:38.586601 30192 raft_consensus.cc:2804] T 0242b20a350c42c9978239cd1ec620d2 P 6c5f1932e9134824a0f7823dccf6273e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:38.586906 29985 raft_consensus.cc:2468] T 0242b20a350c42c9978239cd1ec620d2 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5f1932e9134824a0f7823dccf6273e in term 2.
I20260709 13:07:38.586995 30192 raft_consensus.cc:697] T 0242b20a350c42c9978239cd1ec620d2 P 6c5f1932e9134824a0f7823dccf6273e [term 2 LEADER]: Becoming Leader. State: Replica: 6c5f1932e9134824a0f7823dccf6273e, State: Running, Role: LEADER
I20260709 13:07:38.587993 30192 consensus_queue.cc:237] T 0242b20a350c42c9978239cd1ec620d2 P 6c5f1932e9134824a0f7823dccf6273e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:38.596123 30212 consensus_queue.cc:1048] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:38.596992 29881 catalog_manager.cc:5697] T 0242b20a350c42c9978239cd1ec620d2 P 6c5f1932e9134824a0f7823dccf6273e reported cstate change: term changed from 1 to 2, leader changed from 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2) to 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3). New cstate: current_term: 2 leader_uuid: "6c5f1932e9134824a0f7823dccf6273e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:38.606822 30212 raft_consensus.cc:993] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629: : Instructing follower 02f386f6c1ab419f8c7922092b04a1b0 to start an election
I20260709 13:07:38.607273 30227 raft_consensus.cc:1081] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 1 LEADER]: Signalling peer 02f386f6c1ab419f8c7922092b04a1b0 to start an election
I20260709 13:07:38.608897 30060 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bdc7f4487d69425da272a9c59e5e3c54"
dest_uuid: "02f386f6c1ab419f8c7922092b04a1b0"
 from {username='slave'} at 127.0.0.1:38620
I20260709 13:07:38.609512 30060 raft_consensus.cc:493] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:38.609942 30060 raft_consensus.cc:3060] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.614956 30060 raft_consensus.cc:515] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:38.616755 30060 leader_election.cc:290] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0 [CANDIDATE]: Term 2 election: Requested vote from peers 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1:36133), 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3:43375)
I20260709 13:07:38.617364 29985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc7f4487d69425da272a9c59e5e3c54" candidate_uuid: "02f386f6c1ab419f8c7922092b04a1b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a1d35e9bdf14f44a53c9a1984d04629"
I20260709 13:07:38.617784 30133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc7f4487d69425da272a9c59e5e3c54" candidate_uuid: "02f386f6c1ab419f8c7922092b04a1b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6c5f1932e9134824a0f7823dccf6273e"
I20260709 13:07:38.617918 29985 raft_consensus.cc:3055] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:38.618336 30133 raft_consensus.cc:3060] T bdc7f4487d69425da272a9c59e5e3c54 P 6c5f1932e9134824a0f7823dccf6273e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.618335 29985 raft_consensus.cc:740] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a1d35e9bdf14f44a53c9a1984d04629, State: Running, Role: LEADER
I20260709 13:07:38.620468 29985 consensus_queue.cc:260] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:38.621639 29985 raft_consensus.cc:3060] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.624670 30133 raft_consensus.cc:2468] T bdc7f4487d69425da272a9c59e5e3c54 P 6c5f1932e9134824a0f7823dccf6273e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02f386f6c1ab419f8c7922092b04a1b0 in term 2.
I20260709 13:07:38.625785 30025 leader_election.cc:304] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02f386f6c1ab419f8c7922092b04a1b0, 6c5f1932e9134824a0f7823dccf6273e; no voters: 
I20260709 13:07:38.626596 30217 raft_consensus.cc:2804] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:38.627169 30217 raft_consensus.cc:697] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0 [term 2 LEADER]: Becoming Leader. State: Replica: 02f386f6c1ab419f8c7922092b04a1b0, State: Running, Role: LEADER
I20260709 13:07:38.627655 29985 raft_consensus.cc:2468] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02f386f6c1ab419f8c7922092b04a1b0 in term 2.
I20260709 13:07:38.627907 30217 consensus_queue.cc:237] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:38.633806 29881 catalog_manager.cc:5697] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0 reported cstate change: term changed from 1 to 2, leader changed from 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1) to 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2). New cstate: current_term: 2 leader_uuid: "02f386f6c1ab419f8c7922092b04a1b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:38.637267 30217 consensus_queue.cc:1048] T 22b91a84b0d244f987c2625faa04ecce P 02f386f6c1ab419f8c7922092b04a1b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:38.644802 30192 raft_consensus.cc:993] T 9398eeffa5504937973ba568bce7b4c2 P 6c5f1932e9134824a0f7823dccf6273e: : Instructing follower 4a1d35e9bdf14f44a53c9a1984d04629 to start an election
I20260709 13:07:38.645197 30192 raft_consensus.cc:1081] T 9398eeffa5504937973ba568bce7b4c2 P 6c5f1932e9134824a0f7823dccf6273e [term 1 LEADER]: Signalling peer 4a1d35e9bdf14f44a53c9a1984d04629 to start an election
I20260709 13:07:38.647035 29985 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9398eeffa5504937973ba568bce7b4c2"
dest_uuid: "4a1d35e9bdf14f44a53c9a1984d04629"
 from {username='slave'} at 127.0.0.1:38296
I20260709 13:07:38.647600 29985 raft_consensus.cc:493] T 9398eeffa5504937973ba568bce7b4c2 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:38.648016 29985 raft_consensus.cc:3060] T 9398eeffa5504937973ba568bce7b4c2 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.654577 30217 consensus_queue.cc:1048] T 22b91a84b0d244f987c2625faa04ecce P 02f386f6c1ab419f8c7922092b04a1b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:38.658017 29985 raft_consensus.cc:515] T 9398eeffa5504937973ba568bce7b4c2 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:38.660782 29985 leader_election.cc:290] T 9398eeffa5504937973ba568bce7b4c2 P 4a1d35e9bdf14f44a53c9a1984d04629 [CANDIDATE]: Term 2 election: Requested vote from peers 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2:44093), 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3:43375)
I20260709 13:07:38.660713 30060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9398eeffa5504937973ba568bce7b4c2" candidate_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "02f386f6c1ab419f8c7922092b04a1b0"
I20260709 13:07:38.661389 30060 raft_consensus.cc:3060] T 9398eeffa5504937973ba568bce7b4c2 P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.665899 30133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9398eeffa5504937973ba568bce7b4c2" candidate_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6c5f1932e9134824a0f7823dccf6273e"
I20260709 13:07:38.666468 30133 raft_consensus.cc:3055] T 9398eeffa5504937973ba568bce7b4c2 P 6c5f1932e9134824a0f7823dccf6273e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:38.666776 30133 raft_consensus.cc:740] T 9398eeffa5504937973ba568bce7b4c2 P 6c5f1932e9134824a0f7823dccf6273e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6c5f1932e9134824a0f7823dccf6273e, State: Running, Role: LEADER
I20260709 13:07:38.667554 30133 consensus_queue.cc:260] T 9398eeffa5504937973ba568bce7b4c2 P 6c5f1932e9134824a0f7823dccf6273e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:38.668756 30060 raft_consensus.cc:2468] T 9398eeffa5504937973ba568bce7b4c2 P 02f386f6c1ab419f8c7922092b04a1b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a1d35e9bdf14f44a53c9a1984d04629 in term 2.
I20260709 13:07:38.668764 30133 raft_consensus.cc:3060] T 9398eeffa5504937973ba568bce7b4c2 P 6c5f1932e9134824a0f7823dccf6273e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.669891 29948 leader_election.cc:304] T 9398eeffa5504937973ba568bce7b4c2 P 4a1d35e9bdf14f44a53c9a1984d04629 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02f386f6c1ab419f8c7922092b04a1b0, 4a1d35e9bdf14f44a53c9a1984d04629; no voters: 
I20260709 13:07:38.670635 30227 raft_consensus.cc:2804] T 9398eeffa5504937973ba568bce7b4c2 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:38.671046 30227 raft_consensus.cc:697] T 9398eeffa5504937973ba568bce7b4c2 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 2 LEADER]: Becoming Leader. State: Replica: 4a1d35e9bdf14f44a53c9a1984d04629, State: Running, Role: LEADER
I20260709 13:07:38.671742 30227 consensus_queue.cc:237] T 9398eeffa5504937973ba568bce7b4c2 P 4a1d35e9bdf14f44a53c9a1984d04629 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:38.674409 30217 consensus_queue.cc:1048] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 02f386f6c1ab419f8c7922092b04a1b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:38.678514 30133 raft_consensus.cc:2468] T 9398eeffa5504937973ba568bce7b4c2 P 6c5f1932e9134824a0f7823dccf6273e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a1d35e9bdf14f44a53c9a1984d04629 in term 2.
I20260709 13:07:38.681007 30218 raft_consensus.cc:993] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 02f386f6c1ab419f8c7922092b04a1b0: : Instructing follower 4a1d35e9bdf14f44a53c9a1984d04629 to start an election
I20260709 13:07:38.681463 30181 raft_consensus.cc:1081] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 LEADER]: Signalling peer 4a1d35e9bdf14f44a53c9a1984d04629 to start an election
I20260709 13:07:38.680764 29880 catalog_manager.cc:5697] T 9398eeffa5504937973ba568bce7b4c2 P 4a1d35e9bdf14f44a53c9a1984d04629 reported cstate change: term changed from 1 to 2, leader changed from 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3) to 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1). New cstate: current_term: 2 leader_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:38.683017 29985 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e48e4ede2b9419c805b7d9bcd1e2fb0"
dest_uuid: "4a1d35e9bdf14f44a53c9a1984d04629"
 from {username='slave'} at 127.0.0.1:38300
I20260709 13:07:38.685400 29985 raft_consensus.cc:493] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:38.685791 29985 raft_consensus.cc:3060] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.688295 30227 consensus_queue.cc:1048] T c218ddfeb78c4cfa98f71f681c807503 P 4a1d35e9bdf14f44a53c9a1984d04629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:38.690450 30181 consensus_queue.cc:1048] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 02f386f6c1ab419f8c7922092b04a1b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:38.698501 29985 raft_consensus.cc:515] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:38.704310 29985 leader_election.cc:290] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629 [CANDIDATE]: Term 2 election: Requested vote from peers 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2:44093), 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3:43375)
I20260709 13:07:38.706331 30134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e48e4ede2b9419c805b7d9bcd1e2fb0" candidate_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6c5f1932e9134824a0f7823dccf6273e"
I20260709 13:07:38.706779 30134 raft_consensus.cc:3060] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 6c5f1932e9134824a0f7823dccf6273e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.710665 30060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e48e4ede2b9419c805b7d9bcd1e2fb0" candidate_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "02f386f6c1ab419f8c7922092b04a1b0"
I20260709 13:07:38.710631 30227 consensus_queue.cc:1048] T c218ddfeb78c4cfa98f71f681c807503 P 4a1d35e9bdf14f44a53c9a1984d04629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:38.711417 30060 raft_consensus.cc:3055] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:38.711865 30060 raft_consensus.cc:740] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 02f386f6c1ab419f8c7922092b04a1b0, State: Running, Role: LEADER
I20260709 13:07:38.713244 30134 raft_consensus.cc:2468] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 6c5f1932e9134824a0f7823dccf6273e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a1d35e9bdf14f44a53c9a1984d04629 in term 2.
I20260709 13:07:38.712870 30060 consensus_queue.cc:260] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 02f386f6c1ab419f8c7922092b04a1b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:38.714834 29950 leader_election.cc:304] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a1d35e9bdf14f44a53c9a1984d04629, 6c5f1932e9134824a0f7823dccf6273e; no voters: 
I20260709 13:07:38.715080 30060 raft_consensus.cc:3060] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.716033 30227 raft_consensus.cc:2804] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:38.720254 30227 raft_consensus.cc:697] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 2 LEADER]: Becoming Leader. State: Replica: 4a1d35e9bdf14f44a53c9a1984d04629, State: Running, Role: LEADER
I20260709 13:07:38.721181 30227 consensus_queue.cc:237] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:38.722697 30060 raft_consensus.cc:2468] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 02f386f6c1ab419f8c7922092b04a1b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a1d35e9bdf14f44a53c9a1984d04629 in term 2.
I20260709 13:07:38.727931 29880 catalog_manager.cc:5697] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629 reported cstate change: term changed from 1 to 2, leader changed from 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2) to 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1). New cstate: current_term: 2 leader_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:38.909332 30081 debug-util.cc:398] Leaking SignalData structure 0x7b08001dcc60 after lost signal to thread 29367
W20260709 13:07:38.910251 30081 debug-util.cc:398] Leaking SignalData structure 0x7b08001e8ee0 after lost signal to thread 29917
I20260709 13:07:38.946242 30134 raft_consensus.cc:3060] T 8dfa5968812443d28f2c148c6768f51f P 6c5f1932e9134824a0f7823dccf6273e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.954388 30134 raft_consensus.cc:1275] T 8dfa5968812443d28f2c148c6768f51f P 6c5f1932e9134824a0f7823dccf6273e [term 2 FOLLOWER]: Refusing update from remote peer 4a1d35e9bdf14f44a53c9a1984d04629: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:38.955897 30227 consensus_queue.cc:1048] T 8dfa5968812443d28f2c148c6768f51f P 4a1d35e9bdf14f44a53c9a1984d04629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:38.969106 30060 raft_consensus.cc:1275] T 8dfa5968812443d28f2c148c6768f51f P 02f386f6c1ab419f8c7922092b04a1b0 [term 2 FOLLOWER]: Refusing update from remote peer 4a1d35e9bdf14f44a53c9a1984d04629: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:38.970875 30227 consensus_queue.cc:1048] T 8dfa5968812443d28f2c148c6768f51f P 4a1d35e9bdf14f44a53c9a1984d04629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:39.001025 30060 raft_consensus.cc:1275] T 0242b20a350c42c9978239cd1ec620d2 P 02f386f6c1ab419f8c7922092b04a1b0 [term 2 FOLLOWER]: Refusing update from remote peer 6c5f1932e9134824a0f7823dccf6273e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.002333 30225 consensus_queue.cc:1048] T 0242b20a350c42c9978239cd1ec620d2 P 6c5f1932e9134824a0f7823dccf6273e [LEADER]: Connected to new peer: Peer: permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:39.010602 29985 raft_consensus.cc:1275] T 0242b20a350c42c9978239cd1ec620d2 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 2 FOLLOWER]: Refusing update from remote peer 6c5f1932e9134824a0f7823dccf6273e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.013013 30200 consensus_queue.cc:1048] T 0242b20a350c42c9978239cd1ec620d2 P 6c5f1932e9134824a0f7823dccf6273e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:39.117475 30134 raft_consensus.cc:1275] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e [term 2 FOLLOWER]: Refusing update from remote peer 02f386f6c1ab419f8c7922092b04a1b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.117790 29985 raft_consensus.cc:1275] T c61e62ccbc434482b70daf1670495174 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 2 FOLLOWER]: Refusing update from remote peer 02f386f6c1ab419f8c7922092b04a1b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.118661 30181 consensus_queue.cc:1048] T c61e62ccbc434482b70daf1670495174 P 02f386f6c1ab419f8c7922092b04a1b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:39.119354 30218 consensus_queue.cc:1048] T c61e62ccbc434482b70daf1670495174 P 02f386f6c1ab419f8c7922092b04a1b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:39.141244 29983 raft_consensus.cc:1275] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 2 FOLLOWER]: Refusing update from remote peer 02f386f6c1ab419f8c7922092b04a1b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.143186 30181 consensus_queue.cc:1048] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:39.154376 30134 raft_consensus.cc:1275] T bdc7f4487d69425da272a9c59e5e3c54 P 6c5f1932e9134824a0f7823dccf6273e [term 2 FOLLOWER]: Refusing update from remote peer 02f386f6c1ab419f8c7922092b04a1b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.155630 30217 consensus_queue.cc:1048] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:39.194576 30060 raft_consensus.cc:1275] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 02f386f6c1ab419f8c7922092b04a1b0 [term 2 FOLLOWER]: Refusing update from remote peer 4a1d35e9bdf14f44a53c9a1984d04629: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.195845 30262 consensus_queue.cc:1048] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:39.203047 30134 raft_consensus.cc:1275] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 6c5f1932e9134824a0f7823dccf6273e [term 2 FOLLOWER]: Refusing update from remote peer 4a1d35e9bdf14f44a53c9a1984d04629: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.204725 30227 consensus_queue.cc:1048] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:39.238813 30060 raft_consensus.cc:1275] T 9398eeffa5504937973ba568bce7b4c2 P 02f386f6c1ab419f8c7922092b04a1b0 [term 2 FOLLOWER]: Refusing update from remote peer 4a1d35e9bdf14f44a53c9a1984d04629: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.240074 30262 consensus_queue.cc:1048] T 9398eeffa5504937973ba568bce7b4c2 P 4a1d35e9bdf14f44a53c9a1984d04629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:39.248351 30134 raft_consensus.cc:1275] T 9398eeffa5504937973ba568bce7b4c2 P 6c5f1932e9134824a0f7823dccf6273e [term 2 FOLLOWER]: Refusing update from remote peer 4a1d35e9bdf14f44a53c9a1984d04629: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.249943 30212 consensus_queue.cc:1048] T 9398eeffa5504937973ba568bce7b4c2 P 4a1d35e9bdf14f44a53c9a1984d04629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:41.507236 29364 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:07:41.508056 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:41.528829 29985 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2418e193a92a4d36a4149de5f38be171"
dest_uuid: "4a1d35e9bdf14f44a53c9a1984d04629"
mode: GRACEFUL
new_leader_uuid: "6c5f1932e9134824a0f7823dccf6273e"
 from {username='slave'} at 127.0.0.1:50094
I20260709 13:07:41.529476 29985 raft_consensus.cc:606] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 1 LEADER]: Received request to transfer leadership to TS 6c5f1932e9134824a0f7823dccf6273e
I20260709 13:07:41.531975 29985 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e48e4ede2b9419c805b7d9bcd1e2fb0"
dest_uuid: "4a1d35e9bdf14f44a53c9a1984d04629"
mode: GRACEFUL
new_leader_uuid: "6c5f1932e9134824a0f7823dccf6273e"
 from {username='slave'} at 127.0.0.1:50094
I20260709 13:07:41.532562 29985 raft_consensus.cc:606] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 2 LEADER]: Received request to transfer leadership to TS 6c5f1932e9134824a0f7823dccf6273e
I20260709 13:07:41.533684 29364 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:07:41.534265 29364 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:41.687666 30271 raft_consensus.cc:993] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629: : Instructing follower 6c5f1932e9134824a0f7823dccf6273e to start an election
I20260709 13:07:41.688242 30274 raft_consensus.cc:1081] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 1 LEADER]: Signalling peer 6c5f1932e9134824a0f7823dccf6273e to start an election
I20260709 13:07:41.689950 30134 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2418e193a92a4d36a4149de5f38be171"
dest_uuid: "6c5f1932e9134824a0f7823dccf6273e"
 from {username='slave'} at 127.0.0.1:58414
I20260709 13:07:41.690479 30134 raft_consensus.cc:493] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:41.690769 30134 raft_consensus.cc:3060] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:41.695536 30134 raft_consensus.cc:515] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:41.697261 30134 leader_election.cc:290] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e [CANDIDATE]: Term 2 election: Requested vote from peers 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1:36133), 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2:44093)
I20260709 13:07:41.698278 30059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2418e193a92a4d36a4149de5f38be171" candidate_uuid: "6c5f1932e9134824a0f7823dccf6273e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "02f386f6c1ab419f8c7922092b04a1b0"
I20260709 13:07:41.698472 29985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2418e193a92a4d36a4149de5f38be171" candidate_uuid: "6c5f1932e9134824a0f7823dccf6273e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a1d35e9bdf14f44a53c9a1984d04629"
I20260709 13:07:41.698911 30059 raft_consensus.cc:3060] T 2418e193a92a4d36a4149de5f38be171 P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:41.699142 29985 raft_consensus.cc:3055] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:41.699550 29985 raft_consensus.cc:740] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a1d35e9bdf14f44a53c9a1984d04629, State: Running, Role: LEADER
I20260709 13:07:41.700440 29985 consensus_queue.cc:260] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:41.701788 29985 raft_consensus.cc:3060] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:41.704169 30059 raft_consensus.cc:2468] T 2418e193a92a4d36a4149de5f38be171 P 02f386f6c1ab419f8c7922092b04a1b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5f1932e9134824a0f7823dccf6273e in term 2.
I20260709 13:07:41.705341 30097 leader_election.cc:304] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02f386f6c1ab419f8c7922092b04a1b0, 6c5f1932e9134824a0f7823dccf6273e; no voters: 
I20260709 13:07:41.706172 30268 raft_consensus.cc:2804] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:41.710007 29985 raft_consensus.cc:2468] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5f1932e9134824a0f7823dccf6273e in term 2.
I20260709 13:07:41.716861 30268 raft_consensus.cc:697] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e [term 2 LEADER]: Becoming Leader. State: Replica: 6c5f1932e9134824a0f7823dccf6273e, State: Running, Role: LEADER
I20260709 13:07:41.717795 30274 raft_consensus.cc:993] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629: : Instructing follower 6c5f1932e9134824a0f7823dccf6273e to start an election
I20260709 13:07:41.718369 30275 raft_consensus.cc:1081] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 2 LEADER]: Signalling peer 6c5f1932e9134824a0f7823dccf6273e to start an election
I20260709 13:07:41.717893 30268 consensus_queue.cc:237] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:41.720341 30134 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e48e4ede2b9419c805b7d9bcd1e2fb0"
dest_uuid: "6c5f1932e9134824a0f7823dccf6273e"
 from {username='slave'} at 127.0.0.1:58414
I20260709 13:07:41.721112 30134 raft_consensus.cc:493] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 6c5f1932e9134824a0f7823dccf6273e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:41.721593 30134 raft_consensus.cc:3060] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 6c5f1932e9134824a0f7823dccf6273e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:41.725943 29880 catalog_manager.cc:5697] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e reported cstate change: term changed from 1 to 2, leader changed from 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1) to 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3). New cstate: current_term: 2 leader_uuid: "6c5f1932e9134824a0f7823dccf6273e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:41.729313 30134 raft_consensus.cc:515] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 6c5f1932e9134824a0f7823dccf6273e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:41.731683 30134 leader_election.cc:290] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 6c5f1932e9134824a0f7823dccf6273e [CANDIDATE]: Term 3 election: Requested vote from peers 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1:36133), 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2:44093)
I20260709 13:07:41.732702 29985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e48e4ede2b9419c805b7d9bcd1e2fb0" candidate_uuid: "6c5f1932e9134824a0f7823dccf6273e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4a1d35e9bdf14f44a53c9a1984d04629"
I20260709 13:07:41.733309 29985 raft_consensus.cc:3055] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:41.733619 29985 raft_consensus.cc:740] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4a1d35e9bdf14f44a53c9a1984d04629, State: Running, Role: LEADER
I20260709 13:07:41.733762 30059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e48e4ede2b9419c805b7d9bcd1e2fb0" candidate_uuid: "6c5f1932e9134824a0f7823dccf6273e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "02f386f6c1ab419f8c7922092b04a1b0"
I20260709 13:07:41.734529 30059 raft_consensus.cc:3060] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 02f386f6c1ab419f8c7922092b04a1b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:41.734452 29985 consensus_queue.cc:260] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:41.735630 29985 raft_consensus.cc:3060] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:41.743288 29985 raft_consensus.cc:2468] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5f1932e9134824a0f7823dccf6273e in term 3.
I20260709 13:07:41.744484 30059 raft_consensus.cc:2468] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 02f386f6c1ab419f8c7922092b04a1b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5f1932e9134824a0f7823dccf6273e in term 3.
I20260709 13:07:41.745648 30097 leader_election.cc:304] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 6c5f1932e9134824a0f7823dccf6273e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a1d35e9bdf14f44a53c9a1984d04629, 6c5f1932e9134824a0f7823dccf6273e; no voters: 
I20260709 13:07:41.747666 30268 raft_consensus.cc:2804] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 6c5f1932e9134824a0f7823dccf6273e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:41.748167 30268 raft_consensus.cc:697] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 6c5f1932e9134824a0f7823dccf6273e [term 3 LEADER]: Becoming Leader. State: Replica: 6c5f1932e9134824a0f7823dccf6273e, State: Running, Role: LEADER
I20260709 13:07:41.748974 30268 consensus_queue.cc:237] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 6c5f1932e9134824a0f7823dccf6273e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:41.757324 29880 catalog_manager.cc:5697] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 6c5f1932e9134824a0f7823dccf6273e reported cstate change: term changed from 2 to 3, leader changed from 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1) to 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3). New cstate: current_term: 3 leader_uuid: "6c5f1932e9134824a0f7823dccf6273e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:42.113085 30059 raft_consensus.cc:1275] T 2418e193a92a4d36a4149de5f38be171 P 02f386f6c1ab419f8c7922092b04a1b0 [term 2 FOLLOWER]: Refusing update from remote peer 6c5f1932e9134824a0f7823dccf6273e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:42.114399 30268 consensus_queue.cc:1048] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e [LEADER]: Connected to new peer: Peer: permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:42.143915 29985 raft_consensus.cc:1275] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 2 FOLLOWER]: Refusing update from remote peer 6c5f1932e9134824a0f7823dccf6273e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:42.145349 30276 consensus_queue.cc:1048] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:42.193871 30059 raft_consensus.cc:1275] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 02f386f6c1ab419f8c7922092b04a1b0 [term 3 FOLLOWER]: Refusing update from remote peer 6c5f1932e9134824a0f7823dccf6273e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:42.195109 30276 consensus_queue.cc:1048] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 6c5f1932e9134824a0f7823dccf6273e [LEADER]: Connected to new peer: Peer: permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:42.205879 29985 raft_consensus.cc:1275] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 3 FOLLOWER]: Refusing update from remote peer 6c5f1932e9134824a0f7823dccf6273e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:42.207762 30290 consensus_queue.cc:1048] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 6c5f1932e9134824a0f7823dccf6273e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:07:42.535044 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:42.546960 30134 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2418e193a92a4d36a4149de5f38be171"
dest_uuid: "6c5f1932e9134824a0f7823dccf6273e"
mode: GRACEFUL
new_leader_uuid: "4a1d35e9bdf14f44a53c9a1984d04629"
 from {username='slave'} at 127.0.0.1:58436
I20260709 13:07:42.547501 30134 raft_consensus.cc:606] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e [term 2 LEADER]: Received request to transfer leadership to TS 4a1d35e9bdf14f44a53c9a1984d04629
I20260709 13:07:42.553818 30134 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e48e4ede2b9419c805b7d9bcd1e2fb0"
dest_uuid: "6c5f1932e9134824a0f7823dccf6273e"
mode: GRACEFUL
new_leader_uuid: "4a1d35e9bdf14f44a53c9a1984d04629"
 from {username='slave'} at 127.0.0.1:58436
I20260709 13:07:42.554234 30134 raft_consensus.cc:606] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 6c5f1932e9134824a0f7823dccf6273e [term 3 LEADER]: Received request to transfer leadership to TS 4a1d35e9bdf14f44a53c9a1984d04629
I20260709 13:07:42.560514 30059 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c61e62ccbc434482b70daf1670495174"
dest_uuid: "02f386f6c1ab419f8c7922092b04a1b0"
mode: GRACEFUL
new_leader_uuid: "4a1d35e9bdf14f44a53c9a1984d04629"
 from {username='slave'} at 127.0.0.1:38626
I20260709 13:07:42.560984 30059 raft_consensus.cc:606] T c61e62ccbc434482b70daf1670495174 P 02f386f6c1ab419f8c7922092b04a1b0 [term 2 LEADER]: Received request to transfer leadership to TS 4a1d35e9bdf14f44a53c9a1984d04629
I20260709 13:07:42.565452 30059 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22b91a84b0d244f987c2625faa04ecce"
dest_uuid: "02f386f6c1ab419f8c7922092b04a1b0"
mode: GRACEFUL
new_leader_uuid: "4a1d35e9bdf14f44a53c9a1984d04629"
 from {username='slave'} at 127.0.0.1:38626
I20260709 13:07:42.565917 30059 raft_consensus.cc:606] T 22b91a84b0d244f987c2625faa04ecce P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 LEADER]: Received request to transfer leadership to TS 4a1d35e9bdf14f44a53c9a1984d04629
I20260709 13:07:42.570012 30059 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bdc7f4487d69425da272a9c59e5e3c54"
dest_uuid: "02f386f6c1ab419f8c7922092b04a1b0"
mode: GRACEFUL
new_leader_uuid: "4a1d35e9bdf14f44a53c9a1984d04629"
 from {username='slave'} at 127.0.0.1:38626
I20260709 13:07:42.570475 30059 raft_consensus.cc:606] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0 [term 2 LEADER]: Received request to transfer leadership to TS 4a1d35e9bdf14f44a53c9a1984d04629
I20260709 13:07:42.589802 30276 raft_consensus.cc:993] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 6c5f1932e9134824a0f7823dccf6273e: : Instructing follower 4a1d35e9bdf14f44a53c9a1984d04629 to start an election
I20260709 13:07:42.590334 30290 raft_consensus.cc:1081] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 6c5f1932e9134824a0f7823dccf6273e [term 3 LEADER]: Signalling peer 4a1d35e9bdf14f44a53c9a1984d04629 to start an election
I20260709 13:07:42.591791 29985 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e48e4ede2b9419c805b7d9bcd1e2fb0"
dest_uuid: "4a1d35e9bdf14f44a53c9a1984d04629"
 from {username='slave'} at 127.0.0.1:38296
I20260709 13:07:42.592301 29985 raft_consensus.cc:493] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:42.592628 29985 raft_consensus.cc:3060] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:42.597132 29985 raft_consensus.cc:515] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:42.598578 29985 leader_election.cc:290] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629 [CANDIDATE]: Term 4 election: Requested vote from peers 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2:44093), 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3:43375)
I20260709 13:07:42.599278 30059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e48e4ede2b9419c805b7d9bcd1e2fb0" candidate_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "02f386f6c1ab419f8c7922092b04a1b0"
I20260709 13:07:42.599514 30134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e48e4ede2b9419c805b7d9bcd1e2fb0" candidate_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6c5f1932e9134824a0f7823dccf6273e"
I20260709 13:07:42.599782 30059 raft_consensus.cc:3060] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 02f386f6c1ab419f8c7922092b04a1b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:42.600050 30134 raft_consensus.cc:3055] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 6c5f1932e9134824a0f7823dccf6273e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:42.600361 30134 raft_consensus.cc:740] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 6c5f1932e9134824a0f7823dccf6273e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6c5f1932e9134824a0f7823dccf6273e, State: Running, Role: LEADER
I20260709 13:07:42.600991 30134 consensus_queue.cc:260] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 6c5f1932e9134824a0f7823dccf6273e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:42.601764 30134 raft_consensus.cc:3060] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 6c5f1932e9134824a0f7823dccf6273e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:42.604249 30059 raft_consensus.cc:2468] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 02f386f6c1ab419f8c7922092b04a1b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a1d35e9bdf14f44a53c9a1984d04629 in term 4.
I20260709 13:07:42.605154 29948 leader_election.cc:304] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02f386f6c1ab419f8c7922092b04a1b0, 4a1d35e9bdf14f44a53c9a1984d04629; no voters: 
I20260709 13:07:42.605758 30134 raft_consensus.cc:2468] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 6c5f1932e9134824a0f7823dccf6273e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a1d35e9bdf14f44a53c9a1984d04629 in term 4.
I20260709 13:07:42.605883 30275 raft_consensus.cc:2804] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:42.606854 30275 raft_consensus.cc:697] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 4 LEADER]: Becoming Leader. State: Replica: 4a1d35e9bdf14f44a53c9a1984d04629, State: Running, Role: LEADER
I20260709 13:07:42.607575 30275 consensus_queue.cc:237] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:42.613502 29880 catalog_manager.cc:5697] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629 reported cstate change: term changed from 3 to 4, leader changed from 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3) to 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1). New cstate: current_term: 4 leader_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:42.678730 30268 raft_consensus.cc:993] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e: : Instructing follower 4a1d35e9bdf14f44a53c9a1984d04629 to start an election
I20260709 13:07:42.679179 30276 raft_consensus.cc:1081] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e [term 2 LEADER]: Signalling peer 4a1d35e9bdf14f44a53c9a1984d04629 to start an election
I20260709 13:07:42.680550 29985 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2418e193a92a4d36a4149de5f38be171"
dest_uuid: "4a1d35e9bdf14f44a53c9a1984d04629"
 from {username='slave'} at 127.0.0.1:38296
I20260709 13:07:42.681061 29985 raft_consensus.cc:493] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:42.681336 29985 raft_consensus.cc:3060] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:42.685326 29985 raft_consensus.cc:515] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:42.686657 29985 leader_election.cc:290] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [CANDIDATE]: Term 3 election: Requested vote from peers 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2:44093), 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3:43375)
I20260709 13:07:42.687469 30059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2418e193a92a4d36a4149de5f38be171" candidate_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "02f386f6c1ab419f8c7922092b04a1b0"
I20260709 13:07:42.687728 30134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2418e193a92a4d36a4149de5f38be171" candidate_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6c5f1932e9134824a0f7823dccf6273e"
I20260709 13:07:42.688060 30059 raft_consensus.cc:3060] T 2418e193a92a4d36a4149de5f38be171 P 02f386f6c1ab419f8c7922092b04a1b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:42.688304 30134 raft_consensus.cc:3055] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:42.688635 30134 raft_consensus.cc:740] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6c5f1932e9134824a0f7823dccf6273e, State: Running, Role: LEADER
I20260709 13:07:42.689277 30134 consensus_queue.cc:260] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:42.690078 30134 raft_consensus.cc:3060] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:42.692617 30059 raft_consensus.cc:2468] T 2418e193a92a4d36a4149de5f38be171 P 02f386f6c1ab419f8c7922092b04a1b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a1d35e9bdf14f44a53c9a1984d04629 in term 3.
I20260709 13:07:42.693508 29948 leader_election.cc:304] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02f386f6c1ab419f8c7922092b04a1b0, 4a1d35e9bdf14f44a53c9a1984d04629; no voters: 
I20260709 13:07:42.694213 30275 raft_consensus.cc:2804] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:42.694322 30134 raft_consensus.cc:2468] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a1d35e9bdf14f44a53c9a1984d04629 in term 3.
I20260709 13:07:42.694605 30275 raft_consensus.cc:697] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 3 LEADER]: Becoming Leader. State: Replica: 4a1d35e9bdf14f44a53c9a1984d04629, State: Running, Role: LEADER
I20260709 13:07:42.695379 30275 consensus_queue.cc:237] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:42.700763 29880 catalog_manager.cc:5697] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 reported cstate change: term changed from 2 to 3, leader changed from 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3) to 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1). New cstate: current_term: 3 leader_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:42.719213 30283 raft_consensus.cc:993] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0: : Instructing follower 4a1d35e9bdf14f44a53c9a1984d04629 to start an election
I20260709 13:07:42.719525 30283 raft_consensus.cc:1081] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0 [term 2 LEADER]: Signalling peer 4a1d35e9bdf14f44a53c9a1984d04629 to start an election
I20260709 13:07:42.720873 29985 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bdc7f4487d69425da272a9c59e5e3c54"
dest_uuid: "4a1d35e9bdf14f44a53c9a1984d04629"
 from {username='slave'} at 127.0.0.1:38300
I20260709 13:07:42.721302 29985 raft_consensus.cc:493] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:42.721570 29985 raft_consensus.cc:3060] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:42.725518 29985 raft_consensus.cc:515] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:42.727489 29985 leader_election.cc:290] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [CANDIDATE]: Term 3 election: Requested vote from peers 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2:44093), 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3:43375)
I20260709 13:07:42.727778 30059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc7f4487d69425da272a9c59e5e3c54" candidate_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "02f386f6c1ab419f8c7922092b04a1b0"
I20260709 13:07:42.728327 30134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc7f4487d69425da272a9c59e5e3c54" candidate_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6c5f1932e9134824a0f7823dccf6273e"
I20260709 13:07:42.728406 30059 raft_consensus.cc:3055] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:42.728806 30059 raft_consensus.cc:740] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 02f386f6c1ab419f8c7922092b04a1b0, State: Running, Role: LEADER
I20260709 13:07:42.728856 30134 raft_consensus.cc:3060] T bdc7f4487d69425da272a9c59e5e3c54 P 6c5f1932e9134824a0f7823dccf6273e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:42.729528 30059 consensus_queue.cc:260] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:42.730394 30059 raft_consensus.cc:3060] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:42.733177 30134 raft_consensus.cc:2468] T bdc7f4487d69425da272a9c59e5e3c54 P 6c5f1932e9134824a0f7823dccf6273e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a1d35e9bdf14f44a53c9a1984d04629 in term 3.
I20260709 13:07:42.734074 29950 leader_election.cc:304] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a1d35e9bdf14f44a53c9a1984d04629, 6c5f1932e9134824a0f7823dccf6273e; no voters: 
I20260709 13:07:42.734851 30275 raft_consensus.cc:2804] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:42.735256 30275 raft_consensus.cc:697] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 3 LEADER]: Becoming Leader. State: Replica: 4a1d35e9bdf14f44a53c9a1984d04629, State: Running, Role: LEADER
I20260709 13:07:42.735920 30059 raft_consensus.cc:2468] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a1d35e9bdf14f44a53c9a1984d04629 in term 3.
I20260709 13:07:42.735978 30275 consensus_queue.cc:237] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:42.742295 29880 catalog_manager.cc:5697] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 reported cstate change: term changed from 2 to 3, leader changed from 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2) to 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1). New cstate: current_term: 3 leader_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:42.975687 30296 raft_consensus.cc:993] T c61e62ccbc434482b70daf1670495174 P 02f386f6c1ab419f8c7922092b04a1b0: : Instructing follower 4a1d35e9bdf14f44a53c9a1984d04629 to start an election
I20260709 13:07:42.976250 30296 raft_consensus.cc:1081] T c61e62ccbc434482b70daf1670495174 P 02f386f6c1ab419f8c7922092b04a1b0 [term 2 LEADER]: Signalling peer 4a1d35e9bdf14f44a53c9a1984d04629 to start an election
I20260709 13:07:42.977614 29985 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c61e62ccbc434482b70daf1670495174"
dest_uuid: "4a1d35e9bdf14f44a53c9a1984d04629"
 from {username='slave'} at 127.0.0.1:38300
I20260709 13:07:42.978065 29985 raft_consensus.cc:493] T c61e62ccbc434482b70daf1670495174 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:42.978379 29985 raft_consensus.cc:3060] T c61e62ccbc434482b70daf1670495174 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:42.982674 29985 raft_consensus.cc:515] T c61e62ccbc434482b70daf1670495174 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:42.983964 29985 leader_election.cc:290] T c61e62ccbc434482b70daf1670495174 P 4a1d35e9bdf14f44a53c9a1984d04629 [CANDIDATE]: Term 3 election: Requested vote from peers 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2:44093), 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3:43375)
I20260709 13:07:42.984741 30059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e62ccbc434482b70daf1670495174" candidate_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "02f386f6c1ab419f8c7922092b04a1b0"
I20260709 13:07:42.984999 30133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e62ccbc434482b70daf1670495174" candidate_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6c5f1932e9134824a0f7823dccf6273e"
I20260709 13:07:42.985266 30059 raft_consensus.cc:3055] T c61e62ccbc434482b70daf1670495174 P 02f386f6c1ab419f8c7922092b04a1b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:42.985497 30133 raft_consensus.cc:3060] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:42.985661 30059 raft_consensus.cc:740] T c61e62ccbc434482b70daf1670495174 P 02f386f6c1ab419f8c7922092b04a1b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 02f386f6c1ab419f8c7922092b04a1b0, State: Running, Role: LEADER
I20260709 13:07:42.986378 30059 consensus_queue.cc:260] T c61e62ccbc434482b70daf1670495174 P 02f386f6c1ab419f8c7922092b04a1b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:42.987241 30059 raft_consensus.cc:3060] T c61e62ccbc434482b70daf1670495174 P 02f386f6c1ab419f8c7922092b04a1b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:42.990084 30133 raft_consensus.cc:2468] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a1d35e9bdf14f44a53c9a1984d04629 in term 3.
I20260709 13:07:42.990985 29950 leader_election.cc:304] T c61e62ccbc434482b70daf1670495174 P 4a1d35e9bdf14f44a53c9a1984d04629 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a1d35e9bdf14f44a53c9a1984d04629, 6c5f1932e9134824a0f7823dccf6273e; no voters: 
I20260709 13:07:42.991647 30275 raft_consensus.cc:2804] T c61e62ccbc434482b70daf1670495174 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:42.991736 30059 raft_consensus.cc:2468] T c61e62ccbc434482b70daf1670495174 P 02f386f6c1ab419f8c7922092b04a1b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a1d35e9bdf14f44a53c9a1984d04629 in term 3.
I20260709 13:07:42.992101 30275 raft_consensus.cc:697] T c61e62ccbc434482b70daf1670495174 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 3 LEADER]: Becoming Leader. State: Replica: 4a1d35e9bdf14f44a53c9a1984d04629, State: Running, Role: LEADER
I20260709 13:07:42.992926 30275 consensus_queue.cc:237] T c61e62ccbc434482b70daf1670495174 P 4a1d35e9bdf14f44a53c9a1984d04629 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:42.999053 29880 catalog_manager.cc:5697] T c61e62ccbc434482b70daf1670495174 P 4a1d35e9bdf14f44a53c9a1984d04629 reported cstate change: term changed from 2 to 3, leader changed from 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2) to 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1). New cstate: current_term: 3 leader_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:43.168869 30059 raft_consensus.cc:1275] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0 [term 3 FOLLOWER]: Refusing update from remote peer 4a1d35e9bdf14f44a53c9a1984d04629: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:43.169931 30275 consensus_queue.cc:1048] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:43.175988 30283 raft_consensus.cc:993] T 22b91a84b0d244f987c2625faa04ecce P 02f386f6c1ab419f8c7922092b04a1b0: : Instructing follower 4a1d35e9bdf14f44a53c9a1984d04629 to start an election
I20260709 13:07:43.176434 30283 raft_consensus.cc:1081] T 22b91a84b0d244f987c2625faa04ecce P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 LEADER]: Signalling peer 4a1d35e9bdf14f44a53c9a1984d04629 to start an election
I20260709 13:07:43.178112 29985 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22b91a84b0d244f987c2625faa04ecce"
dest_uuid: "4a1d35e9bdf14f44a53c9a1984d04629"
 from {username='slave'} at 127.0.0.1:38300
I20260709 13:07:43.178647 29985 raft_consensus.cc:493] T 22b91a84b0d244f987c2625faa04ecce P 4a1d35e9bdf14f44a53c9a1984d04629 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:43.178990 29985 raft_consensus.cc:3060] T 22b91a84b0d244f987c2625faa04ecce P 4a1d35e9bdf14f44a53c9a1984d04629 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:43.181434 30133 raft_consensus.cc:1275] T bdc7f4487d69425da272a9c59e5e3c54 P 6c5f1932e9134824a0f7823dccf6273e [term 3 FOLLOWER]: Refusing update from remote peer 4a1d35e9bdf14f44a53c9a1984d04629: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:43.183144 30292 consensus_queue.cc:1048] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:43.185613 29985 raft_consensus.cc:515] T 22b91a84b0d244f987c2625faa04ecce P 4a1d35e9bdf14f44a53c9a1984d04629 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:43.188146 29985 leader_election.cc:290] T 22b91a84b0d244f987c2625faa04ecce P 4a1d35e9bdf14f44a53c9a1984d04629 [CANDIDATE]: Term 2 election: Requested vote from peers 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2:44093), 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3:43375)
I20260709 13:07:43.189070 30059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b91a84b0d244f987c2625faa04ecce" candidate_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "02f386f6c1ab419f8c7922092b04a1b0"
I20260709 13:07:43.189615 30059 raft_consensus.cc:3055] T 22b91a84b0d244f987c2625faa04ecce P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:43.190024 30059 raft_consensus.cc:740] T 22b91a84b0d244f987c2625faa04ecce P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 02f386f6c1ab419f8c7922092b04a1b0, State: Running, Role: LEADER
I20260709 13:07:43.190754 30134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b91a84b0d244f987c2625faa04ecce" candidate_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6c5f1932e9134824a0f7823dccf6273e"
I20260709 13:07:43.191344 30134 raft_consensus.cc:3060] T 22b91a84b0d244f987c2625faa04ecce P 6c5f1932e9134824a0f7823dccf6273e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:43.190948 30059 consensus_queue.cc:260] T 22b91a84b0d244f987c2625faa04ecce P 02f386f6c1ab419f8c7922092b04a1b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:43.192474 30059 raft_consensus.cc:3060] T 22b91a84b0d244f987c2625faa04ecce P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:43.197599 30134 raft_consensus.cc:2468] T 22b91a84b0d244f987c2625faa04ecce P 6c5f1932e9134824a0f7823dccf6273e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a1d35e9bdf14f44a53c9a1984d04629 in term 2.
I20260709 13:07:43.198571 29950 leader_election.cc:304] T 22b91a84b0d244f987c2625faa04ecce P 4a1d35e9bdf14f44a53c9a1984d04629 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a1d35e9bdf14f44a53c9a1984d04629, 6c5f1932e9134824a0f7823dccf6273e; no voters: 
I20260709 13:07:43.199368 30302 raft_consensus.cc:2804] T 22b91a84b0d244f987c2625faa04ecce P 4a1d35e9bdf14f44a53c9a1984d04629 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:43.199425 30132 raft_consensus.cc:1275] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 6c5f1932e9134824a0f7823dccf6273e [term 4 FOLLOWER]: Refusing update from remote peer 4a1d35e9bdf14f44a53c9a1984d04629: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:43.199918 30302 raft_consensus.cc:697] T 22b91a84b0d244f987c2625faa04ecce P 4a1d35e9bdf14f44a53c9a1984d04629 [term 2 LEADER]: Becoming Leader. State: Replica: 4a1d35e9bdf14f44a53c9a1984d04629, State: Running, Role: LEADER
I20260709 13:07:43.200757 30302 consensus_queue.cc:237] T 22b91a84b0d244f987c2625faa04ecce P 4a1d35e9bdf14f44a53c9a1984d04629 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:43.201150 30292 consensus_queue.cc:1048] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:43.201539 30059 raft_consensus.cc:2468] T 22b91a84b0d244f987c2625faa04ecce P 02f386f6c1ab419f8c7922092b04a1b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a1d35e9bdf14f44a53c9a1984d04629 in term 2.
I20260709 13:07:43.206674 30059 raft_consensus.cc:1275] T 2418e193a92a4d36a4149de5f38be171 P 02f386f6c1ab419f8c7922092b04a1b0 [term 3 FOLLOWER]: Refusing update from remote peer 4a1d35e9bdf14f44a53c9a1984d04629: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:43.207825 30292 consensus_queue.cc:1048] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:43.214118 29880 catalog_manager.cc:5697] T 22b91a84b0d244f987c2625faa04ecce P 4a1d35e9bdf14f44a53c9a1984d04629 reported cstate change: term changed from 1 to 2, leader changed from 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2) to 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1). New cstate: current_term: 2 leader_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:43.216693 30059 raft_consensus.cc:1275] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 02f386f6c1ab419f8c7922092b04a1b0 [term 4 FOLLOWER]: Refusing update from remote peer 4a1d35e9bdf14f44a53c9a1984d04629: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:43.234071 30133 raft_consensus.cc:1275] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e [term 3 FOLLOWER]: Refusing update from remote peer 4a1d35e9bdf14f44a53c9a1984d04629: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:43.241636 30311 consensus_queue.cc:1048] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:43.243559 30292 consensus_queue.cc:1048] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:43.402236 30134 raft_consensus.cc:1275] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e [term 3 FOLLOWER]: Refusing update from remote peer 4a1d35e9bdf14f44a53c9a1984d04629: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:43.403352 30275 consensus_queue.cc:1048] T c61e62ccbc434482b70daf1670495174 P 4a1d35e9bdf14f44a53c9a1984d04629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:43.411998 30059 raft_consensus.cc:1275] T c61e62ccbc434482b70daf1670495174 P 02f386f6c1ab419f8c7922092b04a1b0 [term 3 FOLLOWER]: Refusing update from remote peer 4a1d35e9bdf14f44a53c9a1984d04629: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:43.413852 30310 consensus_queue.cc:1048] T c61e62ccbc434482b70daf1670495174 P 4a1d35e9bdf14f44a53c9a1984d04629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:43.634367 30059 raft_consensus.cc:1275] T 22b91a84b0d244f987c2625faa04ecce P 02f386f6c1ab419f8c7922092b04a1b0 [term 2 FOLLOWER]: Refusing update from remote peer 4a1d35e9bdf14f44a53c9a1984d04629: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:43.635452 30275 consensus_queue.cc:1048] T 22b91a84b0d244f987c2625faa04ecce P 4a1d35e9bdf14f44a53c9a1984d04629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:43.644141 30134 raft_consensus.cc:1275] T 22b91a84b0d244f987c2625faa04ecce P 6c5f1932e9134824a0f7823dccf6273e [term 2 FOLLOWER]: Refusing update from remote peer 4a1d35e9bdf14f44a53c9a1984d04629: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:43.645727 30275 consensus_queue.cc:1048] T 22b91a84b0d244f987c2625faa04ecce P 4a1d35e9bdf14f44a53c9a1984d04629 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:45.577086 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:45.584699 29983 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2418e193a92a4d36a4149de5f38be171"
dest_uuid: "4a1d35e9bdf14f44a53c9a1984d04629"
mode: GRACEFUL
new_leader_uuid: "6c5f1932e9134824a0f7823dccf6273e"
 from {username='slave'} at 127.0.0.1:50094
I20260709 13:07:45.585420 29983 raft_consensus.cc:606] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 3 LEADER]: Received request to transfer leadership to TS 6c5f1932e9134824a0f7823dccf6273e
I20260709 13:07:45.587893 29983 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9398eeffa5504937973ba568bce7b4c2"
dest_uuid: "4a1d35e9bdf14f44a53c9a1984d04629"
mode: GRACEFUL
new_leader_uuid: "02f386f6c1ab419f8c7922092b04a1b0"
 from {username='slave'} at 127.0.0.1:50094
I20260709 13:07:45.588369 29983 raft_consensus.cc:606] T 9398eeffa5504937973ba568bce7b4c2 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 2 LEADER]: Received request to transfer leadership to TS 02f386f6c1ab419f8c7922092b04a1b0
I20260709 13:07:45.590497 29983 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bdc7f4487d69425da272a9c59e5e3c54"
dest_uuid: "4a1d35e9bdf14f44a53c9a1984d04629"
mode: GRACEFUL
new_leader_uuid: "02f386f6c1ab419f8c7922092b04a1b0"
 from {username='slave'} at 127.0.0.1:50094
I20260709 13:07:45.590927 29983 raft_consensus.cc:606] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 3 LEADER]: Received request to transfer leadership to TS 02f386f6c1ab419f8c7922092b04a1b0
I20260709 13:07:45.592953 29983 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c61e62ccbc434482b70daf1670495174"
dest_uuid: "4a1d35e9bdf14f44a53c9a1984d04629"
mode: GRACEFUL
new_leader_uuid: "6c5f1932e9134824a0f7823dccf6273e"
 from {username='slave'} at 127.0.0.1:50094
I20260709 13:07:45.593428 29983 raft_consensus.cc:606] T c61e62ccbc434482b70daf1670495174 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 3 LEADER]: Received request to transfer leadership to TS 6c5f1932e9134824a0f7823dccf6273e
I20260709 13:07:45.594475 29364 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:07:45.594888 29364 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:45.636677 30275 raft_consensus.cc:993] T 9398eeffa5504937973ba568bce7b4c2 P 4a1d35e9bdf14f44a53c9a1984d04629: : Instructing follower 02f386f6c1ab419f8c7922092b04a1b0 to start an election
I20260709 13:07:45.637223 30320 raft_consensus.cc:1081] T 9398eeffa5504937973ba568bce7b4c2 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 2 LEADER]: Signalling peer 02f386f6c1ab419f8c7922092b04a1b0 to start an election
I20260709 13:07:45.638652 30058 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9398eeffa5504937973ba568bce7b4c2"
dest_uuid: "02f386f6c1ab419f8c7922092b04a1b0"
 from {username='slave'} at 127.0.0.1:38620
I20260709 13:07:45.639122 30058 raft_consensus.cc:493] T 9398eeffa5504937973ba568bce7b4c2 P 02f386f6c1ab419f8c7922092b04a1b0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:45.639446 30058 raft_consensus.cc:3060] T 9398eeffa5504937973ba568bce7b4c2 P 02f386f6c1ab419f8c7922092b04a1b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:45.644650 30058 raft_consensus.cc:515] T 9398eeffa5504937973ba568bce7b4c2 P 02f386f6c1ab419f8c7922092b04a1b0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:45.646347 30058 leader_election.cc:290] T 9398eeffa5504937973ba568bce7b4c2 P 02f386f6c1ab419f8c7922092b04a1b0 [CANDIDATE]: Term 3 election: Requested vote from peers 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1:36133), 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3:43375)
I20260709 13:07:45.647188 29983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9398eeffa5504937973ba568bce7b4c2" candidate_uuid: "02f386f6c1ab419f8c7922092b04a1b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4a1d35e9bdf14f44a53c9a1984d04629"
I20260709 13:07:45.647442 30134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9398eeffa5504937973ba568bce7b4c2" candidate_uuid: "02f386f6c1ab419f8c7922092b04a1b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6c5f1932e9134824a0f7823dccf6273e"
I20260709 13:07:45.648069 30134 raft_consensus.cc:3060] T 9398eeffa5504937973ba568bce7b4c2 P 6c5f1932e9134824a0f7823dccf6273e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:45.648042 29983 raft_consensus.cc:3055] T 9398eeffa5504937973ba568bce7b4c2 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:45.648583 29983 raft_consensus.cc:740] T 9398eeffa5504937973ba568bce7b4c2 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4a1d35e9bdf14f44a53c9a1984d04629, State: Running, Role: LEADER
I20260709 13:07:45.649477 29983 consensus_queue.cc:260] T 9398eeffa5504937973ba568bce7b4c2 P 4a1d35e9bdf14f44a53c9a1984d04629 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:45.650866 29983 raft_consensus.cc:3060] T 9398eeffa5504937973ba568bce7b4c2 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:45.654896 30134 raft_consensus.cc:2468] T 9398eeffa5504937973ba568bce7b4c2 P 6c5f1932e9134824a0f7823dccf6273e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02f386f6c1ab419f8c7922092b04a1b0 in term 3.
I20260709 13:07:45.656105 30025 leader_election.cc:304] T 9398eeffa5504937973ba568bce7b4c2 P 02f386f6c1ab419f8c7922092b04a1b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02f386f6c1ab419f8c7922092b04a1b0, 6c5f1932e9134824a0f7823dccf6273e; no voters: 
I20260709 13:07:45.656908 30283 raft_consensus.cc:2804] T 9398eeffa5504937973ba568bce7b4c2 P 02f386f6c1ab419f8c7922092b04a1b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:45.657821 29983 raft_consensus.cc:2468] T 9398eeffa5504937973ba568bce7b4c2 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02f386f6c1ab419f8c7922092b04a1b0 in term 3.
I20260709 13:07:45.657851 30283 raft_consensus.cc:697] T 9398eeffa5504937973ba568bce7b4c2 P 02f386f6c1ab419f8c7922092b04a1b0 [term 3 LEADER]: Becoming Leader. State: Replica: 02f386f6c1ab419f8c7922092b04a1b0, State: Running, Role: LEADER
I20260709 13:07:45.659166 30283 consensus_queue.cc:237] T 9398eeffa5504937973ba568bce7b4c2 P 02f386f6c1ab419f8c7922092b04a1b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:45.668560 29880 catalog_manager.cc:5697] T 9398eeffa5504937973ba568bce7b4c2 P 02f386f6c1ab419f8c7922092b04a1b0 reported cstate change: term changed from 2 to 3, leader changed from 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1) to 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2). New cstate: current_term: 3 leader_uuid: "02f386f6c1ab419f8c7922092b04a1b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:45.910423 30320 raft_consensus.cc:993] T c61e62ccbc434482b70daf1670495174 P 4a1d35e9bdf14f44a53c9a1984d04629: : Instructing follower 6c5f1932e9134824a0f7823dccf6273e to start an election
I20260709 13:07:45.911077 30275 raft_consensus.cc:1081] T c61e62ccbc434482b70daf1670495174 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 3 LEADER]: Signalling peer 6c5f1932e9134824a0f7823dccf6273e to start an election
I20260709 13:07:45.912643 30134 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c61e62ccbc434482b70daf1670495174"
dest_uuid: "6c5f1932e9134824a0f7823dccf6273e"
 from {username='slave'} at 127.0.0.1:58414
I20260709 13:07:45.913100 30134 raft_consensus.cc:493] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:45.913394 30134 raft_consensus.cc:3060] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:45.917348 30134 raft_consensus.cc:515] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:45.918874 30134 leader_election.cc:290] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e [CANDIDATE]: Term 4 election: Requested vote from peers 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1:36133), 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2:44093)
I20260709 13:07:45.919584 29983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e62ccbc434482b70daf1670495174" candidate_uuid: "6c5f1932e9134824a0f7823dccf6273e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4a1d35e9bdf14f44a53c9a1984d04629"
I20260709 13:07:45.919938 30058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61e62ccbc434482b70daf1670495174" candidate_uuid: "6c5f1932e9134824a0f7823dccf6273e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "02f386f6c1ab419f8c7922092b04a1b0"
I20260709 13:07:45.920166 29983 raft_consensus.cc:3055] T c61e62ccbc434482b70daf1670495174 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:45.920501 30058 raft_consensus.cc:3060] T c61e62ccbc434482b70daf1670495174 P 02f386f6c1ab419f8c7922092b04a1b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:45.920522 29983 raft_consensus.cc:740] T c61e62ccbc434482b70daf1670495174 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4a1d35e9bdf14f44a53c9a1984d04629, State: Running, Role: LEADER
I20260709 13:07:45.921546 29983 consensus_queue.cc:260] T c61e62ccbc434482b70daf1670495174 P 4a1d35e9bdf14f44a53c9a1984d04629 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:45.922547 29983 raft_consensus.cc:3060] T c61e62ccbc434482b70daf1670495174 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:45.925335 30058 raft_consensus.cc:2468] T c61e62ccbc434482b70daf1670495174 P 02f386f6c1ab419f8c7922092b04a1b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5f1932e9134824a0f7823dccf6273e in term 4.
I20260709 13:07:45.926429 30097 leader_election.cc:304] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02f386f6c1ab419f8c7922092b04a1b0, 6c5f1932e9134824a0f7823dccf6273e; no voters: 
I20260709 13:07:45.926955 29983 raft_consensus.cc:2468] T c61e62ccbc434482b70daf1670495174 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5f1932e9134824a0f7823dccf6273e in term 4.
I20260709 13:07:45.927194 30276 raft_consensus.cc:2804] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:45.928311 30276 raft_consensus.cc:697] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e [term 4 LEADER]: Becoming Leader. State: Replica: 6c5f1932e9134824a0f7823dccf6273e, State: Running, Role: LEADER
I20260709 13:07:45.929154 30276 consensus_queue.cc:237] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:45.935606 29880 catalog_manager.cc:5697] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e reported cstate change: term changed from 3 to 4, leader changed from 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1) to 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3). New cstate: current_term: 4 leader_uuid: "6c5f1932e9134824a0f7823dccf6273e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:45.957752 30327 raft_consensus.cc:993] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629: : Instructing follower 6c5f1932e9134824a0f7823dccf6273e to start an election
I20260709 13:07:45.958232 30275 raft_consensus.cc:1081] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 3 LEADER]: Signalling peer 6c5f1932e9134824a0f7823dccf6273e to start an election
I20260709 13:07:45.959465 30134 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2418e193a92a4d36a4149de5f38be171"
dest_uuid: "6c5f1932e9134824a0f7823dccf6273e"
 from {username='slave'} at 127.0.0.1:58414
I20260709 13:07:45.959924 30134 raft_consensus.cc:493] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:45.960192 30134 raft_consensus.cc:3060] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:45.963953 30134 raft_consensus.cc:515] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:45.965179 30134 leader_election.cc:290] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e [CANDIDATE]: Term 4 election: Requested vote from peers 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1:36133), 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2:44093)
I20260709 13:07:45.966035 29983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2418e193a92a4d36a4149de5f38be171" candidate_uuid: "6c5f1932e9134824a0f7823dccf6273e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4a1d35e9bdf14f44a53c9a1984d04629"
I20260709 13:07:45.966324 30058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2418e193a92a4d36a4149de5f38be171" candidate_uuid: "6c5f1932e9134824a0f7823dccf6273e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "02f386f6c1ab419f8c7922092b04a1b0"
I20260709 13:07:45.966580 29983 raft_consensus.cc:3055] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:45.966898 29983 raft_consensus.cc:740] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4a1d35e9bdf14f44a53c9a1984d04629, State: Running, Role: LEADER
I20260709 13:07:45.966934 30058 raft_consensus.cc:3060] T 2418e193a92a4d36a4149de5f38be171 P 02f386f6c1ab419f8c7922092b04a1b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:45.967779 29983 consensus_queue.cc:260] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:45.968895 29983 raft_consensus.cc:3060] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:45.971978 30058 raft_consensus.cc:2468] T 2418e193a92a4d36a4149de5f38be171 P 02f386f6c1ab419f8c7922092b04a1b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5f1932e9134824a0f7823dccf6273e in term 4.
I20260709 13:07:45.972919 30097 leader_election.cc:304] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02f386f6c1ab419f8c7922092b04a1b0, 6c5f1932e9134824a0f7823dccf6273e; no voters: 
I20260709 13:07:45.973582 30276 raft_consensus.cc:2804] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:45.973567 29983 raft_consensus.cc:2468] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5f1932e9134824a0f7823dccf6273e in term 4.
I20260709 13:07:45.974283 30276 raft_consensus.cc:697] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e [term 4 LEADER]: Becoming Leader. State: Replica: 6c5f1932e9134824a0f7823dccf6273e, State: Running, Role: LEADER
I20260709 13:07:45.975174 30276 consensus_queue.cc:237] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:45.981707 29880 catalog_manager.cc:5697] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e reported cstate change: term changed from 3 to 4, leader changed from 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1) to 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3). New cstate: current_term: 4 leader_uuid: "6c5f1932e9134824a0f7823dccf6273e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:46.032894 30327 raft_consensus.cc:993] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629: : Instructing follower 02f386f6c1ab419f8c7922092b04a1b0 to start an election
I20260709 13:07:46.033331 30275 raft_consensus.cc:1081] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 3 LEADER]: Signalling peer 02f386f6c1ab419f8c7922092b04a1b0 to start an election
I20260709 13:07:46.034696 30058 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bdc7f4487d69425da272a9c59e5e3c54"
dest_uuid: "02f386f6c1ab419f8c7922092b04a1b0"
 from {username='slave'} at 127.0.0.1:38620
I20260709 13:07:46.035159 30058 raft_consensus.cc:493] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:46.035460 30058 raft_consensus.cc:3060] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:46.039932 30058 raft_consensus.cc:515] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:46.041440 30058 leader_election.cc:290] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0 [CANDIDATE]: Term 4 election: Requested vote from peers 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1:36133), 6c5f1932e9134824a0f7823dccf6273e (127.28.173.3:43375)
I20260709 13:07:46.042173 29983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc7f4487d69425da272a9c59e5e3c54" candidate_uuid: "02f386f6c1ab419f8c7922092b04a1b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4a1d35e9bdf14f44a53c9a1984d04629"
I20260709 13:07:46.042333 30134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdc7f4487d69425da272a9c59e5e3c54" candidate_uuid: "02f386f6c1ab419f8c7922092b04a1b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6c5f1932e9134824a0f7823dccf6273e"
I20260709 13:07:46.042718 29983 raft_consensus.cc:3055] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:46.042774 30134 raft_consensus.cc:3060] T bdc7f4487d69425da272a9c59e5e3c54 P 6c5f1932e9134824a0f7823dccf6273e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:46.043167 29983 raft_consensus.cc:740] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4a1d35e9bdf14f44a53c9a1984d04629, State: Running, Role: LEADER
I20260709 13:07:46.044008 29983 consensus_queue.cc:260] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:46.045194 29983 raft_consensus.cc:3060] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:46.048905 30134 raft_consensus.cc:2468] T bdc7f4487d69425da272a9c59e5e3c54 P 6c5f1932e9134824a0f7823dccf6273e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02f386f6c1ab419f8c7922092b04a1b0 in term 4.
I20260709 13:07:46.049901 30025 leader_election.cc:304] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02f386f6c1ab419f8c7922092b04a1b0, 6c5f1932e9134824a0f7823dccf6273e; no voters: 
I20260709 13:07:46.050763 30283 raft_consensus.cc:2804] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:46.051223 30283 raft_consensus.cc:697] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0 [term 4 LEADER]: Becoming Leader. State: Replica: 02f386f6c1ab419f8c7922092b04a1b0, State: Running, Role: LEADER
I20260709 13:07:46.051831 29983 raft_consensus.cc:2468] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02f386f6c1ab419f8c7922092b04a1b0 in term 4.
I20260709 13:07:46.052084 30283 consensus_queue.cc:237] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } }
I20260709 13:07:46.058430 29880 catalog_manager.cc:5697] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0 reported cstate change: term changed from 3 to 4, leader changed from 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1) to 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2). New cstate: current_term: 4 leader_uuid: "02f386f6c1ab419f8c7922092b04a1b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:46.187296 30134 raft_consensus.cc:1275] T 9398eeffa5504937973ba568bce7b4c2 P 6c5f1932e9134824a0f7823dccf6273e [term 3 FOLLOWER]: Refusing update from remote peer 02f386f6c1ab419f8c7922092b04a1b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:46.188524 30283 consensus_queue.cc:1048] T 9398eeffa5504937973ba568bce7b4c2 P 02f386f6c1ab419f8c7922092b04a1b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:46.201401 29983 raft_consensus.cc:1275] T 9398eeffa5504937973ba568bce7b4c2 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 3 FOLLOWER]: Refusing update from remote peer 02f386f6c1ab419f8c7922092b04a1b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:46.202922 30283 consensus_queue.cc:1048] T 9398eeffa5504937973ba568bce7b4c2 P 02f386f6c1ab419f8c7922092b04a1b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:46.351728 29983 raft_consensus.cc:1275] T c61e62ccbc434482b70daf1670495174 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 4 FOLLOWER]: Refusing update from remote peer 6c5f1932e9134824a0f7823dccf6273e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:46.352905 30276 consensus_queue.cc:1048] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:46.361521 30058 raft_consensus.cc:1275] T c61e62ccbc434482b70daf1670495174 P 02f386f6c1ab419f8c7922092b04a1b0 [term 4 FOLLOWER]: Refusing update from remote peer 6c5f1932e9134824a0f7823dccf6273e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:46.363356 30276 consensus_queue.cc:1048] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e [LEADER]: Connected to new peer: Peer: permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:46.405542 29983 raft_consensus.cc:1275] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 4 FOLLOWER]: Refusing update from remote peer 6c5f1932e9134824a0f7823dccf6273e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:46.406945 30276 consensus_queue.cc:1048] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:46.415931 30058 raft_consensus.cc:1275] T 2418e193a92a4d36a4149de5f38be171 P 02f386f6c1ab419f8c7922092b04a1b0 [term 4 FOLLOWER]: Refusing update from remote peer 6c5f1932e9134824a0f7823dccf6273e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:46.417588 30328 consensus_queue.cc:1048] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e [LEADER]: Connected to new peer: Peer: permanent_uuid: "02f386f6c1ab419f8c7922092b04a1b0" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 44093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:46.498337 30134 raft_consensus.cc:1275] T bdc7f4487d69425da272a9c59e5e3c54 P 6c5f1932e9134824a0f7823dccf6273e [term 4 FOLLOWER]: Refusing update from remote peer 02f386f6c1ab419f8c7922092b04a1b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:46.499501 30283 consensus_queue.cc:1048] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c5f1932e9134824a0f7823dccf6273e" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 43375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:46.507997 29983 raft_consensus.cc:1275] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 4 FOLLOWER]: Refusing update from remote peer 02f386f6c1ab419f8c7922092b04a1b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:46.510062 30283 consensus_queue.cc:1048] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a1d35e9bdf14f44a53c9a1984d04629" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:46.595697 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:46.601338 29364 tablet_server.cc:179] TabletServer@127.28.173.1:0 shutting down...
I20260709 13:07:46.626288 29364 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:46.626978 29364 tablet_replica.cc:333] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629: stopping tablet replica
I20260709 13:07:46.627558 29364 raft_consensus.cc:2243] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:07:46.628371 29364 raft_consensus.cc:2272] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.630107 29364 tablet_replica.cc:333] T 4430e39586c24524bffd80447f2999be P 4a1d35e9bdf14f44a53c9a1984d04629: stopping tablet replica
I20260709 13:07:46.630611 29364 raft_consensus.cc:2243] T 4430e39586c24524bffd80447f2999be P 4a1d35e9bdf14f44a53c9a1984d04629 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:46.631021 29364 raft_consensus.cc:2272] T 4430e39586c24524bffd80447f2999be P 4a1d35e9bdf14f44a53c9a1984d04629 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.632649 29364 tablet_replica.cc:333] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629: stopping tablet replica
I20260709 13:07:46.633111 29364 raft_consensus.cc:2243] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:46.633477 29364 raft_consensus.cc:2272] T 2418e193a92a4d36a4149de5f38be171 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.635401 29364 tablet_replica.cc:333] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629: stopping tablet replica
I20260709 13:07:46.635969 29364 raft_consensus.cc:2243] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:46.636339 29364 raft_consensus.cc:2272] T bdc7f4487d69425da272a9c59e5e3c54 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.638199 29364 tablet_replica.cc:333] T 8dfa5968812443d28f2c148c6768f51f P 4a1d35e9bdf14f44a53c9a1984d04629: stopping tablet replica
I20260709 13:07:46.638670 29364 raft_consensus.cc:2243] T 8dfa5968812443d28f2c148c6768f51f P 4a1d35e9bdf14f44a53c9a1984d04629 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:46.639380 29364 raft_consensus.cc:2272] T 8dfa5968812443d28f2c148c6768f51f P 4a1d35e9bdf14f44a53c9a1984d04629 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.640959 29364 tablet_replica.cc:333] T 0242b20a350c42c9978239cd1ec620d2 P 4a1d35e9bdf14f44a53c9a1984d04629: stopping tablet replica
I20260709 13:07:46.641409 29364 raft_consensus.cc:2243] T 0242b20a350c42c9978239cd1ec620d2 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:46.641806 29364 raft_consensus.cc:2272] T 0242b20a350c42c9978239cd1ec620d2 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.643350 29364 tablet_replica.cc:333] T c218ddfeb78c4cfa98f71f681c807503 P 4a1d35e9bdf14f44a53c9a1984d04629: stopping tablet replica
I20260709 13:07:46.643842 29364 raft_consensus.cc:2243] T c218ddfeb78c4cfa98f71f681c807503 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:46.644527 29364 raft_consensus.cc:2272] T c218ddfeb78c4cfa98f71f681c807503 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.645989 29364 tablet_replica.cc:333] T c61e62ccbc434482b70daf1670495174 P 4a1d35e9bdf14f44a53c9a1984d04629: stopping tablet replica
I20260709 13:07:46.646474 29364 raft_consensus.cc:2243] T c61e62ccbc434482b70daf1670495174 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:46.646842 29364 raft_consensus.cc:2272] T c61e62ccbc434482b70daf1670495174 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.648800 29364 tablet_replica.cc:333] T 9398eeffa5504937973ba568bce7b4c2 P 4a1d35e9bdf14f44a53c9a1984d04629: stopping tablet replica
I20260709 13:07:46.649242 29364 raft_consensus.cc:2243] T 9398eeffa5504937973ba568bce7b4c2 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:46.649672 29364 raft_consensus.cc:2272] T 9398eeffa5504937973ba568bce7b4c2 P 4a1d35e9bdf14f44a53c9a1984d04629 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.651461 29364 tablet_replica.cc:333] T 22b91a84b0d244f987c2625faa04ecce P 4a1d35e9bdf14f44a53c9a1984d04629: stopping tablet replica
I20260709 13:07:46.651942 29364 raft_consensus.cc:2243] T 22b91a84b0d244f987c2625faa04ecce P 4a1d35e9bdf14f44a53c9a1984d04629 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:46.652681 29364 raft_consensus.cc:2272] T 22b91a84b0d244f987c2625faa04ecce P 4a1d35e9bdf14f44a53c9a1984d04629 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.670176 29364 tablet_server.cc:196] TabletServer@127.28.173.1:0 shutdown complete.
W20260709 13:07:46.677318 30023 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36133: connect: Connection refused (error 111) [suppressed 2 similar messages]
W20260709 13:07:46.682459 30023 consensus_peers.cc:597] T 9398eeffa5504937973ba568bce7b4c2 P 02f386f6c1ab419f8c7922092b04a1b0 -> Peer 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1:36133): Couldn't send request to peer 4a1d35e9bdf14f44a53c9a1984d04629. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:46.694917 29364 tablet_server.cc:179] TabletServer@127.28.173.2:0 shutting down...
I20260709 13:07:46.719273 29364 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:46.720060 29364 tablet_replica.cc:333] T 4430e39586c24524bffd80447f2999be P 02f386f6c1ab419f8c7922092b04a1b0: stopping tablet replica
I20260709 13:07:46.720714 29364 raft_consensus.cc:2243] T 4430e39586c24524bffd80447f2999be P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:46.721483 29364 raft_consensus.cc:2272] T 4430e39586c24524bffd80447f2999be P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.723347 29364 tablet_replica.cc:333] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 02f386f6c1ab419f8c7922092b04a1b0: stopping tablet replica
I20260709 13:07:46.723946 29364 raft_consensus.cc:2243] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 02f386f6c1ab419f8c7922092b04a1b0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:46.724390 29364 raft_consensus.cc:2272] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 02f386f6c1ab419f8c7922092b04a1b0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.725936 29364 tablet_replica.cc:333] T 9398eeffa5504937973ba568bce7b4c2 P 02f386f6c1ab419f8c7922092b04a1b0: stopping tablet replica
I20260709 13:07:46.726404 29364 raft_consensus.cc:2243] T 9398eeffa5504937973ba568bce7b4c2 P 02f386f6c1ab419f8c7922092b04a1b0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:46.727070 29364 raft_consensus.cc:2272] T 9398eeffa5504937973ba568bce7b4c2 P 02f386f6c1ab419f8c7922092b04a1b0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.729005 29364 tablet_replica.cc:333] T c218ddfeb78c4cfa98f71f681c807503 P 02f386f6c1ab419f8c7922092b04a1b0: stopping tablet replica
I20260709 13:07:46.729514 29364 raft_consensus.cc:2243] T c218ddfeb78c4cfa98f71f681c807503 P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:46.729907 29364 raft_consensus.cc:2272] T c218ddfeb78c4cfa98f71f681c807503 P 02f386f6c1ab419f8c7922092b04a1b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.731465 29364 tablet_replica.cc:333] T c61e62ccbc434482b70daf1670495174 P 02f386f6c1ab419f8c7922092b04a1b0: stopping tablet replica
I20260709 13:07:46.731989 29364 raft_consensus.cc:2243] T c61e62ccbc434482b70daf1670495174 P 02f386f6c1ab419f8c7922092b04a1b0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:46.732412 29364 raft_consensus.cc:2272] T c61e62ccbc434482b70daf1670495174 P 02f386f6c1ab419f8c7922092b04a1b0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.734778 29364 tablet_replica.cc:333] T 0242b20a350c42c9978239cd1ec620d2 P 02f386f6c1ab419f8c7922092b04a1b0: stopping tablet replica
I20260709 13:07:46.735227 29364 raft_consensus.cc:2243] T 0242b20a350c42c9978239cd1ec620d2 P 02f386f6c1ab419f8c7922092b04a1b0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:46.735641 29364 raft_consensus.cc:2272] T 0242b20a350c42c9978239cd1ec620d2 P 02f386f6c1ab419f8c7922092b04a1b0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.737316 29364 tablet_replica.cc:333] T 8dfa5968812443d28f2c148c6768f51f P 02f386f6c1ab419f8c7922092b04a1b0: stopping tablet replica
I20260709 13:07:46.737758 29364 raft_consensus.cc:2243] T 8dfa5968812443d28f2c148c6768f51f P 02f386f6c1ab419f8c7922092b04a1b0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:46.738158 29364 raft_consensus.cc:2272] T 8dfa5968812443d28f2c148c6768f51f P 02f386f6c1ab419f8c7922092b04a1b0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.740087 29364 tablet_replica.cc:333] T 22b91a84b0d244f987c2625faa04ecce P 02f386f6c1ab419f8c7922092b04a1b0: stopping tablet replica
I20260709 13:07:46.740556 29364 raft_consensus.cc:2243] T 22b91a84b0d244f987c2625faa04ecce P 02f386f6c1ab419f8c7922092b04a1b0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:46.740954 29364 raft_consensus.cc:2272] T 22b91a84b0d244f987c2625faa04ecce P 02f386f6c1ab419f8c7922092b04a1b0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:46.741391 30097 consensus_peers.cc:597] T 0242b20a350c42c9978239cd1ec620d2 P 6c5f1932e9134824a0f7823dccf6273e -> Peer 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1:36133): Couldn't send request to peer 4a1d35e9bdf14f44a53c9a1984d04629. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:46.742591 29364 tablet_replica.cc:333] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0: stopping tablet replica
I20260709 13:07:46.743088 29364 raft_consensus.cc:2243] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0 [term 4 LEADER]: Raft consensus shutting down.
W20260709 13:07:46.743331 30097 consensus_peers.cc:597] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e -> Peer 4a1d35e9bdf14f44a53c9a1984d04629 (127.28.173.1:36133): Couldn't send request to peer 4a1d35e9bdf14f44a53c9a1984d04629. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:46.743795 29364 raft_consensus.cc:2272] T bdc7f4487d69425da272a9c59e5e3c54 P 02f386f6c1ab419f8c7922092b04a1b0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.745719 29364 tablet_replica.cc:333] T 2418e193a92a4d36a4149de5f38be171 P 02f386f6c1ab419f8c7922092b04a1b0: stopping tablet replica
I20260709 13:07:46.746136 29364 raft_consensus.cc:2243] T 2418e193a92a4d36a4149de5f38be171 P 02f386f6c1ab419f8c7922092b04a1b0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:46.746483 29364 raft_consensus.cc:2272] T 2418e193a92a4d36a4149de5f38be171 P 02f386f6c1ab419f8c7922092b04a1b0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.797188 29364 tablet_server.cc:196] TabletServer@127.28.173.2:0 shutdown complete.
I20260709 13:07:46.816532 29364 tablet_server.cc:179] TabletServer@127.28.173.3:0 shutting down...
W20260709 13:07:46.821359 30097 consensus_peers.cc:597] T 0242b20a350c42c9978239cd1ec620d2 P 6c5f1932e9134824a0f7823dccf6273e -> Peer 02f386f6c1ab419f8c7922092b04a1b0 (127.28.173.2:44093): Couldn't send request to peer 02f386f6c1ab419f8c7922092b04a1b0. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.2:44093: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:46.838882 29364 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:46.839644 29364 tablet_replica.cc:333] T 22b91a84b0d244f987c2625faa04ecce P 6c5f1932e9134824a0f7823dccf6273e: stopping tablet replica
I20260709 13:07:46.840256 29364 raft_consensus.cc:2243] T 22b91a84b0d244f987c2625faa04ecce P 6c5f1932e9134824a0f7823dccf6273e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:46.840716 29364 raft_consensus.cc:2272] T 22b91a84b0d244f987c2625faa04ecce P 6c5f1932e9134824a0f7823dccf6273e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.842453 29364 tablet_replica.cc:333] T 0242b20a350c42c9978239cd1ec620d2 P 6c5f1932e9134824a0f7823dccf6273e: stopping tablet replica
I20260709 13:07:46.842950 29364 raft_consensus.cc:2243] T 0242b20a350c42c9978239cd1ec620d2 P 6c5f1932e9134824a0f7823dccf6273e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:46.843673 29364 raft_consensus.cc:2272] T 0242b20a350c42c9978239cd1ec620d2 P 6c5f1932e9134824a0f7823dccf6273e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.845291 29364 tablet_replica.cc:333] T 8dfa5968812443d28f2c148c6768f51f P 6c5f1932e9134824a0f7823dccf6273e: stopping tablet replica
I20260709 13:07:46.845765 29364 raft_consensus.cc:2243] T 8dfa5968812443d28f2c148c6768f51f P 6c5f1932e9134824a0f7823dccf6273e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:46.846158 29364 raft_consensus.cc:2272] T 8dfa5968812443d28f2c148c6768f51f P 6c5f1932e9134824a0f7823dccf6273e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.847734 29364 tablet_replica.cc:333] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e: stopping tablet replica
I20260709 13:07:46.848272 29364 raft_consensus.cc:2243] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:07:46.848943 29364 raft_consensus.cc:2272] T c61e62ccbc434482b70daf1670495174 P 6c5f1932e9134824a0f7823dccf6273e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.851276 29364 tablet_replica.cc:333] T c218ddfeb78c4cfa98f71f681c807503 P 6c5f1932e9134824a0f7823dccf6273e: stopping tablet replica
I20260709 13:07:46.851760 29364 raft_consensus.cc:2243] T c218ddfeb78c4cfa98f71f681c807503 P 6c5f1932e9134824a0f7823dccf6273e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:46.852197 29364 raft_consensus.cc:2272] T c218ddfeb78c4cfa98f71f681c807503 P 6c5f1932e9134824a0f7823dccf6273e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.853711 29364 tablet_replica.cc:333] T 9398eeffa5504937973ba568bce7b4c2 P 6c5f1932e9134824a0f7823dccf6273e: stopping tablet replica
I20260709 13:07:46.854169 29364 raft_consensus.cc:2243] T 9398eeffa5504937973ba568bce7b4c2 P 6c5f1932e9134824a0f7823dccf6273e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:46.854552 29364 raft_consensus.cc:2272] T 9398eeffa5504937973ba568bce7b4c2 P 6c5f1932e9134824a0f7823dccf6273e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.857117 29364 tablet_replica.cc:333] T bdc7f4487d69425da272a9c59e5e3c54 P 6c5f1932e9134824a0f7823dccf6273e: stopping tablet replica
I20260709 13:07:46.857620 29364 raft_consensus.cc:2243] T bdc7f4487d69425da272a9c59e5e3c54 P 6c5f1932e9134824a0f7823dccf6273e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:46.858002 29364 raft_consensus.cc:2272] T bdc7f4487d69425da272a9c59e5e3c54 P 6c5f1932e9134824a0f7823dccf6273e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.859797 29364 tablet_replica.cc:333] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e: stopping tablet replica
I20260709 13:07:46.860311 29364 raft_consensus.cc:2243] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:07:46.861004 29364 raft_consensus.cc:2272] T 2418e193a92a4d36a4149de5f38be171 P 6c5f1932e9134824a0f7823dccf6273e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.862857 29364 tablet_replica.cc:333] T 4430e39586c24524bffd80447f2999be P 6c5f1932e9134824a0f7823dccf6273e: stopping tablet replica
I20260709 13:07:46.863322 29364 raft_consensus.cc:2243] T 4430e39586c24524bffd80447f2999be P 6c5f1932e9134824a0f7823dccf6273e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:46.863694 29364 raft_consensus.cc:2272] T 4430e39586c24524bffd80447f2999be P 6c5f1932e9134824a0f7823dccf6273e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.865200 29364 tablet_replica.cc:333] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 6c5f1932e9134824a0f7823dccf6273e: stopping tablet replica
I20260709 13:07:46.865608 29364 raft_consensus.cc:2243] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 6c5f1932e9134824a0f7823dccf6273e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:46.865988 29364 raft_consensus.cc:2272] T 4e48e4ede2b9419c805b7d9bcd1e2fb0 P 6c5f1932e9134824a0f7823dccf6273e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.892057 29364 tablet_server.cc:196] TabletServer@127.28.173.3:0 shutdown complete.
I20260709 13:07:46.909824 29364 master.cc:562] Master@127.28.173.62:38359 shutting down...
I20260709 13:07:46.929374 29364 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6007cf9605be4294a2628ee3c0db7601 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:46.929906 29364 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6007cf9605be4294a2628ee3c0db7601 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:46.930246 29364 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6007cf9605be4294a2628ee3c0db7601: stopping tablet replica
I20260709 13:07:46.949448 29364 master.cc:584] Master@127.28.173.62:38359 shutdown complete.
02f386f6c1ab419f8c7922092b04a1b0  4
4a1d35e9bdf14f44a53c9a1984d04629  5
6c5f1932e9134824a0f7823dccf6273e  1
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10403 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:07:46.987015 29364 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.28.173.62:33437
I20260709 13:07:46.988222 29364 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:46.993582 30349 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:46.993577 30350 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:46.994904 30352 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:46.995939 29364 server_base.cc:1061] running on GCE node
I20260709 13:07:46.996712 29364 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:46.996917 29364 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:46.997077 29364 hybrid_clock.cc:648] HybridClock initialized: now 1783602466997060 us; error 0 us; skew 500 ppm
I20260709 13:07:46.997571 29364 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:46.999770 29364 webserver.cc:533] Webserver started at http://127.28.173.62:38059/ using document root <none> and password file <none>
I20260709 13:07:47.000273 29364 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:47.000471 29364 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:47.000742 29364 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:47.001793 29364 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/master-0-root/instance:
uuid: "045170a35afe4845987482e49e9e1eb9"
format_stamp: "Formatted at 2026-07-09 13:07:46 on dist-test-slave-x62b"
I20260709 13:07:47.006006 29364 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:07:47.009449 30357 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:47.010320 29364 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:07:47.010551 29364 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/master-0-root
uuid: "045170a35afe4845987482e49e9e1eb9"
format_stamp: "Formatted at 2026-07-09 13:07:46 on dist-test-slave-x62b"
I20260709 13:07:47.010788 29364 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:47.039654 29364 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:47.040947 29364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:47.078186 29364 rpc_server.cc:307] RPC server started. Bound to: 127.28.173.62:33437
I20260709 13:07:47.078296 30408 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.173.62:33437 every 8 connection(s)
I20260709 13:07:47.082126 30409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.091291 30409 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 045170a35afe4845987482e49e9e1eb9: Bootstrap starting.
I20260709 13:07:47.095595 30409 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 045170a35afe4845987482e49e9e1eb9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:47.099609 30409 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 045170a35afe4845987482e49e9e1eb9: No bootstrap required, opened a new log
I20260709 13:07:47.101557 30409 raft_consensus.cc:359] T 00000000000000000000000000000000 P 045170a35afe4845987482e49e9e1eb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "045170a35afe4845987482e49e9e1eb9" member_type: VOTER }
I20260709 13:07:47.101903 30409 raft_consensus.cc:385] T 00000000000000000000000000000000 P 045170a35afe4845987482e49e9e1eb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:47.102191 30409 raft_consensus.cc:740] T 00000000000000000000000000000000 P 045170a35afe4845987482e49e9e1eb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 045170a35afe4845987482e49e9e1eb9, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.102819 30409 consensus_queue.cc:260] T 00000000000000000000000000000000 P 045170a35afe4845987482e49e9e1eb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "045170a35afe4845987482e49e9e1eb9" member_type: VOTER }
I20260709 13:07:47.103245 30409 raft_consensus.cc:399] T 00000000000000000000000000000000 P 045170a35afe4845987482e49e9e1eb9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:07:47.103461 30409 raft_consensus.cc:493] T 00000000000000000000000000000000 P 045170a35afe4845987482e49e9e1eb9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:07:47.103737 30409 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 045170a35afe4845987482e49e9e1eb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:47.107681 30409 raft_consensus.cc:515] T 00000000000000000000000000000000 P 045170a35afe4845987482e49e9e1eb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "045170a35afe4845987482e49e9e1eb9" member_type: VOTER }
I20260709 13:07:47.108211 30409 leader_election.cc:304] T 00000000000000000000000000000000 P 045170a35afe4845987482e49e9e1eb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 045170a35afe4845987482e49e9e1eb9; no voters: 
I20260709 13:07:47.109229 30409 leader_election.cc:290] T 00000000000000000000000000000000 P 045170a35afe4845987482e49e9e1eb9 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:07:47.109628 30412 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 045170a35afe4845987482e49e9e1eb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:47.110901 30412 raft_consensus.cc:697] T 00000000000000000000000000000000 P 045170a35afe4845987482e49e9e1eb9 [term 1 LEADER]: Becoming Leader. State: Replica: 045170a35afe4845987482e49e9e1eb9, State: Running, Role: LEADER
I20260709 13:07:47.111541 30412 consensus_queue.cc:237] T 00000000000000000000000000000000 P 045170a35afe4845987482e49e9e1eb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "045170a35afe4845987482e49e9e1eb9" member_type: VOTER }
I20260709 13:07:47.112139 30409 sys_catalog.cc:565] T 00000000000000000000000000000000 P 045170a35afe4845987482e49e9e1eb9 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:07:47.116055 30413 sys_catalog.cc:455] T 00000000000000000000000000000000 P 045170a35afe4845987482e49e9e1eb9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "045170a35afe4845987482e49e9e1eb9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "045170a35afe4845987482e49e9e1eb9" member_type: VOTER } }
I20260709 13:07:47.116744 30413 sys_catalog.cc:458] T 00000000000000000000000000000000 P 045170a35afe4845987482e49e9e1eb9 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:47.116456 30414 sys_catalog.cc:455] T 00000000000000000000000000000000 P 045170a35afe4845987482e49e9e1eb9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 045170a35afe4845987482e49e9e1eb9. Latest consensus state: current_term: 1 leader_uuid: "045170a35afe4845987482e49e9e1eb9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "045170a35afe4845987482e49e9e1eb9" member_type: VOTER } }
I20260709 13:07:47.117328 30414 sys_catalog.cc:458] T 00000000000000000000000000000000 P 045170a35afe4845987482e49e9e1eb9 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:47.121948 30419 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:07:47.129249 30419 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:07:47.130259 29364 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:07:47.137293 30419 catalog_manager.cc:1383] Generated new cluster ID: 030e4ee7eea74979952c523954c9a5d4
I20260709 13:07:47.137557 30419 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:07:47.150314 30419 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:07:47.151480 30419 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:07:47.165220 30419 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 045170a35afe4845987482e49e9e1eb9: Generated new TSK 0
I20260709 13:07:47.165794 30419 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:07:47.196931 29364 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:47.202952 30430 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:47.204893 30431 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:47.206766 29364 server_base.cc:1061] running on GCE node
W20260709 13:07:47.206804 30433 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:47.208020 29364 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:47.208280 29364 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:47.208467 29364 hybrid_clock.cc:648] HybridClock initialized: now 1783602467208451 us; error 0 us; skew 500 ppm
I20260709 13:07:47.208981 29364 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:47.211258 29364 webserver.cc:533] Webserver started at http://127.28.173.1:42535/ using document root <none> and password file <none>
I20260709 13:07:47.211732 29364 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:47.211977 29364 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:47.212277 29364 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:47.213518 29364 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-0-root/instance:
uuid: "f639301059e24dc5b0d88a46dc683326"
format_stamp: "Formatted at 2026-07-09 13:07:47 on dist-test-slave-x62b"
I20260709 13:07:47.218168 29364 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:07:47.221380 30438 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:47.222153 29364 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:07:47.222458 29364 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-0-root
uuid: "f639301059e24dc5b0d88a46dc683326"
format_stamp: "Formatted at 2026-07-09 13:07:47 on dist-test-slave-x62b"
I20260709 13:07:47.222766 29364 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:47.238332 29364 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:47.239514 29364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:47.240983 29364 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:47.243219 29364 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:47.243389 29364 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:47.243721 29364 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:47.243939 29364 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:07:47.284224 29364 rpc_server.cc:307] RPC server started. Bound to: 127.28.173.1:43133
I20260709 13:07:47.284410 30500 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.173.1:43133 every 8 connection(s)
I20260709 13:07:47.291026 29364 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:47.299366 30505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:47.300587 30506 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:47.302945 30508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:47.305490 29364 server_base.cc:1061] running on GCE node
I20260709 13:07:47.306387 29364 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:47.306569 29364 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:47.306694 29364 hybrid_clock.cc:648] HybridClock initialized: now 1783602467306681 us; error 0 us; skew 500 ppm
I20260709 13:07:47.307186 29364 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:47.311267 29364 webserver.cc:533] Webserver started at http://127.28.173.2:34553/ using document root <none> and password file <none>
I20260709 13:07:47.311424 30501 heartbeater.cc:344] Connected to a master server at 127.28.173.62:33437
I20260709 13:07:47.311897 30501 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:47.311964 29364 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:47.312258 29364 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:47.312559 29364 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:47.312819 30501 heartbeater.cc:507] Master 127.28.173.62:33437 requested a full tablet report, sending...
I20260709 13:07:47.313861 29364 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-1-root/instance:
uuid: "092f6eb694fc4bbeab49677cccd880fd"
format_stamp: "Formatted at 2026-07-09 13:07:47 on dist-test-slave-x62b"
I20260709 13:07:47.315001 30374 ts_manager.cc:194] Registered new tserver with Master: f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133)
I20260709 13:07:47.316708 30374 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57538
I20260709 13:07:47.318753 29364 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:07:47.322134 30513 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:47.322876 29364 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:07:47.323154 29364 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-1-root
uuid: "092f6eb694fc4bbeab49677cccd880fd"
format_stamp: "Formatted at 2026-07-09 13:07:47 on dist-test-slave-x62b"
I20260709 13:07:47.323447 29364 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:47.346509 29364 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:47.347659 29364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:47.349100 29364 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:47.351277 29364 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:47.351452 29364 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:47.351742 29364 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:47.351928 29364 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:07:47.389791 29364 rpc_server.cc:307] RPC server started. Bound to: 127.28.173.2:34733
I20260709 13:07:47.389887 30575 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.173.2:34733 every 8 connection(s)
I20260709 13:07:47.394519 29364 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:47.402037 30579 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:47.403080 30580 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:47.406445 30582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:47.406615 30576 heartbeater.cc:344] Connected to a master server at 127.28.173.62:33437
I20260709 13:07:47.407096 30576 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:47.407567 29364 server_base.cc:1061] running on GCE node
I20260709 13:07:47.408018 30576 heartbeater.cc:507] Master 127.28.173.62:33437 requested a full tablet report, sending...
I20260709 13:07:47.408497 29364 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:47.408716 29364 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:47.408914 29364 hybrid_clock.cc:648] HybridClock initialized: now 1783602467408895 us; error 0 us; skew 500 ppm
I20260709 13:07:47.409569 29364 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:47.410104 30374 ts_manager.cc:194] Registered new tserver with Master: 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:47.411963 30374 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57542
I20260709 13:07:47.412274 29364 webserver.cc:533] Webserver started at http://127.28.173.3:37597/ using document root <none> and password file <none>
I20260709 13:07:47.412902 29364 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:47.413141 29364 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:47.413458 29364 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:47.414583 29364 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-2-root/instance:
uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
format_stamp: "Formatted at 2026-07-09 13:07:47 on dist-test-slave-x62b"
I20260709 13:07:47.418752 29364 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:07:47.421788 30587 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:47.422551 29364 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:07:47.422896 29364 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-2-root
uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
format_stamp: "Formatted at 2026-07-09 13:07:47 on dist-test-slave-x62b"
I20260709 13:07:47.423244 29364 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:47.445129 29364 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:47.446416 29364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:47.448014 29364 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:47.450594 29364 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:47.450835 29364 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:47.451098 29364 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:47.451289 29364 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:47.490409 29364 rpc_server.cc:307] RPC server started. Bound to: 127.28.173.3:32851
I20260709 13:07:47.490520 30649 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.173.3:32851 every 8 connection(s)
I20260709 13:07:47.504293 30650 heartbeater.cc:344] Connected to a master server at 127.28.173.62:33437
I20260709 13:07:47.504590 30650 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:47.505290 30650 heartbeater.cc:507] Master 127.28.173.62:33437 requested a full tablet report, sending...
I20260709 13:07:47.507157 30374 ts_manager.cc:194] Registered new tserver with Master: fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:47.507256 29364 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013418189s
I20260709 13:07:47.508530 30374 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57546
I20260709 13:07:47.533068 30374 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57562:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:07:47.539078 30374 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:07:47.730151 30541 tablet_service.cc:1511] Processing CreateTablet for tablet 1270ad76798e4aea9d22209a726cc454 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:07:47.730763 30540 tablet_service.cc:1511] Processing CreateTablet for tablet 1a418ef882d34180817469c4e2495268 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:07:47.732975 30539 tablet_service.cc:1511] Processing CreateTablet for tablet aa9b623a9a0446ca90b350e140072cb4 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:07:47.735198 30538 tablet_service.cc:1511] Processing CreateTablet for tablet 0a6e86e0a4b843478d5970b29ad63ad7 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:07:47.747061 30614 tablet_service.cc:1511] Processing CreateTablet for tablet 1a418ef882d34180817469c4e2495268 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:07:47.731654 30541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1270ad76798e4aea9d22209a726cc454. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.748476 30614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a418ef882d34180817469c4e2495268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.749018 30609 tablet_service.cc:1511] Processing CreateTablet for tablet 60ec00010cf4415890c61ef6278cd0cd (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:07:47.750283 30609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60ec00010cf4415890c61ef6278cd0cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.751947 30540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a418ef882d34180817469c4e2495268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.747491 30610 tablet_service.cc:1511] Processing CreateTablet for tablet 3e82bb3f413748538cf887dcc15fe04c (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:07:47.752908 30610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e82bb3f413748538cf887dcc15fe04c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.753012 30613 tablet_service.cc:1511] Processing CreateTablet for tablet aa9b623a9a0446ca90b350e140072cb4 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:07:47.754256 30613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa9b623a9a0446ca90b350e140072cb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.756932 30533 tablet_service.cc:1511] Processing CreateTablet for tablet 606c3ee77596493da2daa40edde4d1ea (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:07:47.758227 30533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 606c3ee77596493da2daa40edde4d1ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.759101 30539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa9b623a9a0446ca90b350e140072cb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.760260 30534 tablet_service.cc:1511] Processing CreateTablet for tablet 48914655f9d44751a883e36b566dcefd (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:07:47.761567 30534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48914655f9d44751a883e36b566dcefd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.765321 30538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a6e86e0a4b843478d5970b29ad63ad7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.764976 30532 tablet_service.cc:1511] Processing CreateTablet for tablet 47ac231e47e64c0c9330e153212ca4b5 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:07:47.766251 30532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47ac231e47e64c0c9330e153212ca4b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.735852 30462 tablet_service.cc:1511] Processing CreateTablet for tablet dfc9f90b82b84a8cb47cbee7adb0401a (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:07:47.736972 30466 tablet_service.cc:1511] Processing CreateTablet for tablet 1270ad76798e4aea9d22209a726cc454 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:07:47.737547 30537 tablet_service.cc:1511] Processing CreateTablet for tablet dfc9f90b82b84a8cb47cbee7adb0401a (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:07:47.768708 30462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfc9f90b82b84a8cb47cbee7adb0401a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.768952 30537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfc9f90b82b84a8cb47cbee7adb0401a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.738711 30465 tablet_service.cc:1511] Processing CreateTablet for tablet 1a418ef882d34180817469c4e2495268 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:07:47.771471 30465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a418ef882d34180817469c4e2495268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.740387 30536 tablet_service.cc:1511] Processing CreateTablet for tablet 3e82bb3f413748538cf887dcc15fe04c (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:07:47.772578 30536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e82bb3f413748538cf887dcc15fe04c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.772974 30460 tablet_service.cc:1511] Processing CreateTablet for tablet 60ec00010cf4415890c61ef6278cd0cd (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:07:47.774248 30460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60ec00010cf4415890c61ef6278cd0cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.741464 30463 tablet_service.cc:1511] Processing CreateTablet for tablet 0a6e86e0a4b843478d5970b29ad63ad7 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:07:47.776563 30463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a6e86e0a4b843478d5970b29ad63ad7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.777159 30459 tablet_service.cc:1511] Processing CreateTablet for tablet 48914655f9d44751a883e36b566dcefd (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:07:47.742041 30461 tablet_service.cc:1511] Processing CreateTablet for tablet 3e82bb3f413748538cf887dcc15fe04c (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:07:47.778393 30459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48914655f9d44751a883e36b566dcefd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.778980 30461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e82bb3f413748538cf887dcc15fe04c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.743659 30535 tablet_service.cc:1511] Processing CreateTablet for tablet 60ec00010cf4415890c61ef6278cd0cd (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:07:47.780597 30535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60ec00010cf4415890c61ef6278cd0cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.780424 30458 tablet_service.cc:1511] Processing CreateTablet for tablet 606c3ee77596493da2daa40edde4d1ea (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:07:47.744877 30612 tablet_service.cc:1511] Processing CreateTablet for tablet 0a6e86e0a4b843478d5970b29ad63ad7 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:07:47.782465 30457 tablet_service.cc:1511] Processing CreateTablet for tablet 47ac231e47e64c0c9330e153212ca4b5 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:07:47.745812 30611 tablet_service.cc:1511] Processing CreateTablet for tablet dfc9f90b82b84a8cb47cbee7adb0401a (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:07:47.784854 30466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1270ad76798e4aea9d22209a726cc454. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.745373 30615 tablet_service.cc:1511] Processing CreateTablet for tablet 1270ad76798e4aea9d22209a726cc454 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:07:47.740387 30464 tablet_service.cc:1511] Processing CreateTablet for tablet aa9b623a9a0446ca90b350e140072cb4 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:07:47.782888 30612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a6e86e0a4b843478d5970b29ad63ad7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.787892 30464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa9b623a9a0446ca90b350e140072cb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.789619 30611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfc9f90b82b84a8cb47cbee7adb0401a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.791607 30457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47ac231e47e64c0c9330e153212ca4b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.793545 30458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 606c3ee77596493da2daa40edde4d1ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.795360 30615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1270ad76798e4aea9d22209a726cc454. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.803098 30608 tablet_service.cc:1511] Processing CreateTablet for tablet 48914655f9d44751a883e36b566dcefd (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:07:47.805003 30607 tablet_service.cc:1511] Processing CreateTablet for tablet 606c3ee77596493da2daa40edde4d1ea (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:07:47.807199 30607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 606c3ee77596493da2daa40edde4d1ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.817014 30606 tablet_service.cc:1511] Processing CreateTablet for tablet 47ac231e47e64c0c9330e153212ca4b5 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:07:47.818509 30608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48914655f9d44751a883e36b566dcefd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.820120 30606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47ac231e47e64c0c9330e153212ca4b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.901064 30610 tablet_service.cc:1511] Processing CreateTablet for tablet 7c9861593ab94f7792fdd702f1d9a483 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:07:47.902511 30610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c9861593ab94f7792fdd702f1d9a483. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.902719 30538 tablet_service.cc:1511] Processing CreateTablet for tablet 1560cc6404764454b2843cec97934e6b (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:07:47.903777 30538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1560cc6404764454b2843cec97934e6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.919863 30665 tablet_bootstrap.cc:492] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:47.924675 30666 tablet_bootstrap.cc:492] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:47.915933 30607 tablet_service.cc:1511] Processing CreateTablet for tablet 1560cc6404764454b2843cec97934e6b (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:07:47.941027 30607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1560cc6404764454b2843cec97934e6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.940748 30536 tablet_service.cc:1511] Processing CreateTablet for tablet 7c9861593ab94f7792fdd702f1d9a483 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:07:47.941983 30536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c9861593ab94f7792fdd702f1d9a483. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.946389 30539 tablet_service.cc:1511] Processing CreateTablet for tablet 85088611c7e34066afbf929fc1cbe50d (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:07:47.947276 30541 tablet_service.cc:1511] Processing CreateTablet for tablet db4f54e7ad744ccb95e9f62b315f1408 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:07:47.953373 30460 tablet_service.cc:1511] Processing CreateTablet for tablet 1560cc6404764454b2843cec97934e6b (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:07:47.956225 30466 tablet_service.cc:1511] Processing CreateTablet for tablet 7c9861593ab94f7792fdd702f1d9a483 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:07:47.958297 30465 tablet_service.cc:1511] Processing CreateTablet for tablet 85088611c7e34066afbf929fc1cbe50d (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:07:47.960999 30609 tablet_service.cc:1511] Processing CreateTablet for tablet 85088611c7e34066afbf929fc1cbe50d (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:07:47.961855 30666 tablet_bootstrap.cc:654] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:47.961660 30613 tablet_service.cc:1511] Processing CreateTablet for tablet db4f54e7ad744ccb95e9f62b315f1408 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:07:47.962417 30609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85088611c7e34066afbf929fc1cbe50d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.963233 30533 tablet_service.cc:1511] Processing CreateTablet for tablet db830c61bd0a4c3d80284c8c56165b1b (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:07:47.964311 30614 tablet_service.cc:1511] Processing CreateTablet for tablet db830c61bd0a4c3d80284c8c56165b1b (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:07:47.965488 30614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db830c61bd0a4c3d80284c8c56165b1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.966454 30665 tablet_bootstrap.cc:654] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:47.968469 30613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db4f54e7ad744ccb95e9f62b315f1408. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.972981 30461 tablet_service.cc:1511] Processing CreateTablet for tablet db4f54e7ad744ccb95e9f62b315f1408 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:07:47.974304 30461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db4f54e7ad744ccb95e9f62b315f1408. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.977613 30463 tablet_service.cc:1511] Processing CreateTablet for tablet db830c61bd0a4c3d80284c8c56165b1b (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:07:47.978930 30463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db830c61bd0a4c3d80284c8c56165b1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.980378 30465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85088611c7e34066afbf929fc1cbe50d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.981554 30457 tablet_service.cc:1511] Processing CreateTablet for tablet 10b0408011914710a008d9e9b58f002c (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:07:47.982467 30464 tablet_service.cc:1511] Processing CreateTablet for tablet 1f895d2ed89b48cc856a4b80cdde3073 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:07:47.983893 30615 tablet_service.cc:1511] Processing CreateTablet for tablet 1f895d2ed89b48cc856a4b80cdde3073 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:07:47.985152 30615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f895d2ed89b48cc856a4b80cdde3073. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.986815 30458 tablet_service.cc:1511] Processing CreateTablet for tablet 8e5fda238ec24b13b992b82bed92951f (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:07:47.947551 30539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85088611c7e34066afbf929fc1cbe50d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.992116 30541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db4f54e7ad744ccb95e9f62b315f1408. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.992601 30466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c9861593ab94f7792fdd702f1d9a483. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.966077 30608 tablet_service.cc:1511] Processing CreateTablet for tablet 10b0408011914710a008d9e9b58f002c (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:07:47.995577 30608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10b0408011914710a008d9e9b58f002c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.996094 30533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db830c61bd0a4c3d80284c8c56165b1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:47.999122 30537 tablet_service.cc:1511] Processing CreateTablet for tablet 10b0408011914710a008d9e9b58f002c (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:07:48.000094 30460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1560cc6404764454b2843cec97934e6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.001801 30611 tablet_service.cc:1511] Processing CreateTablet for tablet 8e5fda238ec24b13b992b82bed92951f (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:07:48.013438 30612 tablet_service.cc:1511] Processing CreateTablet for tablet 39a5f6c7a19c4fd59922a13945641151 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:07:48.014737 30665 tablet_bootstrap.cc:492] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:48.023567 30665 ts_tablet_manager.cc:1403] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.104s	user 0.003s	sys 0.010s
I20260709 13:07:48.024106 30464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f895d2ed89b48cc856a4b80cdde3073. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.036337 30606 tablet_service.cc:1511] Processing CreateTablet for tablet daf3769ea0a34be69a628c90f1f8a721 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:07:48.036556 30665 raft_consensus.cc:359] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:48.037314 30537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10b0408011914710a008d9e9b58f002c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.037521 30665 raft_consensus.cc:385] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:48.037938 30665 raft_consensus.cc:740] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:48.038899 30665 consensus_queue.cc:260] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:48.040542 30457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10b0408011914710a008d9e9b58f002c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.040953 30611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e5fda238ec24b13b992b82bed92951f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.047246 30612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39a5f6c7a19c4fd59922a13945641151. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.049767 30606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daf3769ea0a34be69a628c90f1f8a721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.075044 30539 tablet_service.cc:1511] Processing CreateTablet for tablet 8e5fda238ec24b13b992b82bed92951f (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:07:48.076510 30539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e5fda238ec24b13b992b82bed92951f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.073804 30614 tablet_service.cc:1511] Processing CreateTablet for tablet 7f8b6eff35aa4b96bf5f73d6a94db695 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:07:48.088289 30458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e5fda238ec24b13b992b82bed92951f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.093890 30535 tablet_service.cc:1511] Processing CreateTablet for tablet 39a5f6c7a19c4fd59922a13945641151 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:07:48.095124 30535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39a5f6c7a19c4fd59922a13945641151. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.097148 30534 tablet_service.cc:1511] Processing CreateTablet for tablet daf3769ea0a34be69a628c90f1f8a721 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:07:48.099436 30534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daf3769ea0a34be69a628c90f1f8a721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.067551 30532 tablet_service.cc:1511] Processing CreateTablet for tablet 1f895d2ed89b48cc856a4b80cdde3073 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:07:48.108405 30532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f895d2ed89b48cc856a4b80cdde3073. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.109716 30666 tablet_bootstrap.cc:492] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:48.110165 30666 ts_tablet_manager.cc:1403] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.193s	user 0.014s	sys 0.008s
I20260709 13:07:48.112605 30667 tablet_bootstrap.cc:492] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:48.083796 30462 tablet_service.cc:1511] Processing CreateTablet for tablet 39a5f6c7a19c4fd59922a13945641151 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:07:48.115526 30462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39a5f6c7a19c4fd59922a13945641151. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.117501 30539 tablet_service.cc:1511] Processing CreateTablet for tablet 7f8b6eff35aa4b96bf5f73d6a94db695 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:07:48.124362 30539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f8b6eff35aa4b96bf5f73d6a94db695. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.126731 30609 tablet_service.cc:1511] Processing CreateTablet for tablet 353e93aef12a4b92b159b611a66cf3c3 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:07:48.127844 30614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f8b6eff35aa4b96bf5f73d6a94db695. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.129567 30612 tablet_service.cc:1511] Processing CreateTablet for tablet a999056752144cc99cdd136c40917d2c (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:07:48.131458 30609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 353e93aef12a4b92b159b611a66cf3c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.133596 30612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a999056752144cc99cdd136c40917d2c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:07:48.138455 30422 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:48.135535 30538 tablet_service.cc:1511] Processing CreateTablet for tablet a999056752144cc99cdd136c40917d2c (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:07:48.140735 30538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a999056752144cc99cdd136c40917d2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.141144 30540 tablet_service.cc:1511] Processing CreateTablet for tablet 353e93aef12a4b92b159b611a66cf3c3 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:07:48.148491 30540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 353e93aef12a4b92b159b611a66cf3c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.149518 30459 tablet_service.cc:1511] Processing CreateTablet for tablet 7f8b6eff35aa4b96bf5f73d6a94db695 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:07:48.156554 30459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f8b6eff35aa4b96bf5f73d6a94db695. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.141928 30666 raft_consensus.cc:359] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:48.160017 30666 raft_consensus.cc:385] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:48.160377 30666 raft_consensus.cc:740] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:48.161244 30666 consensus_queue.cc:260] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:48.171768 30610 tablet_service.cc:1511] Processing CreateTablet for tablet 795e206cd48a484a88a226d02f465b8f (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:07:48.166132 30607 tablet_service.cc:1511] Processing CreateTablet for tablet 541099fd564e49f2ad553f250f319fb0 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:07:48.119367 30463 tablet_service.cc:1511] Processing CreateTablet for tablet daf3769ea0a34be69a628c90f1f8a721 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:07:48.167392 30457 tablet_service.cc:1511] Processing CreateTablet for tablet a999056752144cc99cdd136c40917d2c (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:07:48.184485 30463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daf3769ea0a34be69a628c90f1f8a721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.186635 30461 tablet_service.cc:1511] Processing CreateTablet for tablet 795e206cd48a484a88a226d02f465b8f (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:07:48.163097 30465 tablet_service.cc:1511] Processing CreateTablet for tablet 353e93aef12a4b92b159b611a66cf3c3 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:07:48.159178 30533 tablet_service.cc:1511] Processing CreateTablet for tablet 795e206cd48a484a88a226d02f465b8f (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:07:48.183959 30650 heartbeater.cc:499] Master 127.28.173.62:33437 was elected leader, sending a full tablet report...
I20260709 13:07:48.180895 30667 tablet_bootstrap.cc:654] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:48.190948 30461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 795e206cd48a484a88a226d02f465b8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.196308 30665 ts_tablet_manager.cc:1434] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.172s	user 0.017s	sys 0.008s
I20260709 13:07:48.204429 30666 ts_tablet_manager.cc:1434] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.094s	user 0.010s	sys 0.008s
I20260709 13:07:48.208479 30613 tablet_service.cc:1511] Processing CreateTablet for tablet a439756f6e7242f8b5b1ef7ea97874d4 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:07:48.219985 30541 tablet_service.cc:1511] Processing CreateTablet for tablet a439756f6e7242f8b5b1ef7ea97874d4 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:07:48.223295 30457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a999056752144cc99cdd136c40917d2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.224677 30610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 795e206cd48a484a88a226d02f465b8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.234210 30501 heartbeater.cc:499] Master 127.28.173.62:33437 was elected leader, sending a full tablet report...
I20260709 13:07:48.231216 30670 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.237383 30670 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:48.313963 30613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a439756f6e7242f8b5b1ef7ea97874d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.310002 30465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 353e93aef12a4b92b159b611a66cf3c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.310499 30533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 795e206cd48a484a88a226d02f465b8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.317520 30666 tablet_bootstrap.cc:492] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:48.323446 30607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 541099fd564e49f2ad553f250f319fb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.323314 30611 tablet_service.cc:1511] Processing CreateTablet for tablet 34bc3578422e49f4a6025c428fa5d426 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:07:48.325968 30611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34bc3578422e49f4a6025c428fa5d426. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.336733 30608 tablet_service.cc:1511] Processing CreateTablet for tablet b0842494dc2a48d89fb422524082081d (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:07:48.338001 30608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0842494dc2a48d89fb422524082081d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.340157 30535 tablet_service.cc:1511] Processing CreateTablet for tablet 541099fd564e49f2ad553f250f319fb0 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:07:48.342082 30615 tablet_service.cc:1511] Processing CreateTablet for tablet bd3964085c9b4234998aecbbce16d24a (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:07:48.343287 30615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd3964085c9b4234998aecbbce16d24a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.343519 30670 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:48.344872 30609 tablet_service.cc:1511] Processing CreateTablet for tablet f6fb8561d12345948ed56d359f5ef4f3 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:07:48.345166 30466 tablet_service.cc:1511] Processing CreateTablet for tablet a439756f6e7242f8b5b1ef7ea97874d4 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:07:48.346127 30609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6fb8561d12345948ed56d359f5ef4f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.353443 30607 tablet_service.cc:1511] Processing CreateTablet for tablet 0c27ff7cbfd647edb6f31aac3e234914 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:07:48.354671 30607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c27ff7cbfd647edb6f31aac3e234914. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.355098 30613 tablet_service.cc:1511] Processing CreateTablet for tablet d641a3d4c880431b9375d9c775d7be72 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:07:48.356305 30613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d641a3d4c880431b9375d9c775d7be72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.359120 30606 tablet_service.cc:1511] Processing CreateTablet for tablet 5302637c04824f67b70df2f3ee95c130 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:07:48.359920 30665 tablet_bootstrap.cc:492] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:48.368389 30666 tablet_bootstrap.cc:654] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:48.382751 30536 tablet_service.cc:1511] Processing CreateTablet for tablet b0842494dc2a48d89fb422524082081d (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:07:48.387205 30538 tablet_service.cc:1511] Processing CreateTablet for tablet bd3964085c9b4234998aecbbce16d24a (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:07:48.388842 30667 tablet_bootstrap.cc:492] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:48.392400 30463 tablet_service.cc:1511] Processing CreateTablet for tablet 541099fd564e49f2ad553f250f319fb0 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:07:48.396555 30539 tablet_service.cc:1511] Processing CreateTablet for tablet f6fb8561d12345948ed56d359f5ef4f3 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:07:48.397794 30539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6fb8561d12345948ed56d359f5ef4f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.398512 30541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a439756f6e7242f8b5b1ef7ea97874d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.399436 30465 tablet_service.cc:1511] Processing CreateTablet for tablet b0842494dc2a48d89fb422524082081d (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:07:48.400724 30465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0842494dc2a48d89fb422524082081d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.400831 30532 tablet_service.cc:1511] Processing CreateTablet for tablet 0c27ff7cbfd647edb6f31aac3e234914 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:07:48.402079 30532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c27ff7cbfd647edb6f31aac3e234914. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.405184 30462 tablet_service.cc:1511] Processing CreateTablet for tablet 34bc3578422e49f4a6025c428fa5d426 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:07:48.406558 30462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34bc3578422e49f4a6025c428fa5d426. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.409548 30464 tablet_service.cc:1511] Processing CreateTablet for tablet 0c27ff7cbfd647edb6f31aac3e234914 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:07:48.410926 30464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c27ff7cbfd647edb6f31aac3e234914. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.412963 30466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a439756f6e7242f8b5b1ef7ea97874d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.413213 30534 tablet_service.cc:1511] Processing CreateTablet for tablet d641a3d4c880431b9375d9c775d7be72 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:07:48.414539 30534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d641a3d4c880431b9375d9c775d7be72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.414618 30576 heartbeater.cc:499] Master 127.28.173.62:33437 was elected leader, sending a full tablet report...
I20260709 13:07:48.416344 30535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 541099fd564e49f2ad553f250f319fb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.424489 30537 tablet_service.cc:1511] Processing CreateTablet for tablet 34bc3578422e49f4a6025c428fa5d426 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:07:48.426031 30537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34bc3578422e49f4a6025c428fa5d426. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.399452 30457 tablet_service.cc:1511] Processing CreateTablet for tablet f6fb8561d12345948ed56d359f5ef4f3 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:07:48.427949 30667 ts_tablet_manager.cc:1403] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.316s	user 0.049s	sys 0.056s
I20260709 13:07:48.428292 30457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6fb8561d12345948ed56d359f5ef4f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.428546 30613 tablet_service.cc:1511] Processing CreateTablet for tablet cb22806325394ba386d8549bc4a64701 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:07:48.429694 30613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb22806325394ba386d8549bc4a64701. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.430925 30667 raft_consensus.cc:359] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:48.397454 30459 tablet_service.cc:1511] Processing CreateTablet for tablet bd3964085c9b4234998aecbbce16d24a (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:07:48.432534 30459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd3964085c9b4234998aecbbce16d24a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.433077 30536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0842494dc2a48d89fb422524082081d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.433739 30665 tablet_bootstrap.cc:654] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:48.431612 30667 raft_consensus.cc:385] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:48.436776 30667 raft_consensus.cc:740] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:48.437579 30667 consensus_queue.cc:260] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:48.439548 30609 tablet_service.cc:1511] Processing CreateTablet for tablet 53842c918e2c4018ba572aaf3dfbfe31 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:07:48.440868 30609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53842c918e2c4018ba572aaf3dfbfe31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.444656 30606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5302637c04824f67b70df2f3ee95c130. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.437806 30614 tablet_service.cc:1511] Processing CreateTablet for tablet 9e9b511085f1474dbeaa862dd7e9d278 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:07:48.460913 30614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e9b511085f1474dbeaa862dd7e9d278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.467517 30607 tablet_service.cc:1511] Processing CreateTablet for tablet 4859507b516b4f62a81b965e2686e618 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:07:48.468823 30607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4859507b516b4f62a81b965e2686e618. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.476197 30612 tablet_service.cc:1511] Processing CreateTablet for tablet 47d5557143454f988a101125d3b5c0d7 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:07:48.477432 30612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47d5557143454f988a101125d3b5c0d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.480320 30463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 541099fd564e49f2ad553f250f319fb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.485321 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:07:48.486964 30440 leader_election.cc:343] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:48.497529 30461 tablet_service.cc:1511] Processing CreateTablet for tablet d641a3d4c880431b9375d9c775d7be72 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:07:48.499279 30461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d641a3d4c880431b9375d9c775d7be72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.502439 30460 tablet_service.cc:1511] Processing CreateTablet for tablet 5302637c04824f67b70df2f3ee95c130 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:07:48.505867 30458 tablet_service.cc:1511] Processing CreateTablet for tablet 53842c918e2c4018ba572aaf3dfbfe31 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:07:48.508306 30462 tablet_service.cc:1511] Processing CreateTablet for tablet 47d5557143454f988a101125d3b5c0d7 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:07:48.520064 30460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5302637c04824f67b70df2f3ee95c130. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.519940 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:48.520644 30625 raft_consensus.cc:2468] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 0.
I20260709 13:07:48.521102 30608 tablet_service.cc:1511] Processing CreateTablet for tablet 3fac91e8417848ac93fdc9f02381d2d5 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:07:48.521934 30441 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:07:48.522037 30458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53842c918e2c4018ba572aaf3dfbfe31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.523109 30670 raft_consensus.cc:2804] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:48.523471 30670 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:48.523841 30670 raft_consensus.cc:3060] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:48.527803 30608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fac91e8417848ac93fdc9f02381d2d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.531559 30538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd3964085c9b4234998aecbbce16d24a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.536612 30536 tablet_service.cc:1511] Processing CreateTablet for tablet 5302637c04824f67b70df2f3ee95c130 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:07:48.537995 30610 tablet_service.cc:1511] Processing CreateTablet for tablet a14ecc42199f4251b2f85f94871fe61f (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:07:48.539233 30610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a14ecc42199f4251b2f85f94871fe61f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.541237 30540 tablet_service.cc:1511] Processing CreateTablet for tablet 47d5557143454f988a101125d3b5c0d7 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:07:48.535715 30670 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:48.548521 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:07:48.549146 30670 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:48.550235 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:07:48.550805 30625 raft_consensus.cc:3060] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:48.550942 30464 tablet_service.cc:1511] Processing CreateTablet for tablet 9e9b511085f1474dbeaa862dd7e9d278 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:07:48.556319 30540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47d5557143454f988a101125d3b5c0d7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:07:48.556380 30440 leader_election.cc:343] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:48.559464 30625 raft_consensus.cc:2468] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 1.
I20260709 13:07:48.560328 30536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5302637c04824f67b70df2f3ee95c130. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.529754 30462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47d5557143454f988a101125d3b5c0d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.562912 30441 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:07:48.567243 30667 ts_tablet_manager.cc:1434] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.139s	user 0.007s	sys 0.030s
I20260709 13:07:48.568450 30667 tablet_bootstrap.cc:492] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:48.569386 30609 tablet_service.cc:1511] Processing CreateTablet for tablet 8a8b48bc080241c98b3c2b0e1ce8c041 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:07:48.571050 30609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a8b48bc080241c98b3c2b0e1ce8c041. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.571277 30465 tablet_service.cc:1511] Processing CreateTablet for tablet cb22806325394ba386d8549bc4a64701 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:07:48.572532 30465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb22806325394ba386d8549bc4a64701. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.574249 30464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e9b511085f1474dbeaa862dd7e9d278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.577818 30539 tablet_service.cc:1511] Processing CreateTablet for tablet 53842c918e2c4018ba572aaf3dfbfe31 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:07:48.585055 30539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53842c918e2c4018ba572aaf3dfbfe31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.594547 30533 tablet_service.cc:1511] Processing CreateTablet for tablet cb22806325394ba386d8549bc4a64701 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:07:48.595465 30666 tablet_bootstrap.cc:492] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:48.596102 30533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb22806325394ba386d8549bc4a64701. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.596293 30666 ts_tablet_manager.cc:1403] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.292s	user 0.020s	sys 0.024s
I20260709 13:07:48.598124 30457 tablet_service.cc:1511] Processing CreateTablet for tablet 4859507b516b4f62a81b965e2686e618 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:07:48.582325 30534 tablet_service.cc:1511] Processing CreateTablet for tablet 9e9b511085f1474dbeaa862dd7e9d278 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:07:48.605814 30534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e9b511085f1474dbeaa862dd7e9d278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.578490 30670 raft_consensus.cc:2804] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:48.617048 30457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4859507b516b4f62a81b965e2686e618. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.622104 30532 tablet_service.cc:1511] Processing CreateTablet for tablet a14ecc42199f4251b2f85f94871fe61f (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:07:48.623472 30532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a14ecc42199f4251b2f85f94871fe61f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.608840 30670 raft_consensus.cc:697] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:07:48.627432 30670 consensus_queue.cc:237] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:48.629480 30665 tablet_bootstrap.cc:492] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:48.629936 30665 ts_tablet_manager.cc:1403] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.319s	user 0.014s	sys 0.005s
I20260709 13:07:48.631664 30667 tablet_bootstrap.cc:654] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:48.632745 30665 raft_consensus.cc:359] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:48.633484 30665 raft_consensus.cc:385] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:48.633782 30665 raft_consensus.cc:740] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:48.640762 30535 tablet_service.cc:1511] Processing CreateTablet for tablet 3fac91e8417848ac93fdc9f02381d2d5 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:07:48.642038 30535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fac91e8417848ac93fdc9f02381d2d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.649816 30459 tablet_service.cc:1511] Processing CreateTablet for tablet 3fac91e8417848ac93fdc9f02381d2d5 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:07:48.651422 30459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fac91e8417848ac93fdc9f02381d2d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.653659 30466 tablet_service.cc:1511] Processing CreateTablet for tablet a14ecc42199f4251b2f85f94871fe61f (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:07:48.655642 30679 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.656224 30679 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:48.616611 30541 tablet_service.cc:1511] Processing CreateTablet for tablet 4859507b516b4f62a81b965e2686e618 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:07:48.663417 30541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4859507b516b4f62a81b965e2686e618. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.655067 30466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a14ecc42199f4251b2f85f94871fe61f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.665835 30540 tablet_service.cc:1511] Processing CreateTablet for tablet 8a8b48bc080241c98b3c2b0e1ce8c041 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:07:48.661957 30614 tablet_service.cc:1511] Processing CreateTablet for tablet 265fc568d5674c78833106e4eda814f4 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:07:48.681505 30458 tablet_service.cc:1511] Processing CreateTablet for tablet 8a8b48bc080241c98b3c2b0e1ce8c041 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:07:48.683372 30614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 265fc568d5674c78833106e4eda814f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.692310 30540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a8b48bc080241c98b3c2b0e1ce8c041. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.697886 30665 consensus_queue.cc:260] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:48.699081 30608 tablet_service.cc:1511] Processing CreateTablet for tablet 8b8abe384b054cf09bfba7143adf03f1 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
W20260709 13:07:48.700021 30361 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 46978.9us
I20260709 13:07:48.700366 30608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b8abe384b054cf09bfba7143adf03f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.700405 30665 ts_tablet_manager.cc:1434] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.070s	user 0.007s	sys 0.001s
I20260709 13:07:48.701640 30665 tablet_bootstrap.cc:492] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:48.704337 30612 tablet_service.cc:1511] Processing CreateTablet for tablet a0273ed018424f3a9529e09669fdb7b0 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:07:48.707588 30606 tablet_service.cc:1511] Processing CreateTablet for tablet 6a9b619ab6a04af38de048edd085fe3e (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:07:48.719245 30666 raft_consensus.cc:359] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:48.720804 30458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a8b48bc080241c98b3c2b0e1ce8c041. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.725255 30666 raft_consensus.cc:385] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:48.729192 30666 raft_consensus.cc:740] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:48.730208 30666 consensus_queue.cc:260] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:48.742874 30460 tablet_service.cc:1511] Processing CreateTablet for tablet 265fc568d5674c78833106e4eda814f4 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:07:48.746608 30538 tablet_service.cc:1511] Processing CreateTablet for tablet 265fc568d5674c78833106e4eda814f4 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:07:48.751230 30464 tablet_service.cc:1511] Processing CreateTablet for tablet 8b8abe384b054cf09bfba7143adf03f1 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:07:48.752828 30464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b8abe384b054cf09bfba7143adf03f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.752911 30667 tablet_bootstrap.cc:492] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:48.766757 30667 ts_tablet_manager.cc:1403] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.198s	user 0.004s	sys 0.016s
I20260709 13:07:48.767972 30460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 265fc568d5674c78833106e4eda814f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.769737 30667 raft_consensus.cc:359] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:48.770479 30667 raft_consensus.cc:385] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:48.770782 30667 raft_consensus.cc:740] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:48.771631 30667 consensus_queue.cc:260] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:48.723876 30679 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:48.753325 30538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 265fc568d5674c78833106e4eda814f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.751605 30462 tablet_service.cc:1511] Processing CreateTablet for tablet a0273ed018424f3a9529e09669fdb7b0 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:07:48.760411 30612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0273ed018424f3a9529e09669fdb7b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.782330 30536 tablet_service.cc:1511] Processing CreateTablet for tablet a0273ed018424f3a9529e09669fdb7b0 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:07:48.793052 30462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0273ed018424f3a9529e09669fdb7b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.772384 30537 tablet_service.cc:1511] Processing CreateTablet for tablet 8b8abe384b054cf09bfba7143adf03f1 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:07:48.806546 30606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a9b619ab6a04af38de048edd085fe3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.818657 30536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0273ed018424f3a9529e09669fdb7b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.821911 30374 catalog_manager.cc:5697] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 0 to 1, leader changed from <none> to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:48.822441 30610 tablet_service.cc:1511] Processing CreateTablet for tablet d0d5e1e5ef7e43bb80b43baf4b0d0ae4 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:07:48.823698 30610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0d5e1e5ef7e43bb80b43baf4b0d0ae4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.838110 30667 ts_tablet_manager.cc:1434] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.071s	user 0.030s	sys 0.007s
I20260709 13:07:48.839133 30667 tablet_bootstrap.cc:492] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:48.840111 30665 tablet_bootstrap.cc:654] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:48.836051 30537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b8abe384b054cf09bfba7143adf03f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.848286 30538 tablet_service.cc:1511] Processing CreateTablet for tablet d0d5e1e5ef7e43bb80b43baf4b0d0ae4 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:07:48.849444 30533 tablet_service.cc:1511] Processing CreateTablet for tablet 6a9b619ab6a04af38de048edd085fe3e (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:07:48.857890 30461 tablet_service.cc:1511] Processing CreateTablet for tablet 6a9b619ab6a04af38de048edd085fe3e (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:07:48.859143 30461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a9b619ab6a04af38de048edd085fe3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.866258 30463 tablet_service.cc:1511] Processing CreateTablet for tablet d0d5e1e5ef7e43bb80b43baf4b0d0ae4 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:07:48.868042 30463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0d5e1e5ef7e43bb80b43baf4b0d0ae4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.881610 30532 tablet_service.cc:1511] Processing CreateTablet for tablet 1d4c506564124bd5b3a4c756362eee6b (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:07:48.888690 30666 ts_tablet_manager.cc:1434] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.292s	user 0.027s	sys 0.040s
I20260709 13:07:48.892496 30533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a9b619ab6a04af38de048edd085fe3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.899690 30457 tablet_service.cc:1511] Processing CreateTablet for tablet 1d4c506564124bd5b3a4c756362eee6b (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:07:48.900980 30457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d4c506564124bd5b3a4c756362eee6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.902037 30608 tablet_service.cc:1511] Processing CreateTablet for tablet 1d4c506564124bd5b3a4c756362eee6b (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:07:48.903318 30608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d4c506564124bd5b3a4c756362eee6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.904057 30538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0d5e1e5ef7e43bb80b43baf4b0d0ae4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.908424 30666 tablet_bootstrap.cc:492] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:48.908931 30609 tablet_service.cc:1511] Processing CreateTablet for tablet 772a658508f4465d8c1ef039f5bcaa67 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:07:48.910233 30609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 772a658508f4465d8c1ef039f5bcaa67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.926981 30666 tablet_bootstrap.cc:654] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:48.929278 30532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d4c506564124bd5b3a4c756362eee6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.929576 30539 tablet_service.cc:1511] Processing CreateTablet for tablet 772a658508f4465d8c1ef039f5bcaa67 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:07:48.930904 30539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 772a658508f4465d8c1ef039f5bcaa67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.933424 30535 tablet_service.cc:1511] Processing CreateTablet for tablet e6646800b690458391bbff6a6bba535c (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:07:48.933748 30459 tablet_service.cc:1511] Processing CreateTablet for tablet e6646800b690458391bbff6a6bba535c (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:07:48.934811 30535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6646800b690458391bbff6a6bba535c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.940930 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:48.940765 30465 tablet_service.cc:1511] Processing CreateTablet for tablet 772a658508f4465d8c1ef039f5bcaa67 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
W20260709 13:07:48.942517 30516 leader_election.cc:343] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:48.944455 30614 tablet_service.cc:1511] Processing CreateTablet for tablet e6646800b690458391bbff6a6bba535c (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:07:48.945761 30614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6646800b690458391bbff6a6bba535c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.934841 30459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6646800b690458391bbff6a6bba535c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.952121 30465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 772a658508f4465d8c1ef039f5bcaa67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.956168 30464 tablet_service.cc:1511] Processing CreateTablet for tablet 80cbe47dd35948b8b10070e934216d98 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:07:48.957506 30464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80cbe47dd35948b8b10070e934216d98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:48.957958 30670 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.965092 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:48.956436 30534 tablet_service.cc:1511] Processing CreateTablet for tablet 80cbe47dd35948b8b10070e934216d98 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:07:48.968575 30670 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:48.974874 30476 raft_consensus.cc:2468] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 0.
I20260709 13:07:48.976359 30667 tablet_bootstrap.cc:654] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:48.978897 30517 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:48.979964 30670 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:48.980607 30686 raft_consensus.cc:2804] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:48.981020 30686 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:48.981352 30686 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:48.985009 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:07:48.986788 30441 leader_election.cc:343] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:48.989741 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:48.996909 30461 tablet_service.cc:1511] Processing CreateTablet for tablet 7111be574b514751972d70830d3b644f (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:07:48.999017 30461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7111be574b514751972d70830d3b644f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.005844 30612 tablet_service.cc:1511] Processing CreateTablet for tablet 7111be574b514751972d70830d3b644f (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:07:49.007246 30612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7111be574b514751972d70830d3b644f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.006249 30534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80cbe47dd35948b8b10070e934216d98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.019578 30665 tablet_bootstrap.cc:492] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:49.032294 30665 ts_tablet_manager.cc:1403] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.331s	user 0.009s	sys 0.021s
I20260709 13:07:49.021796 30606 tablet_service.cc:1511] Processing CreateTablet for tablet 7e31b2accf3b4a3b8b7668571e619eb7 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:07:49.033847 30606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e31b2accf3b4a3b8b7668571e619eb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.024189 30670 consensus_queue.cc:1048] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:07:49.036794 30538 tablet_service.cc:1511] Processing CreateTablet for tablet 7e31b2accf3b4a3b8b7668571e619eb7 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:07:49.037999 30538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e31b2accf3b4a3b8b7668571e619eb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.038250 30686 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.039539 30551 raft_consensus.cc:2393] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 1: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:07:49.041043 30535 tablet_service.cc:1511] Processing CreateTablet for tablet a2fd6793fef04209ae40ee4d9ba90f42 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:07:49.041265 30440 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:49.022225 30536 tablet_service.cc:1511] Processing CreateTablet for tablet 7111be574b514751972d70830d3b644f (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:07:49.021522 30610 tablet_service.cc:1511] Processing CreateTablet for tablet 80cbe47dd35948b8b10070e934216d98 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:07:49.045424 30610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80cbe47dd35948b8b10070e934216d98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.045091 30609 tablet_service.cc:1511] Processing CreateTablet for tablet a2fd6793fef04209ae40ee4d9ba90f42 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:07:49.046324 30609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2fd6793fef04209ae40ee4d9ba90f42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.042217 30671 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:49.038380 30463 tablet_service.cc:1511] Processing CreateTablet for tablet a2fd6793fef04209ae40ee4d9ba90f42 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:07:49.019574 30458 tablet_service.cc:1511] Processing CreateTablet for tablet 7e31b2accf3b4a3b8b7668571e619eb7 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:07:49.048313 30458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e31b2accf3b4a3b8b7668571e619eb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.054443 30665 raft_consensus.cc:359] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.055162 30665 raft_consensus.cc:385] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.055462 30665 raft_consensus.cc:740] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.056432 30463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2fd6793fef04209ae40ee4d9ba90f42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.042234 30535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2fd6793fef04209ae40ee4d9ba90f42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.072144 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:07:49.072484 30686 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:49.072412 30466 tablet_service.cc:1511] Processing CreateTablet for tablet 2b207fb799ce4340b29ae053898e0e6c (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:07:49.073863 30466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b207fb799ce4340b29ae053898e0e6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.074590 30541 tablet_service.cc:1511] Processing CreateTablet for tablet 2b207fb799ce4340b29ae053898e0e6c (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:07:49.075766 30541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b207fb799ce4340b29ae053898e0e6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.076375 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:07:49.078023 30516 leader_election.cc:343] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.079792 30671 raft_consensus.cc:2749] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:49.063280 30665 consensus_queue.cc:260] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.089905 30665 ts_tablet_manager.cc:1434] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.000s
I20260709 13:07:49.090962 30665 tablet_bootstrap.cc:492] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:49.093672 30476 raft_consensus.cc:2468] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
I20260709 13:07:49.095417 30517 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:49.096518 30686 raft_consensus.cc:2804] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:49.096989 30686 raft_consensus.cc:697] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:07:49.097802 30686 consensus_queue.cc:237] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.110337 30536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7111be574b514751972d70830d3b644f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.117755 30667 tablet_bootstrap.cc:492] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:49.118230 30667 ts_tablet_manager.cc:1403] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.279s	user 0.011s	sys 0.019s
I20260709 13:07:49.120019 30457 tablet_service.cc:1511] Processing CreateTablet for tablet ee49a377a80e4f4199281fb5e44d3be6 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:07:49.121019 30667 raft_consensus.cc:359] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.129881 30666 tablet_bootstrap.cc:492] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:49.130365 30666 ts_tablet_manager.cc:1403] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.222s	user 0.015s	sys 0.006s
I20260709 13:07:49.133746 30666 raft_consensus.cc:359] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.134416 30666 raft_consensus.cc:385] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.134704 30666 raft_consensus.cc:740] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.134930 30457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee49a377a80e4f4199281fb5e44d3be6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.135507 30666 consensus_queue.cc:260] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.137907 30666 ts_tablet_manager.cc:1434] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
W20260709 13:07:49.140863 30422 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:49.138799 30666 tablet_bootstrap.cc:492] T 47ac231e47e64c0c9330e153212ca4b5 P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:49.127445 30667 raft_consensus.cc:385] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.142632 30667 raft_consensus.cc:740] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.143682 30667 consensus_queue.cc:260] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.147650 30667 ts_tablet_manager.cc:1434] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.001s
I20260709 13:07:49.149096 30667 tablet_bootstrap.cc:492] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:49.151465 30614 tablet_service.cc:1511] Processing CreateTablet for tablet ee49a377a80e4f4199281fb5e44d3be6 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:07:49.154583 30614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee49a377a80e4f4199281fb5e44d3be6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.156157 30679 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.156756 30679 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.160363 30679 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:49.162173 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:07:49.163499 30517 leader_election.cc:343] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.181715 30606 tablet_service.cc:1511] Processing CreateTablet for tablet 2b207fb799ce4340b29ae053898e0e6c (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:07:49.182411 30533 tablet_service.cc:1511] Processing CreateTablet for tablet c504e96bd6f14a19b7dfe8203129e4b4 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:07:49.185204 30608 tablet_service.cc:1511] Processing CreateTablet for tablet c504e96bd6f14a19b7dfe8203129e4b4 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:07:49.186689 30667 tablet_bootstrap.cc:654] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.187104 30458 tablet_service.cc:1511] Processing CreateTablet for tablet c504e96bd6f14a19b7dfe8203129e4b4 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:07:49.188364 30458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c504e96bd6f14a19b7dfe8203129e4b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.176764 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:49.196961 30533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c504e96bd6f14a19b7dfe8203129e4b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.197220 30685 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.197669 30685 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:07:49.200084 30516 leader_election.cc:343] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.200521 30516 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:07:49.200762 30440 consensus_peers.cc:597] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:49.205905 30532 tablet_service.cc:1511] Processing CreateTablet for tablet ee49a377a80e4f4199281fb5e44d3be6 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:07:49.207490 30532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee49a377a80e4f4199281fb5e44d3be6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.208614 30685 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:49.202041 30665 tablet_bootstrap.cc:654] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.204288 30686 raft_consensus.cc:2749] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:49.226357 30608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c504e96bd6f14a19b7dfe8203129e4b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.230429 30666 tablet_bootstrap.cc:654] T 47ac231e47e64c0c9330e153212ca4b5 P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.236284 30606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b207fb799ce4340b29ae053898e0e6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.244432 30465 tablet_service.cc:1511] Processing CreateTablet for tablet 99c151771be541b19017860da4f7218d (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:07:49.245702 30465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99c151771be541b19017860da4f7218d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.252739 30610 tablet_service.cc:1511] Processing CreateTablet for tablet 99c151771be541b19017860da4f7218d (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:07:49.253716 30610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99c151771be541b19017860da4f7218d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.258667 30536 tablet_service.cc:1511] Processing CreateTablet for tablet 99c151771be541b19017860da4f7218d (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:07:49.259891 30536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99c151771be541b19017860da4f7218d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.269387 30463 tablet_service.cc:1511] Processing CreateTablet for tablet 7fce027eac834298aeb0b5714096adb1 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:07:49.271387 30463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fce027eac834298aeb0b5714096adb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.279134 30667 tablet_bootstrap.cc:492] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:49.279692 30667 ts_tablet_manager.cc:1403] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.131s	user 0.007s	sys 0.005s
I20260709 13:07:49.279850 30612 tablet_service.cc:1511] Processing CreateTablet for tablet 7fce027eac834298aeb0b5714096adb1 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:07:49.280551 30464 tablet_service.cc:1511] Processing CreateTablet for tablet 5610a33c644c4e539ad503631763aa40 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:07:49.281147 30612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fce027eac834298aeb0b5714096adb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.281728 30464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5610a33c644c4e539ad503631763aa40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.282959 30667 raft_consensus.cc:359] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.283712 30667 raft_consensus.cc:385] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.277410 30541 tablet_service.cc:1511] Processing CreateTablet for tablet 7fce027eac834298aeb0b5714096adb1 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:07:49.286262 30541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fce027eac834298aeb0b5714096adb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.287487 30609 tablet_service.cc:1511] Processing CreateTablet for tablet 5610a33c644c4e539ad503631763aa40 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:07:49.288576 30609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5610a33c644c4e539ad503631763aa40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.294844 30535 tablet_service.cc:1511] Processing CreateTablet for tablet 5610a33c644c4e539ad503631763aa40 (DEFAULT_TABLE table=test-workload [id=887057791fed41a884abbab3e8d4b49f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:07:49.296058 30535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5610a33c644c4e539ad503631763aa40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.305963 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:07:49.307574 30591 leader_election.cc:343] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.284118 30667 raft_consensus.cc:740] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.312986 30667 consensus_queue.cc:260] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.317108 30667 ts_tablet_manager.cc:1434] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 13:07:49.318092 30667 tablet_bootstrap.cc:492] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:49.323215 30686 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.323680 30686 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.325841 30686 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:49.327041 30667 tablet_bootstrap.cc:654] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.327392 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:49.327800 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:49.328043 30624 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 0.
I20260709 13:07:49.329170 30516 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:07:49.330605 30517 leader_election.cc:343] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.332137 30686 raft_consensus.cc:2804] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:49.332508 30686 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.332859 30686 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:49.341908 30665 tablet_bootstrap.cc:492] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:49.342378 30665 ts_tablet_manager.cc:1403] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.252s	user 0.006s	sys 0.010s
I20260709 13:07:49.346041 30665 raft_consensus.cc:359] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.346572 30665 raft_consensus.cc:385] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.346822 30665 raft_consensus.cc:740] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.347622 30665 consensus_queue.cc:260] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.349975 30665 ts_tablet_manager.cc:1434] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:07:49.351927 30686 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.355844 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:07:49.358888 30589 leader_election.cc:343] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.359345 30589 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:07:49.360420 30685 raft_consensus.cc:2749] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:49.362775 30372 catalog_manager.cc:5697] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:49.364141 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:07:49.364708 30665 tablet_bootstrap.cc:492] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:49.364708 30476 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:49.369436 30666 tablet_bootstrap.cc:492] T 47ac231e47e64c0c9330e153212ca4b5 P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:49.370082 30666 ts_tablet_manager.cc:1403] T 47ac231e47e64c0c9330e153212ca4b5 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.231s	user 0.006s	sys 0.005s
I20260709 13:07:49.371403 30665 tablet_bootstrap.cc:654] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.373822 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:07:49.374606 30624 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:49.374907 30476 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
I20260709 13:07:49.376444 30517 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:07:49.377447 30679 raft_consensus.cc:2804] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:49.384094 30624 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
I20260709 13:07:49.386296 30686 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:49.388345 30667 tablet_bootstrap.cc:492] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:49.388823 30667 ts_tablet_manager.cc:1403] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.071s	user 0.026s	sys 0.027s
I20260709 13:07:49.388672 30666 raft_consensus.cc:359] T 47ac231e47e64c0c9330e153212ca4b5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.389400 30666 raft_consensus.cc:385] T 47ac231e47e64c0c9330e153212ca4b5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.389712 30666 raft_consensus.cc:740] T 47ac231e47e64c0c9330e153212ca4b5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.390472 30666 consensus_queue.cc:260] T 47ac231e47e64c0c9330e153212ca4b5 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.391842 30667 raft_consensus.cc:359] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.392545 30667 raft_consensus.cc:385] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.392740 30666 ts_tablet_manager.cc:1434] T 47ac231e47e64c0c9330e153212ca4b5 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 13:07:49.392839 30667 raft_consensus.cc:740] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.393743 30666 tablet_bootstrap.cc:492] T 1a418ef882d34180817469c4e2495268 P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:49.393595 30667 consensus_queue.cc:260] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.395689 30667 ts_tablet_manager.cc:1434] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:07:49.397123 30667 tablet_bootstrap.cc:492] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:49.400231 30666 tablet_bootstrap.cc:654] T 1a418ef882d34180817469c4e2495268 P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.403206 30667 tablet_bootstrap.cc:654] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.414558 30666 tablet_bootstrap.cc:492] T 1a418ef882d34180817469c4e2495268 P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:49.415004 30666 ts_tablet_manager.cc:1403] T 1a418ef882d34180817469c4e2495268 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.002s
I20260709 13:07:49.418006 30666 raft_consensus.cc:359] T 1a418ef882d34180817469c4e2495268 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.418725 30666 raft_consensus.cc:385] T 1a418ef882d34180817469c4e2495268 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.419014 30666 raft_consensus.cc:740] T 1a418ef882d34180817469c4e2495268 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.419618 30679 raft_consensus.cc:697] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:07:49.419728 30667 tablet_bootstrap.cc:492] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:49.419852 30666 consensus_queue.cc:260] T 1a418ef882d34180817469c4e2495268 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.420419 30667 ts_tablet_manager.cc:1403] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.012s
I20260709 13:07:49.420558 30679 consensus_queue.cc:237] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.423382 30667 raft_consensus.cc:359] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.425541 30667 raft_consensus.cc:385] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.425910 30667 raft_consensus.cc:740] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.426770 30667 consensus_queue.cc:260] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.427296 30666 ts_tablet_manager.cc:1434] T 1a418ef882d34180817469c4e2495268 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 13:07:49.428339 30666 tablet_bootstrap.cc:492] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:49.428613 30665 tablet_bootstrap.cc:492] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:49.429090 30665 ts_tablet_manager.cc:1403] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.065s	user 0.012s	sys 0.037s
I20260709 13:07:49.429270 30667 ts_tablet_manager.cc:1434] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:07:49.430300 30667 tablet_bootstrap.cc:492] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:49.432366 30665 raft_consensus.cc:359] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.433235 30665 raft_consensus.cc:385] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.433537 30665 raft_consensus.cc:740] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.434320 30665 consensus_queue.cc:260] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.437008 30667 tablet_bootstrap.cc:654] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.439682 30665 ts_tablet_manager.cc:1434] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:07:49.439041 30373 catalog_manager.cc:5697] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:49.440661 30665 tablet_bootstrap.cc:492] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:49.443949 30666 tablet_bootstrap.cc:654] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.447117 30665 tablet_bootstrap.cc:654] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.453919 30667 tablet_bootstrap.cc:492] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:49.454470 30667 ts_tablet_manager.cc:1403] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.008s
I20260709 13:07:49.454953 30679 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.455475 30679 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.453945 30666 tablet_bootstrap.cc:492] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:49.457249 30667 raft_consensus.cc:359] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.457834 30666 ts_tablet_manager.cc:1403] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.005s
I20260709 13:07:49.458099 30667 raft_consensus.cc:385] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.458424 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:49.458423 30667 raft_consensus.cc:740] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.459789 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:49.460449 30667 consensus_queue.cc:260] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:07:49.461150 30517 leader_election.cc:343] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.460446 30624 raft_consensus.cc:2468] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 0.
I20260709 13:07:49.461494 30666 raft_consensus.cc:359] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.460031 30665 tablet_bootstrap.cc:492] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:49.462231 30666 raft_consensus.cc:385] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.462548 30666 raft_consensus.cc:740] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.462632 30665 ts_tablet_manager.cc:1403] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.022s	user 0.004s	sys 0.008s
I20260709 13:07:49.462755 30667 ts_tablet_manager.cc:1434] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:07:49.463021 30679 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:49.462905 30516 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:07:49.463760 30667 tablet_bootstrap.cc:492] T 48914655f9d44751a883e36b566dcefd P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:49.463428 30666 consensus_queue.cc:260] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.464174 30679 raft_consensus.cc:2804] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:49.466715 30679 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.467130 30679 raft_consensus.cc:3060] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:49.467635 30671 raft_consensus.cc:493] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.468116 30671 raft_consensus.cc:515] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.465792 30666 ts_tablet_manager.cc:1434] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:07:49.469637 30666 tablet_bootstrap.cc:492] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:49.469831 30667 tablet_bootstrap.cc:654] T 48914655f9d44751a883e36b566dcefd P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.470088 30671 leader_election.cc:290] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:49.472738 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:07:49.474471 30441 leader_election.cc:343] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.474658 30679 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.476177 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:49.476765 30551 raft_consensus.cc:2468] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 0.
I20260709 13:07:49.477945 30679 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:49.478171 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:07:49.478957 30624 raft_consensus.cc:3060] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:49.481353 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:07:49.482116 30665 raft_consensus.cc:359] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.482882 30665 raft_consensus.cc:385] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:07:49.483014 30517 leader_election.cc:343] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.483237 30665 raft_consensus.cc:740] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.483227 30440 leader_election.cc:304] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:49.484330 30665 consensus_queue.cc:260] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.485306 30670 raft_consensus.cc:2804] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:49.485661 30670 raft_consensus.cc:493] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.485965 30670 raft_consensus.cc:3060] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:49.492689 30670 raft_consensus.cc:515] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.494901 30666 tablet_bootstrap.cc:654] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.495394 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:07:49.495689 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:07:49.495968 30551 raft_consensus.cc:3060] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:49.497012 30441 leader_election.cc:343] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.491727 30624 raft_consensus.cc:2468] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
I20260709 13:07:49.499989 30516 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:07:49.501093 30679 raft_consensus.cc:2804] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:49.502234 30679 raft_consensus.cc:697] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:07:49.502408 30667 tablet_bootstrap.cc:492] T 48914655f9d44751a883e36b566dcefd P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:49.502985 30667 ts_tablet_manager.cc:1403] T 48914655f9d44751a883e36b566dcefd P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.022s
I20260709 13:07:49.499104 30670 leader_election.cc:290] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:49.503057 30679 consensus_queue.cc:237] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.498808 30665 ts_tablet_manager.cc:1434] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.033s	user 0.002s	sys 0.004s
I20260709 13:07:49.505654 30551 raft_consensus.cc:2468] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 1.
I20260709 13:07:49.506779 30440 leader_election.cc:304] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:49.506503 30667 raft_consensus.cc:359] T 48914655f9d44751a883e36b566dcefd P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.507377 30667 raft_consensus.cc:385] T 48914655f9d44751a883e36b566dcefd P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.507704 30667 raft_consensus.cc:740] T 48914655f9d44751a883e36b566dcefd P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.508524 30667 consensus_queue.cc:260] T 48914655f9d44751a883e36b566dcefd P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.511106 30667 ts_tablet_manager.cc:1434] T 48914655f9d44751a883e36b566dcefd P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:07:49.511675 30670 raft_consensus.cc:2804] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:49.512241 30667 tablet_bootstrap.cc:492] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:49.512470 30670 raft_consensus.cc:697] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:07:49.512902 30707 consensus_queue.cc:1048] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:49.513706 30670 consensus_queue.cc:237] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.520033 30667 tablet_bootstrap.cc:654] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.520251 30665 tablet_bootstrap.cc:492] T aa9b623a9a0446ca90b350e140072cb4 P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:49.526024 30707 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.526638 30707 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.530860 30686 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.531423 30686 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.533502 30686 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:49.534257 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:49.540198 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:49.541023 30624 raft_consensus.cc:2468] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 0.
I20260709 13:07:49.542775 30516 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:07:49.543713 30686 raft_consensus.cc:2804] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:49.544240 30686 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:49.544314 30517 leader_election.cc:343] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.544615 30686 raft_consensus.cc:3060] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:49.562052 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:07:49.563376 30516 leader_election.cc:343] T 48914655f9d44751a883e36b566dcefd P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.563938 30707 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:49.565310 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:49.565639 30686 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:07:49.567258 30517 leader_election.cc:343] T 48914655f9d44751a883e36b566dcefd P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.567718 30517 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:49.571435 30686 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:49.572533 30686 raft_consensus.cc:2749] T 48914655f9d44751a883e36b566dcefd P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:49.577577 30372 catalog_manager.cc:5697] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:49.583675 30671 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.584296 30671 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.586936 30671 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:49.589094 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:49.589902 30551 raft_consensus.cc:2468] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 0.
I20260709 13:07:49.591583 30440 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:07:49.579632 30625 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:49.572852 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:07:49.572554 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:07:49.597553 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:07:49.604007 30441 leader_election.cc:343] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.605122 30624 raft_consensus.cc:3060] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:49.612468 30517 leader_election.cc:343] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.602272 30671 raft_consensus.cc:2804] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:49.616297 30671 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.620164 30671 raft_consensus.cc:3060] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:49.661275 30624 raft_consensus.cc:2468] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
I20260709 13:07:49.668689 30720 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.669795 30666 tablet_bootstrap.cc:492] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:49.676951 30666 ts_tablet_manager.cc:1403] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.207s	user 0.078s	sys 0.102s
I20260709 13:07:49.676855 30516 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:07:49.673444 30679 consensus_queue.cc:1048] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:49.680351 30679 raft_consensus.cc:2804] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:49.680933 30679 raft_consensus.cc:697] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:07:49.681198 30666 raft_consensus.cc:359] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.682296 30666 raft_consensus.cc:385] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.681990 30679 consensus_queue.cc:237] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.682870 30666 raft_consensus.cc:740] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.684147 30666 consensus_queue.cc:260] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.686631 30666 ts_tablet_manager.cc:1434] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.005s
I20260709 13:07:49.691943 30666 tablet_bootstrap.cc:492] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:49.688494 30671 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.698129 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:07:49.698676 30551 raft_consensus.cc:3060] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:49.698598 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:07:49.699978 30441 leader_election.cc:343] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.687029 30720 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.701884 30666 tablet_bootstrap.cc:654] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.702759 30720 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:49.702824 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:49.704115 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:49.704681 30623 raft_consensus.cc:2468] T 47ac231e47e64c0c9330e153212ca4b5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 0.
I20260709 13:07:49.704962 30671 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:49.704589 30372 catalog_manager.cc:5697] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 0 to 1, leader changed from <none> to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:49.706027 30440 leader_election.cc:343] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.707266 30441 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:07:49.708112 30670 raft_consensus.cc:2804] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:49.708459 30670 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.708796 30670 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:49.695663 30667 tablet_bootstrap.cc:492] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:49.712723 30667 ts_tablet_manager.cc:1403] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.201s	user 0.061s	sys 0.105s
I20260709 13:07:49.714637 30551 raft_consensus.cc:2468] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 1.
I20260709 13:07:49.718309 30440 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:49.719360 30671 raft_consensus.cc:2804] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:49.719797 30671 raft_consensus.cc:697] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:07:49.720574 30671 consensus_queue.cc:237] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.726222 30670 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.716909 30667 raft_consensus.cc:359] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.728343 30667 raft_consensus.cc:385] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.729007 30667 raft_consensus.cc:740] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.733333 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:07:49.734948 30670 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:49.736608 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:07:49.740366 30622 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:49.740913 30667 consensus_queue.cc:260] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.741811 30551 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:49.743317 30373 catalog_manager.cc:5697] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:49.739050 30372 catalog_manager.cc:5697] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 0 to 1, leader changed from <none> to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:49.675403 30665 tablet_bootstrap.cc:654] T aa9b623a9a0446ca90b350e140072cb4 P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.749557 30622 raft_consensus.cc:2468] T 47ac231e47e64c0c9330e153212ca4b5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 1.
I20260709 13:07:49.750847 30441 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:07:49.751864 30670 raft_consensus.cc:2804] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:49.752374 30670 raft_consensus.cc:697] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:07:49.753489 30551 raft_consensus.cc:2468] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 1.
I20260709 13:07:49.753337 30670 consensus_queue.cc:237] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.759006 30667 ts_tablet_manager.cc:1434] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 13:07:49.769429 30667 tablet_bootstrap.cc:492] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:49.775506 30667 tablet_bootstrap.cc:654] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.779305 30666 tablet_bootstrap.cc:492] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:49.779796 30666 ts_tablet_manager.cc:1403] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.088s	user 0.045s	sys 0.037s
I20260709 13:07:49.782377 30666 raft_consensus.cc:359] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.783085 30666 raft_consensus.cc:385] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.783393 30666 raft_consensus.cc:740] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.784086 30666 consensus_queue.cc:260] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.784893 30667 tablet_bootstrap.cc:492] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:49.785336 30667 ts_tablet_manager.cc:1403] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.004s
I20260709 13:07:49.786038 30665 tablet_bootstrap.cc:492] T aa9b623a9a0446ca90b350e140072cb4 P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:49.786484 30665 ts_tablet_manager.cc:1403] T aa9b623a9a0446ca90b350e140072cb4 P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.279s	user 0.007s	sys 0.007s
I20260709 13:07:49.786538 30666 ts_tablet_manager.cc:1434] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:07:49.787633 30666 tablet_bootstrap.cc:492] T 0a6e86e0a4b843478d5970b29ad63ad7 P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:49.787880 30667 raft_consensus.cc:359] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.788537 30667 raft_consensus.cc:385] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.788807 30667 raft_consensus.cc:740] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.789456 30667 consensus_queue.cc:260] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.790416 30665 raft_consensus.cc:359] T aa9b623a9a0446ca90b350e140072cb4 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.791091 30665 raft_consensus.cc:385] T aa9b623a9a0446ca90b350e140072cb4 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.791391 30667 ts_tablet_manager.cc:1434] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:07:49.791354 30665 raft_consensus.cc:740] T aa9b623a9a0446ca90b350e140072cb4 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.792119 30665 consensus_queue.cc:260] T aa9b623a9a0446ca90b350e140072cb4 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.792888 30670 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.793181 30666 tablet_bootstrap.cc:654] T 0a6e86e0a4b843478d5970b29ad63ad7 P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.793442 30670 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.794413 30665 ts_tablet_manager.cc:1434] T aa9b623a9a0446ca90b350e140072cb4 P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:07:49.797353 30665 tablet_bootstrap.cc:492] T 606c3ee77596493da2daa40edde4d1ea P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:49.795059 30667 tablet_bootstrap.cc:492] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:49.802858 30665 tablet_bootstrap.cc:654] T 606c3ee77596493da2daa40edde4d1ea P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.805344 30667 tablet_bootstrap.cc:654] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.806823 30670 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:49.808051 30373 catalog_manager.cc:5697] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 0 to 1, leader changed from <none> to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:49.814435 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:49.816119 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:49.817088 30624 raft_consensus.cc:2393] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 1: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:07:49.819602 30440 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:49.822052 30670 raft_consensus.cc:3060] T aa9b623a9a0446ca90b350e140072cb4 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:49.829919 30665 tablet_bootstrap.cc:492] T 606c3ee77596493da2daa40edde4d1ea P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:49.830546 30665 ts_tablet_manager.cc:1403] T 606c3ee77596493da2daa40edde4d1ea P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.004s
I20260709 13:07:49.835058 30670 raft_consensus.cc:2749] T aa9b623a9a0446ca90b350e140072cb4 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:49.834313 30665 raft_consensus.cc:359] T 606c3ee77596493da2daa40edde4d1ea P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.836241 30665 raft_consensus.cc:385] T 606c3ee77596493da2daa40edde4d1ea P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.836586 30665 raft_consensus.cc:740] T 606c3ee77596493da2daa40edde4d1ea P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.837414 30665 consensus_queue.cc:260] T 606c3ee77596493da2daa40edde4d1ea P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.838039 30666 tablet_bootstrap.cc:492] T 0a6e86e0a4b843478d5970b29ad63ad7 P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:49.838588 30666 ts_tablet_manager.cc:1403] T 0a6e86e0a4b843478d5970b29ad63ad7 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.033s
I20260709 13:07:49.840004 30665 ts_tablet_manager.cc:1434] T 606c3ee77596493da2daa40edde4d1ea P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.002s
I20260709 13:07:49.841176 30665 tablet_bootstrap.cc:492] T dfc9f90b82b84a8cb47cbee7adb0401a P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:49.841610 30666 raft_consensus.cc:359] T 0a6e86e0a4b843478d5970b29ad63ad7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.842321 30666 raft_consensus.cc:385] T 0a6e86e0a4b843478d5970b29ad63ad7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.842645 30666 raft_consensus.cc:740] T 0a6e86e0a4b843478d5970b29ad63ad7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.843314 30666 consensus_queue.cc:260] T 0a6e86e0a4b843478d5970b29ad63ad7 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.846692 30666 ts_tablet_manager.cc:1434] T 0a6e86e0a4b843478d5970b29ad63ad7 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:07:49.847354 30665 tablet_bootstrap.cc:654] T dfc9f90b82b84a8cb47cbee7adb0401a P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.848481 30667 tablet_bootstrap.cc:492] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:49.849505 30667 ts_tablet_manager.cc:1403] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.055s	user 0.030s	sys 0.016s
I20260709 13:07:49.849059 30666 tablet_bootstrap.cc:492] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:49.851759 30667 raft_consensus.cc:359] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.852527 30667 raft_consensus.cc:385] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.853204 30667 raft_consensus.cc:740] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.853879 30667 consensus_queue.cc:260] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.857620 30666 tablet_bootstrap.cc:654] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.859748 30667 ts_tablet_manager.cc:1434] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:07:49.860957 30667 tablet_bootstrap.cc:492] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:49.872038 30667 tablet_bootstrap.cc:654] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.877869 30666 tablet_bootstrap.cc:492] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:49.878363 30666 ts_tablet_manager.cc:1403] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.007s
I20260709 13:07:49.879237 30667 tablet_bootstrap.cc:492] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:49.879647 30667 ts_tablet_manager.cc:1403] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.019s	user 0.003s	sys 0.008s
I20260709 13:07:49.880985 30666 raft_consensus.cc:359] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.881670 30666 raft_consensus.cc:385] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.881973 30666 raft_consensus.cc:740] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.881982 30667 raft_consensus.cc:359] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.882732 30667 raft_consensus.cc:385] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.882390 30679 consensus_queue.cc:1048] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:49.883029 30667 raft_consensus.cc:740] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.882911 30666 consensus_queue.cc:260] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.883726 30667 consensus_queue.cc:260] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.885382 30666 ts_tablet_manager.cc:1434] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:07:49.885514 30667 ts_tablet_manager.cc:1434] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.002s
I20260709 13:07:49.886260 30667 tablet_bootstrap.cc:492] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:49.886276 30666 tablet_bootstrap.cc:492] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:49.890425 30665 tablet_bootstrap.cc:492] T dfc9f90b82b84a8cb47cbee7adb0401a P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:49.890916 30665 ts_tablet_manager.cc:1403] T dfc9f90b82b84a8cb47cbee7adb0401a P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.050s	user 0.021s	sys 0.029s
I20260709 13:07:49.893052 30666 tablet_bootstrap.cc:654] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.893985 30665 raft_consensus.cc:359] T dfc9f90b82b84a8cb47cbee7adb0401a P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.894726 30665 raft_consensus.cc:385] T dfc9f90b82b84a8cb47cbee7adb0401a P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.895056 30665 raft_consensus.cc:740] T dfc9f90b82b84a8cb47cbee7adb0401a P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.895781 30665 consensus_queue.cc:260] T dfc9f90b82b84a8cb47cbee7adb0401a P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.897132 30686 consensus_queue.cc:1048] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:49.902163 30665 ts_tablet_manager.cc:1434] T dfc9f90b82b84a8cb47cbee7adb0401a P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.011s	user 0.000s	sys 0.005s
I20260709 13:07:49.903119 30665 tablet_bootstrap.cc:492] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:49.905330 30667 tablet_bootstrap.cc:654] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.920250 30665 tablet_bootstrap.cc:654] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.924512 30666 tablet_bootstrap.cc:492] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:49.925108 30666 ts_tablet_manager.cc:1403] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.039s	user 0.006s	sys 0.015s
I20260709 13:07:49.925918 30667 tablet_bootstrap.cc:492] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:49.926792 30667 ts_tablet_manager.cc:1403] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.041s	user 0.021s	sys 0.001s
I20260709 13:07:49.927522 30666 raft_consensus.cc:359] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.928263 30666 raft_consensus.cc:385] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.928552 30666 raft_consensus.cc:740] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.929179 30667 raft_consensus.cc:359] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.929191 30666 consensus_queue.cc:260] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.929936 30667 raft_consensus.cc:385] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.930039 30665 tablet_bootstrap.cc:492] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:49.931253 30665 ts_tablet_manager.cc:1403] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.001s
I20260709 13:07:49.931527 30666 ts_tablet_manager.cc:1434] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
I20260709 13:07:49.930310 30667 raft_consensus.cc:740] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.932367 30667 consensus_queue.cc:260] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.934640 30667 ts_tablet_manager.cc:1434] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:07:49.935199 30686 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.935644 30686 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.936429 30665 raft_consensus.cc:359] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.937017 30665 raft_consensus.cc:385] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.937290 30665 raft_consensus.cc:740] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.937676 30686 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:49.937878 30665 consensus_queue.cc:260] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.938477 30686 consensus_queue.cc:1048] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:49.938784 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:49.939838 30665 ts_tablet_manager.cc:1434] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.000s
I20260709 13:07:49.939953 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:49.940683 30665 tablet_bootstrap.cc:492] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:49.941228 30666 tablet_bootstrap.cc:492] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:49.941365 30517 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:49.942704 30686 raft_consensus.cc:2749] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:49.946971 30665 tablet_bootstrap.cc:654] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.948369 30666 tablet_bootstrap.cc:654] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.955981 30686 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.956593 30686 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.960112 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:49.960861 30476 raft_consensus.cc:2468] T dfc9f90b82b84a8cb47cbee7adb0401a P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 0.
I20260709 13:07:49.962415 30517 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:07:49.963405 30707 raft_consensus.cc:2804] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:49.964004 30707 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.964425 30707 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:49.965835 30667 tablet_bootstrap.cc:492] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:49.974090 30667 tablet_bootstrap.cc:654] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:49.975850 30679 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.976362 30679 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.977445 30686 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:49.978410 30679 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:49.979616 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:49.980252 30622 raft_consensus.cc:2468] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 0.
I20260709 13:07:49.982782 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:07:49.984118 30516 leader_election.cc:343] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.986346 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:49.987783 30667 tablet_bootstrap.cc:492] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
W20260709 13:07:49.987927 30517 leader_election.cc:343] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:49.988454 30667 ts_tablet_manager.cc:1403] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.005s
I20260709 13:07:49.988559 30517 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:49.989750 30679 raft_consensus.cc:2749] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:49.991091 30707 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.991973 30667 raft_consensus.cc:359] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:49.992846 30667 raft_consensus.cc:385] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:49.993170 30667 raft_consensus.cc:740] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:49.994469 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:07:49.995177 30476 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:49.998265 30670 consensus_queue.cc:1048] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:50.007258 30707 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:50.007886 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:07:50.008466 30622 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.009397 30476 raft_consensus.cc:2468] T dfc9f90b82b84a8cb47cbee7adb0401a P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
I20260709 13:07:50.010842 30517 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:07:50.011852 30707 raft_consensus.cc:2804] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:50.012763 30707 raft_consensus.cc:697] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:07:50.013670 30707 consensus_queue.cc:237] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.020617 30622 raft_consensus.cc:2468] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
I20260709 13:07:50.021034 30667 consensus_queue.cc:260] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.031376 30476 raft_consensus.cc:3060] T 606c3ee77596493da2daa40edde4d1ea P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.033648 30622 raft_consensus.cc:3060] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.033867 30667 ts_tablet_manager.cc:1434] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.001s
I20260709 13:07:50.037922 30667 tablet_bootstrap.cc:492] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:50.036334 30665 tablet_bootstrap.cc:492] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:50.040278 30665 ts_tablet_manager.cc:1403] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.100s	user 0.037s	sys 0.054s
I20260709 13:07:50.042930 30667 tablet_bootstrap.cc:654] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.043077 30665 raft_consensus.cc:359] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.043876 30665 raft_consensus.cc:385] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.044236 30665 raft_consensus.cc:740] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.045046 30665 consensus_queue.cc:260] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.048695 30722 consensus_queue.cc:1048] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:50.053472 30665 ts_tablet_manager.cc:1434] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:07:50.055106 30665 tablet_bootstrap.cc:492] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:50.073309 30686 consensus_queue.cc:1048] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:50.077946 30666 tablet_bootstrap.cc:492] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:50.078439 30666 ts_tablet_manager.cc:1403] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.137s	user 0.035s	sys 0.056s
I20260709 13:07:50.082159 30685 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.082415 30667 tablet_bootstrap.cc:492] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:50.082628 30685 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.083012 30667 ts_tablet_manager.cc:1403] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.045s	user 0.005s	sys 0.009s
I20260709 13:07:50.083192 30666 raft_consensus.cc:359] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.083900 30666 raft_consensus.cc:385] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.084146 30666 raft_consensus.cc:740] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.084786 30685 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:50.084754 30666 consensus_queue.cc:260] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.086599 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:50.086925 30666 ts_tablet_manager.cc:1434] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:07:50.087203 30551 raft_consensus.cc:2468] T 48914655f9d44751a883e36b566dcefd P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 0.
I20260709 13:07:50.087824 30666 tablet_bootstrap.cc:492] T 85088611c7e34066afbf929fc1cbe50d P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:50.088629 30589 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:07:50.089519 30685 raft_consensus.cc:2804] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:50.089852 30685 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.090359 30685 raft_consensus.cc:3060] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.093827 30667 raft_consensus.cc:359] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.094719 30667 raft_consensus.cc:385] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.095069 30667 raft_consensus.cc:740] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.096752 30667 consensus_queue.cc:260] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.099470 30667 ts_tablet_manager.cc:1434] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:07:50.099515 30666 tablet_bootstrap.cc:654] T 85088611c7e34066afbf929fc1cbe50d P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.100445 30667 tablet_bootstrap.cc:492] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:50.096156 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:50.101606 30476 raft_consensus.cc:2468] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 0.
I20260709 13:07:50.104955 30665 tablet_bootstrap.cc:654] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.113433 30667 tablet_bootstrap.cc:654] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.116051 30685 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.119277 30685 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:50.119973 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:07:50.120672 30476 raft_consensus.cc:3060] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.121027 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:07:50.121634 30551 raft_consensus.cc:3060] T 48914655f9d44751a883e36b566dcefd P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.125276 30720 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.125939 30720 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.129659 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:50.130522 30550 raft_consensus.cc:2468] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 0.
I20260709 13:07:50.133563 30476 raft_consensus.cc:2468] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 1.
I20260709 13:07:50.133817 30720 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:50.133674 30440 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:07:50.135763 30591 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:07:50.137313 30707 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.138089 30707 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.129709 30373 catalog_manager.cc:5697] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:50.140198 30707 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:50.137121 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:50.141295 30624 raft_consensus.cc:2468] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 0.
I20260709 13:07:50.141844 30551 raft_consensus.cc:2468] T 48914655f9d44751a883e36b566dcefd P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 1.
I20260709 13:07:50.145025 30722 raft_consensus.cc:2804] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:50.145387 30722 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.145660 30722 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.147145 30685 raft_consensus.cc:2804] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:50.148777 30666 tablet_bootstrap.cc:492] T 85088611c7e34066afbf929fc1cbe50d P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:50.149359 30666 ts_tablet_manager.cc:1403] T 85088611c7e34066afbf929fc1cbe50d P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.062s	user 0.009s	sys 0.013s
I20260709 13:07:50.150352 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:07:50.151722 30517 leader_election.cc:343] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.152338 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:50.152925 30624 raft_consensus.cc:2468] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 0.
I20260709 13:07:50.156369 30516 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:07:50.158188 30686 raft_consensus.cc:2804] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:50.158543 30686 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.159006 30686 raft_consensus.cc:3060] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:50.164036 30422 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:50.167987 30707 consensus_queue.cc:1048] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:07:50.175036 30551 raft_consensus.cc:3060] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.184142 30624 raft_consensus.cc:3060] T 0a6e86e0a4b843478d5970b29ad63ad7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.194967 30665 tablet_bootstrap.cc:492] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:50.195364 30665 ts_tablet_manager.cc:1403] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.141s	user 0.012s	sys 0.016s
I20260709 13:07:50.206924 30665 raft_consensus.cc:359] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.207501 30671 consensus_queue.cc:1048] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:50.209832 30665 raft_consensus.cc:385] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.210276 30665 raft_consensus.cc:740] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.211090 30665 consensus_queue.cc:260] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.214282 30665 ts_tablet_manager.cc:1434] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:07:50.218572 30685 raft_consensus.cc:697] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:07:50.219831 30685 consensus_queue.cc:237] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.219949 30667 tablet_bootstrap.cc:492] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:50.226353 30667 ts_tablet_manager.cc:1403] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.126s	user 0.027s	sys 0.009s
I20260709 13:07:50.226673 30666 raft_consensus.cc:359] T 85088611c7e34066afbf929fc1cbe50d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.225754 30665 tablet_bootstrap.cc:492] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:50.227301 30666 raft_consensus.cc:385] T 85088611c7e34066afbf929fc1cbe50d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.227757 30666 raft_consensus.cc:740] T 85088611c7e34066afbf929fc1cbe50d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.229528 30722 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.230489 30671 consensus_queue.cc:1048] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:50.230429 30666 consensus_queue.cc:260] T 85088611c7e34066afbf929fc1cbe50d P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.233034 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:07:50.233587 30550 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.233603 30686 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.242027 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:07:50.245949 30686 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:07:50.249545 30517 leader_election.cc:343] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.244192 30722 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:50.250407 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:07:50.250995 30625 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.251380 30667 raft_consensus.cc:359] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.252331 30667 raft_consensus.cc:385] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.252724 30667 raft_consensus.cc:740] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.255499 30755 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.256279 30755 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.286396 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:07:50.289045 30517 leader_election.cc:343] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.278986 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:07:50.296393 30621 raft_consensus.cc:3060] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.314123 30550 raft_consensus.cc:2468] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 1.
I20260709 13:07:50.317682 30440 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:07:50.318732 30722 raft_consensus.cc:2804] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:50.319294 30722 raft_consensus.cc:697] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:07:50.320138 30722 consensus_queue.cc:237] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.321350 30666 ts_tablet_manager.cc:1434] T 85088611c7e34066afbf929fc1cbe50d P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.172s	user 0.018s	sys 0.027s
I20260709 13:07:50.322256 30666 tablet_bootstrap.cc:492] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:50.339939 30625 raft_consensus.cc:2468] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 1.
I20260709 13:07:50.349215 30667 consensus_queue.cc:260] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.353653 30667 ts_tablet_manager.cc:1434] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.127s	user 0.008s	sys 0.001s
I20260709 13:07:50.355304 30667 tablet_bootstrap.cc:492] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:50.356988 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:50.357725 30720 consensus_queue.cc:1048] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:07:50.360394 30516 leader_election.cc:343] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.351951 30755 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:50.360849 30516 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:50.361402 30755 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.361873 30679 raft_consensus.cc:2749] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:50.361904 30755 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.366941 30707 consensus_queue.cc:1048] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:50.385135 30621 raft_consensus.cc:2468] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
I20260709 13:07:50.366971 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:50.378701 30755 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:50.406909 30516 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:07:50.421701 30665 tablet_bootstrap.cc:654] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:50.424456 30517 leader_election.cc:343] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.423282 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:50.415143 30755 raft_consensus.cc:2804] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:50.432516 30754 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
W20260709 13:07:50.432768 30516 leader_election.cc:343] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.433082 30754 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.433383 30516 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:50.435559 30686 raft_consensus.cc:2749] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:50.432299 30755 raft_consensus.cc:697] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:07:50.437985 30666 tablet_bootstrap.cc:654] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.429075 30722 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.440716 30722 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.445765 30667 tablet_bootstrap.cc:654] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.437071 30755 consensus_queue.cc:237] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.448468 30722 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:50.450605 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:50.454699 30622 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 0.
I20260709 13:07:50.458307 30441 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:07:50.458845 30372 catalog_manager.cc:5697] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 1 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:50.461907 30722 raft_consensus.cc:2804] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:50.462283 30722 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.462623 30722 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.444353 30686 consensus_queue.cc:1048] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 13:07:50.470815 30671 consensus_queue.cc:1048] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:50.476101 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:50.476758 30550 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 0.
I20260709 13:07:50.489709 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:50.490953 30373 catalog_manager.cc:5697] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 0 to 1, leader changed from <none> to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:50.497195 30665 tablet_bootstrap.cc:492] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:50.497793 30665 ts_tablet_manager.cc:1403] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.272s	user 0.012s	sys 0.005s
I20260709 13:07:50.500010 30771 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.501427 30771 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.504774 30771 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:50.505345 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:07:50.507057 30517 leader_election.cc:343] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.503852 30754 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:50.509585 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:07:50.511171 30516 leader_election.cc:343] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.511569 30516 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:50.513619 30771 raft_consensus.cc:2749] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:50.518499 30665 raft_consensus.cc:359] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.511567 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:50.520068 30550 raft_consensus.cc:2468] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 1.
I20260709 13:07:50.521119 30665 raft_consensus.cc:385] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.521517 30665 raft_consensus.cc:740] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.521567 30589 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:07:50.522821 30665 consensus_queue.cc:260] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.551994 30722 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.554229 30757 raft_consensus.cc:2804] T 0a6e86e0a4b843478d5970b29ad63ad7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:50.556540 30757 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:07:50.557013 30757 raft_consensus.cc:3060] T 0a6e86e0a4b843478d5970b29ad63ad7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:50.559383 30666 tablet_bootstrap.cc:492] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:50.559991 30666 ts_tablet_manager.cc:1403] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.238s	user 0.015s	sys 0.009s
I20260709 13:07:50.564013 30666 raft_consensus.cc:359] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.564819 30666 raft_consensus.cc:385] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.565164 30666 raft_consensus.cc:740] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.578749 30722 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:50.583225 30765 consensus_queue.cc:1048] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:50.587088 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:07:50.586934 30666 consensus_queue.cc:260] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.587625 30623 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.589190 30666 ts_tablet_manager.cc:1434] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:07:50.590112 30666 tablet_bootstrap.cc:492] T 7c9861593ab94f7792fdd702f1d9a483 P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:50.593016 30665 ts_tablet_manager.cc:1434] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.095s	user 0.011s	sys 0.000s
I20260709 13:07:50.593904 30665 tablet_bootstrap.cc:492] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:50.596585 30757 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.597069 30667 tablet_bootstrap.cc:492] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:50.597785 30667 ts_tablet_manager.cc:1403] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.243s	user 0.018s	sys 0.011s
I20260709 13:07:50.598002 30666 tablet_bootstrap.cc:654] T 7c9861593ab94f7792fdd702f1d9a483 P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.599409 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:07:50.602754 30667 raft_consensus.cc:359] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.604343 30667 raft_consensus.cc:385] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.604704 30667 raft_consensus.cc:740] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.605343 30667 consensus_queue.cc:260] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.607445 30667 ts_tablet_manager.cc:1434] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.001s
W20260709 13:07:50.592600 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 120696us
I20260709 13:07:50.609261 30667 tablet_bootstrap.cc:492] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:50.608469 30779 raft_consensus.cc:493] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.614141 30779 raft_consensus.cc:515] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.614676 30623 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 1.
I20260709 13:07:50.616870 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:07:50.618825 30665 tablet_bootstrap.cc:654] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.615018 30757 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:50.620769 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:07:50.622401 30549 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.628139 30589 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:07:50.637328 30441 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:07:50.637625 30686 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.638249 30686 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.638624 30671 raft_consensus.cc:2804] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:50.639153 30671 raft_consensus.cc:697] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:07:50.641080 30686 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:50.641731 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:50.640199 30671 consensus_queue.cc:237] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.642372 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:07:50.643040 30517 leader_election.cc:343] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:50.644048 30516 leader_election.cc:343] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.644536 30516 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:50.638630 30372 catalog_manager.cc:5697] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:50.645519 30686 raft_consensus.cc:2749] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:50.640277 30757 raft_consensus.cc:2749] T 0a6e86e0a4b843478d5970b29ad63ad7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:50.648917 30667 tablet_bootstrap.cc:654] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.649477 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:07:50.657414 30440 leader_election.cc:343] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.649631 30779 leader_election.cc:290] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:50.660167 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:07:50.662678 30441 leader_election.cc:343] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.663558 30441 leader_election.cc:304] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:50.664252 30549 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 1.
I20260709 13:07:50.666441 30665 tablet_bootstrap.cc:492] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:50.666917 30665 ts_tablet_manager.cc:1403] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.073s	user 0.008s	sys 0.031s
I20260709 13:07:50.668385 30779 raft_consensus.cc:2749] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:50.669291 30665 raft_consensus.cc:359] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.672070 30665 raft_consensus.cc:385] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.672349 30665 raft_consensus.cc:740] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.673323 30666 tablet_bootstrap.cc:492] T 7c9861593ab94f7792fdd702f1d9a483 P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:50.672966 30665 consensus_queue.cc:260] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.673880 30666 ts_tablet_manager.cc:1403] T 7c9861593ab94f7792fdd702f1d9a483 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.084s	user 0.009s	sys 0.003s
I20260709 13:07:50.674968 30665 ts_tablet_manager.cc:1434] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:07:50.675762 30665 tablet_bootstrap.cc:492] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:50.676517 30666 raft_consensus.cc:359] T 7c9861593ab94f7792fdd702f1d9a483 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.677651 30666 raft_consensus.cc:385] T 7c9861593ab94f7792fdd702f1d9a483 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.677958 30666 raft_consensus.cc:740] T 7c9861593ab94f7792fdd702f1d9a483 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.678785 30666 consensus_queue.cc:260] T 7c9861593ab94f7792fdd702f1d9a483 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.681227 30666 ts_tablet_manager.cc:1434] T 7c9861593ab94f7792fdd702f1d9a483 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:07:50.682921 30665 tablet_bootstrap.cc:654] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.683624 30666 tablet_bootstrap.cc:492] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:50.691401 30666 tablet_bootstrap.cc:654] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.694744 30667 tablet_bootstrap.cc:492] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:50.695165 30667 ts_tablet_manager.cc:1403] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.086s	user 0.027s	sys 0.006s
I20260709 13:07:50.697734 30667 raft_consensus.cc:359] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.698712 30667 raft_consensus.cc:385] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.698976 30667 raft_consensus.cc:740] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.699586 30667 consensus_queue.cc:260] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.703370 30667 ts_tablet_manager.cc:1434] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:07:50.704263 30667 tablet_bootstrap.cc:492] T 10b0408011914710a008d9e9b58f002c P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:50.706775 30666 tablet_bootstrap.cc:492] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:50.706503 30754 consensus_queue.cc:1048] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:50.709650 30667 tablet_bootstrap.cc:654] T 10b0408011914710a008d9e9b58f002c P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.712544 30666 ts_tablet_manager.cc:1403] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.029s	user 0.007s	sys 0.012s
I20260709 13:07:50.716879 30754 consensus_queue.cc:1048] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:50.719164 30666 raft_consensus.cc:359] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.720986 30666 raft_consensus.cc:385] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.721815 30666 raft_consensus.cc:740] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.723541 30666 consensus_queue.cc:260] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.727986 30666 ts_tablet_manager.cc:1434] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:07:50.730918 30666 tablet_bootstrap.cc:492] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:50.738602 30666 tablet_bootstrap.cc:654] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.745345 30686 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.746052 30686 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.748227 30686 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:50.750044 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:07:50.751376 30517 leader_election.cc:343] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.752857 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:50.753438 30623 raft_consensus.cc:2468] T 7c9861593ab94f7792fdd702f1d9a483 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 0.
I20260709 13:07:50.754642 30516 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:07:50.756363 30770 raft_consensus.cc:2804] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:50.756915 30667 tablet_bootstrap.cc:492] T 10b0408011914710a008d9e9b58f002c P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:50.756839 30770 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.757354 30667 ts_tablet_manager.cc:1403] T 10b0408011914710a008d9e9b58f002c P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.053s	user 0.031s	sys 0.011s
I20260709 13:07:50.757515 30770 raft_consensus.cc:3060] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.760058 30665 tablet_bootstrap.cc:492] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:50.760000 30667 raft_consensus.cc:359] T 10b0408011914710a008d9e9b58f002c P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.760660 30665 ts_tablet_manager.cc:1403] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.085s	user 0.019s	sys 0.026s
I20260709 13:07:50.760762 30667 raft_consensus.cc:385] T 10b0408011914710a008d9e9b58f002c P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.761090 30667 raft_consensus.cc:740] T 10b0408011914710a008d9e9b58f002c P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.761719 30667 consensus_queue.cc:260] T 10b0408011914710a008d9e9b58f002c P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.763592 30667 ts_tablet_manager.cc:1434] T 10b0408011914710a008d9e9b58f002c P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:07:50.764456 30667 tablet_bootstrap.cc:492] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:50.763849 30665 raft_consensus.cc:359] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.764312 30770 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.764839 30665 raft_consensus.cc:385] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.765232 30665 raft_consensus.cc:740] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.766044 30665 consensus_queue.cc:260] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.766990 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:07:50.767608 30475 raft_consensus.cc:3060] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.769333 30665 ts_tablet_manager.cc:1434] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.002s
I20260709 13:07:50.770530 30665 tablet_bootstrap.cc:492] T daf3769ea0a34be69a628c90f1f8a721 P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:50.770864 30667 tablet_bootstrap.cc:654] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.775173 30475 raft_consensus.cc:2468] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
I20260709 13:07:50.778646 30665 tablet_bootstrap.cc:654] T daf3769ea0a34be69a628c90f1f8a721 P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.780817 30770 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:50.781491 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:07:50.781872 30667 tablet_bootstrap.cc:492] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:50.781930 30517 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:07:50.782043 30623 raft_consensus.cc:3060] T 7c9861593ab94f7792fdd702f1d9a483 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.782404 30667 ts_tablet_manager.cc:1403] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.018s	user 0.003s	sys 0.012s
I20260709 13:07:50.784109 30372 catalog_manager.cc:5697] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 0 to 1, leader changed from <none> to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:50.784972 30667 raft_consensus.cc:359] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.785593 30667 raft_consensus.cc:385] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.785833 30667 raft_consensus.cc:740] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.791584 30623 raft_consensus.cc:2468] T 7c9861593ab94f7792fdd702f1d9a483 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
I20260709 13:07:50.786614 30667 consensus_queue.cc:260] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.796748 30667 ts_tablet_manager.cc:1434] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:07:50.797547 30667 tablet_bootstrap.cc:492] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:50.800496 30686 raft_consensus.cc:2804] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:50.801714 30686 raft_consensus.cc:697] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:07:50.802553 30686 consensus_queue.cc:237] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.808466 30665 tablet_bootstrap.cc:492] T daf3769ea0a34be69a628c90f1f8a721 P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:50.808882 30665 ts_tablet_manager.cc:1403] T daf3769ea0a34be69a628c90f1f8a721 P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.039s	user 0.007s	sys 0.023s
I20260709 13:07:50.809494 30667 tablet_bootstrap.cc:654] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.815905 30665 raft_consensus.cc:359] T daf3769ea0a34be69a628c90f1f8a721 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.816624 30665 raft_consensus.cc:385] T daf3769ea0a34be69a628c90f1f8a721 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.816916 30665 raft_consensus.cc:740] T daf3769ea0a34be69a628c90f1f8a721 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.817559 30665 consensus_queue.cc:260] T daf3769ea0a34be69a628c90f1f8a721 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.819205 30666 tablet_bootstrap.cc:492] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:50.819556 30665 ts_tablet_manager.cc:1434] T daf3769ea0a34be69a628c90f1f8a721 P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:07:50.819752 30666 ts_tablet_manager.cc:1403] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.089s	user 0.020s	sys 0.027s
I20260709 13:07:50.820621 30665 tablet_bootstrap.cc:492] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:50.823340 30666 raft_consensus.cc:359] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.824167 30666 raft_consensus.cc:385] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.824486 30666 raft_consensus.cc:740] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.825877 30666 consensus_queue.cc:260] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.826501 30665 tablet_bootstrap.cc:654] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.828430 30666 ts_tablet_manager.cc:1434] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:07:50.830461 30666 tablet_bootstrap.cc:492] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:50.844329 30667 tablet_bootstrap.cc:492] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:50.844755 30667 ts_tablet_manager.cc:1403] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.047s	user 0.019s	sys 0.008s
I20260709 13:07:50.845706 30666 tablet_bootstrap.cc:654] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.847255 30667 raft_consensus.cc:359] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.847910 30667 raft_consensus.cc:385] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.848176 30667 raft_consensus.cc:740] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.849267 30665 tablet_bootstrap.cc:492] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:50.849045 30667 consensus_queue.cc:260] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.849715 30665 ts_tablet_manager.cc:1403] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.008s
I20260709 13:07:50.850080 30765 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.850513 30765 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.851557 30667 ts_tablet_manager.cc:1434] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:07:50.852501 30667 tablet_bootstrap.cc:492] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:50.852737 30665 raft_consensus.cc:359] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.853323 30665 raft_consensus.cc:385] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.853570 30665 raft_consensus.cc:740] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.853521 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:50.854058 30779 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.854311 30665 consensus_queue.cc:260] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.854521 30779 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.856194 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:50.856492 30779 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:50.852514 30765 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:50.858351 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:50.854241 30623 raft_consensus.cc:2468] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 0.
I20260709 13:07:50.858582 30667 tablet_bootstrap.cc:654] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.858919 30622 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 0.
I20260709 13:07:50.859768 30516 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:07:50.860637 30765 raft_consensus.cc:2804] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:50.860980 30765 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.860637 30441 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:07:50.861372 30765 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.862579 30778 raft_consensus.cc:2804] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:50.862921 30778 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.863276 30778 raft_consensus.cc:3060] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:50.868721 30517 leader_election.cc:343] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.868587 30765 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.869751 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:50.870368 30549 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 0.
I20260709 13:07:50.871567 30765 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:50.856369 30665 ts_tablet_manager.cc:1434] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:07:50.872015 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:07:50.872607 30622 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.879423 30779 consensus_queue.cc:1048] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:50.881389 30372 catalog_manager.cc:5697] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:50.884099 30754 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.890158 30754 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.893616 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:50.894625 30549 raft_consensus.cc:2468] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 0.
I20260709 13:07:50.896435 30589 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:07:50.897228 30757 raft_consensus.cc:2804] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:50.897568 30757 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.897872 30757 raft_consensus.cc:3060] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.900533 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:07:50.901386 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:50.901895 30665 tablet_bootstrap.cc:492] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:50.906688 30686 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.907321 30686 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.910825 30757 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.894097 30754 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:50.927904 30667 tablet_bootstrap.cc:492] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
W20260709 13:07:50.912045 30591 leader_election.cc:343] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.912501 30686 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:50.928381 30667 ts_tablet_manager.cc:1403] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.076s	user 0.024s	sys 0.032s
I20260709 13:07:50.913200 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:50.928880 30476 raft_consensus.cc:2468] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 0.
I20260709 13:07:50.929350 30757 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:07:50.923298 30517 leader_election.cc:343] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.930892 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:07:50.930927 30774 consensus_queue.cc:1048] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:50.931571 30549 raft_consensus.cc:3060] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.927011 30666 tablet_bootstrap.cc:492] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:50.886133 30778 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.933002 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:07:50.885610 30622 raft_consensus.cc:2468] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
I20260709 13:07:50.933758 30517 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:07:50.911830 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:50.935139 30778 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:50.935451 30686 raft_consensus.cc:2804] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:50.935799 30666 ts_tablet_manager.cc:1403] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.106s	user 0.023s	sys 0.056s
I20260709 13:07:50.935874 30686 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.936044 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:07:50.936324 30686 raft_consensus.cc:3060] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.936578 30550 raft_consensus.cc:3060] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.937609 30516 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:07:50.938283 30666 raft_consensus.cc:359] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.938906 30666 raft_consensus.cc:385] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.939152 30666 raft_consensus.cc:740] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
W20260709 13:07:50.939471 30516 leader_election.cc:343] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.924278 30665 tablet_bootstrap.cc:654] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.939980 30755 raft_consensus.cc:2804] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:50.939776 30666 consensus_queue.cc:260] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.940474 30755 raft_consensus.cc:697] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:07:50.941301 30755 consensus_queue.cc:237] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.941771 30666 ts_tablet_manager.cc:1434] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 13:07:50.942657 30666 tablet_bootstrap.cc:492] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:50.942553 30667 raft_consensus.cc:359] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.943192 30667 raft_consensus.cc:385] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.943434 30667 raft_consensus.cc:740] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.944058 30667 consensus_queue.cc:260] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.945135 30686 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.945946 30667 ts_tablet_manager.cc:1434] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:07:50.946771 30667 tablet_bootstrap.cc:492] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:50.948985 30666 tablet_bootstrap.cc:654] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.949498 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:07:50.951730 30516 leader_election.cc:343] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.955411 30550 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 1.
W20260709 13:07:50.956578 30591 leader_election.cc:343] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:50.957912 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:07:50.959570 30623 raft_consensus.cc:3060] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.959898 30666 tablet_bootstrap.cc:492] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:50.960572 30666 ts_tablet_manager.cc:1403] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.003s
I20260709 13:07:50.963585 30666 raft_consensus.cc:359] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.964315 30666 raft_consensus.cc:385] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.964653 30666 raft_consensus.cc:740] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.965430 30666 consensus_queue.cc:260] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.966820 30549 raft_consensus.cc:2468] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 1.
I20260709 13:07:50.966862 30440 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:07:50.967856 30778 raft_consensus.cc:2804] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:50.968398 30778 raft_consensus.cc:697] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:07:50.967252 30667 tablet_bootstrap.cc:654] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.946969 30686 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:50.969344 30778 consensus_queue.cc:237] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.972190 30589 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:07:50.973927 30666 ts_tablet_manager.cc:1434] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:07:50.974408 30754 raft_consensus.cc:2804] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:50.975031 30666 tablet_bootstrap.cc:492] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:50.975072 30754 raft_consensus.cc:697] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:07:50.976473 30754 consensus_queue.cc:237] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.979125 30667 tablet_bootstrap.cc:492] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:50.982654 30667 ts_tablet_manager.cc:1403] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.036s	user 0.008s	sys 0.003s
I20260709 13:07:50.982864 30666 tablet_bootstrap.cc:654] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:50.985128 30667 raft_consensus.cc:359] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.985750 30667 raft_consensus.cc:385] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:50.985668 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:07:50.986089 30667 raft_consensus.cc:740] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:50.986263 30476 raft_consensus.cc:3060] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:50.981427 30765 consensus_queue.cc:1048] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:50.986581 30623 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 1.
I20260709 13:07:50.990271 30667 consensus_queue.cc:260] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.993712 30667 ts_tablet_manager.cc:1434] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:07:50.994546 30765 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.994956 30765 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:50.997828 30765 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:51.000737 30371 catalog_manager.cc:5697] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 0 to 1, leader changed from <none> to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:51.002592 30665 tablet_bootstrap.cc:492] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:51.003123 30665 ts_tablet_manager.cc:1403] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.101s	user 0.024s	sys 0.005s
I20260709 13:07:51.005185 30667 tablet_bootstrap.cc:492] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:51.005755 30666 tablet_bootstrap.cc:492] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:51.006209 30666 ts_tablet_manager.cc:1403] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.005s
I20260709 13:07:51.007736 30665 raft_consensus.cc:359] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.008411 30665 raft_consensus.cc:385] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.008656 30665 raft_consensus.cc:740] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.009363 30665 consensus_queue.cc:260] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.012981 30665 ts_tablet_manager.cc:1434] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.005s
I20260709 13:07:51.014083 30665 tablet_bootstrap.cc:492] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:51.020843 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:51.021349 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:51.021673 30475 raft_consensus.cc:2468] T daf3769ea0a34be69a628c90f1f8a721 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 0.
W20260709 13:07:51.022751 30516 leader_election.cc:343] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.032757 30666 raft_consensus.cc:359] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.033872 30666 raft_consensus.cc:385] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.034097 30666 raft_consensus.cc:740] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.041453 30476 raft_consensus.cc:2468] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
I20260709 13:07:51.042265 30666 consensus_queue.cc:260] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.043737 30517 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:51.045605 30666 ts_tablet_manager.cc:1434] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.039s	user 0.003s	sys 0.003s
I20260709 13:07:51.046388 30755 raft_consensus.cc:2804] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:51.046495 30666 tablet_bootstrap.cc:492] T 541099fd564e49f2ad553f250f319fb0 P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:51.046837 30755 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.047179 30754 raft_consensus.cc:493] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.048381 30755 raft_consensus.cc:3060] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.048486 30754 raft_consensus.cc:515] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.055310 30374 catalog_manager.cc:5697] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 1 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:51.057902 30755 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.081030 30667 tablet_bootstrap.cc:654] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.127713 30665 tablet_bootstrap.cc:654] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.141407 30623 raft_consensus.cc:1240] T 0a6e86e0a4b843478d5970b29ad63ad7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:51.142917 30755 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:51.142863 30517 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:51.144891 30686 raft_consensus.cc:2804] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:51.145349 30686 raft_consensus.cc:697] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:07:51.146139 30686 consensus_queue.cc:237] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.151259 30754 leader_election.cc:290] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:51.152642 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:51.153209 30549 raft_consensus.cc:2468] T 10b0408011914710a008d9e9b58f002c P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 0.
I20260709 13:07:51.154248 30589 leader_election.cc:304] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:07:51.154569 30774 consensus_queue.cc:1059] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:51.155016 30671 consensus_queue.cc:1048] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:51.155646 30774 raft_consensus.cc:3055] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:51.156009 30774 raft_consensus.cc:740] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:07:51.155055 30754 raft_consensus.cc:2804] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:51.156765 30774 consensus_queue.cc:260] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.159227 30754 raft_consensus.cc:493] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.158352 30778 consensus_queue.cc:1048] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:51.162048 30774 raft_consensus.cc:3060] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:51.162118 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:07:51.159595 30754 raft_consensus.cc:3060] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.162947 30474 raft_consensus.cc:3060] T daf3769ea0a34be69a628c90f1f8a721 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.174153 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:51.161332 30371 catalog_manager.cc:5697] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:51.174798 30475 raft_consensus.cc:2468] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 0.
I20260709 13:07:51.177663 30667 tablet_bootstrap.cc:492] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:51.178049 30667 ts_tablet_manager.cc:1403] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.173s	user 0.017s	sys 0.010s
I20260709 13:07:51.179306 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:07:51.196338 30517 consensus_peers.cc:597] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:51.211971 30757 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.232693 30665 tablet_bootstrap.cc:492] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:51.233135 30665 ts_tablet_manager.cc:1403] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.220s	user 0.013s	sys 0.013s
I20260709 13:07:51.212520 30757 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.236644 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:07:51.236644 30516 leader_election.cc:343] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:51.238528 30591 leader_election.cc:343] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.238745 30666 tablet_bootstrap.cc:654] T 541099fd564e49f2ad553f250f319fb0 P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.238538 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:51.240010 30551 raft_consensus.cc:2468] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 0.
I20260709 13:07:51.239712 30757 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:51.241572 30589 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:07:51.241806 30778 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.242271 30778 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.244192 30778 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:51.245242 30757 raft_consensus.cc:2804] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:51.245587 30757 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.245637 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:51.245913 30757 raft_consensus.cc:3060] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.242758 30667 raft_consensus.cc:359] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.246558 30667 raft_consensus.cc:385] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.246963 30667 raft_consensus.cc:740] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
W20260709 13:07:51.245652 30422 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:51.247200 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:51.248284 30754 raft_consensus.cc:515] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.249198 30625 raft_consensus.cc:2468] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 0.
I20260709 13:07:51.247329 30474 raft_consensus.cc:2468] T daf3769ea0a34be69a628c90f1f8a721 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
I20260709 13:07:51.249226 30667 consensus_queue.cc:260] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.255280 30667 ts_tablet_manager.cc:1434] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.077s	user 0.004s	sys 0.003s
I20260709 13:07:51.256121 30667 tablet_bootstrap.cc:492] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:51.254495 30551 raft_consensus.cc:2468] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 0.
I20260709 13:07:51.251338 30441 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:07:51.261492 30778 raft_consensus.cc:2804] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:51.261854 30778 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.262174 30778 raft_consensus.cc:3060] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.263854 30517 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:51.264905 30755 raft_consensus.cc:2804] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:51.265352 30755 raft_consensus.cc:697] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:07:51.266111 30755 consensus_queue.cc:237] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.269357 30778 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.272037 30665 raft_consensus.cc:359] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.272683 30665 raft_consensus.cc:385] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.272960 30665 raft_consensus.cc:740] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.273337 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:07:51.273684 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:07:51.274636 30623 raft_consensus.cc:3060] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.274039 30474 raft_consensus.cc:3060] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.280344 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:07:51.280947 30551 raft_consensus.cc:3060] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.281284 30623 raft_consensus.cc:2468] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 1.
I20260709 13:07:51.282250 30441 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:07:51.283066 30774 raft_consensus.cc:2804] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:51.284332 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:07:51.295764 30774 raft_consensus.cc:697] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:07:51.274340 30778 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:51.283716 30754 leader_election.cc:290] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:51.273622 30665 consensus_queue.cc:260] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.279026 30371 catalog_manager.cc:5697] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:51.297849 30774 consensus_queue.cc:237] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.297012 30550 raft_consensus.cc:3060] T 10b0408011914710a008d9e9b58f002c P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.301110 30686 consensus_queue.cc:1048] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:51.301522 30665 ts_tablet_manager.cc:1434] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.068s	user 0.005s	sys 0.001s
I20260709 13:07:51.302475 30665 tablet_bootstrap.cc:492] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:51.267619 30757 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.324551 30757 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:51.325311 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
W20260709 13:07:51.331220 30591 leader_election.cc:343] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.332743 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:07:51.333562 30549 raft_consensus.cc:3060] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.346474 30550 raft_consensus.cc:2468] T 10b0408011914710a008d9e9b58f002c P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 1.
I20260709 13:07:51.347230 30770 consensus_queue.cc:1048] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:51.350478 30589 leader_election.cc:304] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:07:51.354521 30757 raft_consensus.cc:2804] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:51.356246 30757 raft_consensus.cc:697] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:07:51.357015 30757 consensus_queue.cc:237] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.358467 30551 raft_consensus.cc:2468] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 1.
I20260709 13:07:51.360481 30474 raft_consensus.cc:2468] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 1.
I20260709 13:07:51.362355 30686 consensus_queue.cc:1048] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:07:51.373370 30549 raft_consensus.cc:2468] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 1.
I20260709 13:07:51.377985 30372 catalog_manager.cc:5697] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 0 to 1, leader changed from <none> to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:51.381441 30667 tablet_bootstrap.cc:654] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.379213 30589 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:07:51.392300 30665 tablet_bootstrap.cc:654] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.393347 30757 raft_consensus.cc:2804] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:51.393815 30757 raft_consensus.cc:697] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:07:51.394052 30666 tablet_bootstrap.cc:492] T 541099fd564e49f2ad553f250f319fb0 P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:51.394466 30666 ts_tablet_manager.cc:1403] T 541099fd564e49f2ad553f250f319fb0 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.348s	user 0.017s	sys 0.017s
I20260709 13:07:51.394574 30757 consensus_queue.cc:237] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.401140 30671 consensus_queue.cc:1048] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:51.401466 30666 raft_consensus.cc:359] T 541099fd564e49f2ad553f250f319fb0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.402091 30666 raft_consensus.cc:385] T 541099fd564e49f2ad553f250f319fb0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.402359 30666 raft_consensus.cc:740] T 541099fd564e49f2ad553f250f319fb0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.403079 30666 consensus_queue.cc:260] T 541099fd564e49f2ad553f250f319fb0 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.406101 30754 consensus_queue.cc:1048] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:51.407044 30666 ts_tablet_manager.cc:1434] T 541099fd564e49f2ad553f250f319fb0 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:07:51.407953 30666 tablet_bootstrap.cc:492] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:51.422874 30371 catalog_manager.cc:5697] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:51.424762 30667 tablet_bootstrap.cc:492] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:51.425650 30667 ts_tablet_manager.cc:1403] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.170s	user 0.019s	sys 0.006s
I20260709 13:07:51.428915 30667 raft_consensus.cc:359] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.429740 30667 raft_consensus.cc:385] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.430078 30667 raft_consensus.cc:740] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.435269 30758 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.437299 30758 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.439561 30758 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:51.448719 30667 consensus_queue.cc:260] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:07:51.453478 30591 consensus_peers.cc:597] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:51.453480 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:07:51.456431 30589 leader_election.cc:343] T 541099fd564e49f2ad553f250f319fb0 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.461980 30667 ts_tablet_manager.cc:1434] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.001s
I20260709 13:07:51.462875 30667 tablet_bootstrap.cc:492] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:51.471028 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:51.474567 30665 tablet_bootstrap.cc:492] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:51.475006 30665 ts_tablet_manager.cc:1403] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.173s	user 0.011s	sys 0.003s
W20260709 13:07:51.474917 30591 leader_election.cc:343] T 541099fd564e49f2ad553f250f319fb0 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.475402 30591 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
W20260709 13:07:51.476284 30517 consensus_peers.cc:597] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:51.476593 30757 raft_consensus.cc:2749] T 541099fd564e49f2ad553f250f319fb0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:51.470564 30686 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.477785 30686 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.492933 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:51.493280 30667 tablet_bootstrap.cc:654] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:51.495203 30517 leader_election.cc:343] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.500190 30665 raft_consensus.cc:359] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.500859 30665 raft_consensus.cc:385] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.501087 30665 raft_consensus.cc:740] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.502631 30686 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:51.503331 30665 consensus_queue.cc:260] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.502661 30774 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.504006 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:51.504822 30774 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.506706 30774 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:51.509001 30665 ts_tablet_manager.cc:1434] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 13:07:51.509687 30665 tablet_bootstrap.cc:492] T 1f895d2ed89b48cc856a4b80cdde3073 P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:51.510847 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:51.510723 30774 consensus_queue.cc:1048] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:07:51.512230 30516 leader_election.cc:343] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.512715 30516 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:07:51.512231 30441 leader_election.cc:343] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.514045 30686 raft_consensus.cc:2749] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:51.515233 30371 catalog_manager.cc:5697] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 1 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:51.517545 30371 catalog_manager.cc:5697] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 1 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:51.524688 30665 tablet_bootstrap.cc:654] T 1f895d2ed89b48cc856a4b80cdde3073 P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.526895 30666 tablet_bootstrap.cc:654] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.534072 30666 tablet_bootstrap.cc:492] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:51.534492 30666 ts_tablet_manager.cc:1403] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.127s	user 0.007s	sys 0.003s
I20260709 13:07:51.535662 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:51.536475 30667 tablet_bootstrap.cc:492] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:51.536897 30667 ts_tablet_manager.cc:1403] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.074s	user 0.012s	sys 0.005s
I20260709 13:07:51.536355 30551 raft_consensus.cc:2468] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 0.
I20260709 13:07:51.539762 30440 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:51.541079 30671 raft_consensus.cc:2804] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:51.540903 30666 raft_consensus.cc:359] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.541429 30671 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.541808 30671 raft_consensus.cc:3060] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.541644 30667 raft_consensus.cc:359] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.542573 30667 raft_consensus.cc:385] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.542925 30667 raft_consensus.cc:740] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.544193 30665 tablet_bootstrap.cc:492] T 1f895d2ed89b48cc856a4b80cdde3073 P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:51.543958 30667 consensus_queue.cc:260] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.541600 30666 raft_consensus.cc:385] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.544617 30665 ts_tablet_manager.cc:1403] T 1f895d2ed89b48cc856a4b80cdde3073 P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.002s
I20260709 13:07:51.545043 30666 raft_consensus.cc:740] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.545732 30666 consensus_queue.cc:260] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.547971 30666 ts_tablet_manager.cc:1434] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 13:07:51.548058 30665 raft_consensus.cc:359] T 1f895d2ed89b48cc856a4b80cdde3073 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.548880 30666 tablet_bootstrap.cc:492] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:51.549135 30665 raft_consensus.cc:385] T 1f895d2ed89b48cc856a4b80cdde3073 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.551383 30667 ts_tablet_manager.cc:1434] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:07:51.554874 30666 tablet_bootstrap.cc:654] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.554555 30667 tablet_bootstrap.cc:492] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:51.549515 30665 raft_consensus.cc:740] T 1f895d2ed89b48cc856a4b80cdde3073 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.557706 30665 consensus_queue.cc:260] T 1f895d2ed89b48cc856a4b80cdde3073 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.559561 30665 ts_tablet_manager.cc:1434] T 1f895d2ed89b48cc856a4b80cdde3073 P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:07:51.560377 30665 tablet_bootstrap.cc:492] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:51.560755 30667 tablet_bootstrap.cc:654] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.565922 30665 tablet_bootstrap.cc:654] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.549517 30671 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.569718 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:07:51.570323 30551 raft_consensus.cc:3060] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.571020 30666 tablet_bootstrap.cc:492] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:51.571611 30666 ts_tablet_manager.cc:1403] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.004s
I20260709 13:07:51.574159 30666 raft_consensus.cc:359] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.574753 30666 raft_consensus.cc:385] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.575058 30666 raft_consensus.cc:740] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.575874 30666 consensus_queue.cc:260] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.577852 30666 ts_tablet_manager.cc:1434] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:07:51.578652 30666 tablet_bootstrap.cc:492] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:51.579840 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:07:51.581063 30667 tablet_bootstrap.cc:492] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
W20260709 13:07:51.581342 30441 leader_election.cc:343] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.581605 30667 ts_tablet_manager.cc:1403] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.008s
I20260709 13:07:51.582383 30770 consensus_queue.cc:1048] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:51.584959 30667 raft_consensus.cc:359] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.585880 30667 raft_consensus.cc:385] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.586201 30667 raft_consensus.cc:740] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.587561 30666 tablet_bootstrap.cc:654] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.587272 30667 consensus_queue.cc:260] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.594892 30551 raft_consensus.cc:2468] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 1.
I20260709 13:07:51.604578 30440 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:51.605449 30774 raft_consensus.cc:2804] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:51.605913 30774 raft_consensus.cc:697] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:07:51.606684 30774 consensus_queue.cc:237] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:07:51.607939 30516 consensus_peers.cc:597] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd -> Peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Couldn't send request to peer fe2b7d73f8c743c1ba570cfd981c4e79. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:51.595577 30671 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:51.596745 30667 ts_tablet_manager.cc:1434] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:07:51.597442 30666 tablet_bootstrap.cc:492] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:51.611297 30666 ts_tablet_manager.cc:1403] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.000s
I20260709 13:07:51.602299 30665 tablet_bootstrap.cc:492] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:51.611697 30667 tablet_bootstrap.cc:492] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:51.618877 30667 tablet_bootstrap.cc:654] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.620091 30665 ts_tablet_manager.cc:1403] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.060s	user 0.015s	sys 0.004s
I20260709 13:07:51.621883 30757 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.622283 30757 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.624044 30757 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:51.624857 30666 raft_consensus.cc:359] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.625526 30666 raft_consensus.cc:385] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.625586 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:51.625816 30666 raft_consensus.cc:740] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.626487 30666 consensus_queue.cc:260] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.628230 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:51.628538 30666 ts_tablet_manager.cc:1434] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:07:51.628965 30476 raft_consensus.cc:2393] T daf3769ea0a34be69a628c90f1f8a721 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 1: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:07:51.629426 30666 tablet_bootstrap.cc:492] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:51.630115 30591 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:07:51.630318 30371 catalog_manager.cc:5697] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 0 to 1, leader changed from <none> to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:51.622560 30665 raft_consensus.cc:359] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.633770 30665 raft_consensus.cc:385] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.634070 30665 raft_consensus.cc:740] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.634696 30665 consensus_queue.cc:260] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.636016 30757 raft_consensus.cc:3060] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.636821 30665 ts_tablet_manager.cc:1434] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.002s
I20260709 13:07:51.637696 30665 tablet_bootstrap.cc:492] T 8e5fda238ec24b13b992b82bed92951f P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:51.645316 30757 raft_consensus.cc:2749] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:51.645546 30665 tablet_bootstrap.cc:654] T 8e5fda238ec24b13b992b82bed92951f P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.646276 30666 tablet_bootstrap.cc:654] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.649382 30667 tablet_bootstrap.cc:492] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:51.649964 30667 ts_tablet_manager.cc:1403] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.000s
I20260709 13:07:51.653311 30667 raft_consensus.cc:359] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.654158 30667 raft_consensus.cc:385] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.654481 30667 raft_consensus.cc:740] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.655318 30667 consensus_queue.cc:260] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.657708 30667 ts_tablet_manager.cc:1434] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:07:51.658188 30665 tablet_bootstrap.cc:492] T 8e5fda238ec24b13b992b82bed92951f P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:51.658664 30665 ts_tablet_manager.cc:1403] T 8e5fda238ec24b13b992b82bed92951f P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.005s
I20260709 13:07:51.659207 30771 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.659682 30771 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.661693 30771 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:51.661878 30665 raft_consensus.cc:359] T 8e5fda238ec24b13b992b82bed92951f P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.662830 30665 raft_consensus.cc:385] T 8e5fda238ec24b13b992b82bed92951f P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.663165 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:51.663452 30665 raft_consensus.cc:740] T 8e5fda238ec24b13b992b82bed92951f P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.663796 30624 raft_consensus.cc:2468] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 0.
I20260709 13:07:51.664084 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:51.665453 30516 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:07:51.665316 30665 consensus_queue.cc:260] T 8e5fda238ec24b13b992b82bed92951f P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:07:51.666828 30517 leader_election.cc:343] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.667903 30771 raft_consensus.cc:2804] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:51.668272 30771 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.668372 30665 ts_tablet_manager.cc:1434] T 8e5fda238ec24b13b992b82bed92951f P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:07:51.668624 30771 raft_consensus.cc:3060] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.671207 30665 tablet_bootstrap.cc:492] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:51.676486 30667 tablet_bootstrap.cc:492] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:51.677088 30665 tablet_bootstrap.cc:654] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.682209 30774 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.682787 30774 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.686088 30774 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:51.685942 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:51.687850 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:51.689339 30441 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:51.690053 30667 tablet_bootstrap.cc:654] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.690090 30778 raft_consensus.cc:2749] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:51.692859 30778 consensus_queue.cc:1048] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:51.693099 30771 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.694635 30665 tablet_bootstrap.cc:492] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:51.695153 30665 ts_tablet_manager.cc:1403] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.000s
I20260709 13:07:51.698181 30665 raft_consensus.cc:359] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.699011 30665 raft_consensus.cc:385] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.699285 30665 raft_consensus.cc:740] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.700013 30665 consensus_queue.cc:260] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.701891 30665 ts_tablet_manager.cc:1434] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:07:51.703369 30665 tablet_bootstrap.cc:492] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:51.704474 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:07:51.705120 30666 tablet_bootstrap.cc:492] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:51.705166 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:07:51.706184 30624 raft_consensus.cc:3060] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.706336 30666 ts_tablet_manager.cc:1403] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.077s	user 0.016s	sys 0.013s
I20260709 13:07:51.709301 30665 tablet_bootstrap.cc:654] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:51.712095 30517 leader_election.cc:343] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.713472 30624 raft_consensus.cc:2468] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
I20260709 13:07:51.710865 30666 raft_consensus.cc:359] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.714664 30516 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:07:51.715927 30686 raft_consensus.cc:2804] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:51.714814 30666 raft_consensus.cc:385] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.716410 30686 raft_consensus.cc:697] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:07:51.716490 30666 raft_consensus.cc:740] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.717265 30686 consensus_queue.cc:237] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.718210 30666 consensus_queue.cc:260] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.705708 30771 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:51.731484 30778 consensus_queue.cc:1048] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:51.737464 30667 tablet_bootstrap.cc:492] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:51.737546 30666 ts_tablet_manager.cc:1434] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.001s
I20260709 13:07:51.745229 30666 tablet_bootstrap.cc:492] T 7f8b6eff35aa4b96bf5f73d6a94db695 P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:51.740000 30778 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.746294 30778 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.743513 30374 catalog_manager.cc:5697] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:51.749181 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:51.753988 30665 tablet_bootstrap.cc:492] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:51.754413 30665 ts_tablet_manager.cc:1403] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.051s	user 0.018s	sys 0.008s
I20260709 13:07:51.755045 30666 tablet_bootstrap.cc:654] T 7f8b6eff35aa4b96bf5f73d6a94db695 P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.756464 30667 ts_tablet_manager.cc:1403] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.080s	user 0.008s	sys 0.005s
I20260709 13:07:51.758929 30667 raft_consensus.cc:359] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.759526 30667 raft_consensus.cc:385] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.759793 30667 raft_consensus.cc:740] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.760679 30778 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:51.760501 30667 consensus_queue.cc:260] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.761716 30778 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.762249 30778 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.762543 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:51.763154 30667 ts_tablet_manager.cc:1434] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260709 13:07:51.764026 30667 tablet_bootstrap.cc:492] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:51.765172 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:51.765908 30551 raft_consensus.cc:2393] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 1: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:07:51.761737 30665 raft_consensus.cc:359] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.768515 30665 raft_consensus.cc:385] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.768303 30441 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:51.768837 30665 raft_consensus.cc:740] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.769554 30778 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:51.769474 30665 consensus_queue.cc:260] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.770534 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:51.772003 30665 ts_tablet_manager.cc:1434] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:07:51.773281 30665 tablet_bootstrap.cc:492] T 0c27ff7cbfd647edb6f31aac3e234914 P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:51.781420 30667 tablet_bootstrap.cc:654] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.781240 30441 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:51.770081 30778 raft_consensus.cc:2749] T 1f895d2ed89b48cc856a4b80cdde3073 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:51.782084 30774 raft_consensus.cc:3060] T 8e5fda238ec24b13b992b82bed92951f P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.787528 30665 tablet_bootstrap.cc:654] T 0c27ff7cbfd647edb6f31aac3e234914 P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.788445 30686 consensus_queue.cc:1048] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:51.792826 30667 tablet_bootstrap.cc:492] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:51.793277 30667 ts_tablet_manager.cc:1403] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.029s	user 0.007s	sys 0.003s
I20260709 13:07:51.795073 30666 tablet_bootstrap.cc:492] T 7f8b6eff35aa4b96bf5f73d6a94db695 P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:51.795513 30666 ts_tablet_manager.cc:1403] T 7f8b6eff35aa4b96bf5f73d6a94db695 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.050s	user 0.014s	sys 0.014s
I20260709 13:07:51.796485 30667 raft_consensus.cc:359] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.797179 30667 raft_consensus.cc:385] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.797470 30667 raft_consensus.cc:740] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.798123 30667 consensus_queue.cc:260] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.798347 30666 raft_consensus.cc:359] T 7f8b6eff35aa4b96bf5f73d6a94db695 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.799000 30666 raft_consensus.cc:385] T 7f8b6eff35aa4b96bf5f73d6a94db695 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.799288 30666 raft_consensus.cc:740] T 7f8b6eff35aa4b96bf5f73d6a94db695 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.799993 30666 consensus_queue.cc:260] T 7f8b6eff35aa4b96bf5f73d6a94db695 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.800493 30667 ts_tablet_manager.cc:1434] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:07:51.801410 30774 raft_consensus.cc:2749] T 8e5fda238ec24b13b992b82bed92951f P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:51.802055 30666 ts_tablet_manager.cc:1434] T 7f8b6eff35aa4b96bf5f73d6a94db695 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:07:51.804366 30666 tablet_bootstrap.cc:492] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:51.806600 30667 tablet_bootstrap.cc:492] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:51.810529 30666 tablet_bootstrap.cc:654] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.813759 30667 tablet_bootstrap.cc:654] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.813730 30686 raft_consensus.cc:493] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.814430 30686 raft_consensus.cc:515] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.816582 30686 leader_election.cc:290] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:51.817008 30686 consensus_queue.cc:1048] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:51.817900 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:51.818549 30625 raft_consensus.cc:2468] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 0.
I20260709 13:07:51.818708 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:07:51.819995 30517 leader_election.cc:343] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.821039 30665 tablet_bootstrap.cc:492] T 0c27ff7cbfd647edb6f31aac3e234914 P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:51.821594 30665 ts_tablet_manager.cc:1403] T 0c27ff7cbfd647edb6f31aac3e234914 P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.048s	user 0.005s	sys 0.009s
I20260709 13:07:51.823052 30666 tablet_bootstrap.cc:492] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:51.823468 30666 ts_tablet_manager.cc:1403] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.000s
I20260709 13:07:51.825107 30516 leader_election.cc:304] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:07:51.827260 30770 raft_consensus.cc:493] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.827726 30770 raft_consensus.cc:515] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.829663 30770 leader_election.cc:290] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:51.830228 30667 tablet_bootstrap.cc:492] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:51.829852 30757 consensus_queue.cc:1048] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:51.831670 30667 ts_tablet_manager.cc:1403] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.003s
I20260709 13:07:51.830150 30770 raft_consensus.cc:2804] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:51.832473 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:51.832659 30770 raft_consensus.cc:493] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.833123 30476 raft_consensus.cc:2468] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 0.
I20260709 13:07:51.833321 30770 raft_consensus.cc:3060] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.834342 30517 leader_election.cc:304] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:07:51.836401 30686 raft_consensus.cc:2804] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:51.836887 30686 raft_consensus.cc:493] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.837306 30686 raft_consensus.cc:3060] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.841305 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:51.842954 30757 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.843549 30757 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.846149 30757 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:51.849167 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:51.849895 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:51.850652 30551 raft_consensus.cc:2393] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 1: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:07:51.850786 30770 raft_consensus.cc:515] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.851948 30765 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.851768 30589 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:07:51.852408 30765 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.853003 30757 raft_consensus.cc:3060] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.854068 30475 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.854336 30765 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:07:51.855414 30516 leader_election.cc:343] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.857264 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:07:51.859041 30517 leader_election.cc:343] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.859671 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:51.860289 30624 raft_consensus.cc:2468] T 541099fd564e49f2ad553f250f319fb0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 0.
I20260709 13:07:51.862643 30757 raft_consensus.cc:2749] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:51.863544 30770 leader_election.cc:290] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:51.864457 30516 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:07:51.865087 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:07:51.865291 30770 raft_consensus.cc:2804] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:51.865680 30624 raft_consensus.cc:3060] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.865607 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
W20260709 13:07:51.867125 30517 leader_election.cc:343] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.865747 30770 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.867988 30770 raft_consensus.cc:3060] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.871548 30665 raft_consensus.cc:359] T 0c27ff7cbfd647edb6f31aac3e234914 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.872450 30665 raft_consensus.cc:385] T 0c27ff7cbfd647edb6f31aac3e234914 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.872792 30665 raft_consensus.cc:740] T 0c27ff7cbfd647edb6f31aac3e234914 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.873701 30770 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.874403 30666 raft_consensus.cc:359] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.874526 30667 raft_consensus.cc:359] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.875073 30666 raft_consensus.cc:385] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.875130 30667 raft_consensus.cc:385] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.875437 30666 raft_consensus.cc:740] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.875481 30667 raft_consensus.cc:740] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.876178 30667 consensus_queue.cc:260] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.876049 30665 consensus_queue.cc:260] T 0c27ff7cbfd647edb6f31aac3e234914 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.878384 30667 ts_tablet_manager.cc:1434] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.010s
I20260709 13:07:51.878384 30665 ts_tablet_manager.cc:1434] T 0c27ff7cbfd647edb6f31aac3e234914 P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.002s
I20260709 13:07:51.880394 30667 tablet_bootstrap.cc:492] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:51.883203 30624 raft_consensus.cc:2468] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
I20260709 13:07:51.884456 30770 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:51.885844 30757 consensus_queue.cc:1048] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:51.886442 30516 leader_election.cc:304] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:07:51.888350 30778 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.888788 30778 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.889451 30667 tablet_bootstrap.cc:654] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.889842 30765 raft_consensus.cc:2804] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:51.890326 30765 raft_consensus.cc:697] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:07:51.891175 30765 consensus_queue.cc:237] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.892201 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:51.886703 30666 consensus_queue.cc:260] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.894694 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:51.895044 30666 ts_tablet_manager.cc:1434] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.071s	user 0.018s	sys 0.025s
I20260709 13:07:51.896193 30666 tablet_bootstrap.cc:492] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:51.897019 30441 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:51.899070 30779 raft_consensus.cc:2749] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:51.900919 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:07:51.901484 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:07:51.903021 30666 tablet_bootstrap.cc:654] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:51.904479 30517 leader_election.cc:343] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:51.905812 30665 tablet_bootstrap.cc:492] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:51.913002 30472 raft_consensus.cc:3060] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.916285 30665 tablet_bootstrap.cc:654] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:51.901503 30624 raft_consensus.cc:3060] T 541099fd564e49f2ad553f250f319fb0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.895669 30778 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:51.899103 30686 raft_consensus.cc:515] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.930493 30667 tablet_bootstrap.cc:492] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:51.931106 30667 ts_tablet_manager.cc:1403] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.014s
I20260709 13:07:51.937172 30667 raft_consensus.cc:359] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.937877 30667 raft_consensus.cc:385] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:51.938206 30667 raft_consensus.cc:740] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:51.946158 30667 consensus_queue.cc:260] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:51.956241 30667 ts_tablet_manager.cc:1434] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 13:07:51.956957 30667 tablet_bootstrap.cc:492] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:51.967845 30758 consensus_queue.cc:1048] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:51.960834 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:07:51.972189 30473 raft_consensus.cc:3060] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:51.963569 30686 leader_election.cc:290] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:51.972940 30374 catalog_manager.cc:5697] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:51.960464 30624 raft_consensus.cc:2468] T 541099fd564e49f2ad553f250f319fb0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
I20260709 13:07:51.979418 30666 tablet_bootstrap.cc:492] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:51.982632 30666 ts_tablet_manager.cc:1403] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.087s	user 0.015s	sys 0.025s
I20260709 13:07:52.005002 30755 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.005967 30516 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:07:52.006456 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:07:52.020262 30686 raft_consensus.cc:2804] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:52.022305 30686 raft_consensus.cc:697] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:07:52.023388 30686 consensus_queue.cc:237] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.017771 30476 raft_consensus.cc:3060] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:52.030278 30778 consensus_queue.cc:1048] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:52.017947 30774 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.031889 30666 raft_consensus.cc:359] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.031987 30774 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.032636 30666 raft_consensus.cc:385] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.032941 30666 raft_consensus.cc:740] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.033711 30666 consensus_queue.cc:260] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:07:52.019869 30516 leader_election.cc:343] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.047972 30774 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:52.050078 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:52.050699 30473 raft_consensus.cc:2468] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
W20260709 13:07:52.051446 30440 leader_election.cc:343] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.057389 30757 consensus_queue.cc:1048] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:52.057595 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:52.057781 30517 leader_election.cc:304] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:52.058261 30624 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 0.
I20260709 13:07:52.059953 30771 raft_consensus.cc:2804] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:52.017987 30755 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.061822 30667 tablet_bootstrap.cc:654] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.064077 30666 ts_tablet_manager.cc:1434] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.081s	user 0.001s	sys 0.008s
I20260709 13:07:52.064976 30666 tablet_bootstrap.cc:492] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:52.068544 30441 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:07:52.071682 30774 raft_consensus.cc:2804] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:52.072098 30774 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.072445 30774 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:52.073144 30755 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:52.073693 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:52.063539 30771 raft_consensus.cc:697] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:07:52.106117 30665 tablet_bootstrap.cc:492] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:52.106668 30665 ts_tablet_manager.cc:1403] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.201s	user 0.010s	sys 0.008s
I20260709 13:07:52.106451 30374 catalog_manager.cc:5697] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:52.104234 30517 leader_election.cc:343] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.116189 30666 tablet_bootstrap.cc:654] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.117240 30771 consensus_queue.cc:237] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.125373 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:52.126091 30624 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 0.
I20260709 13:07:52.129848 30665 raft_consensus.cc:359] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.130599 30665 raft_consensus.cc:385] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.130892 30665 raft_consensus.cc:740] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.132457 30516 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:07:52.134178 30770 raft_consensus.cc:2804] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:52.134548 30770 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.133890 30774 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.134997 30770 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:52.135860 30862 log.cc:927] Time spent T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:07:52.136386 30778 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.137071 30765 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.136888 30778 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.137530 30765 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.139412 30765 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:52.131573 30665 consensus_queue.cc:260] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.143628 30770 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.141311 30765 consensus_queue.cc:1048] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:07:52.143882 30779 consensus_queue.cc:1048] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:52.148001 30665 ts_tablet_manager.cc:1434] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 13:07:52.149387 30665 tablet_bootstrap.cc:492] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:52.153843 30778 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:52.156085 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:52.155633 30774 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:52.160910 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:52.166605 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:52.167191 30472 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 0.
I20260709 13:07:52.168052 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:07:52.170779 30666 tablet_bootstrap.cc:492] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:52.171221 30666 ts_tablet_manager.cc:1403] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.106s	user 0.008s	sys 0.012s
I20260709 13:07:52.170895 30667 tablet_bootstrap.cc:492] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:52.172024 30667 ts_tablet_manager.cc:1403] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.215s	user 0.020s	sys 0.012s
W20260709 13:07:52.176309 30516 leader_election.cc:343] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:52.177160 30440 leader_election.cc:343] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.177760 30549 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 0.
I20260709 13:07:52.181752 30440 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:07:52.177737 30770 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:52.184420 30666 raft_consensus.cc:359] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.184916 30666 raft_consensus.cc:385] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.185132 30666 raft_consensus.cc:740] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.187273 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:07:52.189085 30666 consensus_queue.cc:260] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.190697 30871 raft_consensus.cc:2804] T 0c27ff7cbfd647edb6f31aac3e234914 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:52.192073 30871 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.192384 30871 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:52.196066 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:52.207415 30666 ts_tablet_manager.cc:1434] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.036s	user 0.004s	sys 0.004s
I20260709 13:07:52.208635 30666 tablet_bootstrap.cc:492] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:52.195474 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:07:52.209321 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:07:52.209584 30517 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:52.209910 30620 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:52.210738 30517 leader_election.cc:343] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.200790 30623 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 0.
I20260709 13:07:52.212271 30622 raft_consensus.cc:3060] T 7f8b6eff35aa4b96bf5f73d6a94db695 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:52.212358 30765 raft_consensus.cc:2804] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:52.217387 30765 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.217751 30765 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:52.223093 30667 raft_consensus.cc:359] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.223781 30667 raft_consensus.cc:385] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.224069 30667 raft_consensus.cc:740] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.224700 30667 consensus_queue.cc:260] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.227829 30667 ts_tablet_manager.cc:1434] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.055s	user 0.001s	sys 0.004s
I20260709 13:07:52.228652 30667 tablet_bootstrap.cc:492] T 5302637c04824f67b70df2f3ee95c130 P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
W20260709 13:07:52.233681 30866 log.cc:927] Time spent T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:07:52.237061 30620 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
I20260709 13:07:52.236510 30371 catalog_manager.cc:5697] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:52.238068 30516 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:07:52.218849 30625 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:52.239724 30771 raft_consensus.cc:2804] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:52.242118 30771 raft_consensus.cc:697] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:07:52.242913 30771 consensus_queue.cc:237] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.267704 30667 tablet_bootstrap.cc:654] T 5302637c04824f67b70df2f3ee95c130 P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.286033 30765 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.290370 30666 tablet_bootstrap.cc:654] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.292822 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:07:52.293375 30620 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:52.297760 30373 catalog_manager.cc:5697] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:52.300220 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:07:52.300529 30620 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
I20260709 13:07:52.301685 30516 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:07:52.302759 30770 raft_consensus.cc:2804] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:52.303189 30770 raft_consensus.cc:697] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:07:52.304320 30755 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.304764 30755 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.306727 30755 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:52.307250 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:52.308605 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:07:52.308789 30422 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:52.290880 30765 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:07:52.309762 30517 leader_election.cc:343] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.279568 30871 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:07:52.313505 30516 leader_election.cc:343] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.311444 30770 consensus_queue.cc:237] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.315127 30474 raft_consensus.cc:2393] T 0c27ff7cbfd647edb6f31aac3e234914 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 1: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:07:52.317019 30665 tablet_bootstrap.cc:654] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.318297 30758 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:07:52.318785 30758 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.319232 30871 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:52.317474 30516 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:52.321224 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
W20260709 13:07:52.327867 30517 consensus_peers.cc:597] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:52.321798 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:07:52.330821 30755 raft_consensus.cc:2749] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:52.331252 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:52.332448 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:52.329389 30758 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:52.340593 30589 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:07:52.346648 30861 raft_consensus.cc:2749] T 7f8b6eff35aa4b96bf5f73d6a94db695 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:52.349476 30371 catalog_manager.cc:5697] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:52.378993 30770 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:07:52.379683 30770 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.382915 30778 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.383193 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:52.383359 30778 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.385123 30472 raft_consensus.cc:2468] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 2.
I20260709 13:07:52.362916 30620 raft_consensus.cc:2393] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 1: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:07:52.387727 30770 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:52.388033 30441 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:52.389503 30774 raft_consensus.cc:2749] T 0c27ff7cbfd647edb6f31aac3e234914 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:52.333973 30625 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 1.
I20260709 13:07:52.389281 30517 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:07:52.388799 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:52.395605 30441 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:07:52.396152 30771 raft_consensus.cc:2804] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:52.396720 30771 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
W20260709 13:07:52.396296 30517 consensus_peers.cc:597] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:52.397363 30621 raft_consensus.cc:2393] T 0a6e86e0a4b843478d5970b29ad63ad7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 2: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:07:52.398227 30771 raft_consensus.cc:3060] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:52.396148 30778 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:52.401827 30867 raft_consensus.cc:2804] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:52.402478 30867 raft_consensus.cc:697] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:07:52.403889 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:52.403482 30867 consensus_queue.cc:237] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.407054 30665 tablet_bootstrap.cc:492] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:52.407512 30665 ts_tablet_manager.cc:1403] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.258s	user 0.022s	sys 0.026s
I20260709 13:07:52.409360 30765 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.409989 30765 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.410921 30665 raft_consensus.cc:359] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.411644 30665 raft_consensus.cc:385] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.412024 30665 raft_consensus.cc:740] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.412166 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:52.412895 30665 consensus_queue.cc:260] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.414690 30765 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:52.423571 30665 ts_tablet_manager.cc:1434] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:07:52.424710 30665 tablet_bootstrap.cc:492] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:52.426406 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:52.435199 30665 tablet_bootstrap.cc:654] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.417232 30771 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.441318 30667 tablet_bootstrap.cc:492] T 5302637c04824f67b70df2f3ee95c130 P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:52.441373 30549 raft_consensus.cc:2468] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 2.
I20260709 13:07:52.441802 30667 ts_tablet_manager.cc:1403] T 5302637c04824f67b70df2f3ee95c130 P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.213s	user 0.010s	sys 0.017s
I20260709 13:07:52.441262 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:07:52.443463 30440 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:52.444944 30778 raft_consensus.cc:2804] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:52.445431 30778 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.445849 30778 raft_consensus.cc:3060] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:52.448472 30517 leader_election.cc:343] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.448383 30667 raft_consensus.cc:359] T 5302637c04824f67b70df2f3ee95c130 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.449067 30667 raft_consensus.cc:385] T 5302637c04824f67b70df2f3ee95c130 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.448462 30665 tablet_bootstrap.cc:492] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:52.449445 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:07:52.449901 30665 ts_tablet_manager.cc:1403] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.006s
I20260709 13:07:52.449342 30667 raft_consensus.cc:740] T 5302637c04824f67b70df2f3ee95c130 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.453836 30667 consensus_queue.cc:260] T 5302637c04824f67b70df2f3ee95c130 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.454893 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:07:52.456486 30516 leader_election.cc:343] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.457038 30516 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:52.453198 30665 raft_consensus.cc:359] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.461011 30665 raft_consensus.cc:385] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.461890 30621 raft_consensus.cc:2393] T 0a6e86e0a4b843478d5970b29ad63ad7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 2: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:07:52.461098 30778 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.462862 30472 raft_consensus.cc:2368] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 2. Current term is 3.
I20260709 13:07:52.463716 30667 ts_tablet_manager.cc:1434] T 5302637c04824f67b70df2f3ee95c130 P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.003s
I20260709 13:07:52.461882 30665 raft_consensus.cc:740] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.464649 30667 tablet_bootstrap.cc:492] T cb22806325394ba386d8549bc4a64701 P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:52.462463 30770 raft_consensus.cc:2749] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:52.465623 30665 consensus_queue.cc:260] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.467917 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:07:52.470580 30665 ts_tablet_manager.cc:1434] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:07:52.473592 30665 tablet_bootstrap.cc:492] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:52.471469 30666 tablet_bootstrap.cc:492] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:52.471189 30889 consensus_queue.cc:1048] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:52.475278 30666 ts_tablet_manager.cc:1403] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.267s	user 0.031s	sys 0.023s
I20260709 13:07:52.466600 30778 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:52.468954 30621 raft_consensus.cc:3060] T 0a6e86e0a4b843478d5970b29ad63ad7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:52.475993 30667 tablet_bootstrap.cc:654] T cb22806325394ba386d8549bc4a64701 P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.477963 30666 raft_consensus.cc:359] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.479049 30666 raft_consensus.cc:385] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.479408 30666 raft_consensus.cc:740] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.480393 30666 consensus_queue.cc:260] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.466325 30771 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:52.483215 30666 ts_tablet_manager.cc:1434] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:07:52.484115 30666 tablet_bootstrap.cc:492] T b0842494dc2a48d89fb422524082081d P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:52.484637 30621 raft_consensus.cc:2468] T 0a6e86e0a4b843478d5970b29ad63ad7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
I20260709 13:07:52.486317 30441 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:07:52.486924 30778 raft_consensus.cc:2804] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:52.487630 30778 raft_consensus.cc:697] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:07:52.488703 30778 consensus_queue.cc:237] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.510099 30867 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.510601 30867 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.512720 30867 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:52.513852 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:07:52.515566 30441 leader_election.cc:343] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.527004 30666 tablet_bootstrap.cc:654] T b0842494dc2a48d89fb422524082081d P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.533881 30517 leader_election.cc:400] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 election: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 2. Current term is 3.
I20260709 13:07:52.534307 30517 leader_election.cc:403] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 13:07:52.535461 30517 consensus_peers.cc:597] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:52.536748 30882 raft_consensus.cc:3060] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:52.542176 30666 tablet_bootstrap.cc:492] T b0842494dc2a48d89fb422524082081d P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:52.542603 30666 ts_tablet_manager.cc:1403] T b0842494dc2a48d89fb422524082081d P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.059s	user 0.013s	sys 0.017s
I20260709 13:07:52.548266 30686 consensus_queue.cc:1048] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:52.549636 30665 tablet_bootstrap.cc:654] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.557156 30666 raft_consensus.cc:359] T b0842494dc2a48d89fb422524082081d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.558072 30666 raft_consensus.cc:385] T b0842494dc2a48d89fb422524082081d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.558408 30666 raft_consensus.cc:740] T b0842494dc2a48d89fb422524082081d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.559229 30666 consensus_queue.cc:260] T b0842494dc2a48d89fb422524082081d P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.562666 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:52.563268 30549 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 0.
I20260709 13:07:52.570024 30666 ts_tablet_manager.cc:1434] T b0842494dc2a48d89fb422524082081d P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:07:52.570742 30666 tablet_bootstrap.cc:492] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:52.572116 30440 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:52.574628 30774 raft_consensus.cc:2804] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:52.574990 30774 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.577344 30774 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:52.565809 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:07:52.588871 30867 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.594048 30666 tablet_bootstrap.cc:654] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.591504 30867 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.597025 30667 tablet_bootstrap.cc:492] T cb22806325394ba386d8549bc4a64701 P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:52.597468 30667 ts_tablet_manager.cc:1403] T cb22806325394ba386d8549bc4a64701 P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.133s	user 0.008s	sys 0.021s
I20260709 13:07:52.616137 30771 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.616691 30771 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.606798 30883 consensus_queue.cc:1048] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:07:52.636535 30867 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:52.644529 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:52.645200 30549 raft_consensus.cc:2468] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 0.
I20260709 13:07:52.646457 30440 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:07:52.647701 30778 raft_consensus.cc:2804] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:52.648074 30778 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.648186 30771 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:52.648415 30778 raft_consensus.cc:3060] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:52.650403 30667 raft_consensus.cc:359] T cb22806325394ba386d8549bc4a64701 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.651405 30667 raft_consensus.cc:385] T cb22806325394ba386d8549bc4a64701 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.651937 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:52.652700 30621 raft_consensus.cc:2468] T b0842494dc2a48d89fb422524082081d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 0.
I20260709 13:07:52.657279 30667 raft_consensus.cc:740] T cb22806325394ba386d8549bc4a64701 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.667022 30667 consensus_queue.cc:260] T cb22806325394ba386d8549bc4a64701 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.668143 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:52.669044 30619 raft_consensus.cc:2393] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 1: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:07:52.671451 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:52.675799 30476 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:52.677731 30516 consensus_peers.cc:597] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd -> Peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Couldn't send request to peer fe2b7d73f8c743c1ba570cfd981c4e79. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:52.671795 30778 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.679643 30667 ts_tablet_manager.cc:1434] T cb22806325394ba386d8549bc4a64701 P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.082s	user 0.009s	sys 0.001s
I20260709 13:07:52.680707 30667 tablet_bootstrap.cc:492] T 265fc568d5674c78833106e4eda814f4 P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:52.681834 30517 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:52.682572 30884 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:52.682893 30778 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:52.688225 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:07:52.690263 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:07:52.693666 30623 raft_consensus.cc:3060] T b0842494dc2a48d89fb422524082081d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:52.697436 30549 raft_consensus.cc:3060] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:52.723296 30667 tablet_bootstrap.cc:654] T 265fc568d5674c78833106e4eda814f4 P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.717505 30774 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.715502 30666 tablet_bootstrap.cc:492] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:52.734283 30666 ts_tablet_manager.cc:1403] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.164s	user 0.028s	sys 0.019s
I20260709 13:07:52.711229 30882 raft_consensus.cc:2749] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 2. Current term is 3.
I20260709 13:07:52.713042 30665 tablet_bootstrap.cc:492] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:52.735533 30665 ts_tablet_manager.cc:1403] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.262s	user 0.005s	sys 0.019s
I20260709 13:07:52.741505 30548 raft_consensus.cc:2468] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
I20260709 13:07:52.722168 30623 raft_consensus.cc:2468] T b0842494dc2a48d89fb422524082081d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 1.
I20260709 13:07:52.738488 30373 catalog_manager.cc:5697] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 0 to 1, leader changed from <none> to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:52.745393 30882 consensus_queue.cc:1048] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:52.713704 30884 raft_consensus.cc:2749] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:52.745700 30666 raft_consensus.cc:359] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.746572 30666 raft_consensus.cc:385] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.746850 30666 raft_consensus.cc:740] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.745800 30373 catalog_manager.cc:5697] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:52.747464 30666 consensus_queue.cc:260] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.711280 30549 raft_consensus.cc:2468] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 1.
I20260709 13:07:52.749501 30665 raft_consensus.cc:359] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.754578 30665 raft_consensus.cc:385] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.756402 30665 raft_consensus.cc:740] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.757078 30665 consensus_queue.cc:260] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.751302 30441 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:07:52.756069 30666 ts_tablet_manager.cc:1434] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 13:07:52.758939 30671 raft_consensus.cc:2804] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:52.759622 30671 raft_consensus.cc:697] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:07:52.760185 30666 tablet_bootstrap.cc:492] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:52.760538 30671 consensus_queue.cc:237] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.763242 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:07:52.753983 30774 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:52.763886 30549 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:52.764290 30882 raft_consensus.cc:493] T 5302637c04824f67b70df2f3ee95c130 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.764765 30882 raft_consensus.cc:515] T 5302637c04824f67b70df2f3ee95c130 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.766705 30882 leader_election.cc:290] T 5302637c04824f67b70df2f3ee95c130 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:52.763911 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:07:52.767804 30666 tablet_bootstrap.cc:654] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.768361 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:52.773572 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:07:52.774788 30517 leader_election.cc:343] T 5302637c04824f67b70df2f3ee95c130 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.775748 30665 ts_tablet_manager.cc:1434] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.001s
I20260709 13:07:52.775471 30755 consensus_queue.cc:1048] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:52.767746 30623 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:52.777768 30516 leader_election.cc:343] T 5302637c04824f67b70df2f3ee95c130 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.778185 30516 leader_election.cc:304] T 5302637c04824f67b70df2f3ee95c130 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:52.779186 30755 raft_consensus.cc:2749] T 5302637c04824f67b70df2f3ee95c130 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:52.781004 30665 tablet_bootstrap.cc:492] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:52.785791 30882 consensus_queue.cc:1048] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:52.772923 30549 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 1.
I20260709 13:07:52.787196 30440 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:07:52.788102 30774 raft_consensus.cc:2804] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:52.788757 30774 raft_consensus.cc:697] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:07:52.789606 30774 consensus_queue.cc:237] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.803558 30882 consensus_queue.cc:1048] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:52.806571 30623 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 1.
I20260709 13:07:52.813012 30665 tablet_bootstrap.cc:654] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.828439 30666 tablet_bootstrap.cc:492] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:52.828893 30666 ts_tablet_manager.cc:1403] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.069s	user 0.028s	sys 0.008s
I20260709 13:07:52.827090 30667 tablet_bootstrap.cc:492] T 265fc568d5674c78833106e4eda814f4 P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:52.830649 30667 ts_tablet_manager.cc:1403] T 265fc568d5674c78833106e4eda814f4 P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.150s	user 0.016s	sys 0.026s
I20260709 13:07:52.831305 30666 raft_consensus.cc:359] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.831959 30666 raft_consensus.cc:385] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.832201 30666 raft_consensus.cc:740] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.832991 30667 raft_consensus.cc:359] T 265fc568d5674c78833106e4eda814f4 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.832994 30666 consensus_queue.cc:260] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.833760 30667 raft_consensus.cc:385] T 265fc568d5674c78833106e4eda814f4 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.834059 30667 raft_consensus.cc:740] T 265fc568d5674c78833106e4eda814f4 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.834640 30667 consensus_queue.cc:260] T 265fc568d5674c78833106e4eda814f4 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.835426 30666 ts_tablet_manager.cc:1434] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:07:52.836328 30666 tablet_bootstrap.cc:492] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:52.836652 30667 ts_tablet_manager.cc:1434] T 265fc568d5674c78833106e4eda814f4 P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:07:52.837496 30667 tablet_bootstrap.cc:492] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:52.841703 30666 tablet_bootstrap.cc:654] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.841749 30373 catalog_manager.cc:5697] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 0 to 1, leader changed from <none> to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:52.842736 30667 tablet_bootstrap.cc:654] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.844014 30373 catalog_manager.cc:5697] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 0 to 1, leader changed from <none> to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:52.846268 30774 consensus_queue.cc:1048] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:52.855151 30666 tablet_bootstrap.cc:492] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:52.855597 30666 ts_tablet_manager.cc:1403] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.007s
I20260709 13:07:52.857941 30666 raft_consensus.cc:359] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.858560 30666 raft_consensus.cc:385] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.858814 30666 raft_consensus.cc:740] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.859370 30666 consensus_queue.cc:260] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.859930 30758 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.860320 30758 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.862435 30758 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:52.863054 30666 ts_tablet_manager.cc:1434] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:07:52.863387 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:52.863962 30666 tablet_bootstrap.cc:492] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
W20260709 13:07:52.864909 30591 leader_election.cc:343] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.865586 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:52.866169 30549 raft_consensus.cc:2468] T cb22806325394ba386d8549bc4a64701 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 0.
I20260709 13:07:52.867376 30589 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:07:52.868399 30870 raft_consensus.cc:2804] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:52.868726 30870 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.868988 30870 raft_consensus.cc:3060] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:52.869863 30671 consensus_queue.cc:1048] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:52.875407 30870 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.877517 30870 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:52.878120 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:07:52.879837 30666 tablet_bootstrap.cc:654] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.860311 30667 tablet_bootstrap.cc:492] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:52.881500 30667 ts_tablet_manager.cc:1403] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.044s	user 0.008s	sys 0.009s
W20260709 13:07:52.879375 30591 leader_election.cc:343] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.883939 30667 raft_consensus.cc:359] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.884557 30667 raft_consensus.cc:385] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.884848 30667 raft_consensus.cc:740] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.885667 30667 consensus_queue.cc:260] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.884639 30665 tablet_bootstrap.cc:492] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:52.887832 30667 ts_tablet_manager.cc:1434] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
I20260709 13:07:52.888140 30665 ts_tablet_manager.cc:1403] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.112s	user 0.008s	sys 0.007s
I20260709 13:07:52.888666 30667 tablet_bootstrap.cc:492] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:52.890527 30665 raft_consensus.cc:359] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.891170 30665 raft_consensus.cc:385] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.891407 30665 raft_consensus.cc:740] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.892055 30665 consensus_queue.cc:260] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.894013 30665 ts_tablet_manager.cc:1434] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:07:52.894760 30665 tablet_bootstrap.cc:492] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:52.894893 30667 tablet_bootstrap.cc:654] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.902251 30665 tablet_bootstrap.cc:654] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.908424 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:07:52.909401 30667 tablet_bootstrap.cc:492] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:52.911190 30667 ts_tablet_manager.cc:1403] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.005s
I20260709 13:07:52.911190 30549 raft_consensus.cc:3060] T cb22806325394ba386d8549bc4a64701 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:52.913727 30667 raft_consensus.cc:359] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.914342 30667 raft_consensus.cc:385] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.914597 30667 raft_consensus.cc:740] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.915163 30667 consensus_queue.cc:260] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.917879 30870 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.918322 30870 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.920292 30870 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:52.921161 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:07:52.922477 30591 leader_election.cc:343] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.924221 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:52.925420 30549 raft_consensus.cc:2468] T cb22806325394ba386d8549bc4a64701 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 1.
W20260709 13:07:52.925977 30589 leader_election.cc:343] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:52.926412 30589 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:07:52.927079 30870 raft_consensus.cc:2749] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:52.927706 30589 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:07:52.928495 30870 raft_consensus.cc:2804] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:52.928936 30870 raft_consensus.cc:697] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:07:52.929200 30667 ts_tablet_manager.cc:1434] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:07:52.929762 30666 tablet_bootstrap.cc:492] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:52.930101 30667 tablet_bootstrap.cc:492] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:52.929709 30870 consensus_queue.cc:237] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.930383 30666 ts_tablet_manager.cc:1403] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.067s	user 0.034s	sys 0.016s
I20260709 13:07:52.933012 30666 raft_consensus.cc:359] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.933710 30666 raft_consensus.cc:385] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.933938 30758 raft_consensus.cc:493] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.934042 30666 raft_consensus.cc:740] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.934494 30758 raft_consensus.cc:515] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.934959 30666 consensus_queue.cc:260] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.935801 30667 tablet_bootstrap.cc:654] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.936364 30758 leader_election.cc:290] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:52.937531 30666 ts_tablet_manager.cc:1434] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:07:52.938766 30666 tablet_bootstrap.cc:492] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:52.939491 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:52.940412 30665 tablet_bootstrap.cc:492] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:52.940845 30665 ts_tablet_manager.cc:1403] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.046s	user 0.014s	sys 0.000s
I20260709 13:07:52.941768 30623 raft_consensus.cc:1275] T 0a6e86e0a4b843478d5970b29ad63ad7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:52.943467 30665 raft_consensus.cc:359] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.944144 30665 raft_consensus.cc:385] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:52.943959 30774 consensus_queue.cc:1048] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:52.944406 30665 raft_consensus.cc:740] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:52.945029 30665 consensus_queue.cc:260] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:52.947382 30666 tablet_bootstrap.cc:654] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.955739 30665 ts_tablet_manager.cc:1434] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:07:52.960348 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:52.962333 30589 leader_election.cc:304] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:07:52.965770 30758 raft_consensus.cc:2749] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:52.966367 30665 tablet_bootstrap.cc:492] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:52.976436 30665 tablet_bootstrap.cc:654] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:52.982136 30666 tablet_bootstrap.cc:492] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:52.982583 30666 ts_tablet_manager.cc:1403] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.044s	user 0.021s	sys 0.019s
I20260709 13:07:52.997822 30549 raft_consensus.cc:1275] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:53.002048 30373 catalog_manager.cc:5697] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 1 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:53.081286 30654 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.IsCreateTableDone -> {remote=127.28.173.62:33437, user_credentials={real_user=slave}} blocked reactor thread for 87773.3us
I20260709 13:07:53.081236 30666 raft_consensus.cc:359] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.082085 30666 raft_consensus.cc:385] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.082366 30666 raft_consensus.cc:740] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.083002 30666 consensus_queue.cc:260] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.084712 30666 ts_tablet_manager.cc:1434] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.102s	user 0.029s	sys 0.028s
I20260709 13:07:53.086901 30666 tablet_bootstrap.cc:492] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:53.096168 30666 tablet_bootstrap.cc:654] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.097307 30778 consensus_queue.cc:1048] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:53.098867 30867 raft_consensus.cc:493] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.099330 30867 raft_consensus.cc:515] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.100095 30667 tablet_bootstrap.cc:492] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
W20260709 13:07:53.100044 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 93456.5us
I20260709 13:07:53.100584 30667 ts_tablet_manager.cc:1403] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.171s	user 0.040s	sys 0.040s
I20260709 13:07:53.101260 30867 leader_election.cc:290] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:53.101687 30778 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.102201 30778 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.104728 30665 tablet_bootstrap.cc:492] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:53.105139 30665 ts_tablet_manager.cc:1403] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.139s	user 0.017s	sys 0.006s
I20260709 13:07:53.107718 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:53.108340 30625 raft_consensus.cc:2468] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 0.
I20260709 13:07:53.108789 30667 raft_consensus.cc:359] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.109395 30667 raft_consensus.cc:385] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.109647 30667 raft_consensus.cc:740] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.110091 30441 leader_election.cc:304] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:07:53.110240 30667 consensus_queue.cc:260] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.107549 30665 raft_consensus.cc:359] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.111382 30665 raft_consensus.cc:385] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.111670 30665 raft_consensus.cc:740] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.112273 30778 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:53.113024 30774 raft_consensus.cc:2804] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:53.113399 30774 raft_consensus.cc:493] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.113737 30774 raft_consensus.cc:3060] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.116621 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:53.117430 30550 raft_consensus.cc:2468] T 5302637c04824f67b70df2f3ee95c130 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 0.
I20260709 13:07:53.118615 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:53.119182 30549 raft_consensus.cc:2468] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 0.
I20260709 13:07:53.120182 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:53.120885 30623 raft_consensus.cc:2468] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 0.
I20260709 13:07:53.112335 30665 consensus_queue.cc:260] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.128427 30774 raft_consensus.cc:515] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.129343 30665 ts_tablet_manager.cc:1434] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:07:53.130724 30665 tablet_bootstrap.cc:492] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:53.128430 30667 ts_tablet_manager.cc:1434] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.002s
I20260709 13:07:53.132372 30667 tablet_bootstrap.cc:492] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:53.137177 30666 tablet_bootstrap.cc:492] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:53.133266 30774 leader_election.cc:290] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:53.137629 30666 ts_tablet_manager.cc:1403] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.013s
I20260709 13:07:53.137939 30665 tablet_bootstrap.cc:654] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.140101 30666 raft_consensus.cc:359] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.140743 30666 raft_consensus.cc:385] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.141063 30666 raft_consensus.cc:740] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.141198 30667 tablet_bootstrap.cc:654] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.144042 30666 consensus_queue.cc:260] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.146804 30666 ts_tablet_manager.cc:1434] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:07:53.147637 30666 tablet_bootstrap.cc:492] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:53.154980 30667 tablet_bootstrap.cc:492] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:53.155473 30667 ts_tablet_manager.cc:1403] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.002s
I20260709 13:07:53.155491 30666 tablet_bootstrap.cc:654] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.158231 30667 raft_consensus.cc:359] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.158916 30667 raft_consensus.cc:385] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.159228 30667 raft_consensus.cc:740] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.159875 30667 consensus_queue.cc:260] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.162580 30667 ts_tablet_manager.cc:1434] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:07:53.164052 30667 tablet_bootstrap.cc:492] T a0273ed018424f3a9529e09669fdb7b0 P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:53.166535 30440 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:07:53.168205 30867 raft_consensus.cc:2804] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:53.168586 30867 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.169279 30867 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.170562 30666 tablet_bootstrap.cc:492] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:53.171118 30666 ts_tablet_manager.cc:1403] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.001s
I20260709 13:07:53.172225 30665 tablet_bootstrap.cc:492] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:53.172750 30665 ts_tablet_manager.cc:1403] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.000s
I20260709 13:07:53.174341 30666 raft_consensus.cc:359] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.170619 30667 tablet_bootstrap.cc:654] T a0273ed018424f3a9529e09669fdb7b0 P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.175004 30666 raft_consensus.cc:385] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.175308 30666 raft_consensus.cc:740] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.175973 30666 consensus_queue.cc:260] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.184707 30665 raft_consensus.cc:359] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.185377 30665 raft_consensus.cc:385] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.185659 30665 raft_consensus.cc:740] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.185775 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:07:53.186362 30623 raft_consensus.cc:3060] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.186442 30665 consensus_queue.cc:260] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.175539 30867 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.188973 30867 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:53.194159 30623 raft_consensus.cc:2468] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 1.
I20260709 13:07:53.197803 30666 ts_tablet_manager.cc:1434] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:07:53.197868 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:07:53.198668 30548 raft_consensus.cc:3060] T 5302637c04824f67b70df2f3ee95c130 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.201287 30665 ts_tablet_manager.cc:1434] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.000s
I20260709 13:07:53.202008 30666 tablet_bootstrap.cc:492] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:53.205174 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:07:53.206835 30665 tablet_bootstrap.cc:492] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:53.205785 30550 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.208462 30755 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.209352 30755 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.212834 30441 leader_election.cc:304] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:07:53.212770 30867 consensus_queue.cc:1048] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:53.214022 30774 raft_consensus.cc:2804] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:53.215883 30774 raft_consensus.cc:697] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:07:53.216660 30774 consensus_queue.cc:237] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.220096 30550 raft_consensus.cc:2468] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 1.
I20260709 13:07:53.222285 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:07:53.222693 30440 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:07:53.223702 30871 raft_consensus.cc:2804] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:53.224315 30871 raft_consensus.cc:697] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:07:53.225240 30871 consensus_queue.cc:237] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.226667 30667 tablet_bootstrap.cc:492] T a0273ed018424f3a9529e09669fdb7b0 P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:53.222855 30625 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.227178 30667 ts_tablet_manager.cc:1403] T a0273ed018424f3a9529e09669fdb7b0 P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.063s	user 0.007s	sys 0.020s
I20260709 13:07:53.228921 30778 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.229148 30666 tablet_bootstrap.cc:654] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.237066 30667 raft_consensus.cc:359] T a0273ed018424f3a9529e09669fdb7b0 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.237866 30667 raft_consensus.cc:385] T a0273ed018424f3a9529e09669fdb7b0 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.238175 30667 raft_consensus.cc:740] T a0273ed018424f3a9529e09669fdb7b0 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.229431 30778 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.241406 30778 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:53.242266 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:53.242638 30755 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:53.244840 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:07:53.246210 30516 leader_election.cc:343] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.246656 30667 consensus_queue.cc:260] T a0273ed018424f3a9529e09669fdb7b0 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.249457 30758 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.248967 30778 consensus_queue.cc:1048] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:53.250226 30755 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.231974 30548 raft_consensus.cc:2468] T 5302637c04824f67b70df2f3ee95c130 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 1.
I20260709 13:07:53.251228 30625 raft_consensus.cc:2468] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 1.
I20260709 13:07:53.251474 30758 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.252596 30755 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.260015 30758 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:53.261906 30667 ts_tablet_manager.cc:1434] T a0273ed018424f3a9529e09669fdb7b0 P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.001s
I20260709 13:07:53.263046 30667 tablet_bootstrap.cc:492] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:53.265038 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:53.265717 30549 raft_consensus.cc:2468] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 0.
I20260709 13:07:53.267773 30625 raft_consensus.cc:3060] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.269084 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:07:53.270569 30517 leader_election.cc:343] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.270965 30517 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:53.277289 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:53.274677 30884 raft_consensus.cc:2749] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:53.277982 30755 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:53.280032 30665 tablet_bootstrap.cc:654] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.270998 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:53.281417 30441 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:53.281911 30589 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:07:53.282584 30778 raft_consensus.cc:2749] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:53.282645 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:53.284004 30671 consensus_queue.cc:1048] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:07:53.286777 30591 leader_election.cc:343] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.287539 30758 raft_consensus.cc:2804] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:53.287920 30758 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.288260 30758 raft_consensus.cc:3060] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:53.289907 30517 leader_election.cc:343] T 265fc568d5674c78833106e4eda814f4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.292785 30374 catalog_manager.cc:5697] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 0 to 1, leader changed from <none> to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:53.294198 30758 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.294312 30374 catalog_manager.cc:5697] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 0 to 1, leader changed from <none> to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:53.296871 30884 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.297418 30884 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.302477 30758 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:53.302661 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:53.303596 30884 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:53.305981 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:07:53.306545 30550 raft_consensus.cc:3060] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.316246 30667 tablet_bootstrap.cc:654] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:53.324251 30516 leader_election.cc:343] T 265fc568d5674c78833106e4eda814f4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.324729 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:53.324744 30516 leader_election.cc:304] T 265fc568d5674c78833106e4eda814f4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:53.325587 30620 raft_consensus.cc:2468] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 0.
I20260709 13:07:53.325968 30882 raft_consensus.cc:2749] T 265fc568d5674c78833106e4eda814f4 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:53.329815 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:53.330402 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:07:53.330534 30472 raft_consensus.cc:2468] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 0.
I20260709 13:07:53.331238 30550 raft_consensus.cc:2468] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 1.
I20260709 13:07:53.335170 30665 tablet_bootstrap.cc:492] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:53.335611 30665 ts_tablet_manager.cc:1403] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.129s	user 0.003s	sys 0.012s
I20260709 13:07:53.336261 30516 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:07:53.337184 30882 raft_consensus.cc:2804] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:53.337514 30882 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.337942 30882 raft_consensus.cc:3060] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.338125 30665 raft_consensus.cc:359] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.338842 30665 raft_consensus.cc:385] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.339100 30665 raft_consensus.cc:740] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.341603 30666 tablet_bootstrap.cc:492] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:53.341691 30667 tablet_bootstrap.cc:492] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:53.342135 30666 ts_tablet_manager.cc:1403] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.140s	user 0.008s	sys 0.007s
I20260709 13:07:53.342191 30667 ts_tablet_manager.cc:1403] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.079s	user 0.006s	sys 0.006s
I20260709 13:07:53.345646 30666 raft_consensus.cc:359] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.346524 30666 raft_consensus.cc:385] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.347805 30667 raft_consensus.cc:359] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.348003 30665 consensus_queue.cc:260] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.348490 30667 raft_consensus.cc:385] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.348771 30667 raft_consensus.cc:740] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.350041 30665 ts_tablet_manager.cc:1434] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:07:53.346851 30666 raft_consensus.cc:740] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.356302 30589 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:07:53.358359 30882 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.361407 30758 raft_consensus.cc:2804] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:53.351236 30666 consensus_queue.cc:260] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.371711 30758 raft_consensus.cc:697] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:07:53.372546 30758 consensus_queue.cc:237] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.377990 30473 raft_consensus.cc:3060] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.378067 30667 consensus_queue.cc:260] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.379482 30665 tablet_bootstrap.cc:492] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:53.381477 30667 ts_tablet_manager.cc:1434] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.036s	user 0.004s	sys 0.000s
I20260709 13:07:53.382351 30667 tablet_bootstrap.cc:492] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:53.385133 30665 tablet_bootstrap.cc:654] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.389113 30666 ts_tablet_manager.cc:1434] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.002s
I20260709 13:07:53.388710 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:07:53.389564 30472 raft_consensus.cc:3060] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.391394 30667 tablet_bootstrap.cc:654] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.394192 30882 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:53.395537 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:07:53.396121 30472 raft_consensus.cc:2468] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
I20260709 13:07:53.396324 30623 raft_consensus.cc:3060] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.397607 30666 tablet_bootstrap.cc:492] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:53.403623 30666 tablet_bootstrap.cc:654] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.406709 30623 raft_consensus.cc:2468] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
I20260709 13:07:53.407543 30665 tablet_bootstrap.cc:492] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:53.407994 30665 ts_tablet_manager.cc:1403] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.000s
I20260709 13:07:53.409293 30516 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:07:53.410737 30665 raft_consensus.cc:359] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.411249 30884 raft_consensus.cc:2804] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:53.411576 30665 raft_consensus.cc:385] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.409657 30666 tablet_bootstrap.cc:492] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:53.411966 30665 raft_consensus.cc:740] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.412238 30666 ts_tablet_manager.cc:1403] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:07:53.412678 30665 consensus_queue.cc:260] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.414201 30884 raft_consensus.cc:697] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:07:53.414950 30666 raft_consensus.cc:359] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.415620 30666 raft_consensus.cc:385] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.415247 30884 consensus_queue.cc:237] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.415951 30666 raft_consensus.cc:740] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.416710 30666 consensus_queue.cc:260] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.418854 30666 ts_tablet_manager.cc:1434] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:07:53.419704 30666 tablet_bootstrap.cc:492] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:53.422109 30861 consensus_queue.cc:1048] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:53.425496 30666 tablet_bootstrap.cc:654] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.426419 30665 ts_tablet_manager.cc:1434] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:07:53.429481 30887 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.429927 30887 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.431327 30374 catalog_manager.cc:5697] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:53.432365 30887 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:53.443996 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:07:53.445843 30591 leader_election.cc:343] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.447201 30665 tablet_bootstrap.cc:492] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
W20260709 13:07:53.457825 30516 leader_election.cc:343] T a0273ed018424f3a9529e09669fdb7b0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.477962 30666 tablet_bootstrap.cc:492] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:53.478499 30666 ts_tablet_manager.cc:1403] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.059s	user 0.025s	sys 0.015s
I20260709 13:07:53.481113 30666 raft_consensus.cc:359] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.481775 30666 raft_consensus.cc:385] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.482111 30666 raft_consensus.cc:740] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.482797 30666 consensus_queue.cc:260] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.480695 30665 tablet_bootstrap.cc:654] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.485318 30666 ts_tablet_manager.cc:1434] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:07:53.486279 30666 tablet_bootstrap.cc:492] T 8b8abe384b054cf09bfba7143adf03f1 P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:53.493609 30666 tablet_bootstrap.cc:654] T 8b8abe384b054cf09bfba7143adf03f1 P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.509378 30666 tablet_bootstrap.cc:492] T 8b8abe384b054cf09bfba7143adf03f1 P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:53.510741 30666 ts_tablet_manager.cc:1403] T 8b8abe384b054cf09bfba7143adf03f1 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.002s
I20260709 13:07:53.516400 30666 raft_consensus.cc:359] T 8b8abe384b054cf09bfba7143adf03f1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.519665 30666 raft_consensus.cc:385] T 8b8abe384b054cf09bfba7143adf03f1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.520375 30666 raft_consensus.cc:740] T 8b8abe384b054cf09bfba7143adf03f1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.521500 30666 consensus_queue.cc:260] T 8b8abe384b054cf09bfba7143adf03f1 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.520486 30774 consensus_queue.cc:1048] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:53.517671 30371 catalog_manager.cc:5697] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 1 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:53.522125 30867 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.524842 30867 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.526383 30666 ts_tablet_manager.cc:1434] T 8b8abe384b054cf09bfba7143adf03f1 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:07:53.527524 30867 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:53.528206 30666 tablet_bootstrap.cc:492] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:53.533344 30665 tablet_bootstrap.cc:492] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:53.534370 30942 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.534943 30942 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.536135 30665 ts_tablet_manager.cc:1403] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.092s	user 0.024s	sys 0.007s
I20260709 13:07:53.537293 30942 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:53.538915 30666 tablet_bootstrap.cc:654] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.538705 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:53.539425 30550 raft_consensus.cc:2468] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 0.
I20260709 13:07:53.540783 30589 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:07:53.541512 30942 raft_consensus.cc:2804] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:53.541860 30942 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.542167 30942 raft_consensus.cc:3060] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.541520 30667 tablet_bootstrap.cc:492] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:53.544862 30667 ts_tablet_manager.cc:1403] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.163s	user 0.018s	sys 0.030s
I20260709 13:07:53.547415 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:53.547677 30667 raft_consensus.cc:359] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.548921 30667 raft_consensus.cc:385] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.549199 30667 raft_consensus.cc:740] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.549894 30667 consensus_queue.cc:260] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.552217 30667 ts_tablet_manager.cc:1434] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:07:53.554633 30667 tablet_bootstrap.cc:492] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:53.561659 30667 tablet_bootstrap.cc:654] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.564714 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:07:53.572914 30422 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:53.561686 30942 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.575528 30666 tablet_bootstrap.cc:492] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:53.575981 30666 ts_tablet_manager.cc:1403] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.048s	user 0.016s	sys 0.006s
I20260709 13:07:53.538581 30665 raft_consensus.cc:359] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.577046 30665 raft_consensus.cc:385] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.577204 30473 raft_consensus.cc:3060] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.577512 30942 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:53.577322 30665 raft_consensus.cc:740] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.578969 30666 raft_consensus.cc:359] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.580109 30666 raft_consensus.cc:385] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.580421 30666 raft_consensus.cc:740] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.581110 30666 consensus_queue.cc:260] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.582402 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:07:53.584097 30666 ts_tablet_manager.cc:1434] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:07:53.586484 30550 raft_consensus.cc:3060] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.585021 30867 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.593370 30867 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.597139 30867 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:53.598856 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:53.608522 30666 tablet_bootstrap.cc:492] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
W20260709 13:07:53.608635 30517 leader_election.cc:343] T a0273ed018424f3a9529e09669fdb7b0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.609048 30517 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:53.609694 30765 raft_consensus.cc:2749] T a0273ed018424f3a9529e09669fdb7b0 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:53.611099 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:53.617923 30666 tablet_bootstrap.cc:654] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.632668 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:53.633343 30474 raft_consensus.cc:2468] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 0.
W20260709 13:07:53.637303 30591 consensus_peers.cc:597] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:53.639967 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:53.640710 30621 raft_consensus.cc:2393] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 1: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:07:53.637236 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:07:53.643904 30474 raft_consensus.cc:3060] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.644129 30665 consensus_queue.cc:260] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.647933 30441 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:53.650630 30665 ts_tablet_manager.cc:1434] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.114s	user 0.006s	sys 0.001s
I20260709 13:07:53.651362 30665 tablet_bootstrap.cc:492] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:53.646461 30550 raft_consensus.cc:2468] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 1.
I20260709 13:07:53.659403 30666 tablet_bootstrap.cc:492] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:53.660944 30947 raft_consensus.cc:493] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.661928 30942 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.668010 30666 ts_tablet_manager.cc:1403] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.060s	user 0.015s	sys 0.000s
I20260709 13:07:53.665402 30441 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:53.668577 30942 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.673866 30942 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:53.675457 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:53.676061 30549 raft_consensus.cc:2468] T 265fc568d5674c78833106e4eda814f4 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 0.
I20260709 13:07:53.679483 30667 tablet_bootstrap.cc:492] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:53.679929 30667 ts_tablet_manager.cc:1403] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.126s	user 0.019s	sys 0.018s
I20260709 13:07:53.668061 30947 raft_consensus.cc:515] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.681227 30946 raft_consensus.cc:2749] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:53.676307 30474 raft_consensus.cc:2468] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 1.
I20260709 13:07:53.682374 30589 leader_election.cc:304] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:07:53.683161 30774 raft_consensus.cc:2749] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:53.684190 30589 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:07:53.684842 30870 raft_consensus.cc:2804] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:53.684998 30942 raft_consensus.cc:2804] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:53.685216 30870 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.685510 30942 raft_consensus.cc:697] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:07:53.685598 30870 raft_consensus.cc:3060] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.686357 30942 consensus_queue.cc:237] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.690063 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:53.692910 30870 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.693989 30947 leader_election.cc:290] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:53.695978 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:53.696925 30665 tablet_bootstrap.cc:654] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.702111 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
W20260709 13:07:53.702307 30591 leader_election.cc:343] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.702417 30947 consensus_queue.cc:1048] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:07:53.704120 30591 leader_election.cc:343] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.705437 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:53.709303 30441 leader_election.cc:304] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:53.700404 30870 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:53.711741 30946 raft_consensus.cc:2749] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:53.714959 30667 raft_consensus.cc:359] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.715651 30667 raft_consensus.cc:385] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.715958 30667 raft_consensus.cc:740] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.717025 30667 consensus_queue.cc:260] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.719493 30666 raft_consensus.cc:359] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.720135 30666 raft_consensus.cc:385] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.722231 30667 ts_tablet_manager.cc:1434] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.000s
I20260709 13:07:53.722680 30373 catalog_manager.cc:5697] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 1 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:53.732463 30667 tablet_bootstrap.cc:492] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:53.734157 30870 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.735556 30870 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.745110 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:07:53.748142 30591 leader_election.cc:343] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.724292 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:07:53.729249 30882 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.748997 30882 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.720916 30666 raft_consensus.cc:740] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.751909 30882 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:53.752746 30550 raft_consensus.cc:3060] T 265fc568d5674c78833106e4eda814f4 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.753871 30870 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:53.755045 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:53.752628 30666 consensus_queue.cc:260] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.757959 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:07:53.758510 30517 leader_election.cc:343] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.758685 30623 raft_consensus.cc:2468] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 0.
I20260709 13:07:53.756942 30665 tablet_bootstrap.cc:492] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:53.760354 30665 ts_tablet_manager.cc:1403] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.109s	user 0.010s	sys 0.001s
I20260709 13:07:53.761533 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:53.762101 30549 raft_consensus.cc:2468] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 0.
I20260709 13:07:53.762847 30665 raft_consensus.cc:359] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.763476 30665 raft_consensus.cc:385] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.763746 30665 raft_consensus.cc:740] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.764356 30665 consensus_queue.cc:260] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.765780 30665 ts_tablet_manager.cc:1434] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:07:53.766191 30516 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:07:53.766588 30665 tablet_bootstrap.cc:492] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:53.767195 30882 raft_consensus.cc:2804] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:53.767544 30882 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.767861 30882 raft_consensus.cc:3060] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.768996 30947 consensus_queue.cc:1048] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:53.772472 30665 tablet_bootstrap.cc:654] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.774679 30882 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.762300 30946 consensus_queue.cc:1048] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:07:53.778913 30666 ts_tablet_manager.cc:1434] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.110s	user 0.006s	sys 0.000s
I20260709 13:07:53.780206 30942 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.779338 30882 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:53.780376 30666 tablet_bootstrap.cc:492] T 772a658508f4465d8c1ef039f5bcaa67 P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:53.780680 30942 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.782699 30942 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:53.786278 30589 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:07:53.787377 30942 raft_consensus.cc:2804] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:53.787761 30942 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.788105 30942 raft_consensus.cc:3060] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.788653 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:53.790643 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:07:53.759537 30550 raft_consensus.cc:2468] T 265fc568d5674c78833106e4eda814f4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 1.
W20260709 13:07:53.791635 30589 leader_election.cc:343] T 8b8abe384b054cf09bfba7143adf03f1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.792488 30589 leader_election.cc:304] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:07:53.795977 30665 tablet_bootstrap.cc:492] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:53.797587 30665 ts_tablet_manager.cc:1403] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.007s
I20260709 13:07:53.797683 30870 raft_consensus.cc:2804] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:53.798460 30870 raft_consensus.cc:697] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:07:53.794993 30942 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.799654 30870 consensus_queue.cc:237] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.800485 30623 raft_consensus.cc:2393] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 1: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:07:53.797091 30666 tablet_bootstrap.cc:654] T 772a658508f4465d8c1ef039f5bcaa67 P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.803699 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:53.806550 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:07:53.812146 30665 raft_consensus.cc:359] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.812897 30665 raft_consensus.cc:385] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.813232 30665 raft_consensus.cc:740] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.815851 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:07:53.816977 30665 consensus_queue.cc:260] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:07:53.817183 30517 leader_election.cc:343] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:53.819679 30591 leader_election.cc:343] T 8b8abe384b054cf09bfba7143adf03f1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.819924 30942 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:53.820209 30591 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:07:53.820951 30665 ts_tablet_manager.cc:1434] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:07:53.823408 30942 raft_consensus.cc:2749] T 8b8abe384b054cf09bfba7143adf03f1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:07:53.823843 30591 leader_election.cc:343] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.823716 30516 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:53.826056 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:07:53.826802 30550 raft_consensus.cc:2393] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 1: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:07:53.827432 30765 raft_consensus.cc:2749] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:53.828583 30589 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:07:53.834745 30665 tablet_bootstrap.cc:492] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:53.840803 30942 raft_consensus.cc:2749] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:53.843235 30476 raft_consensus.cc:3060] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.845921 30667 tablet_bootstrap.cc:654] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.848672 30867 consensus_queue.cc:1048] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:53.852806 30475 raft_consensus.cc:3060] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.865438 30665 tablet_bootstrap.cc:654] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.888598 30942 consensus_queue.cc:1048] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:07:53.914394 30765 consensus_queue.cc:1048] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:53.935300 30870 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.935845 30870 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.937814 30870 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:53.953027 30666 tablet_bootstrap.cc:492] T 772a658508f4465d8c1ef039f5bcaa67 P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:53.952972 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:53.953579 30666 ts_tablet_manager.cc:1403] T 772a658508f4465d8c1ef039f5bcaa67 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.173s	user 0.015s	sys 0.007s
I20260709 13:07:53.953871 30549 raft_consensus.cc:2468] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 0.
I20260709 13:07:53.959074 30374 catalog_manager.cc:5697] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 1 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:53.965444 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:53.968020 30666 raft_consensus.cc:359] T 772a658508f4465d8c1ef039f5bcaa67 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.968741 30666 raft_consensus.cc:385] T 772a658508f4465d8c1ef039f5bcaa67 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.969043 30666 raft_consensus.cc:740] T 772a658508f4465d8c1ef039f5bcaa67 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.969853 30666 consensus_queue.cc:260] T 772a658508f4465d8c1ef039f5bcaa67 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:07:53.972172 30591 leader_election.cc:343] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:53.976347 30589 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:07:53.977104 30667 tablet_bootstrap.cc:492] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:53.985142 30667 ts_tablet_manager.cc:1403] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.253s	user 0.043s	sys 0.030s
I20260709 13:07:53.985180 30870 raft_consensus.cc:2804] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:53.985646 30870 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.985976 30870 raft_consensus.cc:3060] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.987268 30942 consensus_queue.cc:1048] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:53.987634 30667 raft_consensus.cc:359] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.988344 30667 raft_consensus.cc:385] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.988590 30667 raft_consensus.cc:740] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.989187 30667 consensus_queue.cc:260] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.999881 30667 ts_tablet_manager.cc:1434] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:07:54.001120 30774 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.001814 30774 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:53.982499 30666 ts_tablet_manager.cc:1434] T 772a658508f4465d8c1ef039f5bcaa67 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:07:53.982800 30665 tablet_bootstrap.cc:492] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:53.983316 30884 consensus_queue.cc:1048] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:54.005231 30774 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:54.005236 30665 ts_tablet_manager.cc:1403] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.171s	user 0.027s	sys 0.025s
I20260709 13:07:54.006371 30884 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.006978 30884 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.010100 30884 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:54.009704 30665 raft_consensus.cc:359] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.011495 30665 raft_consensus.cc:385] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.011965 30665 raft_consensus.cc:740] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.012074 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:54.012981 30665 consensus_queue.cc:260] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:07:54.013826 30440 leader_election.cc:343] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:54.016753 30666 tablet_bootstrap.cc:492] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:54.022251 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:54.022939 30621 raft_consensus.cc:2468] T 772a658508f4465d8c1ef039f5bcaa67 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 0.
I20260709 13:07:54.025987 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:54.026599 30621 raft_consensus.cc:2468] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 0.
I20260709 13:07:54.028859 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:54.031231 30665 ts_tablet_manager.cc:1434] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:07:54.033895 30665 tablet_bootstrap.cc:492] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:54.046260 30665 tablet_bootstrap.cc:654] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.048031 30441 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:07:54.051133 30774 raft_consensus.cc:2804] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:54.051915 30774 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.052480 30666 tablet_bootstrap.cc:654] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.052446 30774 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.057130 30666 tablet_bootstrap.cc:492] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
W20260709 13:07:54.057179 30517 leader_election.cc:343] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:54.057639 30666 ts_tablet_manager.cc:1403] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.041s	user 0.008s	sys 0.003s
I20260709 13:07:54.059068 30665 tablet_bootstrap.cc:492] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:54.059481 30665 ts_tablet_manager.cc:1403] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 13:07:54.060277 30666 raft_consensus.cc:359] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.060933 30666 raft_consensus.cc:385] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.061188 30666 raft_consensus.cc:740] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.061887 30665 raft_consensus.cc:359] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.061890 30666 consensus_queue.cc:260] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.062604 30665 raft_consensus.cc:385] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.062870 30665 raft_consensus.cc:740] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.063441 30665 consensus_queue.cc:260] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.065301 30665 ts_tablet_manager.cc:1434] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:07:54.066045 30665 tablet_bootstrap.cc:492] T 8a8b48bc080241c98b3c2b0e1ce8c041 P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:54.066135 30516 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:07:54.067795 30667 tablet_bootstrap.cc:492] T e6646800b690458391bbff6a6bba535c P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:54.068349 30765 raft_consensus.cc:2804] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:54.069456 30765 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.070003 30765 raft_consensus.cc:3060] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.072957 30665 tablet_bootstrap.cc:654] T 8a8b48bc080241c98b3c2b0e1ce8c041 P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.080825 30667 tablet_bootstrap.cc:654] T e6646800b690458391bbff6a6bba535c P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.083720 30665 tablet_bootstrap.cc:492] T 8a8b48bc080241c98b3c2b0e1ce8c041 P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:54.084177 30665 ts_tablet_manager.cc:1403] T 8a8b48bc080241c98b3c2b0e1ce8c041 P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.006s
I20260709 13:07:54.085846 30758 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.086323 30758 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.086624 30665 raft_consensus.cc:359] T 8a8b48bc080241c98b3c2b0e1ce8c041 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.087280 30665 raft_consensus.cc:385] T 8a8b48bc080241c98b3c2b0e1ce8c041 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.087555 30665 raft_consensus.cc:740] T 8a8b48bc080241c98b3c2b0e1ce8c041 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.088176 30665 consensus_queue.cc:260] T 8a8b48bc080241c98b3c2b0e1ce8c041 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.089223 30666 ts_tablet_manager.cc:1434] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.000s
I20260709 13:07:54.090451 30665 ts_tablet_manager.cc:1434] T 8a8b48bc080241c98b3c2b0e1ce8c041 P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:07:54.091312 30665 tablet_bootstrap.cc:492] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:54.095495 30758 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:54.099124 30665 tablet_bootstrap.cc:654] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.100160 30666 tablet_bootstrap.cc:492] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:54.101403 30870 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.105322 30947 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.131753 30947 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.133206 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:54.113780 30671 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.123173 30667 tablet_bootstrap.cc:492] T e6646800b690458391bbff6a6bba535c P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:54.133780 30947 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:54.135418 30671 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.134754 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:54.138126 30671 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:54.138159 30667 ts_tablet_manager.cc:1403] T e6646800b690458391bbff6a6bba535c P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.071s	user 0.012s	sys 0.000s
I20260709 13:07:54.107491 30666 tablet_bootstrap.cc:654] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.140527 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:54.149571 30774 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.149672 30973 consensus_queue.cc:1048] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:54.150947 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:07:54.156270 30548 raft_consensus.cc:3060] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.156634 30550 raft_consensus.cc:2468] T a0273ed018424f3a9529e09669fdb7b0 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 0.
I20260709 13:07:54.151413 30473 raft_consensus.cc:3060] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.162647 30667 raft_consensus.cc:359] T e6646800b690458391bbff6a6bba535c P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.163563 30667 raft_consensus.cc:385] T e6646800b690458391bbff6a6bba535c P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.163934 30667 raft_consensus.cc:740] T e6646800b690458391bbff6a6bba535c P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.163830 30589 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:07:54.135422 30870 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:54.168964 30667 consensus_queue.cc:260] T e6646800b690458391bbff6a6bba535c P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.161067 30549 raft_consensus.cc:2468] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 0.
I20260709 13:07:54.167989 30973 raft_consensus.cc:2804] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:54.177462 30667 ts_tablet_manager.cc:1434] T e6646800b690458391bbff6a6bba535c P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:07:54.178332 30667 tablet_bootstrap.cc:492] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:54.188793 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:54.189308 30755 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.180665 30973 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.189759 30755 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.190333 30973 raft_consensus.cc:3060] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.193470 30765 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.195498 30765 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:54.202543 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:07:54.203766 30475 raft_consensus.cc:3060] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.203392 30665 tablet_bootstrap.cc:492] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:54.205924 30665 ts_tablet_manager.cc:1403] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.115s	user 0.029s	sys 0.036s
I20260709 13:07:54.217139 30774 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:54.219484 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:54.220132 30622 raft_consensus.cc:2468] T 8b8abe384b054cf09bfba7143adf03f1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 0.
I20260709 13:07:54.220252 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:54.229223 30671 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.212803 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:07:54.236738 30755 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:54.235092 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
W20260709 13:07:54.239089 30591 leader_election.cc:343] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:54.239257 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:07:54.246645 30517 leader_election.cc:343] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:54.247391 30517 leader_election.cc:343] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:54.253325 30440 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:07:54.254415 30666 tablet_bootstrap.cc:492] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:54.254915 30666 ts_tablet_manager.cc:1403] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.155s	user 0.004s	sys 0.023s
I20260709 13:07:54.255978 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:54.262181 30667 tablet_bootstrap.cc:654] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.264848 30665 raft_consensus.cc:359] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.265385 30665 raft_consensus.cc:385] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.265612 30665 raft_consensus.cc:740] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.268081 30665 consensus_queue.cc:260] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.255508 30621 raft_consensus.cc:3060] T 772a658508f4465d8c1ef039f5bcaa67 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.258747 30947 raft_consensus.cc:2804] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:54.273993 30947 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.274376 30947 raft_consensus.cc:3060] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.229717 30671 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.282392 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:07:54.284437 30441 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:54.286339 30665 ts_tablet_manager.cc:1434] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.080s	user 0.003s	sys 0.003s
I20260709 13:07:54.291343 30548 raft_consensus.cc:2468] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 1.
I20260709 13:07:54.294247 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:07:54.294823 30619 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.275028 30973 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.306047 30671 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:54.297082 30947 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.307056 30475 raft_consensus.cc:2468] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 1.
I20260709 13:07:54.298499 30774 raft_consensus.cc:2749] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:54.329573 30621 raft_consensus.cc:2468] T 772a658508f4465d8c1ef039f5bcaa67 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
I20260709 13:07:54.330276 30973 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:54.330850 30947 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:54.330770 30666 raft_consensus.cc:359] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.331784 30666 raft_consensus.cc:385] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.332110 30666 raft_consensus.cc:740] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
W20260709 13:07:54.388774 30591 consensus_peers.cc:597] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:54.390319 30665 tablet_bootstrap.cc:492] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:54.390434 30591 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:07:54.391381 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:07:54.392938 30620 raft_consensus.cc:3060] T 8b8abe384b054cf09bfba7143adf03f1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.394573 30974 raft_consensus.cc:2804] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:54.396279 30974 raft_consensus.cc:697] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:07:54.397890 30974 consensus_queue.cc:237] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.400164 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:07:54.332796 30666 consensus_queue.cc:260] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.401129 30475 raft_consensus.cc:3060] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.423875 30475 raft_consensus.cc:2468] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 1.
I20260709 13:07:54.425829 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:54.428119 30621 raft_consensus.cc:2393] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 1: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:07:54.440137 30591 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:07:54.442277 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:07:54.443289 30549 raft_consensus.cc:3060] T a0273ed018424f3a9529e09669fdb7b0 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.442888 30870 consensus_queue.cc:1048] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:54.444099 30973 raft_consensus.cc:2804] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:54.445490 30973 raft_consensus.cc:697] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:07:54.446121 30666 ts_tablet_manager.cc:1434] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.191s	user 0.005s	sys 0.003s
W20260709 13:07:54.447801 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 163476us
I20260709 13:07:54.453389 30516 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:07:54.455257 30619 raft_consensus.cc:2468] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 1.
I20260709 13:07:54.456758 30665 tablet_bootstrap.cc:654] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.458341 30978 raft_consensus.cc:2804] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:54.459013 30978 raft_consensus.cc:697] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:07:54.466292 30972 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.460426 30978 consensus_queue.cc:237] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.463115 30973 consensus_queue.cc:237] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.466885 30972 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.472862 30666 tablet_bootstrap.cc:492] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
W20260709 13:07:54.473148 30440 leader_election.cc:343] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:54.477804 30972 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:54.475629 30620 raft_consensus.cc:2468] T 8b8abe384b054cf09bfba7143adf03f1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 1.
I20260709 13:07:54.467439 30549 raft_consensus.cc:2468] T a0273ed018424f3a9529e09669fdb7b0 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 1.
I20260709 13:07:54.480199 30972 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.488510 30667 tablet_bootstrap.cc:492] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:54.489042 30623 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 0.
I20260709 13:07:54.492038 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:54.492751 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:07:54.493486 30551 raft_consensus.cc:3060] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.493688 30548 raft_consensus.cc:2393] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 1: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:07:54.495404 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:54.496340 30547 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 0.
I20260709 13:07:54.497520 30441 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:07:54.498860 30441 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:07:54.500550 30671 raft_consensus.cc:2804] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:54.500720 30516 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:07:54.501147 30671 raft_consensus.cc:697] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:07:54.506374 30882 raft_consensus.cc:2804] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:54.506109 30671 consensus_queue.cc:237] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.506861 30882 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.507383 30882 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.501914 30946 raft_consensus.cc:2804] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:54.508661 30946 raft_consensus.cc:697] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:07:54.504169 30972 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.516718 30972 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:54.509585 30946 consensus_queue.cc:237] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.521510 30667 ts_tablet_manager.cc:1403] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.343s	user 0.018s	sys 0.025s
I20260709 13:07:54.524747 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:54.494910 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:07:54.527982 30591 leader_election.cc:343] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:54.537055 30589 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:07:54.541357 30972 raft_consensus.cc:2804] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:54.541736 30972 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.542104 30972 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.544839 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:54.550582 30667 raft_consensus.cc:359] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.551334 30667 raft_consensus.cc:385] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.552474 30551 raft_consensus.cc:2468] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 1.
I20260709 13:07:54.551610 30667 raft_consensus.cc:740] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
W20260709 13:07:54.555086 30591 leader_election.cc:343] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:54.555119 30667 consensus_queue.cc:260] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.538079 30974 consensus_queue.cc:1048] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:07:54.557273 30667 ts_tablet_manager.cc:1434] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.002s
W20260709 13:07:54.559446 30589 leader_election.cc:343] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:54.559998 30589 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:07:54.562608 30973 raft_consensus.cc:2749] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:54.558104 30440 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:54.575647 30871 raft_consensus.cc:3060] T 8a8b48bc080241c98b3c2b0e1ce8c041 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.573246 30374 catalog_manager.cc:5697] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 1 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:54.576763 30665 tablet_bootstrap.cc:492] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:54.577255 30665 ts_tablet_manager.cc:1403] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.188s	user 0.021s	sys 0.028s
I20260709 13:07:54.584882 30755 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.586971 30755 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.591606 30755 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:54.593966 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:54.595000 30620 raft_consensus.cc:2393] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 1: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:07:54.601117 30665 raft_consensus.cc:359] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.602216 30665 raft_consensus.cc:385] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.602530 30665 raft_consensus.cc:740] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.604568 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:54.606689 30517 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:54.607437 30666 tablet_bootstrap.cc:654] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.603224 30665 consensus_queue.cc:260] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.608083 30978 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.597599 30373 catalog_manager.cc:5697] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:54.585352 30882 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.616111 30667 tablet_bootstrap.cc:492] T 6a9b619ab6a04af38de048edd085fe3e P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:54.621753 30665 ts_tablet_manager.cc:1434] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.044s	user 0.003s	sys 0.005s
I20260709 13:07:54.626909 30671 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.629074 30671 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.630888 30871 raft_consensus.cc:2749] T 8a8b48bc080241c98b3c2b0e1ce8c041 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:54.648682 30665 tablet_bootstrap.cc:492] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:54.649524 30884 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.649367 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:54.650202 30884 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.653314 30884 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:54.653736 30671 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:54.654521 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:07:54.656052 30516 leader_election.cc:343] T e6646800b690458391bbff6a6bba535c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:54.657191 30371 catalog_manager.cc:5697] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 0 to 1, leader changed from <none> to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:54.661391 30882 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:54.662315 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:07:54.662840 30972 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.664157 30620 raft_consensus.cc:2393] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 1: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:07:54.666397 30371 catalog_manager.cc:5697] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 0 to 1, leader changed from <none> to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:54.668267 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:54.673768 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:54.676545 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:07:54.684523 30667 tablet_bootstrap.cc:654] T 6a9b619ab6a04af38de048edd085fe3e P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:54.685779 30517 leader_election.cc:343] T e6646800b690458391bbff6a6bba535c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:54.686157 30517 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:54.686796 30882 raft_consensus.cc:2749] T e6646800b690458391bbff6a6bba535c P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:54.688889 30978 raft_consensus.cc:2749] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:54.689069 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:07:54.690385 30548 raft_consensus.cc:2393] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 1: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:07:54.692852 30972 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:54.693236 30441 leader_election.cc:304] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:54.700856 30867 raft_consensus.cc:2749] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:07:54.701681 30517 leader_election.cc:343] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:54.702093 30517 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:54.699126 30665 tablet_bootstrap.cc:654] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.703727 30978 raft_consensus.cc:2749] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:54.718586 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
W20260709 13:07:54.723889 30591 leader_election.cc:343] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:54.724395 30591 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:07:54.727356 30758 raft_consensus.cc:2749] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:54.731966 30666 tablet_bootstrap.cc:492] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:54.732476 30666 ts_tablet_manager.cc:1403] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.260s	user 0.018s	sys 0.014s
I20260709 13:07:54.734028 30665 tablet_bootstrap.cc:492] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:54.734513 30665 ts_tablet_manager.cc:1403] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.097s	user 0.010s	sys 0.005s
I20260709 13:07:54.737627 30665 raft_consensus.cc:359] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.738276 30665 raft_consensus.cc:385] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.738560 30665 raft_consensus.cc:740] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.739276 30665 consensus_queue.cc:260] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.741787 30665 ts_tablet_manager.cc:1434] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:07:54.743219 30665 tablet_bootstrap.cc:492] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:54.747535 30667 tablet_bootstrap.cc:492] T 6a9b619ab6a04af38de048edd085fe3e P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:54.747993 30667 ts_tablet_manager.cc:1403] T 6a9b619ab6a04af38de048edd085fe3e P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.148s	user 0.013s	sys 0.008s
I20260709 13:07:54.748378 30665 tablet_bootstrap.cc:654] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.750463 30667 raft_consensus.cc:359] T 6a9b619ab6a04af38de048edd085fe3e P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.751116 30667 raft_consensus.cc:385] T 6a9b619ab6a04af38de048edd085fe3e P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.751366 30667 raft_consensus.cc:740] T 6a9b619ab6a04af38de048edd085fe3e P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.735652 30666 raft_consensus.cc:359] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.751965 30667 consensus_queue.cc:260] T 6a9b619ab6a04af38de048edd085fe3e P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.752338 30666 raft_consensus.cc:385] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.752635 30666 raft_consensus.cc:740] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.753443 30666 consensus_queue.cc:260] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.755517 30666 ts_tablet_manager.cc:1434] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
W20260709 13:07:54.786342 30422 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:54.793145 30666 tablet_bootstrap.cc:492] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:54.794909 30373 catalog_manager.cc:5697] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 1 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:54.794610 30665 tablet_bootstrap.cc:492] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:54.796381 30665 ts_tablet_manager.cc:1403] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.053s	user 0.009s	sys 0.005s
I20260709 13:07:54.794147 30667 ts_tablet_manager.cc:1434] T 6a9b619ab6a04af38de048edd085fe3e P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.000s
I20260709 13:07:54.798161 30667 tablet_bootstrap.cc:492] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:54.799340 30665 raft_consensus.cc:359] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.800021 30665 raft_consensus.cc:385] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.800288 30665 raft_consensus.cc:740] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.800945 30665 consensus_queue.cc:260] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.802719 30665 ts_tablet_manager.cc:1434] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:07:54.803572 30666 tablet_bootstrap.cc:654] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.803748 30665 tablet_bootstrap.cc:492] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:54.805015 30667 tablet_bootstrap.cc:654] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.810887 30665 tablet_bootstrap.cc:654] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.815150 30666 tablet_bootstrap.cc:492] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:54.815603 30666 ts_tablet_manager.cc:1403] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.002s
I20260709 13:07:54.819083 30666 raft_consensus.cc:359] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.820006 30946 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.820484 30946 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.822649 30946 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:54.824188 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:54.824587 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:54.824851 30547 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 0.
I20260709 13:07:54.825191 30620 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 0.
I20260709 13:07:54.826314 30440 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:07:54.819761 30666 raft_consensus.cc:385] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.826843 30666 raft_consensus.cc:740] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.827517 30946 raft_consensus.cc:2804] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:54.828009 30946 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.827576 30666 consensus_queue.cc:260] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.828322 30946 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.829849 30666 ts_tablet_manager.cc:1434] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:07:54.830783 30666 tablet_bootstrap.cc:492] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:54.836992 30946 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.843007 30472 raft_consensus.cc:3060] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.844209 30666 tablet_bootstrap.cc:654] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.844496 30665 tablet_bootstrap.cc:492] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:54.849781 30665 ts_tablet_manager.cc:1403] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.006s
I20260709 13:07:54.851884 30946 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:54.853474 30665 raft_consensus.cc:359] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.854090 30665 raft_consensus.cc:385] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.854398 30665 raft_consensus.cc:740] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.855087 30665 consensus_queue.cc:260] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.857025 30665 ts_tablet_manager.cc:1434] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:07:54.857887 30665 tablet_bootstrap.cc:492] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:54.859071 30667 tablet_bootstrap.cc:492] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:54.859486 30667 ts_tablet_manager.cc:1403] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.062s	user 0.023s	sys 0.019s
I20260709 13:07:54.853909 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:07:54.860292 30620 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.862493 30667 raft_consensus.cc:359] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.863119 30667 raft_consensus.cc:385] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.863421 30665 tablet_bootstrap.cc:654] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.863389 30667 raft_consensus.cc:740] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.864220 30667 consensus_queue.cc:260] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.864403 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:07:54.865151 30547 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.867115 30667 ts_tablet_manager.cc:1434] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:07:54.868479 30667 tablet_bootstrap.cc:492] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:54.904848 30978 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.908833 30547 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 1.
I20260709 13:07:54.913375 30440 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:07:54.914265 30946 raft_consensus.cc:2804] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:54.914736 30946 raft_consensus.cc:697] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:07:54.905575 30978 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.917026 30665 tablet_bootstrap.cc:492] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:54.917508 30665 ts_tablet_manager.cc:1403] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.060s	user 0.025s	sys 0.027s
I20260709 13:07:54.922034 30665 raft_consensus.cc:359] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.922643 30665 raft_consensus.cc:385] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.922896 30665 raft_consensus.cc:740] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.923475 30665 consensus_queue.cc:260] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.915575 30946 consensus_queue.cc:237] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.926281 30666 tablet_bootstrap.cc:492] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:54.926764 30666 ts_tablet_manager.cc:1403] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.096s	user 0.024s	sys 0.039s
I20260709 13:07:54.926956 30755 consensus_queue.cc:1048] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:54.929751 30978 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:54.931257 30667 tablet_bootstrap.cc:654] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.931588 30665 ts_tablet_manager.cc:1434] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:07:54.926159 30620 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 1.
I20260709 13:07:54.934343 30665 tablet_bootstrap.cc:492] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:54.936875 30666 raft_consensus.cc:359] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.937671 30666 raft_consensus.cc:385] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.938009 30666 raft_consensus.cc:740] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.938608 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:07:54.939214 30517 consensus_peers.cc:597] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:54.939285 30474 raft_consensus.cc:2468] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 0.
I20260709 13:07:54.938851 30666 consensus_queue.cc:260] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:54.942888 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:54.943665 30619 raft_consensus.cc:2468] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 0.
I20260709 13:07:54.945273 30516 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:07:54.947669 30882 raft_consensus.cc:2804] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:54.948230 30882 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.949303 30882 raft_consensus.cc:3060] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.953457 30665 tablet_bootstrap.cc:654] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.955850 30666 ts_tablet_manager.cc:1434] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.003s
I20260709 13:07:54.957317 30666 tablet_bootstrap.cc:492] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:54.966019 30666 tablet_bootstrap.cc:654] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.975620 30758 consensus_queue.cc:1048] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:55.044471 30665 tablet_bootstrap.cc:492] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:55.044997 30665 ts_tablet_manager.cc:1403] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.111s	user 0.012s	sys 0.000s
I20260709 13:07:55.049188 30882 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.054039 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:07:55.054602 30621 raft_consensus.cc:3060] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:55.069880 30671 consensus_queue.cc:1048] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:55.069824 30665 raft_consensus.cc:359] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.070856 30665 raft_consensus.cc:385] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:55.071135 30665 raft_consensus.cc:740] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:55.071724 30665 consensus_queue.cc:260] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.072690 30621 raft_consensus.cc:2468] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
I20260709 13:07:55.073788 30665 ts_tablet_manager.cc:1434] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:07:55.074659 30665 tablet_bootstrap.cc:492] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:55.082329 30665 tablet_bootstrap.cc:654] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:55.088232 30666 tablet_bootstrap.cc:492] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:55.088685 30666 ts_tablet_manager.cc:1403] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.132s	user 0.028s	sys 0.051s
I20260709 13:07:55.090590 30516 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:07:55.090770 30882 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:55.091396 30882 raft_consensus.cc:2804] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:55.091883 30882 raft_consensus.cc:697] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:07:55.091713 30666 raft_consensus.cc:359] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.092439 30666 raft_consensus.cc:385] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:55.092710 30666 raft_consensus.cc:740] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:55.092904 30882 consensus_queue.cc:237] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.093283 30666 consensus_queue.cc:260] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.095476 30666 ts_tablet_manager.cc:1434] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:07:55.096509 30666 tablet_bootstrap.cc:492] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:55.098920 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:07:55.099434 30476 raft_consensus.cc:3060] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:55.102977 30665 tablet_bootstrap.cc:492] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:55.103178 30758 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.103406 30665 ts_tablet_manager.cc:1403] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.029s	user 0.007s	sys 0.001s
I20260709 13:07:55.103606 30758 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.105563 30758 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:55.105978 30665 raft_consensus.cc:359] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.106613 30665 raft_consensus.cc:385] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:55.106868 30665 raft_consensus.cc:740] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:55.107611 30665 consensus_queue.cc:260] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.107787 30758 consensus_queue.cc:1048] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:55.109316 30665 ts_tablet_manager.cc:1434] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:07:55.109623 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:55.110281 30665 tablet_bootstrap.cc:492] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:55.111303 30476 raft_consensus.cc:2468] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
I20260709 13:07:55.111857 30758 consensus_queue.cc:1048] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:55.112448 30666 tablet_bootstrap.cc:654] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:55.111445 30589 leader_election.cc:343] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:55.117830 30667 tablet_bootstrap.cc:492] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:55.118259 30667 ts_tablet_manager.cc:1403] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.250s	user 0.023s	sys 0.038s
I20260709 13:07:55.120621 30667 raft_consensus.cc:359] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.121162 30665 tablet_bootstrap.cc:654] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:55.121246 30667 raft_consensus.cc:385] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:55.121793 30667 raft_consensus.cc:740] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:55.122424 30667 consensus_queue.cc:260] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.124939 30667 ts_tablet_manager.cc:1434] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:07:55.125878 30667 tablet_bootstrap.cc:492] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:55.128369 30666 tablet_bootstrap.cc:492] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:55.128826 30666 ts_tablet_manager.cc:1403] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.000s
I20260709 13:07:55.135334 30758 raft_consensus.cc:493] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.136013 30758 raft_consensus.cc:515] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.139866 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:55.140097 30374 catalog_manager.cc:5697] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 0 to 1, leader changed from <none> to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:55.141358 30589 leader_election.cc:343] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:55.142198 30758 leader_election.cc:290] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:55.147424 30972 consensus_queue.cc:1048] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:55.152859 30666 raft_consensus.cc:359] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.153458 30666 raft_consensus.cc:385] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:55.153726 30666 raft_consensus.cc:740] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:55.154320 30666 consensus_queue.cc:260] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.157240 30665 tablet_bootstrap.cc:492] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:55.157670 30665 ts_tablet_manager.cc:1403] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.048s	user 0.005s	sys 0.008s
I20260709 13:07:55.158478 30666 ts_tablet_manager.cc:1434] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.029s	user 0.013s	sys 0.003s
I20260709 13:07:55.163302 30667 tablet_bootstrap.cc:654] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:55.162943 30665 raft_consensus.cc:359] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.163628 30665 raft_consensus.cc:385] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:55.163911 30665 raft_consensus.cc:740] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:55.164500 30665 consensus_queue.cc:260] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.160542 30946 consensus_queue.cc:1048] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:07:55.167327 30671 consensus_queue.cc:1048] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:55.166473 30666 tablet_bootstrap.cc:492] T 80cbe47dd35948b8b10070e934216d98 P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:55.166566 30665 ts_tablet_manager.cc:1434] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:07:55.172513 30665 tablet_bootstrap.cc:492] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:55.180441 30666 tablet_bootstrap.cc:654] T 80cbe47dd35948b8b10070e934216d98 P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:55.183233 30972 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.183475 30671 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.183691 30972 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.184098 30671 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.185846 30972 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:55.186374 30671 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:55.182056 30665 tablet_bootstrap.cc:654] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:55.187330 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:55.188386 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:07:55.188783 30589 leader_election.cc:343] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:55.193069 30946 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.193562 30946 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.195485 30946 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:07:55.197932 30440 leader_election.cc:343] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:55.199105 30372 catalog_manager.cc:5697] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:55.205821 30667 tablet_bootstrap.cc:492] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:55.206301 30667 ts_tablet_manager.cc:1403] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.081s	user 0.006s	sys 0.005s
I20260709 13:07:55.209998 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:55.209888 30667 raft_consensus.cc:359] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.210666 30667 raft_consensus.cc:385] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:55.210608 30550 raft_consensus.cc:2468] T e6646800b690458391bbff6a6bba535c P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 0.
I20260709 13:07:55.211112 30667 raft_consensus.cc:740] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:55.212093 30667 consensus_queue.cc:260] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.217607 30667 ts_tablet_manager.cc:1434] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:07:55.218637 30667 tablet_bootstrap.cc:492] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:55.219410 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:55.220954 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:55.221619 30620 raft_consensus.cc:2468] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 0.
I20260709 13:07:55.222761 30440 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:07:55.225541 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:55.226496 30946 raft_consensus.cc:2804] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:55.226917 30946 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.227299 30946 raft_consensus.cc:3060] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:55.231753 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:55.232484 30476 raft_consensus.cc:2468] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 0.
I20260709 13:07:55.237839 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:55.270533 30671 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.271124 30671 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.246402 30947 consensus_queue.cc:1048] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 13:07:55.276364 30665 tablet_bootstrap.cc:492] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:55.276932 30665 ts_tablet_manager.cc:1403] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.105s	user 0.013s	sys 0.013s
I20260709 13:07:55.292440 30665 raft_consensus.cc:359] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.293267 30665 raft_consensus.cc:385] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:55.293630 30665 raft_consensus.cc:740] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:55.296468 30882 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.294468 30665 consensus_queue.cc:260] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.297569 30882 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.299379 30667 tablet_bootstrap.cc:654] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:55.301496 30671 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:55.302140 30665 ts_tablet_manager.cc:1434] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.003s
I20260709 13:07:55.302294 30666 tablet_bootstrap.cc:492] T 80cbe47dd35948b8b10070e934216d98 P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:55.302758 30666 ts_tablet_manager.cc:1403] T 80cbe47dd35948b8b10070e934216d98 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.144s	user 0.015s	sys 0.029s
W20260709 13:07:55.304355 30441 leader_election.cc:343] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:55.304847 30441 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:55.307235 30671 raft_consensus.cc:2749] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:55.308686 30665 tablet_bootstrap.cc:492] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:55.313158 30867 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.313818 30867 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.316277 30755 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.316723 30755 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.319188 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:55.310495 30666 raft_consensus.cc:359] T 80cbe47dd35948b8b10070e934216d98 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.325770 30666 raft_consensus.cc:385] T 80cbe47dd35948b8b10070e934216d98 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:55.323227 30547 raft_consensus.cc:2393] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 1: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:07:55.322844 30882 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:55.326125 30666 raft_consensus.cc:740] T 80cbe47dd35948b8b10070e934216d98 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:55.336681 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:55.337317 30625 raft_consensus.cc:2468] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 0.
I20260709 13:07:55.339592 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:55.340660 30867 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:55.342502 30666 consensus_queue.cc:260] T 80cbe47dd35948b8b10070e934216d98 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.343693 30621 raft_consensus.cc:2468] T 80cbe47dd35948b8b10070e934216d98 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 0.
I20260709 13:07:55.345448 30667 tablet_bootstrap.cc:492] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:55.345976 30667 ts_tablet_manager.cc:1403] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.128s	user 0.015s	sys 0.001s
I20260709 13:07:55.346139 30516 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:07:55.357066 30666 ts_tablet_manager.cc:1434] T 80cbe47dd35948b8b10070e934216d98 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
I20260709 13:07:55.351672 30978 raft_consensus.cc:2804] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:55.364845 30978 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.365170 30978 raft_consensus.cc:3060] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:55.337131 30755 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:55.367334 30516 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:07:55.372216 30884 raft_consensus.cc:2804] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:55.372560 30884 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.372871 30884 raft_consensus.cc:3060] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:55.382061 30978 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.390288 30666 tablet_bootstrap.cc:492] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:55.391958 30946 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.399170 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:55.387399 30884 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.402045 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:07:55.402578 30621 raft_consensus.cc:3060] T 80cbe47dd35948b8b10070e934216d98 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:55.409121 30621 raft_consensus.cc:2468] T 80cbe47dd35948b8b10070e934216d98 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
I20260709 13:07:55.410259 30516 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:07:55.410987 30977 raft_consensus.cc:2804] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:55.411615 30977 raft_consensus.cc:697] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:07:55.412398 30977 consensus_queue.cc:237] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.415879 30884 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:07:55.421101 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 113142us
W20260709 13:07:55.426357 30591 leader_election.cc:343] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:55.426824 30591 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:07:55.427695 30667 raft_consensus.cc:359] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.428534 30667 raft_consensus.cc:385] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:55.428810 30667 raft_consensus.cc:740] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:55.429060 30972 raft_consensus.cc:2749] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:55.429750 30978 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:55.431098 30591 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:07:55.432929 30758 raft_consensus.cc:2804] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:55.433287 30758 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.433629 30758 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:55.433820 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:55.432930 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:55.434932 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:07:55.435540 30624 raft_consensus.cc:2393] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 1: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:07:55.435482 30550 raft_consensus.cc:3060] T e6646800b690458391bbff6a6bba535c P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:55.437134 30973 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.437584 30973 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.439538 30973 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:55.441334 30946 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:55.441992 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:07:55.442247 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:55.442564 30624 raft_consensus.cc:3060] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:55.442814 30548 raft_consensus.cc:2468] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 1.
I20260709 13:07:55.445674 30589 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:07:55.446388 30973 raft_consensus.cc:2804] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:55.446768 30973 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.447108 30973 raft_consensus.cc:3060] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:55.447530 30758 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.449538 30666 tablet_bootstrap.cc:654] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:55.451786 30665 tablet_bootstrap.cc:654] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:55.452050 30667 consensus_queue.cc:260] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.453853 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:07:55.456414 30667 ts_tablet_manager.cc:1434] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.110s	user 0.010s	sys 0.001s
I20260709 13:07:55.457409 30667 tablet_bootstrap.cc:492] T 7111be574b514751972d70830d3b644f P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:55.458873 30624 raft_consensus.cc:2468] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
W20260709 13:07:55.459303 30589 leader_election.cc:343] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:55.461958 30516 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:07:55.463526 30755 raft_consensus.cc:2804] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:55.464174 30755 raft_consensus.cc:697] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:07:55.465451 30973 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.465197 30755 consensus_queue.cc:237] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.467286 30973 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:55.467746 30758 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:55.472815 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:07:55.473658 30548 raft_consensus.cc:3060] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:55.474443 30550 raft_consensus.cc:2468] T e6646800b690458391bbff6a6bba535c P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 1.
I20260709 13:07:55.473697 30373 catalog_manager.cc:5697] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:55.475521 30440 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:07:55.477026 31029 raft_consensus.cc:2804] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:55.477491 31029 raft_consensus.cc:697] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
W20260709 13:07:55.479137 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 46883.9us
I20260709 13:07:55.480434 31029 consensus_queue.cc:237] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:07:55.484630 30591 leader_election.cc:343] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:55.485083 30591 leader_election.cc:304] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:07:55.485823 30974 raft_consensus.cc:2749] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:55.487239 30548 raft_consensus.cc:2468] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 2.
I20260709 13:07:55.489287 30589 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:07:55.490823 31034 raft_consensus.cc:2804] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:55.491519 31034 raft_consensus.cc:697] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:07:55.492432 31034 consensus_queue.cc:237] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.504429 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:55.506295 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:55.516284 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:07:55.516351 30371 catalog_manager.cc:5697] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:55.518393 30476 raft_consensus.cc:3060] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:55.529212 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:07:55.529618 30665 tablet_bootstrap.cc:492] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:55.530110 30665 ts_tablet_manager.cc:1403] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.224s	user 0.007s	sys 0.017s
I20260709 13:07:55.531491 31031 consensus_queue.cc:1048] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:55.532562 30665 raft_consensus.cc:359] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.538611 30667 tablet_bootstrap.cc:654] T 7111be574b514751972d70830d3b644f P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:55.539554 30666 tablet_bootstrap.cc:492] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:55.540530 30666 ts_tablet_manager.cc:1403] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.150s	user 0.010s	sys 0.006s
I20260709 13:07:55.543325 30666 raft_consensus.cc:359] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.543603 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:55.544260 30467 raft_consensus.cc:2468] T 8a8b48bc080241c98b3c2b0e1ce8c041 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 1.
I20260709 13:07:55.545122 30666 raft_consensus.cc:385] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:55.545066 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:07:55.545495 30666 raft_consensus.cc:740] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:55.545467 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:07:55.546211 30623 raft_consensus.cc:3060] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:55.546316 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:07:55.546913 30472 raft_consensus.cc:3060] T 8a8b48bc080241c98b3c2b0e1ce8c041 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:55.546499 30666 consensus_queue.cc:260] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.533213 30665 raft_consensus.cc:385] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:55.547765 30665 raft_consensus.cc:740] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:55.548360 30665 consensus_queue.cc:260] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.548739 30666 ts_tablet_manager.cc:1434] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:07:55.549682 30666 tablet_bootstrap.cc:492] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:55.551579 30665 ts_tablet_manager.cc:1434] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:07:55.552502 30665 tablet_bootstrap.cc:492] T ee49a377a80e4f4199281fb5e44d3be6 P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:55.553992 30472 raft_consensus.cc:2468] T 8a8b48bc080241c98b3c2b0e1ce8c041 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 2.
I20260709 13:07:55.539881 30371 catalog_manager.cc:5697] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 0 to 2, leader changed from <none> to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 2 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:55.555783 30666 tablet_bootstrap.cc:654] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:55.557785 30665 tablet_bootstrap.cc:654] T ee49a377a80e4f4199281fb5e44d3be6 P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:55.545707 30474 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:55.565582 31034 raft_consensus.cc:493] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.566048 31034 raft_consensus.cc:515] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.568089 31034 leader_election.cc:290] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:55.570042 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:55.571003 30666 tablet_bootstrap.cc:492] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:55.570992 30474 raft_consensus.cc:2468] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 1.
W20260709 13:07:55.571381 30589 leader_election.cc:343] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:55.571552 30666 ts_tablet_manager.cc:1403] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.006s
I20260709 13:07:55.571851 31031 raft_consensus.cc:493] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.572299 31031 raft_consensus.cc:515] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.574108 30373 catalog_manager.cc:5697] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 0 to 1, leader changed from <none> to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:55.574756 31031 leader_election.cc:290] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:55.574898 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:55.575644 30623 raft_consensus.cc:2468] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 1.
W20260709 13:07:55.576342 30440 leader_election.cc:343] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:55.576821 30666 raft_consensus.cc:359] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.577455 30666 raft_consensus.cc:385] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:55.577708 30666 raft_consensus.cc:740] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
W20260709 13:07:55.580452 30517 leader_election.cc:343] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:55.581267 30517 leader_election.cc:343] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:55.582410 30517 leader_election.cc:343] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:55.586153 30441 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:55.587725 31031 raft_consensus.cc:2749] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:55.588317 30441 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:55.587683 30666 consensus_queue.cc:260] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:07:55.590910 30517 leader_election.cc:343] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:55.591766 30665 tablet_bootstrap.cc:492] T ee49a377a80e4f4199281fb5e44d3be6 P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:55.594426 30665 ts_tablet_manager.cc:1403] T ee49a377a80e4f4199281fb5e44d3be6 P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.003s
I20260709 13:07:55.589846 31031 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:55.600601 30666 ts_tablet_manager.cc:1434] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.028s	user 0.002s	sys 0.005s
I20260709 13:07:55.601835 30666 tablet_bootstrap.cc:492] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:55.607446 31031 raft_consensus.cc:2749] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:55.610913 30665 raft_consensus.cc:359] T ee49a377a80e4f4199281fb5e44d3be6 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.613930 30665 raft_consensus.cc:385] T ee49a377a80e4f4199281fb5e44d3be6 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:55.614276 30665 raft_consensus.cc:740] T ee49a377a80e4f4199281fb5e44d3be6 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:55.614959 30665 consensus_queue.cc:260] T ee49a377a80e4f4199281fb5e44d3be6 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.617324 30665 ts_tablet_manager.cc:1434] T ee49a377a80e4f4199281fb5e44d3be6 P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.022s	user 0.002s	sys 0.003s
I20260709 13:07:55.618554 30665 tablet_bootstrap.cc:492] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:55.622305 30666 tablet_bootstrap.cc:654] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:55.631790 31026 consensus_queue.cc:1048] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:55.640002 30665 tablet_bootstrap.cc:654] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:55.640673 30591 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:07:55.642158 30974 raft_consensus.cc:2804] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:55.642781 30974 raft_consensus.cc:697] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:07:55.643899 30974 consensus_queue.cc:237] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.652990 30973 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.653667 30973 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.659399 30973 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:55.660852 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:55.661706 30619 raft_consensus.cc:2468] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 0.
I20260709 13:07:55.661586 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:55.664191 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:07:55.664512 30589 leader_election.cc:343] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:55.664815 30474 raft_consensus.cc:2468] T ee49a377a80e4f4199281fb5e44d3be6 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 0.
I20260709 13:07:55.667024 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:55.695729 30591 leader_election.cc:304] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:07:55.695593 30755 consensus_queue.cc:1048] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:55.697134 30758 raft_consensus.cc:2804] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:55.697526 30758 raft_consensus.cc:493] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.697857 30758 raft_consensus.cc:3060] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:55.699960 30591 leader_election.cc:343] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:55.700713 30591 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:07:55.708305 30974 raft_consensus.cc:2749] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:55.708575 30758 raft_consensus.cc:515] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.715020 30441 leader_election.cc:304] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:07:55.717778 31026 raft_consensus.cc:2804] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:55.718251 31026 raft_consensus.cc:493] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.718669 31026 raft_consensus.cc:3060] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:55.732498 30758 leader_election.cc:290] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:55.734368 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
W20260709 13:07:55.736105 30589 leader_election.cc:343] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:55.738641 31026 raft_consensus.cc:515] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.744536 31026 leader_election.cc:290] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:55.747576 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:07:55.742893 30666 tablet_bootstrap.cc:492] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:55.748196 30472 raft_consensus.cc:3060] T ee49a377a80e4f4199281fb5e44d3be6 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:55.739565 30667 tablet_bootstrap.cc:492] T 7111be574b514751972d70830d3b644f P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:55.748848 30667 ts_tablet_manager.cc:1403] T 7111be574b514751972d70830d3b644f P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.292s	user 0.060s	sys 0.091s
I20260709 13:07:55.746840 30665 tablet_bootstrap.cc:492] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:55.748389 30666 ts_tablet_manager.cc:1403] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.147s	user 0.007s	sys 0.006s
I20260709 13:07:55.749816 30665 ts_tablet_manager.cc:1403] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.131s	user 0.030s	sys 0.043s
I20260709 13:07:55.753932 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:07:55.754509 30618 raft_consensus.cc:3060] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:55.756314 30667 raft_consensus.cc:359] T 7111be574b514751972d70830d3b644f P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.756878 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:07:55.757522 30755 consensus_queue.cc:1048] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:55.750777 30374 catalog_manager.cc:5697] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 1 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:55.758306 30440 leader_election.cc:343] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:55.756981 30667 raft_consensus.cc:385] T 7111be574b514751972d70830d3b644f P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:55.759244 30667 raft_consensus.cc:740] T 7111be574b514751972d70830d3b644f P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:55.761010 30618 raft_consensus.cc:2468] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 1.
I20260709 13:07:55.761092 30667 consensus_queue.cc:260] T 7111be574b514751972d70830d3b644f P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.764029 30667 ts_tablet_manager.cc:1434] T 7111be574b514751972d70830d3b644f P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:07:55.764890 30667 tablet_bootstrap.cc:492] T 7e31b2accf3b4a3b8b7668571e619eb7 P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:55.766238 30665 raft_consensus.cc:359] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.766731 30665 raft_consensus.cc:385] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:55.766944 30665 raft_consensus.cc:740] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:55.768126 30665 consensus_queue.cc:260] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.768826 30666 raft_consensus.cc:359] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.769531 30666 raft_consensus.cc:385] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:55.769798 30666 raft_consensus.cc:740] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:55.770457 30666 consensus_queue.cc:260] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.771912 30472 raft_consensus.cc:2468] T ee49a377a80e4f4199281fb5e44d3be6 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 1.
I20260709 13:07:55.772789 30666 ts_tablet_manager.cc:1434] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 13:07:55.774960 30666 tablet_bootstrap.cc:492] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:55.779254 30667 tablet_bootstrap.cc:654] T 7e31b2accf3b4a3b8b7668571e619eb7 P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:55.782800 30665 ts_tablet_manager.cc:1434] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.000s
I20260709 13:07:55.783825 30665 tablet_bootstrap.cc:492] T 99c151771be541b19017860da4f7218d P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:55.789265 30665 tablet_bootstrap.cc:654] T 99c151771be541b19017860da4f7218d P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:55.777400 30441 leader_election.cc:304] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:07:55.796345 31026 raft_consensus.cc:2804] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:55.796593 30667 tablet_bootstrap.cc:492] T 7e31b2accf3b4a3b8b7668571e619eb7 P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:55.796999 31026 raft_consensus.cc:697] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:07:55.797200 30667 ts_tablet_manager.cc:1403] T 7e31b2accf3b4a3b8b7668571e619eb7 P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.000s
I20260709 13:07:55.798046 31026 consensus_queue.cc:237] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.800068 30667 raft_consensus.cc:359] T 7e31b2accf3b4a3b8b7668571e619eb7 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.800765 30667 raft_consensus.cc:385] T 7e31b2accf3b4a3b8b7668571e619eb7 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:55.801084 30667 raft_consensus.cc:740] T 7e31b2accf3b4a3b8b7668571e619eb7 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:55.802580 30591 leader_election.cc:304] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:07:55.809975 31034 raft_consensus.cc:2804] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:55.810551 31034 raft_consensus.cc:697] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:07:55.806326 30665 tablet_bootstrap.cc:492] T 99c151771be541b19017860da4f7218d P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:55.811693 30665 ts_tablet_manager.cc:1403] T 99c151771be541b19017860da4f7218d P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.006s
I20260709 13:07:55.811448 31034 consensus_queue.cc:237] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.809970 30667 consensus_queue.cc:260] T 7e31b2accf3b4a3b8b7668571e619eb7 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.814980 30667 ts_tablet_manager.cc:1434] T 7e31b2accf3b4a3b8b7668571e619eb7 P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:07:55.814536 30665 raft_consensus.cc:359] T 99c151771be541b19017860da4f7218d P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.810395 30978 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.816577 30665 raft_consensus.cc:385] T 99c151771be541b19017860da4f7218d P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:55.816673 30978 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.816965 30665 raft_consensus.cc:740] T 99c151771be541b19017860da4f7218d P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:55.818401 30665 consensus_queue.cc:260] T 99c151771be541b19017860da4f7218d P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.820724 30665 ts_tablet_manager.cc:1434] T 99c151771be541b19017860da4f7218d P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:07:55.821811 30665 tablet_bootstrap.cc:492] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:55.827714 30665 tablet_bootstrap.cc:654] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:55.832199 30755 consensus_queue.cc:1048] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:55.818796 30978 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:55.836983 30370 catalog_manager.cc:5697] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 0 to 1, leader changed from <none> to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:55.838955 30667 tablet_bootstrap.cc:492] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:55.839955 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:07:55.841116 30516 leader_election.cc:343] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:55.844751 31029 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.845209 31029 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.847121 31029 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:55.847415 30667 tablet_bootstrap.cc:654] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:55.847954 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:55.864289 30667 tablet_bootstrap.cc:492] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:55.864753 30667 ts_tablet_manager.cc:1403] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.010s
I20260709 13:07:55.866262 30370 catalog_manager.cc:5697] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 1 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:55.868887 30667 raft_consensus.cc:359] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.869590 30667 raft_consensus.cc:385] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:55.869853 30667 raft_consensus.cc:740] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:55.870541 30667 consensus_queue.cc:260] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.872638 30667 ts_tablet_manager.cc:1434] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:07:55.873574 30667 tablet_bootstrap.cc:492] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:55.879397 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:55.880059 30473 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 0.
I20260709 13:07:55.884606 30666 tablet_bootstrap.cc:654] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:55.886116 30517 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:55.885401 30470 raft_consensus.cc:3060] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:55.885490 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:55.887390 30617 raft_consensus.cc:2393] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 1: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:07:55.889067 30441 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:55.896663 30665 tablet_bootstrap.cc:492] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:55.897080 30665 ts_tablet_manager.cc:1403] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.076s	user 0.028s	sys 0.021s
I20260709 13:07:55.890743 31029 raft_consensus.cc:3060] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:55.899201 30665 raft_consensus.cc:359] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.899832 30665 raft_consensus.cc:385] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:55.900099 30665 raft_consensus.cc:740] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:55.890725 30884 raft_consensus.cc:2804] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:55.901597 30884 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.904196 30884 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:55.914836 30665 consensus_queue.cc:260] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.919721 30665 ts_tablet_manager.cc:1434] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.002s
I20260709 13:07:55.926785 30667 tablet_bootstrap.cc:654] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:55.927475 30665 tablet_bootstrap.cc:492] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:55.928449 31029 raft_consensus.cc:2749] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:55.929716 30884 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.931775 30884 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:55.931720 30978 consensus_queue.cc:1048] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:07:55.934715 30422 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:55.939139 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:07:55.944584 30516 leader_election.cc:343] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:55.951939 30882 consensus_queue.cc:1048] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:55.954102 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:07:55.956254 30471 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:55.957196 30467 raft_consensus.cc:1275] T 8a8b48bc080241c98b3c2b0e1ce8c041 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:07:55.967971 30974 consensus_queue.cc:1048] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:55.976365 30667 tablet_bootstrap.cc:492] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:55.976920 30667 ts_tablet_manager.cc:1403] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.104s	user 0.016s	sys 0.010s
I20260709 13:07:55.982831 30548 raft_consensus.cc:1275] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:07:55.987742 30978 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.988241 30978 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:55.990334 30978 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:55.992970 30666 tablet_bootstrap.cc:492] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:55.993439 30666 ts_tablet_manager.cc:1403] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.219s	user 0.009s	sys 0.007s
I20260709 13:07:55.993266 31034 consensus_queue.cc:1048] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:55.993590 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:55.995007 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:55.995774 30467 raft_consensus.cc:2393] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 1: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:07:56.002373 30517 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:56.005281 30666 raft_consensus.cc:359] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:56.005852 30666 raft_consensus.cc:385] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:56.006098 30666 raft_consensus.cc:740] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:56.007324 31059 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:56.006824 30666 consensus_queue.cc:260] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:56.012965 30667 raft_consensus.cc:359] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:56.013916 30667 raft_consensus.cc:385] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:56.014211 30667 raft_consensus.cc:740] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:56.014717 30667 consensus_queue.cc:260] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:56.022316 30666 ts_tablet_manager.cc:1434] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:07:56.032050 30667 ts_tablet_manager.cc:1434] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.000s
I20260709 13:07:56.037685 31029 consensus_queue.cc:1048] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:56.038714 30665 tablet_bootstrap.cc:654] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:56.041479 30978 consensus_queue.cc:1048] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:56.047097 31059 raft_consensus.cc:2749] T 7111be574b514751972d70830d3b644f P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:56.049909 30667 tablet_bootstrap.cc:492] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:56.054793 30666 tablet_bootstrap.cc:492] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:56.065062 31029 consensus_queue.cc:1048] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:56.044850 30471 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
I20260709 13:07:56.073354 30978 raft_consensus.cc:493] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.082124 30978 raft_consensus.cc:515] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:56.084239 30978 leader_election.cc:290] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:56.075026 30517 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:56.087189 31059 raft_consensus.cc:2804] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:56.087949 31059 raft_consensus.cc:697] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:07:56.088061 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:56.088893 31059 consensus_queue.cc:237] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:56.099439 30974 consensus_queue.cc:1048] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:56.150490 30667 tablet_bootstrap.cc:654] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:56.162043 30666 tablet_bootstrap.cc:654] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:56.162084 30974 consensus_queue.cc:1048] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:07:56.180064 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:56.180222 30972 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.180878 30470 raft_consensus.cc:2393] T ee49a377a80e4f4199281fb5e44d3be6 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 1: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:07:56.180771 30972 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:56.182116 30517 leader_election.cc:304] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:56.182883 30972 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:56.183573 30665 tablet_bootstrap.cc:492] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:56.183386 30978 raft_consensus.cc:3060] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:56.184074 30665 ts_tablet_manager.cc:1403] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.257s	user 0.016s	sys 0.017s
I20260709 13:07:56.185119 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:56.186530 30470 raft_consensus.cc:2468] T 99c151771be541b19017860da4f7218d P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 0.
I20260709 13:07:56.187595 30666 tablet_bootstrap.cc:492] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:56.190073 30666 ts_tablet_manager.cc:1403] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.135s	user 0.010s	sys 0.005s
I20260709 13:07:56.189313 30946 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.193598 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:56.191332 30946 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:56.198302 30946 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:56.196682 30591 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:07:56.203603 30758 raft_consensus.cc:2804] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:56.203976 30758 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.204325 30758 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:56.205389 30589 leader_election.cc:343] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:56.206732 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:07:56.208477 30440 leader_election.cc:343] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:56.208705 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:56.205411 30665 raft_consensus.cc:359] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:56.209630 30665 raft_consensus.cc:385] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:07:56.210427 30441 leader_election.cc:343] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:56.210582 30665 raft_consensus.cc:740] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:56.200260 30666 raft_consensus.cc:359] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:56.211555 30666 raft_consensus.cc:385] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:56.210975 30441 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:56.212360 30666 raft_consensus.cc:740] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:56.213999 30666 consensus_queue.cc:260] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:56.215632 30666 ts_tablet_manager.cc:1434] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 13:07:56.217737 30666 tablet_bootstrap.cc:492] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79: Bootstrap starting.
I20260709 13:07:56.216396 30665 consensus_queue.cc:260] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:56.219926 30665 ts_tablet_manager.cc:1434] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260709 13:07:56.225471 30665 tablet_bootstrap.cc:492] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326: Bootstrap starting.
I20260709 13:07:56.213642 31031 raft_consensus.cc:2749] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:56.237687 30667 tablet_bootstrap.cc:492] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:56.238333 30667 ts_tablet_manager.cc:1403] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.194s	user 0.014s	sys 0.002s
I20260709 13:07:56.229629 30666 tablet_bootstrap.cc:654] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:56.251780 30974 raft_consensus.cc:493] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.252317 30974 raft_consensus.cc:515] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:56.254927 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:56.255532 30467 raft_consensus.cc:2468] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 0.
I20260709 13:07:56.256668 30591 leader_election.cc:304] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:07:56.258018 30974 leader_election.cc:290] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:56.258651 30974 raft_consensus.cc:2804] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:56.259994 30974 raft_consensus.cc:493] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.260742 30974 raft_consensus.cc:3060] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:56.259105 30665 tablet_bootstrap.cc:654] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:56.268357 30974 raft_consensus.cc:515] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:56.270071 30666 tablet_bootstrap.cc:492] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79: No bootstrap required, opened a new log
I20260709 13:07:56.270522 30666 ts_tablet_manager.cc:1403] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent bootstrapping tablet: real 0.053s	user 0.007s	sys 0.004s
I20260709 13:07:56.271216 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:07:56.271766 30467 raft_consensus.cc:3060] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:56.228752 30978 raft_consensus.cc:2749] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:56.274945 30758 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:56.279328 30666 raft_consensus.cc:359] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:56.279910 30758 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:56.280042 30666 raft_consensus.cc:385] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:56.280395 30666 raft_consensus.cc:740] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Initialized, Role: FOLLOWER
I20260709 13:07:56.281033 30666 consensus_queue.cc:260] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:56.281270 30467 raft_consensus.cc:2468] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 1.
I20260709 13:07:56.283686 30591 leader_election.cc:304] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:07:56.284797 30974 leader_election.cc:290] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:56.284950 31034 raft_consensus.cc:2804] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:56.282548 30666 ts_tablet_manager.cc:1434] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:07:56.286957 31034 raft_consensus.cc:697] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:07:56.287952 30665 tablet_bootstrap.cc:492] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326: No bootstrap required, opened a new log
I20260709 13:07:56.287726 31034 consensus_queue.cc:237] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:56.288393 30665 ts_tablet_manager.cc:1403] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326: Time spent bootstrapping tablet: real 0.063s	user 0.013s	sys 0.002s
I20260709 13:07:56.290925 30665 raft_consensus.cc:359] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:56.291642 30665 raft_consensus.cc:385] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:56.291896 30665 raft_consensus.cc:740] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Initialized, Role: FOLLOWER
I20260709 13:07:56.292497 30665 consensus_queue.cc:260] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:56.294487 30665 ts_tablet_manager.cc:1434] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:07:56.293910 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:07:56.295915 30470 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:56.299837 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 98742.1us
I20260709 13:07:56.299969 30547 raft_consensus.cc:3060] T 7e31b2accf3b4a3b8b7668571e619eb7 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:56.305510 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:56.306104 30548 raft_consensus.cc:2468] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 0.
I20260709 13:07:56.307605 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:07:56.307991 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:07:56.308254 30550 raft_consensus.cc:3060] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:56.309813 30667 raft_consensus.cc:359] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:56.310474 30667 raft_consensus.cc:385] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:56.310710 30667 raft_consensus.cc:740] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:56.313390 31034 consensus_queue.cc:1048] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:56.317075 30755 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.317510 31069 consensus_queue.cc:1048] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:56.317508 30755 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:56.319406 30755 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:56.325759 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:56.326545 30473 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
W20260709 13:07:56.329738 30589 leader_election.cc:343] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:56.311269 30667 consensus_queue.cc:260] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:56.333369 30667 ts_tablet_manager.cc:1434] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.095s	user 0.009s	sys 0.015s
I20260709 13:07:56.334203 30667 tablet_bootstrap.cc:492] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:56.334416 30517 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:07:56.335455 30882 raft_consensus.cc:2804] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:56.335898 30882 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.336289 30882 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:56.336549 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:56.337244 30617 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
I20260709 13:07:56.342206 30373 catalog_manager.cc:5697] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:56.343209 30882 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:56.325829 30371 catalog_manager.cc:5697] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 1 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:56.345353 30884 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.345796 30884 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:56.347669 30884 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:56.349439 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:56.350798 30550 raft_consensus.cc:2468] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 1.
I20260709 13:07:56.339735 30667 tablet_bootstrap.cc:654] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:56.360137 30977 raft_consensus.cc:493] T 7e31b2accf3b4a3b8b7668571e619eb7 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:07:56.360638 30977 raft_consensus.cc:515] T 7e31b2accf3b4a3b8b7668571e619eb7 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:56.362193 30470 raft_consensus.cc:2468] T 99c151771be541b19017860da4f7218d P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 1.
I20260709 13:07:56.363879 30591 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:07:56.364880 31034 raft_consensus.cc:2804] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:56.365332 31034 raft_consensus.cc:697] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:07:56.366317 31034 consensus_queue.cc:237] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:56.369278 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:56.371842 30882 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:56.374831 30516 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:56.376189 31059 raft_consensus.cc:2749] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:56.376228 31031 consensus_queue.cc:1048] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:56.377070 30667 tablet_bootstrap.cc:492] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:56.377355 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:07:56.377918 30617 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:56.371845 30977 leader_election.cc:290] T 7e31b2accf3b4a3b8b7668571e619eb7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:56.382483 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:56.391343 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:07:56.392365 30470 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:56.396210 30617 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 2.
I20260709 13:07:56.377547 30667 ts_tablet_manager.cc:1403] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.044s	user 0.018s	sys 0.000s
I20260709 13:07:56.398129 30516 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:07:56.398506 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:56.400151 30977 raft_consensus.cc:2804] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:56.400620 30977 raft_consensus.cc:697] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 2 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:07:56.401783 30977 consensus_queue.cc:237] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:56.403151 30972 consensus_queue.cc:1048] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:56.407033 30667 raft_consensus.cc:359] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:56.407685 30667 raft_consensus.cc:385] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:56.409850 30667 raft_consensus.cc:740] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:56.410511 30517 leader_election.cc:304] T 7e31b2accf3b4a3b8b7668571e619eb7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:07:56.411512 30882 raft_consensus.cc:2749] T 7e31b2accf3b4a3b8b7668571e619eb7 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:56.415059 30667 consensus_queue.cc:260] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:56.418118 30667 ts_tablet_manager.cc:1434] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:07:56.419044 30667 tablet_bootstrap.cc:492] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd: Bootstrap starting.
I20260709 13:07:56.426244 30667 tablet_bootstrap.cc:654] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:56.435616 30373 catalog_manager.cc:5697] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 1 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:56.438848 30667 tablet_bootstrap.cc:492] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd: No bootstrap required, opened a new log
I20260709 13:07:56.439344 30667 ts_tablet_manager.cc:1403] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.007s
I20260709 13:07:56.441901 30667 raft_consensus.cc:359] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:56.438092 30470 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 2.
I20260709 13:07:56.442881 30667 raft_consensus.cc:385] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:56.443233 30667 raft_consensus.cc:740] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Initialized, Role: FOLLOWER
I20260709 13:07:56.443917 30667 consensus_queue.cc:260] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:56.445932 30667 ts_tablet_manager.cc:1434] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:07:56.464210 30373 catalog_manager.cc:5697] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 0 to 2, leader changed from <none> to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 2 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:56.493132 30974 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.493654 30974 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:56.495540 30974 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:07:56.496265 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:56.496572 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:56.497893 30591 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:07:56.497843 31081 consensus_queue.cc:1048] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:56.498775 30974 raft_consensus.cc:2749] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:56.502341 31031 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.502821 31031 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:56.505210 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:07:56.505412 31031 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:56.505738 30549 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 0.
I20260709 13:07:56.506338 30617 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:56.506762 30440 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:07:56.507536 31031 raft_consensus.cc:2804] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:56.507887 31031 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.508214 31031 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:56.509943 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:56.510389 30623 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 0.
I20260709 13:07:56.514087 31081 consensus_queue.cc:1048] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:56.517333 31031 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:56.523917 31031 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:56.524878 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:07:56.525282 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:07:56.525786 30623 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:56.525388 30549 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:56.532625 30549 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 1.
I20260709 13:07:56.538849 30623 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 1.
I20260709 13:07:56.542141 30440 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:07:56.543324 31069 raft_consensus.cc:2804] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:56.543751 31069 raft_consensus.cc:697] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:07:56.544554 31069 consensus_queue.cc:237] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:56.561036 30373 catalog_manager.cc:5697] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 0 to 1, leader changed from <none> to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:56.638195 31081 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.638613 31081 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:56.640916 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:07:56.640462 31081 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:56.641527 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:07:56.641542 30470 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 0.
I20260709 13:07:56.642318 30617 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 0.
I20260709 13:07:56.642872 30517 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:07:56.643600 31081 raft_consensus.cc:2804] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:56.644032 31081 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.644361 31081 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:56.649966 31081 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:56.652223 31081 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:56.652915 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:07:56.653455 30617 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:56.653885 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:07:56.654454 30473 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:56.658682 30617 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
I20260709 13:07:56.659741 30516 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:07:56.659742 30473 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
I20260709 13:07:56.660593 31081 raft_consensus.cc:2804] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:56.661057 31081 raft_consensus.cc:697] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:07:56.661832 31081 consensus_queue.cc:237] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:07:56.671726 30370 catalog_manager.cc:5697] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:56.729998 30974 consensus_queue.cc:1048] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:56.739230 30758 consensus_queue.cc:1048] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:56.804214 31034 consensus_queue.cc:1048] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:56.821116 30547 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:56.828986 31034 consensus_queue.cc:1048] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:56.844487 30617 raft_consensus.cc:1275] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:07:56.845623 30977 consensus_queue.cc:1048] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:56.859913 30474 raft_consensus.cc:1275] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:07:56.861480 30884 consensus_queue.cc:1048] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:56.934831 30946 consensus_queue.cc:1048] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:56.946781 30946 consensus_queue.cc:1048] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:57.120704 30882 consensus_queue.cc:1048] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:57.130929 30977 consensus_queue.cc:1048] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:57.950820 29364 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:57.986123 31103 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:57.986123 31104 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:57.987177 31106 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:57.990232 29364 server_base.cc:1061] running on GCE node
I20260709 13:07:57.992733 29364 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:57.993023 29364 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:57.993255 29364 hybrid_clock.cc:648] HybridClock initialized: now 1783602477993237 us; error 0 us; skew 500 ppm
I20260709 13:07:57.993893 29364 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:57.997114 29364 webserver.cc:533] Webserver started at http://127.28.173.4:38217/ using document root <none> and password file <none>
I20260709 13:07:57.997851 29364 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:57.998144 29364 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:57.998553 29364 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:58.000505 29364 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-3-root/instance:
uuid: "cd669586cff44d4bbfcc007e213faab6"
format_stamp: "Formatted at 2026-07-09 13:07:57 on dist-test-slave-x62b"
I20260709 13:07:58.006253 29364 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:07:58.021204 31111 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:58.024406 29364 fs_manager.cc:730] Time spent opening block manager: real 0.015s	user 0.007s	sys 0.004s
I20260709 13:07:58.024828 29364 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-3-root
uuid: "cd669586cff44d4bbfcc007e213faab6"
format_stamp: "Formatted at 2026-07-09 13:07:57 on dist-test-slave-x62b"
I20260709 13:07:58.025234 29364 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:58.046482 29364 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:58.048321 29364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:58.053272 29364 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:58.056377 29364 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:58.056598 29364 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:58.056880 29364 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:58.057186 29364 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.001s
I20260709 13:07:58.128518 29364 rpc_server.cc:307] RPC server started. Bound to: 127.28.173.4:34453
I20260709 13:07:58.128875 31175 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.173.4:34453 every 8 connection(s)
I20260709 13:07:58.132557 29364 auto_leader_rebalancer-test.cc:384] add a tserver: cd669586cff44d4bbfcc007e213faab6
I20260709 13:07:58.154351 31176 heartbeater.cc:344] Connected to a master server at 127.28.173.62:33437
I20260709 13:07:58.154744 31176 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:58.155460 31176 heartbeater.cc:507] Master 127.28.173.62:33437 requested a full tablet report, sending...
I20260709 13:07:58.157150 30370 ts_manager.cc:194] Registered new tserver with Master: cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:07:58.158473 30370 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47208
I20260709 13:07:59.145948 30470 consensus_queue.cc:237] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:07:59.151928 30551 raft_consensus.cc:1275] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:59.153178 30618 raft_consensus.cc:1275] T b0842494dc2a48d89fb422524082081d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:59.153590 31112 consensus_queue.cc:1048] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:59.154667 31031 consensus_queue.cc:1048] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:59.160948 31176 heartbeater.cc:499] Master 127.28.173.62:33437 was elected leader, sending a full tablet report...
I20260709 13:07:59.168069 30946 raft_consensus.cc:2955] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
W20260709 13:07:59.173537 30441 consensus_peers.cc:597] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 -> Peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453): Couldn't send request to peer cd669586cff44d4bbfcc007e213faab6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b0842494dc2a48d89fb422524082081d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:59.172789 30547 raft_consensus.cc:2955] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:07:59.171656 30618 raft_consensus.cc:2955] T b0842494dc2a48d89fb422524082081d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:07:59.188841 30370 catalog_manager.cc:5697] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 reported cstate change: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New cstate: current_term: 1 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:59.201704 30618 consensus_queue.cc:237] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:07:59.214315 30547 raft_consensus.cc:1275] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:59.215468 31120 consensus_queue.cc:1048] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:59.225147 30470 raft_consensus.cc:1275] T 8a8b48bc080241c98b3c2b0e1ce8c041 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:59.227393 31120 consensus_queue.cc:1048] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:59.232926 30974 raft_consensus.cc:2955] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
W20260709 13:07:59.238559 30590 consensus_peers.cc:597] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453): Couldn't send request to peer cd669586cff44d4bbfcc007e213faab6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a8b48bc080241c98b3c2b0e1ce8c041. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:59.240370 30547 raft_consensus.cc:2955] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:07:59.250188 30470 raft_consensus.cc:2955] T 8a8b48bc080241c98b3c2b0e1ce8c041 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:07:59.260048 30370 catalog_manager.cc:5697] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New cstate: current_term: 2 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:07:59.268496 30617 consensus_queue.cc:237] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
W20260709 13:07:59.277055 30590 consensus_peers.cc:597] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453): Couldn't send request to peer cd669586cff44d4bbfcc007e213faab6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7111be574b514751972d70830d3b644f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:59.277751 30547 raft_consensus.cc:1275] T 7111be574b514751972d70830d3b644f P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:59.278872 30972 consensus_queue.cc:1048] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:59.279295 30470 raft_consensus.cc:1275] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:59.280879 31196 consensus_queue.cc:1048] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:59.300076 30473 raft_consensus.cc:2955] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:07:59.302968 30547 raft_consensus.cc:2955] T 7111be574b514751972d70830d3b644f P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:07:59.298624 31120 raft_consensus.cc:2955] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:07:59.324843 30373 catalog_manager.cc:5697] T 7111be574b514751972d70830d3b644f P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New cstate: current_term: 1 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:07:59.343314 30473 consensus_queue.cc:237] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
W20260709 13:07:59.351193 30441 consensus_peers.cc:597] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 -> Peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453): Couldn't send request to peer cd669586cff44d4bbfcc007e213faab6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6a9b619ab6a04af38de048edd085fe3e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:59.352293 30623 raft_consensus.cc:1275] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:59.353650 30551 raft_consensus.cc:1275] T 6a9b619ab6a04af38de048edd085fe3e P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:59.354728 31031 consensus_queue.cc:1048] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:59.355507 31112 consensus_queue.cc:1048] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:59.371583 31031 raft_consensus.cc:2955] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:07:59.374166 30617 raft_consensus.cc:2955] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:07:59.393167 30373 catalog_manager.cc:5697] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New cstate: current_term: 1 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:07:59.398547 30551 raft_consensus.cc:2955] T 6a9b619ab6a04af38de048edd085fe3e P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:07:59.705773 31204 ts_tablet_manager.cc:933] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6: Initiating tablet copy from peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133)
I20260709 13:07:59.709636 31204 tablet_copy_client.cc:323] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6: tablet copy: Beginning tablet copy session from remote peer at address 127.28.173.1:43133
I20260709 13:07:59.734022 30486 tablet_copy_service.cc:140] P f639301059e24dc5b0d88a46dc683326: Received BeginTabletCopySession request for tablet b0842494dc2a48d89fb422524082081d from peer cd669586cff44d4bbfcc007e213faab6 ({username='slave'} at 127.0.0.1:60026)
I20260709 13:07:59.734778 30486 tablet_copy_service.cc:161] P f639301059e24dc5b0d88a46dc683326: Beginning new tablet copy session on tablet b0842494dc2a48d89fb422524082081d from peer cd669586cff44d4bbfcc007e213faab6 at {username='slave'} at 127.0.0.1:60026: session id = cd669586cff44d4bbfcc007e213faab6-b0842494dc2a48d89fb422524082081d
I20260709 13:07:59.735865 31208 ts_tablet_manager.cc:933] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6: Initiating tablet copy from peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:59.738255 31208 tablet_copy_client.cc:323] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Beginning tablet copy session from remote peer at address 127.28.173.3:32851
I20260709 13:07:59.742722 30486 tablet_copy_source_session.cc:215] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:59.746678 31204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0842494dc2a48d89fb422524082081d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.752852 30635 tablet_copy_service.cc:140] P fe2b7d73f8c743c1ba570cfd981c4e79: Received BeginTabletCopySession request for tablet 8a8b48bc080241c98b3c2b0e1ce8c041 from peer cd669586cff44d4bbfcc007e213faab6 ({username='slave'} at 127.0.0.1:57140)
I20260709 13:07:59.753443 30635 tablet_copy_service.cc:161] P fe2b7d73f8c743c1ba570cfd981c4e79: Beginning new tablet copy session on tablet 8a8b48bc080241c98b3c2b0e1ce8c041 from peer cd669586cff44d4bbfcc007e213faab6 at {username='slave'} at 127.0.0.1:57140: session id = cd669586cff44d4bbfcc007e213faab6-8a8b48bc080241c98b3c2b0e1ce8c041
I20260709 13:07:59.766824 30635 tablet_copy_source_session.cc:215] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:59.770300 31208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a8b48bc080241c98b3c2b0e1ce8c041. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.771073 31204 tablet_copy_client.cc:806] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:59.771708 31204 tablet_copy_client.cc:670] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:59.775924 31204 tablet_copy_client.cc:538] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:59.782327 31204 tablet_bootstrap.cc:492] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6: Bootstrap starting.
I20260709 13:07:59.787616 31208 tablet_copy_client.cc:806] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:59.788275 31208 tablet_copy_client.cc:670] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:59.794171 31208 tablet_copy_client.cc:538] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:59.805853 31208 tablet_bootstrap.cc:492] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6: Bootstrap starting.
I20260709 13:07:59.821321 31212 ts_tablet_manager.cc:933] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6: Initiating tablet copy from peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:07:59.841276 31212 tablet_copy_client.cc:323] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6: tablet copy: Beginning tablet copy session from remote peer at address 127.28.173.3:32851
I20260709 13:07:59.846729 30635 tablet_copy_service.cc:140] P fe2b7d73f8c743c1ba570cfd981c4e79: Received BeginTabletCopySession request for tablet 7111be574b514751972d70830d3b644f from peer cd669586cff44d4bbfcc007e213faab6 ({username='slave'} at 127.0.0.1:57140)
I20260709 13:07:59.847252 30635 tablet_copy_service.cc:161] P fe2b7d73f8c743c1ba570cfd981c4e79: Beginning new tablet copy session on tablet 7111be574b514751972d70830d3b644f from peer cd669586cff44d4bbfcc007e213faab6 at {username='slave'} at 127.0.0.1:57140: session id = cd669586cff44d4bbfcc007e213faab6-7111be574b514751972d70830d3b644f
I20260709 13:07:59.848608 31204 tablet_bootstrap.cc:492] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:59.849777 31204 tablet_bootstrap.cc:492] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6: Bootstrap complete.
I20260709 13:07:59.850919 31204 ts_tablet_manager.cc:1403] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6: Time spent bootstrapping tablet: real 0.069s	user 0.035s	sys 0.024s
I20260709 13:07:59.854417 31204 raft_consensus.cc:359] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:07:59.855211 31204 raft_consensus.cc:740] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Initialized, Role: LEARNER
I20260709 13:07:59.858446 30635 tablet_copy_source_session.cc:215] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:59.860014 31204 consensus_queue.cc:260] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:07:59.863487 31212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7111be574b514751972d70830d3b644f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.869171 31208 tablet_bootstrap.cc:492] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:59.870348 31208 tablet_bootstrap.cc:492] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6: Bootstrap complete.
I20260709 13:07:59.871043 31208 ts_tablet_manager.cc:1403] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6: Time spent bootstrapping tablet: real 0.065s	user 0.026s	sys 0.004s
I20260709 13:07:59.874964 31208 raft_consensus.cc:359] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:07:59.875856 31208 raft_consensus.cc:740] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Initialized, Role: LEARNER
I20260709 13:07:59.876505 31208 consensus_queue.cc:260] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:07:59.886965 31208 ts_tablet_manager.cc:1434] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.004s
I20260709 13:07:59.910539 30635 tablet_copy_service.cc:342] P fe2b7d73f8c743c1ba570cfd981c4e79: Request end of tablet copy session cd669586cff44d4bbfcc007e213faab6-8a8b48bc080241c98b3c2b0e1ce8c041 received from {username='slave'} at 127.0.0.1:57140
I20260709 13:07:59.911213 30635 tablet_copy_service.cc:434] P fe2b7d73f8c743c1ba570cfd981c4e79: ending tablet copy session cd669586cff44d4bbfcc007e213faab6-8a8b48bc080241c98b3c2b0e1ce8c041 on tablet 8a8b48bc080241c98b3c2b0e1ce8c041 with peer cd669586cff44d4bbfcc007e213faab6
I20260709 13:07:59.918433 31208 ts_tablet_manager.cc:933] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6: Initiating tablet copy from peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133)
I20260709 13:07:59.934273 31208 tablet_copy_client.cc:323] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6: tablet copy: Beginning tablet copy session from remote peer at address 127.28.173.1:43133
I20260709 13:07:59.936178 30486 tablet_copy_service.cc:140] P f639301059e24dc5b0d88a46dc683326: Received BeginTabletCopySession request for tablet 6a9b619ab6a04af38de048edd085fe3e from peer cd669586cff44d4bbfcc007e213faab6 ({username='slave'} at 127.0.0.1:60026)
I20260709 13:07:59.936702 30486 tablet_copy_service.cc:161] P f639301059e24dc5b0d88a46dc683326: Beginning new tablet copy session on tablet 6a9b619ab6a04af38de048edd085fe3e from peer cd669586cff44d4bbfcc007e213faab6 at {username='slave'} at 127.0.0.1:60026: session id = cd669586cff44d4bbfcc007e213faab6-6a9b619ab6a04af38de048edd085fe3e
I20260709 13:07:59.945659 30486 tablet_copy_source_session.cc:215] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:59.950093 31208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a9b619ab6a04af38de048edd085fe3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.981056 31212 tablet_copy_client.cc:806] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:59.981653 31212 tablet_copy_client.cc:670] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:59.979972 31208 tablet_copy_client.cc:806] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:59.985697 31212 tablet_copy_client.cc:538] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:59.986564 31204 ts_tablet_manager.cc:1434] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6: Time spent starting tablet: real 0.135s	user 0.041s	sys 0.055s
I20260709 13:07:59.985781 31208 tablet_copy_client.cc:670] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:59.991566 31208 tablet_copy_client.cc:538] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:59.991845 30486 tablet_copy_service.cc:342] P f639301059e24dc5b0d88a46dc683326: Request end of tablet copy session cd669586cff44d4bbfcc007e213faab6-b0842494dc2a48d89fb422524082081d received from {username='slave'} at 127.0.0.1:60026
I20260709 13:07:59.992261 30486 tablet_copy_service.cc:434] P f639301059e24dc5b0d88a46dc683326: ending tablet copy session cd669586cff44d4bbfcc007e213faab6-b0842494dc2a48d89fb422524082081d on tablet b0842494dc2a48d89fb422524082081d with peer cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:00.001902 31208 tablet_bootstrap.cc:492] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6: Bootstrap starting.
I20260709 13:08:00.010376 31212 tablet_bootstrap.cc:492] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6: Bootstrap starting.
I20260709 13:08:00.030809 31208 tablet_bootstrap.cc:492] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:00.031800 31208 tablet_bootstrap.cc:492] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6: Bootstrap complete.
I20260709 13:08:00.032505 31208 ts_tablet_manager.cc:1403] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.021s
I20260709 13:08:00.035439 31208 raft_consensus.cc:359] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:00.036303 31208 raft_consensus.cc:740] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Initialized, Role: LEARNER
I20260709 13:08:00.036907 31208 consensus_queue.cc:260] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:00.042994 31208 ts_tablet_manager.cc:1434] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:08:00.044631 30486 tablet_copy_service.cc:342] P f639301059e24dc5b0d88a46dc683326: Request end of tablet copy session cd669586cff44d4bbfcc007e213faab6-6a9b619ab6a04af38de048edd085fe3e received from {username='slave'} at 127.0.0.1:60026
I20260709 13:08:00.045046 30486 tablet_copy_service.cc:434] P f639301059e24dc5b0d88a46dc683326: ending tablet copy session cd669586cff44d4bbfcc007e213faab6-6a9b619ab6a04af38de048edd085fe3e on tablet 6a9b619ab6a04af38de048edd085fe3e with peer cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:00.050944 31212 tablet_bootstrap.cc:492] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:00.051873 31212 tablet_bootstrap.cc:492] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6: Bootstrap complete.
I20260709 13:08:00.052582 31212 ts_tablet_manager.cc:1403] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6: Time spent bootstrapping tablet: real 0.042s	user 0.024s	sys 0.004s
I20260709 13:08:00.055124 31212 raft_consensus.cc:359] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:00.055712 31212 raft_consensus.cc:740] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Initialized, Role: LEARNER
I20260709 13:08:00.056238 31212 consensus_queue.cc:260] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:00.057861 31212 ts_tablet_manager.cc:1434] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:08:00.059340 30635 tablet_copy_service.cc:342] P fe2b7d73f8c743c1ba570cfd981c4e79: Request end of tablet copy session cd669586cff44d4bbfcc007e213faab6-7111be574b514751972d70830d3b644f received from {username='slave'} at 127.0.0.1:57140
I20260709 13:08:00.059739 30635 tablet_copy_service.cc:434] P fe2b7d73f8c743c1ba570cfd981c4e79: ending tablet copy session cd669586cff44d4bbfcc007e213faab6-7111be574b514751972d70830d3b644f on tablet 7111be574b514751972d70830d3b644f with peer cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:00.269171 31151 raft_consensus.cc:1217] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:00.274504 31151 raft_consensus.cc:1217] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:08:00.354764 31151 raft_consensus.cc:1217] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:00.509110 31151 raft_consensus.cc:1217] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:00.783288 31223 raft_consensus.cc:1064] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326: attempting to promote NON_VOTER cd669586cff44d4bbfcc007e213faab6 to VOTER
I20260709 13:08:00.785573 31223 consensus_queue.cc:237] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:00.792537 30617 raft_consensus.cc:1275] T b0842494dc2a48d89fb422524082081d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:00.792870 31151 raft_consensus.cc:1275] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:00.793417 30551 raft_consensus.cc:1275] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:00.794661 31223 consensus_queue.cc:1048] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:00.795421 31031 consensus_queue.cc:1048] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:00.796137 30946 consensus_queue.cc:1048] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:00.823594 31031 raft_consensus.cc:2955] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:00.828881 31151 raft_consensus.cc:2955] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:00.830741 30551 raft_consensus.cc:2955] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:00.840238 30617 raft_consensus.cc:2955] T b0842494dc2a48d89fb422524082081d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:00.845919 30370 catalog_manager.cc:5697] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 reported cstate change: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:00.855469 31196 raft_consensus.cc:1064] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79: attempting to promote NON_VOTER cd669586cff44d4bbfcc007e213faab6 to VOTER
I20260709 13:08:00.858263 31196 consensus_queue.cc:237] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:00.862394 30972 raft_consensus.cc:1064] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79: attempting to promote NON_VOTER cd669586cff44d4bbfcc007e213faab6 to VOTER
I20260709 13:08:00.864817 30972 consensus_queue.cc:237] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:00.886459 31150 raft_consensus.cc:1275] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:00.889629 31229 consensus_queue.cc:1048] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:00.892163 30470 raft_consensus.cc:1275] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:00.894860 31234 consensus_queue.cc:1048] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:00.898645 31150 raft_consensus.cc:1275] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 2 LEARNER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:08:00.905540 30547 raft_consensus.cc:1275] T 7111be574b514751972d70830d3b644f P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:00.906734 31196 consensus_queue.cc:1048] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:00.907254 30551 raft_consensus.cc:1275] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:08:00.923105 31196 consensus_queue.cc:1048] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:00.928290 31196 consensus_queue.cc:1048] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:00.952883 30474 raft_consensus.cc:1275] T 8a8b48bc080241c98b3c2b0e1ce8c041 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:08:00.971626 31233 consensus_queue.cc:1048] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:00.972750 30474 consensus_queue.cc:237] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:00.982772 30549 raft_consensus.cc:1275] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:00.984162 30946 consensus_queue.cc:1048] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:00.983706 31196 raft_consensus.cc:2955] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:00.986788 31149 raft_consensus.cc:2955] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:00.990726 31233 raft_consensus.cc:2955] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:00.995746 31150 raft_consensus.cc:2955] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:00.996174 31031 raft_consensus.cc:2955] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:01.003863 30374 catalog_manager.cc:5697] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 reported cstate change: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:01.005028 30550 raft_consensus.cc:2955] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:01.012658 30373 catalog_manager.cc:5697] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:01.011353 30474 raft_consensus.cc:2955] T 8a8b48bc080241c98b3c2b0e1ce8c041 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:01.018311 31151 raft_consensus.cc:1275] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:01.027954 30371 catalog_manager.cc:5697] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: config changed from index 3 to 4, VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) evicted. New cstate: current_term: 1 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:01.028676 30551 raft_consensus.cc:2955] T 7111be574b514751972d70830d3b644f P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:01.030736 30946 consensus_queue.cc:1048] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:01.033551 30623 consensus_queue.cc:237] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:01.045047 31149 raft_consensus.cc:1275] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:08:01.045851 30361 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b0842494dc2a48d89fb422524082081d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:01.049264 31229 consensus_queue.cc:1048] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:01.052161 30612 tablet_service.cc:1558] Processing DeleteTablet for tablet b0842494dc2a48d89fb422524082081d with delete_type TABLET_DATA_TOMBSTONED (TS fe2b7d73f8c743c1ba570cfd981c4e79 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36118
I20260709 13:08:01.050096 31151 raft_consensus.cc:2955] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:01.060838 31245 tablet_replica.cc:333] T b0842494dc2a48d89fb422524082081d P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:08:01.061935 31245 raft_consensus.cc:2243] T b0842494dc2a48d89fb422524082081d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:01.063351 31245 raft_consensus.cc:2272] T b0842494dc2a48d89fb422524082081d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:01.067044 31245 ts_tablet_manager.cc:1916] T b0842494dc2a48d89fb422524082081d P fe2b7d73f8c743c1ba570cfd981c4e79: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:01.068394 30550 raft_consensus.cc:2955] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:01.074961 31233 raft_consensus.cc:2955] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:01.077320 31151 raft_consensus.cc:2955] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:01.086041 31245 ts_tablet_manager.cc:1929] T b0842494dc2a48d89fb422524082081d P fe2b7d73f8c743c1ba570cfd981c4e79: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:01.086638 31245 log.cc:1199] T b0842494dc2a48d89fb422524082081d P fe2b7d73f8c743c1ba570cfd981c4e79: Deleting WAL directory at /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-2-root/wals/b0842494dc2a48d89fb422524082081d
I20260709 13:08:01.087598 30473 raft_consensus.cc:2955] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:01.089368 30360 catalog_manager.cc:5028] TS fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): tablet b0842494dc2a48d89fb422524082081d (table test-workload [id=887057791fed41a884abbab3e8d4b49f]) successfully deleted
I20260709 13:08:01.102296 30360 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8a8b48bc080241c98b3c2b0e1ce8c041 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:01.108556 30371 catalog_manager.cc:5697] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: config changed from index 3 to 4, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New cstate: current_term: 2 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:01.114683 30551 raft_consensus.cc:1275] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:08:01.119415 31244 raft_consensus.cc:1064] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326: attempting to promote NON_VOTER cd669586cff44d4bbfcc007e213faab6 to VOTER
I20260709 13:08:01.121788 31244 consensus_queue.cc:237] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:01.128079 31229 consensus_queue.cc:1048] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:01.134557 30551 raft_consensus.cc:2955] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:01.136123 30623 consensus_queue.cc:237] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:01.143312 30464 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a8b48bc080241c98b3c2b0e1ce8c041 with delete_type TABLET_DATA_TOMBSTONED (TS f639301059e24dc5b0d88a46dc683326 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53858
I20260709 13:08:01.151991 30550 raft_consensus.cc:1275] T 6a9b619ab6a04af38de048edd085fe3e P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:01.152716 31247 tablet_replica.cc:333] T 8a8b48bc080241c98b3c2b0e1ce8c041 P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:08:01.170782 31247 raft_consensus.cc:2243] T 8a8b48bc080241c98b3c2b0e1ce8c041 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:01.171474 31247 raft_consensus.cc:2272] T 8a8b48bc080241c98b3c2b0e1ce8c041 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:01.153628 30617 raft_consensus.cc:1275] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:01.155251 31244 consensus_queue.cc:1048] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:08:01.161298 31149 raft_consensus.cc:1275] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:01.174548 30467 raft_consensus.cc:1275] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:01.153455 31151 raft_consensus.cc:1275] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:01.174420 31233 consensus_queue.cc:1048] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:01.176805 30946 consensus_queue.cc:1048] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:01.177687 31229 consensus_queue.cc:1048] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:01.178076 31247 ts_tablet_manager.cc:1916] T 8a8b48bc080241c98b3c2b0e1ce8c041 P f639301059e24dc5b0d88a46dc683326: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:01.186609 31196 raft_consensus.cc:2955] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:01.191046 31149 raft_consensus.cc:2955] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:01.192996 30946 consensus_queue.cc:1048] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:01.192978 31247 ts_tablet_manager.cc:1929] T 8a8b48bc080241c98b3c2b0e1ce8c041 P f639301059e24dc5b0d88a46dc683326: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 13:08:01.194989 31247 log.cc:1199] T 8a8b48bc080241c98b3c2b0e1ce8c041 P f639301059e24dc5b0d88a46dc683326: Deleting WAL directory at /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-0-root/wals/8a8b48bc080241c98b3c2b0e1ce8c041
I20260709 13:08:01.199152 30361 catalog_manager.cc:5028] TS f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): tablet 8a8b48bc080241c98b3c2b0e1ce8c041 (table test-workload [id=887057791fed41a884abbab3e8d4b49f]) successfully deleted
I20260709 13:08:01.202512 30467 raft_consensus.cc:2955] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:01.206923 30360 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7111be574b514751972d70830d3b644f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:01.217648 30374 catalog_manager.cc:5697] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: config changed from index 3 to 4, VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) evicted. New cstate: current_term: 1 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:01.231551 30541 tablet_service.cc:1558] Processing DeleteTablet for tablet 7111be574b514751972d70830d3b644f with delete_type TABLET_DATA_TOMBSTONED (TS 092f6eb694fc4bbeab49677cccd880fd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43082
I20260709 13:08:01.234398 31251 tablet_replica.cc:333] T 7111be574b514751972d70830d3b644f P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:08:01.239224 31251 raft_consensus.cc:2243] T 7111be574b514751972d70830d3b644f P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:01.240449 31251 raft_consensus.cc:2272] T 7111be574b514751972d70830d3b644f P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:01.244565 31251 ts_tablet_manager.cc:1916] T 7111be574b514751972d70830d3b644f P 092f6eb694fc4bbeab49677cccd880fd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:01.246778 31031 raft_consensus.cc:2955] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:01.257189 30623 raft_consensus.cc:2955] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:01.259263 31251 ts_tablet_manager.cc:1929] T 7111be574b514751972d70830d3b644f P 092f6eb694fc4bbeab49677cccd880fd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:01.259694 31251 log.cc:1199] T 7111be574b514751972d70830d3b644f P 092f6eb694fc4bbeab49677cccd880fd: Deleting WAL directory at /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-1-root/wals/7111be574b514751972d70830d3b644f
I20260709 13:08:01.261678 30359 catalog_manager.cc:5028] TS 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): tablet 7111be574b514751972d70830d3b644f (table test-workload [id=887057791fed41a884abbab3e8d4b49f]) successfully deleted
I20260709 13:08:01.261617 31149 raft_consensus.cc:2955] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:01.261039 30551 raft_consensus.cc:2955] T 6a9b619ab6a04af38de048edd085fe3e P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:01.269833 30373 catalog_manager.cc:5697] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 reported cstate change: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:01.285925 30467 consensus_queue.cc:237] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:01.293056 31149 raft_consensus.cc:1275] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:01.293118 30623 raft_consensus.cc:1275] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:01.294931 30946 consensus_queue.cc:1048] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:01.295629 31031 consensus_queue.cc:1048] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:01.302017 31031 raft_consensus.cc:2955] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:01.305627 31149 raft_consensus.cc:2955] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:01.306197 30623 raft_consensus.cc:2955] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:01.313088 30361 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6a9b619ab6a04af38de048edd085fe3e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:01.317966 30370 catalog_manager.cc:5697] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 reported cstate change: config changed from index 3 to 4, VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) evicted. New cstate: current_term: 1 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:01.336055 30541 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a9b619ab6a04af38de048edd085fe3e with delete_type TABLET_DATA_TOMBSTONED (TS 092f6eb694fc4bbeab49677cccd880fd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43082
I20260709 13:08:01.336905 31251 tablet_replica.cc:333] T 6a9b619ab6a04af38de048edd085fe3e P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:08:01.337714 31251 raft_consensus.cc:2243] T 6a9b619ab6a04af38de048edd085fe3e P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:01.338390 31251 raft_consensus.cc:2272] T 6a9b619ab6a04af38de048edd085fe3e P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:01.341184 31251 ts_tablet_manager.cc:1916] T 6a9b619ab6a04af38de048edd085fe3e P 092f6eb694fc4bbeab49677cccd880fd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:01.353430 31251 ts_tablet_manager.cc:1929] T 6a9b619ab6a04af38de048edd085fe3e P 092f6eb694fc4bbeab49677cccd880fd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:01.353726 31251 log.cc:1199] T 6a9b619ab6a04af38de048edd085fe3e P 092f6eb694fc4bbeab49677cccd880fd: Deleting WAL directory at /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-1-root/wals/6a9b619ab6a04af38de048edd085fe3e
I20260709 13:08:01.354939 30359 catalog_manager.cc:5028] TS 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): tablet 6a9b619ab6a04af38de048edd085fe3e (table test-workload [id=887057791fed41a884abbab3e8d4b49f]) successfully deleted
I20260709 13:08:02.407262 30548 consensus_queue.cc:237] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:02.413259 30473 raft_consensus.cc:1275] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:02.414637 31258 consensus_queue.cc:1048] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:02.414891 30623 raft_consensus.cc:1275] T 772a658508f4465d8c1ef039f5bcaa67 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:02.416885 31081 consensus_queue.cc:1048] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:08:02.432654 30516 consensus_peers.cc:597] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd -> Peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453): Couldn't send request to peer cd669586cff44d4bbfcc007e213faab6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 772a658508f4465d8c1ef039f5bcaa67. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:02.435348 31260 raft_consensus.cc:2955] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:02.446170 30620 raft_consensus.cc:2955] T 772a658508f4465d8c1ef039f5bcaa67 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:02.457463 30548 consensus_queue.cc:237] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:02.461872 30473 raft_consensus.cc:2955] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:02.462687 30370 catalog_manager.cc:5697] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:02.464903 30467 raft_consensus.cc:1275] T 0c27ff7cbfd647edb6f31aac3e234914 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:02.465037 30624 raft_consensus.cc:1275] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:02.466754 30516 consensus_peers.cc:597] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd -> Peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453): Couldn't send request to peer cd669586cff44d4bbfcc007e213faab6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0c27ff7cbfd647edb6f31aac3e234914. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:02.466794 31252 consensus_queue.cc:1048] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:02.469444 31252 consensus_queue.cc:1048] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:02.485860 31258 raft_consensus.cc:2955] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:02.493220 30473 raft_consensus.cc:2955] T 0c27ff7cbfd647edb6f31aac3e234914 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:02.503796 30470 consensus_queue.cc:237] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:02.517870 30620 raft_consensus.cc:2955] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:02.519675 30623 raft_consensus.cc:1275] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:02.520992 30441 consensus_peers.cc:597] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 -> Peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453): Couldn't send request to peer cd669586cff44d4bbfcc007e213faab6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5302637c04824f67b70df2f3ee95c130. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:02.528447 30548 raft_consensus.cc:1275] T 5302637c04824f67b70df2f3ee95c130 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:02.532014 31031 consensus_queue.cc:1048] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:02.534600 30946 consensus_queue.cc:1048] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:02.538177 30374 catalog_manager.cc:5697] T 0c27ff7cbfd647edb6f31aac3e234914 P f639301059e24dc5b0d88a46dc683326 reported cstate change: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:02.555907 31257 raft_consensus.cc:2955] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:02.557374 30549 raft_consensus.cc:2955] T 5302637c04824f67b70df2f3ee95c130 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:02.561998 30623 raft_consensus.cc:2955] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:02.574713 30374 catalog_manager.cc:5697] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 reported cstate change: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New cstate: current_term: 1 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:02.577476 30549 consensus_queue.cc:237] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:02.591528 30620 raft_consensus.cc:1275] T 7c9861593ab94f7792fdd702f1d9a483 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:02.592238 30516 consensus_peers.cc:597] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd -> Peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453): Couldn't send request to peer cd669586cff44d4bbfcc007e213faab6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c9861593ab94f7792fdd702f1d9a483. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:02.593223 30470 raft_consensus.cc:1275] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:02.594959 31258 consensus_queue.cc:1048] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:02.595748 31252 consensus_queue.cc:1048] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:02.606837 31252 raft_consensus.cc:2955] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:02.608911 30620 raft_consensus.cc:2955] T 7c9861593ab94f7792fdd702f1d9a483 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:02.615238 30473 raft_consensus.cc:2955] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:02.625524 30374 catalog_manager.cc:5697] T 7c9861593ab94f7792fdd702f1d9a483 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:02.877581 31285 ts_tablet_manager.cc:933] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6: Initiating tablet copy from peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:02.879228 31285 tablet_copy_client.cc:323] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Beginning tablet copy session from remote peer at address 127.28.173.2:34733
I20260709 13:08:02.889683 30561 tablet_copy_service.cc:140] P 092f6eb694fc4bbeab49677cccd880fd: Received BeginTabletCopySession request for tablet 0c27ff7cbfd647edb6f31aac3e234914 from peer cd669586cff44d4bbfcc007e213faab6 ({username='slave'} at 127.0.0.1:35278)
I20260709 13:08:02.890273 30561 tablet_copy_service.cc:161] P 092f6eb694fc4bbeab49677cccd880fd: Beginning new tablet copy session on tablet 0c27ff7cbfd647edb6f31aac3e234914 from peer cd669586cff44d4bbfcc007e213faab6 at {username='slave'} at 127.0.0.1:35278: session id = cd669586cff44d4bbfcc007e213faab6-0c27ff7cbfd647edb6f31aac3e234914
I20260709 13:08:02.897506 30561 tablet_copy_source_session.cc:215] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:02.900484 31285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c27ff7cbfd647edb6f31aac3e234914. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:02.912057 31285 tablet_copy_client.cc:806] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:02.912557 31285 tablet_copy_client.cc:670] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:02.915942 31285 tablet_copy_client.cc:538] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:02.921485 31285 tablet_bootstrap.cc:492] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6: Bootstrap starting.
I20260709 13:08:02.946234 31285 tablet_bootstrap.cc:492] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:02.947180 31285 tablet_bootstrap.cc:492] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6: Bootstrap complete.
I20260709 13:08:02.947685 31285 ts_tablet_manager.cc:1403] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.013s
I20260709 13:08:02.950026 31285 raft_consensus.cc:359] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:02.950786 31285 raft_consensus.cc:740] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Initialized, Role: LEARNER
I20260709 13:08:02.951418 31285 consensus_queue.cc:260] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:02.953890 31285 ts_tablet_manager.cc:1434] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:08:02.955602 30561 tablet_copy_service.cc:342] P 092f6eb694fc4bbeab49677cccd880fd: Request end of tablet copy session cd669586cff44d4bbfcc007e213faab6-0c27ff7cbfd647edb6f31aac3e234914 received from {username='slave'} at 127.0.0.1:35278
I20260709 13:08:02.955978 30561 tablet_copy_service.cc:434] P 092f6eb694fc4bbeab49677cccd880fd: ending tablet copy session cd669586cff44d4bbfcc007e213faab6-0c27ff7cbfd647edb6f31aac3e234914 on tablet 0c27ff7cbfd647edb6f31aac3e234914 with peer cd669586cff44d4bbfcc007e213faab6
W20260709 13:08:03.002259 30572 debug-util.cc:398] Leaking SignalData structure 0x7b0800051d60 after lost signal to thread 29367
W20260709 13:08:03.003171 30572 debug-util.cc:398] Leaking SignalData structure 0x7b08001c0a20 after lost signal to thread 30408
W20260709 13:08:03.004317 30572 debug-util.cc:398] Leaking SignalData structure 0x7b08000e6b00 after lost signal to thread 30500
W20260709 13:08:03.005765 30572 debug-util.cc:398] Leaking SignalData structure 0x7b0800255280 after lost signal to thread 30649
I20260709 13:08:03.013289 31285 ts_tablet_manager.cc:933] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6: Initiating tablet copy from peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133)
I20260709 13:08:03.048640 31291 ts_tablet_manager.cc:933] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6: Initiating tablet copy from peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:03.059267 31285 tablet_copy_client.cc:323] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Beginning tablet copy session from remote peer at address 127.28.173.1:43133
I20260709 13:08:03.060514 31291 tablet_copy_client.cc:323] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Beginning tablet copy session from remote peer at address 127.28.173.2:34733
I20260709 13:08:03.061638 31293 ts_tablet_manager.cc:933] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6: Initiating tablet copy from peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:03.063433 30486 tablet_copy_service.cc:140] P f639301059e24dc5b0d88a46dc683326: Received BeginTabletCopySession request for tablet 5302637c04824f67b70df2f3ee95c130 from peer cd669586cff44d4bbfcc007e213faab6 ({username='slave'} at 127.0.0.1:60026)
I20260709 13:08:03.063900 30561 tablet_copy_service.cc:140] P 092f6eb694fc4bbeab49677cccd880fd: Received BeginTabletCopySession request for tablet 772a658508f4465d8c1ef039f5bcaa67 from peer cd669586cff44d4bbfcc007e213faab6 ({username='slave'} at 127.0.0.1:35278)
I20260709 13:08:03.063997 30486 tablet_copy_service.cc:161] P f639301059e24dc5b0d88a46dc683326: Beginning new tablet copy session on tablet 5302637c04824f67b70df2f3ee95c130 from peer cd669586cff44d4bbfcc007e213faab6 at {username='slave'} at 127.0.0.1:60026: session id = cd669586cff44d4bbfcc007e213faab6-5302637c04824f67b70df2f3ee95c130
I20260709 13:08:03.064484 30561 tablet_copy_service.cc:161] P 092f6eb694fc4bbeab49677cccd880fd: Beginning new tablet copy session on tablet 772a658508f4465d8c1ef039f5bcaa67 from peer cd669586cff44d4bbfcc007e213faab6 at {username='slave'} at 127.0.0.1:35278: session id = cd669586cff44d4bbfcc007e213faab6-772a658508f4465d8c1ef039f5bcaa67
I20260709 13:08:03.071316 30486 tablet_copy_source_session.cc:215] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:03.075124 31285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5302637c04824f67b70df2f3ee95c130. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.076110 30561 tablet_copy_source_session.cc:215] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:03.084524 31291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 772a658508f4465d8c1ef039f5bcaa67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.095603 31293 tablet_copy_client.cc:323] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Beginning tablet copy session from remote peer at address 127.28.173.2:34733
I20260709 13:08:03.097276 30561 tablet_copy_service.cc:140] P 092f6eb694fc4bbeab49677cccd880fd: Received BeginTabletCopySession request for tablet 7c9861593ab94f7792fdd702f1d9a483 from peer cd669586cff44d4bbfcc007e213faab6 ({username='slave'} at 127.0.0.1:35278)
I20260709 13:08:03.097867 30561 tablet_copy_service.cc:161] P 092f6eb694fc4bbeab49677cccd880fd: Beginning new tablet copy session on tablet 7c9861593ab94f7792fdd702f1d9a483 from peer cd669586cff44d4bbfcc007e213faab6 at {username='slave'} at 127.0.0.1:35278: session id = cd669586cff44d4bbfcc007e213faab6-7c9861593ab94f7792fdd702f1d9a483
I20260709 13:08:03.110240 30561 tablet_copy_source_session.cc:215] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:03.113142 31293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c9861593ab94f7792fdd702f1d9a483. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.119964 31291 tablet_copy_client.cc:806] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:03.120534 31291 tablet_copy_client.cc:670] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:03.124428 31291 tablet_copy_client.cc:538] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:03.134387 31291 tablet_bootstrap.cc:492] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6: Bootstrap starting.
I20260709 13:08:03.135655 31293 tablet_copy_client.cc:806] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:03.136200 31293 tablet_copy_client.cc:670] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:03.141497 31285 tablet_copy_client.cc:806] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:03.142102 31285 tablet_copy_client.cc:670] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:03.143638 31293 tablet_copy_client.cc:538] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:03.170727 31293 tablet_bootstrap.cc:492] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6: Bootstrap starting.
I20260709 13:08:03.175395 31285 tablet_copy_client.cc:538] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:03.201429 31291 tablet_bootstrap.cc:492] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:03.202286 31291 tablet_bootstrap.cc:492] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6: Bootstrap complete.
I20260709 13:08:03.202943 31291 ts_tablet_manager.cc:1403] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6: Time spent bootstrapping tablet: real 0.069s	user 0.032s	sys 0.016s
I20260709 13:08:03.206480 31285 tablet_bootstrap.cc:492] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6: Bootstrap starting.
I20260709 13:08:03.209399 31291 raft_consensus.cc:359] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:03.210448 31291 raft_consensus.cc:740] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Initialized, Role: LEARNER
I20260709 13:08:03.211174 31291 consensus_queue.cc:260] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:03.222409 31291 ts_tablet_manager.cc:1434] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6: Time spent starting tablet: real 0.019s	user 0.010s	sys 0.000s
I20260709 13:08:03.231199 30561 tablet_copy_service.cc:342] P 092f6eb694fc4bbeab49677cccd880fd: Request end of tablet copy session cd669586cff44d4bbfcc007e213faab6-772a658508f4465d8c1ef039f5bcaa67 received from {username='slave'} at 127.0.0.1:35278
I20260709 13:08:03.231690 30561 tablet_copy_service.cc:434] P 092f6eb694fc4bbeab49677cccd880fd: ending tablet copy session cd669586cff44d4bbfcc007e213faab6-772a658508f4465d8c1ef039f5bcaa67 on tablet 772a658508f4465d8c1ef039f5bcaa67 with peer cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:03.253651 31293 tablet_bootstrap.cc:492] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:03.254606 31293 tablet_bootstrap.cc:492] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6: Bootstrap complete.
I20260709 13:08:03.255419 31293 ts_tablet_manager.cc:1403] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6: Time spent bootstrapping tablet: real 0.085s	user 0.022s	sys 0.011s
I20260709 13:08:03.259421 31293 raft_consensus.cc:359] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:03.260319 31293 raft_consensus.cc:740] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Initialized, Role: LEARNER
I20260709 13:08:03.260988 31293 consensus_queue.cc:260] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:03.270327 31293 ts_tablet_manager.cc:1434] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:08:03.278566 30561 tablet_copy_service.cc:342] P 092f6eb694fc4bbeab49677cccd880fd: Request end of tablet copy session cd669586cff44d4bbfcc007e213faab6-7c9861593ab94f7792fdd702f1d9a483 received from {username='slave'} at 127.0.0.1:35278
I20260709 13:08:03.279011 30561 tablet_copy_service.cc:434] P 092f6eb694fc4bbeab49677cccd880fd: ending tablet copy session cd669586cff44d4bbfcc007e213faab6-7c9861593ab94f7792fdd702f1d9a483 on tablet 7c9861593ab94f7792fdd702f1d9a483 with peer cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:03.302740 31285 tablet_bootstrap.cc:492] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:03.310990 31285 tablet_bootstrap.cc:492] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6: Bootstrap complete.
I20260709 13:08:03.311758 31285 ts_tablet_manager.cc:1403] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6: Time spent bootstrapping tablet: real 0.105s	user 0.022s	sys 0.001s
I20260709 13:08:03.317236 31285 raft_consensus.cc:359] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:03.318037 31285 raft_consensus.cc:740] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Initialized, Role: LEARNER
I20260709 13:08:03.318857 31285 consensus_queue.cc:260] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:03.328167 31285 ts_tablet_manager.cc:1434] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.003s
I20260709 13:08:03.330312 30486 tablet_copy_service.cc:342] P f639301059e24dc5b0d88a46dc683326: Request end of tablet copy session cd669586cff44d4bbfcc007e213faab6-5302637c04824f67b70df2f3ee95c130 received from {username='slave'} at 127.0.0.1:60026
I20260709 13:08:03.330737 30486 tablet_copy_service.cc:434] P f639301059e24dc5b0d88a46dc683326: ending tablet copy session cd669586cff44d4bbfcc007e213faab6-5302637c04824f67b70df2f3ee95c130 on tablet 5302637c04824f67b70df2f3ee95c130 with peer cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:03.389243 31149 raft_consensus.cc:1217] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:03.601804 31149 raft_consensus.cc:1217] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:03.641554 31149 raft_consensus.cc:1217] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:03.668954 31149 raft_consensus.cc:1217] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:03.936553 31301 raft_consensus.cc:1064] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd: attempting to promote NON_VOTER cd669586cff44d4bbfcc007e213faab6 to VOTER
I20260709 13:08:03.939016 31301 consensus_queue.cc:237] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:03.957701 31149 raft_consensus.cc:1275] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:03.959651 30623 raft_consensus.cc:1275] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:03.961135 30467 raft_consensus.cc:1275] T 0c27ff7cbfd647edb6f31aac3e234914 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:03.963423 31305 consensus_queue.cc:1048] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:03.964624 31292 consensus_queue.cc:1048] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:03.967788 31301 consensus_queue.cc:1048] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:04.015245 31305 raft_consensus.cc:2955] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:04.018066 30624 raft_consensus.cc:2955] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:04.025252 30473 raft_consensus.cc:2955] T 0c27ff7cbfd647edb6f31aac3e234914 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:04.038676 30371 catalog_manager.cc:5697] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:04.039379 31149 raft_consensus.cc:2955] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:04.081651 30549 consensus_queue.cc:237] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:04.102396 31301 raft_consensus.cc:1064] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd: attempting to promote NON_VOTER cd669586cff44d4bbfcc007e213faab6 to VOTER
I20260709 13:08:04.104866 31301 consensus_queue.cc:237] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:04.107678 31149 raft_consensus.cc:1275] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:04.108134 30624 raft_consensus.cc:1275] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:04.109185 31305 consensus_queue.cc:1048] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:04.110024 31292 consensus_queue.cc:1048] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:04.120045 31252 raft_consensus.cc:2955] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:04.145330 31149 raft_consensus.cc:1275] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:04.151897 30473 raft_consensus.cc:1275] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:04.155476 31301 consensus_queue.cc:1048] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:04.168501 30624 raft_consensus.cc:1275] T 772a658508f4465d8c1ef039f5bcaa67 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:04.169732 30623 raft_consensus.cc:2955] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:04.201998 31292 consensus_queue.cc:1048] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:04.207252 31149 raft_consensus.cc:2955] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:04.220644 31303 raft_consensus.cc:1064] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326: attempting to promote NON_VOTER cd669586cff44d4bbfcc007e213faab6 to VOTER
I20260709 13:08:04.231673 30373 catalog_manager.cc:5697] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: config changed from index 3 to 4, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:04.223276 31303 consensus_queue.cc:237] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:04.248728 30464 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c27ff7cbfd647edb6f31aac3e234914 with delete_type TABLET_DATA_TOMBSTONED (TS f639301059e24dc5b0d88a46dc683326 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53858
I20260709 13:08:04.247737 31292 consensus_queue.cc:1048] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:04.258364 30359 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0c27ff7cbfd647edb6f31aac3e234914 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:04.262856 31318 tablet_replica.cc:333] T 0c27ff7cbfd647edb6f31aac3e234914 P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:08:04.263989 31318 raft_consensus.cc:2243] T 0c27ff7cbfd647edb6f31aac3e234914 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.273768 31318 raft_consensus.cc:2272] T 0c27ff7cbfd647edb6f31aac3e234914 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.290431 31318 ts_tablet_manager.cc:1916] T 0c27ff7cbfd647edb6f31aac3e234914 P f639301059e24dc5b0d88a46dc683326: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:04.292507 31315 raft_consensus.cc:1064] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd: attempting to promote NON_VOTER cd669586cff44d4bbfcc007e213faab6 to VOTER
I20260709 13:08:04.295039 31315 consensus_queue.cc:237] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:04.311092 31149 raft_consensus.cc:1275] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:04.312668 31031 consensus_queue.cc:1048] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:04.317312 30624 raft_consensus.cc:1275] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:04.320123 30546 raft_consensus.cc:1275] T 5302637c04824f67b70df2f3ee95c130 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:04.321825 31304 consensus_queue.cc:1048] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:04.321269 31305 raft_consensus.cc:2955] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:04.323622 31304 consensus_queue.cc:1048] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:04.340128 30473 raft_consensus.cc:2955] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:04.369050 30373 catalog_manager.cc:5697] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:04.371999 31151 raft_consensus.cc:2955] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:04.392846 30623 raft_consensus.cc:2955] T 772a658508f4465d8c1ef039f5bcaa67 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:04.393463 30549 consensus_queue.cc:237] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:04.399691 30624 raft_consensus.cc:2955] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:04.432967 31151 raft_consensus.cc:1275] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:04.400180 31303 raft_consensus.cc:2955] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:04.461745 31149 raft_consensus.cc:2955] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:04.473145 30473 raft_consensus.cc:1275] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:04.474748 31330 consensus_queue.cc:1048] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:04.485518 31318 ts_tablet_manager.cc:1929] T 0c27ff7cbfd647edb6f31aac3e234914 P f639301059e24dc5b0d88a46dc683326: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:04.485954 31318 log.cc:1199] T 0c27ff7cbfd647edb6f31aac3e234914 P f639301059e24dc5b0d88a46dc683326: Deleting WAL directory at /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-0-root/wals/0c27ff7cbfd647edb6f31aac3e234914
I20260709 13:08:04.487483 30361 catalog_manager.cc:5028] TS f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): tablet 0c27ff7cbfd647edb6f31aac3e234914 (table test-workload [id=887057791fed41a884abbab3e8d4b49f]) successfully deleted
W20260709 13:08:04.498202 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 102355us
I20260709 13:08:04.512569 31151 raft_consensus.cc:1275] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:04.521977 30624 raft_consensus.cc:1275] T 7c9861593ab94f7792fdd702f1d9a483 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:04.525148 31305 consensus_queue.cc:1048] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:04.526372 31329 consensus_queue.cc:1048] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:04.521986 30473 raft_consensus.cc:1275] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:04.582855 30370 catalog_manager.cc:5697] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:04.591610 31252 consensus_queue.cc:1048] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:04.603049 30546 raft_consensus.cc:2955] T 5302637c04824f67b70df2f3ee95c130 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
W20260709 13:08:04.618196 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 92283.2us
I20260709 13:08:04.635844 31252 raft_consensus.cc:2955] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:04.651595 31330 consensus_queue.cc:1048] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:04.682857 31151 raft_consensus.cc:2955] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:04.708199 30467 raft_consensus.cc:2955] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:04.712738 30473 consensus_queue.cc:237] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:04.732007 31149 raft_consensus.cc:1275] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:04.732007 30624 raft_consensus.cc:1275] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:04.751750 31031 consensus_queue.cc:1048] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:08:04.752604 30359 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 772a658508f4465d8c1ef039f5bcaa67 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:04.764835 30373 catalog_manager.cc:5697] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: config changed from index 3 to 4, VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) evicted. New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:04.768450 31303 consensus_queue.cc:1048] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:04.771984 31305 raft_consensus.cc:2955] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:04.780993 31149 raft_consensus.cc:2955] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:04.787345 30617 raft_consensus.cc:2955] T 7c9861593ab94f7792fdd702f1d9a483 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:04.808339 31303 raft_consensus.cc:2955] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:04.825495 30370 catalog_manager.cc:5697] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:04.832685 30624 raft_consensus.cc:2955] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:04.838735 30361 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5302637c04824f67b70df2f3ee95c130 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:04.856549 30612 tablet_service.cc:1558] Processing DeleteTablet for tablet 772a658508f4465d8c1ef039f5bcaa67 with delete_type TABLET_DATA_TOMBSTONED (TS fe2b7d73f8c743c1ba570cfd981c4e79 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36118
I20260709 13:08:04.878841 31151 raft_consensus.cc:2955] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:04.887070 30374 catalog_manager.cc:5697] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: config changed from index 3 to 4, VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) evicted. New cstate: current_term: 1 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:04.909312 31338 tablet_replica.cc:333] T 772a658508f4465d8c1ef039f5bcaa67 P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
W20260709 13:08:04.913416 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 98646.3us
I20260709 13:08:04.925869 31338 raft_consensus.cc:2243] T 772a658508f4465d8c1ef039f5bcaa67 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.926790 31338 raft_consensus.cc:2272] T 772a658508f4465d8c1ef039f5bcaa67 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.932480 31338 ts_tablet_manager.cc:1916] T 772a658508f4465d8c1ef039f5bcaa67 P fe2b7d73f8c743c1ba570cfd981c4e79: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:04.939481 30541 tablet_service.cc:1558] Processing DeleteTablet for tablet 5302637c04824f67b70df2f3ee95c130 with delete_type TABLET_DATA_TOMBSTONED (TS 092f6eb694fc4bbeab49677cccd880fd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43082
I20260709 13:08:04.944242 30546 consensus_queue.cc:237] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:04.948586 31339 tablet_replica.cc:333] T 5302637c04824f67b70df2f3ee95c130 P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:08:04.952348 31151 raft_consensus.cc:1275] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:04.953938 31305 consensus_queue.cc:1048] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:04.953368 31339 raft_consensus.cc:2243] T 5302637c04824f67b70df2f3ee95c130 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.006735 31339 raft_consensus.cc:2272] T 5302637c04824f67b70df2f3ee95c130 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.966238 30470 raft_consensus.cc:2955] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:05.020891 30473 raft_consensus.cc:1275] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:05.032054 31339 ts_tablet_manager.cc:1916] T 5302637c04824f67b70df2f3ee95c130 P 092f6eb694fc4bbeab49677cccd880fd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:05.032786 31305 raft_consensus.cc:2955] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:05.034073 31151 raft_consensus.cc:2955] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:05.048122 30374 catalog_manager.cc:5697] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: config changed from index 3 to 4, VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) evicted. New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:05.051123 30359 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7c9861593ab94f7792fdd702f1d9a483 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:05.039487 31338 ts_tablet_manager.cc:1929] T 772a658508f4465d8c1ef039f5bcaa67 P fe2b7d73f8c743c1ba570cfd981c4e79: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:05.059890 31338 log.cc:1199] T 772a658508f4465d8c1ef039f5bcaa67 P fe2b7d73f8c743c1ba570cfd981c4e79: Deleting WAL directory at /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-2-root/wals/772a658508f4465d8c1ef039f5bcaa67
I20260709 13:08:05.063056 30360 catalog_manager.cc:5028] TS fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): tablet 772a658508f4465d8c1ef039f5bcaa67 (table test-workload [id=887057791fed41a884abbab3e8d4b49f]) successfully deleted
I20260709 13:08:05.065281 30612 tablet_service.cc:1558] Processing DeleteTablet for tablet 7c9861593ab94f7792fdd702f1d9a483 with delete_type TABLET_DATA_TOMBSTONED (TS fe2b7d73f8c743c1ba570cfd981c4e79 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36118
I20260709 13:08:05.072391 31338 tablet_replica.cc:333] T 7c9861593ab94f7792fdd702f1d9a483 P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:08:05.073355 31338 raft_consensus.cc:2243] T 7c9861593ab94f7792fdd702f1d9a483 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:05.082085 31252 consensus_queue.cc:1048] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:05.074095 31338 raft_consensus.cc:2272] T 7c9861593ab94f7792fdd702f1d9a483 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:05.088213 31338 ts_tablet_manager.cc:1916] T 7c9861593ab94f7792fdd702f1d9a483 P fe2b7d73f8c743c1ba570cfd981c4e79: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:05.091857 31339 ts_tablet_manager.cc:1929] T 5302637c04824f67b70df2f3ee95c130 P 092f6eb694fc4bbeab49677cccd880fd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:05.092331 31339 log.cc:1199] T 5302637c04824f67b70df2f3ee95c130 P 092f6eb694fc4bbeab49677cccd880fd: Deleting WAL directory at /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-1-root/wals/5302637c04824f67b70df2f3ee95c130
I20260709 13:08:05.094821 30359 catalog_manager.cc:5028] TS 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): tablet 5302637c04824f67b70df2f3ee95c130 (table test-workload [id=887057791fed41a884abbab3e8d4b49f]) successfully deleted
I20260709 13:08:05.102360 31338 ts_tablet_manager.cc:1929] T 7c9861593ab94f7792fdd702f1d9a483 P fe2b7d73f8c743c1ba570cfd981c4e79: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:05.102866 31338 log.cc:1199] T 7c9861593ab94f7792fdd702f1d9a483 P fe2b7d73f8c743c1ba570cfd981c4e79: Deleting WAL directory at /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-2-root/wals/7c9861593ab94f7792fdd702f1d9a483
I20260709 13:08:05.105494 30360 catalog_manager.cc:5028] TS fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): tablet 7c9861593ab94f7792fdd702f1d9a483 (table test-workload [id=887057791fed41a884abbab3e8d4b49f]) successfully deleted
I20260709 13:08:05.107620 30473 raft_consensus.cc:2955] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:06.133561 30551 consensus_queue.cc:237] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
W20260709 13:08:06.142499 30516 consensus_peers.cc:597] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd -> Peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453): Couldn't send request to peer cd669586cff44d4bbfcc007e213faab6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa9b623a9a0446ca90b350e140072cb4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:06.143515 30470 raft_consensus.cc:1275] T aa9b623a9a0446ca90b350e140072cb4 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:06.144256 30617 raft_consensus.cc:1275] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:06.145591 31340 consensus_queue.cc:1048] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:06.146797 31331 consensus_queue.cc:1048] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:06.158455 31252 raft_consensus.cc:2955] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:06.160175 30473 raft_consensus.cc:2955] T aa9b623a9a0446ca90b350e140072cb4 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:06.163280 30617 raft_consensus.cc:2955] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:06.180245 30373 catalog_manager.cc:5697] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:06.209935 30551 consensus_queue.cc:237] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:06.228099 30619 raft_consensus.cc:1275] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:06.229696 30516 consensus_peers.cc:597] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd -> Peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453): Couldn't send request to peer cd669586cff44d4bbfcc007e213faab6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dfc9f90b82b84a8cb47cbee7adb0401a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:06.231923 31305 consensus_queue.cc:1048] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:06.232378 30473 raft_consensus.cc:1275] T dfc9f90b82b84a8cb47cbee7adb0401a P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:06.237514 31252 consensus_queue.cc:1048] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:06.260411 31344 raft_consensus.cc:2955] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:06.261842 30620 raft_consensus.cc:2955] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:06.286046 30374 catalog_manager.cc:5697] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:06.298677 30470 consensus_queue.cc:237] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:06.302588 30467 raft_consensus.cc:2955] T dfc9f90b82b84a8cb47cbee7adb0401a P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:06.342465 30619 raft_consensus.cc:1275] T 85088611c7e34066afbf929fc1cbe50d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:06.344439 30441 consensus_peers.cc:597] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 -> Peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453): Couldn't send request to peer cd669586cff44d4bbfcc007e213faab6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 85088611c7e34066afbf929fc1cbe50d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:06.345564 30551 raft_consensus.cc:1275] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:06.348278 31337 consensus_queue.cc:1048] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:06.350086 31337 consensus_queue.cc:1048] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:06.365505 31337 raft_consensus.cc:2955] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:06.369707 30620 raft_consensus.cc:2955] T 85088611c7e34066afbf929fc1cbe50d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:06.378508 30546 raft_consensus.cc:2955] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:06.384222 30617 consensus_queue.cc:237] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:06.388609 30374 catalog_manager.cc:5697] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 reported cstate change: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New cstate: current_term: 1 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:06.411494 30590 consensus_peers.cc:597] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453): Couldn't send request to peer cd669586cff44d4bbfcc007e213faab6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a0273ed018424f3a9529e09669fdb7b0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:06.411849 30546 raft_consensus.cc:1275] T a0273ed018424f3a9529e09669fdb7b0 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:06.413435 31327 consensus_queue.cc:1048] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:06.424347 30470 raft_consensus.cc:1275] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:06.425858 31327 consensus_queue.cc:1048] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:06.431361 31333 raft_consensus.cc:2955] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:06.433064 30546 raft_consensus.cc:2955] T a0273ed018424f3a9529e09669fdb7b0 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:06.449136 30373 catalog_manager.cc:5697] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New cstate: current_term: 1 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:06.461385 30470 raft_consensus.cc:2955] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:06.624914 31362 ts_tablet_manager.cc:933] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6: Initiating tablet copy from peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:06.633872 31362 tablet_copy_client.cc:323] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Beginning tablet copy session from remote peer at address 127.28.173.2:34733
I20260709 13:08:06.636142 30561 tablet_copy_service.cc:140] P 092f6eb694fc4bbeab49677cccd880fd: Received BeginTabletCopySession request for tablet aa9b623a9a0446ca90b350e140072cb4 from peer cd669586cff44d4bbfcc007e213faab6 ({username='slave'} at 127.0.0.1:35278)
I20260709 13:08:06.636765 30561 tablet_copy_service.cc:161] P 092f6eb694fc4bbeab49677cccd880fd: Beginning new tablet copy session on tablet aa9b623a9a0446ca90b350e140072cb4 from peer cd669586cff44d4bbfcc007e213faab6 at {username='slave'} at 127.0.0.1:35278: session id = cd669586cff44d4bbfcc007e213faab6-aa9b623a9a0446ca90b350e140072cb4
I20260709 13:08:06.645825 30561 tablet_copy_source_session.cc:215] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:06.650777 31362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa9b623a9a0446ca90b350e140072cb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:06.666105 31362 tablet_copy_client.cc:806] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:06.666741 31362 tablet_copy_client.cc:670] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:06.671156 31362 tablet_copy_client.cc:538] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:06.680962 31362 tablet_bootstrap.cc:492] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6: Bootstrap starting.
I20260709 13:08:06.706540 31362 tablet_bootstrap.cc:492] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:06.707414 31362 tablet_bootstrap.cc:492] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6: Bootstrap complete.
I20260709 13:08:06.708078 31362 ts_tablet_manager.cc:1403] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6: Time spent bootstrapping tablet: real 0.027s	user 0.020s	sys 0.003s
I20260709 13:08:06.711318 31362 raft_consensus.cc:359] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:06.712261 31362 raft_consensus.cc:740] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Initialized, Role: LEARNER
I20260709 13:08:06.713847 31362 consensus_queue.cc:260] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:06.720197 31362 ts_tablet_manager.cc:1434] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.002s
I20260709 13:08:06.728487 30561 tablet_copy_service.cc:342] P 092f6eb694fc4bbeab49677cccd880fd: Request end of tablet copy session cd669586cff44d4bbfcc007e213faab6-aa9b623a9a0446ca90b350e140072cb4 received from {username='slave'} at 127.0.0.1:35278
I20260709 13:08:06.728940 30561 tablet_copy_service.cc:434] P 092f6eb694fc4bbeab49677cccd880fd: ending tablet copy session cd669586cff44d4bbfcc007e213faab6-aa9b623a9a0446ca90b350e140072cb4 on tablet aa9b623a9a0446ca90b350e140072cb4 with peer cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:06.746804 31362 ts_tablet_manager.cc:933] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6: Initiating tablet copy from peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133)
I20260709 13:08:06.765364 31362 tablet_copy_client.cc:323] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6: tablet copy: Beginning tablet copy session from remote peer at address 127.28.173.1:43133
I20260709 13:08:06.767455 30486 tablet_copy_service.cc:140] P f639301059e24dc5b0d88a46dc683326: Received BeginTabletCopySession request for tablet 85088611c7e34066afbf929fc1cbe50d from peer cd669586cff44d4bbfcc007e213faab6 ({username='slave'} at 127.0.0.1:60026)
I20260709 13:08:06.768056 30486 tablet_copy_service.cc:161] P f639301059e24dc5b0d88a46dc683326: Beginning new tablet copy session on tablet 85088611c7e34066afbf929fc1cbe50d from peer cd669586cff44d4bbfcc007e213faab6 at {username='slave'} at 127.0.0.1:60026: session id = cd669586cff44d4bbfcc007e213faab6-85088611c7e34066afbf929fc1cbe50d
I20260709 13:08:06.775350 30486 tablet_copy_source_session.cc:215] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:06.778673 31362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85088611c7e34066afbf929fc1cbe50d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:06.812381 31362 tablet_copy_client.cc:806] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:06.812809 31367 ts_tablet_manager.cc:933] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6: Initiating tablet copy from peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:06.813268 31362 tablet_copy_client.cc:670] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:06.817564 31362 tablet_copy_client.cc:538] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:06.830461 31362 tablet_bootstrap.cc:492] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6: Bootstrap starting.
I20260709 13:08:06.871381 31367 tablet_copy_client.cc:323] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6: tablet copy: Beginning tablet copy session from remote peer at address 127.28.173.2:34733
I20260709 13:08:06.873205 30561 tablet_copy_service.cc:140] P 092f6eb694fc4bbeab49677cccd880fd: Received BeginTabletCopySession request for tablet dfc9f90b82b84a8cb47cbee7adb0401a from peer cd669586cff44d4bbfcc007e213faab6 ({username='slave'} at 127.0.0.1:35278)
I20260709 13:08:06.873759 30561 tablet_copy_service.cc:161] P 092f6eb694fc4bbeab49677cccd880fd: Beginning new tablet copy session on tablet dfc9f90b82b84a8cb47cbee7adb0401a from peer cd669586cff44d4bbfcc007e213faab6 at {username='slave'} at 127.0.0.1:35278: session id = cd669586cff44d4bbfcc007e213faab6-dfc9f90b82b84a8cb47cbee7adb0401a
I20260709 13:08:06.879142 31362 tablet_bootstrap.cc:492] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:06.881018 30561 tablet_copy_source_session.cc:215] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:06.881294 31362 tablet_bootstrap.cc:492] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6: Bootstrap complete.
I20260709 13:08:06.883116 31362 ts_tablet_manager.cc:1403] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6: Time spent bootstrapping tablet: real 0.053s	user 0.032s	sys 0.012s
I20260709 13:08:06.884586 31367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfc9f90b82b84a8cb47cbee7adb0401a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:06.886132 31362 raft_consensus.cc:359] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:06.887955 31362 raft_consensus.cc:740] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Initialized, Role: LEARNER
I20260709 13:08:06.888660 31362 consensus_queue.cc:260] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:06.891510 31362 ts_tablet_manager.cc:1434] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 13:08:06.893473 30486 tablet_copy_service.cc:342] P f639301059e24dc5b0d88a46dc683326: Request end of tablet copy session cd669586cff44d4bbfcc007e213faab6-85088611c7e34066afbf929fc1cbe50d received from {username='slave'} at 127.0.0.1:60026
I20260709 13:08:06.893904 30486 tablet_copy_service.cc:434] P f639301059e24dc5b0d88a46dc683326: ending tablet copy session cd669586cff44d4bbfcc007e213faab6-85088611c7e34066afbf929fc1cbe50d on tablet 85088611c7e34066afbf929fc1cbe50d with peer cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:06.905731 31367 tablet_copy_client.cc:806] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:06.906390 31367 tablet_copy_client.cc:670] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:06.919936 31367 tablet_copy_client.cc:538] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:06.928316 31367 tablet_bootstrap.cc:492] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6: Bootstrap starting.
I20260709 13:08:06.950465 31367 tablet_bootstrap.cc:492] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:06.951298 31367 tablet_bootstrap.cc:492] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6: Bootstrap complete.
I20260709 13:08:06.951944 31367 ts_tablet_manager.cc:1403] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6: Time spent bootstrapping tablet: real 0.024s	user 0.021s	sys 0.000s
I20260709 13:08:06.956152 31367 raft_consensus.cc:359] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:06.957419 31367 raft_consensus.cc:740] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Initialized, Role: LEARNER
I20260709 13:08:06.958554 31367 consensus_queue.cc:260] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:06.961081 31367 ts_tablet_manager.cc:1434] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:08:06.964267 30561 tablet_copy_service.cc:342] P 092f6eb694fc4bbeab49677cccd880fd: Request end of tablet copy session cd669586cff44d4bbfcc007e213faab6-dfc9f90b82b84a8cb47cbee7adb0401a received from {username='slave'} at 127.0.0.1:35278
I20260709 13:08:06.964651 30561 tablet_copy_service.cc:434] P 092f6eb694fc4bbeab49677cccd880fd: ending tablet copy session cd669586cff44d4bbfcc007e213faab6-dfc9f90b82b84a8cb47cbee7adb0401a on tablet dfc9f90b82b84a8cb47cbee7adb0401a with peer cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:07.015319 31367 ts_tablet_manager.cc:933] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6: Initiating tablet copy from peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:07.017019 31367 tablet_copy_client.cc:323] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Beginning tablet copy session from remote peer at address 127.28.173.3:32851
I20260709 13:08:07.019236 30635 tablet_copy_service.cc:140] P fe2b7d73f8c743c1ba570cfd981c4e79: Received BeginTabletCopySession request for tablet a0273ed018424f3a9529e09669fdb7b0 from peer cd669586cff44d4bbfcc007e213faab6 ({username='slave'} at 127.0.0.1:57140)
I20260709 13:08:07.019761 30635 tablet_copy_service.cc:161] P fe2b7d73f8c743c1ba570cfd981c4e79: Beginning new tablet copy session on tablet a0273ed018424f3a9529e09669fdb7b0 from peer cd669586cff44d4bbfcc007e213faab6 at {username='slave'} at 127.0.0.1:57140: session id = cd669586cff44d4bbfcc007e213faab6-a0273ed018424f3a9529e09669fdb7b0
I20260709 13:08:07.026909 31149 raft_consensus.cc:1217] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:07.040408 30635 tablet_copy_source_session.cc:215] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:07.051358 31367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0273ed018424f3a9529e09669fdb7b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:07.069641 31367 tablet_copy_client.cc:806] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:07.070310 31367 tablet_copy_client.cc:670] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:07.073945 31367 tablet_copy_client.cc:538] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:07.083604 31367 tablet_bootstrap.cc:492] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6: Bootstrap starting.
I20260709 13:08:07.106716 31367 tablet_bootstrap.cc:492] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:07.107669 31367 tablet_bootstrap.cc:492] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6: Bootstrap complete.
I20260709 13:08:07.108752 31367 ts_tablet_manager.cc:1403] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6: Time spent bootstrapping tablet: real 0.025s	user 0.025s	sys 0.000s
I20260709 13:08:07.113425 31367 raft_consensus.cc:359] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:07.114719 31367 raft_consensus.cc:740] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Initialized, Role: LEARNER
I20260709 13:08:07.115417 31367 consensus_queue.cc:260] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:07.121445 31367 ts_tablet_manager.cc:1434] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.004s
I20260709 13:08:07.123163 30635 tablet_copy_service.cc:342] P fe2b7d73f8c743c1ba570cfd981c4e79: Request end of tablet copy session cd669586cff44d4bbfcc007e213faab6-a0273ed018424f3a9529e09669fdb7b0 received from {username='slave'} at 127.0.0.1:57140
I20260709 13:08:07.123584 30635 tablet_copy_service.cc:434] P fe2b7d73f8c743c1ba570cfd981c4e79: ending tablet copy session cd669586cff44d4bbfcc007e213faab6-a0273ed018424f3a9529e09669fdb7b0 on tablet a0273ed018424f3a9529e09669fdb7b0 with peer cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:07.267084 31149 raft_consensus.cc:1217] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:07.340526 31149 raft_consensus.cc:1217] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:07.506068 31149 raft_consensus.cc:1217] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:07.567898 31340 raft_consensus.cc:1064] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd: attempting to promote NON_VOTER cd669586cff44d4bbfcc007e213faab6 to VOTER
I20260709 13:08:07.570303 31340 consensus_queue.cc:237] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:07.576411 31149 raft_consensus.cc:1275] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:07.576607 30620 raft_consensus.cc:1275] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:07.577751 31344 consensus_queue.cc:1048] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:07.579363 30467 raft_consensus.cc:1275] T aa9b623a9a0446ca90b350e140072cb4 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:07.580139 31340 consensus_queue.cc:1048] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:07.581602 31344 consensus_queue.cc:1048] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:07.594708 31344 raft_consensus.cc:2955] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:07.597635 30467 raft_consensus.cc:2955] T aa9b623a9a0446ca90b350e140072cb4 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:07.597365 30620 raft_consensus.cc:2955] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:07.618175 31149 raft_consensus.cc:2955] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:07.647351 30370 catalog_manager.cc:5697] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:07.666260 31379 raft_consensus.cc:1064] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd: attempting to promote NON_VOTER cd669586cff44d4bbfcc007e213faab6 to VOTER
I20260709 13:08:07.672845 31379 consensus_queue.cc:237] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:07.689682 31149 raft_consensus.cc:1275] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:07.691665 31344 consensus_queue.cc:1048] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:07.697095 30467 raft_consensus.cc:1275] T dfc9f90b82b84a8cb47cbee7adb0401a P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:07.698251 30619 raft_consensus.cc:1275] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:07.699004 31340 consensus_queue.cc:1048] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:07.700408 31379 consensus_queue.cc:1048] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:07.721916 31380 raft_consensus.cc:2955] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:07.724573 30470 raft_consensus.cc:2955] T dfc9f90b82b84a8cb47cbee7adb0401a P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:07.730512 30551 consensus_queue.cc:237] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:07.742458 30620 raft_consensus.cc:2955] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:07.748536 31149 raft_consensus.cc:2955] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:07.750227 30619 raft_consensus.cc:1275] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:07.751972 31380 consensus_queue.cc:1048] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:07.752941 31151 raft_consensus.cc:1275] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:07.756567 31305 consensus_queue.cc:1048] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:07.774003 30619 raft_consensus.cc:2955] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:07.763669 31379 raft_consensus.cc:2955] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:07.783550 30374 catalog_manager.cc:5697] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:07.765087 31151 raft_consensus.cc:2955] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:07.796836 30359 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet aa9b623a9a0446ca90b350e140072cb4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:07.800292 31353 raft_consensus.cc:1064] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326: attempting to promote NON_VOTER cd669586cff44d4bbfcc007e213faab6 to VOTER
I20260709 13:08:07.805142 31353 consensus_queue.cc:237] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:07.813586 30371 catalog_manager.cc:5697] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: config changed from index 3 to 4, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:07.816524 31151 raft_consensus.cc:1275] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:07.819543 30551 raft_consensus.cc:1275] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:07.820868 31337 consensus_queue.cc:1048] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:07.821630 30619 raft_consensus.cc:1275] T 85088611c7e34066afbf929fc1cbe50d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:07.822880 31353 consensus_queue.cc:1048] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:07.825016 31337 consensus_queue.cc:1048] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:07.834182 30464 tablet_service.cc:1558] Processing DeleteTablet for tablet aa9b623a9a0446ca90b350e140072cb4 with delete_type TABLET_DATA_TOMBSTONED (TS f639301059e24dc5b0d88a46dc683326 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53858
I20260709 13:08:07.836071 30551 consensus_queue.cc:237] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:07.846582 30620 raft_consensus.cc:1275] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:07.847843 31149 raft_consensus.cc:1275] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:07.849608 31389 consensus_queue.cc:1048] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:07.850442 31305 consensus_queue.cc:1048] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:07.846531 31393 tablet_replica.cc:333] T aa9b623a9a0446ca90b350e140072cb4 P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:08:07.852849 31393 raft_consensus.cc:2243] T aa9b623a9a0446ca90b350e140072cb4 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:07.853623 31393 raft_consensus.cc:2272] T aa9b623a9a0446ca90b350e140072cb4 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.854746 31031 raft_consensus.cc:2955] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:07.856185 30620 raft_consensus.cc:2955] T 85088611c7e34066afbf929fc1cbe50d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:07.867695 31380 raft_consensus.cc:2955] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:07.876219 31393 ts_tablet_manager.cc:1916] T aa9b623a9a0446ca90b350e140072cb4 P f639301059e24dc5b0d88a46dc683326: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:07.876348 31149 raft_consensus.cc:2955] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:07.876822 30619 raft_consensus.cc:2955] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:07.875349 30374 catalog_manager.cc:5697] T 85088611c7e34066afbf929fc1cbe50d P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:07.893805 30359 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dfc9f90b82b84a8cb47cbee7adb0401a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:07.879004 30546 raft_consensus.cc:2955] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:07.906709 30371 catalog_manager.cc:5697] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 reported cstate change: config changed from index 3 to 4, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:07.907835 31393 ts_tablet_manager.cc:1929] T aa9b623a9a0446ca90b350e140072cb4 P f639301059e24dc5b0d88a46dc683326: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:07.908336 31393 log.cc:1199] T aa9b623a9a0446ca90b350e140072cb4 P f639301059e24dc5b0d88a46dc683326: Deleting WAL directory at /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-0-root/wals/aa9b623a9a0446ca90b350e140072cb4
I20260709 13:08:07.924875 30361 catalog_manager.cc:5028] TS f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): tablet aa9b623a9a0446ca90b350e140072cb4 (table test-workload [id=887057791fed41a884abbab3e8d4b49f]) successfully deleted
I20260709 13:08:07.926972 31149 raft_consensus.cc:2955] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:07.936753 30464 tablet_service.cc:1558] Processing DeleteTablet for tablet dfc9f90b82b84a8cb47cbee7adb0401a with delete_type TABLET_DATA_TOMBSTONED (TS f639301059e24dc5b0d88a46dc683326 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53858
I20260709 13:08:07.937584 31393 tablet_replica.cc:333] T dfc9f90b82b84a8cb47cbee7adb0401a P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:08:07.938618 31393 raft_consensus.cc:2243] T dfc9f90b82b84a8cb47cbee7adb0401a P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:07.939442 31393 raft_consensus.cc:2272] T dfc9f90b82b84a8cb47cbee7adb0401a P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:07.950477 31393 ts_tablet_manager.cc:1916] T dfc9f90b82b84a8cb47cbee7adb0401a P f639301059e24dc5b0d88a46dc683326: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:07.952193 31361 raft_consensus.cc:1064] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79: attempting to promote NON_VOTER cd669586cff44d4bbfcc007e213faab6 to VOTER
I20260709 13:08:07.954702 31361 consensus_queue.cc:237] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:08.036063 30470 consensus_queue.cc:237] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:08.036891 31393 ts_tablet_manager.cc:1929] T dfc9f90b82b84a8cb47cbee7adb0401a P f639301059e24dc5b0d88a46dc683326: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:08.037331 31393 log.cc:1199] T dfc9f90b82b84a8cb47cbee7adb0401a P f639301059e24dc5b0d88a46dc683326: Deleting WAL directory at /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-0-root/wals/dfc9f90b82b84a8cb47cbee7adb0401a
I20260709 13:08:08.041498 30546 raft_consensus.cc:1275] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:08.041885 30361 catalog_manager.cc:5028] TS f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): tablet dfc9f90b82b84a8cb47cbee7adb0401a (table test-workload [id=887057791fed41a884abbab3e8d4b49f]) successfully deleted
I20260709 13:08:08.044456 31149 raft_consensus.cc:1275] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:08.044837 31395 consensus_queue.cc:1048] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:08.049312 31396 consensus_queue.cc:1048] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:08.062258 31397 raft_consensus.cc:2955] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:08.070242 30551 raft_consensus.cc:1275] T a0273ed018424f3a9529e09669fdb7b0 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:08.071843 31373 consensus_queue.cc:1048] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:08.072853 31149 raft_consensus.cc:1275] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:08.074452 31361 consensus_queue.cc:1048] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:08.072403 30546 raft_consensus.cc:2955] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:08.082675 31151 raft_consensus.cc:2955] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:08.099531 30373 catalog_manager.cc:5697] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: config changed from index 3 to 4, VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) evicted. New cstate: current_term: 1 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:08.105214 30470 raft_consensus.cc:1275] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:08.107190 31361 consensus_queue.cc:1048] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:08.109071 30361 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 85088611c7e34066afbf929fc1cbe50d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:08.118245 31373 raft_consensus.cc:2955] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:08.121522 30612 tablet_service.cc:1558] Processing DeleteTablet for tablet 85088611c7e34066afbf929fc1cbe50d with delete_type TABLET_DATA_TOMBSTONED (TS fe2b7d73f8c743c1ba570cfd981c4e79 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36118
I20260709 13:08:08.122110 31149 raft_consensus.cc:2955] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:08.133653 31402 tablet_replica.cc:333] T 85088611c7e34066afbf929fc1cbe50d P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:08:08.134917 31402 raft_consensus.cc:2243] T 85088611c7e34066afbf929fc1cbe50d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:08.153430 31402 raft_consensus.cc:2272] T 85088611c7e34066afbf929fc1cbe50d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.155611 30373 catalog_manager.cc:5697] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:08.162314 31402 ts_tablet_manager.cc:1916] T 85088611c7e34066afbf929fc1cbe50d P fe2b7d73f8c743c1ba570cfd981c4e79: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:08.163759 30470 raft_consensus.cc:2955] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:08.178591 31402 ts_tablet_manager.cc:1929] T 85088611c7e34066afbf929fc1cbe50d P fe2b7d73f8c743c1ba570cfd981c4e79: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:08.179126 31402 log.cc:1199] T 85088611c7e34066afbf929fc1cbe50d P fe2b7d73f8c743c1ba570cfd981c4e79: Deleting WAL directory at /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-2-root/wals/85088611c7e34066afbf929fc1cbe50d
I20260709 13:08:08.181384 30360 catalog_manager.cc:5028] TS fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): tablet 85088611c7e34066afbf929fc1cbe50d (table test-workload [id=887057791fed41a884abbab3e8d4b49f]) successfully deleted
I20260709 13:08:08.181301 30551 raft_consensus.cc:2955] T a0273ed018424f3a9529e09669fdb7b0 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:08.186506 30620 consensus_queue.cc:237] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:08.192309 31149 raft_consensus.cc:1275] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:08.193756 31404 consensus_queue.cc:1048] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:08.195176 30470 raft_consensus.cc:1275] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:08.198768 31404 consensus_queue.cc:1048] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:08:08.204074 31327 raft_consensus.cc:2955] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:08.205976 31149 raft_consensus.cc:2955] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:08.216019 30360 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a0273ed018424f3a9529e09669fdb7b0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:08.219421 30470 raft_consensus.cc:2955] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:08.226686 30373 catalog_manager.cc:5697] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: config changed from index 3 to 4, VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) evicted. New cstate: current_term: 1 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:08.243201 30541 tablet_service.cc:1558] Processing DeleteTablet for tablet a0273ed018424f3a9529e09669fdb7b0 with delete_type TABLET_DATA_TOMBSTONED (TS 092f6eb694fc4bbeab49677cccd880fd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43082
I20260709 13:08:08.246783 31406 tablet_replica.cc:333] T a0273ed018424f3a9529e09669fdb7b0 P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:08:08.247855 31406 raft_consensus.cc:2243] T a0273ed018424f3a9529e09669fdb7b0 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:08.248667 31406 raft_consensus.cc:2272] T a0273ed018424f3a9529e09669fdb7b0 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.252068 31406 ts_tablet_manager.cc:1916] T a0273ed018424f3a9529e09669fdb7b0 P 092f6eb694fc4bbeab49677cccd880fd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:08.262923 31406 ts_tablet_manager.cc:1929] T a0273ed018424f3a9529e09669fdb7b0 P 092f6eb694fc4bbeab49677cccd880fd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:08.263239 31406 log.cc:1199] T a0273ed018424f3a9529e09669fdb7b0 P 092f6eb694fc4bbeab49677cccd880fd: Deleting WAL directory at /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-1-root/wals/a0273ed018424f3a9529e09669fdb7b0
I20260709 13:08:08.264743 30359 catalog_manager.cc:5028] TS 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): tablet a0273ed018424f3a9529e09669fdb7b0 (table test-workload [id=887057791fed41a884abbab3e8d4b49f]) successfully deleted
I20260709 13:08:09.311674 30617 consensus_queue.cc:237] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:09.318380 30549 raft_consensus.cc:1275] T 265fc568d5674c78833106e4eda814f4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:09.318907 30590 consensus_peers.cc:597] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453): Couldn't send request to peer cd669586cff44d4bbfcc007e213faab6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 265fc568d5674c78833106e4eda814f4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:09.319708 30473 raft_consensus.cc:1275] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:09.319769 31373 consensus_queue.cc:1048] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:09.321121 31404 consensus_queue.cc:1048] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:09.328919 31373 raft_consensus.cc:2955] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:09.329825 30473 raft_consensus.cc:2955] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:09.330420 30549 raft_consensus.cc:2955] T 265fc568d5674c78833106e4eda814f4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:09.345444 30370 catalog_manager.cc:5697] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 reported cstate change: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New cstate: current_term: 1 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:09.347407 30617 consensus_queue.cc:237] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:09.357372 30549 raft_consensus.cc:1275] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:09.358060 30590 consensus_peers.cc:597] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453): Couldn't send request to peer cd669586cff44d4bbfcc007e213faab6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 99c151771be541b19017860da4f7218d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:09.359395 31373 consensus_queue.cc:1048] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:09.366827 30470 raft_consensus.cc:1275] T 99c151771be541b19017860da4f7218d P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:09.368827 31373 consensus_queue.cc:1048] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:09.377561 31404 raft_consensus.cc:2955] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:09.379176 30549 raft_consensus.cc:2955] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:09.383421 30470 raft_consensus.cc:2955] T 99c151771be541b19017860da4f7218d P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:09.404358 30473 consensus_queue.cc:237] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:09.426216 30617 raft_consensus.cc:1275] T 8b8abe384b054cf09bfba7143adf03f1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:09.427172 30549 raft_consensus.cc:1275] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:09.428705 30441 consensus_peers.cc:597] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 -> Peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453): Couldn't send request to peer cd669586cff44d4bbfcc007e213faab6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8b8abe384b054cf09bfba7143adf03f1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:09.431136 31337 consensus_queue.cc:1048] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:09.433336 31337 consensus_queue.cc:1048] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:09.459626 31407 raft_consensus.cc:2955] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:09.462837 30549 raft_consensus.cc:2955] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:09.476863 30373 catalog_manager.cc:5697] T 99c151771be541b19017860da4f7218d P f639301059e24dc5b0d88a46dc683326 reported cstate change: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New cstate: current_term: 1 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:09.478266 30619 raft_consensus.cc:2955] T 8b8abe384b054cf09bfba7143adf03f1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:09.481985 30617 consensus_queue.cc:237] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
W20260709 13:08:09.501318 30590 consensus_peers.cc:597] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453): Couldn't send request to peer cd669586cff44d4bbfcc007e213faab6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 10b0408011914710a008d9e9b58f002c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:09.501520 30551 raft_consensus.cc:1275] T 10b0408011914710a008d9e9b58f002c P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:09.503026 31412 consensus_queue.cc:1048] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:09.503497 30473 raft_consensus.cc:1275] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:09.503595 30370 catalog_manager.cc:5697] T 8b8abe384b054cf09bfba7143adf03f1 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New cstate: current_term: 1 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:09.505237 31404 consensus_queue.cc:1048] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:09.540480 31373 raft_consensus.cc:2955] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:09.542098 30473 raft_consensus.cc:2955] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:09.548244 30551 raft_consensus.cc:2955] T 10b0408011914710a008d9e9b58f002c P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:09.560910 30370 catalog_manager.cc:5697] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 reported cstate change: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New cstate: current_term: 1 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:09.806910 31429 ts_tablet_manager.cc:933] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6: Initiating tablet copy from peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133)
I20260709 13:08:09.808905 31429 tablet_copy_client.cc:323] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Beginning tablet copy session from remote peer at address 127.28.173.1:43133
I20260709 13:08:09.810451 30486 tablet_copy_service.cc:140] P f639301059e24dc5b0d88a46dc683326: Received BeginTabletCopySession request for tablet 8b8abe384b054cf09bfba7143adf03f1 from peer cd669586cff44d4bbfcc007e213faab6 ({username='slave'} at 127.0.0.1:60026)
I20260709 13:08:09.810994 30486 tablet_copy_service.cc:161] P f639301059e24dc5b0d88a46dc683326: Beginning new tablet copy session on tablet 8b8abe384b054cf09bfba7143adf03f1 from peer cd669586cff44d4bbfcc007e213faab6 at {username='slave'} at 127.0.0.1:60026: session id = cd669586cff44d4bbfcc007e213faab6-8b8abe384b054cf09bfba7143adf03f1
I20260709 13:08:09.816756 30486 tablet_copy_source_session.cc:215] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:09.819587 31429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b8abe384b054cf09bfba7143adf03f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:09.833603 31429 tablet_copy_client.cc:806] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:09.834147 31429 tablet_copy_client.cc:670] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:09.840073 31429 tablet_copy_client.cc:538] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:09.849500 31429 tablet_bootstrap.cc:492] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6: Bootstrap starting.
I20260709 13:08:09.861234 31431 ts_tablet_manager.cc:933] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6: Initiating tablet copy from peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:09.867535 31431 tablet_copy_client.cc:323] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6: tablet copy: Beginning tablet copy session from remote peer at address 127.28.173.3:32851
I20260709 13:08:09.870230 30635 tablet_copy_service.cc:140] P fe2b7d73f8c743c1ba570cfd981c4e79: Received BeginTabletCopySession request for tablet 99c151771be541b19017860da4f7218d from peer cd669586cff44d4bbfcc007e213faab6 ({username='slave'} at 127.0.0.1:57140)
I20260709 13:08:09.870735 30635 tablet_copy_service.cc:161] P fe2b7d73f8c743c1ba570cfd981c4e79: Beginning new tablet copy session on tablet 99c151771be541b19017860da4f7218d from peer cd669586cff44d4bbfcc007e213faab6 at {username='slave'} at 127.0.0.1:57140: session id = cd669586cff44d4bbfcc007e213faab6-99c151771be541b19017860da4f7218d
I20260709 13:08:09.876935 30635 tablet_copy_source_session.cc:215] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:09.880522 31431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99c151771be541b19017860da4f7218d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:09.884781 31429 tablet_bootstrap.cc:492] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:09.888285 31429 tablet_bootstrap.cc:492] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6: Bootstrap complete.
I20260709 13:08:09.888959 31429 ts_tablet_manager.cc:1403] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6: Time spent bootstrapping tablet: real 0.040s	user 0.017s	sys 0.018s
I20260709 13:08:09.891932 31429 raft_consensus.cc:359] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:09.892743 31429 raft_consensus.cc:740] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Initialized, Role: LEARNER
I20260709 13:08:09.893364 31429 consensus_queue.cc:260] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:09.894640 31434 ts_tablet_manager.cc:933] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6: Initiating tablet copy from peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:09.905462 31434 tablet_copy_client.cc:323] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6: tablet copy: Beginning tablet copy session from remote peer at address 127.28.173.3:32851
I20260709 13:08:09.907692 30635 tablet_copy_service.cc:140] P fe2b7d73f8c743c1ba570cfd981c4e79: Received BeginTabletCopySession request for tablet 10b0408011914710a008d9e9b58f002c from peer cd669586cff44d4bbfcc007e213faab6 ({username='slave'} at 127.0.0.1:57140)
I20260709 13:08:09.908236 30635 tablet_copy_service.cc:161] P fe2b7d73f8c743c1ba570cfd981c4e79: Beginning new tablet copy session on tablet 10b0408011914710a008d9e9b58f002c from peer cd669586cff44d4bbfcc007e213faab6 at {username='slave'} at 127.0.0.1:57140: session id = cd669586cff44d4bbfcc007e213faab6-10b0408011914710a008d9e9b58f002c
I20260709 13:08:09.918324 30635 tablet_copy_source_session.cc:215] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:09.923835 31434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10b0408011914710a008d9e9b58f002c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:09.930059 31437 ts_tablet_manager.cc:933] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6: Initiating tablet copy from peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:09.937641 31429 ts_tablet_manager.cc:1434] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.031s
I20260709 13:08:09.939507 30486 tablet_copy_service.cc:342] P f639301059e24dc5b0d88a46dc683326: Request end of tablet copy session cd669586cff44d4bbfcc007e213faab6-8b8abe384b054cf09bfba7143adf03f1 received from {username='slave'} at 127.0.0.1:60026
I20260709 13:08:09.940033 30486 tablet_copy_service.cc:434] P f639301059e24dc5b0d88a46dc683326: ending tablet copy session cd669586cff44d4bbfcc007e213faab6-8b8abe384b054cf09bfba7143adf03f1 on tablet 8b8abe384b054cf09bfba7143adf03f1 with peer cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:09.942221 31437 tablet_copy_client.cc:323] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Beginning tablet copy session from remote peer at address 127.28.173.3:32851
I20260709 13:08:09.945305 30635 tablet_copy_service.cc:140] P fe2b7d73f8c743c1ba570cfd981c4e79: Received BeginTabletCopySession request for tablet 265fc568d5674c78833106e4eda814f4 from peer cd669586cff44d4bbfcc007e213faab6 ({username='slave'} at 127.0.0.1:57140)
I20260709 13:08:09.945799 30635 tablet_copy_service.cc:161] P fe2b7d73f8c743c1ba570cfd981c4e79: Beginning new tablet copy session on tablet 265fc568d5674c78833106e4eda814f4 from peer cd669586cff44d4bbfcc007e213faab6 at {username='slave'} at 127.0.0.1:57140: session id = cd669586cff44d4bbfcc007e213faab6-265fc568d5674c78833106e4eda814f4
I20260709 13:08:09.946250 31431 tablet_copy_client.cc:806] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:09.946978 31431 tablet_copy_client.cc:670] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:09.952461 31434 tablet_copy_client.cc:806] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:09.953040 31434 tablet_copy_client.cc:670] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:09.954955 31431 tablet_copy_client.cc:538] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:09.957738 30635 tablet_copy_source_session.cc:215] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:09.959406 31434 tablet_copy_client.cc:538] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:09.960505 31437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 265fc568d5674c78833106e4eda814f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:09.963322 31431 tablet_bootstrap.cc:492] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6: Bootstrap starting.
I20260709 13:08:09.968175 31434 tablet_bootstrap.cc:492] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6: Bootstrap starting.
I20260709 13:08:10.006531 31431 tablet_bootstrap.cc:492] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:10.007411 31431 tablet_bootstrap.cc:492] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6: Bootstrap complete.
I20260709 13:08:10.008853 31431 ts_tablet_manager.cc:1403] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6: Time spent bootstrapping tablet: real 0.046s	user 0.024s	sys 0.002s
I20260709 13:08:10.011775 31431 raft_consensus.cc:359] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:10.013576 31431 raft_consensus.cc:740] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Initialized, Role: LEARNER
I20260709 13:08:10.014621 31437 tablet_copy_client.cc:806] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:10.014215 31431 consensus_queue.cc:260] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:10.015153 31437 tablet_copy_client.cc:670] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:10.017043 31431 ts_tablet_manager.cc:1434] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.005s
I20260709 13:08:10.017197 31434 tablet_bootstrap.cc:492] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:10.019560 31434 tablet_bootstrap.cc:492] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6: Bootstrap complete.
I20260709 13:08:10.020258 31434 ts_tablet_manager.cc:1403] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6: Time spent bootstrapping tablet: real 0.052s	user 0.037s	sys 0.008s
I20260709 13:08:10.020334 30634 tablet_copy_service.cc:342] P fe2b7d73f8c743c1ba570cfd981c4e79: Request end of tablet copy session cd669586cff44d4bbfcc007e213faab6-99c151771be541b19017860da4f7218d received from {username='slave'} at 127.0.0.1:57140
I20260709 13:08:10.020799 30634 tablet_copy_service.cc:434] P fe2b7d73f8c743c1ba570cfd981c4e79: ending tablet copy session cd669586cff44d4bbfcc007e213faab6-99c151771be541b19017860da4f7218d on tablet 99c151771be541b19017860da4f7218d with peer cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:10.025357 31434 raft_consensus.cc:359] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:10.026193 31434 raft_consensus.cc:740] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Initialized, Role: LEARNER
I20260709 13:08:10.026822 31434 consensus_queue.cc:260] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:10.032866 31437 tablet_copy_client.cc:538] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:10.033478 31434 ts_tablet_manager.cc:1434] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:08:10.036227 30634 tablet_copy_service.cc:342] P fe2b7d73f8c743c1ba570cfd981c4e79: Request end of tablet copy session cd669586cff44d4bbfcc007e213faab6-10b0408011914710a008d9e9b58f002c received from {username='slave'} at 127.0.0.1:57140
I20260709 13:08:10.036598 30634 tablet_copy_service.cc:434] P fe2b7d73f8c743c1ba570cfd981c4e79: ending tablet copy session cd669586cff44d4bbfcc007e213faab6-10b0408011914710a008d9e9b58f002c on tablet 10b0408011914710a008d9e9b58f002c with peer cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:10.041484 31437 tablet_bootstrap.cc:492] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6: Bootstrap starting.
I20260709 13:08:10.060092 31437 tablet_bootstrap.cc:492] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:10.060916 31437 tablet_bootstrap.cc:492] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6: Bootstrap complete.
I20260709 13:08:10.061604 31437 ts_tablet_manager.cc:1403] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.004s
I20260709 13:08:10.067941 31437 raft_consensus.cc:359] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:10.068599 31437 raft_consensus.cc:740] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Initialized, Role: LEARNER
I20260709 13:08:10.069197 31437 consensus_queue.cc:260] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:10.071300 31437 ts_tablet_manager.cc:1434] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:08:10.074507 30634 tablet_copy_service.cc:342] P fe2b7d73f8c743c1ba570cfd981c4e79: Request end of tablet copy session cd669586cff44d4bbfcc007e213faab6-265fc568d5674c78833106e4eda814f4 received from {username='slave'} at 127.0.0.1:57140
I20260709 13:08:10.074913 30634 tablet_copy_service.cc:434] P fe2b7d73f8c743c1ba570cfd981c4e79: ending tablet copy session cd669586cff44d4bbfcc007e213faab6-265fc568d5674c78833106e4eda814f4 on tablet 265fc568d5674c78833106e4eda814f4 with peer cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:10.181814 31149 raft_consensus.cc:1217] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:10.346568 31149 raft_consensus.cc:1217] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:10.356611 31149 raft_consensus.cc:1217] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:10.446285 31149 raft_consensus.cc:1217] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:10.645280 31425 raft_consensus.cc:1064] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326: attempting to promote NON_VOTER cd669586cff44d4bbfcc007e213faab6 to VOTER
I20260709 13:08:10.647125 31425 consensus_queue.cc:237] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:10.652951 31149 raft_consensus.cc:1275] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:10.653724 30617 raft_consensus.cc:1275] T 8b8abe384b054cf09bfba7143adf03f1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:10.654188 31407 consensus_queue.cc:1048] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:10.655722 30551 raft_consensus.cc:1275] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:10.656288 31407 consensus_queue.cc:1048] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:10.662127 31407 consensus_queue.cc:1048] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:10.669930 31407 raft_consensus.cc:2955] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:10.671636 30619 raft_consensus.cc:2955] T 8b8abe384b054cf09bfba7143adf03f1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:10.676038 30551 raft_consensus.cc:2955] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:10.682022 31149 raft_consensus.cc:2955] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:10.688098 30370 catalog_manager.cc:5697] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 reported cstate change: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:10.718972 30470 consensus_queue.cc:237] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:10.725462 30551 raft_consensus.cc:1275] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:10.727663 31149 raft_consensus.cc:1275] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:10.727594 31407 consensus_queue.cc:1048] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:10.730382 31407 consensus_queue.cc:1048] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:10.736088 31337 raft_consensus.cc:2955] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:10.737501 31151 raft_consensus.cc:2955] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:10.742974 30361 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8b8abe384b054cf09bfba7143adf03f1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:10.754859 30371 catalog_manager.cc:5697] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: config changed from index 3 to 4, VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) evicted. New cstate: current_term: 1 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:10.758335 30551 raft_consensus.cc:2955] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:10.770298 30612 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b8abe384b054cf09bfba7143adf03f1 with delete_type TABLET_DATA_TOMBSTONED (TS fe2b7d73f8c743c1ba570cfd981c4e79 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36118
I20260709 13:08:10.796180 31452 tablet_replica.cc:333] T 8b8abe384b054cf09bfba7143adf03f1 P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:08:10.797150 31452 raft_consensus.cc:2243] T 8b8abe384b054cf09bfba7143adf03f1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:10.797887 31452 raft_consensus.cc:2272] T 8b8abe384b054cf09bfba7143adf03f1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:10.802122 31452 ts_tablet_manager.cc:1916] T 8b8abe384b054cf09bfba7143adf03f1 P fe2b7d73f8c743c1ba570cfd981c4e79: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:10.814849 31452 ts_tablet_manager.cc:1929] T 8b8abe384b054cf09bfba7143adf03f1 P fe2b7d73f8c743c1ba570cfd981c4e79: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:10.815188 31452 log.cc:1199] T 8b8abe384b054cf09bfba7143adf03f1 P fe2b7d73f8c743c1ba570cfd981c4e79: Deleting WAL directory at /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-2-root/wals/8b8abe384b054cf09bfba7143adf03f1
I20260709 13:08:10.816632 30360 catalog_manager.cc:5028] TS fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): tablet 8b8abe384b054cf09bfba7143adf03f1 (table test-workload [id=887057791fed41a884abbab3e8d4b49f]) successfully deleted
I20260709 13:08:10.819690 31412 raft_consensus.cc:1064] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79: attempting to promote NON_VOTER cd669586cff44d4bbfcc007e213faab6 to VOTER
I20260709 13:08:10.820544 31373 raft_consensus.cc:1064] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79: attempting to promote NON_VOTER cd669586cff44d4bbfcc007e213faab6 to VOTER
I20260709 13:08:10.822162 31412 consensus_queue.cc:237] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:10.822640 31373 consensus_queue.cc:237] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:10.828773 31149 raft_consensus.cc:1275] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:10.830801 30551 raft_consensus.cc:1275] T 265fc568d5674c78833106e4eda814f4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:10.831179 30473 raft_consensus.cc:1275] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:10.832257 31442 consensus_queue.cc:1048] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:10.844509 31455 consensus_queue.cc:1048] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:10.847913 31442 consensus_queue.cc:1048] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:10.870214 31151 raft_consensus.cc:1275] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:10.872629 31455 consensus_queue.cc:1048] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:08:10.902527 30548 raft_consensus.cc:1275] T 10b0408011914710a008d9e9b58f002c P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:10.904275 31459 consensus_queue.cc:1048] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:10.916838 30473 raft_consensus.cc:1275] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:10.918570 31459 raft_consensus.cc:1064] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79: attempting to promote NON_VOTER cd669586cff44d4bbfcc007e213faab6 to VOTER
I20260709 13:08:10.920862 31456 consensus_queue.cc:1048] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:10.921182 31459 consensus_queue.cc:237] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:10.929622 31457 raft_consensus.cc:2955] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:10.938138 30551 raft_consensus.cc:2955] T 265fc568d5674c78833106e4eda814f4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:10.944129 31149 raft_consensus.cc:2955] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:10.951581 30473 raft_consensus.cc:2955] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:10.956571 30371 catalog_manager.cc:5697] T 265fc568d5674c78833106e4eda814f4 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:10.967490 31149 raft_consensus.cc:1275] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:10.969125 31412 consensus_queue.cc:1048] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:10.968722 31455 raft_consensus.cc:2955] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:10.978637 30470 raft_consensus.cc:1275] T 99c151771be541b19017860da4f7218d P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:10.998652 31455 consensus_queue.cc:1048] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:10.998131 30467 raft_consensus.cc:2955] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:11.001222 30548 raft_consensus.cc:2955] T 10b0408011914710a008d9e9b58f002c P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:11.005105 30551 raft_consensus.cc:1275] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:11.006835 31455 consensus_queue.cc:1048] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:11.009552 31151 raft_consensus.cc:2955] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:11.027392 30617 consensus_queue.cc:237] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:11.035346 31149 raft_consensus.cc:1275] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:11.036631 31455 consensus_queue.cc:1048] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:11.044534 30373 catalog_manager.cc:5697] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 reported cstate change: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:11.047360 31459 raft_consensus.cc:2955] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:11.049517 30470 raft_consensus.cc:1275] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:11.049615 31456 raft_consensus.cc:2955] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:11.050912 31412 consensus_queue.cc:1048] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:11.052947 31149 raft_consensus.cc:2955] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:11.053278 30549 raft_consensus.cc:2955] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:11.051379 30470 raft_consensus.cc:2955] T 99c151771be541b19017860da4f7218d P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:11.072151 30360 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 265fc568d5674c78833106e4eda814f4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:11.071851 31151 raft_consensus.cc:2955] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:11.080143 30467 raft_consensus.cc:2955] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:11.087065 30372 catalog_manager.cc:5697] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: config changed from index 3 to 4, VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) evicted. New cstate: current_term: 1 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:11.088941 30617 consensus_queue.cc:237] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:11.098385 31149 raft_consensus.cc:1275] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:11.099870 31456 consensus_queue.cc:1048] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:08:11.105088 30467 raft_consensus.cc:1275] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:11.107318 31456 consensus_queue.cc:1048] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:11.108693 30541 tablet_service.cc:1558] Processing DeleteTablet for tablet 265fc568d5674c78833106e4eda814f4 with delete_type TABLET_DATA_TOMBSTONED (TS 092f6eb694fc4bbeab49677cccd880fd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43082
I20260709 13:08:11.111300 30373 catalog_manager.cc:5697] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:11.124383 31455 raft_consensus.cc:2955] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:11.134552 30617 consensus_queue.cc:237] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:11.140720 31151 raft_consensus.cc:1275] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:11.140902 30360 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 10b0408011914710a008d9e9b58f002c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:11.142539 30549 raft_consensus.cc:1275] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:11.143718 31457 consensus_queue.cc:1048] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:11.142724 31149 raft_consensus.cc:2955] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:11.144769 31459 consensus_queue.cc:1048] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:11.151311 31412 raft_consensus.cc:2955] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:11.161855 30372 catalog_manager.cc:5697] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 reported cstate change: config changed from index 3 to 4, VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) evicted. New cstate: current_term: 1 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:11.163560 30548 raft_consensus.cc:2955] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:11.174405 30532 tablet_service.cc:1558] Processing DeleteTablet for tablet 10b0408011914710a008d9e9b58f002c with delete_type TABLET_DATA_TOMBSTONED (TS 092f6eb694fc4bbeab49677cccd880fd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43082
I20260709 13:08:11.187017 30360 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 99c151771be541b19017860da4f7218d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:11.184481 30372 catalog_manager.cc:5697] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: config changed from index 3 to 4, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New cstate: current_term: 1 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:11.193720 31149 raft_consensus.cc:2955] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:11.207774 30467 raft_consensus.cc:2955] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:11.211189 30464 tablet_service.cc:1558] Processing DeleteTablet for tablet 99c151771be541b19017860da4f7218d with delete_type TABLET_DATA_TOMBSTONED (TS f639301059e24dc5b0d88a46dc683326 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53858
I20260709 13:08:11.213546 31470 tablet_replica.cc:333] T 265fc568d5674c78833106e4eda814f4 P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:08:11.215868 31470 raft_consensus.cc:2243] T 265fc568d5674c78833106e4eda814f4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.217918 31470 raft_consensus.cc:2272] T 265fc568d5674c78833106e4eda814f4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.223336 31470 ts_tablet_manager.cc:1916] T 265fc568d5674c78833106e4eda814f4 P 092f6eb694fc4bbeab49677cccd880fd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:11.239822 31472 tablet_replica.cc:333] T 99c151771be541b19017860da4f7218d P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:08:11.241093 31472 raft_consensus.cc:2243] T 99c151771be541b19017860da4f7218d P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.241814 31472 raft_consensus.cc:2272] T 99c151771be541b19017860da4f7218d P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.241854 31470 ts_tablet_manager.cc:1929] T 265fc568d5674c78833106e4eda814f4 P 092f6eb694fc4bbeab49677cccd880fd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:11.242470 31470 log.cc:1199] T 265fc568d5674c78833106e4eda814f4 P 092f6eb694fc4bbeab49677cccd880fd: Deleting WAL directory at /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-1-root/wals/265fc568d5674c78833106e4eda814f4
I20260709 13:08:11.244117 30359 catalog_manager.cc:5028] TS 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): tablet 265fc568d5674c78833106e4eda814f4 (table test-workload [id=887057791fed41a884abbab3e8d4b49f]) successfully deleted
I20260709 13:08:11.244311 31470 tablet_replica.cc:333] T 10b0408011914710a008d9e9b58f002c P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:08:11.245381 31470 raft_consensus.cc:2243] T 10b0408011914710a008d9e9b58f002c P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.245769 31472 ts_tablet_manager.cc:1916] T 99c151771be541b19017860da4f7218d P f639301059e24dc5b0d88a46dc683326: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:11.246065 31470 raft_consensus.cc:2272] T 10b0408011914710a008d9e9b58f002c P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.249069 31470 ts_tablet_manager.cc:1916] T 10b0408011914710a008d9e9b58f002c P 092f6eb694fc4bbeab49677cccd880fd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:11.261231 31472 ts_tablet_manager.cc:1929] T 99c151771be541b19017860da4f7218d P f639301059e24dc5b0d88a46dc683326: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:11.261780 31472 log.cc:1199] T 99c151771be541b19017860da4f7218d P f639301059e24dc5b0d88a46dc683326: Deleting WAL directory at /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-0-root/wals/99c151771be541b19017860da4f7218d
I20260709 13:08:11.263665 30361 catalog_manager.cc:5028] TS f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): tablet 99c151771be541b19017860da4f7218d (table test-workload [id=887057791fed41a884abbab3e8d4b49f]) successfully deleted
I20260709 13:08:11.264848 31470 ts_tablet_manager.cc:1929] T 10b0408011914710a008d9e9b58f002c P 092f6eb694fc4bbeab49677cccd880fd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:11.265327 31470 log.cc:1199] T 10b0408011914710a008d9e9b58f002c P 092f6eb694fc4bbeab49677cccd880fd: Deleting WAL directory at /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-1-root/wals/10b0408011914710a008d9e9b58f002c
I20260709 13:08:11.266666 30359 catalog_manager.cc:5028] TS 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): tablet 10b0408011914710a008d9e9b58f002c (table test-workload [id=887057791fed41a884abbab3e8d4b49f]) successfully deleted
I20260709 13:08:12.280355 30617 consensus_queue.cc:237] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:12.286443 30467 raft_consensus.cc:1275] T 8e5fda238ec24b13b992b82bed92951f P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:12.286665 30549 raft_consensus.cc:1275] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:12.286845 30590 consensus_peers.cc:597] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453): Couldn't send request to peer cd669586cff44d4bbfcc007e213faab6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8e5fda238ec24b13b992b82bed92951f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:12.289258 31412 consensus_queue.cc:1048] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:12.290856 31459 consensus_queue.cc:1048] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:12.299532 31459 raft_consensus.cc:2955] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:12.302518 30473 raft_consensus.cc:2955] T 8e5fda238ec24b13b992b82bed92951f P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:12.303326 30548 raft_consensus.cc:2955] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:12.313692 30467 consensus_queue.cc:237] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:12.318503 30373 catalog_manager.cc:5697] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New cstate: current_term: 1 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:12.340256 30549 raft_consensus.cc:1275] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:12.342324 30441 consensus_peers.cc:597] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 -> Peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453): Couldn't send request to peer cd669586cff44d4bbfcc007e213faab6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 47ac231e47e64c0c9330e153212ca4b5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:12.342476 30617 raft_consensus.cc:1275] T 47ac231e47e64c0c9330e153212ca4b5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:12.342952 31407 consensus_queue.cc:1048] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:12.344318 31425 consensus_queue.cc:1048] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:12.360324 31425 raft_consensus.cc:2955] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:12.369638 30617 raft_consensus.cc:2955] T 47ac231e47e64c0c9330e153212ca4b5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:12.373636 30548 raft_consensus.cc:2955] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:12.376472 30549 consensus_queue.cc:237] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:12.383723 30372 catalog_manager.cc:5697] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 reported cstate change: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New cstate: current_term: 1 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:12.395223 30617 raft_consensus.cc:1275] T 1a418ef882d34180817469c4e2495268 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:12.396591 31473 consensus_queue.cc:1048] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:08:12.399062 30516 consensus_peers.cc:597] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd -> Peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453): Couldn't send request to peer cd669586cff44d4bbfcc007e213faab6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1a418ef882d34180817469c4e2495268. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:12.400116 30473 raft_consensus.cc:1275] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:12.403579 31473 consensus_queue.cc:1048] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:12.411857 31473 raft_consensus.cc:2955] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:12.424968 30619 raft_consensus.cc:2955] T 1a418ef882d34180817469c4e2495268 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:12.435191 30467 raft_consensus.cc:2955] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:12.438740 30473 consensus_queue.cc:237] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:12.443887 30374 catalog_manager.cc:5697] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:12.455449 30441 consensus_peers.cc:597] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 -> Peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453): Couldn't send request to peer cd669586cff44d4bbfcc007e213faab6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7e31b2accf3b4a3b8b7668571e619eb7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:12.456614 30619 raft_consensus.cc:1275] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:12.457098 30548 raft_consensus.cc:1275] T 7e31b2accf3b4a3b8b7668571e619eb7 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:12.459383 31407 consensus_queue.cc:1048] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:12.460350 31425 consensus_queue.cc:1048] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:12.468509 31482 raft_consensus.cc:2955] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:12.470932 30548 raft_consensus.cc:2955] T 7e31b2accf3b4a3b8b7668571e619eb7 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:12.477948 30617 raft_consensus.cc:2955] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:12.495860 30373 catalog_manager.cc:5697] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 reported cstate change: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New cstate: current_term: 1 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:12.718586 31497 ts_tablet_manager.cc:933] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6: Initiating tablet copy from peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:12.720784 31497 tablet_copy_client.cc:323] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6: tablet copy: Beginning tablet copy session from remote peer at address 127.28.173.3:32851
I20260709 13:08:12.722232 30634 tablet_copy_service.cc:140] P fe2b7d73f8c743c1ba570cfd981c4e79: Received BeginTabletCopySession request for tablet 8e5fda238ec24b13b992b82bed92951f from peer cd669586cff44d4bbfcc007e213faab6 ({username='slave'} at 127.0.0.1:57140)
I20260709 13:08:12.722759 30634 tablet_copy_service.cc:161] P fe2b7d73f8c743c1ba570cfd981c4e79: Beginning new tablet copy session on tablet 8e5fda238ec24b13b992b82bed92951f from peer cd669586cff44d4bbfcc007e213faab6 at {username='slave'} at 127.0.0.1:57140: session id = cd669586cff44d4bbfcc007e213faab6-8e5fda238ec24b13b992b82bed92951f
I20260709 13:08:12.730043 30634 tablet_copy_source_session.cc:215] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:12.733076 31497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e5fda238ec24b13b992b82bed92951f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.748313 31497 tablet_copy_client.cc:806] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:12.748986 31497 tablet_copy_client.cc:670] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:12.753600 31497 tablet_copy_client.cc:538] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:12.761654 31497 tablet_bootstrap.cc:492] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6: Bootstrap starting.
I20260709 13:08:12.780727 31497 tablet_bootstrap.cc:492] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:12.781644 31497 tablet_bootstrap.cc:492] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6: Bootstrap complete.
I20260709 13:08:12.782330 31497 ts_tablet_manager.cc:1403] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.004s
I20260709 13:08:12.785354 31497 raft_consensus.cc:359] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:12.786237 31497 raft_consensus.cc:740] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Initialized, Role: LEARNER
I20260709 13:08:12.786936 31497 consensus_queue.cc:260] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:12.790230 31497 ts_tablet_manager.cc:1434] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:08:12.795410 30634 tablet_copy_service.cc:342] P fe2b7d73f8c743c1ba570cfd981c4e79: Request end of tablet copy session cd669586cff44d4bbfcc007e213faab6-8e5fda238ec24b13b992b82bed92951f received from {username='slave'} at 127.0.0.1:57140
I20260709 13:08:12.795797 30634 tablet_copy_service.cc:434] P fe2b7d73f8c743c1ba570cfd981c4e79: ending tablet copy session cd669586cff44d4bbfcc007e213faab6-8e5fda238ec24b13b992b82bed92951f on tablet 8e5fda238ec24b13b992b82bed92951f with peer cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:12.917086 31497 ts_tablet_manager.cc:933] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6: Initiating tablet copy from peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:12.918752 31497 tablet_copy_client.cc:323] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Beginning tablet copy session from remote peer at address 127.28.173.2:34733
I20260709 13:08:12.920379 30561 tablet_copy_service.cc:140] P 092f6eb694fc4bbeab49677cccd880fd: Received BeginTabletCopySession request for tablet 1a418ef882d34180817469c4e2495268 from peer cd669586cff44d4bbfcc007e213faab6 ({username='slave'} at 127.0.0.1:35278)
I20260709 13:08:12.920899 30561 tablet_copy_service.cc:161] P 092f6eb694fc4bbeab49677cccd880fd: Beginning new tablet copy session on tablet 1a418ef882d34180817469c4e2495268 from peer cd669586cff44d4bbfcc007e213faab6 at {username='slave'} at 127.0.0.1:35278: session id = cd669586cff44d4bbfcc007e213faab6-1a418ef882d34180817469c4e2495268
I20260709 13:08:12.928395 30561 tablet_copy_source_session.cc:215] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:12.931928 31497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a418ef882d34180817469c4e2495268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.953413 31497 tablet_copy_client.cc:806] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:12.954022 31497 tablet_copy_client.cc:670] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:12.957861 31497 tablet_copy_client.cc:538] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:12.962074 31502 ts_tablet_manager.cc:933] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6: Initiating tablet copy from peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133)
I20260709 13:08:12.963689 31502 tablet_copy_client.cc:323] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Beginning tablet copy session from remote peer at address 127.28.173.1:43133
I20260709 13:08:12.965060 30486 tablet_copy_service.cc:140] P f639301059e24dc5b0d88a46dc683326: Received BeginTabletCopySession request for tablet 47ac231e47e64c0c9330e153212ca4b5 from peer cd669586cff44d4bbfcc007e213faab6 ({username='slave'} at 127.0.0.1:60026)
I20260709 13:08:12.965605 30486 tablet_copy_service.cc:161] P f639301059e24dc5b0d88a46dc683326: Beginning new tablet copy session on tablet 47ac231e47e64c0c9330e153212ca4b5 from peer cd669586cff44d4bbfcc007e213faab6 at {username='slave'} at 127.0.0.1:60026: session id = cd669586cff44d4bbfcc007e213faab6-47ac231e47e64c0c9330e153212ca4b5
I20260709 13:08:12.966948 31497 tablet_bootstrap.cc:492] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6: Bootstrap starting.
I20260709 13:08:12.970963 30486 tablet_copy_source_session.cc:215] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:12.974710 31502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47ac231e47e64c0c9330e153212ca4b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.987742 31502 tablet_copy_client.cc:806] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:12.989349 31502 tablet_copy_client.cc:670] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:12.989933 31497 tablet_bootstrap.cc:492] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:12.990794 31497 tablet_bootstrap.cc:492] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6: Bootstrap complete.
I20260709 13:08:12.991330 31497 ts_tablet_manager.cc:1403] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6: Time spent bootstrapping tablet: real 0.025s	user 0.021s	sys 0.000s
I20260709 13:08:12.993788 31502 tablet_copy_client.cc:538] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:12.996196 31497 raft_consensus.cc:359] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:12.997108 31497 raft_consensus.cc:740] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Initialized, Role: LEARNER
I20260709 13:08:12.997785 31497 consensus_queue.cc:260] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:13.000437 31497 ts_tablet_manager.cc:1434] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.004s
I20260709 13:08:13.004380 30561 tablet_copy_service.cc:342] P 092f6eb694fc4bbeab49677cccd880fd: Request end of tablet copy session cd669586cff44d4bbfcc007e213faab6-1a418ef882d34180817469c4e2495268 received from {username='slave'} at 127.0.0.1:35278
I20260709 13:08:13.004760 30561 tablet_copy_service.cc:434] P 092f6eb694fc4bbeab49677cccd880fd: ending tablet copy session cd669586cff44d4bbfcc007e213faab6-1a418ef882d34180817469c4e2495268 on tablet 1a418ef882d34180817469c4e2495268 with peer cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:13.006304 31502 tablet_bootstrap.cc:492] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6: Bootstrap starting.
I20260709 13:08:13.036304 31502 tablet_bootstrap.cc:492] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:13.037338 31502 tablet_bootstrap.cc:492] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6: Bootstrap complete.
I20260709 13:08:13.038060 31502 ts_tablet_manager.cc:1403] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6: Time spent bootstrapping tablet: real 0.032s	user 0.021s	sys 0.007s
I20260709 13:08:13.041306 31502 raft_consensus.cc:359] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:13.042137 31502 raft_consensus.cc:740] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Initialized, Role: LEARNER
I20260709 13:08:13.042832 31502 consensus_queue.cc:260] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:13.045868 31502 ts_tablet_manager.cc:1434] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:08:13.056123 30486 tablet_copy_service.cc:342] P f639301059e24dc5b0d88a46dc683326: Request end of tablet copy session cd669586cff44d4bbfcc007e213faab6-47ac231e47e64c0c9330e153212ca4b5 received from {username='slave'} at 127.0.0.1:60026
I20260709 13:08:13.056559 30486 tablet_copy_service.cc:434] P f639301059e24dc5b0d88a46dc683326: ending tablet copy session cd669586cff44d4bbfcc007e213faab6-47ac231e47e64c0c9330e153212ca4b5 on tablet 47ac231e47e64c0c9330e153212ca4b5 with peer cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:13.061286 31502 ts_tablet_manager.cc:933] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6: Initiating tablet copy from peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133)
I20260709 13:08:13.063351 31502 tablet_copy_client.cc:323] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Beginning tablet copy session from remote peer at address 127.28.173.1:43133
I20260709 13:08:13.065949 30486 tablet_copy_service.cc:140] P f639301059e24dc5b0d88a46dc683326: Received BeginTabletCopySession request for tablet 7e31b2accf3b4a3b8b7668571e619eb7 from peer cd669586cff44d4bbfcc007e213faab6 ({username='slave'} at 127.0.0.1:60026)
I20260709 13:08:13.066579 30486 tablet_copy_service.cc:161] P f639301059e24dc5b0d88a46dc683326: Beginning new tablet copy session on tablet 7e31b2accf3b4a3b8b7668571e619eb7 from peer cd669586cff44d4bbfcc007e213faab6 at {username='slave'} at 127.0.0.1:60026: session id = cd669586cff44d4bbfcc007e213faab6-7e31b2accf3b4a3b8b7668571e619eb7
I20260709 13:08:13.078265 30486 tablet_copy_source_session.cc:215] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:13.080945 31502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e31b2accf3b4a3b8b7668571e619eb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:13.095350 31502 tablet_copy_client.cc:806] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:13.095854 31502 tablet_copy_client.cc:670] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:13.098961 31502 tablet_copy_client.cc:538] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:13.105751 31502 tablet_bootstrap.cc:492] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6: Bootstrap starting.
I20260709 13:08:13.123184 31502 tablet_bootstrap.cc:492] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:13.124018 31502 tablet_bootstrap.cc:492] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6: Bootstrap complete.
I20260709 13:08:13.124689 31502 ts_tablet_manager.cc:1403] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6: Time spent bootstrapping tablet: real 0.019s	user 0.019s	sys 0.000s
I20260709 13:08:13.127389 31502 raft_consensus.cc:359] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:13.128190 31502 raft_consensus.cc:740] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Initialized, Role: LEARNER
I20260709 13:08:13.128695 31502 consensus_queue.cc:260] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:13.130493 31502 ts_tablet_manager.cc:1434] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:08:13.132294 30486 tablet_copy_service.cc:342] P f639301059e24dc5b0d88a46dc683326: Request end of tablet copy session cd669586cff44d4bbfcc007e213faab6-7e31b2accf3b4a3b8b7668571e619eb7 received from {username='slave'} at 127.0.0.1:60026
I20260709 13:08:13.132709 30486 tablet_copy_service.cc:434] P f639301059e24dc5b0d88a46dc683326: ending tablet copy session cd669586cff44d4bbfcc007e213faab6-7e31b2accf3b4a3b8b7668571e619eb7 on tablet 7e31b2accf3b4a3b8b7668571e619eb7 with peer cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:13.165431 31149 raft_consensus.cc:1217] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:13.489873 31149 raft_consensus.cc:1217] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:13.560873 31149 raft_consensus.cc:1217] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:13.628415 31149 raft_consensus.cc:1217] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:13.770603 31412 raft_consensus.cc:1064] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79: attempting to promote NON_VOTER cd669586cff44d4bbfcc007e213faab6 to VOTER
I20260709 13:08:13.772802 31412 consensus_queue.cc:237] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:13.778507 31149 raft_consensus.cc:1275] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:13.779042 30549 raft_consensus.cc:1275] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:13.779672 31511 consensus_queue.cc:1048] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:13.780380 30473 raft_consensus.cc:1275] T 8e5fda238ec24b13b992b82bed92951f P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:13.781345 31412 consensus_queue.cc:1048] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:13.782120 31516 consensus_queue.cc:1048] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:13.790490 31516 raft_consensus.cc:2955] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:13.799036 30473 raft_consensus.cc:2955] T 8e5fda238ec24b13b992b82bed92951f P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:13.801463 30549 raft_consensus.cc:2955] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:13.802722 31149 raft_consensus.cc:2955] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:13.823278 30374 catalog_manager.cc:5697] T 8e5fda238ec24b13b992b82bed92951f P f639301059e24dc5b0d88a46dc683326 reported cstate change: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:13.862356 30617 consensus_queue.cc:237] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:13.873574 31149 raft_consensus.cc:1275] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:13.873996 30549 raft_consensus.cc:1275] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:13.875317 31412 consensus_queue.cc:1048] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:13.876170 31516 consensus_queue.cc:1048] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:13.882453 31511 raft_consensus.cc:2955] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:13.885064 30549 raft_consensus.cc:2955] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:13.888499 31149 raft_consensus.cc:2955] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:13.893777 30360 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8e5fda238ec24b13b992b82bed92951f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:13.904742 30373 catalog_manager.cc:5697] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: config changed from index 3 to 4, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New cstate: current_term: 1 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:13.941898 30464 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e5fda238ec24b13b992b82bed92951f with delete_type TABLET_DATA_TOMBSTONED (TS f639301059e24dc5b0d88a46dc683326 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53858
I20260709 13:08:13.943637 31524 tablet_replica.cc:333] T 8e5fda238ec24b13b992b82bed92951f P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:08:13.944428 31524 raft_consensus.cc:2243] T 8e5fda238ec24b13b992b82bed92951f P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:13.945122 31524 raft_consensus.cc:2272] T 8e5fda238ec24b13b992b82bed92951f P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:13.948320 31524 ts_tablet_manager.cc:1916] T 8e5fda238ec24b13b992b82bed92951f P f639301059e24dc5b0d88a46dc683326: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:13.964221 31524 ts_tablet_manager.cc:1929] T 8e5fda238ec24b13b992b82bed92951f P f639301059e24dc5b0d88a46dc683326: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:13.964628 31524 log.cc:1199] T 8e5fda238ec24b13b992b82bed92951f P f639301059e24dc5b0d88a46dc683326: Deleting WAL directory at /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-0-root/wals/8e5fda238ec24b13b992b82bed92951f
I20260709 13:08:13.965866 30361 catalog_manager.cc:5028] TS f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): tablet 8e5fda238ec24b13b992b82bed92951f (table test-workload [id=887057791fed41a884abbab3e8d4b49f]) successfully deleted
I20260709 13:08:13.989431 31508 raft_consensus.cc:1064] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd: attempting to promote NON_VOTER cd669586cff44d4bbfcc007e213faab6 to VOTER
I20260709 13:08:13.991578 31508 consensus_queue.cc:237] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:13.996645 31514 raft_consensus.cc:1064] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326: attempting to promote NON_VOTER cd669586cff44d4bbfcc007e213faab6 to VOTER
I20260709 13:08:13.999776 31514 consensus_queue.cc:237] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:14.008055 30617 raft_consensus.cc:1275] T 47ac231e47e64c0c9330e153212ca4b5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:14.009727 30548 raft_consensus.cc:1275] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:14.009804 31513 consensus_queue.cc:1048] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:14.011231 31149 raft_consensus.cc:1275] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:14.014413 30619 raft_consensus.cc:1275] T 1a418ef882d34180817469c4e2495268 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:14.014418 31513 consensus_queue.cc:1048] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:14.018085 31149 raft_consensus.cc:1275] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:14.019059 31473 consensus_queue.cc:1048] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:14.025694 31473 consensus_queue.cc:1048] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:14.030258 31513 consensus_queue.cc:1048] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:14.034869 30467 raft_consensus.cc:1275] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:14.054340 31425 raft_consensus.cc:2955] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:14.060004 31533 consensus_queue.cc:1048] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:14.064709 31149 raft_consensus.cc:2955] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:14.068687 30548 raft_consensus.cc:2955] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:14.074805 30620 raft_consensus.cc:2955] T 47ac231e47e64c0c9330e153212ca4b5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:14.077076 30373 catalog_manager.cc:5697] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 reported cstate change: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:14.080163 31526 log.cc:927] Time spent T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:08:14.085198 31508 raft_consensus.cc:2955] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:14.096740 30473 consensus_queue.cc:237] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:14.098975 31513 raft_consensus.cc:1064] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326: attempting to promote NON_VOTER cd669586cff44d4bbfcc007e213faab6 to VOTER
I20260709 13:08:14.099087 31150 raft_consensus.cc:2955] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:14.101476 31513 consensus_queue.cc:237] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:14.112797 30371 catalog_manager.cc:5697] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:14.127558 31151 raft_consensus.cc:1275] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:14.128224 30473 raft_consensus.cc:2955] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:14.131547 31482 consensus_queue.cc:1048] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:08:14.137498 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 53132.3us
I20260709 13:08:14.139133 30620 raft_consensus.cc:2955] T 1a418ef882d34180817469c4e2495268 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:14.145478 30549 raft_consensus.cc:1275] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:14.156565 31151 raft_consensus.cc:1275] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:14.157212 31514 consensus_queue.cc:1048] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:14.155900 31425 raft_consensus.cc:2955] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:14.159161 31514 consensus_queue.cc:1048] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:14.165643 30549 raft_consensus.cc:2955] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:14.169631 30620 raft_consensus.cc:1275] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:14.178732 31514 consensus_queue.cc:1048] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:14.160820 31150 raft_consensus.cc:2955] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:14.180519 30551 consensus_queue.cc:237] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:14.182240 30361 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 47ac231e47e64c0c9330e153212ca4b5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:14.185811 31149 raft_consensus.cc:1275] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:14.187309 31507 consensus_queue.cc:1048] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:14.189157 30467 raft_consensus.cc:1275] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:14.189677 30551 raft_consensus.cc:1275] T 7e31b2accf3b4a3b8b7668571e619eb7 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:14.194134 31425 consensus_queue.cc:1048] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:14.194355 31507 consensus_queue.cc:1048] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:14.197834 31533 raft_consensus.cc:2955] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:14.206629 30467 raft_consensus.cc:2955] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:14.211424 31149 raft_consensus.cc:2955] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:14.224102 30359 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1a418ef882d34180817469c4e2495268 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:14.256305 30371 catalog_manager.cc:5697] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 reported cstate change: config changed from index 3 to 4, VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) evicted. New cstate: current_term: 1 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:14.264652 31482 raft_consensus.cc:2955] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:14.266711 30620 raft_consensus.cc:2955] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:14.267052 30374 catalog_manager.cc:5697] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: config changed from index 3 to 4, VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) evicted. New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:14.272411 30612 tablet_service.cc:1558] Processing DeleteTablet for tablet 47ac231e47e64c0c9330e153212ca4b5 with delete_type TABLET_DATA_TOMBSTONED (TS fe2b7d73f8c743c1ba570cfd981c4e79 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36118
I20260709 13:08:14.302492 30551 raft_consensus.cc:2955] T 7e31b2accf3b4a3b8b7668571e619eb7 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:14.303786 30606 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a418ef882d34180817469c4e2495268 with delete_type TABLET_DATA_TOMBSTONED (TS fe2b7d73f8c743c1ba570cfd981c4e79 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36118
I20260709 13:08:14.293850 31150 raft_consensus.cc:2955] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:14.322896 31539 tablet_replica.cc:333] T 47ac231e47e64c0c9330e153212ca4b5 P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:08:14.325047 31539 raft_consensus.cc:2243] T 47ac231e47e64c0c9330e153212ca4b5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:14.325814 31539 raft_consensus.cc:2272] T 47ac231e47e64c0c9330e153212ca4b5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:14.335036 30371 catalog_manager.cc:5697] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 reported cstate change: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:14.337188 31539 ts_tablet_manager.cc:1916] T 47ac231e47e64c0c9330e153212ca4b5 P fe2b7d73f8c743c1ba570cfd981c4e79: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:14.354163 30467 consensus_queue.cc:237] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:14.372964 31539 ts_tablet_manager.cc:1929] T 47ac231e47e64c0c9330e153212ca4b5 P fe2b7d73f8c743c1ba570cfd981c4e79: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:14.373512 31539 log.cc:1199] T 47ac231e47e64c0c9330e153212ca4b5 P fe2b7d73f8c743c1ba570cfd981c4e79: Deleting WAL directory at /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-2-root/wals/47ac231e47e64c0c9330e153212ca4b5
I20260709 13:08:14.375083 30360 catalog_manager.cc:5028] TS fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): tablet 47ac231e47e64c0c9330e153212ca4b5 (table test-workload [id=887057791fed41a884abbab3e8d4b49f]) successfully deleted
I20260709 13:08:14.375236 31539 tablet_replica.cc:333] T 1a418ef882d34180817469c4e2495268 P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:08:14.376286 31539 raft_consensus.cc:2243] T 1a418ef882d34180817469c4e2495268 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:14.377493 31539 raft_consensus.cc:2272] T 1a418ef882d34180817469c4e2495268 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:14.378152 31150 raft_consensus.cc:1275] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:14.378851 30620 raft_consensus.cc:1275] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:14.380491 31482 consensus_queue.cc:1048] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:14.383208 31482 consensus_queue.cc:1048] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:14.395082 31539 ts_tablet_manager.cc:1916] T 1a418ef882d34180817469c4e2495268 P fe2b7d73f8c743c1ba570cfd981c4e79: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:14.394732 31482 raft_consensus.cc:2955] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:14.403847 31150 raft_consensus.cc:2955] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:14.408484 30620 raft_consensus.cc:2955] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:14.412451 30361 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7e31b2accf3b4a3b8b7668571e619eb7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:14.415089 31539 ts_tablet_manager.cc:1929] T 1a418ef882d34180817469c4e2495268 P fe2b7d73f8c743c1ba570cfd981c4e79: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:14.425768 30371 catalog_manager.cc:5697] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 reported cstate change: config changed from index 3 to 4, VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) evicted. New cstate: current_term: 1 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:14.436144 31539 log.cc:1199] T 1a418ef882d34180817469c4e2495268 P fe2b7d73f8c743c1ba570cfd981c4e79: Deleting WAL directory at /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-2-root/wals/1a418ef882d34180817469c4e2495268
I20260709 13:08:14.438181 30360 catalog_manager.cc:5028] TS fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): tablet 1a418ef882d34180817469c4e2495268 (table test-workload [id=887057791fed41a884abbab3e8d4b49f]) successfully deleted
I20260709 13:08:14.440801 30541 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e31b2accf3b4a3b8b7668571e619eb7 with delete_type TABLET_DATA_TOMBSTONED (TS 092f6eb694fc4bbeab49677cccd880fd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43082
I20260709 13:08:14.442831 31540 tablet_replica.cc:333] T 7e31b2accf3b4a3b8b7668571e619eb7 P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:08:14.443854 31540 raft_consensus.cc:2243] T 7e31b2accf3b4a3b8b7668571e619eb7 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:14.444638 31540 raft_consensus.cc:2272] T 7e31b2accf3b4a3b8b7668571e619eb7 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:14.448161 31540 ts_tablet_manager.cc:1916] T 7e31b2accf3b4a3b8b7668571e619eb7 P 092f6eb694fc4bbeab49677cccd880fd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:14.460201 31540 ts_tablet_manager.cc:1929] T 7e31b2accf3b4a3b8b7668571e619eb7 P 092f6eb694fc4bbeab49677cccd880fd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:14.460510 31540 log.cc:1199] T 7e31b2accf3b4a3b8b7668571e619eb7 P 092f6eb694fc4bbeab49677cccd880fd: Deleting WAL directory at /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-1-root/wals/7e31b2accf3b4a3b8b7668571e619eb7
I20260709 13:08:14.462013 30359 catalog_manager.cc:5028] TS 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): tablet 7e31b2accf3b4a3b8b7668571e619eb7 (table test-workload [id=887057791fed41a884abbab3e8d4b49f]) successfully deleted
I20260709 13:08:15.507799 30551 consensus_queue.cc:237] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
W20260709 13:08:15.520457 30516 consensus_peers.cc:597] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd -> Peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453): Couldn't send request to peer cd669586cff44d4bbfcc007e213faab6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 606c3ee77596493da2daa40edde4d1ea. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:15.520745 30470 raft_consensus.cc:1275] T 606c3ee77596493da2daa40edde4d1ea P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:15.520745 30617 raft_consensus.cc:1275] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:15.522361 31544 consensus_queue.cc:1048] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:15.523372 31542 consensus_queue.cc:1048] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:15.540064 31542 raft_consensus.cc:2955] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:15.541702 30470 raft_consensus.cc:2955] T 606c3ee77596493da2daa40edde4d1ea P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:15.546900 30617 raft_consensus.cc:2955] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:15.554824 30551 consensus_queue.cc:237] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:15.557061 30371 catalog_manager.cc:5697] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:15.566753 30617 raft_consensus.cc:1275] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:15.568426 30470 raft_consensus.cc:1275] T 1f895d2ed89b48cc856a4b80cdde3073 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:15.570211 31542 consensus_queue.cc:1048] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:08:15.572420 30516 consensus_peers.cc:597] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd -> Peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453): Couldn't send request to peer cd669586cff44d4bbfcc007e213faab6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1f895d2ed89b48cc856a4b80cdde3073. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:15.575420 31542 consensus_queue.cc:1048] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:15.584384 31533 raft_consensus.cc:2955] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:15.586537 30472 raft_consensus.cc:2955] T 1f895d2ed89b48cc856a4b80cdde3073 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:15.609742 30551 consensus_queue.cc:237] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:15.614737 30617 raft_consensus.cc:2955] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:15.633158 30472 raft_consensus.cc:1275] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:15.633481 30620 raft_consensus.cc:1275] T 7f8b6eff35aa4b96bf5f73d6a94db695 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:15.632668 30373 catalog_manager.cc:5697] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:15.639475 30516 consensus_peers.cc:597] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd -> Peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453): Couldn't send request to peer cd669586cff44d4bbfcc007e213faab6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7f8b6eff35aa4b96bf5f73d6a94db695. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:15.640482 31533 consensus_queue.cc:1048] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:15.645426 31533 consensus_queue.cc:1048] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:15.656390 31555 raft_consensus.cc:2955] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:15.658041 30467 raft_consensus.cc:2955] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:15.659518 30617 raft_consensus.cc:2955] T 7f8b6eff35aa4b96bf5f73d6a94db695 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:15.677601 30373 catalog_manager.cc:5697] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 reported cstate change: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:15.690445 30617 consensus_queue.cc:237] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:15.699016 30551 raft_consensus.cc:1275] T 48914655f9d44751a883e36b566dcefd P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:15.699296 30590 consensus_peers.cc:597] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453): Couldn't send request to peer cd669586cff44d4bbfcc007e213faab6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 48914655f9d44751a883e36b566dcefd. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:15.700711 30472 raft_consensus.cc:1275] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:15.700774 31511 consensus_queue.cc:1048] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:15.704420 31511 consensus_queue.cc:1048] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:15.728883 31563 raft_consensus.cc:2955] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:15.732719 30551 raft_consensus.cc:2955] T 48914655f9d44751a883e36b566dcefd P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:15.733682 30472 raft_consensus.cc:2955] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:15.752838 30373 catalog_manager.cc:5697] T 48914655f9d44751a883e36b566dcefd P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New cstate: current_term: 1 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:15.972930 31568 ts_tablet_manager.cc:933] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6: Initiating tablet copy from peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:15.974704 31568 tablet_copy_client.cc:323] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6: tablet copy: Beginning tablet copy session from remote peer at address 127.28.173.2:34733
I20260709 13:08:15.976557 30561 tablet_copy_service.cc:140] P 092f6eb694fc4bbeab49677cccd880fd: Received BeginTabletCopySession request for tablet 606c3ee77596493da2daa40edde4d1ea from peer cd669586cff44d4bbfcc007e213faab6 ({username='slave'} at 127.0.0.1:35278)
I20260709 13:08:15.977162 30561 tablet_copy_service.cc:161] P 092f6eb694fc4bbeab49677cccd880fd: Beginning new tablet copy session on tablet 606c3ee77596493da2daa40edde4d1ea from peer cd669586cff44d4bbfcc007e213faab6 at {username='slave'} at 127.0.0.1:35278: session id = cd669586cff44d4bbfcc007e213faab6-606c3ee77596493da2daa40edde4d1ea
I20260709 13:08:15.985299 30561 tablet_copy_source_session.cc:215] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:15.990142 31568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 606c3ee77596493da2daa40edde4d1ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.004781 31568 tablet_copy_client.cc:806] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:16.005352 31568 tablet_copy_client.cc:670] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:16.008973 31568 tablet_copy_client.cc:538] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:16.017007 31568 tablet_bootstrap.cc:492] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6: Bootstrap starting.
I20260709 13:08:16.039055 31568 tablet_bootstrap.cc:492] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:16.040060 31568 tablet_bootstrap.cc:492] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6: Bootstrap complete.
I20260709 13:08:16.040702 31568 ts_tablet_manager.cc:1403] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.008s
I20260709 13:08:16.043725 31568 raft_consensus.cc:359] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:16.044576 31568 raft_consensus.cc:740] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Initialized, Role: LEARNER
I20260709 13:08:16.045272 31568 consensus_queue.cc:260] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:16.050825 31568 ts_tablet_manager.cc:1434] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:08:16.055004 30561 tablet_copy_service.cc:342] P 092f6eb694fc4bbeab49677cccd880fd: Request end of tablet copy session cd669586cff44d4bbfcc007e213faab6-606c3ee77596493da2daa40edde4d1ea received from {username='slave'} at 127.0.0.1:35278
I20260709 13:08:16.055505 30561 tablet_copy_service.cc:434] P 092f6eb694fc4bbeab49677cccd880fd: ending tablet copy session cd669586cff44d4bbfcc007e213faab6-606c3ee77596493da2daa40edde4d1ea on tablet 606c3ee77596493da2daa40edde4d1ea with peer cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:16.119449 31568 ts_tablet_manager.cc:933] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6: Initiating tablet copy from peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:16.121660 31568 tablet_copy_client.cc:323] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Beginning tablet copy session from remote peer at address 127.28.173.2:34733
I20260709 13:08:16.123276 30561 tablet_copy_service.cc:140] P 092f6eb694fc4bbeab49677cccd880fd: Received BeginTabletCopySession request for tablet 1f895d2ed89b48cc856a4b80cdde3073 from peer cd669586cff44d4bbfcc007e213faab6 ({username='slave'} at 127.0.0.1:35278)
I20260709 13:08:16.123765 30561 tablet_copy_service.cc:161] P 092f6eb694fc4bbeab49677cccd880fd: Beginning new tablet copy session on tablet 1f895d2ed89b48cc856a4b80cdde3073 from peer cd669586cff44d4bbfcc007e213faab6 at {username='slave'} at 127.0.0.1:35278: session id = cd669586cff44d4bbfcc007e213faab6-1f895d2ed89b48cc856a4b80cdde3073
I20260709 13:08:16.131305 30561 tablet_copy_source_session.cc:215] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:16.135830 31568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f895d2ed89b48cc856a4b80cdde3073. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.150657 31568 tablet_copy_client.cc:806] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:16.151170 31568 tablet_copy_client.cc:670] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:16.154389 31568 tablet_copy_client.cc:538] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:16.160893 31568 tablet_bootstrap.cc:492] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6: Bootstrap starting.
I20260709 13:08:16.175000 31573 ts_tablet_manager.cc:933] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6: Initiating tablet copy from peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:16.177157 31573 tablet_copy_client.cc:323] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6: tablet copy: Beginning tablet copy session from remote peer at address 127.28.173.3:32851
I20260709 13:08:16.179208 30634 tablet_copy_service.cc:140] P fe2b7d73f8c743c1ba570cfd981c4e79: Received BeginTabletCopySession request for tablet 48914655f9d44751a883e36b566dcefd from peer cd669586cff44d4bbfcc007e213faab6 ({username='slave'} at 127.0.0.1:57140)
I20260709 13:08:16.179734 30634 tablet_copy_service.cc:161] P fe2b7d73f8c743c1ba570cfd981c4e79: Beginning new tablet copy session on tablet 48914655f9d44751a883e36b566dcefd from peer cd669586cff44d4bbfcc007e213faab6 at {username='slave'} at 127.0.0.1:57140: session id = cd669586cff44d4bbfcc007e213faab6-48914655f9d44751a883e36b566dcefd
I20260709 13:08:16.191684 31568 tablet_bootstrap.cc:492] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:16.192936 31568 tablet_bootstrap.cc:492] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6: Bootstrap complete.
I20260709 13:08:16.193487 31568 ts_tablet_manager.cc:1403] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6: Time spent bootstrapping tablet: real 0.033s	user 0.018s	sys 0.003s
I20260709 13:08:16.196329 31568 raft_consensus.cc:359] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:16.197188 31568 raft_consensus.cc:740] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Initialized, Role: LEARNER
I20260709 13:08:16.198897 31568 consensus_queue.cc:260] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:16.200964 31568 ts_tablet_manager.cc:1434] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:08:16.204030 30561 tablet_copy_service.cc:342] P 092f6eb694fc4bbeab49677cccd880fd: Request end of tablet copy session cd669586cff44d4bbfcc007e213faab6-1f895d2ed89b48cc856a4b80cdde3073 received from {username='slave'} at 127.0.0.1:35278
I20260709 13:08:16.204416 30561 tablet_copy_service.cc:434] P 092f6eb694fc4bbeab49677cccd880fd: ending tablet copy session cd669586cff44d4bbfcc007e213faab6-1f895d2ed89b48cc856a4b80cdde3073 on tablet 1f895d2ed89b48cc856a4b80cdde3073 with peer cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:16.204497 30634 tablet_copy_source_session.cc:215] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:16.211786 31573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48914655f9d44751a883e36b566dcefd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.220300 31568 ts_tablet_manager.cc:933] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6: Initiating tablet copy from peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:16.222168 31568 tablet_copy_client.cc:323] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Beginning tablet copy session from remote peer at address 127.28.173.2:34733
I20260709 13:08:16.223701 30561 tablet_copy_service.cc:140] P 092f6eb694fc4bbeab49677cccd880fd: Received BeginTabletCopySession request for tablet 7f8b6eff35aa4b96bf5f73d6a94db695 from peer cd669586cff44d4bbfcc007e213faab6 ({username='slave'} at 127.0.0.1:35278)
I20260709 13:08:16.224279 30561 tablet_copy_service.cc:161] P 092f6eb694fc4bbeab49677cccd880fd: Beginning new tablet copy session on tablet 7f8b6eff35aa4b96bf5f73d6a94db695 from peer cd669586cff44d4bbfcc007e213faab6 at {username='slave'} at 127.0.0.1:35278: session id = cd669586cff44d4bbfcc007e213faab6-7f8b6eff35aa4b96bf5f73d6a94db695
I20260709 13:08:16.231459 30561 tablet_copy_source_session.cc:215] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:16.233034 31573 tablet_copy_client.cc:806] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:16.233611 31573 tablet_copy_client.cc:670] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:16.235771 31568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f8b6eff35aa4b96bf5f73d6a94db695. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.237545 31573 tablet_copy_client.cc:538] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:16.247298 31573 tablet_bootstrap.cc:492] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6: Bootstrap starting.
I20260709 13:08:16.255339 31568 tablet_copy_client.cc:806] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:16.256862 31568 tablet_copy_client.cc:670] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:16.273821 31573 tablet_bootstrap.cc:492] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:16.271893 31568 tablet_copy_client.cc:538] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:16.275782 31573 tablet_bootstrap.cc:492] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6: Bootstrap complete.
I20260709 13:08:16.276546 31573 ts_tablet_manager.cc:1403] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.008s
I20260709 13:08:16.279577 31573 raft_consensus.cc:359] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:16.280483 31573 raft_consensus.cc:740] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Initialized, Role: LEARNER
I20260709 13:08:16.281147 31573 consensus_queue.cc:260] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:16.284447 31568 tablet_bootstrap.cc:492] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6: Bootstrap starting.
I20260709 13:08:16.287274 31573 ts_tablet_manager.cc:1434] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.002s
I20260709 13:08:16.288914 30634 tablet_copy_service.cc:342] P fe2b7d73f8c743c1ba570cfd981c4e79: Request end of tablet copy session cd669586cff44d4bbfcc007e213faab6-48914655f9d44751a883e36b566dcefd received from {username='slave'} at 127.0.0.1:57140
I20260709 13:08:16.289327 30634 tablet_copy_service.cc:434] P fe2b7d73f8c743c1ba570cfd981c4e79: ending tablet copy session cd669586cff44d4bbfcc007e213faab6-48914655f9d44751a883e36b566dcefd on tablet 48914655f9d44751a883e36b566dcefd with peer cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:16.326009 31568 tablet_bootstrap.cc:492] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:16.326972 31568 tablet_bootstrap.cc:492] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6: Bootstrap complete.
I20260709 13:08:16.327739 31568 ts_tablet_manager.cc:1403] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6: Time spent bootstrapping tablet: real 0.044s	user 0.024s	sys 0.005s
I20260709 13:08:16.330471 31568 raft_consensus.cc:359] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:16.331228 31568 raft_consensus.cc:740] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Initialized, Role: LEARNER
I20260709 13:08:16.332211 31568 consensus_queue.cc:260] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:16.336634 31568 ts_tablet_manager.cc:1434] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:08:16.337972 30561 tablet_copy_service.cc:342] P 092f6eb694fc4bbeab49677cccd880fd: Request end of tablet copy session cd669586cff44d4bbfcc007e213faab6-7f8b6eff35aa4b96bf5f73d6a94db695 received from {username='slave'} at 127.0.0.1:35278
I20260709 13:08:16.338328 30561 tablet_copy_service.cc:434] P 092f6eb694fc4bbeab49677cccd880fd: ending tablet copy session cd669586cff44d4bbfcc007e213faab6-7f8b6eff35aa4b96bf5f73d6a94db695 on tablet 7f8b6eff35aa4b96bf5f73d6a94db695 with peer cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:16.575687 31150 raft_consensus.cc:1217] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:16.596024 31150 raft_consensus.cc:1217] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:16.648828 31149 raft_consensus.cc:1217] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:16.768043 31150 raft_consensus.cc:1217] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:17.120885 31545 raft_consensus.cc:1064] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79: attempting to promote NON_VOTER cd669586cff44d4bbfcc007e213faab6 to VOTER
I20260709 13:08:17.123236 31545 consensus_queue.cc:237] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:17.132447 31150 raft_consensus.cc:1275] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:17.832968 30551 raft_consensus.cc:1275] T 48914655f9d44751a883e36b566dcefd P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:08:17.860956 30572 debug-util.cc:398] Leaking SignalData structure 0x7b08002ec500 after lost signal to thread 29367
W20260709 13:08:17.861963 30572 debug-util.cc:398] Leaking SignalData structure 0x7b080030f320 after lost signal to thread 30408
W20260709 13:08:17.863027 30572 debug-util.cc:398] Leaking SignalData structure 0x7b08000d5660 after lost signal to thread 30500
W20260709 13:08:17.877487 30572 debug-util.cc:398] Leaking SignalData structure 0x7b0800044600 after lost signal to thread 30575
W20260709 13:08:17.879127 30572 debug-util.cc:398] Leaking SignalData structure 0x7b08002f8600 after lost signal to thread 30649
W20260709 13:08:17.884888 30572 debug-util.cc:398] Leaking SignalData structure 0x7b08000452c0 after lost signal to thread 31175
W20260709 13:08:17.886049 30572 debug-util.cc:398] Leaking SignalData structure 0x7b08002fec00 after lost signal to thread 31558
I20260709 13:08:17.916052 30472 raft_consensus.cc:1275] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:08:17.943631 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 79392us
I20260709 13:08:17.967176 31609 raft_consensus.cc:1064] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd: attempting to promote NON_VOTER cd669586cff44d4bbfcc007e213faab6 to VOTER
I20260709 13:08:17.943341 31605 consensus_queue.cc:1048] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:08:17.976851 31601 consensus_queue.cc:1048] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:17.978053 31598 consensus_queue.cc:1048] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:17.967483 31610 raft_consensus.cc:1064] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd: attempting to promote NON_VOTER cd669586cff44d4bbfcc007e213faab6 to VOTER
I20260709 13:08:17.983126 31610 consensus_queue.cc:237] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:18.005470 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 66992.2us
W20260709 13:08:18.009563 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 70716.7us
I20260709 13:08:18.010761 31616 raft_consensus.cc:1064] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd: attempting to promote NON_VOTER cd669586cff44d4bbfcc007e213faab6 to VOTER
W20260709 13:08:18.016155 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 75546.3us
I20260709 13:08:18.028574 31609 consensus_queue.cc:237] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:18.039201 31616 consensus_queue.cc:237] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:18.054349 31147 raft_consensus.cc:1275] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:18.056031 31592 consensus_queue.cc:1048] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:08:18.064381 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 92590.5us
I20260709 13:08:18.069366 30625 raft_consensus.cc:1275] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:18.069794 30469 raft_consensus.cc:1275] T 1f895d2ed89b48cc856a4b80cdde3073 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:18.071084 31151 raft_consensus.cc:1275] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:18.073629 31589 consensus_queue.cc:1048] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:18.082028 30469 raft_consensus.cc:1275] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:18.084340 30625 raft_consensus.cc:1275] T 7f8b6eff35aa4b96bf5f73d6a94db695 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:18.099007 31592 consensus_queue.cc:1048] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:18.100347 31597 consensus_queue.cc:1048] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:18.104648 31150 raft_consensus.cc:1275] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:18.106019 30619 raft_consensus.cc:1275] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:18.106323 31613 consensus_queue.cc:1048] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:18.111702 31602 consensus_queue.cc:1048] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:08:18.118594 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 113196us
I20260709 13:08:18.137748 31613 consensus_queue.cc:1048] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:18.140312 31613 consensus_queue.cc:1048] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:08:18.156965 31616 raft_consensus.cc:2955] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:18.172915 30474 raft_consensus.cc:1275] T 606c3ee77596493da2daa40edde4d1ea P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:18.179222 31150 raft_consensus.cc:2955] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:18.206950 30619 raft_consensus.cc:2955] T 7f8b6eff35aa4b96bf5f73d6a94db695 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:18.244958 31613 raft_consensus.cc:2955] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:18.251879 30550 raft_consensus.cc:2955] T 48914655f9d44751a883e36b566dcefd P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:18.197645 31619 raft_consensus.cc:2955] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:18.216686 31609 consensus_queue.cc:1048] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:08:18.256989 31147 raft_consensus.cc:2955] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:18.272332 30373 catalog_manager.cc:5697] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:18.276384 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 66313us
I20260709 13:08:18.321743 30476 raft_consensus.cc:2955] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:18.330914 30474 raft_consensus.cc:2955] T 1f895d2ed89b48cc856a4b80cdde3073 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:18.373020 30625 raft_consensus.cc:2955] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:18.428133 30619 raft_consensus.cc:2955] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:18.423141 31613 raft_consensus.cc:2955] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:18.487176 30469 raft_consensus.cc:2955] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:18.500556 31151 raft_consensus.cc:2955] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:18.524439 31150 raft_consensus.cc:2955] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:18.587103 30374 catalog_manager.cc:5697] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 reported cstate change: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:18.594000 30374 catalog_manager.cc:5697] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:18.602550 30374 catalog_manager.cc:5697] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 reported cstate change: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:18.611105 30469 raft_consensus.cc:2955] T 606c3ee77596493da2daa40edde4d1ea P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:18.629498 30625 consensus_queue.cc:237] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:18.633443 30547 consensus_queue.cc:237] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:18.633622 30550 consensus_queue.cc:237] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:18.636893 31150 raft_consensus.cc:1275] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:18.640681 31151 raft_consensus.cc:1275] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:18.641413 31619 consensus_queue.cc:1048] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:18.649500 31613 consensus_queue.cc:1048] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:18.650151 30618 raft_consensus.cc:1275] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:18.650379 31147 raft_consensus.cc:1275] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:18.651854 31608 consensus_queue.cc:1048] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:18.653645 31608 consensus_queue.cc:1048] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:18.653172 31601 raft_consensus.cc:2955] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:18.655030 31150 raft_consensus.cc:2955] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:18.661700 31608 raft_consensus.cc:2955] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:18.665822 30360 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 48914655f9d44751a883e36b566dcefd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:18.677729 31151 raft_consensus.cc:2955] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:18.668336 30618 raft_consensus.cc:2955] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:18.683624 30550 consensus_queue.cc:237] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:18.686801 30471 raft_consensus.cc:1275] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:18.668244 31611 raft_consensus.cc:2955] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:18.677681 31147 raft_consensus.cc:2955] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:18.694116 30471 raft_consensus.cc:1275] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:18.700506 31601 consensus_queue.cc:1048] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:18.702330 30374 catalog_manager.cc:5697] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 reported cstate change: config changed from index 3 to 4, VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) evicted. New cstate: current_term: 1 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:18.709662 31609 consensus_queue.cc:1048] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:18.714907 31151 raft_consensus.cc:1275] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:18.715039 30469 raft_consensus.cc:2955] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:18.716452 31597 consensus_queue.cc:1048] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:18.721829 30541 tablet_service.cc:1558] Processing DeleteTablet for tablet 48914655f9d44751a883e36b566dcefd with delete_type TABLET_DATA_TOMBSTONED (TS 092f6eb694fc4bbeab49677cccd880fd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43082
I20260709 13:08:18.731472 30359 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7f8b6eff35aa4b96bf5f73d6a94db695 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:18.732273 30359 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1f895d2ed89b48cc856a4b80cdde3073 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:08:18.741160 30646 debug-util.cc:398] Leaking SignalData structure 0x7b08000b11c0 after lost signal to thread 29367
W20260709 13:08:18.742123 30646 debug-util.cc:398] Leaking SignalData structure 0x7b08000f08c0 after lost signal to thread 30408
W20260709 13:08:18.743204 30646 debug-util.cc:398] Leaking SignalData structure 0x7b080032ad40 after lost signal to thread 30500
W20260709 13:08:18.744433 30646 debug-util.cc:398] Leaking SignalData structure 0x7b080025f960 after lost signal to thread 30575
W20260709 13:08:18.746412 30646 debug-util.cc:398] Leaking SignalData structure 0x7b080021eea0 after lost signal to thread 30649
W20260709 13:08:18.748274 30646 debug-util.cc:398] Leaking SignalData structure 0x7b0800295fe0 after lost signal to thread 31175
I20260709 13:08:18.736665 30618 raft_consensus.cc:1275] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:18.751489 30374 catalog_manager.cc:5697] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: config changed from index 3 to 4, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:18.756192 30471 raft_consensus.cc:2955] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:18.779580 31608 consensus_queue.cc:1048] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:18.791941 31611 raft_consensus.cc:2955] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:18.798091 30625 raft_consensus.cc:2955] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:18.758493 30374 catalog_manager.cc:5697] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: config changed from index 3 to 4, VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) evicted. New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:18.832746 31151 raft_consensus.cc:2955] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:18.836299 31644 tablet_replica.cc:333] T 48914655f9d44751a883e36b566dcefd P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:08:18.842566 31644 raft_consensus.cc:2243] T 48914655f9d44751a883e36b566dcefd P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:18.843309 31644 raft_consensus.cc:2272] T 48914655f9d44751a883e36b566dcefd P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:18.858753 30359 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 606c3ee77596493da2daa40edde4d1ea with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:18.870713 31644 ts_tablet_manager.cc:1916] T 48914655f9d44751a883e36b566dcefd P 092f6eb694fc4bbeab49677cccd880fd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:18.869686 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:18.906179 31644 ts_tablet_manager.cc:1929] T 48914655f9d44751a883e36b566dcefd P 092f6eb694fc4bbeab49677cccd880fd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:18.906715 31644 log.cc:1199] T 48914655f9d44751a883e36b566dcefd P 092f6eb694fc4bbeab49677cccd880fd: Deleting WAL directory at /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-1-root/wals/48914655f9d44751a883e36b566dcefd
I20260709 13:08:18.910538 30359 catalog_manager.cc:5028] TS 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): tablet 48914655f9d44751a883e36b566dcefd (table test-workload [id=887057791fed41a884abbab3e8d4b49f]) successfully deleted
I20260709 13:08:18.911680 30464 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f895d2ed89b48cc856a4b80cdde3073 with delete_type TABLET_DATA_TOMBSTONED (TS f639301059e24dc5b0d88a46dc683326 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53858
I20260709 13:08:18.920145 30612 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f8b6eff35aa4b96bf5f73d6a94db695 with delete_type TABLET_DATA_TOMBSTONED (TS fe2b7d73f8c743c1ba570cfd981c4e79 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36118
I20260709 13:08:18.932940 30372 catalog_manager.cc:5697] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 reported cstate change: config changed from index 3 to 4, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:18.980075 31646 tablet_replica.cc:333] T 7f8b6eff35aa4b96bf5f73d6a94db695 P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:08:18.982005 31646 raft_consensus.cc:2243] T 7f8b6eff35aa4b96bf5f73d6a94db695 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:18.982741 31646 raft_consensus.cc:2272] T 7f8b6eff35aa4b96bf5f73d6a94db695 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:18.980902 31645 tablet_replica.cc:333] T 1f895d2ed89b48cc856a4b80cdde3073 P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:08:18.984367 31645 raft_consensus.cc:2243] T 1f895d2ed89b48cc856a4b80cdde3073 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:18.985148 31645 raft_consensus.cc:2272] T 1f895d2ed89b48cc856a4b80cdde3073 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:18.995893 31646 ts_tablet_manager.cc:1916] T 7f8b6eff35aa4b96bf5f73d6a94db695 P fe2b7d73f8c743c1ba570cfd981c4e79: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:18.992942 30464 tablet_service.cc:1558] Processing DeleteTablet for tablet 606c3ee77596493da2daa40edde4d1ea with delete_type TABLET_DATA_TOMBSTONED (TS f639301059e24dc5b0d88a46dc683326 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53858
I20260709 13:08:19.003973 31645 ts_tablet_manager.cc:1916] T 1f895d2ed89b48cc856a4b80cdde3073 P f639301059e24dc5b0d88a46dc683326: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:19.049866 31646 ts_tablet_manager.cc:1929] T 7f8b6eff35aa4b96bf5f73d6a94db695 P fe2b7d73f8c743c1ba570cfd981c4e79: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:19.050488 31646 log.cc:1199] T 7f8b6eff35aa4b96bf5f73d6a94db695 P fe2b7d73f8c743c1ba570cfd981c4e79: Deleting WAL directory at /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-2-root/wals/7f8b6eff35aa4b96bf5f73d6a94db695
I20260709 13:08:19.052877 30360 catalog_manager.cc:5028] TS fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): tablet 7f8b6eff35aa4b96bf5f73d6a94db695 (table test-workload [id=887057791fed41a884abbab3e8d4b49f]) successfully deleted
I20260709 13:08:19.070429 31645 ts_tablet_manager.cc:1929] T 1f895d2ed89b48cc856a4b80cdde3073 P f639301059e24dc5b0d88a46dc683326: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:19.070976 31645 log.cc:1199] T 1f895d2ed89b48cc856a4b80cdde3073 P f639301059e24dc5b0d88a46dc683326: Deleting WAL directory at /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-0-root/wals/1f895d2ed89b48cc856a4b80cdde3073
I20260709 13:08:19.074028 30550 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
mode: GRACEFUL
new_leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
 from {username='slave'} at 127.0.0.1:45906
I20260709 13:08:19.074455 30361 catalog_manager.cc:5028] TS f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): tablet 1f895d2ed89b48cc856a4b80cdde3073 (table test-workload [id=887057791fed41a884abbab3e8d4b49f]) successfully deleted
I20260709 13:08:19.074744 30550 raft_consensus.cc:606] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Received request to transfer leadership to TS fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:19.074998 31645 tablet_replica.cc:333] T 606c3ee77596493da2daa40edde4d1ea P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:08:19.077214 31645 raft_consensus.cc:2243] T 606c3ee77596493da2daa40edde4d1ea P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:19.077904 31645 raft_consensus.cc:2272] T 606c3ee77596493da2daa40edde4d1ea P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.086315 31645 ts_tablet_manager.cc:1916] T 606c3ee77596493da2daa40edde4d1ea P f639301059e24dc5b0d88a46dc683326: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:19.132088 31645 ts_tablet_manager.cc:1929] T 606c3ee77596493da2daa40edde4d1ea P f639301059e24dc5b0d88a46dc683326: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:19.132766 30469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5"
dest_uuid: "f639301059e24dc5b0d88a46dc683326"
mode: GRACEFUL
new_leader_uuid: "cd669586cff44d4bbfcc007e213faab6"
 from {username='slave'} at 127.0.0.1:38176
I20260709 13:08:19.134073 30469 raft_consensus.cc:606] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Received request to transfer leadership to TS cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:19.135241 31645 log.cc:1199] T 606c3ee77596493da2daa40edde4d1ea P f639301059e24dc5b0d88a46dc683326: Deleting WAL directory at /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-0-root/wals/606c3ee77596493da2daa40edde4d1ea
I20260709 13:08:19.137120 30550 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
mode: GRACEFUL
new_leader_uuid: "cd669586cff44d4bbfcc007e213faab6"
 from {username='slave'} at 127.0.0.1:45906
I20260709 13:08:19.137712 30550 raft_consensus.cc:606] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Received request to transfer leadership to TS cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:19.138099 30361 catalog_manager.cc:5028] TS f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): tablet 606c3ee77596493da2daa40edde4d1ea (table test-workload [id=887057791fed41a884abbab3e8d4b49f]) successfully deleted
I20260709 13:08:19.140235 30550 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
mode: GRACEFUL
new_leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
 from {username='slave'} at 127.0.0.1:45906
I20260709 13:08:19.140829 30550 raft_consensus.cc:606] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Received request to transfer leadership to TS fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:19.144917 30550 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
mode: GRACEFUL
new_leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
 from {username='slave'} at 127.0.0.1:45906
I20260709 13:08:19.145527 30550 raft_consensus.cc:606] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 2 LEADER]: Received request to transfer leadership to TS fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:19.148489 30550 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
mode: GRACEFUL
new_leader_uuid: "cd669586cff44d4bbfcc007e213faab6"
 from {username='slave'} at 127.0.0.1:45906
I20260709 13:08:19.149086 30550 raft_consensus.cc:606] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Received request to transfer leadership to TS cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:19.150590 29364 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:08:19.152318 29364 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:19.177657 31593 raft_consensus.cc:993] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326: : Instructing follower cd669586cff44d4bbfcc007e213faab6 to start an election
I20260709 13:08:19.178228 31593 raft_consensus.cc:1081] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Signalling peer cd669586cff44d4bbfcc007e213faab6 to start an election
I20260709 13:08:19.179888 31151 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5"
dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
 from {username='slave'} at 127.0.0.1:48412
I20260709 13:08:19.180464 31151 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:19.180795 31151 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:19.187417 31151 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:19.190882 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:19.191577 30469 raft_consensus.cc:3055] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:19.191915 30469 raft_consensus.cc:740] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:19.192770 30469 consensus_queue.cc:260] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:19.194057 30469 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:19.197582 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:19.198230 30550 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:19.201517 30469 raft_consensus.cc:2468] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 2.
I20260709 13:08:19.202956 31116 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:19.204600 31638 raft_consensus.cc:2804] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:19.201325 31151 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:19.212898 31638 raft_consensus.cc:697] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:19.214080 31638 consensus_queue.cc:237] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:19.218869 30550 raft_consensus.cc:2468] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 2.
I20260709 13:08:19.238646 30374 catalog_manager.cc:5697] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 1 to 2, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 2 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:19.251353 31613 raft_consensus.cc:993] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd: : Instructing follower fe2b7d73f8c743c1ba570cfd981c4e79 to start an election
I20260709 13:08:19.251993 31613 raft_consensus.cc:1081] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Signalling peer fe2b7d73f8c743c1ba570cfd981c4e79 to start an election
I20260709 13:08:19.253857 30623 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4"
dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
 from {username='slave'} at 127.0.0.1:47446
I20260709 13:08:19.254403 30623 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:19.254732 30623 raft_consensus.cc:3060] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:19.272488 30623 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:19.280249 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:19.280938 30469 raft_consensus.cc:3060] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:19.288623 30469 raft_consensus.cc:2468] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 2.
I20260709 13:08:19.290727 30591 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:19.291522 31619 raft_consensus.cc:2804] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:19.292001 31619 raft_consensus.cc:697] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:19.292796 31619 consensus_queue.cc:237] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:19.289363 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:19.314261 30550 raft_consensus.cc:3055] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:19.317544 30550 raft_consensus.cc:740] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:19.321152 30623 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:19.319150 30550 consensus_queue.cc:260] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:19.324177 30550 raft_consensus.cc:3060] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:19.349864 31587 raft_consensus.cc:993] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd: : Instructing follower cd669586cff44d4bbfcc007e213faab6 to start an election
I20260709 13:08:19.355587 31613 raft_consensus.cc:1081] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Signalling peer cd669586cff44d4bbfcc007e213faab6 to start an election
I20260709 13:08:19.358165 31151 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67"
dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
 from {username='slave'} at 127.0.0.1:48426
I20260709 13:08:19.358755 31151 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:19.359268 31151 raft_consensus.cc:3060] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:19.369729 31151 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:19.377478 30374 catalog_manager.cc:5697] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 1 to 2, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 2 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:19.379182 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:19.379761 30476 raft_consensus.cc:3060] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:19.393963 30476 raft_consensus.cc:2468] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 2.
I20260709 13:08:19.394912 31116 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:19.395656 31638 raft_consensus.cc:2804] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:19.396955 31151 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:19.396893 31638 raft_consensus.cc:697] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:19.398981 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:19.399379 30550 raft_consensus.cc:2468] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 2.
I20260709 13:08:19.399597 30546 raft_consensus.cc:3055] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:19.399904 30546 raft_consensus.cc:740] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:19.400571 30546 consensus_queue.cc:260] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:19.401649 30546 raft_consensus.cc:3060] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:19.398029 31638 consensus_queue.cc:237] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:19.422641 30546 raft_consensus.cc:2468] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 2.
I20260709 13:08:19.431665 31609 raft_consensus.cc:993] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd: : Instructing follower fe2b7d73f8c743c1ba570cfd981c4e79 to start an election
I20260709 13:08:19.432224 31609 raft_consensus.cc:1081] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Signalling peer fe2b7d73f8c743c1ba570cfd981c4e79 to start an election
I20260709 13:08:19.434998 31587 raft_consensus.cc:993] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd: : Instructing follower cd669586cff44d4bbfcc007e213faab6 to start an election
I20260709 13:08:19.435541 31587 raft_consensus.cc:1081] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Signalling peer cd669586cff44d4bbfcc007e213faab6 to start an election
I20260709 13:08:19.443050 31147 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a"
dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
 from {username='slave'} at 127.0.0.1:48426
I20260709 13:08:19.443708 31147 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:19.444202 31147 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:19.460775 30623 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c"
dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
 from {username='slave'} at 127.0.0.1:47446
I20260709 13:08:19.461386 30623 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:19.461716 30623 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:19.462849 31147 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:19.466974 31147 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:19.467751 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:19.468459 30625 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:19.475433 30625 raft_consensus.cc:2468] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 2.
I20260709 13:08:19.476660 31115 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:19.477504 31638 raft_consensus.cc:2804] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:19.478049 31638 raft_consensus.cc:697] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:19.478953 31638 consensus_queue.cc:237] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:19.485966 30623 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:19.488780 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:19.489316 30476 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:19.498206 30476 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 2.
I20260709 13:08:19.505591 30374 catalog_manager.cc:5697] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 1 to 2, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 2 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:19.507264 30591 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:19.516731 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:19.521076 30546 raft_consensus.cc:3055] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:19.521385 30546 raft_consensus.cc:740] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:19.522185 30546 consensus_queue.cc:260] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:19.523520 30546 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:19.529709 31601 raft_consensus.cc:2804] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:19.530249 31601 raft_consensus.cc:697] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:19.531138 31601 consensus_queue.cc:237] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:19.552399 30623 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:19.565336 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:19.565937 30550 raft_consensus.cc:3055] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:19.566215 30550 raft_consensus.cc:740] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:19.567098 30550 consensus_queue.cc:260] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:19.568451 30550 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:19.574262 30372 catalog_manager.cc:5697] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 1 to 2, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 2 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:19.581243 30546 raft_consensus.cc:2468] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 2.
I20260709 13:08:19.583119 30374 catalog_manager.cc:5697] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 1 to 2, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 2 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:19.605103 31608 raft_consensus.cc:993] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd: : Instructing follower fe2b7d73f8c743c1ba570cfd981c4e79 to start an election
I20260709 13:08:19.605562 31608 raft_consensus.cc:1081] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 2 LEADER]: Signalling peer fe2b7d73f8c743c1ba570cfd981c4e79 to start an election
I20260709 13:08:19.607450 30550 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 2.
I20260709 13:08:19.609189 30547 raft_consensus.cc:1275] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:19.611061 30625 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4"
dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
 from {username='slave'} at 127.0.0.1:47446
I20260709 13:08:19.612280 30625 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:19.612648 30625 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:19.613319 31638 consensus_queue.cc:1048] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:19.618974 30625 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:19.624469 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:19.625015 30469 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:19.633795 30469 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:19.635041 30591 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:19.634995 30625 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:19.635944 31601 raft_consensus.cc:2804] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:19.642083 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:19.642259 31601 raft_consensus.cc:697] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:19.642635 30546 raft_consensus.cc:3055] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:19.642937 30546 raft_consensus.cc:740] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:19.643155 31601 consensus_queue.cc:237] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:19.643684 30546 consensus_queue.cc:260] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:19.645007 30546 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:19.686012 30469 raft_consensus.cc:1275] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:19.696583 31619 consensus_queue.cc:1048] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:19.683781 30374 catalog_manager.cc:5697] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 2 to 3, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 3 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:19.672125 30546 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:19.731087 30469 raft_consensus.cc:1275] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:19.732901 31650 consensus_queue.cc:1048] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:19.759989 30551 raft_consensus.cc:1275] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:19.763979 31601 consensus_queue.cc:1048] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:19.922531 30469 raft_consensus.cc:1275] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:19.924077 31638 consensus_queue.cc:1048] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:19.935297 30551 raft_consensus.cc:1275] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:19.944407 30551 raft_consensus.cc:1275] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:19.945281 31638 consensus_queue.cc:1048] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:19.947490 31638 consensus_queue.cc:1048] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:19.981810 30625 raft_consensus.cc:1275] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:19.983655 31650 consensus_queue.cc:1048] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:20.072104 30546 raft_consensus.cc:1275] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:20.073524 31619 consensus_queue.cc:1048] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:20.087790 30476 raft_consensus.cc:1275] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:20.089408 31601 consensus_queue.cc:1048] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:20.093035 30469 raft_consensus.cc:1275] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:20.094421 31601 consensus_queue.cc:1048] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:20.100644 30551 consensus_queue.cc:237] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:20.125252 30550 raft_consensus.cc:1275] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:20.129578 31674 consensus_queue.cc:1048] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:20.153491 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:20.356851 30469 raft_consensus.cc:1275] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:20.358636 31607 consensus_queue.cc:1048] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:08:20.362267 30516 consensus_peers.cc:597] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd -> Peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453): Couldn't send request to peer cd669586cff44d4bbfcc007e213faab6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 80cbe47dd35948b8b10070e934216d98. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:20.362653 30625 raft_consensus.cc:1275] T 80cbe47dd35948b8b10070e934216d98 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:20.371938 31613 consensus_queue.cc:1048] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:20.381556 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:20.395548 31613 raft_consensus.cc:2955] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:20.402290 30625 raft_consensus.cc:2955] T 80cbe47dd35948b8b10070e934216d98 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:20.414314 30372 catalog_manager.cc:5697] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:20.419394 30623 consensus_queue.cc:237] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:20.432947 30476 raft_consensus.cc:2955] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:20.448865 30551 raft_consensus.cc:1275] T cb22806325394ba386d8549bc4a64701 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:20.452735 30590 consensus_peers.cc:597] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453): Couldn't send request to peer cd669586cff44d4bbfcc007e213faab6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cb22806325394ba386d8549bc4a64701. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:20.453299 31675 consensus_queue.cc:1048] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:20.460088 30469 raft_consensus.cc:1275] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:20.461639 31675 consensus_queue.cc:1048] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:20.491533 30546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
mode: GRACEFUL
new_leader_uuid: "cd669586cff44d4bbfcc007e213faab6"
 from {username='slave'} at 127.0.0.1:45906
I20260709 13:08:20.492162 30546 raft_consensus.cc:606] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Received request to transfer leadership to TS cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:20.490644 31675 raft_consensus.cc:2955] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:20.493352 30547 raft_consensus.cc:2955] T cb22806325394ba386d8549bc4a64701 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:20.506083 30550 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a418ef882d34180817469c4e2495268"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
mode: GRACEFUL
new_leader_uuid: "cd669586cff44d4bbfcc007e213faab6"
 from {username='slave'} at 127.0.0.1:45906
I20260709 13:08:20.506675 30550 raft_consensus.cc:606] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Received request to transfer leadership to TS cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:20.512034 30469 raft_consensus.cc:2955] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:20.513775 30476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31"
dest_uuid: "f639301059e24dc5b0d88a46dc683326"
mode: GRACEFUL
new_leader_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:38176
I20260709 13:08:20.514777 30476 raft_consensus.cc:606] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Received request to transfer leadership to TS 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:20.518563 30373 catalog_manager.cc:5697] T cb22806325394ba386d8549bc4a64701 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New cstate: current_term: 1 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:20.531075 30618 consensus_queue.cc:237] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:20.556156 30546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
mode: GRACEFUL
new_leader_uuid: "cd669586cff44d4bbfcc007e213faab6"
 from {username='slave'} at 127.0.0.1:45906
I20260709 13:08:20.556705 30546 raft_consensus.cc:606] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Received request to transfer leadership to TS cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:20.558034 31678 raft_consensus.cc:993] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326: : Instructing follower 092f6eb694fc4bbeab49677cccd880fd to start an election
I20260709 13:08:20.558481 31678 raft_consensus.cc:1081] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Signalling peer 092f6eb694fc4bbeab49677cccd880fd to start an election
I20260709 13:08:20.564378 30546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
mode: GRACEFUL
new_leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
 from {username='slave'} at 127.0.0.1:45906
I20260709 13:08:20.564942 30546 raft_consensus.cc:606] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Received request to transfer leadership to TS fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:20.570815 30547 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:43088
I20260709 13:08:20.571434 30547 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:20.571846 30547 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:20.578699 30547 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:20.582644 30546 raft_consensus.cc:1275] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:20.586274 31675 consensus_queue.cc:1048] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:20.586290 30469 raft_consensus.cc:1275] T ee49a377a80e4f4199281fb5e44d3be6 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:20.589710 31619 consensus_queue.cc:1048] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:20.592025 30547 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:20.593819 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:20.594377 30467 raft_consensus.cc:3055] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:20.594660 30467 raft_consensus.cc:740] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
W20260709 13:08:20.595925 30590 consensus_peers.cc:597] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453): Couldn't send request to peer cd669586cff44d4bbfcc007e213faab6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ee49a377a80e4f4199281fb5e44d3be6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:20.595440 30467 consensus_queue.cc:260] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:20.599632 30467 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:20.593133 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:20.608134 30618 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:20.613530 31598 raft_consensus.cc:2955] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:20.632433 30546 raft_consensus.cc:2955] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:20.637040 30625 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4"
dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
mode: GRACEFUL
new_leader_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:49382
I20260709 13:08:20.637632 30625 raft_consensus.cc:606] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 LEADER]: Received request to transfer leadership to TS 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:20.638928 29364 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:08:20.640522 29364 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:20.617250 30467 raft_consensus.cc:2468] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 2.
I20260709 13:08:20.644347 30618 raft_consensus.cc:2468] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 2.
I20260709 13:08:20.647514 30516 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:20.648819 31613 raft_consensus.cc:2804] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:20.649319 31613 raft_consensus.cc:697] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 2 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:20.650162 31613 consensus_queue.cc:237] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:20.660104 30473 raft_consensus.cc:2955] T ee49a377a80e4f4199281fb5e44d3be6 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:20.663637 30371 catalog_manager.cc:5697] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New cstate: current_term: 1 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:20.714303 31598 raft_consensus.cc:993] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79: : Instructing follower 092f6eb694fc4bbeab49677cccd880fd to start an election
I20260709 13:08:20.714941 31598 raft_consensus.cc:1081] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 LEADER]: Signalling peer 092f6eb694fc4bbeab49677cccd880fd to start an election
I20260709 13:08:20.716923 30547 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:39952
I20260709 13:08:20.717576 30547 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:20.717984 30547 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:20.729347 30546 consensus_queue.cc:237] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:20.736382 30547 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:20.751233 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:20.751768 30469 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:20.761404 30371 catalog_manager.cc:5697] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 1 to 2, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 2 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:20.762560 30469 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:08:20.764017 30517 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:20.764899 31613 raft_consensus.cc:2804] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:20.765311 31613 raft_consensus.cc:697] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:20.765998 31613 consensus_queue.cc:237] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:20.766561 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:20.767094 30618 raft_consensus.cc:3055] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:20.767381 30618 raft_consensus.cc:740] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:20.768358 30618 consensus_queue.cc:260] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:20.769626 30618 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:20.775122 30547 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:20.782689 30618 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:08:20.783012 31613 raft_consensus.cc:993] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd: : Instructing follower cd669586cff44d4bbfcc007e213faab6 to start an election
I20260709 13:08:20.783457 31613 raft_consensus.cc:1081] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Signalling peer cd669586cff44d4bbfcc007e213faab6 to start an election
I20260709 13:08:20.788113 30625 raft_consensus.cc:1275] T 541099fd564e49f2ad553f250f319fb0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:20.788723 30469 raft_consensus.cc:1275] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:20.792191 31613 consensus_queue.cc:1048] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:08:20.793359 30516 consensus_peers.cc:597] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd -> Peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453): Couldn't send request to peer cd669586cff44d4bbfcc007e213faab6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 541099fd564e49f2ad553f250f319fb0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:20.793744 31587 consensus_queue.cc:1048] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:20.794623 31147 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a418ef882d34180817469c4e2495268"
dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
 from {username='slave'} at 127.0.0.1:48426
I20260709 13:08:20.795251 31147 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:20.795620 31147 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:20.786875 30373 catalog_manager.cc:5697] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 3 to 4, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 4 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:20.806578 31147 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:20.812320 31147 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:20.814607 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:20.815490 30473 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:20.817941 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:20.818506 30546 raft_consensus.cc:3055] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:20.818781 30546 raft_consensus.cc:740] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:20.819458 30546 consensus_queue.cc:260] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:20.822239 30546 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:20.829828 30473 raft_consensus.cc:2468] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 2.
I20260709 13:08:20.834203 31116 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:20.835098 31638 raft_consensus.cc:2804] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:20.835588 31638 raft_consensus.cc:697] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:20.836452 31638 consensus_queue.cc:237] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:20.843622 31613 raft_consensus.cc:2955] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:20.844986 30618 raft_consensus.cc:2955] T 541099fd564e49f2ad553f250f319fb0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:20.844924 30546 raft_consensus.cc:2468] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 2.
I20260709 13:08:20.895171 30371 catalog_manager.cc:5697] T 541099fd564e49f2ad553f250f319fb0 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:20.904379 30473 raft_consensus.cc:2955] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:20.913383 30373 catalog_manager.cc:5697] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 1 to 2, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 2 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:20.930956 31699 ts_tablet_manager.cc:933] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6: Initiating tablet copy from peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:08:20.973963 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 51526.3us
I20260709 13:08:21.016324 31701 raft_consensus.cc:993] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd: : Instructing follower cd669586cff44d4bbfcc007e213faab6 to start an election
I20260709 13:08:21.016799 31701 raft_consensus.cc:1081] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Signalling peer cd669586cff44d4bbfcc007e213faab6 to start an election
I20260709 13:08:21.024003 31699 tablet_copy_client.cc:323] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Beginning tablet copy session from remote peer at address 127.28.173.2:34733
I20260709 13:08:21.027479 31147 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695"
dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
 from {username='slave'} at 127.0.0.1:48426
I20260709 13:08:21.028100 31147 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:21.028415 31147 raft_consensus.cc:3060] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.034965 30561 tablet_copy_service.cc:140] P 092f6eb694fc4bbeab49677cccd880fd: Received BeginTabletCopySession request for tablet 80cbe47dd35948b8b10070e934216d98 from peer cd669586cff44d4bbfcc007e213faab6 ({username='slave'} at 127.0.0.1:35278)
I20260709 13:08:21.035569 30561 tablet_copy_service.cc:161] P 092f6eb694fc4bbeab49677cccd880fd: Beginning new tablet copy session on tablet 80cbe47dd35948b8b10070e934216d98 from peer cd669586cff44d4bbfcc007e213faab6 at {username='slave'} at 127.0.0.1:35278: session id = cd669586cff44d4bbfcc007e213faab6-80cbe47dd35948b8b10070e934216d98
I20260709 13:08:21.045662 31700 raft_consensus.cc:993] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd: : Instructing follower fe2b7d73f8c743c1ba570cfd981c4e79 to start an election
I20260709 13:08:21.046214 30561 tablet_copy_source_session.cc:215] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:21.049844 31704 raft_consensus.cc:1081] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Signalling peer fe2b7d73f8c743c1ba570cfd981c4e79 to start an election
I20260709 13:08:21.051227 31700 raft_consensus.cc:993] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd: : Instructing follower cd669586cff44d4bbfcc007e213faab6 to start an election
I20260709 13:08:21.051829 31702 raft_consensus.cc:1081] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Signalling peer cd669586cff44d4bbfcc007e213faab6 to start an election
I20260709 13:08:21.052767 31147 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:21.053844 31699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80cbe47dd35948b8b10070e934216d98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.054950 31147 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:21.055512 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:21.056052 30473 raft_consensus.cc:3060] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.059043 31150 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914"
dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
 from {username='slave'} at 127.0.0.1:48426
I20260709 13:08:21.059549 31150 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:21.059865 31150 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.059974 30618 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278"
dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
 from {username='slave'} at 127.0.0.1:47446
I20260709 13:08:21.060626 30618 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:21.061065 30618 raft_consensus.cc:3060] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.067572 30618 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:21.072821 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:21.073161 31709 ts_tablet_manager.cc:933] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6: Initiating tablet copy from peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:21.073387 30546 raft_consensus.cc:3055] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:21.073697 30546 raft_consensus.cc:740] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:21.074553 30546 consensus_queue.cc:260] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:21.076064 30546 raft_consensus.cc:3060] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.076669 30473 raft_consensus.cc:2468] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 2.
I20260709 13:08:21.077843 31116 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:21.078606 31150 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:21.080818 31150 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:21.083971 31638 raft_consensus.cc:2804] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:21.084494 31638 raft_consensus.cc:697] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:21.085302 31638 consensus_queue.cc:237] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:21.089605 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:21.090369 30625 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.097249 31710 ts_tablet_manager.cc:933] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6: Initiating tablet copy from peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:21.104349 30618 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:21.104400 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:21.105257 30550 raft_consensus.cc:3055] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:21.105607 30550 raft_consensus.cc:740] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:21.106315 30550 consensus_queue.cc:260] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:21.106678 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:21.108603 30473 raft_consensus.cc:3060] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.116333 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:21.116972 30551 raft_consensus.cc:3055] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:21.117246 30551 raft_consensus.cc:740] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:21.117799 30473 raft_consensus.cc:2468] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 2.
I20260709 13:08:21.107398 30550 raft_consensus.cc:3060] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.117962 30551 consensus_queue.cc:260] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:21.119429 30551 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.119940 30591 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:21.121210 31708 raft_consensus.cc:2804] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:21.121708 31708 raft_consensus.cc:697] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:21.122756 31708 consensus_queue.cc:237] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:21.137212 30550 raft_consensus.cc:2468] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 2.
I20260709 13:08:21.138242 30551 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 2.
I20260709 13:08:21.143493 30621 raft_consensus.cc:1275] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:21.143507 30625 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 2.
I20260709 13:08:21.106487 31710 tablet_copy_client.cc:323] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Beginning tablet copy session from remote peer at address 127.28.173.3:32851
I20260709 13:08:21.157181 30634 tablet_copy_service.cc:140] P fe2b7d73f8c743c1ba570cfd981c4e79: Received BeginTabletCopySession request for tablet ee49a377a80e4f4199281fb5e44d3be6 from peer cd669586cff44d4bbfcc007e213faab6 ({username='slave'} at 127.0.0.1:57140)
I20260709 13:08:21.157459 30546 raft_consensus.cc:2468] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 2.
I20260709 13:08:21.157720 30634 tablet_copy_service.cc:161] P fe2b7d73f8c743c1ba570cfd981c4e79: Beginning new tablet copy session on tablet ee49a377a80e4f4199281fb5e44d3be6 from peer cd669586cff44d4bbfcc007e213faab6 at {username='slave'} at 127.0.0.1:57140: session id = cd669586cff44d4bbfcc007e213faab6-ee49a377a80e4f4199281fb5e44d3be6
I20260709 13:08:21.162932 30373 catalog_manager.cc:5697] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 1 to 2, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 2 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:21.172371 30634 tablet_copy_source_session.cc:215] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:21.177805 31114 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:08:21.179337 31638 raft_consensus.cc:2804] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:21.151114 31699 tablet_copy_client.cc:806] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:21.179869 31638 raft_consensus.cc:697] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:21.180233 31699 tablet_copy_client.cc:670] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:21.180766 31638 consensus_queue.cc:237] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:21.181905 31710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee49a377a80e4f4199281fb5e44d3be6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.193573 31709 tablet_copy_client.cc:323] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Beginning tablet copy session from remote peer at address 127.28.173.3:32851
I20260709 13:08:21.195447 30635 tablet_copy_service.cc:140] P fe2b7d73f8c743c1ba570cfd981c4e79: Received BeginTabletCopySession request for tablet cb22806325394ba386d8549bc4a64701 from peer cd669586cff44d4bbfcc007e213faab6 ({username='slave'} at 127.0.0.1:57140)
I20260709 13:08:21.195973 30635 tablet_copy_service.cc:161] P fe2b7d73f8c743c1ba570cfd981c4e79: Beginning new tablet copy session on tablet cb22806325394ba386d8549bc4a64701 from peer cd669586cff44d4bbfcc007e213faab6 at {username='slave'} at 127.0.0.1:57140: session id = cd669586cff44d4bbfcc007e213faab6-cb22806325394ba386d8549bc4a64701
I20260709 13:08:21.197626 31702 consensus_queue.cc:1048] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:21.199447 30373 catalog_manager.cc:5697] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 1 to 2, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 2 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:21.202499 30618 raft_consensus.cc:1275] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:21.205062 30635 tablet_copy_source_session.cc:215] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:21.211272 31702 consensus_queue.cc:1048] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:21.216490 31709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb22806325394ba386d8549bc4a64701. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.215773 30371 catalog_manager.cc:5697] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 1 to 2, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 2 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:21.238458 31699 tablet_copy_client.cc:538] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:21.240376 30467 raft_consensus.cc:1275] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:21.242122 31700 consensus_queue.cc:1048] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:21.252331 31710 tablet_copy_client.cc:806] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:21.253005 31710 tablet_copy_client.cc:670] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:21.253937 31699 tablet_bootstrap.cc:492] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6: Bootstrap starting.
I20260709 13:08:21.256482 31709 tablet_copy_client.cc:806] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:21.257382 30473 raft_consensus.cc:1275] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:21.258736 31702 consensus_queue.cc:1048] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:21.270576 31710 tablet_copy_client.cc:538] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:21.257022 31709 tablet_copy_client.cc:670] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:21.302191 31710 tablet_bootstrap.cc:492] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6: Bootstrap starting.
I20260709 13:08:21.311882 30551 raft_consensus.cc:1275] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:21.311097 31709 tablet_copy_client.cc:538] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:21.344738 31709 tablet_bootstrap.cc:492] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6: Bootstrap starting.
I20260709 13:08:21.356871 31638 consensus_queue.cc:1048] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:21.399508 31723 ts_tablet_manager.cc:933] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6: Initiating tablet copy from peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:21.428120 30467 raft_consensus.cc:1275] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:21.429241 31638 consensus_queue.cc:1048] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:21.531580 31723 tablet_copy_client.cc:323] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Beginning tablet copy session from remote peer at address 127.28.173.2:34733
I20260709 13:08:21.532711 31709 tablet_bootstrap.cc:492] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:21.533702 31709 tablet_bootstrap.cc:492] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6: Bootstrap complete.
I20260709 13:08:21.539122 30561 tablet_copy_service.cc:140] P 092f6eb694fc4bbeab49677cccd880fd: Received BeginTabletCopySession request for tablet 541099fd564e49f2ad553f250f319fb0 from peer cd669586cff44d4bbfcc007e213faab6 ({username='slave'} at 127.0.0.1:35278)
I20260709 13:08:21.539883 30561 tablet_copy_service.cc:161] P 092f6eb694fc4bbeab49677cccd880fd: Beginning new tablet copy session on tablet 541099fd564e49f2ad553f250f319fb0 from peer cd669586cff44d4bbfcc007e213faab6 at {username='slave'} at 127.0.0.1:35278: session id = cd669586cff44d4bbfcc007e213faab6-541099fd564e49f2ad553f250f319fb0
I20260709 13:08:21.540482 31709 ts_tablet_manager.cc:1403] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6: Time spent bootstrapping tablet: real 0.196s	user 0.014s	sys 0.017s
I20260709 13:08:21.634641 30546 raft_consensus.cc:1275] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:21.659658 30561 tablet_copy_source_session.cc:215] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:21.675995 30551 raft_consensus.cc:1275] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:21.656451 31619 consensus_queue.cc:1048] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:08:21.656268 31709 raft_consensus.cc:359] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:21.751844 30618 raft_consensus.cc:1275] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:21.733799 31709 raft_consensus.cc:740] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Initialized, Role: LEARNER
I20260709 13:08:21.764257 31709 consensus_queue.cc:260] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:21.767553 31709 ts_tablet_manager.cc:1434] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6: Time spent starting tablet: real 0.221s	user 0.006s	sys 0.001s
I20260709 13:08:21.761093 31638 consensus_queue.cc:1048] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:08:21.773258 30635 tablet_copy_service.cc:342] P fe2b7d73f8c743c1ba570cfd981c4e79: Request end of tablet copy session cd669586cff44d4bbfcc007e213faab6-cb22806325394ba386d8549bc4a64701 received from {username='slave'} at 127.0.0.1:57140
I20260709 13:08:21.773669 30635 tablet_copy_service.cc:434] P fe2b7d73f8c743c1ba570cfd981c4e79: ending tablet copy session cd669586cff44d4bbfcc007e213faab6-cb22806325394ba386d8549bc4a64701 on tablet cb22806325394ba386d8549bc4a64701 with peer cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:21.777818 31723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 541099fd564e49f2ad553f250f319fb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.795917 31638 consensus_queue.cc:1048] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:21.790143 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:21.842281 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 90464us
I20260709 13:08:21.850293 30550 raft_consensus.cc:1275] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:21.853416 30467 raft_consensus.cc:1275] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:08:21.858917 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 132490us
I20260709 13:08:21.938898 31699 tablet_bootstrap.cc:492] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:21.941740 31147 raft_consensus.cc:1217] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:21.950500 31710 tablet_bootstrap.cc:492] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:21.951455 31710 tablet_bootstrap.cc:492] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6: Bootstrap complete.
I20260709 13:08:21.952178 31710 ts_tablet_manager.cc:1403] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6: Time spent bootstrapping tablet: real 0.650s	user 0.036s	sys 0.015s
I20260709 13:08:21.922188 31638 consensus_queue.cc:1048] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:08:21.953963 31699 tablet_bootstrap.cc:492] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6: Bootstrap complete.
I20260709 13:08:21.992549 31699 ts_tablet_manager.cc:1403] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6: Time spent bootstrapping tablet: real 0.739s	user 0.021s	sys 0.041s
I20260709 13:08:21.996275 31710 raft_consensus.cc:359] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
W20260709 13:08:22.038916 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 368031us
I20260709 13:08:22.017601 31710 raft_consensus.cc:740] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Initialized, Role: LEARNER
I20260709 13:08:22.063872 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:22.069746 30473 raft_consensus.cc:1275] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:22.023865 31680 consensus_queue.cc:1048] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
W20260709 13:08:22.092381 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 73571.2us
W20260709 13:08:22.096999 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 45618.5us
I20260709 13:08:22.142267 31723 tablet_copy_client.cc:806] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:22.093353 31710 consensus_queue.cc:260] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:22.153625 31710 ts_tablet_manager.cc:1434] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6: Time spent starting tablet: real 0.201s	user 0.007s	sys 0.000s
I20260709 13:08:22.154788 31723 tablet_copy_client.cc:670] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:22.155550 30635 tablet_copy_service.cc:342] P fe2b7d73f8c743c1ba570cfd981c4e79: Request end of tablet copy session cd669586cff44d4bbfcc007e213faab6-ee49a377a80e4f4199281fb5e44d3be6 received from {username='slave'} at 127.0.0.1:57140
I20260709 13:08:22.144945 31699 raft_consensus.cc:359] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:22.163961 30635 tablet_copy_service.cc:434] P fe2b7d73f8c743c1ba570cfd981c4e79: ending tablet copy session cd669586cff44d4bbfcc007e213faab6-ee49a377a80e4f4199281fb5e44d3be6 on tablet ee49a377a80e4f4199281fb5e44d3be6 with peer cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:22.163589 31699 raft_consensus.cc:740] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Initialized, Role: LEARNER
I20260709 13:08:22.305482 31151 raft_consensus.cc:1217] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:08:22.317548 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 227563us
I20260709 13:08:22.338871 30550 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
mode: GRACEFUL
new_leader_uuid: "cd669586cff44d4bbfcc007e213faab6"
 from {username='slave'} at 127.0.0.1:45906
I20260709 13:08:22.339489 30550 raft_consensus.cc:606] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Received request to transfer leadership to TS cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:22.377419 31741 consensus_queue.cc:1048] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:08:22.332907 31699 consensus_queue.cc:260] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
W20260709 13:08:22.462824 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 63430.4us
W20260709 13:08:22.467646 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 90028us
I20260709 13:08:22.485509 31699 ts_tablet_manager.cc:1434] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6: Time spent starting tablet: real 0.484s	user 0.009s	sys 0.000s
W20260709 13:08:22.526528 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 87724.8us
W20260709 13:08:22.542433 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 166787us
W20260709 13:08:22.683063 31729 log.cc:927] Time spent T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:08:22.694475 31680 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:22.797883 31680 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:22.800921 31680 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:22.807430 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:22.819703 30561 tablet_copy_service.cc:342] P 092f6eb694fc4bbeab49677cccd880fd: Request end of tablet copy session cd669586cff44d4bbfcc007e213faab6-80cbe47dd35948b8b10070e934216d98 received from {username='slave'} at 127.0.0.1:35278
I20260709 13:08:22.820179 30561 tablet_copy_service.cc:434] P 092f6eb694fc4bbeab49677cccd880fd: ending tablet copy session cd669586cff44d4bbfcc007e213faab6-80cbe47dd35948b8b10070e934216d98 on tablet 80cbe47dd35948b8b10070e934216d98 with peer cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:22.826668 31723 tablet_copy_client.cc:538] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:22.849999 31146 raft_consensus.cc:1217] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:22.851733 31736 raft_consensus.cc:993] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd: : Instructing follower cd669586cff44d4bbfcc007e213faab6 to start an election
I20260709 13:08:22.853142 31759 raft_consensus.cc:1081] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Signalling peer cd669586cff44d4bbfcc007e213faab6 to start an election
I20260709 13:08:22.866634 31146 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073"
dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
 from {username='slave'} at 127.0.0.1:48426
I20260709 13:08:22.867211 31146 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:22.867565 31146 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:22.869776 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:22.900599 31116 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:22.904084 31146 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:22.918769 31755 raft_consensus.cc:2749] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:22.934659 31723 tablet_bootstrap.cc:492] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6: Bootstrap starting.
I20260709 13:08:22.937058 31146 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:22.949046 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:22.949743 30622 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:22.951560 30625 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48914655f9d44751a883e36b566dcefd"
dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
mode: GRACEFUL
new_leader_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:49382
I20260709 13:08:22.952157 30625 raft_consensus.cc:606] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Received request to transfer leadership to TS f639301059e24dc5b0d88a46dc683326
I20260709 13:08:22.952809 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:22.953362 30546 raft_consensus.cc:3055] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:22.953660 30546 raft_consensus.cc:740] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:22.954591 30546 consensus_queue.cc:260] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:22.955715 30546 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:22.967774 30546 raft_consensus.cc:2468] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 2.
I20260709 13:08:22.971601 31114 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:08:22.972470 31680 raft_consensus.cc:2804] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:22.972929 31680 raft_consensus.cc:697] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:22.973749 31680 consensus_queue.cc:237] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:22.983928 30546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
mode: GRACEFUL
new_leader_uuid: "cd669586cff44d4bbfcc007e213faab6"
 from {username='slave'} at 127.0.0.1:45906
I20260709 13:08:22.984547 31773 raft_consensus.cc:1064] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79: attempting to promote NON_VOTER cd669586cff44d4bbfcc007e213faab6 to VOTER
I20260709 13:08:22.989338 31773 consensus_queue.cc:237] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:22.993261 30546 raft_consensus.cc:606] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Received request to transfer leadership to TS cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:22.994592 30622 raft_consensus.cc:2468] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 2.
I20260709 13:08:22.999468 30470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a999056752144cc99cdd136c40917d2c"
dest_uuid: "f639301059e24dc5b0d88a46dc683326"
mode: GRACEFUL
new_leader_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:38176
I20260709 13:08:23.000133 30470 raft_consensus.cc:606] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Received request to transfer leadership to TS 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:23.007917 30470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a"
dest_uuid: "f639301059e24dc5b0d88a46dc683326"
mode: GRACEFUL
new_leader_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:38176
I20260709 13:08:23.008435 30470 raft_consensus.cc:606] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Received request to transfer leadership to TS 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:23.009819 29364 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:23.011596 29364 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:23.026214 30546 raft_consensus.cc:1275] T cb22806325394ba386d8549bc4a64701 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:23.025851 30372 catalog_manager.cc:5697] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 1 to 2, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 2 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:23.027609 31676 consensus_queue.cc:1048] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:23.030882 31146 raft_consensus.cc:1275] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:23.032648 31782 consensus_queue.cc:1048] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:23.062288 30467 raft_consensus.cc:1275] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:23.072907 31780 consensus_queue.cc:1048] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:23.078840 31674 raft_consensus.cc:993] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79: : Instructing follower f639301059e24dc5b0d88a46dc683326 to start an election
I20260709 13:08:23.079351 31674 raft_consensus.cc:1081] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Signalling peer f639301059e24dc5b0d88a46dc683326 to start an election
I20260709 13:08:23.098618 30467 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "48914655f9d44751a883e36b566dcefd"
dest_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:50446
I20260709 13:08:23.099365 30467 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:23.099862 30467 raft_consensus.cc:3060] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:23.100307 31773 raft_consensus.cc:2955] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:23.106065 30546 raft_consensus.cc:2955] T cb22806325394ba386d8549bc4a64701 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:23.116855 30467 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:23.132848 31723 tablet_bootstrap.cc:492] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:23.135504 30469 raft_consensus.cc:2955] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:23.141953 30467 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:23.143194 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:23.143786 31146 raft_consensus.cc:3060] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:23.147270 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:23.135356 31723 tablet_bootstrap.cc:492] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6: Bootstrap complete.
I20260709 13:08:23.147862 30621 raft_consensus.cc:3055] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:23.154923 31147 raft_consensus.cc:2955] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:23.164140 30621 raft_consensus.cc:740] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:23.170877 30621 consensus_queue.cc:260] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:23.172112 30621 raft_consensus.cc:3060] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:23.156085 31146 raft_consensus.cc:2468] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 2.
I20260709 13:08:23.177476 30441 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:23.178434 31763 raft_consensus.cc:2804] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:23.179111 31763 raft_consensus.cc:697] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 2 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:23.180179 31763 consensus_queue.cc:237] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:23.181625 30621 raft_consensus.cc:2468] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 2.
I20260709 13:08:23.184316 31723 ts_tablet_manager.cc:1403] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6: Time spent bootstrapping tablet: real 0.250s	user 0.022s	sys 0.004s
I20260709 13:08:23.190449 30373 catalog_manager.cc:5697] T cb22806325394ba386d8549bc4a64701 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:23.193804 31723 raft_consensus.cc:359] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:23.194661 31723 raft_consensus.cc:740] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Initialized, Role: LEARNER
I20260709 13:08:23.198757 31723 consensus_queue.cc:260] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:23.201876 31723 ts_tablet_manager.cc:1434] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:08:23.206444 30561 tablet_copy_service.cc:342] P 092f6eb694fc4bbeab49677cccd880fd: Request end of tablet copy session cd669586cff44d4bbfcc007e213faab6-541099fd564e49f2ad553f250f319fb0 received from {username='slave'} at 127.0.0.1:35278
I20260709 13:08:23.206902 30561 tablet_copy_service.cc:434] P 092f6eb694fc4bbeab49677cccd880fd: ending tablet copy session cd669586cff44d4bbfcc007e213faab6-541099fd564e49f2ad553f250f319fb0 on tablet 541099fd564e49f2ad553f250f319fb0 with peer cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:23.257987 30621 consensus_queue.cc:237] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:23.264436 30467 raft_consensus.cc:1275] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:23.268438 31674 consensus_queue.cc:1048] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:23.270921 31150 raft_consensus.cc:1275] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:23.272603 31773 raft_consensus.cc:1064] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79: attempting to promote NON_VOTER cd669586cff44d4bbfcc007e213faab6 to VOTER
I20260709 13:08:23.285102 31782 raft_consensus.cc:2955] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:23.286337 31700 raft_consensus.cc:993] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd: : Instructing follower cd669586cff44d4bbfcc007e213faab6 to start an election
I20260709 13:08:23.286903 31700 raft_consensus.cc:1081] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Signalling peer cd669586cff44d4bbfcc007e213faab6 to start an election
I20260709 13:08:23.290603 31757 consensus_queue.cc:1048] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:23.293201 30374 catalog_manager.cc:5697] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 1 to 2, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 2 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:23.299407 30467 raft_consensus.cc:2955] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:23.301677 31773 consensus_queue.cc:237] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:23.307320 31147 raft_consensus.cc:2955] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:23.323980 31702 raft_consensus.cc:1064] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd: attempting to promote NON_VOTER cd669586cff44d4bbfcc007e213faab6 to VOTER
I20260709 13:08:23.329171 31146 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483"
dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
 from {username='slave'} at 127.0.0.1:48426
I20260709 13:08:23.329764 31146 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:23.330153 31146 raft_consensus.cc:3060] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:23.335443 30371 catalog_manager.cc:5697] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: config changed from index 3 to 4, VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) evicted. New cstate: current_term: 1 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:23.357991 31147 raft_consensus.cc:1275] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:23.362092 30546 raft_consensus.cc:1275] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:23.365116 30547 raft_consensus.cc:1275] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:23.367977 31780 consensus_queue.cc:1048] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:23.371018 30471 raft_consensus.cc:1275] T ee49a377a80e4f4199281fb5e44d3be6 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:23.375898 31680 consensus_queue.cc:1048] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:23.376317 31674 consensus_queue.cc:1048] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:23.386355 31674 consensus_queue.cc:1048] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:23.342006 31702 consensus_queue.cc:237] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:23.392308 30541 tablet_service.cc:1558] Processing DeleteTablet for tablet cb22806325394ba386d8549bc4a64701 with delete_type TABLET_DATA_TOMBSTONED (TS 092f6eb694fc4bbeab49677cccd880fd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43082
I20260709 13:08:23.406291 30360 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cb22806325394ba386d8549bc4a64701 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:23.408380 31146 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:23.421835 31146 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:23.428668 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:23.429351 30469 raft_consensus.cc:3060] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:23.439630 30621 raft_consensus.cc:1275] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:23.444602 31802 tablet_replica.cc:333] T cb22806325394ba386d8549bc4a64701 P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:08:23.448498 31680 consensus_queue.cc:1048] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:23.451624 30469 raft_consensus.cc:2468] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 2.
I20260709 13:08:23.452876 31116 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:08:23.453419 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 64974.3us
I20260709 13:08:23.453744 31680 raft_consensus.cc:2804] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:23.454507 31680 raft_consensus.cc:697] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:23.455451 31680 consensus_queue.cc:237] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:23.475741 31773 raft_consensus.cc:2955] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:23.485436 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:23.486188 30546 raft_consensus.cc:3055] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:23.486501 30546 raft_consensus.cc:740] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:23.487250 30546 consensus_queue.cc:260] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:23.489938 30546 raft_consensus.cc:3060] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:23.493366 31151 raft_consensus.cc:2955] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:23.505287 31802 raft_consensus.cc:2243] T cb22806325394ba386d8549bc4a64701 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:23.506074 31802 raft_consensus.cc:2272] T cb22806325394ba386d8549bc4a64701 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:23.509490 31802 ts_tablet_manager.cc:1916] T cb22806325394ba386d8549bc4a64701 P 092f6eb694fc4bbeab49677cccd880fd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:23.512071 31766 raft_consensus.cc:993] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326: : Instructing follower 092f6eb694fc4bbeab49677cccd880fd to start an election
I20260709 13:08:23.512526 31766 raft_consensus.cc:1081] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Signalling peer 092f6eb694fc4bbeab49677cccd880fd to start an election
I20260709 13:08:23.514810 30548 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a999056752144cc99cdd136c40917d2c"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:43088
I20260709 13:08:23.515336 30548 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:23.515654 30548 raft_consensus.cc:3060] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:23.524886 30548 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:23.525327 30371 catalog_manager.cc:5697] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 1 to 2, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 2 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:23.532848 30548 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:23.546052 31802 ts_tablet_manager.cc:1929] T cb22806325394ba386d8549bc4a64701 P 092f6eb694fc4bbeab49677cccd880fd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:23.548852 31802 log.cc:1199] T cb22806325394ba386d8549bc4a64701 P 092f6eb694fc4bbeab49677cccd880fd: Deleting WAL directory at /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-1-root/wals/cb22806325394ba386d8549bc4a64701
I20260709 13:08:23.550733 30546 raft_consensus.cc:2468] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 2.
I20260709 13:08:23.554450 30371 catalog_manager.cc:5697] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:23.565058 31766 raft_consensus.cc:993] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326: : Instructing follower 092f6eb694fc4bbeab49677cccd880fd to start an election
I20260709 13:08:23.565552 31766 raft_consensus.cc:1081] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Signalling peer 092f6eb694fc4bbeab49677cccd880fd to start an election
I20260709 13:08:23.571170 30474 raft_consensus.cc:2955] T ee49a377a80e4f4199281fb5e44d3be6 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:23.573376 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:23.574034 30471 raft_consensus.cc:3055] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:23.574342 30471 raft_consensus.cc:740] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:23.575117 30471 consensus_queue.cc:260] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:23.576749 30471 raft_consensus.cc:3060] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:23.576830 30359 catalog_manager.cc:5028] TS 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): tablet cb22806325394ba386d8549bc4a64701 (table test-workload [id=887057791fed41a884abbab3e8d4b49f]) successfully deleted
I20260709 13:08:23.577782 30546 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:43088
I20260709 13:08:23.580729 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:23.581311 30622 raft_consensus.cc:3060] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:23.584645 30471 raft_consensus.cc:2468] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 2.
I20260709 13:08:23.585423 31151 raft_consensus.cc:1217] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:23.591643 30546 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:23.592103 30546 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:23.602870 30618 raft_consensus.cc:1275] T 80cbe47dd35948b8b10070e934216d98 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:23.650687 31702 consensus_queue.cc:1048] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:23.613806 30548 raft_consensus.cc:2955] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:23.711391 31151 raft_consensus.cc:1275] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:23.712162 30622 raft_consensus.cc:2468] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 2.
I20260709 13:08:23.713052 30618 raft_consensus.cc:1240] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:23.720796 31702 consensus_queue.cc:1048] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:23.695703 30546 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:23.739318 30622 consensus_queue.cc:237] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:23.773106 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 51929.8us
I20260709 13:08:23.884446 30546 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:23.888103 30474 raft_consensus.cc:1275] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:23.888347 30517 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:08:23.888994 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 147217us
I20260709 13:08:23.889076 31756 raft_consensus.cc:2804] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:23.889945 31756 raft_consensus.cc:697] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 2 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:23.890832 31756 consensus_queue.cc:237] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:23.911909 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:23.912499 30467 raft_consensus.cc:3055] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:23.912801 30467 raft_consensus.cc:740] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:23.913486 30467 consensus_queue.cc:260] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:23.914481 30467 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:23.920782 30625 raft_consensus.cc:1275] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:23.930997 30467 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 2.
I20260709 13:08:23.947156 30548 raft_consensus.cc:1275] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:23.965937 31147 raft_consensus.cc:1275] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:23.973577 30548 raft_consensus.cc:1275] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:23.979104 31619 consensus_queue.cc:1048] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:08:24.006927 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 64053.8us
I20260709 13:08:23.992194 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:24.017328 30622 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:24.011672 31147 raft_consensus.cc:1275] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:24.012738 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:24.016304 31811 log.cc:927] Time spent T 80cbe47dd35948b8b10070e934216d98 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:08:24.038348 30548 raft_consensus.cc:2955] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:24.044232 31619 consensus_queue.cc:1048] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:24.027905 30374 catalog_manager.cc:5697] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 1 to 2, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 2 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:24.051651 31151 raft_consensus.cc:2955] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:24.035462 31782 raft_consensus.cc:2955] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:24.048643 30622 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 2.
I20260709 13:08:24.051874 31633 consensus_queue.cc:1048] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:08:24.096971 30371 catalog_manager.cc:5697] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: config changed from index 3 to 4, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New cstate: current_term: 1 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
W20260709 13:08:24.086467 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 81842.7us
W20260709 13:08:24.106829 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 45816.7us
I20260709 13:08:24.109786 30517 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:24.110545 31702 raft_consensus.cc:2804] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:24.111020 31702 raft_consensus.cc:697] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 2 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:24.088343 31756 consensus_queue.cc:1048] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:08:24.112025 31702 consensus_queue.cc:237] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:24.113744 31743 consensus_queue.cc:1048] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:08:24.147133 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 93428us
I20260709 13:08:24.148164 30469 raft_consensus.cc:1275] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:24.156113 31750 raft_consensus.cc:2955] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:24.171119 31680 consensus_queue.cc:1048] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:24.159889 30360 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ee49a377a80e4f4199281fb5e44d3be6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:24.182940 30621 raft_consensus.cc:2955] T 80cbe47dd35948b8b10070e934216d98 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:24.214489 31706 raft_consensus.cc:1064] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd: attempting to promote NON_VOTER cd669586cff44d4bbfcc007e213faab6 to VOTER
I20260709 13:08:24.216987 31706 consensus_queue.cc:237] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:24.210309 31821 consensus_queue.cc:1048] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:08:24.271389 31147 raft_consensus.cc:2955] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:24.297448 30464 tablet_service.cc:1558] Processing DeleteTablet for tablet ee49a377a80e4f4199281fb5e44d3be6 with delete_type TABLET_DATA_TOMBSTONED (TS f639301059e24dc5b0d88a46dc683326 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53858
I20260709 13:08:24.311105 30370 catalog_manager.cc:5697] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:24.314942 30469 raft_consensus.cc:2955] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:24.317332 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:24.356861 30616 raft_consensus.cc:1275] T 541099fd564e49f2ad553f250f319fb0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:24.357398 31147 raft_consensus.cc:1275] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:24.365635 30469 raft_consensus.cc:1275] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:24.367165 31831 consensus_queue.cc:1048] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:24.375305 31837 tablet_replica.cc:333] T ee49a377a80e4f4199281fb5e44d3be6 P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:08:24.372506 31706 consensus_queue.cc:1048] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:08:24.408432 31837 raft_consensus.cc:2243] T ee49a377a80e4f4199281fb5e44d3be6 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:24.388530 31750 consensus_queue.cc:1048] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:08:24.427717 30371 catalog_manager.cc:5697] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 1 to 2, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 2 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:24.444993 31837 raft_consensus.cc:2272] T ee49a377a80e4f4199281fb5e44d3be6 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:24.516180 31837 ts_tablet_manager.cc:1916] T ee49a377a80e4f4199281fb5e44d3be6 P f639301059e24dc5b0d88a46dc683326: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:08:24.519948 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 47252.9us
I20260709 13:08:24.546870 30621 raft_consensus.cc:1275] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:24.548738 31823 raft_consensus.cc:2955] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:24.577535 31837 ts_tablet_manager.cc:1929] T ee49a377a80e4f4199281fb5e44d3be6 P f639301059e24dc5b0d88a46dc683326: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:24.578058 31837 log.cc:1199] T ee49a377a80e4f4199281fb5e44d3be6 P f639301059e24dc5b0d88a46dc683326: Deleting WAL directory at /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-0-root/wals/ee49a377a80e4f4199281fb5e44d3be6
W20260709 13:08:24.529234 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 56072.8us
I20260709 13:08:24.584127 30361 catalog_manager.cc:5028] TS f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): tablet ee49a377a80e4f4199281fb5e44d3be6 (table test-workload [id=887057791fed41a884abbab3e8d4b49f]) successfully deleted
I20260709 13:08:24.585037 30467 raft_consensus.cc:1275] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:24.590598 31846 consensus_queue.cc:1048] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:24.591301 30548 consensus_queue.cc:237] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:24.597715 30474 raft_consensus.cc:2955] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:24.598840 30546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
mode: GRACEFUL
new_leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
 from {username='slave'} at 127.0.0.1:45906
I20260709 13:08:24.599738 30546 raft_consensus.cc:606] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Received request to transfer leadership to TS fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:24.610095 30471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3"
dest_uuid: "f639301059e24dc5b0d88a46dc683326"
mode: GRACEFUL
new_leader_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:38176
I20260709 13:08:24.610774 30471 raft_consensus.cc:606] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Received request to transfer leadership to TS 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:24.613524 31146 raft_consensus.cc:1275] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:24.615013 30470 raft_consensus.cc:1275] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:24.617059 30621 raft_consensus.cc:2955] T 541099fd564e49f2ad553f250f319fb0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:24.622416 30547 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
mode: GRACEFUL
new_leader_uuid: "cd669586cff44d4bbfcc007e213faab6"
 from {username='slave'} at 127.0.0.1:45906
I20260709 13:08:24.623133 30547 raft_consensus.cc:606] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Received request to transfer leadership to TS cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:24.628882 31831 consensus_queue.cc:1048] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:24.630237 31831 consensus_queue.cc:1048] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:24.631580 31831 consensus_queue.cc:1048] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:24.635596 30625 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7111be574b514751972d70830d3b644f"
dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
mode: GRACEFUL
new_leader_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:49382
I20260709 13:08:24.636227 30625 raft_consensus.cc:606] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Received request to transfer leadership to TS f639301059e24dc5b0d88a46dc683326
I20260709 13:08:24.620810 31146 raft_consensus.cc:2955] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:24.639123 30470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7"
dest_uuid: "f639301059e24dc5b0d88a46dc683326"
mode: GRACEFUL
new_leader_uuid: "cd669586cff44d4bbfcc007e213faab6"
 from {username='slave'} at 127.0.0.1:38176
I20260709 13:08:24.639627 30470 raft_consensus.cc:606] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Received request to transfer leadership to TS cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:24.640918 29364 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:24.642885 29364 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:24.655620 30370 catalog_manager.cc:5697] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:24.674742 30548 consensus_queue.cc:237] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:24.698325 31823 raft_consensus.cc:993] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd: : Instructing follower fe2b7d73f8c743c1ba570cfd981c4e79 to start an election
I20260709 13:08:24.698805 31823 raft_consensus.cc:1081] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Signalling peer fe2b7d73f8c743c1ba570cfd981c4e79 to start an election
I20260709 13:08:24.699962 30467 raft_consensus.cc:1275] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:24.715219 31846 raft_consensus.cc:2955] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:24.718914 30471 raft_consensus.cc:1275] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:24.722529 31706 consensus_queue.cc:1048] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:24.729283 30625 raft_consensus.cc:1275] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:24.728864 31147 raft_consensus.cc:2955] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:24.732323 31831 consensus_queue.cc:1048] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:24.736106 31151 raft_consensus.cc:1275] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:24.740139 31831 consensus_queue.cc:1048] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:24.742309 30621 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c"
dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
 from {username='slave'} at 127.0.0.1:47446
I20260709 13:08:24.743616 30621 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:24.744366 30621 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:24.778285 30359 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 80cbe47dd35948b8b10070e934216d98 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:08:24.781230 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 59588.6us
I20260709 13:08:24.798986 30467 raft_consensus.cc:2955] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:24.853315 31825 consensus_queue.cc:1048] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:24.842952 30621 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:24.907533 30374 catalog_manager.cc:5697] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 reported cstate change: config changed from index 3 to 4, VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) evicted. New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:24.968246 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:24.969113 30471 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:24.988176 30612 tablet_service.cc:1558] Processing DeleteTablet for tablet 80cbe47dd35948b8b10070e934216d98 with delete_type TABLET_DATA_TOMBSTONED (TS fe2b7d73f8c743c1ba570cfd981c4e79 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36118
I20260709 13:08:24.990850 31702 raft_consensus.cc:993] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd: : Instructing follower cd669586cff44d4bbfcc007e213faab6 to start an election
I20260709 13:08:24.991519 31702 raft_consensus.cc:1081] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Signalling peer cd669586cff44d4bbfcc007e213faab6 to start an election
I20260709 13:08:25.000571 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:25.001276 30548 raft_consensus.cc:3055] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:25.001600 30548 raft_consensus.cc:740] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:25.002532 30548 consensus_queue.cc:260] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:25.003559 30548 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:24.975567 30621 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:25.025198 31151 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea"
dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
 from {username='slave'} at 127.0.0.1:48426
I20260709 13:08:25.026000 31151 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:25.026396 31151 raft_consensus.cc:3060] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.006889 31759 raft_consensus.cc:2955] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:25.039844 31147 raft_consensus.cc:2955] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:25.095258 30467 raft_consensus.cc:2955] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
W20260709 13:08:25.104038 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.115062 30471 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 2.
I20260709 13:08:25.122808 30591 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:25.124519 31862 tablet_replica.cc:333] T 80cbe47dd35948b8b10070e934216d98 P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:08:25.128657 31726 raft_consensus.cc:993] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326: : Instructing follower 092f6eb694fc4bbeab49677cccd880fd to start an election
I20260709 13:08:25.131373 31856 raft_consensus.cc:993] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79: : Instructing follower f639301059e24dc5b0d88a46dc683326 to start an election
W20260709 13:08:25.131232 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 245184us
I20260709 13:08:25.132066 31856 raft_consensus.cc:1081] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Signalling peer f639301059e24dc5b0d88a46dc683326 to start an election
I20260709 13:08:25.129988 31726 raft_consensus.cc:1081] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Signalling peer 092f6eb694fc4bbeab49677cccd880fd to start an election
I20260709 13:08:25.145465 30547 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:43088
I20260709 13:08:25.146036 30547 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:25.146386 30547 raft_consensus.cc:3060] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.149293 31814 raft_consensus.cc:2804] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:25.149967 31814 raft_consensus.cc:697] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:25.155582 30374 catalog_manager.cc:5697] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: config changed from index 3 to 4, VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) evicted. New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:25.164191 30548 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 2.
I20260709 13:08:25.151075 31814 consensus_queue.cc:237] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:25.185101 30359 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 541099fd564e49f2ad553f250f319fb0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:25.194669 30547 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:25.198089 30469 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7111be574b514751972d70830d3b644f"
dest_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:50446
I20260709 13:08:25.192473 31151 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:25.212745 30469 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:25.214249 30469 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.226212 30469 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:25.230823 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:25.230607 31151 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:25.231071 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:25.231369 30546 raft_consensus.cc:3055] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:25.231740 30546 raft_consensus.cc:740] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:25.231791 30618 raft_consensus.cc:3060] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.232532 30612 tablet_service.cc:1558] Processing DeleteTablet for tablet 541099fd564e49f2ad553f250f319fb0 with delete_type TABLET_DATA_TOMBSTONED (TS fe2b7d73f8c743c1ba570cfd981c4e79 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36118
I20260709 13:08:25.240314 30547 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:25.241016 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:25.241533 31151 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.245018 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:25.245538 30624 raft_consensus.cc:3055] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:25.245810 30624 raft_consensus.cc:740] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:25.233799 30469 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:25.246611 30624 consensus_queue.cc:260] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:25.233906 30546 consensus_queue.cc:260] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:25.247776 30624 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.248368 31862 raft_consensus.cc:2243] T 80cbe47dd35948b8b10070e934216d98 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:25.248566 30546 raft_consensus.cc:3060] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.249439 31862 raft_consensus.cc:2272] T 80cbe47dd35948b8b10070e934216d98 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:25.255259 30546 raft_consensus.cc:2468] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 2.
I20260709 13:08:25.255409 31862 ts_tablet_manager.cc:1916] T 80cbe47dd35948b8b10070e934216d98 P fe2b7d73f8c743c1ba570cfd981c4e79: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:25.261920 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:25.265558 30469 raft_consensus.cc:3055] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:25.265928 30469 raft_consensus.cc:740] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:25.269639 30469 consensus_queue.cc:260] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:25.271675 31815 raft_consensus.cc:993] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326: : Instructing follower cd669586cff44d4bbfcc007e213faab6 to start an election
I20260709 13:08:25.263584 30370 catalog_manager.cc:5697] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 1 to 2, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 2 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:25.284083 31151 raft_consensus.cc:2468] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 2.
I20260709 13:08:25.277400 31815 raft_consensus.cc:1081] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Signalling peer cd669586cff44d4bbfcc007e213faab6 to start an election
I20260709 13:08:25.277267 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:25.292564 30625 raft_consensus.cc:3060] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.293354 31150 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7"
dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
 from {username='slave'} at 127.0.0.1:48412
I20260709 13:08:25.293876 31150 raft_consensus.cc:493] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:25.294188 31150 raft_consensus.cc:3060] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.276859 30469 raft_consensus.cc:3060] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.299981 30625 raft_consensus.cc:2468] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 2.
I20260709 13:08:25.301894 30516 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:25.303059 30441 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:25.303586 31816 raft_consensus.cc:2804] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:25.303990 31815 raft_consensus.cc:2804] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:25.304133 31816 raft_consensus.cc:697] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 2 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:25.304476 31815 raft_consensus.cc:697] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 2 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:25.305114 31816 consensus_queue.cc:237] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:25.305387 31815 consensus_queue.cc:237] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:25.275002 30624 raft_consensus.cc:2468] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 2.
I20260709 13:08:25.300817 31150 raft_consensus.cc:515] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:25.335125 31150 leader_election.cc:290] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:25.334565 30373 catalog_manager.cc:5697] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 1 to 2, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 2 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:25.327786 31114 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:08:25.336476 31820 raft_consensus.cc:2804] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:25.336978 31820 raft_consensus.cc:697] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:25.337195 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:25.337786 30624 raft_consensus.cc:3060] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.337990 31820 consensus_queue.cc:237] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:25.342806 30624 raft_consensus.cc:2468] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 2.
I20260709 13:08:25.344221 31115 leader_election.cc:304] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:25.345415 31860 raft_consensus.cc:2804] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:25.345919 31860 raft_consensus.cc:697] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:25.346899 31860 consensus_queue.cc:237] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:25.357630 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:25.358279 30471 raft_consensus.cc:3055] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:25.358608 30471 raft_consensus.cc:740] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:25.359421 30471 consensus_queue.cc:260] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:25.362315 30471 raft_consensus.cc:3060] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.282363 30618 raft_consensus.cc:2468] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 2.
I20260709 13:08:25.378525 30374 catalog_manager.cc:5697] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 1 to 2, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 2 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:25.412248 30471 raft_consensus.cc:2468] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 2.
I20260709 13:08:25.434571 30469 raft_consensus.cc:2468] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 2.
I20260709 13:08:25.454102 30373 catalog_manager.cc:5697] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 1 to 2, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 2 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:25.489156 31862 ts_tablet_manager.cc:1929] T 80cbe47dd35948b8b10070e934216d98 P fe2b7d73f8c743c1ba570cfd981c4e79: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:25.489756 31862 log.cc:1199] T 80cbe47dd35948b8b10070e934216d98 P fe2b7d73f8c743c1ba570cfd981c4e79: Deleting WAL directory at /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-2-root/wals/80cbe47dd35948b8b10070e934216d98
I20260709 13:08:25.491694 30360 catalog_manager.cc:5028] TS fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): tablet 80cbe47dd35948b8b10070e934216d98 (table test-workload [id=887057791fed41a884abbab3e8d4b49f]) successfully deleted
I20260709 13:08:25.492089 31862 tablet_replica.cc:333] T 541099fd564e49f2ad553f250f319fb0 P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:08:25.493110 31862 raft_consensus.cc:2243] T 541099fd564e49f2ad553f250f319fb0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:25.493286 30373 catalog_manager.cc:5697] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 1 to 2, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 2 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:25.499176 31862 raft_consensus.cc:2272] T 541099fd564e49f2ad553f250f319fb0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:25.509078 31862 ts_tablet_manager.cc:1916] T 541099fd564e49f2ad553f250f319fb0 P fe2b7d73f8c743c1ba570cfd981c4e79: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:25.525938 31862 ts_tablet_manager.cc:1929] T 541099fd564e49f2ad553f250f319fb0 P fe2b7d73f8c743c1ba570cfd981c4e79: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:25.526292 31862 log.cc:1199] T 541099fd564e49f2ad553f250f319fb0 P fe2b7d73f8c743c1ba570cfd981c4e79: Deleting WAL directory at /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-2-root/wals/541099fd564e49f2ad553f250f319fb0
I20260709 13:08:25.527872 30360 catalog_manager.cc:5028] TS fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): tablet 541099fd564e49f2ad553f250f319fb0 (table test-workload [id=887057791fed41a884abbab3e8d4b49f]) successfully deleted
I20260709 13:08:25.644125 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:25.657171 30469 raft_consensus.cc:1275] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:25.658545 31856 consensus_queue.cc:1048] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:25.682104 30547 raft_consensus.cc:1275] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:25.684031 31814 consensus_queue.cc:1048] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:25.706161 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:25.723016 30624 raft_consensus.cc:1275] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:25.728521 31819 consensus_queue.cc:1048] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:25.752362 31151 raft_consensus.cc:1275] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:25.762749 31815 consensus_queue.cc:1048] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:25.768603 30618 raft_consensus.cc:1275] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:25.769379 30624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c"
dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
mode: GRACEFUL
new_leader_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:49382
I20260709 13:08:25.772083 30624 raft_consensus.cc:606] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 LEADER]: Received request to transfer leadership to TS f639301059e24dc5b0d88a46dc683326
I20260709 13:08:25.774576 31816 consensus_queue.cc:1048] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:25.775879 30548 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
mode: GRACEFUL
new_leader_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:45906
I20260709 13:08:25.776419 30548 raft_consensus.cc:606] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Received request to transfer leadership to TS f639301059e24dc5b0d88a46dc683326
I20260709 13:08:25.784128 30469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1"
dest_uuid: "f639301059e24dc5b0d88a46dc683326"
mode: GRACEFUL
new_leader_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:38176
I20260709 13:08:25.784687 30469 raft_consensus.cc:606] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Received request to transfer leadership to TS 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:25.793259 30625 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278"
dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
mode: GRACEFUL
new_leader_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:49382
I20260709 13:08:25.793800 30625 raft_consensus.cc:606] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 LEADER]: Received request to transfer leadership to TS 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:25.796065 29364 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:08:25.798182 29364 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:25.805883 30546 raft_consensus.cc:1275] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:25.813966 31820 consensus_queue.cc:1048] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:25.830384 30471 raft_consensus.cc:1275] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:25.831645 30469 raft_consensus.cc:1275] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:25.834817 31860 consensus_queue.cc:1048] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:25.841627 31816 consensus_queue.cc:1048] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:25.855047 30624 raft_consensus.cc:1275] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:25.856685 31820 consensus_queue.cc:1048] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:25.868201 30625 raft_consensus.cc:1275] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:25.870154 31821 consensus_queue.cc:1048] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:25.885969 31814 raft_consensus.cc:993] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79: : Instructing follower 092f6eb694fc4bbeab49677cccd880fd to start an election
I20260709 13:08:25.886556 31856 raft_consensus.cc:1081] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 LEADER]: Signalling peer 092f6eb694fc4bbeab49677cccd880fd to start an election
I20260709 13:08:25.891206 30548 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:39952
I20260709 13:08:25.891918 30548 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:25.892377 30548 raft_consensus.cc:3060] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:25.901350 31726 raft_consensus.cc:993] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326: : Instructing follower 092f6eb694fc4bbeab49677cccd880fd to start an election
I20260709 13:08:25.901868 31726 raft_consensus.cc:1081] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Signalling peer 092f6eb694fc4bbeab49677cccd880fd to start an election
I20260709 13:08:25.913327 30546 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:43088
I20260709 13:08:25.914003 30546 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:25.914433 30546 raft_consensus.cc:3060] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.956830 30548 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:25.966200 31846 raft_consensus.cc:993] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd: : Instructing follower f639301059e24dc5b0d88a46dc683326 to start an election
I20260709 13:08:25.966845 31700 raft_consensus.cc:1081] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Signalling peer f639301059e24dc5b0d88a46dc683326 to start an election
I20260709 13:08:25.967767 30548 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:25.974159 30546 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:25.976919 30546 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:25.980952 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:25.981467 31151 raft_consensus.cc:3060] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.988621 31151 raft_consensus.cc:2468] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 2.
I20260709 13:08:25.990013 30516 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:08:25.990097 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:25.990748 30624 raft_consensus.cc:3055] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:25.991009 31700 raft_consensus.cc:2804] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:25.991660 31700 raft_consensus.cc:697] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 2 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:25.993212 31700 consensus_queue.cc:237] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:25.993585 30474 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1"
dest_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:50430
I20260709 13:08:25.994917 30474 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:25.995270 30474 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.997834 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:25.998379 30469 raft_consensus.cc:3055] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:25.998672 30469 raft_consensus.cc:740] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:25.999310 30469 consensus_queue.cc:260] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:26.000650 30469 raft_consensus.cc:3060] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:25.994305 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:26.003182 30476 raft_consensus.cc:3060] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:26.008088 30474 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:26.021478 30474 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:25.991094 30624 raft_consensus.cc:740] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:26.023444 30624 consensus_queue.cc:260] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:26.022249 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:26.024742 30618 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:26.026005 30624 raft_consensus.cc:3060] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:26.031510 30618 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 2.
I20260709 13:08:26.032805 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:26.033152 30624 raft_consensus.cc:2468] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 3.
I20260709 13:08:26.012477 30469 raft_consensus.cc:2468] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 2.
I20260709 13:08:26.033322 30546 raft_consensus.cc:3055] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:26.033842 30546 raft_consensus.cc:740] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:26.035043 30546 consensus_queue.cc:260] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:26.022421 30476 raft_consensus.cc:2468] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 3.
I20260709 13:08:26.036152 30546 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:26.042441 30516 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:26.047317 31825 raft_consensus.cc:2804] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:26.047847 31825 raft_consensus.cc:697] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 3 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:26.048811 31825 consensus_queue.cc:237] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:26.043278 30441 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:26.051002 31815 raft_consensus.cc:2804] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:26.051513 30370 catalog_manager.cc:5697] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 1 to 2, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 2 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:26.051488 31815 raft_consensus.cc:697] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 2 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:26.053160 31815 consensus_queue.cc:237] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:26.058859 30546 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 2.
I20260709 13:08:26.087443 30373 catalog_manager.cc:5697] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 1 to 2, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 2 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:26.097754 30370 catalog_manager.cc:5697] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 2 to 3, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 3 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:26.264333 31814 raft_consensus.cc:993] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79: : Instructing follower f639301059e24dc5b0d88a46dc683326 to start an election
I20260709 13:08:26.264968 31676 raft_consensus.cc:1081] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 LEADER]: Signalling peer f639301059e24dc5b0d88a46dc683326 to start an election
I20260709 13:08:26.266595 30469 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c"
dest_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:50446
I20260709 13:08:26.267110 30469 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:26.267439 30469 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:26.273896 30469 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:26.276479 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:26.277050 30546 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:26.278182 30469 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:26.280220 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:26.280778 30624 raft_consensus.cc:3055] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:26.281066 30624 raft_consensus.cc:740] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:26.281744 30624 consensus_queue.cc:260] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:26.282866 30624 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:26.292452 30546 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
I20260709 13:08:26.294453 30440 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:26.295240 31815 raft_consensus.cc:2804] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:26.296692 31815 raft_consensus.cc:697] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:26.299041 31815 consensus_queue.cc:237] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:26.299517 30624 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
I20260709 13:08:26.313787 30469 consensus_queue.cc:237] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:26.315456 30370 catalog_manager.cc:5697] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 2 to 3, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 3 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:26.324723 30441 consensus_peers.cc:597] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 -> Peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453): Couldn't send request to peer cd669586cff44d4bbfcc007e213faab6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e6646800b690458391bbff6a6bba535c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:26.325073 30618 raft_consensus.cc:1275] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:26.329304 31815 consensus_queue.cc:1048] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:26.335415 30546 raft_consensus.cc:1275] T e6646800b690458391bbff6a6bba535c P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:26.358875 31815 raft_consensus.cc:2955] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:26.363085 31726 consensus_queue.cc:1048] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:26.367437 30618 raft_consensus.cc:2955] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:26.382730 30548 consensus_queue.cc:237] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:26.384002 30370 catalog_manager.cc:5697] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 reported cstate change: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New cstate: current_term: 1 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:26.413499 30516 consensus_peers.cc:597] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd -> Peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453): Couldn't send request to peer cd669586cff44d4bbfcc007e213faab6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: daf3769ea0a34be69a628c90f1f8a721. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:26.417441 30618 raft_consensus.cc:1275] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:26.418773 30546 raft_consensus.cc:2955] T e6646800b690458391bbff6a6bba535c P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:26.419559 31846 consensus_queue.cc:1048] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:26.424852 30469 raft_consensus.cc:1275] T daf3769ea0a34be69a628c90f1f8a721 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:26.427212 31700 consensus_queue.cc:1048] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:26.440881 31846 raft_consensus.cc:2955] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:26.446233 30476 raft_consensus.cc:2955] T daf3769ea0a34be69a628c90f1f8a721 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:26.451013 30618 raft_consensus.cc:2955] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:26.469153 30370 catalog_manager.cc:5697] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
W20260709 13:08:26.482542 30422 auto_rebalancer.cc:629] Failed to schedule move for tablet 2b207fb799ce4340b29ae053898e0e6c: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:08:26.491029 30546 raft_consensus.cc:1275] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:26.492480 31815 consensus_queue.cc:1048] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:26.495570 30618 raft_consensus.cc:1275] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:26.495756 30476 consensus_queue.cc:237] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:26.496868 31700 consensus_queue.cc:1048] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:26.520515 30624 raft_consensus.cc:1275] T 0a6e86e0a4b843478d5970b29ad63ad7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:26.520622 30548 raft_consensus.cc:1275] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:26.522222 31890 consensus_queue.cc:1048] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:08:26.523213 30441 consensus_peers.cc:597] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 -> Peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453): Couldn't send request to peer cd669586cff44d4bbfcc007e213faab6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0a6e86e0a4b843478d5970b29ad63ad7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:26.524056 31815 consensus_queue.cc:1048] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:26.548030 30476 raft_consensus.cc:1275] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:26.550590 31890 raft_consensus.cc:2955] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:26.552409 31816 consensus_queue.cc:1048] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:26.554109 30621 raft_consensus.cc:2955] T 0a6e86e0a4b843478d5970b29ad63ad7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:26.564706 31151 raft_consensus.cc:1275] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:26.568280 30625 raft_consensus.cc:1275] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:26.568185 31816 consensus_queue.cc:1048] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:26.595479 31726 consensus_queue.cc:1048] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:08:26.605284 30370 catalog_manager.cc:5697] T 0a6e86e0a4b843478d5970b29ad63ad7 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: config changed from index -1 to 3, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New cstate: current_term: 3 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
W20260709 13:08:26.637517 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 45985us
I20260709 13:08:26.640542 30469 raft_consensus.cc:1275] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:26.650461 30549 raft_consensus.cc:2955] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:26.655191 31907 consensus_queue.cc:1048] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:26.728622 30548 raft_consensus.cc:1275] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:26.730338 31815 consensus_queue.cc:1048] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:26.782058 30624 raft_consensus.cc:1275] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:26.783421 31815 consensus_queue.cc:1048] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:26.800729 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:26.916138 31920 ts_tablet_manager.cc:933] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6: Initiating tablet copy from peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133)
I20260709 13:08:26.921721 31920 tablet_copy_client.cc:323] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6: tablet copy: Beginning tablet copy session from remote peer at address 127.28.173.1:43133
I20260709 13:08:26.924366 30486 tablet_copy_service.cc:140] P f639301059e24dc5b0d88a46dc683326: Received BeginTabletCopySession request for tablet e6646800b690458391bbff6a6bba535c from peer cd669586cff44d4bbfcc007e213faab6 ({username='slave'} at 127.0.0.1:60026)
I20260709 13:08:26.924940 30486 tablet_copy_service.cc:161] P f639301059e24dc5b0d88a46dc683326: Beginning new tablet copy session on tablet e6646800b690458391bbff6a6bba535c from peer cd669586cff44d4bbfcc007e213faab6 at {username='slave'} at 127.0.0.1:60026: session id = cd669586cff44d4bbfcc007e213faab6-e6646800b690458391bbff6a6bba535c
I20260709 13:08:26.944671 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:26.946518 31922 ts_tablet_manager.cc:933] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6: Initiating tablet copy from peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:26.952432 31922 tablet_copy_client.cc:323] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Beginning tablet copy session from remote peer at address 127.28.173.2:34733
I20260709 13:08:26.963423 30561 tablet_copy_service.cc:140] P 092f6eb694fc4bbeab49677cccd880fd: Received BeginTabletCopySession request for tablet daf3769ea0a34be69a628c90f1f8a721 from peer cd669586cff44d4bbfcc007e213faab6 ({username='slave'} at 127.0.0.1:35278)
I20260709 13:08:26.963982 30561 tablet_copy_service.cc:161] P 092f6eb694fc4bbeab49677cccd880fd: Beginning new tablet copy session on tablet daf3769ea0a34be69a628c90f1f8a721 from peer cd669586cff44d4bbfcc007e213faab6 at {username='slave'} at 127.0.0.1:35278: session id = cd669586cff44d4bbfcc007e213faab6-daf3769ea0a34be69a628c90f1f8a721
I20260709 13:08:26.975710 30561 tablet_copy_source_session.cc:215] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:26.982448 31922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daf3769ea0a34be69a628c90f1f8a721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:27.006420 31922 tablet_copy_client.cc:806] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:27.011547 31922 tablet_copy_client.cc:670] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:27.003723 31925 ts_tablet_manager.cc:933] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6: Initiating tablet copy from peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133)
I20260709 13:08:27.011673 30469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7"
dest_uuid: "f639301059e24dc5b0d88a46dc683326"
mode: GRACEFUL
new_leader_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:38176
I20260709 13:08:27.013288 30469 raft_consensus.cc:606] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Received request to transfer leadership to TS 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:27.017663 30548 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1560cc6404764454b2843cec97934e6b"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
mode: GRACEFUL
new_leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
 from {username='slave'} at 127.0.0.1:45906
I20260709 13:08:27.018239 30548 raft_consensus.cc:606] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Received request to transfer leadership to TS fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:27.020387 31922 tablet_copy_client.cc:538] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:27.021364 30469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7111be574b514751972d70830d3b644f"
dest_uuid: "f639301059e24dc5b0d88a46dc683326"
mode: GRACEFUL
new_leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
 from {username='slave'} at 127.0.0.1:38176
I20260709 13:08:27.021974 30469 raft_consensus.cc:606] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 2 LEADER]: Received request to transfer leadership to TS fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:27.018280 30486 tablet_copy_source_session.cc:215] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:27.023149 29364 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:08:27.024479 31925 tablet_copy_client.cc:323] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Beginning tablet copy session from remote peer at address 127.28.173.1:43133
I20260709 13:08:27.024837 29364 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:27.029626 31920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6646800b690458391bbff6a6bba535c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:27.030040 30486 tablet_copy_service.cc:140] P f639301059e24dc5b0d88a46dc683326: Received BeginTabletCopySession request for tablet 0a6e86e0a4b843478d5970b29ad63ad7 from peer cd669586cff44d4bbfcc007e213faab6 ({username='slave'} at 127.0.0.1:60026)
I20260709 13:08:27.030594 30486 tablet_copy_service.cc:161] P f639301059e24dc5b0d88a46dc683326: Beginning new tablet copy session on tablet 0a6e86e0a4b843478d5970b29ad63ad7 from peer cd669586cff44d4bbfcc007e213faab6 at {username='slave'} at 127.0.0.1:60026: session id = cd669586cff44d4bbfcc007e213faab6-0a6e86e0a4b843478d5970b29ad63ad7
I20260709 13:08:27.040902 30486 tablet_copy_source_session.cc:215] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:27.042884 31922 tablet_bootstrap.cc:492] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6: Bootstrap starting.
I20260709 13:08:27.044370 31925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a6e86e0a4b843478d5970b29ad63ad7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:27.056547 31912 raft_consensus.cc:993] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326: : Instructing follower fe2b7d73f8c743c1ba570cfd981c4e79 to start an election
I20260709 13:08:27.057097 31815 raft_consensus.cc:1081] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 2 LEADER]: Signalling peer fe2b7d73f8c743c1ba570cfd981c4e79 to start an election
I20260709 13:08:27.059003 30618 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7111be574b514751972d70830d3b644f"
dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
 from {username='slave'} at 127.0.0.1:36130
I20260709 13:08:27.059103 31920 tablet_copy_client.cc:806] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:27.059566 30618 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:27.059952 30618 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:27.060108 31920 tablet_copy_client.cc:670] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:27.068207 30618 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:27.071159 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:27.071751 30469 raft_consensus.cc:3055] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:27.072208 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:27.072453 30469 raft_consensus.cc:740] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:27.072799 31151 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:27.073223 30469 consensus_queue.cc:260] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:27.074304 30469 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:27.091274 31920 tablet_copy_client.cc:538] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:27.094175 31151 raft_consensus.cc:2468] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:27.103327 30590 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:27.104187 31676 raft_consensus.cc:2804] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:27.104641 31676 raft_consensus.cc:697] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:27.105319 30469 raft_consensus.cc:2468] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:27.105410 31676 consensus_queue.cc:237] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:27.111703 31925 tablet_copy_client.cc:806] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:27.115494 31925 tablet_copy_client.cc:670] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:27.118566 30618 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:27.120311 31925 tablet_copy_client.cc:538] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:27.145870 30371 catalog_manager.cc:5697] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 2 to 3, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 3 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:27.120357 31920 tablet_bootstrap.cc:492] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6: Bootstrap starting.
I20260709 13:08:27.159403 31925 tablet_bootstrap.cc:492] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6: Bootstrap starting.
I20260709 13:08:27.164644 31922 tablet_bootstrap.cc:492] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:27.165655 31922 tablet_bootstrap.cc:492] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6: Bootstrap complete.
I20260709 13:08:27.166366 31922 ts_tablet_manager.cc:1403] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6: Time spent bootstrapping tablet: real 0.124s	user 0.024s	sys 0.008s
I20260709 13:08:27.169533 31922 raft_consensus.cc:359] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:27.171110 31922 raft_consensus.cc:740] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Initialized, Role: LEARNER
I20260709 13:08:27.171792 31922 consensus_queue.cc:260] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:27.174431 31922 ts_tablet_manager.cc:1434] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:08:27.178462 30561 tablet_copy_service.cc:342] P 092f6eb694fc4bbeab49677cccd880fd: Request end of tablet copy session cd669586cff44d4bbfcc007e213faab6-daf3769ea0a34be69a628c90f1f8a721 received from {username='slave'} at 127.0.0.1:35278
I20260709 13:08:27.178918 30561 tablet_copy_service.cc:434] P 092f6eb694fc4bbeab49677cccd880fd: ending tablet copy session cd669586cff44d4bbfcc007e213faab6-daf3769ea0a34be69a628c90f1f8a721 on tablet daf3769ea0a34be69a628c90f1f8a721 with peer cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:27.212724 31912 raft_consensus.cc:993] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326: : Instructing follower 092f6eb694fc4bbeab49677cccd880fd to start an election
I20260709 13:08:27.213204 31912 raft_consensus.cc:1081] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Signalling peer 092f6eb694fc4bbeab49677cccd880fd to start an election
I20260709 13:08:27.214912 30548 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:43088
I20260709 13:08:27.215467 30548 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:27.215803 30548 raft_consensus.cc:3060] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:27.222730 30548 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:27.224637 31920 tablet_bootstrap.cc:492] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:27.225374 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:27.225690 31920 tablet_bootstrap.cc:492] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6: Bootstrap complete.
I20260709 13:08:27.228294 31920 ts_tablet_manager.cc:1403] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6: Time spent bootstrapping tablet: real 0.108s	user 0.026s	sys 0.019s
I20260709 13:08:27.226011 30469 raft_consensus.cc:3055] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:27.228931 30469 raft_consensus.cc:740] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:27.229635 30469 consensus_queue.cc:260] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:27.230918 30469 raft_consensus.cc:3060] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:27.231467 31920 raft_consensus.cc:359] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:27.234207 31920 raft_consensus.cc:740] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Initialized, Role: LEARNER
I20260709 13:08:27.235183 31920 consensus_queue.cc:260] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:27.238240 31920 ts_tablet_manager.cc:1434] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:08:27.240412 30486 tablet_copy_service.cc:342] P f639301059e24dc5b0d88a46dc683326: Request end of tablet copy session cd669586cff44d4bbfcc007e213faab6-e6646800b690458391bbff6a6bba535c received from {username='slave'} at 127.0.0.1:60026
I20260709 13:08:27.240852 30486 tablet_copy_service.cc:434] P f639301059e24dc5b0d88a46dc683326: ending tablet copy session cd669586cff44d4bbfcc007e213faab6-e6646800b690458391bbff6a6bba535c on tablet e6646800b690458391bbff6a6bba535c with peer cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:27.251880 30469 raft_consensus.cc:2468] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:08:27.264446 30548 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:27.265893 30517 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:27.267635 31910 raft_consensus.cc:2804] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:27.268148 31910 raft_consensus.cc:697] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:27.268201 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:27.268818 30618 raft_consensus.cc:3060] T 0a6e86e0a4b843478d5970b29ad63ad7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:27.269332 31910 consensus_queue.cc:237] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:27.275713 30618 raft_consensus.cc:2468] T 0a6e86e0a4b843478d5970b29ad63ad7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:08:27.285001 31925 tablet_bootstrap.cc:492] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:27.286600 31925 tablet_bootstrap.cc:492] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6: Bootstrap complete.
I20260709 13:08:27.287367 31925 ts_tablet_manager.cc:1403] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6: Time spent bootstrapping tablet: real 0.128s	user 0.031s	sys 0.004s
I20260709 13:08:27.291669 31925 raft_consensus.cc:359] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:27.292517 31925 raft_consensus.cc:740] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Initialized, Role: LEARNER
I20260709 13:08:27.293210 31925 consensus_queue.cc:260] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:27.295760 31925 ts_tablet_manager.cc:1434] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:08:27.300721 30486 tablet_copy_service.cc:342] P f639301059e24dc5b0d88a46dc683326: Request end of tablet copy session cd669586cff44d4bbfcc007e213faab6-0a6e86e0a4b843478d5970b29ad63ad7 received from {username='slave'} at 127.0.0.1:60026
I20260709 13:08:27.301112 30486 tablet_copy_service.cc:434] P f639301059e24dc5b0d88a46dc683326: ending tablet copy session cd669586cff44d4bbfcc007e213faab6-0a6e86e0a4b843478d5970b29ad63ad7 on tablet 0a6e86e0a4b843478d5970b29ad63ad7 with peer cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:27.303555 30371 catalog_manager.cc:5697] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 3 to 4, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 4 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:27.349623 31700 raft_consensus.cc:993] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd: : Instructing follower fe2b7d73f8c743c1ba570cfd981c4e79 to start an election
I20260709 13:08:27.350138 31700 raft_consensus.cc:1081] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Signalling peer fe2b7d73f8c743c1ba570cfd981c4e79 to start an election
I20260709 13:08:27.352428 30624 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1560cc6404764454b2843cec97934e6b"
dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
 from {username='slave'} at 127.0.0.1:47446
I20260709 13:08:27.352960 30624 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:27.353294 30624 raft_consensus.cc:3060] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:27.360925 30624 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:27.363590 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:27.364185 30469 raft_consensus.cc:3060] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:27.370559 31150 raft_consensus.cc:1217] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:27.380450 30469 raft_consensus.cc:2468] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 2.
I20260709 13:08:27.381701 30591 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:27.382552 31676 raft_consensus.cc:2804] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:27.383041 31676 raft_consensus.cc:697] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:27.383890 31676 consensus_queue.cc:237] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:27.390750 30624 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:27.392120 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:27.392731 30546 raft_consensus.cc:3055] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:27.393029 30546 raft_consensus.cc:740] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:27.398383 30469 raft_consensus.cc:1240] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:27.404498 30546 consensus_queue.cc:260] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:27.407394 30371 catalog_manager.cc:5697] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 1 to 2, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 2 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:27.427491 30546 raft_consensus.cc:3060] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:27.430667 31700 consensus_queue.cc:1175] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f639301059e24dc5b0d88a46dc683326" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:27.443642 30546 raft_consensus.cc:2468] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 2.
I20260709 13:08:27.466774 31150 raft_consensus.cc:1217] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:27.516340 31150 raft_consensus.cc:1275] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:27.517745 31924 consensus_queue.cc:1048] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:27.545027 30474 raft_consensus.cc:1275] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:27.546583 31924 consensus_queue.cc:1048] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:27.714656 30624 raft_consensus.cc:1275] T 0a6e86e0a4b843478d5970b29ad63ad7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:27.717904 31700 consensus_queue.cc:1048] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:27.767231 31150 raft_consensus.cc:3060] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 3 LEARNER]: Advancing to term 4
I20260709 13:08:27.776563 30474 raft_consensus.cc:1275] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:27.779307 31910 consensus_queue.cc:1048] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:27.783020 31150 raft_consensus.cc:1275] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 4 LEARNER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:27.784969 31910 consensus_queue.cc:1048] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:27.802599 31700 raft_consensus.cc:1064] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd: attempting to promote NON_VOTER cd669586cff44d4bbfcc007e213faab6 to VOTER
I20260709 13:08:27.813571 31700 consensus_queue.cc:237] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:27.834461 31151 raft_consensus.cc:1275] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 4 LEARNER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:08:27.839716 30474 raft_consensus.cc:1275] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:08:27.841164 31913 consensus_queue.cc:1048] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:27.842579 31914 consensus_queue.cc:1048] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:27.847057 30618 raft_consensus.cc:1275] T 0a6e86e0a4b843478d5970b29ad63ad7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:08:27.857497 31913 consensus_queue.cc:1048] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:27.867172 31910 raft_consensus.cc:1064] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd: attempting to promote NON_VOTER cd669586cff44d4bbfcc007e213faab6 to VOTER
I20260709 13:08:27.869791 31910 consensus_queue.cc:237] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:27.884544 31913 raft_consensus.cc:2955] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 3 to 5, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:27.902913 30371 catalog_manager.cc:5697] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: config changed from index 3 to 5, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:27.913059 30469 raft_consensus.cc:2955] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
W20260709 13:08:27.939666 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 55373.5us
I20260709 13:08:27.943049 31150 raft_consensus.cc:2955] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:27.968672 30548 consensus_queue.cc:237] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:27.999855 30474 raft_consensus.cc:1275] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:28.004231 31676 consensus_queue.cc:1048] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:08:27.959091 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 85999.3us
I20260709 13:08:28.010751 30548 raft_consensus.cc:1275] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:28.012979 31856 consensus_queue.cc:1048] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:28.028017 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:28.050735 30618 raft_consensus.cc:2955] T 0a6e86e0a4b843478d5970b29ad63ad7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:28.107470 31151 raft_consensus.cc:1275] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:28.128233 31910 consensus_queue.cc:1048] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:28.133005 30474 raft_consensus.cc:1275] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:28.151346 30471 raft_consensus.cc:1275] T daf3769ea0a34be69a628c90f1f8a721 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:28.162732 31910 consensus_queue.cc:1048] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:28.167131 31913 consensus_queue.cc:1048] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:28.176278 31150 raft_consensus.cc:1275] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:28.179226 30618 raft_consensus.cc:1275] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:28.186692 31909 raft_consensus.cc:1064] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326: attempting to promote NON_VOTER cd669586cff44d4bbfcc007e213faab6 to VOTER
I20260709 13:08:28.188851 31909 consensus_queue.cc:237] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:28.212152 31910 consensus_queue.cc:1048] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:28.217353 31947 consensus_queue.cc:1048] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:28.223423 31914 raft_consensus.cc:2955] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
W20260709 13:08:28.280913 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 71508.3us
I20260709 13:08:28.282465 30545 raft_consensus.cc:1275] T e6646800b690458391bbff6a6bba535c P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:28.282582 31150 raft_consensus.cc:1275] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:28.285672 30624 raft_consensus.cc:1275] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:28.303939 31952 consensus_queue.cc:1048] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:28.305540 31950 consensus_queue.cc:1048] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:28.306442 31952 consensus_queue.cc:1048] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:08:28.324702 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 104720us
I20260709 13:08:28.334034 30359 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0a6e86e0a4b843478d5970b29ad63ad7 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:28.331547 31151 raft_consensus.cc:2955] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:28.354161 30372 catalog_manager.cc:5697] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: config changed from index 5 to 6, VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) evicted. New cstate: current_term: 4 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:28.414443 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:28.415607 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 78702.3us
W20260709 13:08:28.423930 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 87290.1us
W20260709 13:08:28.520541 31955 log.cc:927] Time spent T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
W20260709 13:08:28.551386 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 71088.1us
W20260709 13:08:28.628199 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 179179us
W20260709 13:08:28.687860 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 57157.6us
I20260709 13:08:28.726846 31974 raft_consensus.cc:2955] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
W20260709 13:08:28.729517 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 98455.7us
W20260709 13:08:28.735569 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 181148us
I20260709 13:08:28.741467 30476 raft_consensus.cc:2955] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:28.755998 31947 raft_consensus.cc:2955] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:28.761348 31150 raft_consensus.cc:2955] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
W20260709 13:08:28.772713 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 436026us
I20260709 13:08:28.779650 30371 catalog_manager.cc:5697] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 reported cstate change: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:28.785002 30476 raft_consensus.cc:2955] T daf3769ea0a34be69a628c90f1f8a721 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:28.788157 30621 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c"
dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
mode: GRACEFUL
new_leader_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:49382
I20260709 13:08:28.788713 30621 raft_consensus.cc:606] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 LEADER]: Received request to transfer leadership to TS 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:28.795471 30621 raft_consensus.cc:2955] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:28.798538 30470 consensus_queue.cc:237] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:28.809736 31146 raft_consensus.cc:1275] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:28.818835 30618 raft_consensus.cc:2955] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:28.822781 31974 consensus_queue.cc:1048] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:28.835289 30372 catalog_manager.cc:5697] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:28.844772 30624 raft_consensus.cc:1275] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:28.851449 30550 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
mode: GRACEFUL
new_leader_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:45906
I20260709 13:08:28.851964 30550 raft_consensus.cc:606] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 2 LEADER]: Received request to transfer leadership to TS f639301059e24dc5b0d88a46dc683326
I20260709 13:08:28.842830 31150 raft_consensus.cc:2955] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:28.876130 30545 consensus_queue.cc:237] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:28.879781 31964 raft_consensus.cc:2955] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:28.884203 30612 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a6e86e0a4b843478d5970b29ad63ad7 with delete_type TABLET_DATA_TOMBSTONED (TS fe2b7d73f8c743c1ba570cfd981c4e79 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:36118
I20260709 13:08:28.895884 31146 raft_consensus.cc:2955] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:28.900291 31974 consensus_queue.cc:1048] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:28.901433 30624 raft_consensus.cc:1275] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:28.903160 31151 raft_consensus.cc:1275] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:28.905977 31700 consensus_queue.cc:1048] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:28.907467 31700 consensus_queue.cc:1048] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:28.910772 30624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041"
dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
mode: GRACEFUL
new_leader_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:49382
I20260709 13:08:28.911336 30624 raft_consensus.cc:606] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 LEADER]: Received request to transfer leadership to TS 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:28.916118 30550 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
mode: GRACEFUL
new_leader_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:45906
I20260709 13:08:28.916692 30550 raft_consensus.cc:606] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Received request to transfer leadership to TS f639301059e24dc5b0d88a46dc683326
I20260709 13:08:28.915854 31963 raft_consensus.cc:2955] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:28.918967 29364 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:08:28.920523 29364 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:28.923401 31151 raft_consensus.cc:2955] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:28.925679 30624 raft_consensus.cc:2955] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:28.926928 30618 raft_consensus.cc:2955] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:28.947449 30371 catalog_manager.cc:5697] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: config changed from index 3 to 4, VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) evicted. New cstate: current_term: 1 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:28.948735 30359 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet daf3769ea0a34be69a628c90f1f8a721 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:28.963675 30541 tablet_service.cc:1558] Processing DeleteTablet for tablet e6646800b690458391bbff6a6bba535c with delete_type TABLET_DATA_TOMBSTONED (TS 092f6eb694fc4bbeab49677cccd880fd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43082
I20260709 13:08:28.961947 30374 catalog_manager.cc:5697] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: config changed from index 3 to 4, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:28.970712 30361 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e6646800b690458391bbff6a6bba535c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:28.980998 31957 raft_consensus.cc:993] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd: : Instructing follower f639301059e24dc5b0d88a46dc683326 to start an election
I20260709 13:08:28.981600 31957 raft_consensus.cc:1081] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 2 LEADER]: Signalling peer f639301059e24dc5b0d88a46dc683326 to start an election
I20260709 13:08:28.982107 31981 tablet_replica.cc:333] T 0a6e86e0a4b843478d5970b29ad63ad7 P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:08:28.983297 30471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31"
dest_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:50430
I20260709 13:08:28.983916 30471 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:28.984238 30471 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:28.985538 31981 raft_consensus.cc:2243] T 0a6e86e0a4b843478d5970b29ad63ad7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.986395 31981 raft_consensus.cc:2272] T 0a6e86e0a4b843478d5970b29ad63ad7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.995191 31981 ts_tablet_manager.cc:1916] T 0a6e86e0a4b843478d5970b29ad63ad7 P fe2b7d73f8c743c1ba570cfd981c4e79: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:29.010756 30464 tablet_service.cc:1558] Processing DeleteTablet for tablet daf3769ea0a34be69a628c90f1f8a721 with delete_type TABLET_DATA_TOMBSTONED (TS f639301059e24dc5b0d88a46dc683326 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53858
I20260709 13:08:29.012347 31982 tablet_replica.cc:333] T e6646800b690458391bbff6a6bba535c P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:08:29.022339 30471 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:29.032075 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:29.032696 30550 raft_consensus.cc:3055] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:29.032982 30550 raft_consensus.cc:740] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:29.033097 31676 raft_consensus.cc:993] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79: : Instructing follower 092f6eb694fc4bbeab49677cccd880fd to start an election
I20260709 13:08:29.033653 31676 raft_consensus.cc:1081] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 LEADER]: Signalling peer 092f6eb694fc4bbeab49677cccd880fd to start an election
I20260709 13:08:29.033710 30550 consensus_queue.cc:260] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:29.034984 30550 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:29.035761 30545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:39952
I20260709 13:08:29.036536 30545 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:29.036964 30545 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:29.028751 31981 ts_tablet_manager.cc:1929] T 0a6e86e0a4b843478d5970b29ad63ad7 P fe2b7d73f8c743c1ba570cfd981c4e79: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 13:08:29.043669 31981 log.cc:1199] T 0a6e86e0a4b843478d5970b29ad63ad7 P fe2b7d73f8c743c1ba570cfd981c4e79: Deleting WAL directory at /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-2-root/wals/0a6e86e0a4b843478d5970b29ad63ad7
I20260709 13:08:29.045528 30360 catalog_manager.cc:5028] TS fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): tablet 0a6e86e0a4b843478d5970b29ad63ad7 (table test-workload [id=887057791fed41a884abbab3e8d4b49f]) successfully deleted
I20260709 13:08:29.046795 30550 raft_consensus.cc:2468] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
I20260709 13:08:29.048813 30440 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:29.048619 30545 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:29.050122 30471 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:29.049612 31964 raft_consensus.cc:2804] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:29.088465 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:29.089108 30624 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:29.095475 30624 raft_consensus.cc:2468] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
I20260709 13:08:29.104264 31983 tablet_replica.cc:333] T daf3769ea0a34be69a628c90f1f8a721 P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:08:29.105350 31983 raft_consensus.cc:2243] T daf3769ea0a34be69a628c90f1f8a721 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:29.106180 31983 raft_consensus.cc:2272] T daf3769ea0a34be69a628c90f1f8a721 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.107566 30545 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:29.108258 31982 raft_consensus.cc:2243] T e6646800b690458391bbff6a6bba535c P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:29.108798 31982 pending_rounds.cc:70] T e6646800b690458391bbff6a6bba535c P 092f6eb694fc4bbeab49677cccd880fd: Trying to abort 1 pending ops.
I20260709 13:08:29.109613 31983 ts_tablet_manager.cc:1916] T daf3769ea0a34be69a628c90f1f8a721 P f639301059e24dc5b0d88a46dc683326: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:29.109108 31982 pending_rounds.cc:77] T e6646800b690458391bbff6a6bba535c P 092f6eb694fc4bbeab49677cccd880fd: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305635873536905216 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "e6646800b690458391bbff6a6bba535c" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } } }
I20260709 13:08:29.110091 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:29.110463 31982 raft_consensus.cc:2917] T e6646800b690458391bbff6a6bba535c P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 13:08:29.110706 30618 raft_consensus.cc:3055] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:29.110965 31982 raft_consensus.cc:2889] T e6646800b690458391bbff6a6bba535c P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:08:29.111074 30618 raft_consensus.cc:740] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:29.111460 31982 raft_consensus.cc:2272] T e6646800b690458391bbff6a6bba535c P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.112020 30618 consensus_queue.cc:260] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:29.113300 30618 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:29.124701 30618 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 3.
I20260709 13:08:29.128096 30516 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:29.129424 31700 raft_consensus.cc:2804] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:29.129892 31700 raft_consensus.cc:697] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 3 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:29.129774 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:29.130733 30471 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:29.138872 31700 consensus_queue.cc:237] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:29.142042 31982 ts_tablet_manager.cc:1916] T e6646800b690458391bbff6a6bba535c P 092f6eb694fc4bbeab49677cccd880fd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:29.153266 30471 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 3.
I20260709 13:08:29.159070 30371 catalog_manager.cc:5697] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 2 to 3, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 3 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:29.163798 31983 ts_tablet_manager.cc:1929] T daf3769ea0a34be69a628c90f1f8a721 P f639301059e24dc5b0d88a46dc683326: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:29.164366 31983 log.cc:1199] T daf3769ea0a34be69a628c90f1f8a721 P f639301059e24dc5b0d88a46dc683326: Deleting WAL directory at /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-0-root/wals/daf3769ea0a34be69a628c90f1f8a721
I20260709 13:08:29.165397 31964 raft_consensus.cc:697] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:29.168637 30361 catalog_manager.cc:5028] TS f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): tablet daf3769ea0a34be69a628c90f1f8a721 (table test-workload [id=887057791fed41a884abbab3e8d4b49f]) successfully deleted
I20260709 13:08:29.166325 31964 consensus_queue.cc:237] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:29.170373 31982 ts_tablet_manager.cc:1929] T e6646800b690458391bbff6a6bba535c P 092f6eb694fc4bbeab49677cccd880fd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:29.170818 31982 log.cc:1199] T e6646800b690458391bbff6a6bba535c P 092f6eb694fc4bbeab49677cccd880fd: Deleting WAL directory at /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-1-root/wals/e6646800b690458391bbff6a6bba535c
I20260709 13:08:29.172544 30359 catalog_manager.cc:5028] TS 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): tablet e6646800b690458391bbff6a6bba535c (table test-workload [id=887057791fed41a884abbab3e8d4b49f]) successfully deleted
I20260709 13:08:29.183995 30371 catalog_manager.cc:5697] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 2 to 3, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 3 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:29.277619 31676 raft_consensus.cc:993] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79: : Instructing follower 092f6eb694fc4bbeab49677cccd880fd to start an election
I20260709 13:08:29.278087 31975 raft_consensus.cc:1081] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 LEADER]: Signalling peer 092f6eb694fc4bbeab49677cccd880fd to start an election
I20260709 13:08:29.279459 30550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:39952
I20260709 13:08:29.280084 30550 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:29.280443 30550 raft_consensus.cc:3060] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:29.291015 30550 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:29.295421 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:29.296020 30618 raft_consensus.cc:3055] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:29.297463 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:29.298028 31146 raft_consensus.cc:3060] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:29.298159 30550 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:29.297052 30618 raft_consensus.cc:740] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:29.300594 30618 consensus_queue.cc:260] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:29.302191 30618 raft_consensus.cc:3060] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:29.306756 31146 raft_consensus.cc:2468] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 3.
I20260709 13:08:29.307971 30516 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:08:29.308611 31957 raft_consensus.cc:2804] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:29.309067 31957 raft_consensus.cc:697] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 3 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:29.309881 31957 consensus_queue.cc:237] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:29.313432 30618 raft_consensus.cc:2468] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 3.
I20260709 13:08:29.319147 30371 catalog_manager.cc:5697] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 2 to 3, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 3 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:29.323062 31700 raft_consensus.cc:993] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd: : Instructing follower f639301059e24dc5b0d88a46dc683326 to start an election
I20260709 13:08:29.323540 31700 raft_consensus.cc:1081] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Signalling peer f639301059e24dc5b0d88a46dc683326 to start an election
I20260709 13:08:29.324918 30471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72"
dest_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:50430
I20260709 13:08:29.325416 30471 raft_consensus.cc:493] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:29.325734 30471 raft_consensus.cc:3060] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:29.331974 30471 raft_consensus.cc:515] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:29.333534 30471 leader_election.cc:290] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:29.334242 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:29.334372 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:29.334818 30550 raft_consensus.cc:3055] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:29.334833 30618 raft_consensus.cc:3060] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:29.335165 30550 raft_consensus.cc:740] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:29.335911 30550 consensus_queue.cc:260] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:29.336798 30550 raft_consensus.cc:3060] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:29.339430 30618 raft_consensus.cc:2468] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 2.
I20260709 13:08:29.341933 30550 raft_consensus.cc:2468] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 2.
I20260709 13:08:29.342839 30440 leader_election.cc:304] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:29.343544 31987 raft_consensus.cc:2804] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:29.343912 31987 raft_consensus.cc:697] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 2 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:29.344719 31987 consensus_queue.cc:237] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:29.359043 30371 catalog_manager.cc:5697] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 1 to 2, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 2 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:29.546911 30470 raft_consensus.cc:1275] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:29.548027 31957 consensus_queue.cc:1048] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:29.557053 30624 raft_consensus.cc:1275] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:29.559340 31957 consensus_queue.cc:1048] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:29.646550 30550 raft_consensus.cc:1275] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:29.647854 31964 consensus_queue.cc:1048] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:29.648046 30624 raft_consensus.cc:1275] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:29.649811 31964 consensus_queue.cc:1048] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:29.724825 31151 raft_consensus.cc:1275] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:29.726236 31957 consensus_queue.cc:1048] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:29.738401 30624 raft_consensus.cc:1275] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:29.739804 31700 consensus_queue.cc:1048] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:29.844808 30624 raft_consensus.cc:1275] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:29.845862 31987 consensus_queue.cc:1048] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:29.856165 30550 raft_consensus.cc:1275] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:29.859259 31987 consensus_queue.cc:1048] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:29.921298 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:30.025169 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:30.080762 30470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130"
dest_uuid: "f639301059e24dc5b0d88a46dc683326"
mode: GRACEFUL
new_leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
 from {username='slave'} at 127.0.0.1:38176
I20260709 13:08:30.081265 30470 raft_consensus.cc:606] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Received request to transfer leadership to TS fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:30.083669 30470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31"
dest_uuid: "f639301059e24dc5b0d88a46dc683326"
mode: GRACEFUL
new_leader_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:38176
I20260709 13:08:30.084157 30470 raft_consensus.cc:606] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Received request to transfer leadership to TS 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:30.086457 30545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
mode: GRACEFUL
new_leader_uuid: "cd669586cff44d4bbfcc007e213faab6"
 from {username='slave'} at 127.0.0.1:45906
I20260709 13:08:30.087035 30545 raft_consensus.cc:606] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Received request to transfer leadership to TS cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:30.089367 30545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
mode: GRACEFUL
new_leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
 from {username='slave'} at 127.0.0.1:45906
I20260709 13:08:30.089913 30545 raft_consensus.cc:606] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Received request to transfer leadership to TS fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:30.091953 29364 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:08:30.093809 29364 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:30.109563 30618 consensus_queue.cc:237] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:30.115325 30550 raft_consensus.cc:1275] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:08:30.116631 30590 consensus_peers.cc:597] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453): Couldn't send request to peer cd669586cff44d4bbfcc007e213faab6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1560cc6404764454b2843cec97934e6b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:30.117228 30470 raft_consensus.cc:1275] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:08:30.117697 32006 consensus_queue.cc:1048] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:30.118569 31676 consensus_queue.cc:1048] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:30.122629 32002 raft_consensus.cc:993] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326: : Instructing follower 092f6eb694fc4bbeab49677cccd880fd to start an election
I20260709 13:08:30.123147 32002 raft_consensus.cc:1081] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Signalling peer 092f6eb694fc4bbeab49677cccd880fd to start an election
I20260709 13:08:30.125430 30550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:43088
I20260709 13:08:30.126035 30550 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:30.126461 30550 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:30.126452 32006 raft_consensus.cc:2955] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:30.128780 30470 raft_consensus.cc:2955] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:30.128909 30545 raft_consensus.cc:2955] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:30.133518 30550 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:30.136021 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:30.136551 30471 raft_consensus.cc:3055] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:30.136849 30471 raft_consensus.cc:740] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:30.137522 30471 consensus_queue.cc:260] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:30.138036 30550 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:30.138506 30471 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:30.147126 30471 raft_consensus.cc:2468] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:08:30.147193 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:30.146863 30370 catalog_manager.cc:5697] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: config changed from index -1 to 3, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New cstate: current_term: 2 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:30.148027 30618 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:30.147606 30467 consensus_queue.cc:237] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:30.152339 30517 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:30.153514 31913 raft_consensus.cc:2804] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:30.153941 31913 raft_consensus.cc:697] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:30.154662 31913 consensus_queue.cc:237] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:30.155598 30618 raft_consensus.cc:2468] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:08:30.164754 30621 raft_consensus.cc:1275] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:08:30.166759 30550 raft_consensus.cc:1275] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 13:08:30.167500 30441 consensus_peers.cc:597] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 -> Peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453): Couldn't send request to peer cd669586cff44d4bbfcc007e213faab6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2b207fb799ce4340b29ae053898e0e6c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:30.168217 32002 consensus_queue.cc:1048] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:30.169193 32003 consensus_queue.cc:1048] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:30.173727 30372 catalog_manager.cc:5697] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 3 to 4, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 4 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:30.193157 31987 raft_consensus.cc:2955] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:30.195276 30618 raft_consensus.cc:2955] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:30.195878 30550 raft_consensus.cc:2955] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:30.210964 30545 consensus_queue.cc:237] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
W20260709 13:08:30.224119 30516 consensus_peers.cc:597] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd -> Peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453): Couldn't send request to peer cd669586cff44d4bbfcc007e213faab6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f6fb8561d12345948ed56d359f5ef4f3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:30.225179 30618 raft_consensus.cc:1275] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:30.226619 31957 consensus_queue.cc:1048] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:30.229543 30467 raft_consensus.cc:1275] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:30.231043 31957 consensus_queue.cc:1048] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:30.230927 30372 catalog_manager.cc:5697] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: config changed from index -1 to 4, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New cstate: current_term: 3 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:30.236802 31913 raft_consensus.cc:2955] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:30.238574 30621 raft_consensus.cc:2955] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:30.245873 30470 raft_consensus.cc:2955] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:30.257681 30467 consensus_queue.cc:237] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:30.261956 30372 catalog_manager.cc:5697] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New cstate: current_term: 1 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:30.279088 30621 raft_consensus.cc:1275] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:30.281011 31987 consensus_queue.cc:1048] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:30.281348 30545 raft_consensus.cc:1275] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:30.284798 30441 consensus_peers.cc:597] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 -> Peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453): Couldn't send request to peer cd669586cff44d4bbfcc007e213faab6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5610a33c644c4e539ad503631763aa40. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:31.097535 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:31.338403 32022 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:31.339020 32022 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:31.341990 31113 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.023s	sys 0.030s
W20260709 13:08:31.342445 31113 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.023s	sys 0.030s
I20260709 13:08:31.361236 32022 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:31.363375 32029 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:31.363971 32029 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:31.366374 32029 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:31.377409 32030 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:31.380833 32030 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:31.383796 32030 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:08:31.407639 29369 debug-util.cc:398] Leaking SignalData structure 0x7b080000fc60 after lost signal to thread 30440
W20260709 13:08:31.408290 29369 kernel_stack_watchdog.cc:198] Thread 30440 stuck at /apache/dev/git/kudu/src/kudu/rpc/outbound_call.cc:307 for 118ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
I20260709 13:08:31.412655 32028 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:31.413323 32028 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:31.415860 32028 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:31.424497 31856 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:31.425115 31856 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:31.425750 32033 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:31.426275 32033 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:31.426713 32034 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:31.427398 31856 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:31.427186 32034 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:31.428543 32033 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:31.429251 32034 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:31.443019 32027 raft_consensus.cc:493] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:31.443660 32027 raft_consensus.cc:515] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:31.445778 32028 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:31.445885 32027 leader_election.cc:290] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:31.446332 32028 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:31.446486 32026 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:31.446543 32027 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
W20260709 13:08:31.447481 30470 consensus_meta.cc:287] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 1.200s	user 0.010s	sys 0.000s
I20260709 13:08:31.447327 32027 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:31.447192 32026 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:31.449163 32028 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:31.449477 32027 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:31.449750 32026 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:31.451628 32034 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:31.452207 32034 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:31.453441 32030 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:31.454212 32034 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:31.454006 32030 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:31.455374 30372 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57546 (request call id 300) took 1196 ms. Trace:
I20260709 13:08:31.455977 32030 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:31.455775 30372 rpcz_store.cc:276] 0709 13:08:30.258883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.259028 (+   145us) service_pool.cc:224] Handling call
0709 13:08:31.455293 (+1196265us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:30.265420 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:30.265852 (+   432us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:30.265917 (+    65us) write_op.cc:435] Acquired schema lock
0709 13:08:30.265944 (+    27us) tablet.cc:662] Decoding operations
0709 13:08:30.266333 (+   389us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:30.266369 (+    36us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:30.266389 (+    20us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:30.266524 (+   135us) tablet.cc:701] Row locks acquired
0709 13:08:30.266535 (+    11us) write_op.cc:260] PREPARE: finished
0709 13:08:30.266675 (+   140us) write_op.cc:270] Start()
0709 13:08:30.266823 (+   148us) write_op.cc:276] Timestamp: P: 1783602510266620 usec, L: 0
0709 13:08:30.266869 (+    46us) op_driver.cc:348] REPLICATION: starting
0709 13:08:30.267511 (+   642us) log.cc:844] Serialized 595 byte log entry
0709 13:08:30.269240 (+  1729us) op_driver.cc:464] REPLICATION: finished
0709 13:08:30.270016 (+   776us) write_op.cc:301] APPLY: starting
0709 13:08:30.270080 (+    64us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:30.270178 (+    98us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:30.270279 (+   101us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:30.270482 (+   203us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:30.270644 (+   162us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:08:30.270715 (+    71us) write_op.cc:312] APPLY: finished
0709 13:08:30.270903 (+   188us) log.cc:844] Serialized 23 byte log entry
0709 13:08:30.271055 (+   152us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:30.271142 (+    87us) write_op.cc:454] Released schema lock
0709 13:08:30.271174 (+    32us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:30.271473 (+   299us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:30.271499 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":583,"apply.run_cpu_time_us":1428,"apply.run_wall_time_us":1428,"num_ops":1,"prepare.queue_time_us":142,"prepare.run_cpu_time_us":2323,"prepare.run_wall_time_us":2325,"replication_time_us":2254}]]}
I20260709 13:08:31.457983 30370 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57542 (request call id 294) took 1196 ms. Trace:
I20260709 13:08:31.458839 30370 rpcz_store.cc:276] 0709 13:08:30.261519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.261651 (+   132us) service_pool.cc:224] Handling call
0709 13:08:31.457938 (+1196287us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":119272,"reported_tablets":1}
I20260709 13:08:31.460884 30470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 1672) took 1216 ms. Trace:
I20260709 13:08:31.461272 30470 rpcz_store.cc:276] 0709 13:08:30.244464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.245420 (+   956us) service_pool.cc:224] Handling call
0709 13:08:30.245645 (+   225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:30.245790 (+   145us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:08:31.447922 (+1202132us) log.cc:844] Serialized 14 byte log entry
0709 13:08:31.460558 (+ 12636us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:31.460607 (+    49us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:31.460646 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:31.460710 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:31.460814 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":108,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"thread_start_us":11660,"threads_started":1,"wal-append.queue_time_us":8505}
I20260709 13:08:31.477763 32026 raft_consensus.cc:493] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:31.478811 32026 raft_consensus.cc:515] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:31.481037 32026 leader_election.cc:290] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:31.495863 32026 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:31.496481 32026 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:31.500584 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:31.503923 32034 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:31.505033 32026 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:31.505174 32033 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:31.506105 32037 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:31.504803 32034 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:31.506096 32033 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:31.506764 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:31.508673 32033 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:31.509253 32033 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:31.509754 32033 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:31.512669 32033 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:31.514634 32026 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:31.515226 32026 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:31.506768 32037 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:31.518848 32027 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:31.518982 32033 raft_consensus.cc:493] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:31.519431 32027 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:31.519513 32033 raft_consensus.cc:515] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:31.521473 32027 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:31.523416 32038 raft_consensus.cc:493] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:31.523911 32026 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:31.524021 30619 raft_consensus.cc:1275] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:31.524945 32034 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:31.525444 32034 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:31.525890 32034 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:31.529237 32037 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:31.530668 32033 leader_election.cc:290] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133)
I20260709 13:08:31.530740 32027 raft_consensus.cc:493] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:31.531296 32027 raft_consensus.cc:515] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:31.533264 32027 leader_election.cc:290] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:31.533191 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:31.533962 30618 raft_consensus.cc:2468] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 2.
I20260709 13:08:31.534641 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:31.535218 30624 raft_consensus.cc:2468] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
I20260709 13:08:31.535686 32034 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:31.536417 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:31.538437 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:31.538614 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:31.539932 32035 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:31.540211 32028 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:31.540621 32035 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:31.540683 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:31.540858 32028 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:31.541653 30624 raft_consensus.cc:2468] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
I20260709 13:08:31.542862 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:31.543359 32035 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:31.543946 32028 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:31.544243 32039 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:31.544848 32039 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:31.546953 32031 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:31.547004 32039 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:31.547495 32031 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:31.549130 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:31.549989 30624 raft_consensus.cc:2468] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
I20260709 13:08:31.550525 32031 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:31.551268 32028 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:31.551728 32028 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:31.553154 32035 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:31.553634 32035 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:31.554214 32028 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:08:31.555258 31116 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.021s	user 0.023s	sys 0.017s
I20260709 13:08:31.555362 32035 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:08:31.555776 31116 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.022s	user 0.023s	sys 0.017s
I20260709 13:08:31.556826 32029 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:31.557337 32029 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:31.559212 32029 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:31.559312 32028 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:31.559855 32029 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:31.559894 32028 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:31.560694 30467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 1098) took 1275 ms. Trace:
I20260709 13:08:31.560460 32029 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:31.561045 30467 rpcz_store.cc:276] 0709 13:08:30.285476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.285931 (+   455us) service_pool.cc:224] Handling call
0709 13:08:31.560255 (+1274324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:31.560402 (+   147us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:31.560428 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:31.560477 (+    49us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:31.560507 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:31.560554 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:31.560642 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:31.562330 32029 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:31.562788 32029 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:31.523953 32038 raft_consensus.cc:515] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:31.563944 32030 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:31.565209 32038 leader_election.cc:290] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:31.564456 32027 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:31.565737 32028 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:31.565845 32027 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:31.563221 32029 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:31.564976 32030 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:31.569111 32027 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:31.571848 31969 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:31.559149 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:31.574905 30471 raft_consensus.cc:2468] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 1.
I20260709 13:08:31.582193 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:31.584297 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:31.592634 32030 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:31.572937 31969 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:31.597764 31969 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:31.584299 31967 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:31.623733 32037 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:31.624336 32037 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:31.626360 32037 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:31.627061 32027 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:31.627579 32027 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:31.629312 32035 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:31.629547 32027 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:31.629858 32035 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:31.632001 32035 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:31.632457 32035 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:31.632867 32035 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:31.633966 32028 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:31.634454 32028 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:31.635133 32035 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:31.635186 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:31.636296 32028 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:31.603722 31967 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:31.646656 31676 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:31.647143 31676 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:31.648904 31676 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:31.653375 32030 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:31.657649 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:31.658536 30624 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
I20260709 13:08:31.659536 31969 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:31.660218 31969 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:31.659387 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:31.659453 32030 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:31.657183 32039 raft_consensus.cc:493] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:31.664444 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:31.665196 30625 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
I20260709 13:08:31.667004 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:31.669317 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:31.670063 30622 raft_consensus.cc:2468] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 2.
I20260709 13:08:31.671257 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:31.674501 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:31.675305 30549 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 1.
I20260709 13:08:31.678982 32047 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:31.679944 32039 raft_consensus.cc:515] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:31.680305 32042 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.680371 31969 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:08:31.682590 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 1.39334e+06us
W20260709 13:08:31.682895 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 105922us
I20260709 13:08:31.653746 31967 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:31.680953 32042 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:31.686548 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:31.686847 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:31.688110 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:31.661509 32041 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:31.689647 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:31.679524 32047 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:31.706920 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:31.691339 32043 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:31.691777 30589 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:31.692341 32040 consensus_queue.cc:1048] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:08:31.694933 32039 leader_election.cc:290] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:31.697572 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:31.697016 31676 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:31.738271 31676 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:31.692091 32045 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:31.689199 31967 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:31.722018 32050 ts_tablet_manager.cc:933] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6: Initiating tablet copy from peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:31.706720 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:31.749662 32048 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:31.750304 32048 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:31.724834 32051 raft_consensus.cc:493] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:31.729724 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:31.730577 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:31.731278 32054 ts_tablet_manager.cc:933] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6: Initiating tablet copy from peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:31.732383 32024 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:31.695739 32029 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:31.696558 32044 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:31.705736 32030 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:31.700803 31969 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:31.701893 32023 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:31.723286 32052 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:31.705457 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:31.737635 32037 raft_consensus.cc:2804] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:31.791185 32032 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:31.736213 32038 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:31.812698 31148 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 1.
I20260709 13:08:31.813354 32038 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:31.814093 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:31.794854 31676 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:31.745344 32034 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:31.734432 32043 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:31.746649 32035 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:31.744336 32028 consensus_queue.cc:1048] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:08:31.745141 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:31.804416 31969 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:31.696738 32041 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:31.745291 32045 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:31.815148 32052 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:31.793581 32024 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:31.804524 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:31.799970 32029 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:31.747110 31967 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:31.800161 32051 raft_consensus.cc:515] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:31.913125 31676 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
W20260709 13:08:31.956472 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 208865us
I20260709 13:08:31.803071 31142 raft_consensus.cc:2468] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
I20260709 13:08:31.806308 32042 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:31.869222 32039 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:31.806692 32037 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:31.819404 32038 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:31.972201 31676 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:31.838882 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:31.923883 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:31.979686 32056 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:31.982549 31151 raft_consensus.cc:2468] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 2.
I20260709 13:08:31.828956 32032 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:31.976884 32029 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:31.918783 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:31.803508 32044 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:31.979672 32025 raft_consensus.cc:493] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:31.947781 32030 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:31.823642 32034 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:32.029347 32057 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:31.987421 32037 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:31.808795 32023 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:32.040632 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:31.983373 30544 raft_consensus.cc:2468] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 1.
I20260709 13:08:32.041868 31676 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:31.974149 32035 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:32.047408 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:31.986757 32039 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:31.988340 31148 raft_consensus.cc:2468] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 1.
W20260709 13:08:32.044301 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 69396.6us
I20260709 13:08:32.057687 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:31.982812 32048 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:32.048491 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:32.018972 32058 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:32.061328 30551 raft_consensus.cc:2468] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 1.
I20260709 13:08:32.031279 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:32.020475 32032 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:32.018266 32060 raft_consensus.cc:493] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:32.050172 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:31.987658 30543 raft_consensus.cc:2468] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 1.
I20260709 13:08:32.056499 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:32.070001 30624 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 1.
I20260709 13:08:32.040297 30545 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:32.072047 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.062160 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:31.984956 32043 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:32.063678 30589 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:32.054679 32025 raft_consensus.cc:515] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:32.067351 32054 tablet_copy_client.cc:323] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Beginning tablet copy session from remote peer at address 127.28.173.2:34733
I20260709 13:08:32.048570 32050 tablet_copy_client.cc:323] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6: tablet copy: Beginning tablet copy session from remote peer at address 127.28.173.3:32851
I20260709 13:08:32.067752 32034 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:32.067945 32055 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:32.068112 32039 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:32.069129 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:32.071363 32046 raft_consensus.cc:493] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:32.072618 30471 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:08:32.114219 32035 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:32.042825 32030 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:32.071219 32060 raft_consensus.cc:515] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:32.114259 32051 leader_election.cc:290] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:08:32.114490 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 50864us
W20260709 13:08:32.116891 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 313059us
I20260709 13:08:32.059849 32047 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:32.119321 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.073869 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:08:32.121062 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 149302us
I20260709 13:08:32.071725 32053 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:32.080768 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:32.053794 32057 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:32.111016 32041 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:32.116428 32038 raft_consensus.cc:2804] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:32.126662 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:32.124742 32024 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:32.129268 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.118063 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:32.131484 30589 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:32.136741 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.137198 31676 raft_consensus.cc:2804] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:32.137526 31676 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:32.137861 31676 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.138296 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:32.138988 30589 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:32.139520 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:32.140100 31150 raft_consensus.cc:2468] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 1.
I20260709 13:08:32.123178 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:32.143920 30516 leader_election.cc:304] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:32.126744 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:32.098412 32058 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:32.126693 30545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
mode: GRACEFUL
new_leader_uuid: "cd669586cff44d4bbfcc007e213faab6"
 from {username='slave'} at 127.0.0.1:45906
I20260709 13:08:32.153599 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:32.043288 32056 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:32.136301 32038 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:32.167979 32027 raft_consensus.cc:2804] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:32.171749 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.142498 32042 raft_consensus.cc:2804] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:32.172125 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.143953 31967 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:32.174748 30476 raft_consensus.cc:2468] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 2.
I20260709 13:08:32.174911 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.121554 32055 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:32.171233 30545 raft_consensus.cc:606] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Received request to transfer leadership to TS cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:32.173060 32027 raft_consensus.cc:493] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:32.171000 30543 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 2.
I20260709 13:08:32.177745 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.170074 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:32.193503 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:32.191524 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:32.177498 30470 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 2.
I20260709 13:08:32.173041 32038 raft_consensus.cc:3060] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.172746 32030 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:32.193061 32057 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:32.145287 32046 raft_consensus.cc:515] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:32.174293 32042 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:32.144949 32053 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:32.260182 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:32.263185 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:32.191172 32027 raft_consensus.cc:3060] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:32.266335 31144 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
W20260709 13:08:32.234040 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 167913us
I20260709 13:08:32.299934 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:32.267369 32044 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:32.267953 30548 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
mode: GRACEFUL
new_leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
 from {username='slave'} at 127.0.0.1:45906
I20260709 13:08:32.308514 30548 raft_consensus.cc:606] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Received request to transfer leadership to TS fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:32.233718 32029 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:32.303874 31676 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:32.308889 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.246308 30589 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:32.305115 32053 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:08:32.310773 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 184607us
I20260709 13:08:32.261677 32042 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:32.312062 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.305958 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:32.313273 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.313676 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.314096 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.314271 30473 raft_consensus.cc:2468] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:08:32.315323 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:32.315393 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.316001 30551 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 1.
I20260709 13:08:32.317627 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.318739 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.319489 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:32.320247 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:32.321979 31116 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:32.324898 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.325739 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:32.326099 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.327181 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.328007 30622 raft_consensus.cc:1240] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:32.328677 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.323638 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.330147 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.331030 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.332863 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.333060 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.333578 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:32.333896 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.334726 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:32.336407 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:32.336557 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:32.334867 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.338798 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:32.339088 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.342137 30591 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:32.342752 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:32.319778 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.344771 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.347262 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.350975 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.345570 32033 raft_consensus.cc:2804] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:08:32.310331 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 64144us
I20260709 13:08:32.352010 32033 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:32.352435 32033 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:32.347684 30441 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:32.352927 32047 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:32.353046 32039 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:32.353438 32047 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:32.353608 32039 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:32.356181 32068 raft_consensus.cc:2804] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:32.356093 32042 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:32.357300 30624 raft_consensus.cc:1240] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:32.359030 32042 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:32.355616 32039 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:32.343091 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.340523 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.365365 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.365857 30469 raft_consensus.cc:1275] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:32.346289 31676 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:32.352349 32065 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:32.356664 32068 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:32.371941 32068 raft_consensus.cc:3060] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.348767 32048 raft_consensus.cc:2955] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:32.355559 32047 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:32.371285 32065 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:32.377781 32065 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:32.345044 30591 leader_election.cc:304] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:32.379522 32042 raft_consensus.cc:2749] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:32.380263 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:32.380273 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:32.380973 30591 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:32.382933 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:32.383512 30546 raft_consensus.cc:2468] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 1.
I20260709 13:08:32.385149 32068 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:32.386242 30473 raft_consensus.cc:1240] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:32.387365 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:32.388708 32068 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:32.345515 30475 raft_consensus.cc:2468] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 2.
I20260709 13:08:32.392002 32033 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:32.392745 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:32.393893 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:32.395774 30591 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:32.255575 32052 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:08:32.397215 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 85461.3us
I20260709 13:08:32.411438 32025 leader_election.cc:290] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:32.412218 30589 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:32.412935 31856 raft_consensus.cc:2804] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:32.413259 31856 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:32.413369 32056 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:32.413621 31856 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.414418 32058 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:32.415408 32060 leader_election.cc:290] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:32.398093 32063 raft_consensus.cc:2804] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:32.398584 32022 raft_consensus.cc:2804] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:32.407058 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:32.394939 32042 raft_consensus.cc:2804] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:32.420944 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.399369 31676 raft_consensus.cc:2804] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:08:32.422024 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 278186us
I20260709 13:08:32.422151 31676 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:32.422737 31676 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:32.422895 30516 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:32.408599 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:32.406884 30440 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:32.405130 30591 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:32.412482 32055 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:32.425329 30440 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:32.428187 30516 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:32.428783 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:32.419747 32022 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:32.431599 30516 leader_election.cc:304] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:32.393889 32033 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:32.432552 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.433310 30470 raft_consensus.cc:2393] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 2: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:32.434648 30516 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:32.439026 30547 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a999056752144cc99cdd136c40917d2c"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
mode: GRACEFUL
new_leader_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:45906
I20260709 13:08:32.425271 32042 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:32.439798 30547 raft_consensus.cc:606] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 2 LEADER]: Received request to transfer leadership to TS f639301059e24dc5b0d88a46dc683326
I20260709 13:08:32.427625 32060 raft_consensus.cc:2749] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:32.441721 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:32.438476 30516 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:32.429967 32022 raft_consensus.cc:3060] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.426141 32063 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:32.430161 32025 raft_consensus.cc:2804] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:32.446800 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.433478 32058 raft_consensus.cc:2804] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:32.437578 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:32.428800 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:32.435348 32028 raft_consensus.cc:2804] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:32.439152 32032 raft_consensus.cc:2804] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:32.455379 31856 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:32.456231 30516 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:32.457366 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.448992 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:32.445343 32042 raft_consensus.cc:3060] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:32.453075 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.441776 32069 raft_consensus.cc:2804] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:32.457366 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:08:32.470544 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 98513.7us
I20260709 13:08:32.477527 31856 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:32.483240 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:32.452852 32063 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:32.459867 32023 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:32.464236 32032 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:32.458034 32073 raft_consensus.cc:2804] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:32.500700 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.486860 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:32.453171 32025 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:32.454274 32058 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:32.444171 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:32.476512 32035 raft_consensus.cc:993] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd: : Instructing follower fe2b7d73f8c743c1ba570cfd981c4e79 to start an election
I20260709 13:08:32.489164 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.490571 30441 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:32.459048 32028 raft_consensus.cc:493] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:32.497644 30473 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0842494dc2a48d89fb422524082081d"
dest_uuid: "f639301059e24dc5b0d88a46dc683326"
mode: GRACEFUL
new_leader_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:38176
I20260709 13:08:32.451004 32046 leader_election.cc:290] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:32.504649 32058 raft_consensus.cc:3060] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.500938 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:08:32.501472 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 84832.2us
W20260709 13:08:32.485564 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 68655.6us
I20260709 13:08:32.503151 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.503561 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:32.515357 30548 raft_consensus.cc:2468] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 2.
I20260709 13:08:32.516340 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:32.516600 31676 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:32.507085 30441 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:32.504060 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:32.502547 32032 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.520226 31676 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:32.504796 32025 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.508978 30561 tablet_copy_service.cc:140] P 092f6eb694fc4bbeab49677cccd880fd: Received BeginTabletCopySession request for tablet f6fb8561d12345948ed56d359f5ef4f3 from peer cd669586cff44d4bbfcc007e213faab6 ({username='slave'} at 127.0.0.1:35278)
I20260709 13:08:32.488106 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.509057 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:32.526918 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:32.489950 32034 raft_consensus.cc:2749] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:32.509971 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.529086 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.529273 32039 raft_consensus.cc:2749] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:32.511072 30473 raft_consensus.cc:606] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Received request to transfer leadership to TS 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:32.520226 32076 raft_consensus.cc:2749] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:32.508314 31172 debug-util.cc:398] Leaking SignalData structure 0x7b0800214c80 after lost signal to thread 29367
I20260709 13:08:32.500936 32026 raft_consensus.cc:2804] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:32.514727 32028 raft_consensus.cc:3060] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.502224 32069 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:32.525480 30441 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:32.525853 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:32.526394 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:32.503964 32073 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:32.523375 31116 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:32.530092 30561 tablet_copy_service.cc:161] P 092f6eb694fc4bbeab49677cccd880fd: Beginning new tablet copy session on tablet f6fb8561d12345948ed56d359f5ef4f3 from peer cd669586cff44d4bbfcc007e213faab6 at {username='slave'} at 127.0.0.1:35278: session id = cd669586cff44d4bbfcc007e213faab6-f6fb8561d12345948ed56d359f5ef4f3
I20260709 13:08:32.521060 31969 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:32.521077 32035 raft_consensus.cc:1081] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Signalling peer fe2b7d73f8c743c1ba570cfd981c4e79 to start an election
I20260709 13:08:32.506152 31115 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:08:32.541944 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 44219.4us
I20260709 13:08:32.542291 32045 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:32.542842 32045 raft_consensus.cc:2804] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:32.543167 32045 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:32.531560 32026 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:32.544167 32026 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:32.544986 29364 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:08:32.531991 30590 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:32.536252 31116 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:32.545585 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:32.505447 32037 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:32.535087 30441 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:32.537520 30516 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:08:32.537634 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:32.540195 32072 raft_consensus.cc:2749] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:32.535719 32073 raft_consensus.cc:3060] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.546515 29364 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:32.543229 32027 raft_consensus.cc:515] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:32.549988 30590 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:08:32.560037 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:32.560937 30590 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:32.561466 31676 raft_consensus.cc:2804] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:32.561776 31676 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:32.561810 30590 leader_election.cc:304] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:32.562206 31676 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.543604 32045 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.554713 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:32.564520 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:32.534840 32069 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.562211 31856 raft_consensus.cc:2749] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:32.562650 30590 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:08:32.550144 30516 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:32.534996 32039 raft_consensus.cc:2749] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:32.556725 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:32.588460 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:32.571856 30621 raft_consensus.cc:1240] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:32.572926 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:32.528208 32038 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:32.581766 32066 raft_consensus.cc:2804] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:32.583685 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:32.595111 30624 raft_consensus.cc:2468] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 1.
I20260709 13:08:32.584329 30625 raft_consensus.cc:1240] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:32.588732 30618 raft_consensus.cc:2393] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 4: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:08:32.572330 32058 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:32.559680 32034 raft_consensus.cc:2749] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:32.593950 32076 consensus_queue.cc:1059] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:08:32.604321 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 199287us
I20260709 13:08:32.559374 32046 raft_consensus.cc:2749] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:32.585170 31172 debug-util.cc:398] Leaking SignalData structure 0x7b08001040c0 after lost signal to thread 30408
I20260709 13:08:32.610499 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:32.610848 30591 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:32.611944 30440 leader_election.cc:304] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:32.612195 30591 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:32.612629 31856 raft_consensus.cc:2804] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:32.612977 31856 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:32.613287 31856 raft_consensus.cc:3060] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:32.615078 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 52481.8us
I20260709 13:08:32.589859 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:32.594451 32049 raft_consensus.cc:3060] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.628159 31856 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:32.603113 32056 raft_consensus.cc:2749] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:32.639569 30440 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:32.688939 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:32.618924 30517 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:32.642468 30441 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:32.648893 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:32.704946 31856 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:32.703472 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:32.696285 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:08:32.713582 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 71224.8us
W20260709 13:08:32.696792 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 146711us
W20260709 13:08:32.715760 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 76293.3us
I20260709 13:08:32.685635 32085 ts_tablet_manager.cc:933] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6: Initiating tablet copy from peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133)
W20260709 13:08:32.616372 31172 debug-util.cc:398] Leaking SignalData structure 0x7b080027b140 after lost signal to thread 30422
I20260709 13:08:32.621351 32067 consensus_queue.cc:1059] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.101s
I20260709 13:08:32.603842 32066 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:32.728616 30440 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:32.732867 32063 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:32.734123 32045 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:32.688313 32057 raft_consensus.cc:2749] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:32.625174 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:32.691800 32048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:60016 (request call id 11) took 2363 ms. Trace:
I20260709 13:08:32.747961 30440 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:32.749574 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:32.718837 32046 raft_consensus.cc:2749] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:32.749420 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:32.752627 31676 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:32.626868 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:32.615111 32083 raft_consensus.cc:2749] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:32.749852 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:32.784116 32027 leader_election.cc:290] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:32.737445 32066 raft_consensus.cc:3060] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.721748 32065 raft_consensus.cc:2804] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:32.734687 30635 tablet_copy_service.cc:140] P fe2b7d73f8c743c1ba570cfd981c4e79: Received BeginTabletCopySession request for tablet 1560cc6404764454b2843cec97934e6b from peer cd669586cff44d4bbfcc007e213faab6 ({username='slave'} at 127.0.0.1:57140)
I20260709 13:08:32.792460 30440 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:32.750576 32041 raft_consensus.cc:2749] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:32.790602 32065 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:08:32.794399 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 77937.2us
I20260709 13:08:32.795241 30440 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:32.796902 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:32.796878 30516 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:08:32.796072 32040 raft_consensus.cc:2749] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:32.798967 30635 tablet_copy_service.cc:161] P fe2b7d73f8c743c1ba570cfd981c4e79: Beginning new tablet copy session on tablet 1560cc6404764454b2843cec97934e6b from peer cd669586cff44d4bbfcc007e213faab6 at {username='slave'} at 127.0.0.1:57140: session id = cd669586cff44d4bbfcc007e213faab6-1560cc6404764454b2843cec97934e6b
I20260709 13:08:32.799182 32078 raft_consensus.cc:2804] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:08:32.796459 31172 debug-util.cc:398] Leaking SignalData structure 0x7b0800347a80 after lost signal to thread 30500
I20260709 13:08:32.802407 30440 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:32.804803 32041 raft_consensus.cc:2749] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:32.804881 32063 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:08:32.804986 31172 debug-util.cc:398] Leaking SignalData structure 0x7b080034e560 after lost signal to thread 30575
I20260709 13:08:32.808279 30440 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:32.810364 30440 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:32.810133 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:32.811141 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:32.803889 32046 raft_consensus.cc:2749] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:32.813060 32087 raft_consensus.cc:2804] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:32.812927 30440 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:32.818233 30618 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f"
dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
 from {username='slave'} at 127.0.0.1:47446
I20260709 13:08:32.818753 30618 raft_consensus.cc:493] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:32.818913 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:32.819118 30618 raft_consensus.cc:3060] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.819473 30621 raft_consensus.cc:3060] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:32.819867 30440 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:32.801254 32065 raft_consensus.cc:3060] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.824277 30440 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:32.812122 32037 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:32.812067 32057 raft_consensus.cc:2749] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:32.750023 32048 rpcz_store.cc:276] 0709 13:08:30.253540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.255629 (+  2089us) service_pool.cc:224] Handling call
0709 13:08:30.270282 (+ 14653us) log.cc:844] Serialized 499 byte log entry
0709 13:08:32.617153 (+2346871us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":303,"raft.run_cpu_time_us":1522,"raft.run_wall_time_us":1521,"spinlock_wait_cycles":13184,"thread_start_us":5443,"threads_started":1,"wal-append.queue_time_us":887,"wal-append.run_cpu_time_us":1845,"wal-append.run_wall_time_us":1002084}
I20260709 13:08:32.807858 32078 raft_consensus.cc:493] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:32.816499 32041 raft_consensus.cc:2749] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:32.881035 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 64684.4us
I20260709 13:08:32.881981 31114 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:32.882191 30618 raft_consensus.cc:515] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:32.883317 30623 raft_consensus.cc:1240] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:32.884296 30618 leader_election.cc:290] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:32.829794 32040 raft_consensus.cc:2804] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:32.821832 32087 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:32.834337 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
W20260709 13:08:32.908807 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 89369.5us
W20260709 13:08:32.885932 31172 debug-util.cc:398] Leaking SignalData structure 0x7b0800253a20 after lost signal to thread 30649
I20260709 13:08:32.859701 32038 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:32.861617 32058 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:32.834079 32060 raft_consensus.cc:2749] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:32.823472 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:32.884733 32078 raft_consensus.cc:3060] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.924947 31114 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:32.834678 32067 raft_consensus.cc:2749] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:32.874150 32049 raft_consensus.cc:2749] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:32.933851 32084 raft_consensus.cc:2749] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:32.930685 30516 leader_election.cc:304] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:32.889643 32040 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:32.823159 31115 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:08:32.922691 32087 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:32.940186 31114 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:32.926379 31967 raft_consensus.cc:2749] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:32.926697 32057 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:32.928859 32085 tablet_copy_client.cc:323] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Beginning tablet copy session from remote peer at address 127.28.173.1:43133
I20260709 13:08:32.955181 30516 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:32.949921 32040 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:32.958876 32052 raft_consensus.cc:2804] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:32.938292 32084 consensus_queue.cc:1059] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:32.931651 32075 raft_consensus.cc:2749] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:32.944514 32049 raft_consensus.cc:2749] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:32.968394 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 349468us
I20260709 13:08:32.973592 30621 raft_consensus.cc:2468] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 3.
I20260709 13:08:32.951303 32043 raft_consensus.cc:2749] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:32.980468 30517 leader_election.cc:304] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:08:32.962112 31172 debug-util.cc:398] Leaking SignalData structure 0x7b08000b00c0 after lost signal to thread 31175
I20260709 13:08:32.984400 30561 tablet_copy_source_session.cc:215] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:32.959331 32052 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
W20260709 13:08:32.992123 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 373576us
I20260709 13:08:32.984671 32084 raft_consensus.cc:3055] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:32.984777 32064 raft_consensus.cc:2749] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:32.979310 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 167322us
W20260709 13:08:32.994575 32022 consensus_meta.cc:287] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.546s	user 0.010s	sys 0.000s
I20260709 13:08:32.995028 32084 raft_consensus.cc:740] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:32.956715 32097 raft_consensus.cc:2749] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:33.004951 30517 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:32.964957 32057 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:32.996110 32052 raft_consensus.cc:3060] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:33.016127 30517 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:33.019208 32062 raft_consensus.cc:3055] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:33.019740 32062 raft_consensus.cc:740] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:33.020864 32062 consensus_queue.cc:260] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:33.022753 32062 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:33.027616 30517 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:33.028342 32093 ts_tablet_manager.cc:933] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6: Initiating tablet copy from peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133)
I20260709 13:08:33.033120 30517 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:33.034248 30517 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:33.008142 32022 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:33.037371 32097 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:33.057565 30635 tablet_copy_source_session.cc:215] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:33.057987 32094 raft_consensus.cc:2749] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:33.052912 32084 consensus_queue.cc:260] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:33.026916 31115 leader_election.cc:304] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:33.068910 32089 raft_consensus.cc:2749] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:33.069509 32082 raft_consensus.cc:2749] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:33.092653 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:33.047304 32100 raft_consensus.cc:2749] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:33.104815 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 488810us
I20260709 13:08:33.106004 30590 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:33.101861 30486 tablet_copy_service.cc:140] P f639301059e24dc5b0d88a46dc683326: Received BeginTabletCopySession request for tablet 5610a33c644c4e539ad503631763aa40 from peer cd669586cff44d4bbfcc007e213faab6 ({username='slave'} at 127.0.0.1:60026)
I20260709 13:08:33.104566 32084 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:33.103041 32049 raft_consensus.cc:2749] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:33.112581 32057 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:33.116719 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:33.118564 32091 raft_consensus.cc:2749] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:33.109100 32038 raft_consensus.cc:2749] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:33.123617 32054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6fb8561d12345948ed56d359f5ef4f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:33.114488 30486 tablet_copy_service.cc:161] P f639301059e24dc5b0d88a46dc683326: Beginning new tablet copy session on tablet 5610a33c644c4e539ad503631763aa40 from peer cd669586cff44d4bbfcc007e213faab6 at {username='slave'} at 127.0.0.1:60026: session id = cd669586cff44d4bbfcc007e213faab6-5610a33c644c4e539ad503631763aa40
W20260709 13:08:33.111656 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 99449us
I20260709 13:08:33.130632 32093 tablet_copy_client.cc:323] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6: tablet copy: Beginning tablet copy session from remote peer at address 127.28.173.1:43133
I20260709 13:08:33.137342 32080 raft_consensus.cc:2804] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:08:33.120532 32073 consensus_meta.cc:287] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.532s	user 0.001s	sys 0.010s
I20260709 13:08:33.143417 31115 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:33.143721 31143 raft_consensus.cc:1240] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:33.144722 31115 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:33.144944 32022 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:33.145521 32022 raft_consensus.cc:2749] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:33.145927 31115 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:33.146116 32022 raft_consensus.cc:2749] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:33.149549 32047 raft_consensus.cc:3055] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:33.149928 32047 raft_consensus.cc:740] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:33.133747 32087 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:33.156077 32042 consensus_meta.cc:287] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.655s	user 0.010s	sys 0.000s
I20260709 13:08:33.155804 32047 consensus_queue.cc:260] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:33.156464 32042 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:08:33.156864 30441 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.157476 30616 raft_consensus.cc:1240] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:33.158463 32042 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:08:33.160416 32025 consensus_meta.cc:287] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.636s	user 0.008s	sys 0.002s
I20260709 13:08:33.160743 32025 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:33.156827 32047 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:33.171700 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:33.171854 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:33.172746 32055 consensus_queue.cc:1059] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:33.172917 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:33.173743 32055 raft_consensus.cc:3055] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:33.174101 32055 raft_consensus.cc:740] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:33.174619 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:33.174826 32055 consensus_queue.cc:260] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:33.175357 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:33.175747 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:33.175830 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:33.176486 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:33.177121 30472 raft_consensus.cc:3060] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:33.177459 30591 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:33.178548 30591 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:33.178618 31856 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:33.179280 31856 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:33.179587 30591 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:33.182535 32037 raft_consensus.cc:2749] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:33.189399 32099 raft_consensus.cc:2749] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:33.190086 32099 raft_consensus.cc:2749] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:33.194267 31856 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:33.146754 32073 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:33.154112 32049 raft_consensus.cc:2749] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:33.204321 31676 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:33.206717 32080 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:33.207226 32080 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:33.165526 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
W20260709 13:08:33.217411 32028 consensus_meta.cc:287] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.672s	user 0.003s	sys 0.010s
I20260709 13:08:33.217826 32028 raft_consensus.cc:515] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:33.219305 32027 raft_consensus.cc:993] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd: : Instructing follower cd669586cff44d4bbfcc007e213faab6 to start an election
I20260709 13:08:33.221560 30516 leader_election.cc:304] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:33.185876 32055 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:33.197804 32066 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:33.209177 32032 consensus_meta.cc:287] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.687s	user 0.007s	sys 0.003s
I20260709 13:08:33.230325 30591 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
W20260709 13:08:33.219333 32069 consensus_meta.cc:287] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.617s	user 0.009s	sys 0.003s
I20260709 13:08:33.228953 32094 consensus_queue.cc:1059] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:08:33.246189 30618 raft_consensus.cc:1240] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:33.232692 30589 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:33.229192 32091 raft_consensus.cc:1081] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Signalling peer cd669586cff44d4bbfcc007e213faab6 to start an election
I20260709 13:08:33.227016 32082 consensus_queue.cc:1059] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:08:33.226548 32089 raft_consensus.cc:2804] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:33.241832 32066 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:33.244247 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:33.244989 30625 raft_consensus.cc:1240] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:33.233561 30619 raft_consensus.cc:1240] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:33.248474 30472 raft_consensus.cc:2468] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 2.
I20260709 13:08:33.249567 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:33.183080 32065 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:33.250401 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:33.251245 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:33.226635 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:33.225644 32028 leader_election.cc:290] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:33.159631 32078 raft_consensus.cc:515] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:33.255560 30589 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:33.255892 30623 raft_consensus.cc:1240] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:33.260031 30625 raft_consensus.cc:1240] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:33.260632 30591 leader_election.cc:304] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:08:33.260727 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 223493us
I20260709 13:08:33.261718 30624 raft_consensus.cc:1240] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:33.239287 32025 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:33.264133 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:33.245365 32037 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:33.250886 32034 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:33.266045 30620 raft_consensus.cc:2393] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 3: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:08:33.253252 30486 tablet_copy_source_session.cc:215] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:33.225103 31115 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:33.270323 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:33.271783 31856 raft_consensus.cc:2749] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:33.239108 32032 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:33.269404 32038 raft_consensus.cc:2804] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:33.278033 31149 raft_consensus.cc:1240] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:33.281764 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:33.282117 32101 raft_consensus.cc:2749] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:33.271206 32034 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:33.283427 32088 raft_consensus.cc:2749] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:33.268427 31969 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:33.285570 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:33.294112 32096 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:33.278412 32072 raft_consensus.cc:2749] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:33.249809 32069 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:33.272347 32037 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:33.292086 32038 raft_consensus.cc:697] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:33.291708 31969 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:33.311789 32073 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:33.314137 30617 raft_consensus.cc:1240] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 1. Current term is 2. Ops: []
W20260709 13:08:33.293344 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 88909.1us
I20260709 13:08:33.315783 30620 raft_consensus.cc:1240] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:33.300434 32045 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:33.286737 32052 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:33.313217 30485 tablet_copy_service.cc:140] P f639301059e24dc5b0d88a46dc683326: Received BeginTabletCopySession request for tablet 2b207fb799ce4340b29ae053898e0e6c from peer cd669586cff44d4bbfcc007e213faab6 ({username='slave'} at 127.0.0.1:60026)
I20260709 13:08:33.294660 32096 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:33.321916 30485 tablet_copy_service.cc:161] P f639301059e24dc5b0d88a46dc683326: Beginning new tablet copy session on tablet 2b207fb799ce4340b29ae053898e0e6c from peer cd669586cff44d4bbfcc007e213faab6 at {username='slave'} at 127.0.0.1:60026: session id = cd669586cff44d4bbfcc007e213faab6-2b207fb799ce4340b29ae053898e0e6c
I20260709 13:08:33.323596 32032 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:33.329535 31147 raft_consensus.cc:1240] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:33.332574 32085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5610a33c644c4e539ad503631763aa40. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:33.329190 32026 consensus_meta.cc:287] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.784s	user 0.013s	sys 0.004s
I20260709 13:08:33.335645 32026 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:33.336973 30547 raft_consensus.cc:1240] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:33.328991 31115 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:33.328684 32038 consensus_queue.cc:237] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:33.345244 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:33.347306 30617 raft_consensus.cc:1240] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:33.349066 32070 raft_consensus.cc:2749] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:33.351006 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:33.351730 30623 raft_consensus.cc:2393] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 2: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:08:33.352121 32050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1560cc6404764454b2843cec97934e6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:33.358536 32078 leader_election.cc:290] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:33.362077 32096 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:33.363209 32037 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:33.373072 30590 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:33.375722 30441 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:33.368800 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:33.378929 30441 leader_election.cc:304] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:08:33.381078 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.382185 30441 leader_election.cc:304] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:33.383472 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:33.386121 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:33.386166 30623 raft_consensus.cc:1240] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:33.387171 30441 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:33.374547 32065 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:33.394002 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:33.394088 32098 consensus_queue.cc:1059] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:08:33.380960 32039 consensus_queue.cc:1059] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:08:33.404211 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.399645 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:33.382292 32042 raft_consensus.cc:2749] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:33.415535 30441 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:33.356583 32040 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:33.420578 30467 raft_consensus.cc:1240] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:33.396812 32072 raft_consensus.cc:493] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:33.385737 32088 consensus_queue.cc:1059] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:08:33.422250 31148 raft_consensus.cc:2468] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 1.
I20260709 13:08:33.389753 32068 raft_consensus.cc:2749] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:33.389858 32046 raft_consensus.cc:2749] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:33.390057 32057 raft_consensus.cc:2749] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:33.422492 32072 raft_consensus.cc:515] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:33.427083 30590 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:33.435518 32030 raft_consensus.cc:3060] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:33.405297 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:33.392221 32067 consensus_queue.cc:1059] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:08:33.422276 32102 raft_consensus.cc:2749] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:33.428555 32088 raft_consensus.cc:3055] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:33.391870 32041 consensus_queue.cc:1059] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:08:33.448980 32035 raft_consensus.cc:3055] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:33.432518 32039 raft_consensus.cc:3055] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:33.466562 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:33.416878 32048 consensus_queue.cc:1059] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:08:33.437201 32078 raft_consensus.cc:2804] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:33.443524 32094 raft_consensus.cc:3055] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:33.479339 30472 raft_consensus.cc:1240] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:33.470340 32072 leader_election.cc:290] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:33.468648 31969 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:33.464083 32088 raft_consensus.cc:740] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:33.479859 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:33.480671 32052 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:33.481351 32034 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:33.466636 32035 raft_consensus.cc:740] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:33.493068 32035 consensus_queue.cc:260] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:33.494490 32035 raft_consensus.cc:3060] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:33.496340 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:33.463851 32075 consensus_queue.cc:1059] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:08:33.468983 32039 raft_consensus.cc:740] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:33.497750 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:33.499735 30473 raft_consensus.cc:1240] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:33.502310 30370 catalog_manager.cc:5697] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 reported cstate change: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New cstate: current_term: 1 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:33.516953 30591 leader_election.cc:304] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:33.518733 31856 consensus_queue.cc:1059] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:33.489151 32069 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:33.487288 32078 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:33.488713 32094 raft_consensus.cc:740] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:33.530510 30590 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:33.537444 31676 consensus_queue.cc:1059] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:33.527048 31856 raft_consensus.cc:2749] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:33.546231 31676 raft_consensus.cc:3055] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:33.546648 31676 raft_consensus.cc:740] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:33.498278 32039 consensus_queue.cc:260] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:33.532413 32078 raft_consensus.cc:3060] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:33.529349 32097 raft_consensus.cc:2749] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:08:33.559942 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.544422 32099 raft_consensus.cc:2749] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:33.561685 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:33.566565 31676 consensus_queue.cc:260] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:33.585064 31676 raft_consensus.cc:3060] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:33.562307 32026 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:33.596498 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:33.574734 32039 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:33.582496 32089 raft_consensus.cc:697] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 3 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:33.569883 31115 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:08:33.620090 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 357734us
W20260709 13:08:33.625962 30441 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.603195 32086 raft_consensus.cc:3055] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:33.627543 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:33.633505 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:33.601082 32094 consensus_queue.cc:260] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:33.636610 30625 raft_consensus.cc:2393] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 2: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:08:33.639216 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:33.642099 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:33.644629 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:33.646903 30621 raft_consensus.cc:2393] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 2: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:08:33.629142 32052 raft_consensus.cc:2749] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:33.651063 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:33.637761 32086 raft_consensus.cc:740] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:33.655798 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:33.665717 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
W20260709 13:08:33.642906 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 81905.7us
I20260709 13:08:33.674784 31115 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:33.679561 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:33.687724 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:33.660573 32026 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:33.637457 32089 consensus_queue.cc:237] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:33.652557 32049 consensus_queue.cc:1059] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:08:33.679014 32070 raft_consensus.cc:2749] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:33.696189 32068 consensus_queue.cc:1059] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:08:33.695744 31144 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0"
dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
 from {username='slave'} at 127.0.0.1:48426
W20260709 13:08:33.733973 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 462151us
I20260709 13:08:33.734578 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:33.737354 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:33.756438 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:33.760320 32030 raft_consensus.cc:2749] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:33.748867 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:33.735471 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:33.728188 31115 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:33.731772 31144 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:33.764451 31144 raft_consensus.cc:3060] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:33.769421 30589 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:33.777364 30516 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:33.738487 32087 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:33.704154 32026 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:33.779927 30517 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:33.727258 32086 consensus_queue.cc:260] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:08:33.775750 32055 consensus_meta.cc:287] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.544s	user 0.010s	sys 0.000s
I20260709 13:08:33.780323 32042 raft_consensus.cc:2749] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:33.790555 32064 raft_consensus.cc:993] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd: : Instructing follower f639301059e24dc5b0d88a46dc683326 to start an election
I20260709 13:08:33.791042 32064 raft_consensus.cc:1081] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 2 LEADER]: Signalling peer f639301059e24dc5b0d88a46dc683326 to start an election
I20260709 13:08:33.791195 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:33.774098 32051 raft_consensus.cc:2749] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:33.755342 32075 consensus_queue.cc:1059] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:08:33.797891 32046 raft_consensus.cc:3055] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:33.802485 32062 raft_consensus.cc:3055] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:33.824707 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:33.803004 32078 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:33.804956 30517 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:33.828169 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:08:33.829309 32047 consensus_meta.cc:287] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.667s	user 0.005s	sys 0.006s
I20260709 13:08:33.829218 30517 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:33.825390 32110 raft_consensus.cc:2749] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:33.805495 32100 raft_consensus.cc:2749] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:33.775987 32025 consensus_queue.cc:1059] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
W20260709 13:08:33.783249 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 79033us
I20260709 13:08:33.806878 32057 raft_consensus.cc:3055] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:33.833792 32066 raft_consensus.cc:2749] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:33.835166 32057 raft_consensus.cc:740] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:33.835260 32113 consensus_queue.cc:1048] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:33.836544 32116 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:33.825692 32062 raft_consensus.cc:740] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:33.836400 32057 consensus_queue.cc:260] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:33.837092 32116 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:33.837535 32062 consensus_queue.cc:260] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:33.837980 32057 raft_consensus.cc:3060] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:33.838814 32062 raft_consensus.cc:3060] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:33.839128 32116 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:33.825764 32046 raft_consensus.cc:740] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:33.841275 32046 consensus_queue.cc:260] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:33.842408 32046 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:33.842696 32048 raft_consensus.cc:3055] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:33.843210 32048 raft_consensus.cc:740] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:33.844219 32048 consensus_queue.cc:260] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:33.845719 32048 raft_consensus.cc:3060] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:33.853047 31969 raft_consensus.cc:3055] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:33.853415 31969 raft_consensus.cc:740] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:33.854208 31969 consensus_queue.cc:260] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:33.855268 31969 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:33.856366 31149 raft_consensus.cc:1240] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:33.793996 32026 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:33.805250 32088 consensus_queue.cc:260] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:33.833029 30517 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:08:33.832463 32080 consensus_meta.cc:287] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.620s	user 0.004s	sys 0.009s
I20260709 13:08:33.862447 32035 consensus_queue.cc:1059] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:08:33.866338 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 91423.7us
W20260709 13:08:33.866473 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 44080.9us
W20260709 13:08:33.859457 31116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.867578 30620 raft_consensus.cc:2393] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 2: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:08:33.868611 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:33.869096 32056 raft_consensus.cc:2804] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:33.874161 32047 consensus_queue.cc:1059] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:08:33.878473 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.878832 32047 raft_consensus.cc:3055] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:33.879200 32047 raft_consensus.cc:740] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
W20260709 13:08:33.879325 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 46349.8us
I20260709 13:08:33.878404 32056 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:33.879977 32066 raft_consensus.cc:2749] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:33.880060 32056 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:33.880285 30517 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:33.881168 32047 consensus_queue.cc:260] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:33.882272 32047 raft_consensus.cc:3060] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:33.884161 32025 raft_consensus.cc:2749] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:33.885551 30516 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:33.884109 30440 leader_election.cc:304] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:33.886240 32109 raft_consensus.cc:3055] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:33.886591 32109 raft_consensus.cc:740] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:33.886775 32113 raft_consensus.cc:2749] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:33.887342 32109 consensus_queue.cc:260] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:33.887748 30590 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:33.887955 32035 raft_consensus.cc:3055] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:33.888085 32056 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:33.888530 32109 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:33.888662 32035 raft_consensus.cc:740] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:33.892597 30473 raft_consensus.cc:1240] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:33.893011 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:33.893817 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:33.893937 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:33.877547 30545 raft_consensus.cc:2468] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:33.894122 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:33.893493 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:33.894145 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:33.889101 32037 raft_consensus.cc:2749] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:33.896317 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:33.871562 32034 consensus_queue.cc:1059] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:08:33.898516 31144 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:33.900604 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:33.900417 32035 consensus_queue.cc:260] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:33.900427 30471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a999056752144cc99cdd136c40917d2c"
dest_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:50430
I20260709 13:08:33.901350 32085 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:48412 (request call id 375) took 1278 ms. Trace:
I20260709 13:08:33.902089 30471 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:33.902590 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:33.902637 30471 raft_consensus.cc:3060] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:33.903971 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:33.904397 31115 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:33.907204 31145 raft_consensus.cc:1240] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 1. Current term is 3. Ops: []
I20260709 13:08:33.887977 32116 raft_consensus.cc:2749] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:33.908083 32096 raft_consensus.cc:2749] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:33.906345 31115 leader_election.cc:304] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:33.908787 32089 consensus_queue.cc:1059] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:33.909648 32096 raft_consensus.cc:2749] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:33.873178 32080 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:33.911230 30621 raft_consensus.cc:1240] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:33.912302 32080 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:33.913333 32078 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:33.914127 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:33.914364 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:33.914614 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:33.918179 32065 raft_consensus.cc:3055] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:33.918552 32065 raft_consensus.cc:740] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:33.919332 32065 consensus_queue.cc:260] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:33.920324 30467 raft_consensus.cc:2468] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 2.
I20260709 13:08:33.920967 32065 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:33.921057 31144 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 3 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:33.922703 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:33.923527 30543 raft_consensus.cc:1240] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 3 LEADER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:33.923547 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:33.925172 30547 raft_consensus.cc:1240] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:33.926127 30550 raft_consensus.cc:1240] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:33.926522 30544 raft_consensus.cc:2955] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:33.928746 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:33.929617 30547 raft_consensus.cc:1240] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:33.851729 32050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:48414 (request call id 424) took 2153 ms. Trace:
W20260709 13:08:33.931353 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.932286 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:33.932580 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:33.937485 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:33.942811 30547 raft_consensus.cc:1240] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:33.943676 30547 raft_consensus.cc:1240] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:33.944620 30547 raft_consensus.cc:1240] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:33.945891 30440 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:33.947188 32116 raft_consensus.cc:2749] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:33.936264 30468 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:08:34.008522 30471 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:34.009775 30440 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:08:34.013166 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.014371 30543 raft_consensus.cc:1240] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:34.003077 32039 consensus_queue.cc:1059] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:08:34.019981 30471 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:34.015468 32075 raft_consensus.cc:2749] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:08:34.031437 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.034200 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:34.034732 30470 raft_consensus.cc:3060] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:34.038465 30471 raft_consensus.cc:1240] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:34.043614 30473 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 2.
I20260709 13:08:34.015192 32058 raft_consensus.cc:3055] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:34.008924 32116 consensus_queue.cc:1059] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:08:34.049325 30440 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:34.049778 32116 raft_consensus.cc:3055] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:34.050168 32116 raft_consensus.cc:740] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:34.050745 32030 raft_consensus.cc:2749] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:34.051012 32116 consensus_queue.cc:260] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:34.051414 32030 consensus_queue.cc:1059] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:34.051604 32068 consensus_queue.cc:1059] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:34.052230 32116 raft_consensus.cc:3060] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:34.052449 32030 raft_consensus.cc:3055] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:34.052753 32068 raft_consensus.cc:3055] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:34.054359 32068 raft_consensus.cc:740] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:34.052870 32030 raft_consensus.cc:740] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:34.055230 32068 consensus_queue.cc:260] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:34.055418 32030 consensus_queue.cc:260] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:34.056522 32068 raft_consensus.cc:3060] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:34.056843 30485 tablet_copy_source_session.cc:215] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:34.057191 32030 raft_consensus.cc:3060] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:34.030349 32052 consensus_queue.cc:1059] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:08:34.065343 32052 raft_consensus.cc:3055] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:34.065670 32052 raft_consensus.cc:740] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:34.066475 32052 consensus_queue.cc:260] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:34.067619 32052 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:34.068625 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:34.069638 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:34.070369 30623 raft_consensus.cc:1240] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:34.071645 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:34.071938 31115 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:34.058578 32114 consensus_queue.cc:1059] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:34.080324 30470 raft_consensus.cc:2468] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 3.
I20260709 13:08:34.050177 32056 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:34.072170 30548 raft_consensus.cc:3055] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:34.096459 32114 raft_consensus.cc:3055] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:34.096664 30548 raft_consensus.cc:740] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:34.096880 32114 raft_consensus.cc:740] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:34.097478 30548 consensus_queue.cc:260] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:34.097759 32114 consensus_queue.cc:260] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:34.098567 30548 raft_consensus.cc:3060] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:34.098898 32114 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:34.059125 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.060735 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:34.080228 32093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b207fb799ce4340b29ae053898e0e6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:34.092519 32094 raft_consensus.cc:3060] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:34.093127 30589 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:34.084585 31116 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:08:34.101333 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.099699 32072 raft_consensus.cc:3060] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:34.111986 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:34.048166 32058 raft_consensus.cc:740] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:34.103938 30372 catalog_manager.cc:5697] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 2 to 3, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 3 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:34.108806 30548 raft_consensus.cc:2468] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
I20260709 13:08:34.111447 30621 raft_consensus.cc:1240] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:34.111580 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:34.107854 32040 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:33.902287 32085 rpcz_store.cc:276] 0709 13:08:32.623343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.623496 (+   153us) service_pool.cc:224] Handling call
0709 13:08:32.739183 (+115687us) ts_tablet_manager.cc:934] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6: Initiating tablet copy from peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133)
0709 13:08:33.327035 (+587852us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:08:33.846320 (+519285us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:33.846420 (+   100us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:08:33.900657 (+ 54237us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:08:33.900927 (+   270us) tablet_replica.cc:206] Creating consensus instance
0709 13:08:33.901218 (+   291us) ts_tablet_manager.cc:989] Replica registered.
0709 13:08:33.901275 (+    57us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":111966,"tablet-copy.queue_time_us":5225,"thread_start_us":33323,"threads_started":2}
I20260709 13:08:34.116730 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:34.121677 30621 raft_consensus.cc:1240] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:34.121784 30441 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:34.122951 30440 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:34.124076 30617 raft_consensus.cc:3060] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:34.125587 32088 raft_consensus.cc:3060] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:34.120203 32037 raft_consensus.cc:2749] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:34.116211 32043 raft_consensus.cc:2804] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:34.129451 30548 raft_consensus.cc:1240] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:34.133574 30475 raft_consensus.cc:2468] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 3.
I20260709 13:08:34.137735 30517 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:34.138648 30517 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:34.135212 32040 raft_consensus.cc:2749] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:34.141007 32043 raft_consensus.cc:697] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 3 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:34.140308 30591 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:34.142035 32069 raft_consensus.cc:2749] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:34.142278 32037 raft_consensus.cc:2804] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:34.141906 32043 consensus_queue.cc:237] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:34.142800 32037 raft_consensus.cc:697] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:34.143471 32051 consensus_queue.cc:1059] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:34.144197 30517 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:34.146438 30517 leader_election.cc:304] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:34.145663 32056 raft_consensus.cc:2749] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:34.147092 32051 raft_consensus.cc:3055] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:34.149910 30517 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:34.139369 32046 raft_consensus.cc:2804] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:34.139585 32085 tablet_copy_client.cc:806] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:33.931736 32050 rpcz_store.cc:276] 0709 13:08:31.697883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.699769 (+  1886us) service_pool.cc:224] Handling call
0709 13:08:31.793850 (+ 94081us) ts_tablet_manager.cc:934] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6: Initiating tablet copy from peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
0709 13:08:33.343884 (+1550034us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:08:33.761077 (+417193us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:33.761195 (+   118us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:08:33.851001 (+ 89806us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:08:33.851294 (+   293us) tablet_replica.cc:206] Creating consensus instance
0709 13:08:33.851594 (+   300us) ts_tablet_manager.cc:989] Replica registered.
0709 13:08:33.851652 (+    58us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":64091,"spinlock_wait_cycles":35712,"tablet-copy.queue_time_us":15016,"thread_start_us":190499,"threads_started":2}
I20260709 13:08:34.151733 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:08:34.148442 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 55432.4us
I20260709 13:08:34.152483 30517 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:34.148200 32100 raft_consensus.cc:2749] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:34.152442 32066 raft_consensus.cc:2749] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:34.167563 30589 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:34.149758 32056 raft_consensus.cc:2749] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:34.149060 32051 raft_consensus.cc:740] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:34.171262 30517 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:34.143679 32037 consensus_queue.cc:237] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:34.169482 32046 raft_consensus.cc:697] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:34.189910 31146 raft_consensus.cc:2468] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
I20260709 13:08:34.190517 32046 consensus_queue.cc:237] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:34.190986 32051 consensus_queue.cc:260] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:34.192379 32051 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:34.178567 32038 raft_consensus.cc:2749] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:34.171870 32113 raft_consensus.cc:2804] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:34.169970 32098 raft_consensus.cc:3055] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:34.189515 32054 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:48426 (request call id 381) took 2460 ms. Trace:
I20260709 13:08:34.169785 32050 tablet_copy_client.cc:806] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:34.170512 32085 tablet_copy_client.cc:670] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:34.204715 30374 catalog_manager.cc:5697] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 1 to 2, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 2 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:34.196106 32113 raft_consensus.cc:697] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 2 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:34.239753 30517 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:34.240943 30617 raft_consensus.cc:2468] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
I20260709 13:08:34.235073 32050 tablet_copy_client.cc:670] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:34.197546 32066 consensus_queue.cc:1059] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:08:34.151091 32058 consensus_queue.cc:260] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:34.246752 30549 raft_consensus.cc:2468] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 2.
I20260709 13:08:34.196396 32098 raft_consensus.cc:740] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:34.202926 32025 raft_consensus.cc:2804] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:34.260504 32035 raft_consensus.cc:3060] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:34.260883 32040 consensus_queue.cc:1059] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:34.262080 32085 tablet_copy_client.cc:538] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:34.266294 32086 raft_consensus.cc:3060] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:34.250136 32109 raft_consensus.cc:2749] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:08:34.287922 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.229449 32100 consensus_queue.cc:1059] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:08:34.288434 32072 raft_consensus.cc:2749] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:34.289026 32025 raft_consensus.cc:697] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 2 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:34.202711 32054 rpcz_store.cc:276] 0709 13:08:31.728897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.728995 (+    98us) service_pool.cc:224] Handling call
0709 13:08:31.804178 (+ 75183us) ts_tablet_manager.cc:934] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6: Initiating tablet copy from peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
0709 13:08:33.035939 (+1231761us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:08:33.845238 (+809299us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:33.845364 (+   126us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:08:34.188880 (+343516us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:08:34.189147 (+   267us) tablet_replica.cc:206] Creating consensus instance
0709 13:08:34.189407 (+   260us) ts_tablet_manager.cc:989] Replica registered.
0709 13:08:34.189462 (+    55us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":39445,"tablet-copy.queue_time_us":1139,"thread_start_us":189489,"threads_started":2}
I20260709 13:08:34.304212 32025 consensus_queue.cc:237] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:34.300937 32098 consensus_queue.cc:260] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:34.311383 30470 raft_consensus.cc:1275] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:34.308804 32054 tablet_copy_client.cc:806] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:34.316212 32078 consensus_queue.cc:1048] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:34.316946 32054 tablet_copy_client.cc:670] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 1 WAL segments...
W20260709 13:08:34.318872 32127 log.cc:927] Time spent T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.091s	user 0.003s	sys 0.000s
I20260709 13:08:34.319576 30620 raft_consensus.cc:1275] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:34.321835 32026 consensus_queue.cc:1048] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:34.329816 32054 tablet_copy_client.cc:538] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:34.305998 32113 consensus_queue.cc:237] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:34.358438 30589 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:08:34.376372 32085 tablet_bootstrap.cc:492] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6: Bootstrap starting.
I20260709 13:08:34.376677 32097 raft_consensus.cc:3055] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:34.383478 32097 raft_consensus.cc:740] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:34.428941 32097 consensus_queue.cc:260] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:34.430306 32097 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:34.387779 32038 raft_consensus.cc:2804] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:34.420825 32050 tablet_copy_client.cc:538] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:34.423286 32058 raft_consensus.cc:3060] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:34.466964 32038 raft_consensus.cc:697] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:34.467640 32098 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:34.469090 31145 raft_consensus.cc:1240] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:34.471709 30441 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:34.472836 32109 raft_consensus.cc:3055] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:08:34.484668 30441 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.484511 32109 raft_consensus.cc:740] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:34.497182 32114 raft_consensus.cc:2804] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:34.516607 30370 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57538 (request call id 299) took 1274 ms. Trace:
I20260709 13:08:34.511494 32054 tablet_bootstrap.cc:492] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6: Bootstrap starting.
I20260709 13:08:34.517016 30370 rpcz_store.cc:276] 0709 13:08:33.242297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:33.242438 (+   141us) service_pool.cc:224] Handling call
0709 13:08:34.516559 (+1274121us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:33.784110 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:33.784954 (+   844us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:33.785002 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:08:33.785030 (+    28us) tablet.cc:662] Decoding operations
0709 13:08:33.785445 (+   415us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:33.785543 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:33.785588 (+    45us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:33.785821 (+   233us) tablet.cc:701] Row locks acquired
0709 13:08:33.785856 (+    35us) write_op.cc:260] PREPARE: finished
0709 13:08:33.786034 (+   178us) write_op.cc:270] Start()
0709 13:08:33.786173 (+   139us) write_op.cc:276] Timestamp: P: 1783602513785980 usec, L: 0
0709 13:08:33.786204 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:08:33.797275 (+ 11071us) log.cc:844] Serialized 591 byte log entry
0709 13:08:34.014912 (+217637us) op_driver.cc:464] REPLICATION: finished
0709 13:08:34.102674 (+ 87762us) write_op.cc:301] APPLY: starting
0709 13:08:34.102751 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:34.102950 (+   199us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:34.132318 (+ 29368us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:34.147325 (+ 15007us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:34.147553 (+   228us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:08:34.147595 (+    42us) write_op.cc:312] APPLY: finished
0709 13:08:34.175795 (+ 28200us) log.cc:844] Serialized 23 byte log entry
0709 13:08:34.228535 (+ 52740us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:34.234451 (+  5916us) write_op.cc:454] Released schema lock
0709 13:08:34.244690 (+ 10239us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:34.434806 (+190116us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b18002e27c0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e7b522 00007fc780e7d7c1 00007fc780e7d779 00007fc780e7d709 00007fc780e7d6d1 00007fc780e7c9cd 000000000038f354 000000000038f199 00007fc780e5e83a
0709 13:08:34.434944 (+   138us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:34.434984 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":34145,"apply.run_cpu_time_us":2702,"apply.run_wall_time_us":176042,"num_ops":1,"prepare.queue_time_us":253599,"prepare.run_cpu_time_us":6123,"prepare.run_wall_time_us":153552,"raft.queue_time_us":77809,"raft.run_cpu_time_us":98049,"raft.run_wall_time_us":190821,"replication_time_us":228578,"spinlock_wait_cycles":3151232,"thread_start_us":411232,"threads_started":4,"wal-append.queue_time_us":118921}]]}
I20260709 13:08:34.532272 30550 raft_consensus.cc:3060] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:34.513091 32114 raft_consensus.cc:697] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:34.544462 30542 raft_consensus.cc:1275] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:34.529207 30468 raft_consensus.cc:1275] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:34.531919 32038 consensus_queue.cc:237] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:34.562856 32114 consensus_queue.cc:237] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:34.540757 32109 consensus_queue.cc:260] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:34.777640 32109 raft_consensus.cc:3060] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:34.571683 32093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:48412 (request call id 373) took 1965 ms. Trace:
I20260709 13:08:34.780031 32093 rpcz_store.cc:276] 0709 13:08:32.606689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.616399 (+  9710us) service_pool.cc:224] Handling call
0709 13:08:33.028783 (+412384us) ts_tablet_manager.cc:934] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6: Initiating tablet copy from peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133)
0709 13:08:34.079003 (+1050220us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:08:34.395545 (+316542us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:34.395686 (+   141us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:08:34.571087 (+175401us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:08:34.571325 (+   238us) tablet_replica.cc:206] Creating consensus instance
0709 13:08:34.571588 (+   263us) ts_tablet_manager.cc:989] Replica registered.
0709 13:08:34.571631 (+    43us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":417,"tablet-copy.queue_time_us":268636,"thread_start_us":259182,"threads_started":2}
I20260709 13:08:34.781771 32093 tablet_copy_client.cc:806] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:34.782406 32093 tablet_copy_client.cc:670] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:34.592159 32050 tablet_bootstrap.cc:492] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6: Bootstrap starting.
I20260709 13:08:34.632584 32085 tablet_bootstrap.cc:492] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:34.783656 32085 tablet_bootstrap.cc:492] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6: Bootstrap complete.
I20260709 13:08:34.784385 32085 ts_tablet_manager.cc:1403] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6: Time spent bootstrapping tablet: real 0.409s	user 0.024s	sys 0.002s
I20260709 13:08:34.640810 32054 tablet_bootstrap.cc:492] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:34.729475 32098 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.786825 32054 tablet_bootstrap.cc:492] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6: Bootstrap complete.
I20260709 13:08:34.786502 32098 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:34.787569 32054 ts_tablet_manager.cc:1403] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6: Time spent bootstrapping tablet: real 0.276s	user 0.023s	sys 0.011s
I20260709 13:08:34.788875 32098 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:34.733354 30470 raft_consensus.cc:1275] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:08:34.805017 32087 consensus_queue.cc:1175] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "cd669586cff44d4bbfcc007e213faab6" responder_term: 2 status { last_received { term: 1 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:34.814028 30550 raft_consensus.cc:2468] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 3.
I20260709 13:08:34.817912 32043 raft_consensus.cc:493] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:34.818506 32043 raft_consensus.cc:515] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:34.821280 32043 leader_election.cc:290] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:34.822369 32043 consensus_queue.cc:1048] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:34.827150 32085 raft_consensus.cc:359] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:34.827355 32054 raft_consensus.cc:359] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:34.828079 32085 raft_consensus.cc:740] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Initialized, Role: LEARNER
I20260709 13:08:34.828332 32054 raft_consensus.cc:740] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Initialized, Role: LEARNER
I20260709 13:08:34.828824 32085 consensus_queue.cc:260] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
W20260709 13:08:34.830353 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 281460us
I20260709 13:08:34.829089 32054 consensus_queue.cc:260] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
W20260709 13:08:34.835847 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.840816 32093 tablet_copy_client.cc:538] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:34.841347 30546 raft_consensus.cc:1275] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:08:34.844591 32113 consensus_queue.cc:1048] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:34.850013 30549 raft_consensus.cc:1275] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:34.851056 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:08:34.859604 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 104424us
I20260709 13:08:34.862998 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:34.863801 30620 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 2.
I20260709 13:08:34.864562 30621 raft_consensus.cc:1275] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:34.869999 30371 catalog_manager.cc:5697] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 1 to 3, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 3 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:34.893837 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:34.894642 30621 raft_consensus.cc:2393] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 2: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:08:34.913321 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:34.914105 30468 raft_consensus.cc:2468] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 2.
I20260709 13:08:34.918180 32083 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.918829 32083 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:34.923722 32083 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:34.940716 32038 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.947932 32038 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:34.944734 32114 consensus_queue.cc:1048] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:34.952226 32038 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:34.952780 32038 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.953483 32078 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.954924 32083 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.953449 32038 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:34.955435 32083 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:34.954843 32078 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:34.957855 32078 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:34.958364 32083 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:34.959053 32038 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:34.960987 32083 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:34.961493 32083 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:34.971864 32038 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.972510 32038 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:34.956173 32142 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.973842 32142 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:34.974910 32038 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:34.975605 32083 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:34.977726 30621 raft_consensus.cc:1275] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:34.978817 32083 consensus_queue.cc:1048] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:34.981009 32096 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:34.981534 32096 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:34.984172 32096 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:34.987847 32088 consensus_queue.cc:1048] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:34.990734 32142 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:34.998417 32050 tablet_bootstrap.cc:492] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:34.999300 32050 tablet_bootstrap.cc:492] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6: Bootstrap complete.
I20260709 13:08:35.000048 32050 ts_tablet_manager.cc:1403] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6: Time spent bootstrapping tablet: real 0.412s	user 0.026s	sys 0.006s
I20260709 13:08:35.002363 32050 raft_consensus.cc:359] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:35.002923 32050 raft_consensus.cc:740] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Initialized, Role: LEARNER
I20260709 13:08:35.003598 32050 consensus_queue.cc:260] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:35.005165 32050 ts_tablet_manager.cc:1434] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:08:34.925843 30441 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
W20260709 13:08:35.048081 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 122022us
I20260709 13:08:35.059535 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:35.061194 30469 raft_consensus.cc:2468] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 2.
I20260709 13:08:35.067541 30471 raft_consensus.cc:1275] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:35.070688 30473 raft_consensus.cc:1275] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:35.075872 30476 raft_consensus.cc:1275] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:08:35.076284 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:35.087599 30550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35278 (request call id 243) took 1153 ms. Trace:
I20260709 13:08:35.088287 30550 rpcz_store.cc:276] 0709 13:08:33.934195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:33.936751 (+  2556us) service_pool.cc:224] Handling call
0709 13:08:35.086929 (+1150178us) spinlock_profiling.cc:243] Waited 594 ms on lock 0x7b54000dcfd4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:08:35.087236 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1366590208}
I20260709 13:08:35.095175 30548 raft_consensus.cc:1275] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:35.096968 30621 raft_consensus.cc:1275] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:35.118122 32054 ts_tablet_manager.cc:1434] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6: Time spent starting tablet: real 0.330s	user 0.009s	sys 0.001s
I20260709 13:08:35.122432 32114 raft_consensus.cc:2804] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:35.123186 32114 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.123757 32114 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:35.126434 32056 consensus_queue.cc:1048] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:35.127986 32086 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.128800 32086 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:35.152012 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:35.145227 32107 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.152962 30476 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:35.153191 32107 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:35.122502 32142 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.156363 32142 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:35.159061 32142 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:35.165591 32072 consensus_queue.cc:1048] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:35.171782 32107 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:35.143685 32086 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:35.181077 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:35.181509 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:35.192958 30474 raft_consensus.cc:2468] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 2.
I20260709 13:08:35.182374 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:35.183243 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:35.196611 30472 raft_consensus.cc:2468] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 2.
I20260709 13:08:35.183439 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:35.183504 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:35.198423 30467 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 2.
I20260709 13:08:35.184095 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:35.199606 30471 raft_consensus.cc:2468] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 2.
I20260709 13:08:35.205615 32154 consensus_queue.cc:1048] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:08:35.211767 30591 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:35.222039 32037 raft_consensus.cc:2804] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:35.222633 32037 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.223001 32037 raft_consensus.cc:3060] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:35.222726 32030 consensus_queue.cc:1048] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:35.226488 30561 tablet_copy_service.cc:342] P 092f6eb694fc4bbeab49677cccd880fd: Request end of tablet copy session cd669586cff44d4bbfcc007e213faab6-f6fb8561d12345948ed56d359f5ef4f3 received from {username='slave'} at 127.0.0.1:35278
I20260709 13:08:35.227430 30561 tablet_copy_service.cc:434] P 092f6eb694fc4bbeab49677cccd880fd: ending tablet copy session cd669586cff44d4bbfcc007e213faab6-f6fb8561d12345948ed56d359f5ef4f3 on tablet f6fb8561d12345948ed56d359f5ef4f3 with peer cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:35.234385 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:35.235280 30471 raft_consensus.cc:2468] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 3.
I20260709 13:08:35.234488 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:35.238538 30620 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
I20260709 13:08:35.235606 31144 raft_consensus.cc:1217] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:35.245625 32085 ts_tablet_manager.cc:1434] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6: Time spent starting tablet: real 0.459s	user 0.006s	sys 0.011s
I20260709 13:08:35.260558 32058 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.261456 32058 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:35.264711 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:35.270665 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:35.270674 32142 consensus_queue.cc:1048] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:35.267663 32056 consensus_queue.cc:1048] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:35.301868 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:35.302469 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:35.302726 31144 raft_consensus.cc:2468] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 2.
I20260709 13:08:35.304833 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:35.305565 30547 raft_consensus.cc:2468] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 1.
I20260709 13:08:35.269672 30591 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:35.274426 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:35.268337 32113 consensus_queue.cc:1048] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:35.276389 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:35.277854 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:35.280536 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:35.282371 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:35.296672 30516 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:35.325861 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:35.329383 30549 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:35.331620 32037 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:35.335446 32037 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:35.336268 30551 raft_consensus.cc:2393] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 3: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:08:35.340049 30548 raft_consensus.cc:2468] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 1.
I20260709 13:08:35.341955 32098 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:35.349387 32098 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:35.351480 32098 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:35.359571 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:35.360677 30617 raft_consensus.cc:2393] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 3: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:08:35.359436 30635 tablet_copy_service.cc:342] P fe2b7d73f8c743c1ba570cfd981c4e79: Request end of tablet copy session cd669586cff44d4bbfcc007e213faab6-1560cc6404764454b2843cec97934e6b received from {username='slave'} at 127.0.0.1:57140
I20260709 13:08:35.361392 30635 tablet_copy_service.cc:434] P fe2b7d73f8c743c1ba570cfd981c4e79: ending tablet copy session cd669586cff44d4bbfcc007e213faab6-1560cc6404764454b2843cec97934e6b on tablet 1560cc6404764454b2843cec97934e6b with peer cd669586cff44d4bbfcc007e213faab6
W20260709 13:08:35.368917 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 46857.6us
I20260709 13:08:35.343957 32114 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:35.344225 32087 raft_consensus.cc:2804] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:35.378576 32087 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.378770 30467 raft_consensus.cc:1275] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:35.379034 32087 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:35.352073 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 82602.9us
I20260709 13:08:35.353403 32058 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:35.353860 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:35.353159 30371 catalog_manager.cc:5697] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 3 to 4, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 4 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:35.355942 32143 raft_consensus.cc:2804] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:35.367971 32030 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:35.368063 31116 leader_election.cc:304] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:35.397866 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:35.398141 31144 raft_consensus.cc:2468] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:35.388463 32143 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.414623 32114 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:35.409981 30371 catalog_manager.cc:5697] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 2 to 3, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 3 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:35.417289 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 51912.5us
I20260709 13:08:35.421245 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:35.429312 32154 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:35.430127 32154 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:35.431876 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:35.432658 31146 raft_consensus.cc:2468] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 2.
I20260709 13:08:35.433393 32154 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:35.433516 32043 raft_consensus.cc:2804] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:35.433972 32043 raft_consensus.cc:493] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:35.434513 32043 raft_consensus.cc:3060] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:35.435050 32154 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:35.429401 30619 raft_consensus.cc:2468] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 2.
I20260709 13:08:35.408553 32143 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:35.415504 32114 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:35.439689 32114 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:35.442250 30591 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:35.443614 30591 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:35.444061 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:35.444832 31144 raft_consensus.cc:2393] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 2: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:08:35.444689 30591 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:35.446164 32126 raft_consensus.cc:2804] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:35.446520 32126 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.446866 32126 raft_consensus.cc:3060] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:35.448284 32058 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:35.448881 32058 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:35.451109 32058 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:35.451881 32030 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:35.453253 32056 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:35.453966 32030 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:35.454241 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:35.454075 32056 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:35.456130 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:35.456693 30551 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
I20260709 13:08:35.456745 30591 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:08:35.457291 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 44836.1us
I20260709 13:08:35.457544 32142 raft_consensus.cc:2804] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:35.458017 32101 raft_consensus.cc:2804] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:35.458132 32142 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.458503 32101 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:35.458630 32142 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:35.458971 32101 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:35.435629 32154 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:35.461423 32154 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:35.461712 31116 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:35.458606 32086 raft_consensus.cc:2804] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:35.462584 32086 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.462893 32086 raft_consensus.cc:3060] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:35.464586 32156 raft_consensus.cc:2804] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:35.464967 32156 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:35.465315 32156 raft_consensus.cc:3060] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:35.468573 30550 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:35.467649 32101 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:35.471009 32086 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:35.468544 32056 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:35.472198 32101 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:35.475346 32093 tablet_bootstrap.cc:492] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6: Bootstrap starting.
I20260709 13:08:35.459348 30589 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:08:35.479935 30440 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:35.467604 32142 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:35.487663 30550 raft_consensus.cc:1275] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:35.488891 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:35.495133 32096 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.495874 32096 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:35.499300 30590 consensus_peers.cc:597] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453): Couldn't send request to peer cd669586cff44d4bbfcc007e213faab6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:35.504055 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:35.504451 31144 raft_consensus.cc:1217] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:08:35.504822 30543 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:08:35.499329 32045 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.511868 30551 raft_consensus.cc:2393] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 3: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:08:35.512132 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:35.512974 30473 raft_consensus.cc:2368] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 2. Current term is 3.
I20260709 13:08:35.515530 32142 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:35.490037 32058 raft_consensus.cc:2804] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:35.525552 32058 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:35.525952 32058 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:35.531737 30590 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:08:35.520267 32101 raft_consensus.cc:2804] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:35.528136 32114 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:35.528775 32142 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.552219 32142 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:35.554539 32142 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:35.515566 32045 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:35.559476 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:35.560231 30620 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 2.
I20260709 13:08:35.562050 31115 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:35.562721 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:35.563297 32110 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.516378 32037 consensus_queue.cc:1048] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:08:35.544616 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:35.518571 32143 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:35.612183 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:35.585191 31146 raft_consensus.cc:1275] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:35.590456 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:35.568277 30590 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:35.563567 30468 raft_consensus.cc:2468] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 2.
I20260709 13:08:35.614933 30476 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 3.
I20260709 13:08:35.618847 30550 raft_consensus.cc:2468] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 3.
I20260709 13:08:35.589960 32072 raft_consensus.cc:2804] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:35.540720 32101 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:35.649328 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 81498.1us
I20260709 13:08:35.571096 32086 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:35.627534 31144 raft_consensus.cc:2468] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
W20260709 13:08:35.662300 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 66197.9us
I20260709 13:08:35.657687 32114 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.658003 30441 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:35.663800 32114 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:35.665140 30441 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:35.658855 31114 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:08:35.658435 32164 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.659968 32167 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:35.584810 32078 raft_consensus.cc:2804] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:35.608623 32156 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:35.674418 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 130791us
I20260709 13:08:35.626832 30543 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
I20260709 13:08:35.660885 32034 raft_consensus.cc:2804] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:35.661108 32170 raft_consensus.cc:493] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:35.663970 32098 consensus_queue.cc:1048] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:35.588105 32096 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:35.613489 32045 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:35.551615 32126 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:35.682070 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:35.674789 32078 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.636720 32072 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.646332 32101 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:35.686231 32086 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:35.563969 32110 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:35.619987 32087 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:35.679685 32034 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:35.707041 30551 raft_consensus.cc:2468] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
W20260709 13:08:35.714584 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 94022.9us
I20260709 13:08:35.708142 32078 raft_consensus.cc:3060] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:35.707958 32072 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:35.711427 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 149540us
I20260709 13:08:35.719331 30547 raft_consensus.cc:2393] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 6: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:08:35.720345 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:35.717608 30440 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:35.721042 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:08:35.720340 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 55275.5us
I20260709 13:08:35.721112 31146 raft_consensus.cc:2468] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:35.708706 32045 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:35.674202 32167 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:35.722563 30441 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:35.716399 32086 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:35.711994 32034 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:35.712873 32168 raft_consensus.cc:2804] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:35.682741 32164 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:35.715082 32114 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:35.720645 32143 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:35.733258 30476 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 2.
I20260709 13:08:35.735141 32051 raft_consensus.cc:2804] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:35.735858 32168 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.732635 32037 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:35.739764 32114 raft_consensus.cc:2804] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:35.725382 32030 consensus_queue.cc:1048] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:08:35.743952 32051 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.727931 32043 raft_consensus.cc:515] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:35.766773 32056 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.755725 32083 raft_consensus.cc:493] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:35.793491 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 75715.2us
I20260709 13:08:35.725196 32170 raft_consensus.cc:515] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:35.762141 32098 raft_consensus.cc:2804] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:35.760176 32168 raft_consensus.cc:3060] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:35.762991 32114 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:35.745574 32058 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:08:35.800611 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 76979.7us
I20260709 13:08:35.744395 32045 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:35.797700 32098 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:35.766554 32051 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:35.779395 32056 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:35.811444 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 93931.1us
I20260709 13:08:35.821110 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
W20260709 13:08:35.821709 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 93022.6us
I20260709 13:08:35.822911 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:35.823644 30469 raft_consensus.cc:3060] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:35.809192 32114 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:35.813122 32098 raft_consensus.cc:3060] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:35.837484 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:35.835717 32156 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 3 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:35.850739 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:35.851491 30474 raft_consensus.cc:3060] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:35.852133 30517 leader_election.cc:400] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 2. Current term is 3.
I20260709 13:08:35.852257 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:35.852465 30517 leader_election.cc:403] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:35.853071 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:35.846657 30473 raft_consensus.cc:3060] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:35.856109 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:35.855213 30590 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:35.852871 30467 raft_consensus.cc:2468] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:35.856006 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:35.864073 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:35.816362 32037 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:35.865166 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:35.843848 32174 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:35.869302 30621 raft_consensus.cc:2393] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 5: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:08:35.853492 32087 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:35.824350 32083 raft_consensus.cc:515] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:35.884806 30620 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:35.854465 32126 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:35.896806 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:35.899538 30467 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:35.900979 32126 raft_consensus.cc:2804] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:35.903020 32083 leader_election.cc:290] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:08:35.904507 32141 log.cc:927] Time spent T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:08:35.904582 32173 log.cc:927] Time spent T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:08:35.905678 32087 raft_consensus.cc:2749] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 2. Current term is 3.
I20260709 13:08:35.907244 32037 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:35.907435 32030 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.907570 32056 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:35.907161 32170 leader_election.cc:290] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133)
I20260709 13:08:35.908007 32086 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:35.908360 32043 leader_election.cc:290] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:35.908788 32089 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.865432 30485 tablet_copy_service.cc:342] P f639301059e24dc5b0d88a46dc683326: Request end of tablet copy session cd669586cff44d4bbfcc007e213faab6-5610a33c644c4e539ad503631763aa40 received from {username='slave'} at 127.0.0.1:60026
I20260709 13:08:35.915978 32167 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:35.916324 32174 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:35.919910 32094 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.912637 32110 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:35.884294 32178 raft_consensus.cc:2804] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:35.923209 30620 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
I20260709 13:08:35.911949 32126 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.945721 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:08:35.952323 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 97177.5us
I20260709 13:08:35.952675 32094 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:35.953315 30441 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:35.955003 32094 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:35.956008 32194 raft_consensus.cc:493] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.956339 32167 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:35.956764 30441 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:35.956512 32194 raft_consensus.cc:515] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:35.944758 32089 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:35.958817 32194 leader_election.cc:290] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:35.959201 32089 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:35.944454 32156 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.959982 32156 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:35.960593 32045 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:35.949271 32178 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.961371 32178 raft_consensus.cc:3060] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:35.962596 32156 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:08:35.964071 30646 debug-util.cc:398] Leaking SignalData structure 0x7b0800307d60 after lost signal to thread 29367
W20260709 13:08:35.965605 30646 debug-util.cc:398] Leaking SignalData structure 0x7b08001d5a40 after lost signal to thread 30408
I20260709 13:08:35.967088 30469 raft_consensus.cc:2468] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
W20260709 13:08:35.967309 30646 debug-util.cc:398] Leaking SignalData structure 0x7b08001a8280 after lost signal to thread 30500
I20260709 13:08:35.977658 32098 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:35.978036 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:35.978458 32058 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:35.980654 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:35.983026 30473 raft_consensus.cc:2468] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:35.988330 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:35.988765 32170 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.996868 30485 tablet_copy_service.cc:434] P f639301059e24dc5b0d88a46dc683326: ending tablet copy session cd669586cff44d4bbfcc007e213faab6-5610a33c644c4e539ad503631763aa40 on tablet 5610a33c644c4e539ad503631763aa40 with peer cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:35.996649 32170 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:35.998775 32170 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:35.999997 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:36.002296 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:36.002933 30470 raft_consensus.cc:2468] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 2.
I20260709 13:08:36.004383 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:36.004976 30472 raft_consensus.cc:2468] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 2.
I20260709 13:08:36.008592 30471 raft_consensus.cc:2468] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 3.
I20260709 13:08:36.009438 30474 raft_consensus.cc:2468] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
W20260709 13:08:36.009372 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 161868us
I20260709 13:08:36.013572 32098 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:36.014909 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:36.015532 30591 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:36.016438 30591 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:36.017066 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:36.017158 32176 raft_consensus.cc:2804] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:36.017248 30591 leader_election.cc:304] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:36.017714 30473 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 2.
I20260709 13:08:36.017828 32176 raft_consensus.cc:697] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:36.018656 32086 raft_consensus.cc:2804] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:36.018815 32176 consensus_queue.cc:237] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:36.020009 32083 raft_consensus.cc:2804] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:36.020401 32083 raft_consensus.cc:493] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:36.020532 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:36.020779 32083 raft_consensus.cc:3060] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:36.021263 31146 raft_consensus.cc:2393] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 2: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:08:36.019172 32086 raft_consensus.cc:697] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:36.023027 32086 consensus_queue.cc:237] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:35.942656 32030 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:36.025612 32030 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:36.016302 32167 raft_consensus.cc:2749] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:36.026789 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:36.027393 31146 raft_consensus.cc:2468] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 1.
I20260709 13:08:36.027557 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:36.028725 30591 leader_election.cc:304] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:36.030452 30591 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:35.959453 32194 raft_consensus.cc:2804] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:35.951618 32126 raft_consensus.cc:3060] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:36.052286 30441 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:36.053318 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:36.054340 30620 raft_consensus.cc:2393] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 5: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:08:36.054816 30591 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:36.057579 30618 raft_consensus.cc:2393] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 2: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:08:36.055333 30517 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:36.060242 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:36.055598 32143 raft_consensus.cc:2804] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:36.062569 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:36.004978 32164 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:36.063839 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:36.064363 30546 raft_consensus.cc:3060] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:08:36.066872 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:36.067644 30474 raft_consensus.cc:2468] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:08:36.071182 30517 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:36.072589 32195 raft_consensus.cc:2804] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:36.073122 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:36.074574 32195 raft_consensus.cc:493] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.076350 32183 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:36.076884 32174 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:36.076903 32183 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:36.078745 32078 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:36.079362 32183 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:36.080083 30624 raft_consensus.cc:2368] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 2. Current term is 3.
I20260709 13:08:36.080176 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:36.080818 30471 raft_consensus.cc:2468] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 2.
I20260709 13:08:36.080881 32078 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:08:36.081976 30646 debug-util.cc:398] Leaking SignalData structure 0x7b08001af560 after lost signal to thread 30575
I20260709 13:08:36.082588 30441 leader_election.cc:400] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 election: Vote denied by peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) with higher term. Message: Invalid argument: T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 2. Current term is 3.
I20260709 13:08:36.082907 30441 leader_election.cc:403] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 13:08:36.083176 30646 debug-util.cc:398] Leaking SignalData structure 0x7b08003c3340 after lost signal to thread 30649
I20260709 13:08:36.085457 32195 raft_consensus.cc:3060] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:36.087205 30546 raft_consensus.cc:2468] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:36.027388 32051 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:36.060356 32167 raft_consensus.cc:2804] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:36.110741 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:36.122311 30547 raft_consensus.cc:1275] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:36.058882 32037 raft_consensus.cc:2804] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:36.111037 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:36.029698 32072 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:36.130765 30646 debug-util.cc:398] Leaking SignalData structure 0x7b08003c3ca0 after lost signal to thread 31175
I20260709 13:08:36.065419 32089 raft_consensus.cc:2804] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:08:36.140170 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 57727.8us
W20260709 13:08:36.142192 30646 debug-util.cc:398] Leaking SignalData structure 0x7b08003b3360 after lost signal to thread 32028
I20260709 13:08:36.145426 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:36.065805 32143 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:36.146294 30624 raft_consensus.cc:2468] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 2.
I20260709 13:08:36.148680 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:36.149094 30591 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:36.149412 30549 raft_consensus.cc:3060] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:08:36.149454 30467 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:08:36.069891 32194 raft_consensus.cc:697] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:36.149995 30591 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:36.152601 32170 raft_consensus.cc:2804] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:36.164625 32170 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:36.165012 32170 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:36.165867 32078 raft_consensus.cc:2804] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:36.150292 32164 raft_consensus.cc:3060] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:36.156939 32034 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:36.126822 32154 raft_consensus.cc:2804] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:36.173190 32154 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:36.173614 32154 raft_consensus.cc:3060] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:36.127173 32167 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.176095 32167 raft_consensus.cc:3060] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:36.183059 32034 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:36.168306 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:36.129302 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:36.172140 30591 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:36.184217 32189 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.169919 32078 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.184792 32078 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:36.185969 32178 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:36.187160 30475 raft_consensus.cc:1240] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:08:36.188882 32168 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:36.184816 32189 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:36.192065 30470 raft_consensus.cc:2368] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 2. Current term is 3.
I20260709 13:08:36.147553 32037 raft_consensus.cc:697] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:36.191576 32189 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:36.200111 30549 raft_consensus.cc:2468] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:36.164129 32051 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:08:36.205899 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 336889us
I20260709 13:08:36.164227 32143 raft_consensus.cc:3060] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:36.199395 32174 raft_consensus.cc:2804] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:36.202678 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:36.215196 30622 raft_consensus.cc:3060] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:08:36.203016 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:36.215931 31146 raft_consensus.cc:3060] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:36.203732 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:36.144699 32089 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:36.191076 32168 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:36.221020 32174 raft_consensus.cc:697] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:36.217217 32101 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:36.225332 32174 consensus_queue.cc:237] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:36.225857 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:36.226578 32101 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:36.193645 32083 raft_consensus.cc:515] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:36.227288 30619 raft_consensus.cc:2368] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 3. Current term is 4.
I20260709 13:08:36.227993 30623 raft_consensus.cc:2468] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 2.
I20260709 13:08:36.228623 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:36.228714 32037 consensus_queue.cc:237] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:36.231680 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:36.229202 32083 leader_election.cc:290] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133)
I20260709 13:08:36.237648 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:36.232242 30467 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:36.223547 31143 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 1.
I20260709 13:08:36.233475 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:36.234556 32072 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 3 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:36.235834 30591 leader_election.cc:400] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 2. Current term is 3.
I20260709 13:08:36.240252 30591 leader_election.cc:403] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:36.242758 30550 raft_consensus.cc:2393] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 2: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:08:36.242692 31115 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:36.222481 32089 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:36.227415 32078 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:36.245075 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:36.248142 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:36.248725 30624 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:36.249852 32200 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.252465 32200 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:36.252926 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:36.254485 32200 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:36.256629 30546 raft_consensus.cc:2468] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 2.
I20260709 13:08:36.241499 32154 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:36.258566 32167 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:36.259548 32154 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:36.247903 32156 raft_consensus.cc:2804] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:36.260161 32156 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.260259 30624 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 3.
I20260709 13:08:36.260520 32156 raft_consensus.cc:3060] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:36.260964 32154 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.261315 31115 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:36.261407 32154 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:36.262130 32043 raft_consensus.cc:2804] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:36.262600 32043 raft_consensus.cc:697] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 3 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:36.263418 32043 consensus_queue.cc:237] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:36.250943 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:36.263953 30543 raft_consensus.cc:3060] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:36.272926 30441 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:36.274369 32190 raft_consensus.cc:2804] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:36.276300 32078 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:36.276469 32101 consensus_queue.cc:1059] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:36.294277 32101 raft_consensus.cc:3055] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:36.294602 32101 raft_consensus.cc:740] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:36.295009 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:36.295610 31143 raft_consensus.cc:3060] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:08:36.295431 32101 consensus_queue.cc:260] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:36.296717 32101 raft_consensus.cc:3060] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:36.298496 30441 leader_election.cc:304] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:36.299436 30441 leader_election.cc:400] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Vote denied by peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) with higher term. Message: Invalid argument: T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 3. Current term is 4.
I20260709 13:08:36.263461 32154 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:36.301946 31146 raft_consensus.cc:2468] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
I20260709 13:08:36.303757 32126 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:36.304872 30617 raft_consensus.cc:2368] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 3. Current term is 4.
I20260709 13:08:36.306619 31115 leader_election.cc:400] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 3 election: Vote denied by peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) with higher term. Message: Invalid argument: T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 3. Current term is 4.
I20260709 13:08:36.306910 31115 leader_election.cc:403] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:08:36.277971 32164 raft_consensus.cc:2749] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) with higher term. Message: Invalid argument: T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 2. Current term is 3.
I20260709 13:08:36.198462 32195 raft_consensus.cc:515] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:36.307737 32051 raft_consensus.cc:3060] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:36.310207 32195 leader_election.cc:290] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:36.274793 32190 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.282909 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:36.312069 32190 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:36.312227 30470 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:08:36.283886 32178 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:36.286654 32114 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:36.325367 30469 raft_consensus.cc:2468] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:36.286984 32156 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:36.290261 30471 raft_consensus.cc:2468] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 2.
I20260709 13:08:36.293303 32167 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:36.293618 30543 raft_consensus.cc:2468] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:36.306819 32126 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:36.316646 30472 raft_consensus.cc:2468] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 2.
I20260709 13:08:36.281905 32170 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:36.318645 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:36.319198 30622 raft_consensus.cc:2468] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
I20260709 13:08:36.319890 30441 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:36.332574 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:36.385015 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:36.385600 30546 raft_consensus.cc:2393] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 2: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
W20260709 13:08:36.385457 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 65664.9us
I20260709 13:08:36.371454 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:36.386512 30473 raft_consensus.cc:3060] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:36.323787 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:36.374051 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:36.387871 30469 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:36.377213 31116 leader_election.cc:304] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:36.382478 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:36.387750 30591 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:36.388645 30474 raft_consensus.cc:3060] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:36.388960 30591 leader_election.cc:304] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:36.375461 30467 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:08:36.397909 30475 raft_consensus.cc:2368] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 2. Current term is 3.
I20260709 13:08:36.397702 31143 raft_consensus.cc:2468] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
I20260709 13:08:36.460753 30441 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:36.461367 32170 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:36.461782 32167 raft_consensus.cc:2804] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:36.462457 32167 raft_consensus.cc:697] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:36.387105 32168 raft_consensus.cc:2804] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:36.463547 32167 consensus_queue.cc:237] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:36.464362 32168 raft_consensus.cc:493] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.464888 32168 raft_consensus.cc:3060] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:36.479110 32038 raft_consensus.cc:2804] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:36.403748 32178 raft_consensus.cc:2804] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:36.480563 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:36.480834 32178 raft_consensus.cc:697] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:36.482097 32178 consensus_queue.cc:237] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:36.386255 32083 raft_consensus.cc:2749] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 2. Current term is 3.
I20260709 13:08:36.509182 32196 raft_consensus.cc:493] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.509855 32196 raft_consensus.cc:515] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:36.512658 32196 leader_election.cc:290] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:36.513589 32156 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 3 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:36.515535 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:36.516266 30622 raft_consensus.cc:3060] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:36.518422 32168 raft_consensus.cc:515] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:36.400629 32142 raft_consensus.cc:2804] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:36.331830 32194 consensus_queue.cc:237] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:36.490334 32126 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:36.491823 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:36.554096 30546 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:36.498068 32198 raft_consensus.cc:1064] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd: attempting to promote NON_VOTER cd669586cff44d4bbfcc007e213faab6 to VOTER
I20260709 13:08:36.498489 31116 leader_election.cc:400] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 2. Current term is 3.
I20260709 13:08:36.570617 31116 leader_election.cc:403] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:36.499979 32114 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:08:36.573050 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 74688.1us
I20260709 13:08:36.573101 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:36.402722 32096 raft_consensus.cc:2804] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:36.574216 30469 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 3.
I20260709 13:08:36.568801 30474 raft_consensus.cc:2468] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:08:36.479761 32038 raft_consensus.cc:697] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:36.528324 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:36.651844 30546 raft_consensus.cc:2468] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 4.
I20260709 13:08:36.660885 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:36.676443 31146 raft_consensus.cc:2368] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 3. Current term is 4.
I20260709 13:08:36.677349 30470 raft_consensus.cc:2468] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:08:36.674386 30473 raft_consensus.cc:2468] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:36.591765 30622 raft_consensus.cc:2468] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 3.
I20260709 13:08:36.450642 30468 raft_consensus.cc:2468] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 3.
I20260709 13:08:36.688190 31115 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:36.659677 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:36.690263 31147 raft_consensus.cc:2468] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 3.
I20260709 13:08:36.692732 30441 leader_election.cc:400] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Vote denied by peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453) with higher term. Message: Invalid argument: T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 3. Current term is 4.
I20260709 13:08:36.693219 30441 leader_election.cc:403] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 13:08:36.683319 32093 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.002s	sys 0.030s
I20260709 13:08:36.694408 30516 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:08:36.564538 32142 raft_consensus.cc:697] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
W20260709 13:08:36.617592 32184 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.009s	sys 0.035s
I20260709 13:08:36.592574 32164 raft_consensus.cc:493] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:36.609966 32051 raft_consensus.cc:2749] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) with higher term. Message: Invalid argument: T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 3. Current term is 4.
I20260709 13:08:36.592720 32072 raft_consensus.cc:2749] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 2. Current term is 3.
I20260709 13:08:36.619937 32096 raft_consensus.cc:697] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
W20260709 13:08:36.745765 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 240378us
I20260709 13:08:36.686694 32114 raft_consensus.cc:493] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:08:36.743592 32093 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.002s	sys 0.039s
I20260709 13:08:36.696259 32196 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:08:36.729017 32086 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.018s	sys 0.036s
I20260709 13:08:36.617089 32126 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:36.751153 32164 raft_consensus.cc:515] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:36.748502 32056 raft_consensus.cc:2804] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:36.660099 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:36.609043 32195 raft_consensus.cc:493] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:36.693707 32183 raft_consensus.cc:2804] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:08:36.728634 32184 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.010s	sys 0.043s
I20260709 13:08:36.772150 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:36.783221 31114 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:08:36.774271 31144 raft_consensus.cc:2368] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 2. Current term is 3.
I20260709 13:08:36.696273 32189 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:36.797287 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:36.787984 32196 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:36.788081 32056 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:36.782970 32086 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.025s	sys 0.038s
I20260709 13:08:36.690980 32089 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:08:36.786232 30517 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.015s	sys 0.020s
I20260709 13:08:36.619527 32198 consensus_queue.cc:237] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:36.804452 32094 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.009s	sys 0.024s
W20260709 13:08:36.826256 32094 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.010s	sys 0.024s
W20260709 13:08:36.821501 30517 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.016s	sys 0.020s
I20260709 13:08:36.822969 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:36.802263 31142 raft_consensus.cc:3060] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:36.839066 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 713346us
I20260709 13:08:36.809270 32156 raft_consensus.cc:2804] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:36.791965 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:36.836340 30545 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:36.818312 32143 consensus_meta.cc:287] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.589s	user 0.009s	sys 0.000s
I20260709 13:08:36.802680 32195 raft_consensus.cc:515] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:08:36.844097 32174 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.013s	sys 0.008s
I20260709 13:08:36.828542 32056 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:36.806547 32114 raft_consensus.cc:515] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:08:36.866411 30515 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.003s	sys 0.051s
W20260709 13:08:36.888641 30515 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.003s	sys 0.052s
I20260709 13:08:36.882292 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:36.890588 30474 raft_consensus.cc:2393] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 6: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:08:36.885089 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:36.891588 30473 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:36.865664 30543 raft_consensus.cc:3060] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:36.874536 30514 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.011s	sys 0.023s
W20260709 13:08:36.897508 30514 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.011s	sys 0.023s
W20260709 13:08:36.844238 32043 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.015s	sys 0.008s
I20260709 13:08:36.899870 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:37.027542 30469 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 2.
I20260709 13:08:36.900668 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:36.903237 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:08:36.886821 32174 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.013s	sys 0.008s
W20260709 13:08:36.904215 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.872583 32176 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:36.912053 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:37.031459 30474 raft_consensus.cc:2368] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 2. Current term is 3.
I20260709 13:08:36.824146 32142 consensus_queue.cc:237] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:36.873737 32156 raft_consensus.cc:697] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:36.888059 32164 leader_election.cc:290] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:36.851665 32143 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:36.932821 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:37.147397 30546 raft_consensus.cc:2468] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 5.
I20260709 13:08:36.933152 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:36.937279 32114 leader_election.cc:290] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:37.148752 30550 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 2.
I20260709 13:08:36.939934 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:36.940166 30616 raft_consensus.cc:1240] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:08:36.940172 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:37.160750 30617 raft_consensus.cc:2393] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 6: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:08:36.948071 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:36.895828 32034 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:36.839390 32038 consensus_queue.cc:237] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:36.844669 32096 consensus_queue.cc:237] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:36.912096 32154 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.962695 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:37.170234 30471 raft_consensus.cc:2393] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 3: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
W20260709 13:08:36.954516 32122 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.017s	sys 0.019s
I20260709 13:08:36.970638 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:36.948757 32094 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.969023 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:08:36.980990 30516 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.173.3:32851 timed out after 1.525s (SENT) [suppressed 3 similar messages]
W20260709 13:08:36.984678 32190 consensus_meta.cc:287] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.672s	user 0.011s	sys 0.000s
I20260709 13:08:36.985111 32126 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:36.994094 32208 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:37.177883 32190 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:37.178145 32208 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:37.179060 30476 raft_consensus.cc:2368] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 2. Current term is 3.
I20260709 13:08:37.180028 32190 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:37.180130 32208 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:37.180667 32190 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:37.181133 32190 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:37.183040 32094 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:37.167771 32034 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:37.186015 32094 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:37.186160 32034 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:37.190141 30545 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:08:37.004426 32192 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:37.004801 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:37.009123 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:08:37.171751 32122 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.006s	user 0.017s	sys 0.020s
I20260709 13:08:36.963061 32210 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
W20260709 13:08:37.031279 30591 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.019s	sys 0.031s
I20260709 13:08:37.007655 32051 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:08:37.206881 32194 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.033s	sys 0.030s
I20260709 13:08:37.140667 30473 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 6.
I20260709 13:08:37.043411 32176 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:37.032922 32196 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:37.209481 32168 leader_election.cc:290] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:37.143725 31150 raft_consensus.cc:2468] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:08:37.161675 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:08:37.110095 32167 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.004s	sys 0.038s
I20260709 13:08:37.163156 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:37.163803 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:37.267716 30550 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 2.
W20260709 13:08:37.249945 32194 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.034s	sys 0.030s
I20260709 13:08:37.268824 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:37.269708 30550 raft_consensus.cc:2368] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 3. Current term is 4.
I20260709 13:08:37.172312 30625 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 2.
I20260709 13:08:37.173939 30547 raft_consensus.cc:2468] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 2.
I20260709 13:08:37.174759 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:37.175428 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:37.271164 30621 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:37.142712 32213 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:37.191228 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:37.173297 32154 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:36.995680 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:08:37.167246 30468 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60026 (request call id 197) took 1470 ms (client timeout 1957 ms). Trace:
W20260709 13:08:37.163195 32037 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.889s	user 0.035s	sys 0.046s
I20260709 13:08:37.165297 32114 raft_consensus.cc:493] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:37.022774 30589 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
W20260709 13:08:37.373885 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 351158us
I20260709 13:08:37.374641 30589 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:37.208971 30623 raft_consensus.cc:2393] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 3: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:08:37.170511 32164 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
W20260709 13:08:37.237766 30591 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.020s	sys 0.032s
W20260709 13:08:37.248713 30590 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.038s	sys 0.037s
I20260709 13:08:37.377209 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:08:37.377720 30590 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.038s	sys 0.037s
W20260709 13:08:37.377686 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 988694us
W20260709 13:08:37.378250 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 798598us
I20260709 13:08:37.250545 30549 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
W20260709 13:08:37.032058 32043 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.015s	sys 0.009s
I20260709 13:08:37.216647 30542 raft_consensus.cc:3060] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:37.209609 32195 leader_election.cc:290] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:37.266266 30624 raft_consensus.cc:2468] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 3.
W20260709 13:08:37.271977 32167 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.004s	sys 0.039s
W20260709 13:08:37.042841 32205 log.cc:927] Time spent T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.095s	user 0.002s	sys 0.001s
I20260709 13:08:37.379365 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:08:37.270161 32182 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.029s	sys 0.041s
I20260709 13:08:37.252497 32051 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:37.373112 32037 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.079s	user 0.035s	sys 0.046s
I20260709 13:08:37.209872 32192 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:37.389881 30548 raft_consensus.cc:2468] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 2.
I20260709 13:08:37.247879 32210 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:08:37.385666 32184 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.006s	sys 0.023s
I20260709 13:08:37.404997 30617 raft_consensus.cc:1240] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:37.405753 30589 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:37.408301 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
W20260709 13:08:37.395939 32183 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.000s	sys 0.017s
W20260709 13:08:37.494261 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.500679 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:37.505332 30549 raft_consensus.cc:2393] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 2: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:08:37.502899 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:08:37.460476 30472 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.011s	sys 0.032s
I20260709 13:08:37.382719 32034 raft_consensus.cc:2749] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:08:37.399714 32182 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.829s	user 0.030s	sys 0.042s
I20260709 13:08:37.491626 30473 raft_consensus.cc:2368] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 3. Current term is 4.
I20260709 13:08:37.464908 30621 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 6.
I20260709 13:08:37.464237 32110 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:08:37.495779 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 90076.1us
I20260709 13:08:37.516036 30550 raft_consensus.cc:2393] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 2: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
W20260709 13:08:37.507158 30472 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.015s	sys 0.033s
W20260709 13:08:37.494812 32202 log.cc:927] Time spent T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.597s	user 0.001s	sys 0.001s
I20260709 13:08:37.389560 32164 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:08:37.492020 32184 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.007s	sys 0.030s
I20260709 13:08:37.529784 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:37.542439 30547 raft_consensus.cc:2393] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 2: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
W20260709 13:08:37.529721 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 558464us
W20260709 13:08:37.508853 32214 log.cc:927] Time spent T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.301s	user 0.000s	sys 0.000s
I20260709 13:08:37.545290 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:37.546552 30550 raft_consensus.cc:2393] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 2: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:08:37.383163 32114 raft_consensus.cc:515] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:08:37.352820 30468 rpcz_store.cc:269] 0709 13:08:35.688370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.689854 (+  1484us) service_pool.cc:224] Handling call
0709 13:08:35.999841 (+309987us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b5800002d98. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780e43b71 00007fc780e43a22 00007fc789d5cc09 00007fc788eb6ee0 00007fc788f800ab 00007fc788f80131 00007fc788f2e0a0 00007fc788f2d984 00007fc7824a86d4 00007fc7824a8662
0709 13:08:37.056815 (+1056974us) spinlock_profiling.cc:243] Waited 386 ms on lock 0x7b54000424d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:08:37.158606 (+101791us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":893957760}
I20260709 13:08:37.508993 32196 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:37.390951 32213 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:37.536351 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:37.554740 30549 raft_consensus.cc:2468] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
I20260709 13:08:37.493814 32051 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:37.548986 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:37.532876 30517 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:08:37.519593 32178 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.009s	sys 0.013s
W20260709 13:08:37.503290 32183 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.000s	sys 0.018s
I20260709 13:08:37.515606 32078 raft_consensus.cc:2749] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:37.513773 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:37.559130 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:37.579574 30548 raft_consensus.cc:2393] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 2: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:08:37.514029 32219 raft_consensus.cc:2749] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:37.594738 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:08:37.554374 31142 consensus_meta.cc:287] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.717s	user 0.004s	sys 0.007s
I20260709 13:08:37.579909 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
W20260709 13:08:37.544489 31143 consensus_meta.cc:287] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.734s	user 0.012s	sys 0.004s
I20260709 13:08:37.537948 32110 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:37.581262 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:37.375329 32156 consensus_queue.cc:237] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:37.592017 30550 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:37.541043 32194 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
W20260709 13:08:37.593183 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 108500us
I20260709 13:08:37.596400 30549 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:37.552178 32143 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:08:37.584645 32178 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.010s	sys 0.013s
W20260709 13:08:37.604941 30440 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.002s	sys 0.028s
W20260709 13:08:37.608182 30440 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.002s	sys 0.028s
I20260709 13:08:37.597187 31142 raft_consensus.cc:2468] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:37.585119 32225 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:37.597539 31143 raft_consensus.cc:2468] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:37.585199 32190 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:37.584362 32183 raft_consensus.cc:697] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 3 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:37.602994 31144 raft_consensus.cc:2468] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 1.
I20260709 13:08:37.593112 32196 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:37.652041 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 360703us
I20260709 13:08:37.639595 31142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48414 (request call id 483) took 1121 ms. Trace:
I20260709 13:08:37.624760 32225 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:37.658294 31142 rpcz_store.cc:276] 0709 13:08:36.495447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.502516 (+  7069us) service_pool.cc:224] Handling call
0709 13:08:36.658380 (+155864us) spinlock_profiling.cc:243] Waited 44.4 ms on lock 0x7b5800003998. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780e43b71 00007fc780e43a22 00007fc789d5cc09 00007fc788eb6ee0 00007fc788f800ab 00007fc788f80131 00007fc788f2e0a0 00007fc788f2d984 00007fc7824a86d4 00007fc7824a8662
0709 13:08:37.616636 (+958256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":102077696}
I20260709 13:08:37.667326 32225 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:37.650520 32234 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:37.669145 32234 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:08:37.670475 32220 log.cc:927] Time spent T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 13:08:37.671419 32234 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:08:37.672015 32221 log.cc:927] Time spent T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
W20260709 13:08:37.672580 30439 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.009s	sys 0.010s
W20260709 13:08:37.676522 30439 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.009s	sys 0.010s
W20260709 13:08:37.673451 30625 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36130 (request call id 1474) took 1632 ms (client timeout 1762 ms). Trace:
I20260709 13:08:37.641381 30549 raft_consensus.cc:2468] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
W20260709 13:08:37.651266 32189 consensus_meta.cc:287] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.832s	user 0.001s	sys 0.009s
W20260709 13:08:37.677230 30625 rpcz_store.cc:269] 0709 13:08:36.024316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.028486 (+  4170us) service_pool.cc:224] Handling call
0709 13:08:37.655908 (+1627422us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540027ea54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:08:37.657039 (+  1131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2401686272}
I20260709 13:08:37.639891 31143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48414 (request call id 484) took 1140 ms. Trace:
I20260709 13:08:37.683650 32226 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:37.684266 32226 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:37.608839 32194 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:37.681066 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:37.601620 30548 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
mode: GRACEFUL
new_leader_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:45906
I20260709 13:08:37.647380 32178 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:37.650787 32176 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:37.701031 30591 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:08:37.707545 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 174817us
I20260709 13:08:37.707713 30591 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:37.709569 30517 leader_election.cc:400] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 election: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 2. Current term is 3.
I20260709 13:08:37.709906 30517 leader_election.cc:403] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:08:37.713358 30550 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:08:37.688143 32189 raft_consensus.cc:2749] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453) with higher term. Message: Invalid argument: T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 3. Current term is 4.
I20260709 13:08:37.689090 32225 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.718180 30551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43088 (request call id 1456) took 1893 ms. Trace:
I20260709 13:08:37.720803 30591 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:37.734637 32198 raft_consensus.cc:2804] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:37.734989 32126 raft_consensus.cc:2804] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:37.735946 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:37.735980 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:37.743896 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:37.742175 30591 leader_election.cc:304] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:37.689350 32234 raft_consensus.cc:493] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:37.683313 31143 rpcz_store.cc:276] 0709 13:08:36.495848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.496866 (+  1018us) service_pool.cc:224] Handling call
0709 13:08:36.786403 (+289537us) spinlock_profiling.cc:243] Waited 32.5 ms on lock 0x7b5800003998. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780e43b71 00007fc780e43a22 00007fc789d5cc09 00007fc788eb6ee0 00007fc788f800ab 00007fc788f80131 00007fc788f2e0a0 00007fc788f2d984 00007fc7824a86d4 00007fc7824a8662
0709 13:08:37.635839 (+849436us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":74650880}
I20260709 13:08:37.708185 32190 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:08:37.740826 32056 consensus_meta.cc:287] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.833s	user 0.009s	sys 0.004s
W20260709 13:08:37.761366 32216 log.cc:927] Time spent T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 13:08:37.739166 32176 raft_consensus.cc:2804] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:37.718683 32226 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:37.745609 32198 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.790410 32251 raft_consensus.cc:493] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:37.768577 32182 raft_consensus.cc:2804] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:37.747159 32192 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:37.779018 32195 raft_consensus.cc:2804] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:37.741466 30551 rpcz_store.cc:276] 0709 13:08:35.815654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.815861 (+   207us) service_pool.cc:224] Handling call
0709 13:08:35.836538 (+ 20677us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:35.958320 (+121782us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:35.958349 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:35.958796 (+   447us) log.cc:844] Serialized 26 byte log entry
0709 13:08:36.380417 (+421621us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:36.380457 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:36.472093 (+ 91636us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b5400397bd4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:36.472132 (+    39us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:37.702920 (+1230788us) raft_consensus.cc:1685] finished
0709 13:08:37.702949 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:37.708481 (+  5532us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1401,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":113,"spinlock_wait_cycles":279232896,"thread_start_us":421251,"threads_started":1,"wal-append.queue_time_us":848132}
I20260709 13:08:37.717998 32178 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:37.810262 30371 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57546 (request call id 303) took 2522 ms. Trace:
I20260709 13:08:37.779337 32126 raft_consensus.cc:697] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:37.811702 32236 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:37.811311 30372 catalog_manager.cc:5697] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 1 to 2, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 2 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:37.813912 32236 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:37.814741 32238 raft_consensus.cc:493] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:37.814805 32244 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:37.815395 32238 raft_consensus.cc:515] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:37.815471 32244 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:37.816160 31151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48414 (request call id 477) took 1426 ms. Trace:
I20260709 13:08:37.816574 31151 rpcz_store.cc:276] 0709 13:08:36.389411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.389572 (+   161us) service_pool.cc:224] Handling call
0709 13:08:37.815969 (+1426397us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b5400564ad4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:08:37.816103 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2682067200}
I20260709 13:08:37.769420 32225 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:37.793270 32198 raft_consensus.cc:3060] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:37.815315 30372 catalog_manager.cc:5697] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 1 to 2, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 2 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:37.791466 32164 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:37.774057 32234 raft_consensus.cc:515] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:08:37.800484 32223 log.cc:927] Time spent T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:08:37.801337 32196 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:37.796873 32176 raft_consensus.cc:697] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:37.838326 32233 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:37.799400 32187 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:37.792806 30542 raft_consensus.cc:2468] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 4.
I20260709 13:08:37.800518 30545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39952 (request call id 1143) took 1734 ms. Trace:
I20260709 13:08:37.799533 32204 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:37.845609 32250 raft_consensus.cc:2749] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 2. Current term is 3.
I20260709 13:08:37.846164 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:37.789075 32210 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:37.848099 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:37.849007 32236 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:37.849530 30545 rpcz_store.cc:276] 0709 13:08:36.069101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.072832 (+  3731us) service_pool.cc:224] Handling call
0709 13:08:37.800315 (+1727483us) spinlock_profiling.cc:243] Waited 750 ms on lock 0x7b540038d454. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:08:37.800456 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1724846464}
I20260709 13:08:37.842000 32143 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.784143 32056 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:37.835952 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:37.820771 32114 leader_election.cc:290] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:37.837599 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:37.833323 32195 raft_consensus.cc:697] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:37.784960 32190 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:37.869395 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:08:37.870124 30543 consensus_meta.cc:287] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.959s	user 0.010s	sys 0.000s
I20260709 13:08:37.870623 30543 raft_consensus.cc:2468] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 3.
I20260709 13:08:37.850679 32187 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:37.871125 30543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35278 (request call id 278) took 1096 ms. Trace:
I20260709 13:08:37.839596 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:37.843947 30548 raft_consensus.cc:606] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Received request to transfer leadership to TS f639301059e24dc5b0d88a46dc683326
I20260709 13:08:37.872494 30548 raft_consensus.cc:614] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:37.840832 32184 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:37.843480 32233 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:37.843571 32176 consensus_queue.cc:237] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:37.846295 32250 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:37.846043 32204 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:37.823920 30372 catalog_manager.cc:5697] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 2 to 3, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 3 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
I20260709 13:08:37.847505 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:37.895170 30623 raft_consensus.cc:2468] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 2.
I20260709 13:08:37.819020 32182 raft_consensus.cc:697] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:37.859897 30590 leader_election.cc:400] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Vote denied by peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453) with higher term. Message: Invalid argument: T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 2. Current term is 3.
I20260709 13:08:37.837533 32110 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:08:37.897699 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 45614.4us
I20260709 13:08:37.850519 32143 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:37.863667 32056 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:37.864778 32225 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:37.788335 32183 consensus_queue.cc:237] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:37.866770 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:37.868208 30547 raft_consensus.cc:2368] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 3. Current term is 4.
I20260709 13:08:37.841997 32164 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:37.868705 32244 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:37.870205 30618 raft_consensus.cc:2368] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 2. Current term is 3.
I20260709 13:08:37.832782 30440 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:37.819979 32168 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.906738 32182 consensus_queue.cc:237] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:37.909919 32164 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:37.912051 32164 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:37.874483 32187 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:37.874997 32126 consensus_queue.cc:237] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:37.875458 32246 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:08:37.876300 32232 log.cc:927] Time spent T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.165s	user 0.000s	sys 0.002s
I20260709 13:08:37.812417 30371 rpcz_store.cc:276] 0709 13:08:35.284434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.295497 (+ 11063us) service_pool.cc:224] Handling call
0709 13:08:37.806768 (+2511271us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:35.716625 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:35.816035 (+ 99410us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:35.830821 (+ 14786us) write_op.cc:435] Acquired schema lock
0709 13:08:35.844463 (+ 13642us) tablet.cc:662] Decoding operations
0709 13:08:35.981757 (+137294us) spinlock_profiling.cc:243] Waited 9.27 ms on lock 0x7b5c00196a8c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc78a15a331 00007fc78a15a221 00007fc78a154f6c 00007fc7878b0370 00007fc7879b2e74 00007fc78799e0a6 00007fc78799dd58 00007fc7879a29f1 00007fc7879a29a9 00007fc7879a2939 00007fc7879a2901
0709 13:08:35.982489 (+   732us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:35.982585 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:35.982627 (+    42us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:08:35.983063 (+   436us) tablet.cc:701] Row locks acquired
0709 13:08:35.983107 (+    44us) write_op.cc:260] PREPARE: finished
0709 13:08:35.983330 (+   223us) write_op.cc:270] Start()
0709 13:08:35.983662 (+   332us) write_op.cc:276] Timestamp: P: 1783602515983255 usec, L: 0
0709 13:08:35.983696 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:08:36.162045 (+178349us) log.cc:844] Serialized 980 byte log entry
0709 13:08:37.177551 (+1015506us) op_driver.cc:464] REPLICATION: finished
0709 13:08:37.667222 (+489671us) write_op.cc:301] APPLY: starting
0709 13:08:37.667305 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:37.667417 (+   112us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:37.667439 (+    22us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:37.667889 (+   450us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:37.668056 (+   167us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:08:37.668096 (+    40us) write_op.cc:312] APPLY: finished
0709 13:08:37.668263 (+   167us) log.cc:844] Serialized 29 byte log entry
0709 13:08:37.668417 (+   154us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:37.668497 (+    80us) write_op.cc:454] Released schema lock
0709 13:08:37.668534 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:37.668856 (+   322us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:37.668886 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":489410,"apply.run_cpu_time_us":1621,"apply.run_wall_time_us":1621,"num_ops":2,"prepare.queue_time_us":205544,"prepare.run_cpu_time_us":8235,"prepare.run_wall_time_us":449414,"replication_time_us":1185927,"spinlock_wait_cycles":21327744,"thread_start_us":516383,"threads_started":2}]]}
I20260709 13:08:37.843793 32213 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:37.870051 32195 consensus_queue.cc:237] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:37.885752 30476 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60026 (request call id 206) took 1567 ms (client timeout 1546 ms). Trace:
W20260709 13:08:37.939980 30476 rpcz_store.cc:269] 0709 13:08:36.318317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.318437 (+   120us) service_pool.cc:224] Handling call
0709 13:08:37.878442 (+1560005us) spinlock_profiling.cc:243] Waited 794 ms on lock 0x7b540011e254. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:08:37.885671 (+  7229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1825821440}
I20260709 13:08:37.888562 32184 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:37.799921 32251 raft_consensus.cc:515] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:37.893476 32233 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:08:37.902094 32242 log.cc:927] Time spent T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:08:37.903172 32194 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:37.871466 30543 rpcz_store.cc:276] 0709 13:08:36.774618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.778462 (+  3844us) service_pool.cc:224] Handling call
0709 13:08:37.871068 (+1092606us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:37.921355 32168 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:37.922710 30618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47446 (request call id 1802) took 1020 ms. Trace:
I20260709 13:08:37.923470 32238 leader_election.cc:290] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:37.925911 32093 tablet_bootstrap.cc:492] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:37.927379 32190 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:37.928102 32089 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:37.928436 32198 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:37.933811 32246 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:37.948886 32184 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:37.950052 32168 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:37.946781 30618 rpcz_store.cc:276] 0709 13:08:36.902509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.902641 (+   132us) service_pool.cc:224] Handling call
0709 13:08:37.869216 (+966575us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b58001a3198. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780e43b71 00007fc780e43a22 00007fc789d5cc09 00007fc788eb6ee0 00007fc788f800ab 00007fc788f80131 00007fc788f2e0a0 00007fc788f2d984 00007fc7824a86d4 00007fc7824a8662
0709 13:08:37.922616 (+ 53400us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39994240}
I20260709 13:08:37.966751 32093 tablet_bootstrap.cc:492] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6: Bootstrap complete.
I20260709 13:08:37.966487 32187 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:37.989784 32093 ts_tablet_manager.cc:1403] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6: Time spent bootstrapping tablet: real 2.515s	user 0.030s	sys 0.052s
I20260709 13:08:37.990408 32143 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:37.989216 32187 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:37.993723 32187 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:37.995977 32246 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:37.983609 32154 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:37.996975 32178 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:37.998162 32234 leader_election.cc:290] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:37.935421 32250 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:38.002236 32250 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:38.003741 32251 leader_election.cc:290] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:38.004922 32204 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:38.010885 32093 raft_consensus.cc:359] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:38.012247 32093 raft_consensus.cc:740] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Initialized, Role: LEARNER
I20260709 13:08:38.013161 32093 consensus_queue.cc:260] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:38.028884 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:38.029139 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:38.029654 30548 raft_consensus.cc:3060] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:38.030788 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:38.031380 30549 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:38.033373 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 287852us
I20260709 13:08:38.034686 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:38.045939 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:38.049268 30474 raft_consensus.cc:1275] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:38.049664 30471 raft_consensus.cc:2468] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:38.046541 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:38.048278 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:38.037935 30549 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
I20260709 13:08:38.052649 30468 raft_consensus.cc:1275] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:38.047629 30475 raft_consensus.cc:2468] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 2.
I20260709 13:08:38.057723 30468 raft_consensus.cc:1275] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:38.060107 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:38.060783 30472 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 2.
I20260709 13:08:38.021940 32198 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:38.063838 32093 ts_tablet_manager.cc:1434] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6: Time spent starting tablet: real 0.074s	user 0.008s	sys 0.000s
I20260709 13:08:38.068881 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:38.069892 30548 raft_consensus.cc:2468] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
I20260709 13:08:38.070961 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:38.073055 30472 raft_consensus.cc:2468] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
W20260709 13:08:38.075519 31148 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 431) took 1569 ms (client timeout 1520 ms). Trace:
W20260709 13:08:38.075984 31148 rpcz_store.cc:269] 0709 13:08:36.506523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.508346 (+  1823us) service_pool.cc:224] Handling call
0709 13:08:36.819226 (+310880us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b5800003998. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780e43b71 00007fc780e43a22 00007fc789d5cc09 00007fc788eb6ee0 00007fc788f800ab 00007fc788f80131 00007fc788f2e0a0 00007fc788f2d984 00007fc7824a86d4 00007fc7824a8662
0709 13:08:38.075292 (+1256066us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400573d54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:08:38.075454 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2893934208}
I20260709 13:08:38.076704 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:38.077284 31151 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:08:38.084611 31151 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
W20260709 13:08:38.089551 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 256820us
I20260709 13:08:38.090504 30440 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:38.092073 32233 raft_consensus.cc:2764] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:08:38.094586 32056 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:38.099112 32227 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:38.095310 32056 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:38.099700 32227 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:38.101127 32056 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:38.102077 32227 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:38.102859 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:38.103098 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:38.104210 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:38.092135 32194 raft_consensus.cc:2804] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:38.104808 30474 raft_consensus.cc:2368] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 2. Current term is 3.
I20260709 13:08:38.105005 32194 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:38.105402 32194 raft_consensus.cc:3060] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:38.105629 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:38.106226 30471 raft_consensus.cc:2468] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 4.
I20260709 13:08:38.106307 32142 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.106845 32142 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:38.108088 32260 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:38.108608 32260 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:38.109576 32142 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:38.110692 32260 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:38.111465 30589 leader_election.cc:400] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 election: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 3. Current term is 4.
I20260709 13:08:38.111764 30589 leader_election.cc:403] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:08:38.113317 32259 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:38.113430 30619 raft_consensus.cc:1240] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 LEADER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:38.113605 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:38.115744 32194 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:38.117040 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:38.117890 32194 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:38.118436 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:08:38.119372 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 219932us
I20260709 13:08:38.119904 32183 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.120368 32183 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:38.120865 30590 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:38.121253 32034 raft_consensus.cc:1064] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79: attempting to promote NON_VOTER cd669586cff44d4bbfcc007e213faab6 to VOTER
I20260709 13:08:38.122406 32183 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:38.123102 32218 raft_consensus.cc:2804] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:38.123488 32218 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:38.123898 32218 raft_consensus.cc:3060] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:38.126484 30485 tablet_copy_service.cc:342] P f639301059e24dc5b0d88a46dc683326: Request end of tablet copy session cd669586cff44d4bbfcc007e213faab6-2b207fb799ce4340b29ae053898e0e6c received from {username='slave'} at 127.0.0.1:60026
I20260709 13:08:38.126917 30485 tablet_copy_service.cc:434] P f639301059e24dc5b0d88a46dc683326: ending tablet copy session cd669586cff44d4bbfcc007e213faab6-2b207fb799ce4340b29ae053898e0e6c on tablet 2b207fb799ce4340b29ae053898e0e6c with peer cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:38.129218 30517 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:38.130788 32249 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:38.131038 32089 raft_consensus.cc:2749] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:38.131316 32249 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:38.133559 32249 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:38.134099 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:38.134716 31116 leader_election.cc:400] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 2. Current term is 3.
I20260709 13:08:38.135022 31116 leader_election.cc:403] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:38.130659 30517 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:38.136173 32262 raft_consensus.cc:2749] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:38.136152 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:38.138172 32183 raft_consensus.cc:2749] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 2. Current term is 3.
I20260709 13:08:38.136492 31116 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:38.139525 32227 raft_consensus.cc:2804] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:38.139881 30516 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:38.140307 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:38.140654 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:38.141598 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:38.142539 30516 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:38.142904 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:38.143693 30546 raft_consensus.cc:2368] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 2. Current term is 3.
I20260709 13:08:38.139881 32227 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:38.143985 32210 consensus_queue.cc:1059] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:38.144438 32227 raft_consensus.cc:3060] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:38.144471 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:38.144904 32210 raft_consensus.cc:2749] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:38.145546 32252 raft_consensus.cc:3055] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:38.145898 32252 raft_consensus.cc:740] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:38.146499 30543 raft_consensus.cc:1275] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:38.146704 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:38.148101 30543 raft_consensus.cc:1240] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:38.148262 31146 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Advancing to term 3
I20260709 13:08:38.126942 30547 raft_consensus.cc:1275] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:38.150617 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:08:38.151526 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 59943us
I20260709 13:08:38.140331 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:38.153040 30440 leader_election.cc:400] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 3. Current term is 4.
I20260709 13:08:38.153311 31145 raft_consensus.cc:2468] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
I20260709 13:08:38.154978 31144 raft_consensus.cc:1275] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:38.155313 30440 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:38.143765 32213 raft_consensus.cc:2749] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:38.156104 32190 raft_consensus.cc:2764] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 13:08:38.159238 30591 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:38.159893 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:38.161468 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:38.161643 30476 raft_consensus.cc:1240] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:38.162045 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:38.159751 32072 consensus_queue.cc:1059] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:08:38.163564 32072 consensus_queue.cc:1243] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer fe2b7d73f8c743c1ba570cfd981c4e79 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:08:38.164142 32072 raft_consensus.cc:3055] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:38.164438 32072 raft_consensus.cc:740] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:38.146677 32252 consensus_queue.cc:260] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:38.165246 32072 consensus_queue.cc:260] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:38.165679 32037 consensus_queue.cc:1048] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:38.166402 32072 raft_consensus.cc:3060] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:38.166446 32252 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:38.162055 30547 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:38.168583 30471 raft_consensus.cc:2468] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 4.
I20260709 13:08:38.169323 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:38.175738 30625 raft_consensus.cc:2468] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 3.
I20260709 13:08:38.148126 30517 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:38.179420 30517 leader_election.cc:400] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 election: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 3. Current term is 4.
I20260709 13:08:38.171308 30623 raft_consensus.cc:1275] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:38.180009 32056 raft_consensus.cc:2804] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:38.180483 32056 raft_consensus.cc:697] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 6 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:38.181195 31148 raft_consensus.cc:1275] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:38.181295 32056 consensus_queue.cc:237] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:38.171880 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:38.182821 31115 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:38.172518 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:38.172981 32204 raft_consensus.cc:2804] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:38.173175 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:38.183903 32204 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:38.184474 32204 raft_consensus.cc:3060] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:38.173801 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:38.184489 32187 raft_consensus.cc:2804] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:38.189034 32187 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:38.179679 30517 leader_election.cc:403] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:08:38.189307 30440 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:38.170413 32034 consensus_queue.cc:237] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:38.126129 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:08:38.204267 30467 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.019s	sys 0.053s
W20260709 13:08:38.204588 30467 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.019s	sys 0.053s
I20260709 13:08:38.190577 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:38.189482 32187 raft_consensus.cc:3060] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:38.190258 30476 raft_consensus.cc:1275] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:38.191375 32213 raft_consensus.cc:2749] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 3. Current term is 4.
I20260709 13:08:38.206691 31146 raft_consensus.cc:1275] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 3 LEARNER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:08:38.131071 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:38.191430 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 47867.8us
I20260709 13:08:38.152153 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:38.215131 30543 raft_consensus.cc:2468] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:08:38.173854 30591 leader_election.cc:304] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:38.217137 32078 raft_consensus.cc:2749] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:38.218132 32083 consensus_queue.cc:1048] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:38.221261 30591 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:38.223857 32142 raft_consensus.cc:2804] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:38.224356 32142 raft_consensus.cc:697] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:38.224435 32256 raft_consensus.cc:2804] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:38.225108 32256 raft_consensus.cc:697] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 4 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:38.225850 32142 consensus_queue.cc:237] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:38.211153 32096 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:38.227516 32096 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:38.196960 32227 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:38.229414 31143 raft_consensus.cc:2393] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 5: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:08:38.230391 30440 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:38.230401 32096 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:38.215492 30516 leader_election.cc:304] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:38.226212 32256 consensus_queue.cc:237] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:38.231666 32260 raft_consensus.cc:2804] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:38.232268 32260 raft_consensus.cc:697] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:38.233214 32260 consensus_queue.cc:237] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:38.235402 32218 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:38.236445 32227 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:38.239568 32213 raft_consensus.cc:2749] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:38.240337 32198 consensus_queue.cc:1059] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:38.240936 30516 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:38.241294 32198 raft_consensus.cc:3055] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:38.241703 32198 raft_consensus.cc:740] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:38.205183 30467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 1769) took 1325 ms. Trace:
I20260709 13:08:38.249120 30516 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:38.252614 32250 raft_consensus.cc:2749] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:38.252673 30624 raft_consensus.cc:1275] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:38.248723 31116 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:38.245859 32198 consensus_queue.cc:260] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:38.254897 32072 raft_consensus.cc:2749] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:38.255316 32213 raft_consensus.cc:2804] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:38.255553 32198 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:38.255968 32213 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:38.256413 32213 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:38.245322 32227 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:38.262786 31116 leader_election.cc:304] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:38.263034 32227 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:38.251507 30440 leader_election.cc:304] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:38.265352 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:38.266844 30589 leader_election.cc:400] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 election: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 2. Current term is 3.
I20260709 13:08:38.267220 30589 leader_election.cc:403] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 13:08:38.269665 31115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.271747 30548 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
mode: GRACEFUL
new_leader_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:45906
I20260709 13:08:38.272114 31146 raft_consensus.cc:1275] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 1 LEARNER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:38.278728 30589 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:38.248909 30467 rpcz_store.cc:276] 0709 13:08:36.879546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.879664 (+   118us) service_pool.cc:224] Handling call
0709 13:08:36.880017 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:36.880244 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:08:37.254650 (+374406us) log.cc:844] Serialized 14 byte log entry
0709 13:08:38.204871 (+950221us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:38.204922 (+    51us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:38.204960 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:38.205022 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:38.205114 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":102583,"prepare.queue_time_us":668608,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":101742,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":24911,"thread_start_us":1223381,"threads_started":3,"wal-append.queue_time_us":548851}
I20260709 13:08:38.292876 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:38.292814 30548 raft_consensus.cc:606] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 6 LEADER]: Received request to transfer leadership to TS f639301059e24dc5b0d88a46dc683326
I20260709 13:08:38.308934 30547 raft_consensus.cc:3060] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:38.309279 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:38.295846 31116 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:38.312711 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:38.314999 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:38.284950 32256 raft_consensus.cc:2804] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:38.320905 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:38.321942 30589 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:38.324496 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:38.328045 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:38.284917 32078 raft_consensus.cc:3060] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:38.330001 30589 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:38.310458 32086 raft_consensus.cc:2749] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:38.284426 32072 raft_consensus.cc:2749] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:38.332898 30589 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:38.311674 32219 consensus_queue.cc:1048] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:08:38.308915 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:38.310040 32190 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:38.339587 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:38.214145 32187 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:38.337280 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:38.352933 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:38.353257 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:38.353499 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:38.354535 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:38.354602 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:38.322021 32038 consensus_queue.cc:1059] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:08:38.337230 32256 raft_consensus.cc:697] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:38.347667 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:38.343021 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:38.356545 32038 raft_consensus.cc:3055] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:38.329783 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:38.356894 30616 raft_consensus.cc:1275] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:38.357368 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:38.357702 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:38.355744 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:38.356962 32256 consensus_queue.cc:237] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:38.358110 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:38.358762 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:38.360087 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:38.356573 30548 raft_consensus.cc:2468] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
I20260709 13:08:38.360838 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:38.295130 32083 consensus_queue.cc:1048] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:08:38.363449 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:38.364281 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:38.345973 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:38.331441 32156 raft_consensus.cc:2749] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:38.330464 32222 raft_consensus.cc:2749] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:38.369342 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:38.334370 32259 raft_consensus.cc:2749] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 3. Current term is 4.
I20260709 13:08:38.348361 32182 raft_consensus.cc:2804] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:38.331597 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:38.382820 30516 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:38.371001 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:38.382344 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:38.345599 32176 raft_consensus.cc:2804] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:38.373823 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:38.351727 32218 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:38.382822 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:38.434309 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:38.370800 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:38.366927 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:38.361104 31144 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:38.380587 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:08:38.555317 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 396599us
I20260709 13:08:38.395663 32250 raft_consensus.cc:2749] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:38.356931 32038 raft_consensus.cc:740] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:38.371788 32089 consensus_queue.cc:1048] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:08:38.430366 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:38.437551 30516 leader_election.cc:304] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:08:38.581120 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 143658us
I20260709 13:08:38.395606 32260 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:38.367508 32096 consensus_queue.cc:1048] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:08:38.591090 30469 raft_consensus.cc:1275] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:38.369791 32190 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:38.396809 32176 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:38.397635 31142 raft_consensus.cc:1240] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:38.404224 30542 raft_consensus.cc:1275] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:38.558435 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:38.549057 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:38.619297 30545 raft_consensus.cc:2393] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 3: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:08:38.399047 32182 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:38.620010 32182 raft_consensus.cc:3060] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:38.620330 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:38.422792 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:38.569532 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:38.570736 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:38.622225 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:38.571060 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:38.574149 30441 leader_election.cc:304] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:08:38.565836 30517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.583999 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:38.586700 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:38.587491 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:38.594085 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:38.590837 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:38.577893 32194 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.606585 30440 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:38.580257 32164 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.511705 32213 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:38.614548 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:38.661597 30547 raft_consensus.cc:1275] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:38.660791 30617 raft_consensus.cc:2468] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
W20260709 13:08:38.657624 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 327874us
I20260709 13:08:38.588202 32226 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:38.759403 31114 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:38.672122 30472 raft_consensus.cc:2468] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 2.
W20260709 13:08:38.758781 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 184678us
I20260709 13:08:38.761303 30441 leader_election.cc:304] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:38.588477 32251 raft_consensus.cc:2749] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:38.661218 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 339731us
I20260709 13:08:38.673148 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:38.676329 30476 raft_consensus.cc:2393] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 3: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:38.610785 32176 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:38.710175 32277 log.cc:927] Time spent T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.076s	user 0.000s	sys 0.003s
I20260709 13:08:38.658916 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:38.663169 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:38.612028 32056 consensus_queue.cc:1048] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.101s
I20260709 13:08:38.682652 32227 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:38.751250 30546 raft_consensus.cc:2393] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 3: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:08:38.729022 32196 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.599910 32260 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:38.682878 32038 consensus_queue.cc:260] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:38.728349 32194 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:38.753734 32256 raft_consensus.cc:2749] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:38.730257 32164 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:38.768291 32204 consensus_meta.cc:287] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.583s	user 0.011s	sys 0.001s
I20260709 13:08:38.759322 32187 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:38.757287 32142 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:38.809732 30616 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 1.
I20260709 13:08:38.809728 32229 consensus_queue.cc:1048] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
W20260709 13:08:38.816010 32279 log.cc:927] Time spent T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
W20260709 13:08:38.817754 32281 log.cc:927] Time spent T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.379s	user 0.001s	sys 0.006s
I20260709 13:08:38.818446 32196 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:38.819754 32283 log.cc:927] Time spent T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:08:38.849601 32213 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:08:38.840801 32198 consensus_meta.cc:287] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.585s	user 0.005s	sys 0.005s
I20260709 13:08:38.850999 32194 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:38.852633 32264 raft_consensus.cc:2749] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:38.855662 32196 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:08:38.856366 32282 log.cc:927] Time spent T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:08:38.857851 32164 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:38.767544 32226 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:38.835336 32204 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:38.856274 32256 raft_consensus.cc:2804] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:38.805349 32043 raft_consensus.cc:2749] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:38.863127 31115 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.023s	sys 0.031s
W20260709 13:08:38.864166 31115 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.023s	sys 0.031s
W20260709 13:08:38.865792 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 520000us
I20260709 13:08:38.851684 32194 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:38.868340 32194 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:38.868547 31144 raft_consensus.cc:2468] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:08:38.869047 32182 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:38.870429 32194 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:38.870998 32182 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:08:38.864051 32252 consensus_meta.cc:287] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.695s	user 0.013s	sys 0.000s
I20260709 13:08:38.863154 32256 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:38.882561 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 276060us
I20260709 13:08:38.882277 32256 raft_consensus.cc:3060] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:38.917405 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:38.919978 30620 raft_consensus.cc:3060] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:38.847066 32142 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:38.946821 30516 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:38.936622 32260 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:38.926067 32194 consensus_queue.cc:1048] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:08:38.953770 30516 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
W20260709 13:08:38.962150 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 153102us
I20260709 13:08:38.963413 30620 raft_consensus.cc:2468] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 4.
I20260709 13:08:38.950302 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:38.968256 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:08:38.958441 32278 log.cc:927] Time spent T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.666s	user 0.004s	sys 0.000s
I20260709 13:08:38.952364 32196 raft_consensus.cc:2749] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:38.970901 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:38.973387 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:38.977056 30545 raft_consensus.cc:2468] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
I20260709 13:08:38.961637 32296 raft_consensus.cc:2804] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:38.980005 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
W20260709 13:08:38.984964 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 223719us
I20260709 13:08:38.986897 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:38.987645 30545 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
I20260709 13:08:38.999233 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:39.000082 30625 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6"
dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
mode: GRACEFUL
new_leader_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:49382
I20260709 13:08:39.000793 30625 raft_consensus.cc:606] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Received request to transfer leadership to TS 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:39.002084 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:38.978300 32287 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.960282 32250 consensus_queue.cc:1059] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:08:39.012629 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:39.038822 32287 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:39.039892 30545 raft_consensus.cc:1275] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:39.041054 30545 raft_consensus.cc:1275] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:39.013258 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:39.042130 30468 raft_consensus.cc:2468] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 1.
I20260709 13:08:39.042349 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:39.014261 31148 raft_consensus.cc:1275] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 2 LEARNER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:08:39.008621 32226 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:39.018102 32083 consensus_queue.cc:1048] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:39.022962 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:39.006505 32297 raft_consensus.cc:493] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.985651 32204 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:38.983058 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:38.971678 32260 consensus_queue.cc:1048] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:08:39.035126 32142 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:39.005775 32296 raft_consensus.cc:697] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
W20260709 13:08:39.219417 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 233687us
I20260709 13:08:39.276889 30441 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:39.279983 30440 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:39.280812 32164 raft_consensus.cc:2804] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:39.281271 32164 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:39.281719 32164 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:39.040987 32287 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:39.285651 32303 consensus_queue.cc:1048] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:08:39.292815 30441 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:39.304003 30441 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:39.258167 32294 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.308568 32301 raft_consensus.cc:2749] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:39.316711 30441 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:39.299048 32226 raft_consensus.cc:2749] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:39.322539 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 340148us
I20260709 13:08:39.325507 31116 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:39.310369 32305 raft_consensus.cc:2749] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:39.325270 32078 consensus_meta.cc:287] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.988s	user 0.005s	sys 0.007s
I20260709 13:08:39.322085 32301 raft_consensus.cc:2749] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:39.262447 32297 raft_consensus.cc:515] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:39.335676 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:39.344542 31142 raft_consensus.cc:2468] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
I20260709 13:08:39.335764 30441 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:39.337955 30622 raft_consensus.cc:1275] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:39.338595 32096 raft_consensus.cc:2749] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:39.349519 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:39.350332 30544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43088 (request call id 1476) took 1083 ms. Trace:
I20260709 13:08:39.350656 30544 rpcz_store.cc:276] 0709 13:08:38.267245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.275555 (+  8310us) service_pool.cc:224] Handling call
0709 13:08:39.349370 (+1073815us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b5800028598. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780e43b71 00007fc780e43a22 00007fc789d5cc09 00007fc788eb6ee0 00007fc788f800ab 00007fc788f80131 00007fc788f2e0a0 00007fc788f2d984 00007fc7824a86d4 00007fc7824a8662
0709 13:08:39.350275 (+   905us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28251904}
I20260709 13:08:39.312791 32303 consensus_queue.cc:1048] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:08:39.340996 30545 raft_consensus.cc:1275] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:39.314756 32294 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:39.341758 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:39.343792 32297 leader_election.cc:290] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:39.347410 32296 consensus_queue.cc:237] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:39.348677 32176 consensus_meta.cc:287] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.543s	user 0.006s	sys 0.004s
I20260709 13:08:39.353502 32164 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:39.355916 32260 raft_consensus.cc:2749] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:39.353561 31145 raft_consensus.cc:1275] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:39.358975 32176 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:39.361148 32176 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:39.361899 30623 raft_consensus.cc:2368] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 2. Current term is 4.
I20260709 13:08:39.362378 32164 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:39.341181 32078 raft_consensus.cc:2749] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 2. Current term is 3.
I20260709 13:08:39.371416 30441 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:39.372645 32264 raft_consensus.cc:2749] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:39.373039 30441 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:39.373867 32260 raft_consensus.cc:2749] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:39.374305 30441 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:39.375161 32260 raft_consensus.cc:2749] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:39.375543 30441 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:39.376492 32301 raft_consensus.cc:2804] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:39.376964 32301 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:39.377398 32301 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:39.383541 30441 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:39.384510 32264 raft_consensus.cc:3060] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:39.385213 31116 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:39.388019 32226 consensus_queue.cc:1048] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:39.388899 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:39.389525 30476 raft_consensus.cc:2468] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 4.
I20260709 13:08:39.390321 32164 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.390704 30441 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:39.390794 32164 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:39.391470 32293 raft_consensus.cc:2804] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:39.391852 32293 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:39.392208 32293 raft_consensus.cc:3060] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:39.393445 32164 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:39.396085 32264 raft_consensus.cc:2749] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:39.401547 32264 consensus_queue.cc:1048] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:39.404167 32293 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:39.406613 32293 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:39.406975 30546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43088 (request call id 1484) took 1079 ms. Trace:
I20260709 13:08:39.407536 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:39.408130 30617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47446 (request call id 1827) took 1064 ms. Trace:
I20260709 13:08:39.408517 30617 rpcz_store.cc:276] 0709 13:08:38.343895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.344015 (+   120us) service_pool.cc:224] Handling call
0709 13:08:39.407957 (+1063942us) spinlock_profiling.cc:243] Waited 36.6 ms on lock 0x7b5400195354. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:08:39.408069 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":84186880}
I20260709 13:08:39.407397 30546 rpcz_store.cc:276] 0709 13:08:38.327153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.327742 (+   589us) service_pool.cc:224] Handling call
0709 13:08:39.406765 (+1079023us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b54000d84d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:08:39.406911 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":966792064}
I20260709 13:08:39.412546 30440 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:39.413229 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:39.413386 30440 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:39.413810 30469 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:39.415398 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:39.415081 32301 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:39.416206 32264 raft_consensus.cc:2804] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:39.418927 32264 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:39.419147 30470 raft_consensus.cc:1275] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:39.419394 32264 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:39.422948 32305 raft_consensus.cc:2749] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:39.424422 30549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 1182) took 1149 ms. Trace:
I20260709 13:08:39.424765 30549 rpcz_store.cc:276] 0709 13:08:38.274523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.395164 (+120641us) service_pool.cc:224] Handling call
0709 13:08:38.425576 (+ 30412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:38.425837 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:38.425868 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:38.551444 (+125576us) log.cc:844] Serialized 26 byte log entry
0709 13:08:38.867015 (+315571us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:38.867065 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:38.867148 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:39.383871 (+516723us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b2400265178. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780d019c4 00007fc780cffacb 00007fc780ebadc9 00007fc780ebaa55 00007fc780eb9fb0 00007fc783b30488 00007fc783b30be8 00007fc783b08398 00007fc783b0376a 00007fc783b02bb6
0709 13:08:39.424136 (+ 40265us) raft_consensus.cc:1685] finished
0709 13:08:39.424155 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:39.424356 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":453063424,"thread_start_us":275489,"threads_started":1,"wal-append.queue_time_us":413046}
I20260709 13:08:39.427796 30516 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:39.429435 30469 raft_consensus.cc:2468] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 3.
I20260709 13:08:39.430995 30544 raft_consensus.cc:1275] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:39.431977 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:39.432510 30544 raft_consensus.cc:3060] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:39.434917 32089 raft_consensus.cc:2749] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:39.435070 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:39.437067 30476 raft_consensus.cc:1240] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:39.438396 32190 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:08:39.439456 32306 log.cc:927] Time spent T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 13:08:39.442143 30517 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:39.442031 32056 consensus_queue.cc:1048] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:39.444029 32261 raft_consensus.cc:2749] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:39.444789 32164 consensus_queue.cc:1048] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:39.445359 30618 raft_consensus.cc:2468] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 3.
I20260709 13:08:39.445444 32305 consensus_queue.cc:1048] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:39.444912 30440 leader_election.cc:304] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:39.446768 30618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47446 (request call id 1822) took 1104 ms. Trace:
I20260709 13:08:39.447089 30618 rpcz_store.cc:276] 0709 13:08:38.341975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.342100 (+   125us) service_pool.cc:224] Handling call
0709 13:08:39.446622 (+1104522us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54002de1d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:08:39.446719 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2494540160}
I20260709 13:08:39.448033 32305 raft_consensus.cc:2749] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:39.451170 32301 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:39.452859 32260 consensus_queue.cc:1048] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:39.358121 32294 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:39.457386 32254 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:39.457741 30543 raft_consensus.cc:1275] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 13:08:39.458170 32290 log.cc:927] Time spent T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.511s	user 0.000s	sys 0.002s
I20260709 13:08:39.458300 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:39.458984 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:39.496215 30545 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:39.399155 30589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.463920 31115 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:08:39.498320 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
W20260709 13:08:39.467967 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 82814.5us
I20260709 13:08:39.499083 31149 raft_consensus.cc:3060] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:39.500425 31116 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:39.504341 30467 raft_consensus.cc:1240] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:39.506575 30476 raft_consensus.cc:1275] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:39.510026 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:39.509294 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:39.512773 30467 raft_consensus.cc:1275] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:39.515062 30471 raft_consensus.cc:1275] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:08:39.469494 30619 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 3.
I20260709 13:08:39.472271 32072 raft_consensus.cc:2804] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:39.472172 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:39.467097 32300 raft_consensus.cc:493] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:39.473012 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:39.477784 30544 raft_consensus.cc:2468] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
W20260709 13:08:39.480263 32256 consensus_meta.cc:287] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.555s	user 0.009s	sys 0.000s
I20260709 13:08:39.484162 30517 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:08:39.489871 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 480004us
I20260709 13:08:39.520653 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
W20260709 13:08:39.521093 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 77321us
I20260709 13:08:39.521726 30517 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:39.522609 30517 leader_election.cc:304] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:39.523530 30517 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:08:39.520185 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 56363.5us
I20260709 13:08:39.525429 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:39.530754 30471 raft_consensus.cc:1275] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:08:39.532874 30590 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:39.533140 30470 raft_consensus.cc:1275] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:39.526921 30517 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:39.509305 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:39.499704 32254 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:39.525136 32256 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:39.530052 32250 raft_consensus.cc:2749] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:39.579804 32296 raft_consensus.cc:2749] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:39.525610 32056 raft_consensus.cc:2749] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:39.773749 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 238461us
I20260709 13:08:39.517654 32072 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:39.529381 32143 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.531924 31145 raft_consensus.cc:2410] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:08:39.529749 30542 raft_consensus.cc:1275] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:08:39.524885 32089 raft_consensus.cc:2749] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:39.580274 32156 raft_consensus.cc:2804] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:39.520087 32043 raft_consensus.cc:2804] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:39.529183 32299 raft_consensus.cc:2749] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:39.528985 32300 raft_consensus.cc:515] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:39.797945 32308 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:39.783409 31149 raft_consensus.cc:2468] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 4.
W20260709 13:08:39.785879 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 254375us
I20260709 13:08:39.792243 30548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 1181) took 1518 ms. Trace:
I20260709 13:08:39.793494 30517 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:08:39.794054 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 261236us
I20260709 13:08:39.785645 31143 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:39.821293 30516 leader_election.cc:336] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Timed out: RequestConsensusVote RPC to 127.28.173.3:32851 timed out after 1.525s (SENT)
I20260709 13:08:39.801390 30475 raft_consensus.cc:1240] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:08:39.784085 32301 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:08:39.791664 32311 log.cc:927] Time spent T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.255s	user 0.009s	sys 0.005s
I20260709 13:08:39.784561 32142 consensus_queue.cc:1048] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:08:39.798820 32072 raft_consensus.cc:3060] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:39.803062 30468 raft_consensus.cc:1240] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:08:39.782984 30545 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:08:39.803417 32248 raft_consensus.cc:2749] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:08:40.158872 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 378630us
I20260709 13:08:39.820113 32195 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:40.072535 32312 log.cc:927] Time spent T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.279s	user 0.000s	sys 0.000s
I20260709 13:08:39.811442 32287 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:39.828013 30625 raft_consensus.cc:1275] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:40.077015 32226 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:39.807222 32218 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:39.813374 32043 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:40.135524 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 318668us
I20260709 13:08:39.803838 32143 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:40.181893 32143 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:39.822861 30548 rpcz_store.cc:276] 0709 13:08:38.274304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.393611 (+119307us) service_pool.cc:224] Handling call
0709 13:08:38.393962 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:38.394188 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:38.394223 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:38.431536 (+ 37313us) log.cc:844] Serialized 26 byte log entry
0709 13:08:38.756329 (+324793us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:38.756385 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:38.756475 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:39.457839 (+701364us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b2400265178. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780d019c4 00007fc780cffacb 00007fc780ebadc9 00007fc780ebaa55 00007fc780eba09d 00007fc783aec10e 00007fc783b0388c 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221
0709 13:08:39.784999 (+327160us) raft_consensus.cc:1685] finished
0709 13:08:39.785023 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:39.792158 (+  7135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":565160320,"thread_start_us":174475,"threads_started":1,"wal-append.queue_time_us":366754}
I20260709 13:08:40.137317 30517 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
W20260709 13:08:40.183498 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 46298.8us
I20260709 13:08:40.135462 29364 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:08:40.189146 32298 consensus_queue.cc:1048] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:39.822365 32096 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:40.190717 32096 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:40.193545 32096 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:39.844748 32156 raft_consensus.cc:697] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:40.196754 32156 consensus_queue.cc:237] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:40.140780 32294 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.200696 32294 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:40.140961 32261 raft_consensus.cc:2749] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:40.143592 32183 raft_consensus.cc:493] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.140478 32293 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.840848 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:40.203464 32294 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:39.839685 32308 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:40.178038 30617 raft_consensus.cc:1240] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:40.212528 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:08:40.170585 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 349623us
I20260709 13:08:40.166350 32301 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:08:40.217592 32314 log.cc:927] Time spent T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:08:40.204802 32089 raft_consensus.cc:2749] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:40.213268 32143 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.219441 32143 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:40.219950 32218 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:40.221465 32143 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:40.222486 32218 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:40.177264 32226 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:40.225762 32222 consensus_queue.cc:1059] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:40.228356 32308 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:40.229280 32301 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:40.229841 32143 raft_consensus.cc:3055] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:40.230463 32143 raft_consensus.cc:740] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:40.236137 30547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 293) took 1270 ms. Trace:
I20260709 13:08:40.231508 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:40.238453 30545 raft_consensus.cc:2468] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 1.
I20260709 13:08:40.172164 32287 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:40.236325 32264 consensus_meta.cc:287] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.816s	user 0.031s	sys 0.026s
I20260709 13:08:40.236469 32143 consensus_queue.cc:260] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:40.207847 32043 raft_consensus.cc:3060] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:40.247975 30619 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47446 (request call id 1831) took 1898 ms (client timeout 1503 ms). Trace:
I20260709 13:08:40.236522 30547 rpcz_store.cc:276] 0709 13:08:38.966340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.966448 (+   108us) service_pool.cc:224] Handling call
0709 13:08:38.966748 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:38.967038 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:38.967066 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:38.974862 (+  7796us) log.cc:844] Serialized 26 byte log entry
0709 13:08:39.333579 (+358717us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:39.333604 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.333647 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:40.235886 (+902239us) raft_consensus.cc:1685] finished
0709 13:08:40.235912 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:40.236074 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":112,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":9368,"thread_start_us":299862,"threads_started":1,"wal-append.queue_time_us":511243}
W20260709 13:08:40.248764 30619 rpcz_store.cc:269] 0709 13:08:38.347389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.355530 (+  8141us) service_pool.cc:224] Handling call
0709 13:08:40.245338 (+1889808us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540027ea54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:08:40.245428 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2316254976}
I20260709 13:08:40.169603 32195 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:40.255182 32324 consensus_queue.cc:1048] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:40.261011 32072 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:40.253129 30441 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:40.277884 30441 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:40.238092 32293 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:40.216271 32183 raft_consensus.cc:515] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:40.306506 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:40.307541 30619 raft_consensus.cc:2393] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 4: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:08:40.312029 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:40.314265 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:40.315001 30622 raft_consensus.cc:2393] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 3: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:08:40.315158 32183 leader_election.cc:290] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:40.316416 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:40.317363 30616 raft_consensus.cc:2393] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 3: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:08:40.303277 32056 consensus_queue.cc:1048] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:08:40.319434 30372 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57542 (request call id 298) took 4869 ms. Trace:
I20260709 13:08:40.302081 32294 raft_consensus.cc:2749] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:40.320964 32056 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:40.324280 29364 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:08:40.326764 32318 log.cc:927] Time spent T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.160s	user 0.003s	sys 0.000s
I20260709 13:08:40.326860 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:40.328133 30547 raft_consensus.cc:2468] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:40.313040 30441 leader_election.cc:304] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:40.329397 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:40.332422 30619 raft_consensus.cc:1240] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:40.329429 31114 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:40.249665 32264 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:40.335651 31147 raft_consensus.cc:1240] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:40.338168 31147 raft_consensus.cc:1240] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:40.299031 32301 raft_consensus.cc:2749] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.300122 32302 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:40.337363 30441 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:40.350528 31147 raft_consensus.cc:1275] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:40.344389 30589 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:08:40.345070 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 171555us
W20260709 13:08:40.345459 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 160463us
I20260709 13:08:40.347239 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:40.359778 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:08:40.355559 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 195729us
I20260709 13:08:40.354259 30441 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:40.359387 30469 raft_consensus.cc:1240] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:40.366343 30624 raft_consensus.cc:2393] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 3: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:08:40.343061 32254 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:40.373167 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:40.368952 30517 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:40.348126 32256 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:40.324245 32056 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:40.343827 32327 raft_consensus.cc:2749] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:40.351328 32294 raft_consensus.cc:2804] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:40.400167 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:40.352558 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:40.358063 32083 raft_consensus.cc:2804] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:40.319796 30372 rpcz_store.cc:276] 0709 13:08:35.450181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.450447 (+   266us) service_pool.cc:224] Handling call
0709 13:08:35.572586 (+122139us) spinlock_profiling.cc:243] Waited 27.3 ms on lock 0x7b540008b954. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed2090 00007fc783f70f3a 00007fc789d271cc 00007fc789e2537e 00007fc7882e62a4 00007fc7882e6232 00007fc7882e6161 00007fc7882e60dc 00007fc7882e5392 00007fc7822a348c 00007fc7822a28c6
0709 13:08:40.319351 (+4746765us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:38.078015 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:38.078838 (+   823us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:38.078892 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:08:38.078910 (+    18us) tablet.cc:662] Decoding operations
0709 13:08:38.079615 (+   705us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:38.079715 (+   100us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:38.079755 (+    40us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:08:38.088298 (+  8543us) tablet.cc:701] Row locks acquired
0709 13:08:38.088328 (+    30us) write_op.cc:260] PREPARE: finished
0709 13:08:38.088521 (+   193us) write_op.cc:270] Start()
0709 13:08:38.088687 (+   166us) write_op.cc:276] Timestamp: P: 1783602518088460 usec, L: 0
0709 13:08:38.088720 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:08:38.218043 (+129323us) log.cc:844] Serialized 1308 byte log entry
0709 13:08:38.553021 (+334978us) op_driver.cc:464] REPLICATION: finished
0709 13:08:38.936808 (+383787us) write_op.cc:301] APPLY: starting
0709 13:08:38.938473 (+  1665us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:38.948053 (+  9580us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:38.959339 (+ 11286us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:39.026661 (+ 67322us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:39.026844 (+   183us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:08:39.026894 (+    50us) write_op.cc:312] APPLY: finished
0709 13:08:39.027116 (+   222us) log.cc:844] Serialized 35 byte log entry
0709 13:08:39.027281 (+   165us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:39.027379 (+    98us) write_op.cc:454] Released schema lock
0709 13:08:39.027420 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:39.027825 (+   405us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:39.027864 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4356,"reported_tablets":9,"spinlock_wait_cycles":62828544,"child_traces":[["op",{"apply.queue_time_us":367660,"apply.run_cpu_time_us":2720,"apply.run_wall_time_us":100110,"num_ops":3,"prepare.queue_time_us":120752,"prepare.run_cpu_time_us":3998,"prepare.run_wall_time_us":207429,"replication_time_us":334922,"spinlock_wait_cycles":2432,"thread_start_us":283098,"threads_started":2}]]}
I20260709 13:08:40.377516 31114 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:08:40.405944 31150 raft_consensus.cc:1240] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:08:40.368999 32301 raft_consensus.cc:2804] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:40.410074 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:40.415115 30624 raft_consensus.cc:2393] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 3: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:08:40.349203 32142 consensus_queue.cc:1048] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:08:40.418994 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:40.419199 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:40.420042 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:40.373703 32224 raft_consensus.cc:2749] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:40.422178 30621 raft_consensus.cc:2393] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 3: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:08:40.403219 32294 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:40.427249 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:40.351009 32302 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:40.375250 32089 consensus_queue.cc:1059] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:08:40.428004 30624 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 6.
I20260709 13:08:40.375260 32261 consensus_queue.cc:1059] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
W20260709 13:08:40.431685 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 59454.1us
I20260709 13:08:40.419543 30616 raft_consensus.cc:1275] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:08:40.429409 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 56644.9us
I20260709 13:08:40.445323 30589 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:08:40.436666 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 70225.7us
I20260709 13:08:40.444741 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:40.402681 32192 consensus_queue.cc:1048] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:08:40.422894 32083 raft_consensus.cc:697] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:40.455298 32328 consensus_queue.cc:1048] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:08:40.433305 32325 raft_consensus.cc:2804] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:40.430002 32294 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:40.467440 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 90009.2us
I20260709 13:08:40.469228 32301 raft_consensus.cc:697] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 4 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:40.470304 32301 consensus_queue.cc:237] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:40.473417 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 104569us
I20260709 13:08:40.428097 32324 consensus_queue.cc:1048] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:08:40.435058 32096 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:40.436338 32252 raft_consensus.cc:2804] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:40.477914 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:40.444548 32327 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:40.482477 30475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 1256) took 1072 ms. Trace:
I20260709 13:08:40.485743 30475 rpcz_store.cc:276] 0709 13:08:39.409943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.410090 (+   147us) service_pool.cc:224] Handling call
0709 13:08:39.410451 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:40.139179 (+728728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.482216 (+343037us) spinlock_profiling.cc:243] Waited 391 ms on lock 0x7b54003d2f54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:40.482421 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":898364160}
I20260709 13:08:40.468197 32325 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:40.467988 32287 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:40.486347 30589 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:40.459528 32296 consensus_queue.cc:1048] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:08:40.477454 32183 consensus_queue.cc:1048] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:08:40.486266 32195 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:40.484269 32248 consensus_queue.cc:1048] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.189s
W20260709 13:08:40.497371 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 49368.7us
I20260709 13:08:40.496691 32342 consensus_queue.cc:1059] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.187s
I20260709 13:08:40.646209 32348 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:40.675319 30591 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:40.487460 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:40.683844 30591 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:40.511163 30545 raft_consensus.cc:2468] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
I20260709 13:08:40.681579 32348 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:40.687549 32316 log.cc:927] Time spent T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.533s	user 0.001s	sys 0.000s
I20260709 13:08:40.688113 32348 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:40.688694 30472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 1257) took 1277 ms. Trace:
I20260709 13:08:40.688645 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:40.689383 30543 raft_consensus.cc:2468] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 6.
W20260709 13:08:40.613884 32334 log.cc:927] Time spent T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.181s	user 0.001s	sys 0.001s
I20260709 13:08:40.689128 30472 rpcz_store.cc:276] 0709 13:08:39.410926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.432850 (+ 21924us) service_pool.cc:224] Handling call
0709 13:08:39.433196 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:39.433531 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:39.433558 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:39.433973 (+   415us) log.cc:844] Serialized 26 byte log entry
0709 13:08:39.534738 (+100765us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:39.534775 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.534836 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:40.686983 (+1152147us) spinlock_profiling.cc:243] Waited 8.3 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:08:40.688399 (+  1416us) raft_consensus.cc:1685] finished
0709 13:08:40.688423 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:40.688642 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1035,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":99,"spinlock_wait_cycles":19098880,"thread_start_us":100410,"threads_started":1,"wal-append.queue_time_us":375556}
W20260709 13:08:40.691843 32317 log.cc:927] Time spent T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.538s	user 0.001s	sys 0.000s
I20260709 13:08:40.694169 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:40.695289 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:08:40.696404 32335 log.cc:927] Time spent T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.209s	user 0.000s	sys 0.000s
I20260709 13:08:40.681756 32248 consensus_queue.cc:1048] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:08:40.697809 31144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48412 (request call id 420) took 1213 ms. Trace:
I20260709 13:08:40.698817 32297 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:40.694216 32302 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:40.565384 32083 consensus_queue.cc:237] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:40.700352 32332 raft_consensus.cc:3055] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:40.701536 32142 raft_consensus.cc:2749] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:40.703336 32332 raft_consensus.cc:740] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:40.653944 32264 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:08:40.704519 30623 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47446 (request call id 1821) took 2363 ms (client timeout 1525 ms). Trace:
I20260709 13:08:40.704262 32332 consensus_queue.cc:260] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:40.704903 30623 rpcz_store.cc:269] 0709 13:08:38.341606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.341746 (+   140us) service_pool.cc:224] Handling call
0709 13:08:40.704306 (+2362560us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54001e3f54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:08:40.704423 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2317408640}
I20260709 13:08:40.705520 32056 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:40.699574 32297 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:40.706125 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:40.560768 32293 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:40.707322 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:40.707912 32297 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:40.697281 32198 raft_consensus.cc:3055] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:40.708549 32198 raft_consensus.cc:740] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:40.708670 32043 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:40.709915 31148 raft_consensus.cc:2393] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 5: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:08:40.709470 32198 consensus_queue.cc:260] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:40.710794 32043 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:40.710875 32198 raft_consensus.cc:3060] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:40.712098 31148 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48412 (request call id 418) took 1246 ms (client timeout 1638 ms). Trace:
I20260709 13:08:40.712345 32294 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:40.707072 32327 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:40.713984 30440 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:08:40.834923 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 120992us
I20260709 13:08:40.835868 30440 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:40.712579 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:40.714651 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:40.841964 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
W20260709 13:08:40.712574 31148 rpcz_store.cc:269] 0709 13:08:39.466088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.466357 (+   269us) service_pool.cc:224] Handling call
0709 13:08:40.711911 (+1245554us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54006eee54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:08:40.712042 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2740461824}
I20260709 13:08:40.696161 30546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 1184) took 1266 ms. Trace:
I20260709 13:08:40.685400 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:40.844451 30546 rpcz_store.cc:276] 0709 13:08:39.429627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.437236 (+  7609us) service_pool.cc:224] Handling call
0709 13:08:39.437572 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:39.437944 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:39.437981 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:39.438463 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 13:08:39.526609 (+ 88146us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:39.526675 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.526762 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:40.691300 (+1164538us) spinlock_profiling.cc:243] Waited 8.36 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:08:40.695868 (+  4568us) raft_consensus.cc:1685] finished
0709 13:08:40.695886 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:40.696105 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1255,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":123,"spinlock_wait_cycles":19225472,"thread_start_us":87713,"threads_started":1,"wal-append.queue_time_us":363806}
I20260709 13:08:40.717497 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:40.712163 30551 raft_consensus.cc:1275] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:40.718216 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:08:40.717260 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 230987us
I20260709 13:08:40.719050 30550 raft_consensus.cc:1240] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:08:40.720351 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:40.705525 32332 raft_consensus.cc:3060] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.612183 32350 raft_consensus.cc:1064] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326: attempting to promote NON_VOTER cd669586cff44d4bbfcc007e213faab6 to VOTER
I20260709 13:08:40.724395 32324 raft_consensus.cc:2804] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:40.725982 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:40.555233 32252 raft_consensus.cc:697] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 3 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:40.554651 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:40.698246 31144 rpcz_store.cc:276] 0709 13:08:39.484833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.489040 (+  4207us) service_pool.cc:224] Handling call
0709 13:08:40.235011 (+745971us) spinlock_profiling.cc:243] Waited 5.97 ms on lock 0x7b5800003998. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780e43f8c 00007fc780e43ef6 0000000000375939 00007fc788eb71e0 00007fc788f800c4 00007fc788f80131 00007fc788f41fc0 00007fc788f2c929 00007fc788f2c3d2 00007fc7824a3bd4
0709 13:08:40.235176 (+   165us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:40.235620 (+   444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:40.235663 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:40.303146 (+ 67483us) log.cc:844] Serialized 26 byte log entry
0709 13:08:40.461264 (+158118us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:40.466421 (+  5157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.478724 (+ 12303us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:40.697487 (+218763us) raft_consensus.cc:1685] finished
0709 13:08:40.697515 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:40.697733 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3768,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":5965,"spinlock_wait_cycles":13725568,"thread_start_us":132431,"threads_started":1,"wal-append.queue_time_us":139582}
W20260709 13:08:40.752873 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 69104.6us
I20260709 13:08:40.500005 31143 raft_consensus.cc:2468] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 4.
I20260709 13:08:40.487452 32096 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:40.869835 31149 raft_consensus.cc:1240] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:40.556828 32256 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:40.613132 32261 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:40.752735 32219 raft_consensus.cc:2749] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:40.482204 32339 raft_consensus.cc:2804] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:40.740671 32195 consensus_queue.cc:1048] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:08:40.863011 32285 raft_consensus.cc:493] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:40.840701 32330 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:40.848351 30549 raft_consensus.cc:2468] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 1.
I20260709 13:08:40.908898 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:08:40.844286 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.855103 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:40.857972 30473 raft_consensus.cc:2468] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 3.
I20260709 13:08:40.863344 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:40.869990 31150 raft_consensus.cc:1240] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:08:40.684345 32325 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:40.871136 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:40.874562 30622 raft_consensus.cc:1240] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 LEADER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:40.856056 32038 raft_consensus.cc:3060] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:40.876533 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:40.877348 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:08:40.879202 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 504934us
I20260709 13:08:40.862923 32324 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:40.867959 32250 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:40.840399 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:08:40.950313 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 103980us
I20260709 13:08:40.891582 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:40.891772 30474 raft_consensus.cc:1240] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 13:08:40.951160 30475 raft_consensus.cc:2468] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 3.
I20260709 13:08:40.891588 30441 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:40.895668 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:40.898116 31148 raft_consensus.cc:1275] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:08:40.898186 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:40.904310 30543 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
I20260709 13:08:40.878521 31143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48412 (request call id 422) took 1376 ms. Trace:
I20260709 13:08:40.910715 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:40.846969 32344 raft_consensus.cc:493] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.944427 32342 consensus_queue.cc:1243] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer cd669586cff44d4bbfcc007e213faab6 log is divergent from this leader: its last log entry 4.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:08:40.875784 32331 consensus_queue.cc:1059] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.105s
I20260709 13:08:40.981626 31148 pending_rounds.cc:85] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6: Aborting all ops after (but not including) 4
I20260709 13:08:40.920666 30617 raft_consensus.cc:2393] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 2: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:08:41.080036 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:40.950220 32089 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:40.916872 30551 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 2.
I20260709 13:08:40.952052 30476 raft_consensus.cc:3060] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:41.083542 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:40.883415 32213 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:40.880455 32354 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:40.894119 32297 raft_consensus.cc:2804] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:08:41.091385 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 218634us
I20260709 13:08:41.005692 32096 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:41.007877 32327 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:40.879751 32256 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:40.986720 31143 rpcz_store.cc:276] 0709 13:08:39.496652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.500093 (+  3441us) service_pool.cc:224] Handling call
0709 13:08:40.873248 (+1373155us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:41.014919 32360 raft_consensus.cc:2804] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:08:41.016438 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.878012 32328 consensus_queue.cc:1048] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 13:08:41.087000 30467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 1276) took 1556 ms. Trace:
I20260709 13:08:41.095101 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:40.882565 32261 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:41.089138 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 222503us
I20260709 13:08:40.990532 32250 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:41.081518 32324 raft_consensus.cc:3060] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:41.128187 30467 rpcz_store.cc:276] 0709 13:08:39.530563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.530693 (+   130us) service_pool.cc:224] Handling call
0709 13:08:39.780809 (+250116us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:40.217582 (+436773us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:40.217612 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:40.217651 (+    39us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:40.217679 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.086715 (+869036us) spinlock_profiling.cc:243] Waited 437 ms on lock 0x7b540010efd4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:41.086772 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.086934 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1004042112}
I20260709 13:08:41.128217 30617 raft_consensus.cc:2376] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4. Re-sending same reply.
I20260709 13:08:41.081202 31148 pending_rounds.cc:107] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:08:40.920228 32330 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:41.090408 32339 raft_consensus.cc:697] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:40.916270 32285 raft_consensus.cc:515] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:41.145876 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 254351us
I20260709 13:08:41.151003 32367 raft_consensus.cc:493] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:41.020298 32355 consensus_queue.cc:1059] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.144s
I20260709 13:08:41.028278 32344 raft_consensus.cc:515] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:41.085891 32089 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:41.093351 32357 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:41.158869 30441 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:41.124939 32360 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:41.131237 32362 raft_consensus.cc:493] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:41.153009 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:41.132469 32195 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:41.182207 32374 consensus_queue.cc:1059] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:08:41.182260 32195 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:41.183171 32261 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:41.091104 32213 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:41.170562 32250 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:41.170953 32089 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:41.178735 30621 raft_consensus.cc:1275] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:08:41.230125 30621 pending_rounds.cc:85] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79: Aborting all ops after (but not including) 1
I20260709 13:08:41.230538 30621 pending_rounds.cc:107] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:08:41.230873 30621 raft_consensus.cc:2889] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:41.144940 31148 raft_consensus.cc:2889] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:41.082260 32252 consensus_queue.cc:237] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:41.150703 32342 raft_consensus.cc:3060] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:41.190841 30476 raft_consensus.cc:2468] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 5.
I20260709 13:08:41.226923 32198 consensus_queue.cc:1059] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:08:41.272046 32339 consensus_queue.cc:237] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:41.092821 32354 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:41.364311 32294 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:41.276633 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:41.392963 32294 raft_consensus.cc:2749] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:41.393376 30551 raft_consensus.cc:2410] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:41.180382 32360 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:41.344025 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 217015us
W20260709 13:08:41.366458 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 215444us
I20260709 13:08:41.020015 30616 raft_consensus.cc:2376] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 3. Re-sending same reply.
I20260709 13:08:41.397168 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:41.399155 30616 raft_consensus.cc:1240] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:08:41.348161 32374 consensus_queue.cc:1059] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.102s
I20260709 13:08:41.202101 32362 raft_consensus.cc:515] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:41.363737 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:41.234122 32355 raft_consensus.cc:3055] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:41.404286 32355 raft_consensus.cc:740] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:41.405254 32355 consensus_queue.cc:260] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:41.226753 32038 consensus_queue.cc:1059] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.180s
I20260709 13:08:41.403640 32362 leader_election.cc:290] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:08:41.364427 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 205654us
I20260709 13:08:41.408653 30441 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:41.180904 32367 raft_consensus.cc:515] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:41.403602 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 236527us
I20260709 13:08:41.421679 32367 leader_election.cc:290] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:41.180681 32357 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:41.231894 32254 raft_consensus.cc:493] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.414146 32078 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.422322 32294 raft_consensus.cc:2749] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:41.434650 30516 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:41.428514 30441 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:41.433450 32365 consensus_queue.cc:1048] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:08:41.364074 32356 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.442049 32356 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:41.364715 32359 log.cc:927] Time spent T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 13:08:41.438556 30516 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:08:41.445945 32299 raft_consensus.cc:2804] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:41.446535 32299 raft_consensus.cc:697] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 3 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:41.447721 32299 consensus_queue.cc:237] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:41.450350 32262 raft_consensus.cc:493] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:41.450924 32262 raft_consensus.cc:515] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:41.454252 30441 leader_election.cc:304] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:41.434932 32250 consensus_queue.cc:1048] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:08:41.345542 32302 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.455380 30621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36130 (request call id 1502) took 1108 ms. Trace:
I20260709 13:08:41.458606 32198 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:41.459421 30621 rpcz_store.cc:276] 0709 13:08:40.347159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.426651 (+ 79492us) service_pool.cc:224] Handling call
0709 13:08:40.444337 (+ 17686us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:41.231416 (+787079us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.455155 (+223739us) spinlock_profiling.cc:243] Waited 734 ms on lock 0x7b5400202e54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:41.455331 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1688025856}
I20260709 13:08:41.460942 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:41.455988 30441 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:41.461488 30621 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
I20260709 13:08:41.465392 30441 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:41.460182 32198 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:41.469408 30441 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:41.470369 32366 raft_consensus.cc:2749] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:41.470691 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:41.482923 30621 raft_consensus.cc:2393] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 3: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:08:41.466229 32302 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:41.475517 32262 leader_election.cc:290] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:41.476548 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:41.491801 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:41.477784 32213 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:41.452917 32298 raft_consensus.cc:2749] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:41.486068 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:41.499773 30621 raft_consensus.cc:2468] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 2.
I20260709 13:08:41.500037 32072 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:41.500833 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:41.502135 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:41.508090 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:41.509029 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:08:41.510571 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.437155 32254 raft_consensus.cc:515] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:08:41.487905 32358 log.cc:927] Time spent T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.372s	user 0.001s	sys 0.000s
I20260709 13:08:41.521714 32226 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:41.521864 32300 leader_election.cc:290] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:08:41.488399 32361 log.cc:927] Time spent T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.287s	user 0.001s	sys 0.000s
I20260709 13:08:41.489066 32195 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:41.493991 30441 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:41.530555 30441 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:41.458886 32367 raft_consensus.cc:2749] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:41.498181 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:41.487305 32302 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:41.440595 32078 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:41.467801 32294 raft_consensus.cc:2749] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:41.517117 32256 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:41.519121 32360 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:41.484802 32365 raft_consensus.cc:2804] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:41.476555 32330 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:41.454792 32353 consensus_queue.cc:1059] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:08:41.534052 31114 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:41.534682 30441 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:41.537763 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:41.538797 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:41.576327 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:41.574523 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:41.583945 32294 consensus_queue.cc:1048] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:41.585685 32294 raft_consensus.cc:2804] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:41.586033 32294 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:41.586395 32294 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:41.583016 30551 raft_consensus.cc:2468] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 5.
W20260709 13:08:41.598441 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 66662.6us
I20260709 13:08:41.603317 31114 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:08:41.588255 31116 leader_election.cc:304] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:41.513985 32301 raft_consensus.cc:2749] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:41.605374 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:41.605805 30618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47446 (request call id 1833) took 1776 ms. Trace:
I20260709 13:08:41.609193 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:41.611610 30517 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:41.615635 30618 rpcz_store.cc:276] 0709 13:08:39.816344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.816463 (+   119us) service_pool.cc:224] Handling call
0709 13:08:40.135629 (+319166us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:40.223244 (+ 87615us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:40.223288 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:40.223341 (+    53us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:40.223385 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.592000 (+1368615us) spinlock_profiling.cc:243] Waited 87.4 ms on lock 0x7b54001e3a54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:41.592056 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.592201 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":200933248}
I20260709 13:08:41.538410 32226 raft_consensus.cc:2749] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:41.561057 31148 raft_consensus.cc:1240] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:41.511986 32357 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:41.566654 32353 raft_consensus.cc:3055] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:41.627769 32353 raft_consensus.cc:740] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:41.628690 32198 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:41.628604 32353 consensus_queue.cc:260] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:41.597661 32366 consensus_queue.cc:1059] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:08:41.597880 32330 raft_consensus.cc:2749] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:41.631345 32366 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:41.631837 32366 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:41.631894 32298 consensus_queue.cc:1059] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:41.619274 32301 raft_consensus.cc:2749] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:41.620442 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:41.565544 32360 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:41.565744 32365 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:41.622155 32309 raft_consensus.cc:2804] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:41.563177 32078 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:41.606771 32256 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:41.625245 32349 log.cc:927] Time spent T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.944s	user 0.019s	sys 0.007s
I20260709 13:08:41.626137 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:41.627266 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:41.634778 32250 raft_consensus.cc:2804] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:41.635433 32366 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:41.621275 32072 raft_consensus.cc:2804] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:41.549294 32354 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:41.614399 32367 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:41.636891 32353 raft_consensus.cc:3060] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:41.649075 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:41.646303 32250 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:41.640866 32365 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:41.658259 32337 log.cc:927] Time spent T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.879s	user 0.003s	sys 0.003s
I20260709 13:08:41.658351 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:41.659408 32250 raft_consensus.cc:3060] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:41.659502 31142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48412 (request call id 419) took 2176 ms. Trace:
I20260709 13:08:41.659674 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:41.660807 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:41.660058 31142 rpcz_store.cc:276] 0709 13:08:39.483605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.488885 (+  5280us) service_pool.cc:224] Handling call
0709 13:08:40.320942 (+832057us) spinlock_profiling.cc:243] Waited 6.47 ms on lock 0x7b5800003998. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780e43b71 00007fc780e43eee 0000000000375939 00007fc788eb71e0 00007fc788f800c4 00007fc788f80131 00007fc788f41fc0 00007fc788f2c929 00007fc788f2c3d2 00007fc7824a3bd4
0709 13:08:40.321074 (+   132us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:40.321284 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:40.321312 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:40.321801 (+   489us) log.cc:844] Serialized 26 byte log entry
0709 13:08:40.431135 (+109334us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:40.432013 (+   878us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.445546 (+ 13533us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:41.524957 (+1079411us) spinlock_profiling.cc:243] Waited 5.03 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:08:41.659255 (+134298us) raft_consensus.cc:1685] finished
0709 13:08:41.659277 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.659422 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26452096,"thread_start_us":96881,"threads_started":1,"wal-append.queue_time_us":324586}
I20260709 13:08:41.661989 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:41.662252 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:41.662998 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:41.632682 32324 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:41.663506 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:41.665565 32324 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:41.652846 32360 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:41.666895 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:41.666857 32360 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:41.668923 32360 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:41.656647 30441 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:41.646944 32309 raft_consensus.cc:493] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:41.648595 32072 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:41.654132 32325 consensus_meta.cc:287] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.705s	user 0.010s	sys 0.000s
I20260709 13:08:41.682482 30440 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:41.638315 32356 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:41.685523 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:41.688323 30517 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:41.689996 30440 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:41.678655 32366 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:08:41.672689 32297 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.045s	sys 0.105s
W20260709 13:08:41.700712 32297 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.046s	sys 0.105s
I20260709 13:08:41.701349 32297 raft_consensus.cc:697] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:41.703500 32297 consensus_queue.cc:237] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:41.647181 32256 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:41.710587 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:41.711386 30469 raft_consensus.cc:2468] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 2.
I20260709 13:08:41.716197 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:41.716995 30467 raft_consensus.cc:2468] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
I20260709 13:08:41.682709 32309 raft_consensus.cc:3060] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:41.684515 32072 raft_consensus.cc:3060] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:41.719745 32366 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:41.655318 32367 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:41.712387 32332 consensus_meta.cc:287] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.849s	user 0.011s	sys 0.000s
I20260709 13:08:41.692605 32285 leader_election.cc:290] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:41.694772 32296 raft_consensus.cc:2749] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:41.715417 32342 raft_consensus.cc:2749] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:41.721477 31142 raft_consensus.cc:1275] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:08:41.871496 31146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48412 (request call id 424) took 1499 ms. Trace:
I20260709 13:08:41.692459 32325 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:41.872061 31146 rpcz_store.cc:276] 0709 13:08:40.371786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.371956 (+   170us) service_pool.cc:224] Handling call
0709 13:08:40.372292 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:40.444551 (+ 72259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:40.444596 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:40.444638 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:40.444676 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.871176 (+1426500us) spinlock_profiling.cc:243] Waited 72 ms on lock 0x7b540045f454. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:41.871235 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.871411 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":165570304}
I20260709 13:08:41.834918 32224 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:41.838595 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:41.842473 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:41.894556 31144 raft_consensus.cc:1240] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 1. Current term is 2. Ops: []
W20260709 13:08:41.908901 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.882784 32342 raft_consensus.cc:2804] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:41.945030 32325 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:41.945953 32378 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:41.908578 32355 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:41.946537 32378 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:41.935096 32256 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:41.888409 32360 consensus_queue.cc:1059] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:08:41.964794 32078 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.949424 32342 raft_consensus.cc:697] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 4 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:41.968228 32078 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:41.982101 30550 raft_consensus.cc:2468] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 2.
I20260709 13:08:41.984864 32326 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:41.888970 32224 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:41.985447 32326 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:41.975888 32256 raft_consensus.cc:2804] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:41.978327 32360 raft_consensus.cc:2804] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:41.977042 32365 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:42.015556 30476 raft_consensus.cc:1240] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:08:41.977682 30543 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.017s	sys 0.036s
I20260709 13:08:42.001767 32256 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:08:42.244418 30616 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.841s	user 0.012s	sys 0.032s
I20260709 13:08:42.247555 32256 raft_consensus.cc:3060] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:42.248538 30616 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.846s	user 0.012s	sys 0.032s
W20260709 13:08:42.212266 32250 consensus_meta.cc:287] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.552s	user 0.007s	sys 0.002s
W20260709 13:08:42.107534 32341 log.cc:927] Time spent T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 1.453s	user 0.007s	sys 0.009s
I20260709 13:08:42.083878 32262 raft_consensus.cc:3055] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:08:42.244519 30549 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.812s	user 0.018s	sys 0.021s
I20260709 13:08:42.013051 32360 raft_consensus.cc:697] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
W20260709 13:08:42.182667 32294 consensus_meta.cc:287] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.596s	user 0.008s	sys 0.003s
W20260709 13:08:42.252982 32038 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.839s	user 0.011s	sys 0.027s
I20260709 13:08:42.182037 32353 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:42.016783 32365 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:08:42.244776 30543 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.011s	user 0.017s	sys 0.041s
W20260709 13:08:42.259711 30549 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.828s	user 0.018s	sys 0.021s
I20260709 13:08:42.225942 32143 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:42.258419 32174 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.753s	user 0.003s	sys 0.023s
I20260709 13:08:42.222469 32309 raft_consensus.cc:515] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:42.228138 32072 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:42.256165 32224 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:08:42.262085 32252 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.007s	sys 0.021s
W20260709 13:08:42.264941 32339 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.844s	user 0.015s	sys 0.025s
I20260709 13:08:42.245010 32366 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:42.259681 32262 raft_consensus.cc:740] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:42.013998 32367 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:42.117735 32261 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:42.263226 32038 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.856s	user 0.011s	sys 0.027s
W20260709 13:08:42.277041 32299 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.805s	user 0.048s	sys 0.111s
I20260709 13:08:42.264058 31145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48426 (request call id 452) took 1936 ms. Trace:
W20260709 13:08:42.280506 32259 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.631s	user 0.025s	sys 0.028s
I20260709 13:08:42.256795 32250 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:08:42.280369 32174 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.775s	user 0.003s	sys 0.024s
W20260709 13:08:42.282860 32252 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.803s	user 0.007s	sys 0.021s
W20260709 13:08:42.303757 31116 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.014s	sys 0.018s
W20260709 13:08:42.305495 31114 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.020s	sys 0.013s
I20260709 13:08:42.264380 32294 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:42.047117 32342 consensus_queue.cc:237] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:42.302863 30546 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.770s	user 0.002s	sys 0.026s
I20260709 13:08:42.301848 32326 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:08:42.312980 31116 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.015s	sys 0.018s
W20260709 13:08:42.316814 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 703878us
W20260709 13:08:42.302726 32339 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.882s	user 0.018s	sys 0.028s
W20260709 13:08:42.306959 32299 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.835s	user 0.049s	sys 0.112s
I20260709 13:08:42.280224 32378 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:42.278472 32353 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:08:42.302809 32348 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.014s	sys 0.014s
W20260709 13:08:42.308270 32259 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.659s	user 0.025s	sys 0.029s
W20260709 13:08:42.316268 30546 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.002s	sys 0.026s
W20260709 13:08:42.314160 31114 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.020s	sys 0.013s
W20260709 13:08:42.367992 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 755242us
I20260709 13:08:42.369102 31114 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:08:42.303295 32379 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.320529 31116 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:08:42.372262 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 51833.2us
I20260709 13:08:42.372133 32379 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:42.374228 32379 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:42.375293 32224 raft_consensus.cc:2804] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:08:42.308622 32327 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.020s	sys 0.043s
I20260709 13:08:42.375831 32224 raft_consensus.cc:697] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
W20260709 13:08:42.375982 32327 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.020s	sys 0.043s
I20260709 13:08:42.377012 32321 raft_consensus.cc:2804] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:42.376765 32224 consensus_queue.cc:237] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:42.377481 32321 raft_consensus.cc:697] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 5 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:42.378361 32321 consensus_queue.cc:237] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:42.321761 30625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47446 (request call id 1842) took 1990 ms. Trace:
I20260709 13:08:42.323640 30623 raft_consensus.cc:1240] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 LEADER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:08:42.380714 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:42.382253 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:42.382898 30547 raft_consensus.cc:3060] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:42.323272 32262 consensus_queue.cc:260] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:42.306849 31145 rpcz_store.cc:276] 0709 13:08:40.328192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.333795 (+  5603us) service_pool.cc:224] Handling call
0709 13:08:40.361619 (+ 27824us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:40.464495 (+102876us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:40.466317 (+  1822us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:40.476246 (+  9929us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:40.476319 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.261593 (+1785274us) spinlock_profiling.cc:243] Waited 90.2 ms on lock 0x7b5400715a54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:42.261661 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:42.263996 (+  2335us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":207537408}
I20260709 13:08:42.336658 32381 raft_consensus.cc:3055] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:42.379958 30625 rpcz_store.cc:276] 0709 13:08:40.331535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.331659 (+   124us) service_pool.cc:224] Handling call
0709 13:08:40.332310 (+   651us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:40.332736 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:40.332771 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:40.350243 (+ 17472us) log.cc:844] Serialized 556 byte log entry
0709 13:08:40.432395 (+ 82152us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:40.432417 (+    22us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.432462 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:42.088367 (+1655905us) spinlock_profiling.cc:243] Waited 7.53 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:08:42.317708 (+229341us) raft_consensus.cc:1685] finished
0709 13:08:42.317738 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:42.321670 (+  3932us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17327872,"thread_start_us":63739,"threads_started":1,"wal-append.queue_time_us":146094}
I20260709 13:08:42.384163 32381 raft_consensus.cc:740] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:42.340279 32254 leader_election.cc:290] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133)
I20260709 13:08:42.341887 32072 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:42.346038 32294 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:42.349979 32309 leader_election.cc:290] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:42.314052 32078 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:42.350605 30472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 241) took 1639 ms. Trace:
I20260709 13:08:42.400813 30472 rpcz_store.cc:276] 0709 13:08:40.711048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.718850 (+  7802us) service_pool.cc:224] Handling call
0709 13:08:40.837475 (+118625us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:41.148565 (+311090us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:41.148593 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:41.148635 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:41.148666 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.350330 (+1201664us) spinlock_profiling.cc:243] Waited 311 ms on lock 0x7b54001761d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:42.350381 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:42.350536 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":715057408}
I20260709 13:08:42.312760 32261 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:42.318594 32360 consensus_queue.cc:237] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:42.361024 32256 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:42.380816 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:42.325804 32250 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:42.414134 32353 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:08:42.368166 32348 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.014s	sys 0.014s
I20260709 13:08:42.384451 32262 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:42.402383 30545 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.015s	sys 0.045s
W20260709 13:08:42.429637 30545 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.016s	sys 0.045s
W20260709 13:08:42.432134 30439 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.815s	user 0.020s	sys 0.035s
W20260709 13:08:42.436167 30439 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.819s	user 0.020s	sys 0.035s
I20260709 13:08:42.442973 30624 raft_consensus.cc:2468] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 4.
I20260709 13:08:42.428349 32183 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.446403 30472 raft_consensus.cc:3055] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:42.448891 30472 raft_consensus.cc:740] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:42.457283 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:42.458122 30473 raft_consensus.cc:2468] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 1.
I20260709 13:08:42.460484 32089 raft_consensus.cc:3055] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:42.460175 30472 consensus_queue.cc:260] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:42.460994 32089 raft_consensus.cc:740] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:42.461604 30472 raft_consensus.cc:3060] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:42.462030 32089 consensus_queue.cc:260] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:42.463516 32089 raft_consensus.cc:3060] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:42.444023 32356 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.465341 31115 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:42.469209 30542 raft_consensus.cc:1240] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:08:42.399945 32381 consensus_queue.cc:260] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:42.449031 32056 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:08:42.478363 30442 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.022s	sys 0.027s
W20260709 13:08:42.488075 30442 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.915s	user 0.022s	sys 0.027s
I20260709 13:08:42.479461 30516 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
W20260709 13:08:42.486927 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.502691 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:42.503569 30467 raft_consensus.cc:2468] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 1.
I20260709 13:08:42.507753 30547 raft_consensus.cc:2468] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 6.
I20260709 13:08:42.509579 30620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47446 (request call id 1835) took 2635 ms. Trace:
W20260709 13:08:42.568812 30589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.509686 32260 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:08:42.576736 31149 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.006s	sys 0.050s
W20260709 13:08:42.577587 30551 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.925s	user 0.003s	sys 0.057s
W20260709 13:08:42.577739 31149 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.006s	sys 0.050s
W20260709 13:08:42.577950 30551 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.925s	user 0.003s	sys 0.057s
I20260709 13:08:42.512276 31115 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:08:42.583057 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 70853.2us
W20260709 13:08:42.566833 31143 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.018s	user 0.010s	sys 0.045s
I20260709 13:08:42.589133 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:42.589211 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:42.589851 30470 raft_consensus.cc:2468] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 5.
I20260709 13:08:42.477078 32381 raft_consensus.cc:3060] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:42.575670 30620 rpcz_store.cc:276] 0709 13:08:39.816993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.822186 (+  5193us) service_pool.cc:224] Handling call
0709 13:08:42.451398 (+2629212us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b58001a3198. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780e43b71 00007fc780e43a22 00007fc789d5cc09 00007fc788eb6ee0 00007fc788f800ab 00007fc788f80131 00007fc788f41fc0 00007fc788f2c929 00007fc788f2c3d2 00007fc7824a3bd4
0709 13:08:42.451641 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:42.451865 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:42.451902 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:42.452094 (+   192us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:42.452148 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.452230 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:42.452361 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5792512}
I20260709 13:08:42.464339 32356 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:42.568558 32299 raft_consensus.cc:2804] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:42.474538 30616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47446 (request call id 1847) took 1607 ms. Trace:
I20260709 13:08:42.614152 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:42.615134 30473 raft_consensus.cc:2468] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 2.
I20260709 13:08:42.451184 32072 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:42.450076 32353 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:42.472501 32322 raft_consensus.cc:2749] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:42.510491 32368 raft_consensus.cc:3055] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:42.572043 32294 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:42.579180 32256 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:42.622551 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:42.590725 32309 raft_consensus.cc:3060] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:42.450687 32183 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:42.646647 30589 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:08:42.589502 31143 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.097s	user 0.010s	sys 0.045s
I20260709 13:08:42.571157 32260 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:42.589851 32384 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.639791 30470 raft_consensus.cc:2468] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 1.
I20260709 13:08:42.607074 32261 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:08:42.622948 30440 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.927s	user 0.007s	sys 0.060s
I20260709 13:08:42.471802 30542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43088 (request call id 1499) took 1995 ms. Trace:
I20260709 13:08:42.644250 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:42.652143 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:42.675302 30619 raft_consensus.cc:2468] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 2.
I20260709 13:08:42.606263 32078 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:42.609848 32299 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:42.655287 31151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48414 (request call id 510) took 1791 ms. Trace:
I20260709 13:08:42.679235 31151 rpcz_store.cc:276] 0709 13:08:40.864364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.085230 (+220866us) service_pool.cc:224] Handling call
0709 13:08:41.085518 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:41.201916 (+116398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:41.201958 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:41.202022 (+    64us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:41.202064 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.655018 (+1452954us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54004c6154. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:42.655073 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:42.655223 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":267131264}
W20260709 13:08:42.619903 30441 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.832s	user 0.003s	sys 0.062s
W20260709 13:08:42.682910 30441 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.895s	user 0.004s	sys 0.063s
I20260709 13:08:42.599136 30472 raft_consensus.cc:1275] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
W20260709 13:08:42.670782 30440 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.975s	user 0.009s	sys 0.061s
I20260709 13:08:42.674521 31116 leader_election.cc:304] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:42.676790 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:08:42.711113 30624 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36130 (request call id 1511) took 2284 ms (client timeout 2201 ms). Trace:
I20260709 13:08:42.677533 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:42.505050 32056 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:42.714867 30441 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.173.3:32851 timed out after 2.201s (SENT) [suppressed 7 similar messages]
I20260709 13:08:42.716153 30623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36130 (request call id 1504) took 2368 ms. Trace:
I20260709 13:08:42.716416 30470 raft_consensus.cc:1240] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:42.638969 32368 raft_consensus.cc:740] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:42.689837 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:42.716656 30623 rpcz_store.cc:276] 0709 13:08:40.347733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.103832 (+756099us) service_pool.cc:224] Handling call
0709 13:08:41.104167 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:42.380141 (+1275974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.715880 (+335739us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54001e3f54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:42.716089 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2803767680}
W20260709 13:08:42.684623 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 988924us
I20260709 13:08:42.636029 32353 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:42.690508 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:42.718778 30440 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:42.690383 32299 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:42.656119 32254 raft_consensus.cc:2804] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:42.761907 32254 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:42.762429 32254 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:42.704125 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:42.764139 30473 raft_consensus.cc:3060] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:42.662392 32346 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.009s	user 0.020s	sys 0.059s
I20260709 13:08:42.684491 30472 pending_rounds.cc:85] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326: Aborting all ops after (but not including) 4
I20260709 13:08:42.658113 32330 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:42.639106 32294 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:42.707405 31115 leader_election.cc:304] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:08:42.798599 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 91281.5us
I20260709 13:08:42.800379 31115 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:42.717790 30622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36130 (request call id 1499) took 2371 ms. Trace:
W20260709 13:08:42.711679 30624 rpcz_store.cc:269] 0709 13:08:40.427211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.444499 (+ 17288us) service_pool.cc:224] Handling call
0709 13:08:42.710913 (+2266414us) spinlock_profiling.cc:243] Waited 1.96 s on lock 0x7b54002df0d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:08:42.711038 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4503741312}
I20260709 13:08:42.711390 30546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 307) took 1205 ms. Trace:
I20260709 13:08:42.701774 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:42.723477 30440 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:42.710911 31116 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:42.728065 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:42.729313 32353 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:42.729648 30476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 1805) took 1048 ms. Trace:
I20260709 13:08:42.806783 30476 rpcz_store.cc:276] 0709 13:08:41.681433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.681600 (+   167us) service_pool.cc:224] Handling call
0709 13:08:41.682043 (+   443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:42.016004 (+333961us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.729380 (+713376us) spinlock_profiling.cc:243] Waited 333 ms on lock 0x7b54002184d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:42.729568 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":766468352}
I20260709 13:08:42.729971 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:42.730439 32367 raft_consensus.cc:2749] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:42.732652 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:42.733922 31148 raft_consensus.cc:1240] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:08:42.734522 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:42.735183 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:42.738145 30549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 1206) took 1887 ms. Trace:
I20260709 13:08:42.739640 32356 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:42.740598 31144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48414 (request call id 514) took 1852 ms. Trace:
I20260709 13:08:42.752435 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:42.673178 32384 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:42.754608 32142 raft_consensus.cc:3055] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:42.692101 32252 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:42.756597 32375 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.757869 30618 raft_consensus.cc:1240] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:42.761164 32344 leader_election.cc:290] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:42.768965 30472 pending_rounds.cc:107] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:08:42.771469 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:42.638208 32072 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:42.773309 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:42.678179 32261 raft_consensus.cc:493] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:42.788909 32260 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:42.789325 32309 raft_consensus.cc:2749] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:42.775681 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:42.801265 30473 raft_consensus.cc:2468] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 4.
I20260709 13:08:42.801628 30546 rpcz_store.cc:276] 0709 13:08:41.506427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.509818 (+  3391us) service_pool.cc:224] Handling call
0709 13:08:41.510168 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:41.510406 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:42.367445 (+857039us) log.cc:844] Serialized 14 byte log entry
0709 13:08:42.711098 (+343653us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:42.711145 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:42.711183 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.711243 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:42.711341 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":918456,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":2461,"thread_start_us":1178005,"threads_started":2}
I20260709 13:08:42.801050 30622 rpcz_store.cc:276] 0709 13:08:40.346167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.346295 (+   128us) service_pool.cc:224] Handling call
0709 13:08:40.358300 (+ 12005us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:40.918256 (+559956us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.717541 (+1799285us) spinlock_profiling.cc:243] Waited 516 ms on lock 0x7b5400304654. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:42.717727 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1186690304}
W20260709 13:08:42.778959 32346 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.134s	user 0.021s	sys 0.059s
I20260709 13:08:42.772221 32322 raft_consensus.cc:2804] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:08:42.807634 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 96791.1us
I20260709 13:08:42.808753 30624 raft_consensus.cc:1275] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:08:42.690089 32078 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:08:42.812242 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 88802.2us
I20260709 13:08:42.874728 32142 raft_consensus.cc:740] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:42.805687 32300 raft_consensus.cc:2749] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:42.794725 32330 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:42.888873 32089 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:42.847131 30549 rpcz_store.cc:276] 0709 13:08:40.851147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.910706 (+ 59559us) service_pool.cc:224] Handling call
0709 13:08:40.910973 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:41.294853 (+383880us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:08:42.279092 (+984239us) log.cc:844] Serialized 14 byte log entry
0709 13:08:42.654418 (+375326us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:42.654479 (+    61us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:42.654526 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.737881 (+ 83355us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b54003d9fd4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:42.737934 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:42.738080 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1119938,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":2176,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":11610,"spinlock_wait_cycles":882270080,"thread_start_us":1218542,"threads_started":2}
I20260709 13:08:42.854102 30551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43088 (request call id 1517) took 1214 ms. Trace:
I20260709 13:08:42.811285 30468 raft_consensus.cc:3060] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:42.815862 32174 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.023s	sys 0.037s
I20260709 13:08:43.002149 32056 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:08:43.003996 32174 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.024s	sys 0.039s
I20260709 13:08:43.004364 32072 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:42.811790 32192 raft_consensus.cc:2804] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:43.004802 32174 raft_consensus.cc:3055] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:43.005076 32192 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:43.005345 32174 raft_consensus.cc:740] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:42.674408 30542 rpcz_store.cc:276] 0709 13:08:40.476876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.480165 (+  3289us) service_pool.cc:224] Handling call
0709 13:08:42.354601 (+1874436us) spinlock_profiling.cc:243] Waited 5.08 ms on lock 0x7b5800028598. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780e43b71 00007fc780e43a22 00007fc789d5cc09 00007fc788eb6ee0 00007fc788f800ab 00007fc788f80131 00007fc788f41fc0 00007fc788f2c929 00007fc788f2c3d2 00007fc7824a3bd4
0709 13:08:42.354860 (+   259us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:42.469632 (+114772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.471452 (+  1820us) spinlock_profiling.cc:243] Waited 78.7 ms on lock 0x7b54000dded4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:42.471721 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":192744448}
I20260709 13:08:42.884871 30472 raft_consensus.cc:2889] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:42.906716 32322 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:43.006687 32322 raft_consensus.cc:3060] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:43.006409 32174 consensus_queue.cc:260] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:42.887377 30618 raft_consensus.cc:1240] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:08:42.847714 32396 raft_consensus.cc:2749] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:43.014498 30468 raft_consensus.cc:2468] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 6.
I20260709 13:08:43.026070 32299 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:43.029544 32384 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:42.900507 31116 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd
W20260709 13:08:43.039103 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 138683us
I20260709 13:08:42.871941 32353 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:08:42.846004 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 47772us
I20260709 13:08:42.889623 32375 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:08:42.906056 32327 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.003s	sys 0.025s
W20260709 13:08:42.810959 30543 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.017s	sys 0.007s
W20260709 13:08:42.915285 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.906869 31145 raft_consensus.cc:2393] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 6: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:08:42.891989 32344 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.887797 32224 raft_consensus.cc:2749] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:42.996266 30551 rpcz_store.cc:276] 0709 13:08:41.639652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.639826 (+   174us) service_pool.cc:224] Handling call
0709 13:08:41.640202 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:41.643214 (+  3012us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:41.643252 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:41.652222 (+  8970us) log.cc:844] Serialized 26 byte log entry
0709 13:08:42.578290 (+926068us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:42.578322 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.578375 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:42.853885 (+275510us) raft_consensus.cc:1685] finished
0709 13:08:42.853902 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:42.854037 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3106,"raft.queue_time_us":251,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":5680,"thread_start_us":925735,"threads_started":1,"wal-append.queue_time_us":1199688}
I20260709 13:08:42.899170 32261 raft_consensus.cc:515] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:42.860369 32368 consensus_queue.cc:260] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:43.002126 32183 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:43.002247 32330 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:43.002846 32294 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:42.871598 30374 catalog_manager.cc:5697] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 2 to 3, leader changed from cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 3 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:43.007401 32174 raft_consensus.cc:3060] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:42.898976 32297 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.015s	sys 0.019s
W20260709 13:08:43.063987 32297 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.015s	sys 0.019s
I20260709 13:08:43.040012 31116 leader_election.cc:304] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:42.888154 32252 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
W20260709 13:08:43.053064 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:43.052780 30543 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.017s	sys 0.008s
W20260709 13:08:43.056425 32327 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.003s	sys 0.025s
I20260709 13:08:43.005703 32192 raft_consensus.cc:3060] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:42.911302 32259 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.014s	sys 0.018s
W20260709 13:08:43.056342 30548 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.022s	sys 0.036s
I20260709 13:08:43.103966 31116 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
W20260709 13:08:43.105161 30548 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.022s	sys 0.036s
W20260709 13:08:43.040961 32293 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:08:43.063402 32222 raft_consensus.cc:1064] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79: attempting to promote NON_VOTER cd669586cff44d4bbfcc007e213faab6 to VOTER
I20260709 13:08:42.614020 30616 rpcz_store.cc:276] 0709 13:08:40.867079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.401344 (+534265us) service_pool.cc:224] Handling call
0709 13:08:41.401682 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:41.402063 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:41.402116 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:41.402681 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 13:08:42.249060 (+846379us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:42.249112 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.249187 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:42.474325 (+225138us) raft_consensus.cc:1685] finished
0709 13:08:42.474349 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:42.474480 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":29951,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":18309,"thread_start_us":845948,"threads_started":1,"wal-append.queue_time_us":1043905}
I20260709 13:08:43.051997 32300 raft_consensus.cc:2804] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:42.859637 31144 rpcz_store.cc:276] 0709 13:08:40.888297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.455294 (+566997us) service_pool.cc:224] Handling call
0709 13:08:41.476110 (+ 20816us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:41.895111 (+419001us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.740371 (+845260us) spinlock_profiling.cc:243] Waited 418 ms on lock 0x7b54005c2454. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:42.740541 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":961754880}
I20260709 13:08:43.103397 30543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 1213) took 2239 ms. Trace:
W20260709 13:08:43.071863 32321 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.023s	sys 0.036s
I20260709 13:08:43.071651 32368 raft_consensus.cc:3060] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:43.141858 31116 leader_election.cc:304] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:43.071089 32330 raft_consensus.cc:2804] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:08:43.109930 32259 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.021s	sys 0.020s
I20260709 13:08:43.052217 32353 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:43.150306 31116 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:08:43.144454 32321 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.025s	sys 0.040s
I20260709 13:08:43.159418 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:08:43.148756 32357 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.900s	user 0.013s	sys 0.049s
I20260709 13:08:43.067087 32384 consensus_queue.cc:1048] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 13:08:43.065657 32344 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:43.001049 32089 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:43.051172 32142 consensus_queue.cc:260] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:43.152926 32330 raft_consensus.cc:493] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:08:43.161252 30625 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.018s	sys 0.044s
I20260709 13:08:43.139714 32300 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:43.181149 32300 raft_consensus.cc:3060] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:43.153412 32308 raft_consensus.cc:2804] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:08:43.177654 30625 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.019s	sys 0.044s
W20260709 13:08:43.163977 32357 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.919s	user 0.013s	sys 0.050s
I20260709 13:08:43.146144 32397 consensus_queue.cc:1059] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
W20260709 13:08:43.189675 30514 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.000s	sys 0.009s
I20260709 13:08:43.191908 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:43.193142 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:43.165494 32224 raft_consensus.cc:2804] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:08:43.197082 30515 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.013s	sys 0.038s
W20260709 13:08:43.202056 30514 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.000s	sys 0.010s
W20260709 13:08:43.203116 30545 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.012s	sys 0.012s
W20260709 13:08:43.203416 30516 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.002s	sys 0.014s
I20260709 13:08:43.153534 32395 consensus_queue.cc:1048] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
W20260709 13:08:43.173697 32262 consensus_meta.cc:287] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.738s	user 0.010s	sys 0.001s
W20260709 13:08:43.212033 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.210047 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:08:43.280023 30545 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.849s	user 0.013s	sys 0.012s
W20260709 13:08:43.212358 30516 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.002s	sys 0.014s
W20260709 13:08:43.211506 30515 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.013s	sys 0.038s
I20260709 13:08:43.213526 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:43.214308 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:08:43.280732 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 776950us
I20260709 13:08:43.217634 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:43.282538 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:43.280148 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:43.287055 30622 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:43.292179 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.182085 32330 raft_consensus.cc:3060] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:43.203784 32360 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.798s	user 0.009s	sys 0.016s
I20260709 13:08:43.196748 32308 raft_consensus.cc:697] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:43.210932 32142 raft_consensus.cc:3060] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:43.310550 32299 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:43.314142 32322 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:43.317009 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.317943 32330 raft_consensus.cc:515] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:43.322371 32222 consensus_queue.cc:237] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:43.337489 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:43.198475 32297 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:43.345391 30551 raft_consensus.cc:1240] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 3. Current term is 4. Ops: []
W20260709 13:08:43.357059 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:43.479924 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.490561 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:43.296528 32262 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:43.300099 32078 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:43.338420 32397 raft_consensus.cc:3055] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:43.485623 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:08:43.405925 32404 log.cc:927] Time spent T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.289s	user 0.000s	sys 0.000s
W20260709 13:08:43.406198 32405 log.cc:927] Time spent T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
W20260709 13:08:43.355386 32406 log.cc:927] Time spent T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:08:43.493137 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:08:43.406791 32408 log.cc:927] Time spent T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 13:08:43.571630 31115 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.763s	user 0.023s	sys 0.056s
I20260709 13:08:43.501122 30546 raft_consensus.cc:2410] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:43.501075 30545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43088 (request call id 1515) took 1863 ms. Trace:
I20260709 13:08:43.574391 30545 rpcz_store.cc:276] 0709 13:08:41.637336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.637507 (+   171us) service_pool.cc:224] Handling call
0709 13:08:41.637862 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:41.638077 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:08:42.430262 (+792185us) log.cc:844] Serialized 14 byte log entry
0709 13:08:43.500735 (+1070473us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:43.500794 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:43.500836 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.500907 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:43.501021 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":220006,"prepare.queue_time_us":814444,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"thread_start_us":1637938,"threads_started":2,"wal-append.queue_time_us":871733}
W20260709 13:08:43.505609 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 224149us
I20260709 13:08:43.576983 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:43.577869 30549 raft_consensus.cc:2468] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 2.
W20260709 13:08:43.338737 32360 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.896s	user 0.009s	sys 0.017s
W20260709 13:08:43.541200 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:43.543592 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.540858 32417 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:43.425390 32402 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:43.406458 32299 raft_consensus.cc:493] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:08:43.406699 32407 log.cc:927] Time spent T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
W20260709 13:08:43.504230 32310 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.885s	user 0.064s	sys 0.086s
I20260709 13:08:43.477778 32346 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.478408 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:43.505395 32056 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:43.478818 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:43.559952 32308 consensus_queue.cc:237] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:43.571062 30551 raft_consensus.cc:2410] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:08:43.500222 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 208928us
W20260709 13:08:43.583572 31150 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.848s	user 0.053s	sys 0.105s
W20260709 13:08:43.611976 31150 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.876s	user 0.054s	sys 0.105s
W20260709 13:08:43.607604 32310 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.991s	user 0.065s	sys 0.087s
I20260709 13:08:43.613986 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:43.614796 30467 raft_consensus.cc:2393] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 2: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:43.576912 30545 raft_consensus.cc:1275] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:43.550529 32397 raft_consensus.cc:740] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
W20260709 13:08:43.576314 30441 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.851s	user 0.005s	sys 0.020s
I20260709 13:08:43.621209 31147 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 3 LEARNER]: Advancing to term 4
W20260709 13:08:43.622211 30441 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.907s	user 0.005s	sys 0.020s
I20260709 13:08:43.621681 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:08:43.622967 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 908032us
W20260709 13:08:43.616312 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.600418 32348 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.628782 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:43.566458 32261 leader_election.cc:290] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:43.546447 32384 consensus_queue.cc:1059] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:08:43.479926 32297 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:08:43.601684 30591 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.003s	sys 0.020s
I20260709 13:08:43.628446 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:43.628649 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:43.629070 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:43.629770 32360 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:43.630627 32415 log.cc:927] Time spent T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
W20260709 13:08:43.631423 32416 log.cc:927] Time spent T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:08:43.631764 32294 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:43.665141 32294 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:43.667276 32294 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:08:43.667410 32192 consensus_meta.cc:287] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.524s	user 0.006s	sys 0.000s
I20260709 13:08:43.631876 32219 raft_consensus.cc:493] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
W20260709 13:08:43.669160 32174 consensus_meta.cc:287] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.607s	user 0.005s	sys 0.006s
I20260709 13:08:43.669039 32219 raft_consensus.cc:515] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:43.670205 32300 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:43.671036 32219 leader_election.cc:290] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:08:43.633114 30374 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.007s	sys 0.012s
I20260709 13:08:43.633375 31146 raft_consensus.cc:2468] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 2.
I20260709 13:08:43.634152 31149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48426 (request call id 464) took 1961 ms. Trace:
W20260709 13:08:43.672363 30374 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.007s	sys 0.012s
I20260709 13:08:43.672219 31149 rpcz_store.cc:276] 0709 13:08:41.672687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.672978 (+   291us) service_pool.cc:224] Handling call
0709 13:08:41.673323 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:41.680929 (+  7606us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:41.680959 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:41.683887 (+  2928us) log.cc:844] Serialized 26 byte log entry
0709 13:08:42.578252 (+894365us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:42.578286 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.578363 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:43.633955 (+1055592us) raft_consensus.cc:1685] finished
0709 13:08:43.633977 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:43.634100 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7817,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":16101,"thread_start_us":743854,"threads_started":1,"wal-append.queue_time_us":1164129}
W20260709 13:08:43.675408 32254 consensus_meta.cc:287] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.912s	user 0.008s	sys 0.004s
I20260709 13:08:43.676287 32322 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:43.144253 30543 rpcz_store.cc:276] 0709 13:08:40.863653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.085676 (+222023us) service_pool.cc:224] Handling call
0709 13:08:41.132595 (+ 46919us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:41.156457 (+ 23862us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:08:42.299669 (+1143212us) log.cc:844] Serialized 14 byte log entry
0709 13:08:43.103014 (+803345us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:43.103070 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:43.103118 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.103185 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:43.103321 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1253417,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":896,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"thread_start_us":1818245,"threads_started":2,"wal-append.queue_time_us":861577}
I20260709 13:08:43.677639 32397 consensus_queue.cc:260] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:43.679054 32397 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:43.608685 32299 raft_consensus.cc:515] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:43.680066 32294 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:43.680663 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
W20260709 13:08:43.637522 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.681371 30475 raft_consensus.cc:3060] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:43.681844 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.640244 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:43.638013 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:43.684167 32330 leader_election.cc:290] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:43.606276 32402 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:43.686967 32402 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:43.611559 32252 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:43.615207 32353 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:08:43.649019 31151 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.922s	user 0.049s	sys 0.068s
I20260709 13:08:43.656699 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:43.691972 30469 raft_consensus.cc:3060] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:43.657269 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:43.693049 30472 raft_consensus.cc:2393] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 7: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:43.658243 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:43.659369 30468 raft_consensus.cc:1240] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 13:08:43.697783 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:43.698539 30468 raft_consensus.cc:2393] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 7: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
W20260709 13:08:43.660451 32390 log.cc:927] Time spent T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.367s	user 0.000s	sys 0.001s
I20260709 13:08:43.660382 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:43.661262 32226 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.633394 30622 raft_consensus.cc:2410] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:08:43.646858 32403 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:43.662025 31148 raft_consensus.cc:1240] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 5 LEADER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:08:43.624053 32355 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:43.662608 31147 raft_consensus.cc:1240] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 13:08:43.662858 32411 log.cc:927] Time spent T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:08:43.616165 32056 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:43.622678 32262 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:43.616036 32078 raft_consensus.cc:493] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:43.680568 32294 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:43.681721 32299 leader_election.cc:290] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:43.688758 30550 raft_consensus.cc:1240] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 3 LEADER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:43.720041 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:08:43.602582 31115 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.024s	sys 0.056s
W20260709 13:08:43.693569 31151 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.966s	user 0.049s	sys 0.068s
W20260709 13:08:43.731181 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 930755us
I20260709 13:08:43.607821 32417 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:43.644606 32250 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:43.691397 32360 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:43.708217 31145 raft_consensus.cc:2468] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:08:43.708830 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:43.711036 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:43.612229 32346 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:43.711973 32226 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:43.642583 32348 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:43.716789 30469 raft_consensus.cc:2468] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:08:43.718173 30517 leader_election.cc:304] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:08:43.763022 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 44926.6us
I20260709 13:08:43.763199 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:43.648516 32426 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:43.667804 32192 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:43.712922 32375 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:43.692157 32254 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:43.690450 30475 raft_consensus.cc:2468] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 2.
W20260709 13:08:43.646075 30591 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.003s	sys 0.020s
I20260709 13:08:43.734014 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:43.801081 30617 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 1.
W20260709 13:08:43.801344 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 223262us
I20260709 13:08:43.735540 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:43.730031 32078 raft_consensus.cc:515] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:43.738006 32300 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 3 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:43.741814 32262 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:43.725390 31143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48414 (request call id 513) took 2840 ms. Trace:
I20260709 13:08:43.722424 32403 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:43.744796 32297 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:08:43.745674 32350 raft_consensus.cc:1068] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326: Unable to promote non-voter cd669586cff44d4bbfcc007e213faab6: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:08:43.746552 32417 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:43.747265 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:43.747598 32294 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:43.748246 30625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47446 (request call id 1854) took 1178 ms. Trace:
I20260709 13:08:43.827414 30625 rpcz_store.cc:276] 0709 13:08:42.570313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.570464 (+   151us) service_pool.cc:224] Handling call
0709 13:08:42.570822 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:42.571207 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:42.571230 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:42.571666 (+   436us) log.cc:844] Serialized 26 byte log entry
0709 13:08:43.182046 (+610380us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:43.182089 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.182162 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:43.747972 (+565810us) raft_consensus.cc:1685] finished
0709 13:08:43.748000 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:43.748171 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24902,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":7283,"thread_start_us":607451,"threads_started":1,"wal-append.queue_time_us":1059033}
I20260709 13:08:43.748984 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:43.749086 32056 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:08:43.750102 30589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.707609 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:43.751266 30590 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:08:43.832051 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 80885.5us
I20260709 13:08:43.753041 30472 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
W20260709 13:08:43.754904 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:43.834635 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.764423 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:43.764617 30517 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:43.836176 32294 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:43.836755 32294 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:43.723553 32355 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:43.838171 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:43.796026 30474 raft_consensus.cc:2393] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 4: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:43.802455 30516 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:43.840291 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:43.840346 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:43.851310 32226 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:43.840997 30551 raft_consensus.cc:1275] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:43.831527 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:08:43.846374 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 43985.8us
I20260709 13:08:43.853677 30468 raft_consensus.cc:1240] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:08:43.820039 31143 rpcz_store.cc:276] 0709 13:08:40.884460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.148762 (+264302us) service_pool.cc:224] Handling call
0709 13:08:41.272276 (+123514us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:41.272705 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:41.272735 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:41.492145 (+219410us) log.cc:844] Serialized 556 byte log entry
0709 13:08:42.689174 (+1197029us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:42.711250 (+ 22076us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.772830 (+ 61580us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:43.720598 (+947768us) raft_consensus.cc:1685] finished
0709 13:08:43.720625 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:43.724836 (+  4211us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1160642,"threads_started":1,"wal-append.queue_time_us":1659161}
I20260709 13:08:43.823285 30623 raft_consensus.cc:1240] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:43.854918 30468 raft_consensus.cc:1240] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:43.855458 32254 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:08:43.813194 32224 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.021s	sys 0.051s
W20260709 13:08:43.856026 32224 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.021s	sys 0.052s
I20260709 13:08:43.800995 32421 raft_consensus.cc:2804] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:43.856417 32224 raft_consensus.cc:697] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 6 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:43.753108 32250 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:43.856793 32421 raft_consensus.cc:493] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:43.857251 32421 raft_consensus.cc:3060] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:43.857611 32224 consensus_queue.cc:237] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:43.858208 32346 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:43.858517 32250 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:08:43.847324 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 82779us
I20260709 13:08:43.861285 30476 raft_consensus.cc:1240] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:08:43.863135 32348 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:43.863406 30476 raft_consensus.cc:1240] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:08:43.864667 32078 leader_election.cc:290] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:43.864646 30468 raft_consensus.cc:1240] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
W20260709 13:08:43.865546 32368 consensus_meta.cc:287] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.712s	user 0.010s	sys 0.000s
I20260709 13:08:43.799281 32426 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:43.866360 30618 raft_consensus.cc:1275] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:08:43.866704 30618 pending_rounds.cc:85] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79: Aborting all ops after (but not including) 4
I20260709 13:08:43.866916 30618 pending_rounds.cc:107] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:08:43.867129 30618 raft_consensus.cc:2889] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:43.867722 32426 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:43.868011 30545 raft_consensus.cc:2468] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:43.869251 30589 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:43.865301 30517 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:43.874488 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:43.875566 30590 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:08:43.807977 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 973432us
I20260709 13:08:43.849526 31142 raft_consensus.cc:2393] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 2: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:08:43.890383 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
W20260709 13:08:43.892527 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.894073 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:43.894152 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:43.894932 30471 raft_consensus.cc:3060] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:43.895220 31149 raft_consensus.cc:2468] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
I20260709 13:08:43.898741 30589 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:43.899945 30467 raft_consensus.cc:3060] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:43.849323 32384 raft_consensus.cc:2804] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:43.857174 32403 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:43.886827 32426 raft_consensus.cc:2749] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:43.871869 32056 raft_consensus.cc:2804] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:43.909299 32421 raft_consensus.cc:515] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:43.869295 32192 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:43.910022 32437 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.910128 32174 raft_consensus.cc:2749] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:43.906497 32297 consensus_queue.cc:1059] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:08:43.839846 32355 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:43.916002 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:43.916307 32261 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:43.916944 32353 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.920953 30467 raft_consensus.cc:1275] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:43.871249 32252 raft_consensus.cc:2804] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:43.960098 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:43.964570 31150 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48412 (request call id 434) took 1249 ms. Trace:
I20260709 13:08:43.984615 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:43.922444 32384 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.012167 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:44.014192 30545 raft_consensus.cc:2393] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 6: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:08:43.967594 30471 raft_consensus.cc:2468] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 2.
I20260709 13:08:44.015542 30472 raft_consensus.cc:1240] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:43.984843 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:43.921360 32368 raft_consensus.cc:2804] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:43.906767 32254 raft_consensus.cc:2749] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:44.010850 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:44.018311 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:43.923558 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:44.023250 31146 raft_consensus.cc:1240] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:08:44.009763 31150 rpcz_store.cc:276] 0709 13:08:42.715425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.717684 (+  2259us) service_pool.cc:224] Handling call
0709 13:08:42.727738 (+ 10054us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:42.735690 (+  7952us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:08:43.612326 (+876636us) log.cc:844] Serialized 14 byte log entry
0709 13:08:43.964175 (+351849us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:43.964237 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:43.964294 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.964373 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:43.964507 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1004262,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"raft.queue_time_us":89,"thread_start_us":1227686,"threads_started":2}
I20260709 13:08:43.938093 32250 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:43.902057 32348 consensus_queue.cc:1059] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 13:08:43.951853 32262 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.048422 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:44.058077 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:43.956583 32056 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:43.961572 32422 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:44.023085 32384 raft_consensus.cc:3060] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:44.022857 32368 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.071153 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:44.026949 32294 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:44.072643 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:44.073010 30545 raft_consensus.cc:2468] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 4.
I20260709 13:08:44.012595 32252 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:44.142717 31151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48412 (request call id 432) took 1428 ms. Trace:
I20260709 13:08:44.129006 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:44.141360 32252 raft_consensus.cc:3060] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:44.141635 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 404260us
I20260709 13:08:44.145905 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:44.060209 32297 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.128619 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:44.155618 30545 raft_consensus.cc:2468] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
I20260709 13:08:44.157123 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:43.958547 32437 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:44.072253 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:44.113014 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:44.147799 31151 rpcz_store.cc:276] 0709 13:08:42.714778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.718324 (+  3546us) service_pool.cc:224] Handling call
0709 13:08:42.720554 (+  2230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:42.720815 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:08:43.739170 (+1018355us) log.cc:844] Serialized 14 byte log entry
0709 13:08:44.140775 (+401605us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:44.140871 (+    96us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:44.142335 (+  1464us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.142462 (+   127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:44.142641 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1008216,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":74,"thread_start_us":1386955,"threads_started":2}
W20260709 13:08:44.147177 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 248508us
I20260709 13:08:44.152791 30440 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:43.961764 32346 consensus_queue.cc:1048] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.151s
I20260709 13:08:44.149091 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:44.113086 32056 raft_consensus.cc:3060] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:44.118009 32219 raft_consensus.cc:3055] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:44.023325 32353 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:44.009649 32261 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:44.165607 30440 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:44.141702 32226 raft_consensus.cc:493] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:44.168078 31151 raft_consensus.cc:1240] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 4 LEARNER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 3. Current term is 4. Ops: []
W20260709 13:08:44.168567 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 292947us
I20260709 13:08:44.117038 32262 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:44.164400 32417 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:44.168249 31115 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:44.122015 32368 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:44.146389 32309 raft_consensus.cc:2749] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:08:44.174919 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.061187 32250 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:44.195612 30550 raft_consensus.cc:2393] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 2: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:08:44.169864 32219 raft_consensus.cc:740] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:44.168911 32357 raft_consensus.cc:2749] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:44.188244 32293 raft_consensus.cc:2804] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:44.143473 32422 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:44.171958 32330 consensus_queue.cc:1059] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
W20260709 13:08:44.204814 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:44.205116 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 244423us
I20260709 13:08:44.218904 30589 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
W20260709 13:08:44.219518 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.162427 32297 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:44.221926 32297 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:44.162592 31150 raft_consensus.cc:2468] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
I20260709 13:08:44.170060 32397 consensus_queue.cc:1048] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:08:44.219676 30516 leader_election.cc:304] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
W20260709 13:08:44.227066 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.192687 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:44.204365 32294 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:44.201938 32427 raft_consensus.cc:2749] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:44.268244 30589 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:44.239488 32261 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:44.230916 31150 raft_consensus.cc:1240] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:44.210938 32293 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:44.193148 32226 raft_consensus.cc:515] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:44.260443 32219 consensus_queue.cc:260] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:44.265020 32421 leader_election.cc:290] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:44.234297 32218 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.265544 32329 raft_consensus.cc:3055] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:44.266405 32250 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:08:44.266877 32440 log.cc:927] Time spent T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:08:44.266820 32264 raft_consensus.cc:3055] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:08:44.239782 32433 log.cc:927] Time spent T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:08:44.270835 31151 raft_consensus.cc:1240] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:44.204598 32417 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:44.304363 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.605068 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:44.235316 32254 consensus_queue.cc:1048] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 13:08:44.334458 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:44.335136 30624 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
I20260709 13:08:44.337090 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:44.337809 30624 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
W20260709 13:08:44.319438 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 51307.9us
I20260709 13:08:44.288319 32293 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:44.267373 32453 raft_consensus.cc:2749] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:44.325256 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:44.342345 30620 raft_consensus.cc:2468] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 1.
I20260709 13:08:44.343289 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:44.306250 32261 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.300971 32262 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:44.346074 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:44.302662 32329 raft_consensus.cc:740] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:44.348116 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:44.351912 30622 raft_consensus.cc:1275] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:44.272084 32294 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:44.356230 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:44.357708 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:44.318763 32264 raft_consensus.cc:740] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:44.358489 30617 raft_consensus.cc:2468] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 1.
I20260709 13:08:44.330008 32219 raft_consensus.cc:3060] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:44.322988 32452 raft_consensus.cc:2749] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:44.309916 32218 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:44.369665 30370 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47208 (request call id 184) took 8924 ms. Trace:
I20260709 13:08:44.350160 32250 raft_consensus.cc:2804] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:44.380646 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:08:44.382578 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 61671.7us
I20260709 13:08:44.379235 30370 rpcz_store.cc:276] 0709 13:08:35.380580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.380847 (+   267us) service_pool.cc:224] Handling call
0709 13:08:44.304937 (+8924090us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4434,"reported_tablets":3}
W20260709 13:08:44.397751 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 69955.2us
I20260709 13:08:44.439033 32218 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:44.458151 32226 leader_election.cc:290] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:44.459372 30622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3"
dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
mode: GRACEFUL
new_leader_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:49382
I20260709 13:08:44.460249 30622 raft_consensus.cc:606] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 LEADER]: Received request to transfer leadership to TS 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:44.461237 32417 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:44.463320 30622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7111be574b514751972d70830d3b644f"
dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
mode: GRACEFUL
new_leader_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:49382
I20260709 13:08:44.395455 32250 raft_consensus.cc:493] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:08:44.489396 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 269685us
I20260709 13:08:44.361904 32261 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:44.399196 32375 consensus_queue.cc:1059] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.090s
I20260709 13:08:44.454892 32353 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:08:44.497789 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 109445us
W20260709 13:08:44.503237 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 119900us
I20260709 13:08:44.493897 32250 raft_consensus.cc:3060] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:44.490622 30516 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
W20260709 13:08:44.498428 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 172494us
I20260709 13:08:44.504590 30589 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:44.504338 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:44.506112 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:44.480865 32078 consensus_queue.cc:1048] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:08:44.510979 30548 raft_consensus.cc:1240] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:44.484294 32142 consensus_queue.cc:1059] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:08:44.400748 32329 consensus_queue.cc:260] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:44.491735 32264 consensus_queue.cc:260] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:44.505833 32472 consensus_queue.cc:1059] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:08:44.514760 32142 consensus_queue.cc:1059] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:44.514457 32218 raft_consensus.cc:2955] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:44.515642 32472 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:44.516026 32142 raft_consensus.cc:2804] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:44.516502 32142 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:44.516911 32142 raft_consensus.cc:3060] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:44.517392 32254 raft_consensus.cc:3055] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:44.517789 32254 raft_consensus.cc:740] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:44.516136 32472 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:44.507427 32353 raft_consensus.cc:2804] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:44.512290 32089 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:44.522112 32453 raft_consensus.cc:3055] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:44.523783 32453 raft_consensus.cc:740] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:44.523852 32473 raft_consensus.cc:3055] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:44.524351 32473 raft_consensus.cc:740] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:44.524631 32259 raft_consensus.cc:3055] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:44.525108 32259 raft_consensus.cc:740] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:44.524715 32453 consensus_queue.cc:260] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:44.525220 32473 consensus_queue.cc:260] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:44.526432 32473 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:44.507652 32435 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:44.527257 32435 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:44.527487 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:44.529488 30468 raft_consensus.cc:2468] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
W20260709 13:08:44.530098 32447 log.cc:927] Time spent T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.309s	user 0.000s	sys 0.001s
I20260709 13:08:44.530515 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:44.531121 30468 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:44.533075 32329 raft_consensus.cc:3060] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:44.533672 32437 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:08:44.536911 32459 log.cc:927] Time spent T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
I20260709 13:08:44.526031 32259 consensus_queue.cc:260] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:44.544893 32056 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:44.509438 32471 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.540485 32353 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:08:44.517424 32456 log.cc:927] Time spent T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.295s	user 0.003s	sys 0.000s
I20260709 13:08:44.548877 30618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36130 (request call id 1531) took 1354 ms. Trace:
I20260709 13:08:44.566784 30618 rpcz_store.cc:276] 0709 13:08:43.194684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.280072 (+ 85388us) service_pool.cc:224] Handling call
0709 13:08:43.298435 (+ 18363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:43.867722 (+569287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.548649 (+680927us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b540027f954. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:44.548823 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1304608512}
I20260709 13:08:44.552383 30441 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:44.553501 32463 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.548091 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:44.568918 30467 raft_consensus.cc:2468] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:44.526455 32453 raft_consensus.cc:3060] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:44.575425 32353 raft_consensus.cc:3060] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:44.576157 32445 log.cc:927] Time spent T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.342s	user 0.003s	sys 0.000s
I20260709 13:08:44.505213 32384 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:44.574558 32327 raft_consensus.cc:2749] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:44.574358 32463 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:44.575178 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:44.560221 32264 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:44.612799 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:44.613408 30467 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:44.579075 30547 raft_consensus.cc:1240] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 2. Current term is 3. Ops: []
W20260709 13:08:44.579746 32461 log.cc:927] Time spent T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.357s	user 0.001s	sys 0.000s
I20260709 13:08:44.554227 32254 consensus_queue.cc:260] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:44.615661 32254 raft_consensus.cc:3060] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:44.616111 32056 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:08:44.581001 32441 log.cc:927] Time spent T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.359s	user 0.000s	sys 0.002s
I20260709 13:08:44.628774 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:44.575901 32471 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:44.635593 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:08:44.588701 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 79020.8us
W20260709 13:08:44.600081 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 47787.5us
W20260709 13:08:44.609169 32451 log.cc:927] Time spent T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.362s	user 0.000s	sys 0.001s
I20260709 13:08:44.637203 30441 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:44.638772 31148 raft_consensus.cc:1240] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 2. Current term is 3. Ops: []
W20260709 13:08:44.606215 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.606832 30548 raft_consensus.cc:1275] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:44.614347 30551 raft_consensus.cc:1275] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:44.636366 31146 raft_consensus.cc:2468] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 3.
I20260709 13:08:44.600301 32294 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:44.664377 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:44.673699 32472 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:08:44.676318 32445 log.cc:927] Time spent T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:08:44.676469 30616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36130 (request call id 1526) took 1485 ms. Trace:
I20260709 13:08:44.660419 32327 raft_consensus.cc:2749] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:44.678392 32261 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:44.676960 30616 rpcz_store.cc:276] 0709 13:08:43.191070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.197863 (+  6793us) service_pool.cc:224] Handling call
0709 13:08:43.326890 (+129027us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:43.550901 (+224011us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:43.555260 (+  4359us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:43.612991 (+ 57731us) log.cc:844] Serialized 26 byte log entry
0709 13:08:44.026854 (+413863us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:44.051514 (+ 24660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.072505 (+ 20991us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:44.580448 (+507943us) spinlock_profiling.cc:243] Waited 37.4 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:08:44.676100 (+ 95652us) raft_consensus.cc:1685] finished
0709 13:08:44.676135 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:44.676401 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":190720,"raft.queue_time_us":214239,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":9346,"spinlock_wait_cycles":86041856,"thread_start_us":376374,"threads_started":1,"wal-append.queue_time_us":606245}
I20260709 13:08:44.628252 32259 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:44.682006 30470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 265) took 1522 ms. Trace:
I20260709 13:08:44.682865 31145 pending_rounds.cc:85] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6: Aborting all ops after (but not including) 2
I20260709 13:08:44.683193 31145 pending_rounds.cc:107] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:08:44.683449 31145 raft_consensus.cc:2889] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 4 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:44.634799 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:44.682394 30470 rpcz_store.cc:276] 0709 13:08:43.159311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.159428 (+   117us) service_pool.cc:224] Handling call
0709 13:08:43.641434 (+482006us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b5800002d98. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780e43b71 00007fc780e43a22 00007fc789d5cc09 00007fc788eb6ee0 00007fc788f800ab 00007fc788f80131 00007fc788f41fc0 00007fc788f2c929 00007fc788f2c3d2 00007fc7824a3bd4
0709 13:08:43.641646 (+   212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:43.668004 (+ 26358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:43.668034 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:43.668074 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:43.668101 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.681767 (+1013666us) spinlock_profiling.cc:243] Waited 26.2 ms on lock 0x7b54000424d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:44.681820 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:44.681940 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":63941248}
W20260709 13:08:44.688074 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 50981.9us
I20260709 13:08:44.688665 31114 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:44.687477 30517 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:44.690955 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:44.690145 30441 leader_election.cc:304] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:44.693122 30516 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:08:44.694175 30441 leader_election.cc:304] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:44.608734 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:44.695029 30440 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:08:44.696808 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.697463 31114 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
W20260709 13:08:44.699723 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.703348 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:44.705713 30548 raft_consensus.cc:2468] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 5.
I20260709 13:08:44.704000 32357 raft_consensus.cc:2804] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:44.706375 32357 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:44.706748 32357 raft_consensus.cc:3060] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:44.707571 32368 consensus_meta.cc:287] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.502s	user 0.019s	sys 0.006s
I20260709 13:08:44.698331 32294 raft_consensus.cc:2749] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:44.707490 32476 consensus_queue.cc:1059] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:08:44.708137 32368 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:44.708803 32437 raft_consensus.cc:3055] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:44.708693 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:44.709776 30546 raft_consensus.cc:2468] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
I20260709 13:08:44.701668 30440 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:44.710484 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:44.711668 30440 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:44.703050 30441 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:44.692121 32431 raft_consensus.cc:2749] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:44.713840 30441 leader_election.cc:304] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:08:44.714792 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 210240us
I20260709 13:08:44.693884 32327 raft_consensus.cc:2749] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:44.717384 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:44.718027 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:44.718276 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:44.721297 31150 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
I20260709 13:08:44.722002 30550 raft_consensus.cc:1275] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:44.719151 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:44.700042 32308 consensus_queue.cc:1059] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:08:44.709189 32437 raft_consensus.cc:740] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:44.723318 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:44.715538 32342 raft_consensus.cc:2804] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:44.727236 30549 raft_consensus.cc:1275] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:44.728404 30550 raft_consensus.cc:2468] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:08:44.696002 32261 raft_consensus.cc:2804] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:44.705227 32321 raft_consensus.cc:2749] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:44.731777 30624 raft_consensus.cc:2368] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 4. Current term is 5.
I20260709 13:08:44.705368 32472 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.732318 30622 raft_consensus.cc:606] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Received request to transfer leadership to TS f639301059e24dc5b0d88a46dc683326
I20260709 13:08:44.734012 30622 raft_consensus.cc:614] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:08:44.735422 30589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.700579 32477 raft_consensus.cc:2804] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:44.739254 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:44.739305 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:44.709398 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:44.713346 32294 raft_consensus.cc:2749] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:44.742440 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:44.720155 32297 raft_consensus.cc:2749] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:44.743739 30467 raft_consensus.cc:1240] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 4 LEADER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:08:44.744896 30625 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:44.729382 32342 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.756083 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:44.721108 32395 consensus_queue.cc:1048] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:08:44.771054 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:44.744889 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:44.773728 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:08:44.774263 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.726295 32300 consensus_queue.cc:1048] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:08:44.744328 32477 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:44.806252 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:08:44.807158 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 93386.4us
I20260709 13:08:44.807979 30441 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:44.752655 32261 raft_consensus.cc:697] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:44.768446 32294 raft_consensus.cc:2749] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:44.764377 32421 raft_consensus.cc:3055] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:44.766492 32342 raft_consensus.cc:3060] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:44.745090 32472 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:44.755425 31143 raft_consensus.cc:2468] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 3.
I20260709 13:08:44.746088 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:44.787773 32463 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:44.812693 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:08:44.805984 32252 consensus_meta.cc:287] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.641s	user 0.007s	sys 0.017s
I20260709 13:08:44.799196 32471 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:44.825357 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:44.826315 30471 raft_consensus.cc:1240] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:44.809674 32477 raft_consensus.cc:3060] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:44.804912 32384 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:44.829356 30471 raft_consensus.cc:1240] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:08:44.814076 32421 raft_consensus.cc:740] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:44.829980 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:44.830724 32252 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:08:44.831936 32443 log.cc:927] Time spent T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.592s	user 0.000s	sys 0.004s
I20260709 13:08:44.834395 30618 raft_consensus.cc:2468] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 7.
I20260709 13:08:44.834650 31116 leader_election.cc:304] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:44.836122 30623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 200) took 2262 ms. Trace:
I20260709 13:08:44.848595 30516 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:08:44.848526 30623 rpcz_store.cc:276] 0709 13:08:42.573498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.810233 (+236735us) service_pool.cc:224] Handling call
0709 13:08:42.810544 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:43.854371 (+1043827us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.835920 (+981549us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400222254. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:44.836068 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2328670976}
I20260709 13:08:44.849709 30619 raft_consensus.cc:1275] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:08:44.850199 30619 pending_rounds.cc:85] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79: Aborting all ops after (but not including) 1
I20260709 13:08:44.850303 30623 raft_consensus.cc:1275] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:44.850533 30619 pending_rounds.cc:107] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:08:44.850914 30619 raft_consensus.cc:2889] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:44.839140 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:44.839421 32368 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:44.789932 32437 consensus_queue.cc:260] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:44.840571 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.815423 32344 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:44.828119 32293 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:44.845131 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:44.844084 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:44.853410 31116 leader_election.cc:304] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:44.965821 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:44.875859 30545 raft_consensus.cc:1240] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:44.884649 30440 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:44.921744 31147 raft_consensus.cc:1240] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:44.855170 30619 raft_consensus.cc:1240] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:44.918917 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:08:44.973490 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:44.860980 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.973840 30551 raft_consensus.cc:2468] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 4.
W20260709 13:08:44.944576 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.974186 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:08:44.854053 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 46223.1us
I20260709 13:08:44.977555 30625 raft_consensus.cc:2468] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 3.
I20260709 13:08:44.993937 30441 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:08:44.973862 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.972147 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:44.995177 30621 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 3.
W20260709 13:08:44.995234 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 110651us
W20260709 13:08:44.996958 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 143650us
I20260709 13:08:45.002012 30440 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:45.001106 31116 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:45.003530 30441 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:08:44.876986 32442 log.cc:927] Time spent T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.646s	user 0.004s	sys 0.000s
I20260709 13:08:45.011996 30475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 1298) took 1100 ms. Trace:
I20260709 13:08:44.975090 30551 raft_consensus.cc:2955] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
W20260709 13:08:44.924679 32455 log.cc:927] Time spent T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.702s	user 0.000s	sys 0.003s
I20260709 13:08:44.854568 32476 raft_consensus.cc:2804] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:45.000360 32183 raft_consensus.cc:2749] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:45.016522 32476 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:45.017009 32226 raft_consensus.cc:2804] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:44.868043 32484 raft_consensus.cc:2749] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:45.006788 32482 raft_consensus.cc:2749] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:45.017288 32476 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:45.007609 32192 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.002875 32350 raft_consensus.cc:2804] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:45.028020 32350 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:45.028458 32350 raft_consensus.cc:3060] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:45.009037 32374 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.010522 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:45.010578 30589 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:45.010937 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:08:44.921412 31142 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48412 (request call id 437) took 2189 ms (client timeout 1916 ms). Trace:
I20260709 13:08:45.040495 30468 raft_consensus.cc:1275] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:08:45.040640 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:45.040922 30468 pending_rounds.cc:85] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326: Aborting all ops after (but not including) 2
I20260709 13:08:45.041270 30620 raft_consensus.cc:3060] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:44.885365 32457 log.cc:927] Time spent T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.666s	user 0.003s	sys 0.001s
I20260709 13:08:44.880846 30542 raft_consensus.cc:1240] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:45.044153 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:45.044883 30548 raft_consensus.cc:2393] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 3: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:08:45.044811 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:44.966032 32462 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.013545 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:45.048853 30619 raft_consensus.cc:2468] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:08:45.014693 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:44.880934 32431 raft_consensus.cc:3055] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:45.000454 32344 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:45.017455 32226 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.006029 32307 consensus_queue.cc:1048] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:45.008414 32293 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:44.867419 32322 raft_consensus.cc:2804] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:45.016631 32422 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:45.021107 32327 raft_consensus.cc:2749] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:44.952167 32261 consensus_queue.cc:237] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:44.882489 32252 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:45.024195 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:08:45.065266 32250 consensus_meta.cc:287] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.555s	user 0.014s	sys 0.010s
I20260709 13:08:45.073108 32250 raft_consensus.cc:515] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:45.073832 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:45.074535 30550 raft_consensus.cc:1240] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:45.053035 32431 raft_consensus.cc:740] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:45.075017 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:45.075219 32250 leader_election.cc:290] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:45.075639 31143 raft_consensus.cc:2468] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:08:45.077368 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:45.077932 32360 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:45.080807 32477 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:45.041311 30468 pending_rounds.cc:107] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:08:45.012380 30475 rpcz_store.cc:276] 0709 13:08:43.911909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.705223 (+793314us) service_pool.cc:224] Handling call
0709 13:08:44.726587 (+ 21364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:44.726913 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:44.726938 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:44.740404 (+ 13466us) log.cc:844] Serialized 556 byte log entry
0709 13:08:44.842177 (+101773us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:44.842211 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.842272 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:45.011797 (+169525us) raft_consensus.cc:1685] finished
0709 13:08:45.011830 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:45.011944 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":67780,"threads_started":1,"wal-append.queue_time_us":210799}
I20260709 13:08:45.013928 32308 raft_consensus.cc:2804] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:45.055395 30476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 276) took 1182 ms. Trace:
I20260709 13:08:44.910336 32142 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:45.056002 30621 raft_consensus.cc:2393] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 3: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:08:45.056025 30620 raft_consensus.cc:2468] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 3.
I20260709 13:08:45.046738 32374 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:45.092583 32308 raft_consensus.cc:697] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
W20260709 13:08:45.093361 32353 consensus_meta.cc:287] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.517s	user 0.014s	sys 0.008s
I20260709 13:08:45.094123 32374 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:45.087206 30476 rpcz_store.cc:276] 0709 13:08:43.872733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.878083 (+  5350us) service_pool.cc:224] Handling call
0709 13:08:43.906418 (+ 28335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:43.906611 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:43.906639 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:43.918880 (+ 12241us) log.cc:844] Serialized 26 byte log entry
0709 13:08:44.174937 (+256057us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:44.174971 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.175037 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:44.924064 (+749027us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:08:45.052636 (+128572us) raft_consensus.cc:1685] finished
0709 13:08:45.052656 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:45.055334 (+  2678us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32765696,"thread_start_us":255711,"threads_started":1,"wal-append.queue_time_us":303163}
I20260709 13:08:45.090372 30468 raft_consensus.cc:2889] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:45.063055 32226 raft_consensus.cc:3060] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:45.051887 32329 consensus_meta.cc:287] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.518s	user 0.010s	sys 0.005s
I20260709 13:08:45.065204 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:45.100623 30618 raft_consensus.cc:2468] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 3.
I20260709 13:08:45.018846 32463 consensus_queue.cc:1048] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:08:45.068109 30473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 271) took 1390 ms. Trace:
I20260709 13:08:45.068184 30516 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:45.058897 32355 raft_consensus.cc:2804] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:44.887373 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:08:45.040833 31142 rpcz_store.cc:269] 0709 13:08:42.731604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.734260 (+  2656us) service_pool.cc:224] Handling call
0709 13:08:44.921150 (+2186890us) spinlock_profiling.cc:243] Waited 965 ms on lock 0x7b54005c3d54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:08:44.921304 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2219818752}
I20260709 13:08:45.084195 32437 raft_consensus.cc:3060] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:44.876682 32421 consensus_queue.cc:260] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:45.084977 32453 consensus_queue.cc:1059] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:45.064028 32344 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:45.022640 30441 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:45.029336 32473 consensus_queue.cc:1048] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:08:45.092307 30620 raft_consensus.cc:1275] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:08:45.115700 30620 pending_rounds.cc:85] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79: Aborting all ops after (but not including) 4
I20260709 13:08:45.116110 30620 pending_rounds.cc:107] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:08:45.116436 30620 raft_consensus.cc:2889] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:45.116779 30617 raft_consensus.cc:2393] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 4: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:08:45.093750 32353 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:45.093631 32308 consensus_queue.cc:237] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:45.050357 32462 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:45.037684 32192 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:45.063961 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:45.122135 30619 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
I20260709 13:08:45.030630 32183 consensus_queue.cc:1059] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:08:45.124609 32183 raft_consensus.cc:3055] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:45.125139 32183 raft_consensus.cc:740] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:45.126766 32462 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:45.104135 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:45.127475 30548 raft_consensus.cc:3060] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:45.121470 30543 raft_consensus.cc:1240] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:45.103879 32355 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:45.112993 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 90400.1us
I20260709 13:08:45.113427 30623 raft_consensus.cc:1240] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:45.111708 30625 raft_consensus.cc:1275] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:08:45.101563 30473 rpcz_store.cc:276] 0709 13:08:43.677712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.677872 (+   160us) service_pool.cc:224] Handling call
0709 13:08:43.678198 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:43.678575 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:43.678614 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:43.679118 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 13:08:44.112269 (+433151us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:44.112307 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:44.112385 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:44.843485 (+731100us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:08:45.063054 (+219569us) raft_consensus.cc:1685] finished
0709 13:08:45.063075 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:45.068052 (+  4977us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":99,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"spinlock_wait_cycles":24539904,"thread_start_us":432825,"threads_started":1,"wal-append.queue_time_us":522609}
I20260709 13:08:45.088788 32322 raft_consensus.cc:697] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:45.106949 30516 leader_election.cc:304] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:08:45.124768 32448 log.cc:927] Time spent T 00000000000000000000000000000000 P 045170a35afe4845987482e49e9e1eb9: Append to log took a long time: real 0.902s	user 0.001s	sys 0.002s
I20260709 13:08:45.139025 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:45.126180 32183 consensus_queue.cc:260] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:45.140414 32183 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:45.071072 32472 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:45.129357 30441 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:45.110849 31145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48414 (request call id 529) took 1237 ms. Trace:
I20260709 13:08:45.133385 32353 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:45.120041 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:45.133689 32192 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:45.115963 30544 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 2.
I20260709 13:08:45.151510 30544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
mode: GRACEFUL
new_leader_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:45906
I20260709 13:08:45.151767 30516 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:45.146458 32346 raft_consensus.cc:2749] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:45.133790 32142 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:45.148187 32453 consensus_queue.cc:1059] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:08:45.150741 32321 consensus_queue.cc:1059] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:08:45.148343 32397 consensus_queue.cc:1048] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:08:45.153614 30548 raft_consensus.cc:2468] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:45.153944 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:45.154114 32321 raft_consensus.cc:3055] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:45.154740 30589 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:45.140249 32342 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:45.142074 30441 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:45.129397 30625 pending_rounds.cc:85] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79: Aborting all ops after (but not including) 5
I20260709 13:08:45.168357 30625 pending_rounds.cc:107] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:08:45.168630 30625 raft_consensus.cc:2889] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:45.114820 32482 raft_consensus.cc:2749] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:45.139623 30550 raft_consensus.cc:2468] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:45.120131 32421 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:45.149586 32462 consensus_queue.cc:1048] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:45.149904 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:45.150285 32056 consensus_queue.cc:1048] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:45.150544 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:45.183705 30620 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 3.
I20260709 13:08:45.156158 30590 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:45.156842 30516 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:45.104689 32357 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:45.154505 32321 raft_consensus.cc:740] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:45.170351 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:45.150591 30468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 1306) took 1236 ms. Trace:
I20260709 13:08:45.171226 32250 raft_consensus.cc:2749] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:45.171898 32472 raft_consensus.cc:2804] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:45.173667 30441 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:45.175259 30589 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:45.131101 32355 raft_consensus.cc:3060] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:45.152096 30544 raft_consensus.cc:606] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Received request to transfer leadership to TS f639301059e24dc5b0d88a46dc683326
W20260709 13:08:45.232823 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 59221.6us
I20260709 13:08:45.233549 30441 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:45.233692 30470 raft_consensus.cc:1240] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:45.075703 32431 consensus_queue.cc:260] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:45.180820 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.181068 30476 raft_consensus.cc:1275] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:08:45.146467 32262 raft_consensus.cc:2749] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:45.177678 32360 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:45.186794 30516 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:45.192000 32259 raft_consensus.cc:2749] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:45.188311 30467 raft_consensus.cc:1240] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:45.177155 32346 raft_consensus.cc:2804] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:08:45.232084 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 56901.8us
I20260709 13:08:45.236877 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:45.245405 30475 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 4.
I20260709 13:08:45.228564 31144 raft_consensus.cc:3060] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:45.245888 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 53499.9us
I20260709 13:08:45.237121 30441 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:45.147207 31145 rpcz_store.cc:276] 0709 13:08:43.873193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.877595 (+  4402us) service_pool.cc:224] Handling call
0709 13:08:44.682455 (+804860us) spinlock_profiling.cc:243] Waited 3.31 ms on lock 0x7b5800003998. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780e43b71 00007fc780e43a22 00007fc789d5cc09 00007fc788eb6ee0 00007fc788f800ab 00007fc788f80131 00007fc788f41fc0 00007fc788f2c929 00007fc788f2c3d2 00007fc7824a3bd4
0709 13:08:44.682665 (+   210us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:44.684266 (+  1601us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:44.684300 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:44.926920 (+242620us) spinlock_profiling.cc:243] Waited 3.76 ms on lock 0x7b2c00047988. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc782861a11 00007fc782871372 00007fc783fa3a01 00007fc783f6843a 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2
0709 13:08:44.927488 (+   568us) log.cc:844] Serialized 26 byte log entry
0709 13:08:45.005565 (+ 78077us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:45.005613 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:45.005700 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:45.088833 (+ 83133us) raft_consensus.cc:1685] finished
0709 13:08:45.091011 (+  2178us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:45.110782 (+ 19771us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16258560,"thread_start_us":77713,"threads_started":1,"wal-append.queue_time_us":145486}
W20260709 13:08:45.187986 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 141289us
I20260709 13:08:45.192996 32422 raft_consensus.cc:2804] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:45.193209 32477 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:08:45.241765 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 55067.4us
I20260709 13:08:45.233184 30544 raft_consensus.cc:614] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:45.293900 30516 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:45.244853 32346 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:45.189584 32395 consensus_queue.cc:1048] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:08:45.237603 32482 raft_consensus.cc:2804] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:08:45.280699 30517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.276332 32250 raft_consensus.cc:2804] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:08:45.283290 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.298933 30516 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:08:45.281817 32463 raft_consensus.cc:2749] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:45.272061 32374 raft_consensus.cc:2804] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:45.242734 32293 raft_consensus.cc:2804] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:45.250146 30590 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:08:45.296686 32488 log.cc:927] Time spent T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 13:08:45.236575 32454 consensus_queue.cc:1059] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:08:45.280680 32072 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:08:45.302603 32490 log.cc:927] Time spent T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.338s	user 0.004s	sys 0.000s
I20260709 13:08:45.291981 32422 raft_consensus.cc:697] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 3 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
W20260709 13:08:45.330394 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 59704.9us
I20260709 13:08:45.246469 32360 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:45.304083 32346 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:45.280898 32327 consensus_queue.cc:1048] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:08:45.301343 32482 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:45.306705 32462 raft_consensus.cc:2804] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:45.310148 32261 raft_consensus.cc:2804] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:45.327430 32344 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:08:45.347795 32492 log.cc:927] Time spent T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:08:45.352547 32482 raft_consensus.cc:3060] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:45.326964 32293 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.312047 32374 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.325908 32397 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.246728 32322 consensus_queue.cc:237] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:45.291564 32321 consensus_queue.cc:260] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:45.353178 32462 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.352908 32329 consensus_queue.cc:1048] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
W20260709 13:08:45.455327 32219 consensus_meta.cc:287] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 1.084s	user 0.012s	sys 0.026s
W20260709 13:08:45.409297 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.225929 30468 rpcz_store.cc:276] 0709 13:08:43.913706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.840595 (+926889us) service_pool.cc:224] Handling call
0709 13:08:44.855712 (+ 15117us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:45.094940 (+239228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:45.150349 (+ 55409us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b5400028fd4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:45.150535 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":394238336}
I20260709 13:08:45.308223 30516 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:45.413849 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:08:45.415277 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 165053us
I20260709 13:08:45.346514 31116 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:45.351187 31149 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 3.
I20260709 13:08:45.361871 32293 raft_consensus.cc:3060] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:45.472122 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 125707us
I20260709 13:08:45.433933 32218 raft_consensus.cc:2804] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:45.476049 32218 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.476562 32218 raft_consensus.cc:3060] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:45.476677 30544 raft_consensus.cc:2410] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:08:45.477504 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.353370 32261 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:45.372159 32422 consensus_queue.cc:237] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:45.438418 32321 raft_consensus.cc:3060] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:45.480093 30616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0"
dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
mode: GRACEFUL
new_leader_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:49382
I20260709 13:08:45.375335 32350 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:45.500008 30473 raft_consensus.cc:1240] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:45.375077 32357 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:45.374763 32360 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:45.363719 32374 raft_consensus.cc:3060] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:45.367982 32397 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:45.368484 32462 raft_consensus.cc:3060] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:45.522782 30551 consensus_meta.cc:287] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.509s	user 0.001s	sys 0.015s
I20260709 13:08:45.450188 32437 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:45.367636 32472 raft_consensus.cc:697] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:45.269116 30441 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:45.455250 32342 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:45.460561 32476 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:45.459535 32219 raft_consensus.cc:2955] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } } }
I20260709 13:08:45.468001 32477 raft_consensus.cc:2804] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:08:45.468395 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 160101us
I20260709 13:08:45.481197 30616 raft_consensus.cc:606] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Received request to transfer leadership to TS f639301059e24dc5b0d88a46dc683326
I20260709 13:08:45.479576 32261 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:45.518543 32397 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:45.558959 30470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 1297) took 1647 ms. Trace:
I20260709 13:08:45.516618 30468 raft_consensus.cc:1275] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:45.524794 32350 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:45.559569 30470 rpcz_store.cc:276] 0709 13:08:43.911656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.705697 (+794041us) service_pool.cc:224] Handling call
0709 13:08:44.726155 (+ 20458us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:45.234101 (+507946us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:45.558395 (+324294us) spinlock_profiling.cc:243] Waited 507 ms on lock 0x7b540010f9d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:45.558719 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1166808320}
I20260709 13:08:45.548148 32437 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:45.564492 32437 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:45.556790 32504 raft_consensus.cc:2804] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:45.565289 32504 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.565793 32504 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:45.566128 30471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 278) took 1420 ms. Trace:
W20260709 13:08:45.557888 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 288687us
I20260709 13:08:45.558640 31145 raft_consensus.cc:1240] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:45.345633 32072 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:45.571075 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:45.566606 30471 rpcz_store.cc:276] 0709 13:08:44.145957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.843028 (+697071us) service_pool.cc:224] Handling call
0709 13:08:45.564699 (+721671us) spinlock_profiling.cc:243] Waited 3.66 ms on lock 0x7b5800002d98. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780e43b71 00007fc780e43a22 00007fc789d5cc09 00007fc788eb6ee0 00007fc788f800ab 00007fc788f80131 00007fc788f41fc0 00007fc788f2c929 00007fc788f2c3d2 00007fc7824a3bd4
0709 13:08:45.565132 (+   433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:45.565541 (+   409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:45.565576 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:45.565653 (+    77us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:45.565685 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:45.565745 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:45.565907 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8408448}
I20260709 13:08:45.572842 30547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 330) took 1042 ms. Trace:
I20260709 13:08:45.578565 30547 rpcz_store.cc:276] 0709 13:08:44.530754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.530857 (+   103us) service_pool.cc:224] Handling call
0709 13:08:44.531103 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:44.614715 (+ 83612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:45.572298 (+957583us) spinlock_profiling.cc:243] Waited 47.7 ms on lock 0x7b54000d7fd4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:45.572645 (+   347us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":109819776}
I20260709 13:08:45.580341 30441 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:45.581249 30474 raft_consensus.cc:2393] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 4: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
W20260709 13:08:45.581830 30474 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50446 (request call id 1296) took 1670 ms (client timeout 1998 ms). Trace:
I20260709 13:08:45.582157 30441 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:45.583027 32350 raft_consensus.cc:2804] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:45.583382 30624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36130 (request call id 1540) took 1259 ms. Trace:
I20260709 13:08:45.583520 32350 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:45.583989 32350 raft_consensus.cc:3060] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:45.584244 32360 raft_consensus.cc:2749] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:45.582276 30474 rpcz_store.cc:269] 0709 13:08:43.911389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:45.570527 (+1659138us) service_pool.cc:224] Handling call
0709 13:08:45.581727 (+ 11200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:45.558643 32327 raft_consensus.cc:2749] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:45.583801 30624 rpcz_store.cc:276] 0709 13:08:44.323982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.347781 (+ 23799us) service_pool.cc:224] Handling call
0709 13:08:45.582912 (+1235131us) spinlock_profiling.cc:243] Waited 381 ms on lock 0x7b54002df0d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:08:45.583155 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":877006080}
I20260709 13:08:45.590678 30516 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:45.591114 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:08:45.594424 31116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.600641 31147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48414 (request call id 530) took 1726 ms. Trace:
I20260709 13:08:45.601164 31147 rpcz_store.cc:276] 0709 13:08:43.873554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.873654 (+   100us) service_pool.cc:224] Handling call
0709 13:08:44.921572 (+1047918us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:44.973024 (+ 51452us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:45.600196 (+627172us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54005c3d50. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f678ad 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:08:45.600416 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2409263488}
I20260709 13:08:45.600761 31142 raft_consensus.cc:2955] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:45.602428 32072 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:45.604652 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:45.598969 32397 consensus_queue.cc:1048] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:45.607448 31150 raft_consensus.cc:1275] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 4 LEARNER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:45.607946 32472 consensus_queue.cc:237] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:45.576385 32477 raft_consensus.cc:697] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 3 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:45.612529 31146 raft_consensus.cc:1240] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 1. Current term is 2. Ops: []
W20260709 13:08:45.612625 30591 leader_election.cc:336] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.671s (SENT)
I20260709 13:08:45.614053 32460 raft_consensus.cc:2749] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:45.615116 32226 consensus_meta.cc:287] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.500s	user 0.013s	sys 0.001s
I20260709 13:08:45.609735 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:45.619683 32477 consensus_queue.cc:237] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:45.620398 32476 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:45.624614 32226 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:45.625195 30516 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:45.629156 32422 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:45.629483 30591 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:45.640019 32437 raft_consensus.cc:2804] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:45.640542 32437 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.640903 32437 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:45.642591 32261 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:45.643038 32435 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:45.645006 32226 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:45.647714 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:45.647946 32327 consensus_queue.cc:1048] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:45.651856 30547 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
mode: GRACEFUL
new_leader_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:45906
I20260709 13:08:45.652582 30547 raft_consensus.cc:606] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Received request to transfer leadership to TS f639301059e24dc5b0d88a46dc683326
I20260709 13:08:45.654479 29364 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:45.659288 29364 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:08:45.659433 32494 log.cc:927] Time spent T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.296s	user 0.000s	sys 0.000s
W20260709 13:08:45.666879 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 238146us
I20260709 13:08:45.667833 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:45.665617 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:08:45.660590 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 48203.3us
I20260709 13:08:45.667258 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:45.668627 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:45.681957 31148 raft_consensus.cc:2468] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
W20260709 13:08:45.684574 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 52313.6us
I20260709 13:08:45.672631 31114 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:08:45.693288 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:45.695271 30618 raft_consensus.cc:1240] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:45.696074 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:45.675120 32454 consensus_queue.cc:1059] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 13:08:45.652536 31144 raft_consensus.cc:2468] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:45.700764 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:45.660986 32471 raft_consensus.cc:2749] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:45.711901 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:45.712798 30620 raft_consensus.cc:2468] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 2.
I20260709 13:08:45.713675 31150 raft_consensus.cc:3060] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:45.712857 32514 consensus_queue.cc:1048] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:45.659791 32293 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:45.669329 32374 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:08:45.716605 32421 consensus_meta.cc:287] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.535s	user 0.011s	sys 0.002s
I20260709 13:08:45.704241 32261 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:45.669449 32482 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:08:45.729647 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 57509.8us
I20260709 13:08:45.731752 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:45.733031 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:45.735002 32072 raft_consensus.cc:2804] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:45.735261 32142 raft_consensus.cc:3055] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:45.735528 32072 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:45.735745 32142 raft_consensus.cc:740] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:45.736063 32072 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:45.740859 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:45.740736 32142 consensus_queue.cc:260] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:45.735888 31115 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:45.742651 32462 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:45.743268 32218 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:45.746186 32502 raft_consensus.cc:3055] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:45.761670 32502 raft_consensus.cc:740] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:45.750193 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:45.741894 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:45.756620 32072 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:45.725224 32346 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:08:45.798193 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 62387.2us
I20260709 13:08:45.801086 32374 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:08:45.817022 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.826753 32218 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:08:45.828455 32183 consensus_meta.cc:287] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.679s	user 0.013s	sys 0.005s
I20260709 13:08:45.831278 31150 raft_consensus.cc:2468] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:08:45.829020 32397 raft_consensus.cc:2804] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:45.839303 32072 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:45.845814 30550 raft_consensus.cc:2393] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 5: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:08:45.722805 32514 consensus_queue.cc:1059] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.112s
W20260709 13:08:45.848302 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.845556 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:45.850706 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:45.851554 31150 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:45.852115 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:45.829267 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:45.854439 31148 raft_consensus.cc:3060] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:45.856020 32250 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:45.856581 32250 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:45.859539 31150 raft_consensus.cc:2468] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:08:45.848238 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:45.861507 30624 raft_consensus.cc:2393] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 4: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:08:45.869346 32293 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:45.871769 30548 raft_consensus.cc:1240] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:45.838755 32397 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.879976 32226 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:45.882516 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:45.882901 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:45.890846 30621 raft_consensus.cc:2468] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 2.
I20260709 13:08:45.883991 31149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 473) took 1250 ms. Trace:
I20260709 13:08:45.884614 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:45.885105 32501 raft_consensus.cc:3055] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:45.891644 31149 rpcz_store.cc:276] 0709 13:08:44.633782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.634422 (+   640us) service_pool.cc:224] Handling call
0709 13:08:45.883633 (+1249211us) spinlock_profiling.cc:243] Waited 664 ms on lock 0x7b54005749d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:08:45.883797 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1527811456}
W20260709 13:08:45.885218 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 72607us
I20260709 13:08:45.885648 30469 raft_consensus.cc:1275] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:08:45.885731 32355 consensus_meta.cc:287] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.629s	user 0.005s	sys 0.012s
I20260709 13:08:45.886264 30471 raft_consensus.cc:1240] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:45.901330 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:45.902894 30468 raft_consensus.cc:2393] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 2: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:45.891417 32397 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:45.844799 32502 consensus_queue.cc:260] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:45.926628 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:08:45.932811 32522 log.cc:927] Time spent T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:08:45.866003 32350 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:45.899555 32501 raft_consensus.cc:740] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
W20260709 13:08:45.944113 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 48567us
I20260709 13:08:45.935765 32226 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:45.948597 30621 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:45.951627 32517 log.cc:927] Time spent T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.155s	user 0.003s	sys 0.000s
I20260709 13:08:45.929358 32355 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:45.952068 32502 raft_consensus.cc:3060] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:45.952770 32294 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.953382 32294 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:45.953868 32355 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:45.983551 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:45.986721 32142 raft_consensus.cc:3060] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:45.988220 32437 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:45.988945 31148 raft_consensus.cc:2468] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
I20260709 13:08:45.990386 32437 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:45.991164 30551 raft_consensus.cc:1240] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:08:45.992573 32422 raft_consensus.cc:2749] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:45.992288 32250 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:08:45.993285 32525 log.cc:927] Time spent T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:08:45.994076 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:45.994630 32250 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:45.994830 30475 raft_consensus.cc:2468] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
I20260709 13:08:45.995340 32355 consensus_queue.cc:1059] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:45.996748 32504 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:45.998847 32504 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:45.999683 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:46.000994 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:46.002099 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:46.002702 32346 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:46.002751 30473 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:08:45.955693 32294 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:46.003978 30545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 1248) took 1239 ms. Trace:
I20260709 13:08:46.004444 30545 rpcz_store.cc:276] 0709 13:08:44.721744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.740623 (+ 18879us) service_pool.cc:224] Handling call
0709 13:08:44.740930 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:44.981977 (+241047us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:45.936389 (+954412us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b54002580d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:45.960865 (+ 24476us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":309650304}
I20260709 13:08:46.005647 32462 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:46.005731 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:46.006457 30545 raft_consensus.cc:3060] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:08:46.009492 32490 log.cc:927] Time spent T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:08:45.981907 32482 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:08:46.016328 30517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.017462 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:45.950328 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:46.008893 32395 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:46.036345 30621 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 2.
I20260709 13:08:46.037866 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:46.037552 32514 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.044198 30468 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:08:46.046885 30590 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:46.047873 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
W20260709 13:08:46.045490 30591 leader_election.cc:336] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.688s (SENT)
I20260709 13:08:46.050117 30591 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:46.050968 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:46.043576 32479 raft_consensus.cc:3055] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:46.052770 30547 raft_consensus.cc:2468] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 1.
I20260709 13:08:46.049085 30473 raft_consensus.cc:3060] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:46.048743 32308 consensus_queue.cc:1059] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:08:46.052299 32501 consensus_queue.cc:260] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:46.058202 32480 consensus_queue.cc:1059] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:08:46.059000 32254 raft_consensus.cc:2749] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:46.058450 32500 log.cc:927] Time spent T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.806s	user 0.000s	sys 0.004s
I20260709 13:08:46.059480 32480 raft_consensus.cc:3055] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:46.059897 32480 raft_consensus.cc:740] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:46.060045 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:46.060256 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:46.058408 32308 raft_consensus.cc:3055] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:46.061026 30542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43088 (request call id 1549) took 1174 ms. Trace:
I20260709 13:08:46.061565 32308 raft_consensus.cc:740] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:46.048754 32374 raft_consensus.cc:2804] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:46.062276 32374 raft_consensus.cc:697] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:46.063331 32374 consensus_queue.cc:237] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:46.061643 30542 rpcz_store.cc:276] 0709 13:08:44.886322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:45.045761 (+159439us) service_pool.cc:224] Handling call
0709 13:08:45.046074 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:45.046278 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:45.046305 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:45.046762 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 13:08:45.252571 (+205809us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:45.252625 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:45.252722 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:46.052370 (+799648us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:08:46.060543 (+  8173us) raft_consensus.cc:1685] finished
0709 13:08:46.060562 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:46.060850 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44389120,"thread_start_us":205285,"threads_started":1,"wal-append.queue_time_us":205459}
I20260709 13:08:46.066018 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:46.066257 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:46.067488 30542 raft_consensus.cc:1240] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:46.067581 30550 raft_consensus.cc:1240] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:46.061074 30547 raft_consensus.cc:2393] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 5: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:08:46.068779 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:46.070287 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:46.070580 30468 raft_consensus.cc:1240] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:46.071049 30469 raft_consensus.cc:2393] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 5: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:46.061100 32480 consensus_queue.cc:260] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:46.061306 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:46.076741 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:46.079732 30617 raft_consensus.cc:1275] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:46.080788 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:46.081140 32501 raft_consensus.cc:3060] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:46.056769 32479 raft_consensus.cc:740] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:46.082863 30545 raft_consensus.cc:2468] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
I20260709 13:08:46.085952 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:46.088871 32480 raft_consensus.cc:3060] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:46.089697 30543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43088 (request call id 1530) took 2099 ms. Trace:
I20260709 13:08:46.090109 30543 rpcz_store.cc:276] 0709 13:08:43.989719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.009086 (+ 19367us) service_pool.cc:224] Handling call
0709 13:08:44.928131 (+919045us) spinlock_profiling.cc:243] Waited 4.71 ms on lock 0x7b5800028598. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780e43b71 00007fc780e43eee 0000000000375939 00007fc788eb71e0 00007fc788f800c4 00007fc788f80131 00007fc788f41fc0 00007fc788f2c929 00007fc788f2c3d2 00007fc7824a3bd4
0709 13:08:44.928326 (+   195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:45.128215 (+199889us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:46.089254 (+961039us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b54003386d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:46.089518 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":438114432}
I20260709 13:08:46.052551 32395 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:46.095083 32479 consensus_queue.cc:260] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:46.096340 30473 raft_consensus.cc:2468] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 3.
I20260709 13:08:46.096498 32479 raft_consensus.cc:3060] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:46.099254 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:46.086877 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:46.110741 32254 consensus_queue.cc:1059] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:46.112102 30469 raft_consensus.cc:1275] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:46.112396 32355 raft_consensus.cc:3055] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:46.112746 32355 raft_consensus.cc:740] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
W20260709 13:08:46.113919 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.113637 32355 consensus_queue.cc:260] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:46.114594 32355 raft_consensus.cc:3060] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:46.115845 32507 raft_consensus.cc:993] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79: : Instructing follower 092f6eb694fc4bbeab49677cccd880fd to start an election
I20260709 13:08:46.116647 32226 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:46.048219 32514 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:46.122807 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:46.123423 30469 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 2.
I20260709 13:08:46.117008 32454 raft_consensus.cc:2955] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 4 to 6, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:46.124585 31144 raft_consensus.cc:2955] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 4 to 6, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
W20260709 13:08:46.139351 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 98982.4us
I20260709 13:08:46.117297 32350 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:46.121946 30468 raft_consensus.cc:1240] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:46.141744 32142 raft_consensus.cc:1081] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 LEADER]: Signalling peer 092f6eb694fc4bbeab49677cccd880fd to start an election
W20260709 13:08:46.158015 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.164448 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:08:46.180863 30591 leader_election.cc:336] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.800s (SENT)
I20260709 13:08:46.181567 30591 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:46.185501 30516 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:08:46.188323 30469 raft_consensus.cc:1240] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:08:46.203616 30547 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:39952
I20260709 13:08:46.210709 32261 raft_consensus.cc:2804] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:46.211241 32261 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:46.211665 32261 raft_consensus.cc:3060] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:46.204056 32218 raft_consensus.cc:2749] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:46.216955 30547 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:46.217360 30516 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:08:46.217387 30547 raft_consensus.cc:3060] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:46.219931 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:46.200107 32226 consensus_queue.cc:1059] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
W20260709 13:08:46.224363 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 45908.7us
I20260709 13:08:46.226383 30516 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:08:46.223382 30548 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 2.
I20260709 13:08:46.234786 30468 raft_consensus.cc:1240] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:46.236399 30469 raft_consensus.cc:3060] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:46.241009 30516 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:08:46.245354 30467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 1302) took 2332 ms. Trace:
I20260709 13:08:46.245716 30467 rpcz_store.cc:276] 0709 13:08:43.912818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.748923 (+836105us) service_pool.cc:224] Handling call
0709 13:08:44.772466 (+ 23543us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:45.242982 (+470516us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:46.244936 (+1001954us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b540011e754. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:46.245184 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":955798912}
I20260709 13:08:46.252544 30472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 283) took 1073 ms. Trace:
I20260709 13:08:46.252465 32250 raft_consensus.cc:2804] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:46.253305 32250 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:46.253144 30472 rpcz_store.cc:276] 0709 13:08:45.178582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:45.178777 (+   195us) service_pool.cc:224] Handling call
0709 13:08:45.191571 (+ 12794us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:45.410921 (+219350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:45.410989 (+    68us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:45.411065 (+    76us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:45.411145 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:46.248212 (+837067us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b54001216d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:46.248248 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:46.252390 (+  4142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":502778112}
I20260709 13:08:46.254029 32250 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:46.258903 32431 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:46.261585 30516 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:46.262647 32462 raft_consensus.cc:2804] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:46.238269 32460 raft_consensus.cc:2804] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:46.236230 32477 raft_consensus.cc:2804] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:46.265403 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:08:46.267946 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.263072 32462 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:46.274701 32462 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:46.275427 32521 log.cc:927] Time spent T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.636s	user 0.004s	sys 0.000s
W20260709 13:08:46.276073 32529 log.cc:927] Time spent T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 13:08:46.276216 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:46.280471 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:46.281685 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:46.282444 30475 raft_consensus.cc:2393] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 4: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:46.283221 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:46.273295 32514 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:46.284145 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:46.284618 30547 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:46.285346 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:46.286146 30474 raft_consensus.cc:2393] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 5: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:46.286994 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:46.287766 32460 raft_consensus.cc:697] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:46.288360 30516 leader_election.cc:304] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:46.288986 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:46.288785 32460 consensus_queue.cc:237] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:46.289559 30476 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:08:46.290458 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:46.290941 30476 raft_consensus.cc:2468] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
I20260709 13:08:46.291766 32437 raft_consensus.cc:2749] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:46.292165 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:46.295243 30548 raft_consensus.cc:2468] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
W20260709 13:08:46.297091 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 47673.9us
I20260709 13:08:46.301297 30475 raft_consensus.cc:2393] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 6: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:46.301607 30469 raft_consensus.cc:2468] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 2.
I20260709 13:08:46.301975 30472 raft_consensus.cc:1240] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:46.302501 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:46.306059 30472 raft_consensus.cc:1275] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:46.309039 30516 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:46.309950 30516 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:46.311324 32435 raft_consensus.cc:2804] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:46.311903 32435 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:46.311357 32422 raft_consensus.cc:2749] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:46.312454 32435 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:46.303845 30474 raft_consensus.cc:2468] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 2.
W20260709 13:08:46.314117 30591 leader_election.cc:336] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.504s (SENT)
I20260709 13:08:46.316356 30548 raft_consensus.cc:1240] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:46.318747 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:46.319536 30470 raft_consensus.cc:2468] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 2.
I20260709 13:08:46.318678 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:46.315588 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:46.243443 32397 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:46.323069 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:46.329656 30440 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:46.315516 32477 raft_consensus.cc:697] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:46.315153 32395 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:46.316412 32226 consensus_queue.cc:1059] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:08:46.334206 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:46.301115 32350 consensus_queue.cc:1059] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:08:46.334448 30548 raft_consensus.cc:2955] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 4 to 6, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:46.336265 32327 raft_consensus.cc:2804] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:46.336697 32327 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:46.337049 32327 raft_consensus.cc:3060] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:46.332875 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:46.340147 31147 raft_consensus.cc:2368] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 2. Current term is 3.
I20260709 13:08:46.341055 32397 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 3 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:46.344185 32293 consensus_queue.cc:1059] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:08:46.375805 32536 log.cc:927] Time spent T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:08:46.375916 32477 consensus_queue.cc:237] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:46.379951 31143 raft_consensus.cc:2468] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:46.381191 32250 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:46.384495 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.389047 32374 raft_consensus.cc:493] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.389542 32374 raft_consensus.cc:515] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:46.393466 32250 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:46.401726 30547 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:46.405304 32350 raft_consensus.cc:3055] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:46.405841 32350 raft_consensus.cc:740] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:46.407356 31142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48414 (request call id 539) took 1358 ms. Trace:
I20260709 13:08:46.407771 31142 rpcz_store.cc:276] 0709 13:08:45.049171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:45.280629 (+231458us) service_pool.cc:224] Handling call
0709 13:08:45.298121 (+ 17492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:45.600422 (+302301us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:08:45.888258 (+287836us) log.cc:844] Serialized 14 byte log entry
0709 13:08:45.997799 (+109541us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:45.997868 (+    69us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:45.997985 (+   117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:46.407126 (+409141us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b54005ac3d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:46.407172 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:46.407291 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1032,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":73,"spinlock_wait_cycles":694126848,"thread_start_us":108993,"threads_started":1,"wal-append.queue_time_us":182385}
I20260709 13:08:46.411963 32294 raft_consensus.cc:3055] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:46.412356 32294 raft_consensus.cc:740] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:46.413200 32294 consensus_queue.cc:260] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:46.414526 32294 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:46.406860 32350 consensus_queue.cc:260] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:46.419104 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.421710 32346 raft_consensus.cc:493] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.422199 32346 raft_consensus.cc:515] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:46.418846 32374 leader_election.cc:290] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:46.426206 32219 raft_consensus.cc:1064] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79: attempting to promote NON_VOTER cd669586cff44d4bbfcc007e213faab6 to VOTER
I20260709 13:08:46.427064 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:46.426038 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:46.428203 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:46.428310 30468 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:08:46.429230 30374 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57538 (request call id 300) took 10668 ms. Trace:
I20260709 13:08:46.429431 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:46.430217 30472 raft_consensus.cc:2393] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 6: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:46.431970 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:46.432530 30468 raft_consensus.cc:2376] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 2. Re-sending same reply.
I20260709 13:08:46.433619 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:46.433212 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:46.432933 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:46.434532 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:46.446506 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:46.446636 30473 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:08:46.447197 30623 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:08:46.447752 32072 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:46.447932 32534 log.cc:927] Time spent T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:08:46.448864 31143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48414 (request call id 538) took 1409 ms. Trace:
I20260709 13:08:46.449196 32072 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:46.452049 30621 raft_consensus.cc:1275] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:46.452275 32072 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:46.449306 31143 rpcz_store.cc:276] 0709 13:08:45.039120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:45.077092 (+ 37972us) service_pool.cc:224] Handling call
0709 13:08:46.448681 (+1371589us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b5400602a54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:08:46.448807 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2993585536}
I20260709 13:08:46.434303 30624 raft_consensus.cc:2468] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 2.
I20260709 13:08:46.450358 30476 raft_consensus.cc:2393] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 7: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
W20260709 13:08:46.453526 32535 log.cc:927] Time spent T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 13:08:46.454744 30589 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:46.455489 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:46.456013 32479 raft_consensus.cc:2804] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:46.456168 30468 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:46.456550 32479 raft_consensus.cc:697] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:46.457425 32479 consensus_queue.cc:237] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:08:46.460398 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.462445 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:46.463001 30472 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 2.
I20260709 13:08:46.464200 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:46.469177 30476 raft_consensus.cc:1275] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:46.381280 32308 consensus_queue.cc:260] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:46.473052 32308 raft_consensus.cc:3060] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:46.472769 32219 consensus_queue.cc:237] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:46.474550 32327 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:46.481379 32293 raft_consensus.cc:3055] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:46.481843 32293 raft_consensus.cc:740] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:46.482679 32293 consensus_queue.cc:260] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:46.485854 32174 raft_consensus.cc:1027] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 LEADER]: attempt to promote peer cd669586cff44d4bbfcc007e213faab6: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:08:46.485486 32462 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:46.489359 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 184867us
I20260709 13:08:46.490566 31143 raft_consensus.cc:1240] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
W20260709 13:08:46.490688 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.492590 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:46.493110 30468 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 5.
I20260709 13:08:46.493667 30624 raft_consensus.cc:1275] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:46.494019 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:46.494949 32327 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:46.495080 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:46.496529 32435 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:46.497531 32350 raft_consensus.cc:3060] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:46.497848 32261 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:46.498852 32435 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:46.500870 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:46.501454 30624 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:46.502679 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:46.503453 30621 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 3.
I20260709 13:08:46.503791 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:46.504603 30617 raft_consensus.cc:2393] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 5: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:08:46.505612 32346 leader_election.cc:290] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:46.454766 31116 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:46.506788 32072 raft_consensus.cc:2749] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:46.507364 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 52688.1us
I20260709 13:08:46.508093 32514 raft_consensus.cc:1027] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 LEADER]: attempt to promote peer cd669586cff44d4bbfcc007e213faab6: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:08:46.508664 32322 consensus_queue.cc:1059] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:46.509727 32431 raft_consensus.cc:3055] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:46.510087 32431 raft_consensus.cc:740] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:46.510872 32431 consensus_queue.cc:260] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:46.512109 32501 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:46.508107 32072 consensus_queue.cc:1048] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:08:46.513875 32501 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:46.515105 32431 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:46.516567 32501 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:46.495946 32462 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:08:46.495441 31115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:46.522383 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 211468us
I20260709 13:08:46.523017 30624 raft_consensus.cc:2468] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 3.
I20260709 13:08:46.524485 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:46.483868 32293 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:46.528687 30623 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 5.
I20260709 13:08:46.524991 32435 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.536561 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:46.537299 30547 raft_consensus.cc:1240] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:46.538457 30546 raft_consensus.cc:1240] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:46.542404 30469 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:08:46.543766 31115 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:46.429669 30374 rpcz_store.cc:276] 0709 13:08:35.759391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.779011 (+ 19620us) service_pool.cc:224] Handling call
0709 13:08:35.997667 (+218656us) spinlock_profiling.cc:243] Waited 1.29 ms on lock 0x7b540033ff90. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780e43b71 00007fc780e440b2 00007fc789dbda89 00007fc789d55da6 00007fc789d27088 00007fc789e2537e 00007fc7882e62a4 00007fc7882e6232 00007fc7882e6161 00007fc7882e60dc
0709 13:08:36.181274 (+183607us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b540008b954. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed2090 00007fc783f70f3a 00007fc789d271cc 00007fc789e2537e 00007fc7882e62a4 00007fc7882e6232 00007fc7882e6161 00007fc7882e60dc 00007fc7882e5392 00007fc7822a348c 00007fc7822a28c6
0709 13:08:46.427837 (+10246563us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:43.824487 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:43.850570 (+ 26083us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:43.850600 (+    30us) write_op.cc:435] Acquired schema lock
0709 13:08:43.850618 (+    18us) tablet.cc:662] Decoding operations
0709 13:08:43.850956 (+   338us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:43.851024 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:43.851056 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:43.851228 (+   172us) tablet.cc:701] Row locks acquired
0709 13:08:43.851246 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:08:43.851375 (+   129us) write_op.cc:270] Start()
0709 13:08:43.851502 (+   127us) write_op.cc:276] Timestamp: P: 1783602523851335 usec, L: 0
0709 13:08:43.851523 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:08:43.852181 (+   658us) log.cc:844] Serialized 533 byte log entry
0709 13:08:45.090906 (+1238725us) spinlock_profiling.cc:243] Waited 46.3 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:08:45.253497 (+162591us) op_driver.cc:464] REPLICATION: finished
0709 13:08:45.514149 (+260652us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc780e5e0ac 00007fc789cb8ab9 00007fc780e7a69b 00007fc780e7893f 00007fc780e7ac02 00007fc78799eef0
0709 13:08:45.653735 (+139586us) write_op.cc:301] APPLY: starting
0709 13:08:45.653880 (+   145us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:45.654035 (+   155us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:45.654072 (+    37us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:45.654447 (+   375us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:45.654780 (+   333us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:08:45.654854 (+    74us) write_op.cc:312] APPLY: finished
0709 13:08:45.655248 (+   394us) log.cc:844] Serialized 23 byte log entry
0709 13:08:45.657924 (+  2676us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:45.658045 (+   121us) write_op.cc:454] Released schema lock
0709 13:08:45.658111 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:45.665659 (+  7548us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:45.665691 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2189600,"reported_tablets":7,"spinlock_wait_cycles":383212160,"child_traces":[["op",{"apply.queue_time_us":385505,"apply.run_cpu_time_us":2624,"apply.run_wall_time_us":26297,"num_ops":1,"prepare.queue_time_us":687462,"prepare.run_cpu_time_us":14273,"prepare.run_wall_time_us":371855,"raft.queue_time_us":117624,"raft.run_cpu_time_us":37527,"raft.run_wall_time_us":393747,"replication_time_us":1401810,"spinlock_wait_cycles":148293632,"thread_start_us":1343485,"threads_started":4,"wal-append.queue_time_us":370433}]]}
I20260709 13:08:46.551951 32346 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:46.552548 32346 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:46.553731 31115 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:46.545509 31116 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:46.524376 32395 consensus_queue.cc:1048] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:08:46.557953 32346 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:46.526711 32397 consensus_queue.cc:1048] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
W20260709 13:08:46.563649 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.564747 30623 raft_consensus.cc:1275] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:46.568212 31115 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:46.556150 32350 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.573909 32192 raft_consensus.cc:2804] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:46.574379 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:46.575572 32308 raft_consensus.cc:2804] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:46.575649 32300 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:46.583202 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:46.563349 32504 raft_consensus.cc:2804] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:46.578796 30621 raft_consensus.cc:1275] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:46.593636 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:46.546751 32435 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:46.575892 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:46.599038 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:46.596792 30623 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:46.566897 32321 consensus_queue.cc:1048] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:08:46.597424 30617 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:46.608742 30623 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:08:46.604260 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:46.609735 31147 raft_consensus.cc:2468] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 4.
I20260709 13:08:46.610734 32072 raft_consensus.cc:493] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:46.613916 30617 raft_consensus.cc:2468] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:08:46.613695 32072 raft_consensus.cc:515] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:46.580636 32346 consensus_queue.cc:1059] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:08:46.617312 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:46.617584 32346 raft_consensus.cc:3055] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:46.617904 31149 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:46.618007 32346 raft_consensus.cc:740] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:46.618960 32346 consensus_queue.cc:260] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:46.620070 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:46.620177 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:46.620563 31148 raft_consensus.cc:1275] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:46.620678 31146 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:46.599689 32308 raft_consensus.cc:697] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 3 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:46.621022 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:46.621773 32308 consensus_queue.cc:237] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:46.623304 31113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.594422 32192 raft_consensus.cc:697] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 5 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:46.624303 31144 raft_consensus.cc:1275] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:46.624639 32192 consensus_queue.cc:237] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:46.596592 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:46.634241 31143 raft_consensus.cc:1275] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 4 LEARNER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:46.592209 32350 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:46.635197 30620 raft_consensus.cc:1275] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:46.594628 32482 raft_consensus.cc:3055] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:46.620841 30622 raft_consensus.cc:2393] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 5: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
W20260709 13:08:46.645130 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 76963.1us
I20260709 13:08:46.599290 32504 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:46.651924 32504 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:46.646999 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 84157.1us
I20260709 13:08:46.647379 30590 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:46.653869 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:46.654457 30617 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:46.659063 30517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.660319 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:46.661165 30620 raft_consensus.cc:3055] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:46.620673 32300 raft_consensus.cc:2749] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:46.662925 30545 raft_consensus.cc:1275] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:46.661554 30620 raft_consensus.cc:740] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
W20260709 13:08:46.666237 30589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.668367 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:46.667136 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:46.691130 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:46.668936 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:46.696444 30547 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:46.696749 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:46.646152 32482 raft_consensus.cc:740] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:46.643323 30624 raft_consensus.cc:2468] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 7.
I20260709 13:08:46.706519 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:46.699613 30623 raft_consensus.cc:2368] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 2. Current term is 3.
I20260709 13:08:46.707099 30621 raft_consensus.cc:2468] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 2.
I20260709 13:08:46.701203 30549 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 3.
I20260709 13:08:46.664467 32507 raft_consensus.cc:2749] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:46.671908 32346 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:46.717636 31115 leader_election.cc:304] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:46.716096 31146 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 3.
I20260709 13:08:46.716205 30516 leader_election.cc:400] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Vote denied by peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453) with higher term. Message: Invalid argument: T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 2. Current term is 3.
I20260709 13:08:46.686933 32321 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.720463 32321 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:46.722417 32321 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:46.723376 32350 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:46.717139 30550 raft_consensus.cc:2393] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 2: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:08:46.726209 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:46.726792 30475 raft_consensus.cc:2468] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 3.
I20260709 13:08:46.724470 30547 raft_consensus.cc:2468] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 3.
I20260709 13:08:46.686604 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:46.731397 30617 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 3.
I20260709 13:08:46.727993 31116 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:46.708549 32072 leader_election.cc:290] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:46.743597 30516 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:46.668062 32374 consensus_queue.cc:1048] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:08:46.754149 31114 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:08:46.747406 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:46.741945 32300 raft_consensus.cc:2804] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:46.738440 32321 raft_consensus.cc:2804] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:08:46.762933 30591 leader_election.cc:336] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.998s (SENT)
I20260709 13:08:46.763535 30591 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
W20260709 13:08:46.764071 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:46.764880 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.738862 31143 raft_consensus.cc:2468] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:46.733731 32462 consensus_queue.cc:1048] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
W20260709 13:08:46.786782 30591 leader_election.cc:336] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.115s (SENT)
I20260709 13:08:46.749347 31142 raft_consensus.cc:1275] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:08:46.787252 30591 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:46.788674 32501 raft_consensus.cc:2749] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:46.738018 32250 consensus_queue.cc:1048] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:08:46.791390 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:46.762828 32325 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.792142 32325 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:46.761420 32477 raft_consensus.cc:2804] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:46.794298 32477 raft_consensus.cc:697] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:46.794329 32325 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:46.795302 32477 consensus_queue.cc:237] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:46.743266 32422 consensus_queue.cc:1048] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:08:46.761490 32322 raft_consensus.cc:2764] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:08:46.752012 32435 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:46.800093 32421 consensus_queue.cc:1048] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:46.756300 32472 consensus_queue.cc:1048] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:08:46.778291 32174 raft_consensus.cc:2749] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:46.792152 30617 raft_consensus.cc:2393] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 5: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:08:46.800175 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:46.805511 32174 consensus_queue.cc:1048] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:46.782246 31146 raft_consensus.cc:1275] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:46.809553 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:46.810762 30546 raft_consensus.cc:2468] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
I20260709 13:08:46.762008 32300 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:46.789731 30591 leader_election.cc:336] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.039s (SENT)
I20260709 13:08:46.766237 32321 raft_consensus.cc:493] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:46.811946 30440 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:46.830312 30617 raft_consensus.cc:1240] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:46.830798 31149 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:08:46.832068 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:46.813805 30591 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:46.833698 32507 raft_consensus.cc:2749] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:46.834986 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 45274.5us
W20260709 13:08:46.854417 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 110874us
I20260709 13:08:46.856961 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:46.818089 32321 raft_consensus.cc:3060] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:46.863925 30516 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:46.864429 30617 raft_consensus.cc:2468] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 3.
I20260709 13:08:46.812103 32300 raft_consensus.cc:3060] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:46.868798 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:46.836474 32350 raft_consensus.cc:2804] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:08:46.872665 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.821091 31142 raft_consensus.cc:2468] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 5.
I20260709 13:08:46.870597 30516 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:08:46.880154 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.877538 31115 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:46.864174 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:46.811774 32504 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:46.883419 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:46.873870 32477 raft_consensus.cc:2804] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:46.885897 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:46.891781 30546 raft_consensus.cc:2468] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 3.
I20260709 13:08:46.891736 30516 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:08:46.873445 32460 consensus_queue.cc:1048] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:08:46.896389 32477 raft_consensus.cc:697] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:46.897433 32477 consensus_queue.cc:237] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:46.812834 32482 consensus_queue.cc:260] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:46.906587 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:08:46.907626 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.916456 32462 raft_consensus.cc:2804] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:46.917089 32462 raft_consensus.cc:697] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:46.917291 30620 consensus_queue.cc:260] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:46.918282 30620 raft_consensus.cc:3060] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:46.918306 32462 consensus_queue.cc:237] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:46.890043 32435 raft_consensus.cc:2804] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:46.921236 32435 raft_consensus.cc:697] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 7 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:46.921355 32261 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:46.922369 32435 consensus_queue.cc:237] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:46.924016 31147 raft_consensus.cc:1275] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:08:46.927258 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.927327 32550 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.927914 32550 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:46.935087 30623 raft_consensus.cc:1240] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 3. Current term is 4. Ops: [2.2-3.3]
I20260709 13:08:46.880347 32350 raft_consensus.cc:697] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
W20260709 13:08:46.944660 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 50391.5us
I20260709 13:08:46.945577 30550 raft_consensus.cc:1275] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:46.952605 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:46.959163 31149 raft_consensus.cc:2468] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 4.
I20260709 13:08:46.963030 30516 leader_election.cc:400] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 election: Vote denied by peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) with higher term. Message: Invalid argument: T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 2. Current term is 3.
I20260709 13:08:46.963320 30516 leader_election.cc:403] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:08:46.986887 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:46.987728 30624 raft_consensus.cc:2393] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 4: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:08:46.989130 30549 raft_consensus.cc:1240] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:47.011210 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:47.012049 30623 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 7.
I20260709 13:08:47.010105 32287 raft_consensus.cc:2804] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:47.066910 31150 raft_consensus.cc:2468] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:08:46.991024 32174 consensus_queue.cc:1059] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
W20260709 13:08:47.075258 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 112342us
I20260709 13:08:47.037357 32293 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.078565 30516 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:47.076409 32421 raft_consensus.cc:2749] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) with higher term. Message: Invalid argument: T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 2. Current term is 3.
I20260709 13:08:47.055217 32287 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.099529 30516 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:47.082978 32550 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:47.097503 32287 raft_consensus.cc:3060] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:47.071007 32321 raft_consensus.cc:515] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:47.102926 32557 raft_consensus.cc:2804] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:47.140322 30620 raft_consensus.cc:2468] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 6.
I20260709 13:08:47.121711 32421 raft_consensus.cc:2804] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:47.102100 32293 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:08:47.144869 30441 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.088678 32350 consensus_queue.cc:237] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:47.122298 32460 consensus_queue.cc:1048] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:08:47.170529 30620 raft_consensus.cc:1275] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:08:47.146863 32421 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:47.198401 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 123999us
I20260709 13:08:47.159070 32557 raft_consensus.cc:697] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 3 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:47.191706 32421 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:47.223701 32561 log.cc:927] Time spent T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:08:47.202390 32308 consensus_queue.cc:1048] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:08:47.221356 32174 consensus_queue.cc:1059] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:08:47.211582 32300 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:47.237509 32346 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.229278 32501 consensus_queue.cc:1048] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
W20260709 13:08:47.242245 30441 connection.cc:256] RPC call timeout handler was delayed by -2.0239130930000329s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1916s for a response
W20260709 13:08:47.251276 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 162320us
I20260709 13:08:47.256685 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:47.257706 30469 raft_consensus.cc:2393] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 2: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:47.264560 32504 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:47.269555 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:47.270467 30475 raft_consensus.cc:2393] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 5: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:47.271473 32507 raft_consensus.cc:3055] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:47.271914 32507 raft_consensus.cc:740] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:47.272220 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:47.272698 32507 consensus_queue.cc:260] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:47.274037 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:47.274824 30472 raft_consensus.cc:2410] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:47.276312 30473 raft_consensus.cc:1275] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:47.276830 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:47.277333 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:47.274185 32507 raft_consensus.cc:3060] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:47.278497 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:47.281445 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:47.281530 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
W20260709 13:08:47.283967 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.285257 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:47.286689 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:47.292301 30476 raft_consensus.cc:2468] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:08:47.294637 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:47.295668 30468 raft_consensus.cc:2368] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 4. Current term is 5.
I20260709 13:08:47.302299 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:47.304052 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:47.304684 30624 raft_consensus.cc:2468] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 2.
I20260709 13:08:47.304725 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:47.306613 30621 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:47.307019 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:47.263468 32287 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:47.308743 31144 raft_consensus.cc:1240] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:08:47.313513 32287 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:08:47.315730 32572 log.cc:927] Time spent T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:08:47.318320 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:47.321069 30476 raft_consensus.cc:2468] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:47.322588 30476 raft_consensus.cc:1240] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:47.301582 32293 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:47.290256 32346 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:47.332441 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:47.336295 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:47.337108 30471 raft_consensus.cc:3060] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:47.321147 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:47.344789 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:47.320286 32300 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:08:47.351006 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 137396us
W20260709 13:08:47.352306 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 54365.6us
I20260709 13:08:47.354952 30469 raft_consensus.cc:2393] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 7: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:47.248211 32557 consensus_queue.cc:237] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:47.357704 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:47.366852 30467 raft_consensus.cc:2393] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 2: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
W20260709 13:08:47.358795 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.362453 32482 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:47.377841 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:47.378460 30546 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:47.376209 30547 raft_consensus.cc:1275] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:47.368677 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:47.380987 30476 raft_consensus.cc:2393] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 5: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:47.381841 30516 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:47.387888 30546 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 4.
I20260709 13:08:47.391245 30621 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 4.
I20260709 13:08:47.390200 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:47.392794 30476 raft_consensus.cc:2393] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 4: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:47.384383 32460 raft_consensus.cc:2804] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:47.398614 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:47.398753 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:47.404975 30476 raft_consensus.cc:2468] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
W20260709 13:08:47.409238 30591 leader_election.cc:336] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.535s (SENT)
I20260709 13:08:47.409889 30591 leader_election.cc:304] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:47.414631 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:08:47.415145 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.415359 30476 raft_consensus.cc:2468] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 2.
I20260709 13:08:47.429030 32480 raft_consensus.cc:3055] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:47.429541 32480 raft_consensus.cc:740] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:47.430449 32480 consensus_queue.cc:260] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:47.435056 30474 raft_consensus.cc:1275] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:47.436192 30474 raft_consensus.cc:1240] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:47.439780 30475 raft_consensus.cc:2410] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:47.441258 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:47.442031 30471 raft_consensus.cc:2468] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
I20260709 13:08:47.431615 32480 raft_consensus.cc:3060] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:47.425953 32578 log.cc:927] Time spent T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:08:47.423215 32574 raft_consensus.cc:2749] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:47.492336 32421 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:47.493637 32346 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:47.498351 31115 leader_election.cc:304] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:08:47.490795 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 90406.2us
W20260709 13:08:47.515261 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 106082us
W20260709 13:08:47.502665 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:47.503981 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.506955 32472 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.516304 31115 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:47.535140 30516 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:08:47.535878 30591 leader_election.cc:336] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.633s (SENT)
I20260709 13:08:47.536305 30591 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
W20260709 13:08:47.538018 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.532202 32480 raft_consensus.cc:493] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.542220 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:47.545261 32574 raft_consensus.cc:2749] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:47.547284 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:47.543673 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:47.541544 32480 raft_consensus.cc:515] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:47.551152 31151 raft_consensus.cc:2368] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 3. Current term is 4.
I20260709 13:08:47.553663 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
W20260709 13:08:47.555395 30591 leader_election.cc:336] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.211s (SENT)
I20260709 13:08:47.556625 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:47.527268 32550 raft_consensus.cc:2804] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:47.562219 30591 leader_election.cc:304] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:47.533070 32460 raft_consensus.cc:697] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 6 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:47.570098 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:47.537644 32250 raft_consensus.cc:493] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:47.553078 32575 raft_consensus.cc:2804] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:47.589244 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:47.566829 32550 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.572355 32308 raft_consensus.cc:2804] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:47.538224 32472 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:47.616150 30590 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
W20260709 13:08:47.618141 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 62783.4us
I20260709 13:08:47.618850 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:08:47.619608 30591 leader_election.cc:336] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.760s (SENT)
I20260709 13:08:47.620042 31142 raft_consensus.cc:1275] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:47.620136 30591 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:47.621155 32585 raft_consensus.cc:2749] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:47.621176 32329 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.622023 32329 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:47.623296 32480 leader_election.cc:290] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:47.623687 32421 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:47.623898 32594 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:47.624536 32594 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:47.626955 32594 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:47.619654 30625 raft_consensus.cc:2393] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 5: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:08:47.606784 32550 raft_consensus.cc:3060] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:47.594779 32250 raft_consensus.cc:515] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:47.616856 32575 raft_consensus.cc:697] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
W20260709 13:08:47.650671 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 53559.6us
I20260709 13:08:47.629451 32308 raft_consensus.cc:697] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:47.606166 32501 consensus_queue.cc:1048] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:08:47.648416 32422 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:47.643492 32374 raft_consensus.cc:2764] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:08:47.662925 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 50441.1us
I20260709 13:08:47.664903 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:47.665573 30617 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:47.670459 30441 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:47.673465 30441 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:47.674667 32308 consensus_queue.cc:237] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:47.676388 32587 log.cc:927] Time spent T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:08:47.651429 32294 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:47.689661 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.687409 32294 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:47.692875 30591 leader_election.cc:336] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.763s (SENT)
I20260709 13:08:47.695765 32294 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:47.690814 32577 raft_consensus.cc:2749] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:47.695917 32542 consensus_queue.cc:1059] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:47.664361 32422 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:47.703701 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:47.704556 30441 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:47.708678 30617 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 8.
I20260709 13:08:47.710198 32575 consensus_queue.cc:237] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:47.711278 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:47.660473 32460 consensus_queue.cc:237] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:47.678565 32250 leader_election.cc:290] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:47.678159 32576 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
W20260709 13:08:47.817276 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 105670us
I20260709 13:08:47.991770 30548 raft_consensus.cc:2393] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 2: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:08:47.913703 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:47.992667 30472 raft_consensus.cc:2393] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 5: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:47.725190 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:47.996203 30546 raft_consensus.cc:3060] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:47.690984 32350 raft_consensus.cc:2804] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:08:47.931007 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:47.760182 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 67354us
W20260709 13:08:48.001998 30591 leader_election.cc:336] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.792s (SENT)
W20260709 13:08:47.996976 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.993227 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:48.002370 30591 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
W20260709 13:08:48.005203 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 300694us
I20260709 13:08:48.006067 30441 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:48.004674 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:08:48.008252 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:48.008024 30517 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.671s (SENT) [suppressed 45 similar messages]
W20260709 13:08:47.946216 32598 log.cc:927] Time spent T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.256s	user 0.002s	sys 0.000s
W20260709 13:08:47.948132 32592 log.cc:927] Time spent T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.259s	user 0.002s	sys 0.000s
W20260709 13:08:47.835495 32599 log.cc:927] Time spent T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:08:48.011373 32600 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.008064 30616 raft_consensus.cc:1217] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 LEADER]: Deduplicated request from leader. Original: 1.4->[4.5-4.5]   Dedup: 4.5->[]
I20260709 13:08:48.016939 32422 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:47.757192 32397 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:48.040577 30616 raft_consensus.cc:1240] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 LEADER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:08:48.040500 32600 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:48.041093 30470 raft_consensus.cc:1275] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:48.040900 32397 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:48.018345 32603 log.cc:927] Time spent T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
W20260709 13:08:47.903797 32601 log.cc:927] Time spent T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 13:08:47.929445 32472 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:48.004606 32576 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:47.900151 32542 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.817440 32504 consensus_queue.cc:1048] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.216s
I20260709 13:08:47.692698 32557 consensus_queue.cc:1048] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.318s
I20260709 13:08:48.003743 32501 raft_consensus.cc:2749] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:47.725919 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:48.042723 32600 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:48.054078 31142 raft_consensus.cc:2393] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 5: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:47.758257 32574 raft_consensus.cc:2749] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:48.054759 30476 raft_consensus.cc:3055] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:48.055179 30476 raft_consensus.cc:740] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:48.055500 32397 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:48.010644 32579 raft_consensus.cc:2804] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:48.025997 32294 raft_consensus.cc:2749] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:48.056883 32579 raft_consensus.cc:697] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 4 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:48.026247 30623 raft_consensus.cc:2468] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 2.
I20260709 13:08:48.026751 30546 raft_consensus.cc:2468] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 4.
I20260709 13:08:48.057736 32550 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:48.057808 32579 consensus_queue.cc:237] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:48.060081 32329 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:48.061751 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:48.065321 32550 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 3 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:08:48.065543 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:48.031052 30374 catalog_manager.cc:5697] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: config changed from index 3 to 4, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:48.025398 30441 leader_election.cc:400] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Vote denied by peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453) with higher term. Message: Invalid argument: T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 3. Current term is 4.
I20260709 13:08:48.033998 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:48.035771 30468 raft_consensus.cc:2955] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
W20260709 13:08:48.020957 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 159732us
W20260709 13:08:48.072741 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 47482.1us
I20260709 13:08:48.073540 30441 leader_election.cc:400] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 election: Vote denied by peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) with higher term. Message: Invalid argument: T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 4. Current term is 5.
I20260709 13:08:48.073935 30516 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:48.074285 30441 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:48.075976 32482 raft_consensus.cc:2764] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:08:48.075505 30441 leader_election.cc:304] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:48.037591 30618 raft_consensus.cc:1275] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:48.039852 31144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48426 (request call id 500) took 1151 ms. Trace:
I20260709 13:08:48.043824 32374 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.082661 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:48.083132 32374 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:48.045425 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:48.084333 31149 raft_consensus.cc:2410] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:08:47.844769 32321 leader_election.cc:290] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:48.048797 32542 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:48.086795 32542 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:48.086318 32583 raft_consensus.cc:2955] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index 2 to 4, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:48.080982 31144 rpcz_store.cc:276] 0709 13:08:46.888768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.889469 (+   701us) service_pool.cc:224] Handling call
0709 13:08:46.895556 (+  6087us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:47.309206 (+413650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:48.039626 (+730420us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b54000ad7d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:48.039761 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":949590272}
I20260709 13:08:48.090104 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:48.090382 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:48.090719 30470 raft_consensus.cc:2468] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 4.
I20260709 13:08:48.091104 31142 raft_consensus.cc:2468] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
I20260709 13:08:48.091969 30623 raft_consensus.cc:2468] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 2.
I20260709 13:08:48.051024 32576 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:48.054518 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:48.056001 30476 consensus_queue.cc:260] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:48.092971 30476 raft_consensus.cc:3060] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:48.094839 30474 raft_consensus.cc:1275] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:08:48.027181 32350 raft_consensus.cc:697] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 5 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:48.079124 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:48.096901 31150 raft_consensus.cc:2393] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 4: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:48.096475 32350 consensus_queue.cc:237] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:48.082568 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:48.097666 30620 raft_consensus.cc:3060] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:48.099191 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:48.076010 32540 raft_consensus.cc:2804] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:48.096498 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:48.101331 31114 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:08:48.102234 30374 catalog_manager.cc:5697] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 1 to 4, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 4 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:48.105825 30622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47446 (request call id 1921) took 1141 ms. Trace:
I20260709 13:08:48.107406 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:48.106189 30622 rpcz_store.cc:276] 0709 13:08:46.964658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.712116 (+747458us) service_pool.cc:224] Handling call
0709 13:08:47.997160 (+285044us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:48.049727 (+ 52567us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:48.049759 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:48.049824 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:48.049858 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:48.105397 (+ 55539us) spinlock_profiling.cc:243] Waited 52.4 ms on lock 0x7b54001e3054. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:48.105436 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:48.105772 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120476416}
I20260709 13:08:48.109766 30374 catalog_manager.cc:5697] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:48.112421 32540 raft_consensus.cc:697] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 8 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:48.128921 32540 consensus_queue.cc:237] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:48.108400 32542 raft_consensus.cc:2749] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:48.130693 32591 consensus_queue.cc:1059] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:48.115285 32374 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:48.115392 30625 raft_consensus.cc:1275] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:08:48.120920 31116 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:48.121536 30476 raft_consensus.cc:1275] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 13:08:48.137610 30476 pending_rounds.cc:85] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326: Aborting all ops after (but not including) 4
I20260709 13:08:48.122107 30516 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:08:48.125293 32183 raft_consensus.cc:2804] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:48.126641 30374 catalog_manager.cc:5697] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 2 to 5, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 5 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:48.144511 32183 raft_consensus.cc:697] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:48.145701 32427 consensus_queue.cc:1048] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:48.149641 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:48.150306 31146 raft_consensus.cc:2468] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 1.
I20260709 13:08:48.151420 32594 raft_consensus.cc:493] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.151983 30590 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:48.151916 32594 raft_consensus.cc:515] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:48.138036 30476 pending_rounds.cc:107] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326: Aborting uncommitted NO_OP operation due to leader change: 4.5
I20260709 13:08:48.139528 31115 leader_election.cc:304] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:48.145265 30374 catalog_manager.cc:5697] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 2 to 4, leader changed from cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 4 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:48.134011 30620 raft_consensus.cc:2468] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 3.
I20260709 13:08:48.145427 32183 consensus_queue.cc:237] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:48.262430 30591 leader_election.cc:336] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.026s (SENT)
I20260709 13:08:48.266126 30591 leader_election.cc:304] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:48.266098 30476 raft_consensus.cc:2889] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:48.267866 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:08:48.180428 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 58385.4us
I20260709 13:08:48.272043 30374 catalog_manager.cc:5697] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 1 to 5, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 5 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:48.274502 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 135070us
I20260709 13:08:48.274662 31114 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:48.152421 31150 raft_consensus.cc:2955] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index 2 to 4, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:48.281291 31115 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:48.282735 30374 catalog_manager.cc:5697] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: config changed from index 4 to 6, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:48.279367 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 170271us
I20260709 13:08:48.284869 30374 catalog_manager.cc:5697] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:48.287122 30374 catalog_manager.cc:5697] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 1 to 3, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 3 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
I20260709 13:08:48.181157 32600 raft_consensus.cc:2804] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:48.298406 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:48.312150 30549 raft_consensus.cc:2468] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:48.300688 30374 catalog_manager.cc:5697] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 2 to 4, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 4 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:48.173888 32374 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.315035 31115 leader_election.cc:304] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
W20260709 13:08:48.317798 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 55466.4us
W20260709 13:08:48.319592 32308 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.004s	sys 0.013s
I20260709 13:08:48.314646 30374 catalog_manager.cc:5697] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
W20260709 13:08:48.283077 32577 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:08:48.328528 30374 catalog_manager.cc:5697] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:48.329993 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 321961us
W20260709 13:08:48.330546 30517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:48.152846 32573 raft_consensus.cc:2804] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:48.278379 32321 raft_consensus.cc:2804] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:48.331482 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:48.331954 30374 catalog_manager.cc:5697] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 1 to 3, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 3 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
I20260709 13:08:48.344254 30374 catalog_manager.cc:5697] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 2 to 4, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 4 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:48.329679 32308 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.005s	sys 0.013s
I20260709 13:08:48.296954 32542 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:48.279721 32454 raft_consensus.cc:2749] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:48.312582 32300 raft_consensus.cc:2749] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:48.347715 30374 catalog_manager.cc:5697] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 1 to 4, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 4 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:48.348816 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:48.318465 32600 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:48.332011 32325 raft_consensus.cc:2804] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:48.333516 32397 raft_consensus.cc:2804] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:48.363504 32397 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:48.363966 32397 raft_consensus.cc:3060] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:48.364684 31144 raft_consensus.cc:1275] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:08:48.333292 32374 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:48.367213 32374 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:48.312168 32550 consensus_queue.cc:1048] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:08:48.338617 32573 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:48.369660 32573 raft_consensus.cc:3060] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:48.369799 32542 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:08:48.372028 32542 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:48.376767 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:48.378652 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:48.380432 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:48.359328 30374 catalog_manager.cc:5697] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 1 to 4, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3), now has a pending config: VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1), VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2), VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3), VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 4 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:48.380144 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:48.388692 30374 catalog_manager.cc:5697] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 1 to 3, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 3 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:48.389513 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 50391.8us
W20260709 13:08:48.393275 30591 leader_election.cc:336] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.162s (SENT)
I20260709 13:08:48.393895 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:48.362670 32600 raft_consensus.cc:3060] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:48.359166 32395 raft_consensus.cc:2804] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:48.375620 32325 raft_consensus.cc:697] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 3 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:48.391490 30589 leader_election.cc:304] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:48.398793 30591 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:48.399976 30589 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:48.401175 32479 raft_consensus.cc:2804] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:48.401238 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:48.401736 32479 raft_consensus.cc:493] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:48.402148 32479 raft_consensus.cc:3060] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:48.402467 32174 raft_consensus.cc:2749] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:48.404630 32507 raft_consensus.cc:2749] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:48.436867 30548 raft_consensus.cc:1275] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:48.428535 32321 raft_consensus.cc:697] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
W20260709 13:08:48.453832 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:48.511180 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:48.536190 30591 leader_election.cc:336] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.725s (SENT)
W20260709 13:08:48.537760 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:48.532626 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 85499us
I20260709 13:08:48.536755 30591 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:48.554279 30620 raft_consensus.cc:1275] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:08:48.581277 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 144423us
W20260709 13:08:48.587803 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 187877us
I20260709 13:08:48.592543 30589 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
W20260709 13:08:48.595865 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 310084us
I20260709 13:08:48.596618 30441 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:48.536656 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:48.539562 32350 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.441372 32462 consensus_queue.cc:1059] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.156s
I20260709 13:08:48.440754 32477 consensus_queue.cc:1048] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.149s
W20260709 13:08:48.617503 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:48.597499 30517 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:48.611063 32629 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.611958 32504 consensus_queue.cc:1048] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:08:48.626420 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 90267.3us
W20260709 13:08:48.637413 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 78471.6us
I20260709 13:08:48.640916 30441 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:48.597328 32174 raft_consensus.cc:2749] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:48.600355 32574 raft_consensus.cc:2749] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:48.648761 30441 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:48.641036 31142 raft_consensus.cc:1240] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:08:48.639464 32577 raft_consensus.cc:2749] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:48.611225 30543 raft_consensus.cc:2468] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 2.
W20260709 13:08:48.651388 32627 log.cc:927] Time spent T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:08:48.647748 32300 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.606722 32350 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:08:48.680809 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 87110.1us
I20260709 13:08:48.651153 32482 raft_consensus.cc:2749] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:48.645468 32542 consensus_queue.cc:1059] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:08:48.665221 32628 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.658360 32609 raft_consensus.cc:3055] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:48.696290 32609 raft_consensus.cc:740] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:48.697129 32609 consensus_queue.cc:260] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:48.679085 32321 consensus_queue.cc:237] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:48.698285 32609 raft_consensus.cc:3060] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:48.702386 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:48.703024 30616 raft_consensus.cc:2468] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 2.
I20260709 13:08:48.653654 32594 leader_election.cc:290] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:48.654644 32437 raft_consensus.cc:2749] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:48.646061 32477 consensus_queue.cc:1048] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:08:48.640568 32325 consensus_queue.cc:237] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:48.690696 32583 consensus_meta.cc:287] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.574s	user 0.003s	sys 0.006s
I20260709 13:08:48.680626 30542 raft_consensus.cc:2955] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index 2 to 4, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:48.693334 32542 raft_consensus.cc:3055] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:48.678257 32422 raft_consensus.cc:3055] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:48.645503 32629 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:48.686357 32579 raft_consensus.cc:2749] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:48.695957 32606 consensus_queue.cc:1048] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:08:48.680747 32300 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:48.725827 32542 raft_consensus.cc:740] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:48.795274 32174 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.729072 32422 raft_consensus.cc:740] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:48.794884 32350 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:48.815505 32174 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:48.818928 32174 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:48.814459 32422 consensus_queue.cc:260] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:48.819375 32616 log.cc:927] Time spent T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 13:08:48.721880 32628 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:48.820876 32630 consensus_queue.cc:1059] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:08:48.822117 32437 raft_consensus.cc:3055] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:48.822477 32437 raft_consensus.cc:740] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:48.823294 32437 consensus_queue.cc:260] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:48.824149 31142 raft_consensus.cc:1275] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:08:48.814560 32615 log.cc:927] Time spent T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.316s	user 0.001s	sys 0.000s
W20260709 13:08:48.824932 32612 log.cc:927] Time spent T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260709 13:08:48.823138 32628 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:48.826586 32600 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:48.829546 30546 raft_consensus.cc:2368] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 2. Current term is 3.
I20260709 13:08:48.858762 32629 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:48.787669 32636 consensus_queue.cc:1048] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.083s
I20260709 13:08:48.787873 32594 consensus_queue.cc:1059] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.076s
W20260709 13:08:48.864159 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 215485us
I20260709 13:08:48.864406 32594 raft_consensus.cc:3055] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:48.864830 32594 raft_consensus.cc:740] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:48.865664 32594 consensus_queue.cc:260] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:48.865785 32542 consensus_queue.cc:260] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:48.864025 32397 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:48.866811 32600 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:08:48.875223 30591 leader_election.cc:336] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.085s (SENT)
W20260709 13:08:48.958479 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 85383.7us
W20260709 13:08:48.959223 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 84044.7us
I20260709 13:08:48.959367 30441 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:08:48.960242 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 285628us
W20260709 13:08:48.978438 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:48.984928 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:48.987454 30441 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:48.989018 30441 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:48.866850 32594 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:48.867357 32542 raft_consensus.cc:3060] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:48.927424 30468 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.032s	sys 0.022s
W20260709 13:08:48.994930 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:48.995611 30441 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:48.996306 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:48.996658 31150 raft_consensus.cc:3060] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:48.997681 32321 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.869475 32300 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:08:48.987819 32573 consensus_meta.cc:287] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.618s	user 0.004s	sys 0.005s
W20260709 13:08:49.044879 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.019245 32579 raft_consensus.cc:2749] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:49.047938 32482 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:48.982717 32477 consensus_queue.cc:1048] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 13:08:49.053630 32350 raft_consensus.cc:2749] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:49.100858 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 105329us
I20260709 13:08:49.107909 30441 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:49.109383 30441 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:08:49.110550 30516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:49.112095 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 318637us
W20260709 13:08:49.113128 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 436593us
W20260709 13:08:49.100020 32479 consensus_meta.cc:287] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.697s	user 0.009s	sys 0.003s
I20260709 13:08:49.111354 32482 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:49.095149 32454 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:08:49.102316 30468 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.033s	sys 0.023s
I20260709 13:08:49.098455 32460 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:49.127702 31150 raft_consensus.cc:2468] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 3.
I20260709 13:08:49.105090 32294 raft_consensus.cc:2749] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:49.111500 32577 raft_consensus.cc:2749] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:49.121225 32579 raft_consensus.cc:2749] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:49.103578 32573 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:49.104385 32321 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:49.148829 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:49.150449 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.137115 32219 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.120738 32479 raft_consensus.cc:515] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:49.133538 32454 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:49.146721 32350 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.136693 32460 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:49.151355 30468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 1352) took 1715 ms. Trace:
W20260709 13:08:49.175613 30591 leader_election.cc:336] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.650s (SENT)
W20260709 13:08:49.176220 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 66927.5us
I20260709 13:08:49.176100 30591 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:49.176549 32397 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:49.180476 32397 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.181027 32397 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:49.182368 32611 log.cc:927] Time spent T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.638s	user 0.019s	sys 0.028s
I20260709 13:08:49.183131 32397 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:49.164736 32219 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:49.185904 32219 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:49.186275 32573 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:49.191254 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:49.184103 32482 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:49.193253 30546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35278 (request call id 366) took 1086 ms. Trace:
I20260709 13:08:49.193743 32183 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:49.193624 30546 rpcz_store.cc:276] 0709 13:08:48.106498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.128296 (+ 21798us) service_pool.cc:224] Handling call
0709 13:08:49.193059 (+1064763us) spinlock_profiling.cc:243] Waited 561 ms on lock 0x7b5400358254. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:08:49.193178 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1289336320}
I20260709 13:08:49.194413 32655 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.194336 32183 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:49.196441 32183 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:49.194958 32655 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:49.197111 32654 raft_consensus.cc:2749] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:08:49.198477 30517 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.014s	sys 0.021s
W20260709 13:08:49.198839 30517 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.016s	sys 0.022s
I20260709 13:08:49.175997 32350 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
W20260709 13:08:49.199095 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 505975us
I20260709 13:08:49.205631 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:49.170331 32640 raft_consensus.cc:2749] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:49.224509 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:49.199790 30517 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:49.225255 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:49.226022 30620 raft_consensus.cc:2368] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 2. Current term is 3.
I20260709 13:08:49.219061 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:49.227596 32609 raft_consensus.cc:2749] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:49.227506 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:49.227943 30543 raft_consensus.cc:1275] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:49.207887 32655 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:49.230232 32640 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:49.230822 32640 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:49.233619 32640 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:49.234267 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:49.235275 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:49.236109 30543 raft_consensus.cc:2368] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 2. Current term is 3.
I20260709 13:08:49.236212 32640 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.236928 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:49.236779 32640 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:49.237490 30546 raft_consensus.cc:2468] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 3.
I20260709 13:08:49.174937 30468 rpcz_store.cc:276] 0709 13:08:47.434587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.437471 (+  2884us) service_pool.cc:224] Handling call
0709 13:08:48.035243 (+597772us) spinlock_profiling.cc:243] Waited 3.71 ms on lock 0x7b5800002d98. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780e43b71 00007fc780e43a22 00007fc789d5cc09 00007fc788eb6ee0 00007fc788f800ab 00007fc788f80131 00007fc788f41fc0 00007fc788f2c929 00007fc788f2c3d2 00007fc7824a3bd4
0709 13:08:48.035451 (+   208us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:48.035660 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:08:48.405369 (+369709us) log.cc:844] Serialized 14 byte log entry
0709 13:08:49.122057 (+716688us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:49.122126 (+    69us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:49.131931 (+  9805us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:49.136349 (+  4418us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:49.149957 (+ 13608us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23636,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":7049,"spinlock_wait_cycles":8527232,"thread_start_us":716265,"threads_started":1,"wal-append.queue_time_us":609428}
I20260709 13:08:49.226886 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:49.240731 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:08:49.242004 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 66433.6us
I20260709 13:08:49.243685 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:49.244009 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:49.244475 30620 raft_consensus.cc:2410] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:49.244598 30622 raft_consensus.cc:2468] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 2.
I20260709 13:08:49.244504 30623 raft_consensus.cc:1240] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:49.246357 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:49.246970 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:49.247290 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:49.247736 30622 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 4.
I20260709 13:08:49.246997 30623 raft_consensus.cc:2393] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 8: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:08:49.256177 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:49.200639 32350 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:49.261482 31114 leader_election.cc:400] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 2. Current term is 3.
I20260709 13:08:49.261993 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:49.262565 30472 raft_consensus.cc:2376] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 3. Re-sending same reply.
I20260709 13:08:49.263067 31114 leader_election.cc:400] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 2. Current term is 3.
I20260709 13:08:49.263370 31114 leader_election.cc:403] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 13:08:49.230284 32646 log.cc:927] Time spent T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:08:49.264245 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:49.267339 30472 raft_consensus.cc:1275] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:49.264047 31114 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:08:49.265899 31149 raft_consensus.cc:1240] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:08:49.265365 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:49.266621 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:49.267246 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:49.239235 32640 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:49.269660 32656 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:49.268306 30474 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:08:49.271595 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:49.271775 31147 raft_consensus.cc:1217] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[4.5-4.5]   Dedup: 4.5->[]
I20260709 13:08:49.268544 30473 raft_consensus.cc:2468] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:08:49.273986 30469 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 7.
I20260709 13:08:49.274284 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:49.249408 32542 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.276340 31147 raft_consensus.cc:1240] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:08:49.277365 30471 raft_consensus.cc:1275] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:49.278292 30467 raft_consensus.cc:2393] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 5: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
W20260709 13:08:49.280130 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 80421.9us
I20260709 13:08:49.282711 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:49.283306 31149 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 4.
I20260709 13:08:49.283756 30517 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:08:49.287057 32647 log.cc:927] Time spent T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:08:49.289055 31142 raft_consensus.cc:1275] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:49.289317 32657 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.289557 32649 raft_consensus.cc:2749] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 2. Current term is 3.
I20260709 13:08:49.290845 32479 leader_election.cc:290] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:49.292073 32460 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:49.300709 32321 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:49.289865 32657 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:49.303563 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:49.304162 30469 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:49.305861 30546 raft_consensus.cc:1275] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:49.310385 30517 leader_election.cc:304] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:49.311740 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:49.313130 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:49.313321 30617 raft_consensus.cc:1275] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:49.313911 30622 raft_consensus.cc:2368] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 2. Current term is 3.
I20260709 13:08:49.314718 30620 raft_consensus.cc:2468] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 5.
I20260709 13:08:49.280473 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:49.264024 32655 consensus_queue.cc:1048] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:08:49.316677 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:08:49.308108 32645 log.cc:927] Time spent T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:08:49.319738 32397 consensus_queue.cc:1048] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:49.320756 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:49.285739 32325 raft_consensus.cc:2804] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:49.321408 32325 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.321806 32325 raft_consensus.cc:3060] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:49.322762 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:49.323137 32422 raft_consensus.cc:3060] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:49.323357 30623 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 3.
I20260709 13:08:49.313869 32261 raft_consensus.cc:2749] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:49.285228 32542 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:49.326048 31115 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:49.326589 32542 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:49.326898 31115 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:49.328260 32649 raft_consensus.cc:2804] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:49.329192 30470 raft_consensus.cc:1275] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:08:49.330713 31115 leader_election.cc:400] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 2 election: Vote denied by peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) with higher term. Message: Invalid argument: T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 2. Current term is 3.
I20260709 13:08:49.328661 32649 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.336444 32649 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:49.336937 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:49.342078 30469 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 8.
I20260709 13:08:49.328608 32549 raft_consensus.cc:2749] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:49.351347 30517 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:49.353935 30469 raft_consensus.cc:1275] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:08:49.355283 32651 log.cc:927] Time spent T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.105s	user 0.000s	sys 0.007s
I20260709 13:08:49.351102 32574 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:49.356369 32325 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:49.358812 31146 raft_consensus.cc:1240] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:49.333205 30468 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:49.335969 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:49.341174 32261 raft_consensus.cc:2804] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:49.352924 32609 raft_consensus.cc:2749] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 6 LEADER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:08:49.372879 30591 leader_election.cc:336] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.649s (SENT)
W20260709 13:08:49.373772 30591 leader_election.cc:336] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.730s (SENT)
I20260709 13:08:49.373978 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:49.374409 32479 consensus_queue.cc:1048] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:49.377583 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:49.377614 32325 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:49.378186 30471 raft_consensus.cc:2468] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
I20260709 13:08:49.380679 30516 leader_election.cc:304] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:49.380630 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:49.381688 30545 raft_consensus.cc:3060] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:08:49.384869 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:49.363101 32472 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:49.390254 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 45976.7us
I20260709 13:08:49.385591 30467 raft_consensus.cc:2376] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5. Re-sending same reply.
I20260709 13:08:49.328043 32660 consensus_queue.cc:1048] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:08:49.367524 32261 raft_consensus.cc:493] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:49.398984 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:49.400017 30622 raft_consensus.cc:1275] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:08:49.398469 30618 raft_consensus.cc:1275] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:49.405021 30545 raft_consensus.cc:2468] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 5.
I20260709 13:08:49.404971 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:49.405896 30623 raft_consensus.cc:2393] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 3: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:08:49.406469 30589 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:49.406559 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:49.407048 31114 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:08:49.407223 30622 raft_consensus.cc:2468] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 2.
I20260709 13:08:49.270254 32648 consensus_queue.cc:1048] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.125s
I20260709 13:08:49.409466 30517 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:49.356395 32574 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:49.410295 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:49.369493 32659 consensus_queue.cc:1048] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:08:49.401084 32657 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:49.411594 32183 raft_consensus.cc:2804] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:49.412146 32183 raft_consensus.cc:697] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 5 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:49.413021 32183 consensus_queue.cc:237] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:49.400187 32261 raft_consensus.cc:3060] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:49.416322 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:49.395409 32472 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:49.419219 30625 raft_consensus.cc:1275] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:08:49.419489 32501 raft_consensus.cc:2804] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:49.419905 32501 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.420145 32472 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:49.420253 32501 raft_consensus.cc:3060] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:49.390970 32573 consensus_queue.cc:1048] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:08:49.277245 32656 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:49.426959 30469 raft_consensus.cc:2468] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:08:49.371146 30542 raft_consensus.cc:2468] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 4.
I20260709 13:08:49.428937 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:49.433321 30467 raft_consensus.cc:2468] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
I20260709 13:08:49.438871 32656 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:49.439940 32460 raft_consensus.cc:2804] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:49.440361 32460 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:49.440721 32460 raft_consensus.cc:3060] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:49.441541 32649 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:49.408718 32609 consensus_queue.cc:1059] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:08:49.408455 32421 consensus_queue.cc:1048] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:08:49.444048 32600 raft_consensus.cc:3055] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:49.444412 32600 raft_consensus.cc:740] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:49.445150 32600 consensus_queue.cc:260] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:49.446362 32600 raft_consensus.cc:3060] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:49.452279 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.452942 30516 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:08:49.454986 30591 leader_election.cc:336] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.888s (SENT)
I20260709 13:08:49.461177 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:49.462908 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:49.467546 30467 raft_consensus.cc:3055] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:49.468114 30467 raft_consensus.cc:740] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:49.469461 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:49.470853 30476 raft_consensus.cc:2468] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:49.460297 32542 raft_consensus.cc:493] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:49.461163 32636 raft_consensus.cc:2804] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:49.472549 30547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 1307) took 1172 ms. Trace:
I20260709 13:08:49.474661 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:49.475966 30547 rpcz_store.cc:276] 0709 13:08:48.300078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.300185 (+   107us) service_pool.cc:224] Handling call
0709 13:08:48.300436 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:48.300606 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:08:48.332311 (+ 31705us) log.cc:844] Serialized 14 byte log entry
0709 13:08:49.452282 (+1119971us) spinlock_profiling.cc:243] Waited 24.4 ms on lock 0x7b18004068a0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e492a6 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc783b104bc 00007fc780e5e48b
0709 13:08:49.453057 (+   775us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b18004068a0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc783b104bc 00007fc780e5e48b 00007fc789cb8ab9 00007fc780e7a69b 00007fc780e7893f 00007fc780e78455 00007fc783f60060 00007fc783f72716 00007fc783f83287
0709 13:08:49.472091 (+ 19034us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:49.472162 (+    71us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:49.472244 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:49.472334 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:49.472481 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21144,"prepare.queue_time_us":31566,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":4698,"raft.queue_time_us":30014,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":90948,"spinlock_wait_cycles":119857536,"thread_start_us":187611,"threads_started":2,"wal-append.queue_time_us":214202}
W20260709 13:08:49.479130 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 76599.2us
I20260709 13:08:49.472733 30467 consensus_queue.cc:260] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:49.488687 30467 raft_consensus.cc:3060] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:49.461704 32656 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:49.491734 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:49.492604 30469 raft_consensus.cc:2393] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 5: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:49.492620 30476 raft_consensus.cc:3060] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:08:49.494791 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:49.495028 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:49.495620 30472 raft_consensus.cc:2376] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5. Re-sending same reply.
W20260709 13:08:49.497112 32666 log.cc:927] Time spent T 00000000000000000000000000000000 P 045170a35afe4845987482e49e9e1eb9: Append to log took a long time: real 0.059s	user 0.002s	sys 0.000s
I20260709 13:08:49.504104 30476 raft_consensus.cc:1275] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:49.498577 32395 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:49.513446 32395 raft_consensus.cc:3060] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:49.504047 32649 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:49.498199 32261 raft_consensus.cc:515] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:49.507824 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:49.508956 32594 raft_consensus.cc:2804] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:49.509624 30467 raft_consensus.cc:1275] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:08:49.530324 30467 pending_rounds.cc:85] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326: Aborting all ops after (but not including) 5
I20260709 13:08:49.474881 32435 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:49.461412 32609 consensus_queue.cc:1048] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:08:49.508440 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:49.530556 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:49.521982 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:49.530563 30467 pending_rounds.cc:107] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:08:49.482246 32636 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:49.463213 32421 consensus_queue.cc:1048] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:08:49.535094 30517 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:49.536244 32421 raft_consensus.cc:2804] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:49.505293 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:49.536779 32421 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:49.537117 30472 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 4.
W20260709 13:08:49.527603 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.526669 31116 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:49.536751 30517 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:49.525394 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:49.531239 30473 raft_consensus.cc:2468] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 2.
I20260709 13:08:49.539076 30476 raft_consensus.cc:2468] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:08:49.530023 32573 raft_consensus.cc:493] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:49.533141 32636 raft_consensus.cc:3060] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:49.534122 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:49.537339 32421 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:49.531916 30467 raft_consensus.cc:2889] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:49.531976 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:49.553392 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:49.555085 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:49.556068 30551 raft_consensus.cc:2393] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 3: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:08:49.490058 32460 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:49.494786 32656 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:49.557415 30517 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:49.499980 32542 raft_consensus.cc:515] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:49.561690 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:49.569741 30589 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:49.572604 30546 raft_consensus.cc:3060] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:49.561779 32624 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:49.554630 32641 raft_consensus.cc:2804] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:49.562222 32435 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:49.559595 32329 raft_consensus.cc:2749] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:49.552392 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:49.564416 30616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3"
dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
mode: GRACEFUL
new_leader_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:49382
I20260709 13:08:49.556603 32397 consensus_queue.cc:1048] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:08:49.567781 30548 raft_consensus.cc:1240] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:49.567335 32395 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:49.574252 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:49.551990 32573 raft_consensus.cc:515] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:49.600267 30517 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:49.600337 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:49.600270 32624 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:49.611703 32656 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:49.612730 30544 raft_consensus.cc:2468] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:49.614009 32624 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:49.614497 32501 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:49.615029 32421 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:08:49.616967 32613 log.cc:927] Time spent T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 1.069s	user 0.009s	sys 0.011s
I20260709 13:08:49.601413 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:49.575248 30589 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:49.573832 32479 raft_consensus.cc:2749] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:49.602083 32462 raft_consensus.cc:2749] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:49.620282 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:08:49.625375 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 50221.6us
I20260709 13:08:49.626480 30589 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:49.628552 30589 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:49.601402 32659 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:49.635823 32659 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:49.625439 30473 raft_consensus.cc:2468] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:08:49.601600 32641 raft_consensus.cc:697] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 2 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:49.634979 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:49.633695 32655 raft_consensus.cc:2749] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:49.638406 30476 raft_consensus.cc:2410] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:49.643163 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:49.643795 30469 raft_consensus.cc:3060] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:49.641615 30517 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:49.609207 32460 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:49.610607 32350 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:49.624606 30616 raft_consensus.cc:606] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Received request to transfer leadership to TS 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:49.650190 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:49.653407 32600 raft_consensus.cc:3060] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:49.654938 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:49.664094 32642 raft_consensus.cc:2804] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:49.664610 32642 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:49.664991 32642 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:49.668205 32350 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:49.669183 32573 leader_election.cc:290] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:49.654282 32583 raft_consensus.cc:2804] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:49.670006 32583 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.670243 32350 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:49.670348 32583 raft_consensus.cc:3060] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:49.670861 30616 raft_consensus.cc:614] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:49.673355 32421 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:49.676949 32542 leader_election.cc:290] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:49.655591 30476 raft_consensus.cc:2468] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:08:49.677814 32261 leader_election.cc:290] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:49.678979 32501 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:49.679896 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:49.681493 30517 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:49.633782 32585 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:49.657106 32659 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:49.657917 32641 consensus_queue.cc:237] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:49.660939 32395 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:49.633601 32219 raft_consensus.cc:2749] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:49.686399 30468 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 3.
I20260709 13:08:49.701223 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:49.702229 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:49.702695 30468 raft_consensus.cc:3060] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:49.689802 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 121395us
I20260709 13:08:49.696902 30469 raft_consensus.cc:2468] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:08:49.704821 30546 raft_consensus.cc:2468] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
W20260709 13:08:49.675705 32625 log.cc:927] Time spent T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 1.022s	user 0.003s	sys 0.010s
I20260709 13:08:49.706102 30591 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
W20260709 13:08:49.706146 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.707023 30589 leader_election.cc:304] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:08:49.706192 30517 connection.cc:256] RPC call timeout handler was delayed by -1.7053048409999292s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1676s for a response
W20260709 13:08:49.708338 30517 connection.cc:256] RPC call timeout handler was delayed by -1.6396629650000705s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1763s for a response
W20260709 13:08:49.708666 30517 connection.cc:256] RPC call timeout handler was delayed by -1.6333629650000603s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17700000000000002s for a response
W20260709 13:08:49.709070 30517 connection.cc:256] RPC call timeout handler was delayed by -1.5138014489999705s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1595s for a response
I20260709 13:08:49.714278 30468 raft_consensus.cc:2468] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:49.717459 30591 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
W20260709 13:08:49.718745 30517 connection.cc:256] RPC call timeout handler was delayed by -1.3479605409999067s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1912s for a response
W20260709 13:08:49.719426 30517 connection.cc:256] RPC call timeout handler was delayed by -1.0139636039999687s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2094s for a response
I20260709 13:08:49.723235 30591 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:49.724381 30546 raft_consensus.cc:1240] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:49.708695 32261 raft_consensus.cc:2804] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:49.726276 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:49.727789 32261 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:49.728281 32261 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:49.710186 32501 raft_consensus.cc:2749] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:49.731973 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:49.716063 32573 raft_consensus.cc:2804] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:49.730504 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:49.733505 30591 leader_election.cc:304] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:49.734624 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:49.724762 32542 raft_consensus.cc:493] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:49.726555 32219 raft_consensus.cc:2749] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:49.741001 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:49.742934 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:49.738628 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:49.742831 30591 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:49.744256 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:49.700717 32636 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:49.737833 32659 raft_consensus.cc:2804] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:49.746528 32659 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:49.746886 32659 raft_consensus.cc:3060] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:49.747140 32654 raft_consensus.cc:2749] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:49.747577 32636 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:49.696164 32585 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:49.740600 30473 raft_consensus.cc:2955] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 4 to 6, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:49.756016 30591 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:49.738387 30441 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:49.735520 32644 raft_consensus.cc:2749] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:49.761220 30550 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:49.757718 30441 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:49.764263 30517 leader_election.cc:304] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:49.765332 32641 raft_consensus.cc:2764] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 13:08:49.740736 32573 raft_consensus.cc:697] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:49.767736 30517 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:49.752291 32642 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:49.740908 32656 consensus_queue.cc:1059] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:08:49.762133 32654 raft_consensus.cc:2804] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:49.743594 32542 raft_consensus.cc:515] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:49.767474 32640 raft_consensus.cc:2749] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:49.788784 30475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 332) took 1427 ms. Trace:
I20260709 13:08:49.791112 30517 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:49.793748 32679 raft_consensus.cc:2749] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:49.793947 30543 raft_consensus.cc:1240] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:49.795845 32542 leader_election.cc:290] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:49.796442 32542 raft_consensus.cc:2804] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:49.796797 32542 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.797151 32542 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:49.799698 32573 consensus_queue.cc:237] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:49.767285 32350 consensus_queue.cc:1059] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:08:49.782029 32654 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.789191 30475 rpcz_store.cc:276] 0709 13:08:48.360889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.361012 (+   123us) service_pool.cc:224] Handling call
0709 13:08:48.361307 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:48.363572 (+  2265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:48.363604 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:48.364031 (+   427us) log.cc:844] Serialized 26 byte log entry
0709 13:08:48.580437 (+216406us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:48.596366 (+ 15929us) log.cc:844] Serialized 14 byte log entry
0709 13:08:48.598851 (+  2485us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:48.599011 (+   160us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:49.442538 (+843527us) spinlock_profiling.cc:243] Waited 1.39 ms on lock 0x7b18001c4d40. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e7b3f3 00007fc780e7d7c1 00007fc780e7d779 00007fc780e7d709 00007fc780e7d6d1 00007fc780e7c9cd 000000000038f354 000000000038f199 00007fc780e5e83a
0709 13:08:49.675311 (+232773us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b2400110888. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780d019c4 00007fc780cffacb 00007fc780ebadc9 00007fc780ebaa55 00007fc780eba09d 00007fc783aec10e 00007fc783b0388c 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221
0709 13:08:49.788581 (+113270us) raft_consensus.cc:1685] finished
0709 13:08:49.788604 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:49.788726 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1832,"prepare.queue_time_us":15625,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":5532,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":8682,"spinlock_wait_cycles":27428096,"thread_start_us":216004,"threads_started":1,"wal-append.queue_time_us":232159}
W20260709 13:08:49.813287 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 55643.5us
I20260709 13:08:49.816306 30441 leader_election.cc:304] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:49.816175 30476 raft_consensus.cc:2955] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index 2 to 4, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:49.817239 30517 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:49.819110 30517 leader_election.cc:304] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:49.820050 32462 raft_consensus.cc:2749] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:49.793443 32641 raft_consensus.cc:2749] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:49.811075 32618 log.cc:927] Time spent T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 1.263s	user 0.004s	sys 0.010s
I20260709 13:08:49.809553 32654 raft_consensus.cc:3060] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:49.803443 32679 consensus_queue.cc:1048] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:08:49.828608 32462 consensus_queue.cc:1048] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:08:49.830654 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:49.835505 32600 raft_consensus.cc:2749] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:49.838219 32542 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:49.848224 30550 raft_consensus.cc:1275] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:49.852056 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:49.820952 32632 consensus_queue.cc:1048] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:08:49.827580 32350 raft_consensus.cc:3055] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:08:49.878242 32681 log.cc:927] Time spent T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:08:49.881410 32686 consensus_queue.cc:1048] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:49.883196 32686 raft_consensus.cc:2749] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:49.856065 32421 raft_consensus.cc:2749] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:49.901480 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 85232.8us
I20260709 13:08:49.902644 30441 leader_election.cc:400] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Vote denied by peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) with higher term. Message: Invalid argument: T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 2. Current term is 3.
I20260709 13:08:49.903043 30441 leader_election.cc:403] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:49.864549 32678 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:49.869376 32350 raft_consensus.cc:740] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:49.904142 30441 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:49.908799 30441 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:49.911352 31151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48414 (request call id 561) took 1877 ms. Trace:
I20260709 13:08:49.911783 31151 rpcz_store.cc:276] 0709 13:08:48.033925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.034050 (+   125us) service_pool.cc:224] Handling call
0709 13:08:48.034354 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:48.034694 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:48.034723 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:48.035184 (+   461us) log.cc:844] Serialized 26 byte log entry
0709 13:08:48.398315 (+363131us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:48.440801 (+ 42486us) log.cc:844] Serialized 14 byte log entry
0709 13:08:48.600336 (+159535us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:48.600408 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:49.810519 (+1210111us) spinlock_profiling.cc:243] Waited 34.3 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:08:49.910994 (+100475us) raft_consensus.cc:1685] finished
0709 13:08:49.911109 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:49.911257 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":181370,"prepare.queue_time_us":48961,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":159535,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":12800,"spinlock_wait_cycles":78952320,"thread_start_us":362776,"threads_started":1,"wal-append.queue_time_us":508747}
I20260709 13:08:49.914330 32659 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:49.922676 32642 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:49.922956 32688 raft_consensus.cc:2804] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:49.922823 32350 consensus_queue.cc:260] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:49.923504 32688 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.910226 32678 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:49.908854 32585 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:49.909186 32685 consensus_queue.cc:1048] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:08:49.924165 32350 raft_consensus.cc:3060] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:49.924952 32542 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:49.910032 32686 raft_consensus.cc:2749] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) with higher term. Message: Invalid argument: T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 2. Current term is 3.
I20260709 13:08:49.929227 30441 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:08:49.927413 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 73172.1us
I20260709 13:08:49.931555 30441 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:49.927536 32688 raft_consensus.cc:3060] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:49.934544 30591 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:49.937420 30468 raft_consensus.cc:1275] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:08:49.935856 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:49.939126 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:49.939927 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:49.940543 32686 raft_consensus.cc:2804] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:49.940371 32583 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:49.943989 32689 raft_consensus.cc:2749] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:49.945439 32261 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:49.940981 32686 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.949193 30473 raft_consensus.cc:3060] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:49.949322 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:49.952381 32678 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:49.953229 32261 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:49.938603 32542 raft_consensus.cc:2749] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:49.939388 32573 raft_consensus.cc:2804] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:49.957234 32573 raft_consensus.cc:697] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:49.958362 32573 consensus_queue.cc:237] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:49.961941 32686 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:49.968888 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:49.968140 32659 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:49.978566 30517 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:49.982650 32575 consensus_queue.cc:1048] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:08:49.990206 30469 raft_consensus.cc:2368] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 4. Current term is 5.
I20260709 13:08:49.992578 32654 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:49.994920 32631 raft_consensus.cc:2749] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:49.999622 30473 raft_consensus.cc:2468] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
I20260709 13:08:50.006839 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:50.007628 30468 raft_consensus.cc:3060] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:50.010766 32693 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:50.011358 32693 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:50.012148 32654 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:49.938295 32656 consensus_queue.cc:1059] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:08:49.992358 32688 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:50.017406 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:50.022624 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:50.024084 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:50.025146 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:50.025586 30472 raft_consensus.cc:3060] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:50.069182 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:50.069631 30468 raft_consensus.cc:2468] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
I20260709 13:08:50.070987 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:50.070664 30472 raft_consensus.cc:2468] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7.
I20260709 13:08:50.070670 30591 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:50.072038 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:50.072554 30472 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:50.073220 30591 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:50.074801 30475 raft_consensus.cc:2368] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 2. Current term is 3.
I20260709 13:08:50.075758 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:50.077204 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:50.080515 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:50.076745 32655 raft_consensus.cc:2804] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:50.074848 32654 raft_consensus.cc:2804] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:50.081102 31143 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:50.081266 32655 raft_consensus.cc:697] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:50.081601 32654 raft_consensus.cc:697] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:50.082218 32655 consensus_queue.cc:237] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:50.082484 32654 consensus_queue.cc:237] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:50.090983 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:50.069741 32686 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:50.093233 30472 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
I20260709 13:08:50.094172 32686 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:50.095263 30517 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:50.096912 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:50.097193 32631 raft_consensus.cc:2804] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:50.097892 32631 raft_consensus.cc:697] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 5 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:50.098557 30472 raft_consensus.cc:1240] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:50.099902 30472 pending_rounds.cc:85] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326: Aborting all ops after (but not including) 2
I20260709 13:08:50.101301 32642 consensus_queue.cc:1059] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:50.102167 32642 raft_consensus.cc:3055] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:50.102511 32642 raft_consensus.cc:740] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:50.103602 32693 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:50.106585 30441 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:50.108147 32642 consensus_queue.cc:260] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:50.109661 32693 raft_consensus.cc:2749] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:50.101181 30472 pending_rounds.cc:107] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:08:50.111739 30472 raft_consensus.cc:2889] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:50.114321 31143 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 5.
I20260709 13:08:50.119019 30441 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:50.122241 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:50.098963 32631 consensus_queue.cc:237] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:50.132443 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:50.132910 32688 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:50.134271 30551 raft_consensus.cc:3060] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:50.135322 32619 log.cc:927] Time spent T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 1.588s	user 0.002s	sys 0.008s
I20260709 13:08:50.124143 32659 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:50.124338 32693 raft_consensus.cc:2804] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:50.129104 32501 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:50.147099 32693 raft_consensus.cc:697] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 5 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:50.147131 32501 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:50.148092 32693 consensus_queue.cc:237] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:50.148803 32437 raft_consensus.cc:3060] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:50.149396 32501 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:50.130131 32661 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:50.146214 32659 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:50.151095 32661 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:08:50.158468 32697 log.cc:927] Time spent T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:08:50.178234 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:50.180114 30472 raft_consensus.cc:1240] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:08:50.125221 31143 raft_consensus.cc:2468] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 2.
W20260709 13:08:50.191669 32696 log.cc:927] Time spent T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:08:50.183759 32656 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:50.209585 30551 raft_consensus.cc:2468] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
I20260709 13:08:50.215641 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:50.216256 30622 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:50.184448 32679 consensus_queue.cc:1059] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:08:50.221212 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:50.223184 30472 raft_consensus.cc:2393] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 2: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:50.224344 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:50.209115 32573 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.228912 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:50.245702 30620 raft_consensus.cc:2468] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 3.
I20260709 13:08:50.220845 32472 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:50.250792 32661 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:50.210538 32656 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:50.255019 32656 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:50.247500 32460 raft_consensus.cc:3055] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:50.255798 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:50.259411 31114 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:08:50.256470 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:50.262740 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:50.259734 30472 raft_consensus.cc:2468] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
W20260709 13:08:50.263041 32705 log.cc:927] Time spent T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:08:50.256671 32472 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:50.266223 32472 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:50.251047 31115 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:50.268139 30622 raft_consensus.cc:2468] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 6.
I20260709 13:08:50.269867 31150 raft_consensus.cc:1240] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:50.272138 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:50.275956 32591 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:50.276748 30624 raft_consensus.cc:1275] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:08:50.282747 32664 log.cc:927] Time spent T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.898s	user 0.002s	sys 0.002s
I20260709 13:08:50.284291 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:50.259282 32460 raft_consensus.cc:740] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:50.247920 32573 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:50.272460 32659 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:50.469434 30625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47446 (request call id 1951) took 1068 ms. Trace:
I20260709 13:08:50.286698 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:08:50.319620 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 44640.2us
I20260709 13:08:50.353595 31144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48426 (request call id 525) took 1161 ms. Trace:
I20260709 13:08:50.334880 32435 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:50.456468 30591 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:50.548466 32624 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.288885 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:50.645054 30467 raft_consensus.cc:3060] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:50.469944 32594 raft_consensus.cc:493] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:50.324416 32661 raft_consensus.cc:493] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:50.450942 30542 raft_consensus.cc:1240] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:50.639060 30516 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:50.642666 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:50.329459 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:50.270038 32550 raft_consensus.cc:2804] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:50.269802 32679 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.678049 30618 raft_consensus.cc:1275] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:50.272205 32261 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.637001 30625 rpcz_store.cc:276] 0709 13:08:49.401427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.403939 (+  2512us) service_pool.cc:224] Handling call
0709 13:08:49.416181 (+ 12242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:49.419555 (+  3374us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:50.469112 (+1049557us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b5400304654. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:50.469329 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6240000}
W20260709 13:08:50.646809 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 190411us
I20260709 13:08:50.354012 32701 raft_consensus.cc:2804] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:50.646798 31150 raft_consensus.cc:1240] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 4. Current term is 6. Ops: [4.7-4.7]
I20260709 13:08:50.458824 32574 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:50.448704 30470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 1886) took 1189 ms. Trace:
W20260709 13:08:50.620019 32708 log.cc:927] Time spent T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 13:08:50.662266 31116 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:50.277438 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:50.663642 30619 raft_consensus.cc:1275] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:08:50.667518 30516 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:50.668231 30471 raft_consensus.cc:2468] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 2.
I20260709 13:08:50.674049 30469 raft_consensus.cc:1275] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:08:50.697819 30469 pending_rounds.cc:85] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326: Aborting all ops after (but not including) 5
I20260709 13:08:50.698158 30469 pending_rounds.cc:107] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:08:50.698469 30469 raft_consensus.cc:2889] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:50.560563 32655 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
W20260709 13:08:50.682498 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 421375us
I20260709 13:08:50.276634 32591 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:50.686707 30470 rpcz_store.cc:276] 0709 13:08:49.259137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.265425 (+  6288us) service_pool.cc:224] Handling call
0709 13:08:49.265655 (+   230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:49.329528 (+ 63873us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:50.448418 (+1118890us) spinlock_profiling.cc:243] Waited 63.2 ms on lock 0x7b540011dd54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:50.448631 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":145408256}
I20260709 13:08:50.659258 32594 raft_consensus.cc:3060] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:50.661283 32659 raft_consensus.cc:2804] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:50.694329 30624 raft_consensus.cc:2468] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 2.
I20260709 13:08:50.660053 32435 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.677539 32437 raft_consensus.cc:2804] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:50.713949 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:50.663072 32624 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:50.703131 32608 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:50.721438 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:50.682790 32701 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:50.732252 30624 raft_consensus.cc:1275] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:50.705233 32667 raft_consensus.cc:2764] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:08:50.672513 32661 raft_consensus.cc:515] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:50.739264 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:50.706002 30542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 1320) took 1183 ms. Trace:
I20260709 13:08:50.749871 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:50.686152 32679 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:50.729745 32631 raft_consensus.cc:2749] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:50.685987 32261 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:50.729523 32659 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:50.735430 32435 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:50.745293 32437 raft_consensus.cc:697] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 3 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:50.748728 32701 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:50.695885 32656 consensus_queue.cc:1059] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:08:50.720815 32648 consensus_queue.cc:1048] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
W20260709 13:08:50.747114 32682 log.cc:927] Time spent T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.947s	user 0.003s	sys 0.004s
I20260709 13:08:50.767937 32661 leader_election.cc:290] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:50.769577 31150 raft_consensus.cc:1275] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:08:50.758767 30542 rpcz_store.cc:276] 0709 13:08:49.520775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.524787 (+  4012us) service_pool.cc:224] Handling call
0709 13:08:50.450479 (+925692us) spinlock_profiling.cc:243] Waited 2.83 ms on lock 0x7b5800028598. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780e43b71 00007fc780e43eee 0000000000375939 00007fc788eb71e0 00007fc788f800c4 00007fc788f80131 00007fc788f41fc0 00007fc788f2c929 00007fc788f2c3d2 00007fc7824a3bd4
0709 13:08:50.450688 (+   209us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:50.672532 (+221844us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:50.704077 (+ 31545us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6515456}
I20260709 13:08:50.714335 32655 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:50.732528 32636 consensus_queue.cc:1059] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:08:50.754989 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:50.714910 30467 raft_consensus.cc:2468] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 5.
I20260709 13:08:50.770109 32716 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
W20260709 13:08:50.795185 31115 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.008s	sys 0.024s
W20260709 13:08:50.833797 31115 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.009s	sys 0.024s
W20260709 13:08:50.834126 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 583082us
I20260709 13:08:50.834276 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:50.706699 32460 consensus_queue.cc:260] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:50.798590 30475 raft_consensus.cc:1275] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:08:50.772336 32659 raft_consensus.cc:3060] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:50.791908 30517 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.018s	sys 0.019s
I20260709 13:08:50.772194 32667 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:08:50.840234 30517 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.018s	sys 0.019s
W20260709 13:08:50.842643 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 569791us
I20260709 13:08:50.843487 30440 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:50.853839 32679 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:50.752173 32608 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:50.854609 32437 consensus_queue.cc:237] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:50.857229 31115 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:08:50.791849 32504 consensus_queue.cc:1048] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
W20260709 13:08:50.872225 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 138223us
I20260709 13:08:50.638468 31144 rpcz_store.cc:276] 0709 13:08:49.199943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.200107 (+   164us) service_pool.cc:224] Handling call
0709 13:08:49.200449 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:49.200895 (+   446us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:08:49.200929 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:49.201458 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 13:08:49.267036 (+ 65578us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:49.273021 (+  5985us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:49.277176 (+  4155us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:50.200882 (+923706us) spinlock_profiling.cc:243] Waited 8.13 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:08:50.310230 (+109348us) raft_consensus.cc:1685] finished
0709 13:08:50.310256 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:50.342111 (+ 31855us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3186,"raft.queue_time_us":2458,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":1387,"spinlock_wait_cycles":18688896,"thread_start_us":53422,"threads_started":1,"wal-append.queue_time_us":81575}
I20260709 13:08:50.873154 31116 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:50.871341 30440 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:50.838332 32654 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:50.879608 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:50.862282 32460 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:50.876737 30440 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:50.856549 32329 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:50.892002 30517 leader_election.cc:400] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 pre-election: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 2. Current term is 3.
I20260709 13:08:50.858466 32667 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:50.875322 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:08:50.957145 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 91368.5us
I20260709 13:08:50.882718 32686 raft_consensus.cc:2804] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:50.881928 32656 raft_consensus.cc:2749] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:50.860500 32507 consensus_queue.cc:1059] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:08:50.882203 32573 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:50.978940 30625 raft_consensus.cc:1240] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 4. Current term is 5. Ops: []
W20260709 13:08:50.979923 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 88263.8us
I20260709 13:08:50.892974 30517 leader_election.cc:400] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 4. Current term is 5.
W20260709 13:08:50.990495 32682 log.cc:927] Time spent T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:08:50.841334 32716 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:50.915867 32713 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.022748 30476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 1371) took 1374 ms. Trace:
I20260709 13:08:51.023872 31114 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:50.887313 32654 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:50.893512 32631 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.012061 32454 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:51.012396 30551 raft_consensus.cc:1275] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:08:51.012920 32435 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:08:51.016292 32712 log.cc:927] Time spent T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 13:08:51.016721 32726 raft_consensus.cc:2804] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:51.019260 32711 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:50.942090 32329 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:51.053918 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 46327.2us
I20260709 13:08:50.892382 32718 raft_consensus.cc:2804] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:08:51.056529 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.057142 32643 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:51.007745 30517 leader_election.cc:403] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:51.030293 32716 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:51.030838 32656 raft_consensus.cc:2749] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:51.034950 30623 raft_consensus.cc:1240] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 LEADER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:51.037612 32261 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:51.023116 30476 rpcz_store.cc:276] 0709 13:08:49.648473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.677725 (+ 29252us) service_pool.cc:224] Handling call
0709 13:08:49.678288 (+   563us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:49.678759 (+   471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:49.678787 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:49.680046 (+  1259us) log.cc:844] Serialized 582 byte log entry
0709 13:08:49.767598 (+ 87552us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:49.779797 (+ 12199us) log.cc:844] Serialized 14 byte log entry
0709 13:08:49.843261 (+ 63464us) log.cc:844] Serialized 14 byte log entry
0709 13:08:49.979647 (+136386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:49.979716 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:50.474552 (+494836us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b18002b3480. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e492a6 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db
0709 13:08:50.598372 (+123820us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:08:51.022563 (+424191us) raft_consensus.cc:1685] finished
0709 13:08:51.022582 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:51.022696 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2153,"prepare.queue_time_us":8221,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":5579,"raft.queue_time_us":84513,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":5219,"spinlock_wait_cycles":7385216,"thread_start_us":254400,"threads_started":3,"wal-append.queue_time_us":119733}
I20260709 13:08:51.046752 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:51.062058 30625 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 3.
I20260709 13:08:51.054528 32583 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:51.057683 32643 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:08:51.065567 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 172717us
I20260709 13:08:51.066056 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:51.064743 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:51.070436 30623 raft_consensus.cc:2468] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
I20260709 13:08:51.059665 32726 raft_consensus.cc:697] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 5 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:51.069631 32636 raft_consensus.cc:2749] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 4. Current term is 5.
I20260709 13:08:51.071753 32636 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:51.072062 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:51.022116 32713 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:51.069634 32325 raft_consensus.cc:2749] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:51.074697 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 212481us
I20260709 13:08:51.069880 32694 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.082463 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:51.084280 30625 raft_consensus.cc:2410] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:08:51.049202 32631 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:51.069747 32608 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:51.072315 32435 consensus_queue.cc:1048] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:08:51.062474 32711 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:51.081079 32718 raft_consensus.cc:697] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 6 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:51.100293 32540 raft_consensus.cc:3055] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:51.083592 30616 raft_consensus.cc:3055] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:51.072300 32636 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:51.098205 32718 consensus_queue.cc:237] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:51.071971 32726 consensus_queue.cc:237] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:51.098984 32655 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:51.152256 30551 raft_consensus.cc:2410] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:08:51.347044 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 210150us
I20260709 13:08:51.137943 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:51.350850 30476 raft_consensus.cc:2468] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 4.
I20260709 13:08:51.351761 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:51.088861 32694 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:08:51.811188 32659 consensus_meta.cc:287] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.930s	user 0.007s	sys 0.002s
W20260709 13:08:51.593775 30473 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50446 (request call id 1379) took 1658 ms (client timeout 1729 ms). Trace:
I20260709 13:08:51.855726 30548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 1325) took 2333 ms. Trace:
W20260709 13:08:51.583658 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.100703 32540 raft_consensus.cc:740] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:51.635123 30474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 352) took 2127 ms. Trace:
W20260709 13:08:52.303514 30473 rpcz_store.cc:269] 0709 13:08:49.935463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.935597 (+   134us) service_pool.cc:224] Handling call
0709 13:08:51.593610 (+1658013us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b5400176bd4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:08:51.593720 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25454336}
I20260709 13:08:51.565850 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:52.311342 30474 rpcz_store.cc:276] 0709 13:08:49.507490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.512055 (+  4565us) service_pool.cc:224] Handling call
0709 13:08:49.512408 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:49.602935 (+ 90527us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:49.602979 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:49.603037 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:49.603084 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:51.634887 (+2031803us) spinlock_profiling.cc:243] Waited 90.3 ms on lock 0x7b5400149954. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:51.634932 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:51.635060 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":207590144}
I20260709 13:08:51.567042 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
W20260709 13:08:51.883384 30517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.592829 32713 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:52.279567 32679 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:51.095873 32656 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:51.374212 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 497480us
I20260709 13:08:52.337692 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:51.566954 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:52.339213 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:52.307471 30548 rpcz_store.cc:276] 0709 13:08:49.522111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.522219 (+   108us) service_pool.cc:224] Handling call
0709 13:08:49.522509 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:49.608990 (+ 86481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:51.855382 (+2246392us) spinlock_profiling.cc:243] Waited 45.1 ms on lock 0x7b540038c554. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:51.855640 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":103630208}
I20260709 13:08:52.340744 30548 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
mode: GRACEFUL
new_leader_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:45906
I20260709 13:08:52.341259 30548 raft_consensus.cc:606] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Received request to transfer leadership to TS f639301059e24dc5b0d88a46dc683326
I20260709 13:08:52.341572 30548 raft_consensus.cc:614] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:51.885311 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:51.796993 30546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 395) took 1044 ms. Trace:
I20260709 13:08:52.342784 30546 rpcz_store.cc:276] 0709 13:08:50.752571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.752775 (+   204us) service_pool.cc:224] Handling call
0709 13:08:51.796151 (+1043376us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b5800028598. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780e43b71 00007fc780e43a22 00007fc789d5cc09 00007fc788eb6ee0 00007fc788f800ab 00007fc788f80131 00007fc788f41fc0 00007fc788f2c929 00007fc788f2c3d2 00007fc7824a3bd4
0709 13:08:51.796389 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:51.796601 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:51.796636 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:51.796688 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:51.796730 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:51.796801 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:51.796917 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4937472}
I20260709 13:08:52.345805 30546 raft_consensus.cc:1240] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 5 LEADER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:51.594180 30468 raft_consensus.cc:1240] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 4. Current term is 5. Ops: [3.2-4.3]
I20260709 13:08:51.339236 32654 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:08:51.247342 32730 log.cc:927] Time spent T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 13:08:52.340070 30550 raft_consensus.cc:2468] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 2.
W20260709 13:08:51.648862 32460 consensus_meta.cc:287] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.754s	user 0.007s	sys 0.003s
W20260709 13:08:51.451279 32701 consensus_meta.cc:287] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.655s	user 0.008s	sys 0.000s
W20260709 13:08:52.351032 30516 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.008s	sys 0.015s
I20260709 13:08:52.350947 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:51.127594 32261 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:51.764777 32732 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.017s	sys 0.039s
I20260709 13:08:51.561758 32661 raft_consensus.cc:3055] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:08:51.886840 32704 log.cc:927] Time spent T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 1.555s	user 0.004s	sys 0.006s
W20260709 13:08:51.624246 32725 log.cc:927] Time spent T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:08:51.749878 32736 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.540637 32717 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.783037 32655 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.350373 30616 raft_consensus.cc:740] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:51.260596 32667 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:52.206650 32678 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:51.484885 32462 raft_consensus.cc:476] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 6 LEADER]: Not starting pre-election -- already a leader
I20260709 13:08:51.856068 32308 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:51.368548 32624 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:51.348317 32686 raft_consensus.cc:697] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:52.366716 30546 raft_consensus.cc:1240] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:51.881803 32715 raft_consensus.cc:493] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.553691 32737 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.877296 32591 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:51.883899 32609 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:51.564363 32640 raft_consensus.cc:3055] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:51.802996 32576 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:51.449205 32643 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:52.294704 32739 raft_consensus.cc:493] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:51.452088 32631 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:51.526608 32734 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:52.296912 32636 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:52.350749 32656 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:51.132639 32594 raft_consensus.cc:515] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:52.330050 32659 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:52.620534 32640 raft_consensus.cc:740] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:52.632296 32640 consensus_queue.cc:260] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:52.633026 32659 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:52.633319 32640 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:52.633582 32659 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:52.634087 32659 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:52.636047 30624 raft_consensus.cc:1240] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 4. Current term is 5. Ops: []
W20260709 13:08:52.409444 30516 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.010s	sys 0.024s
I20260709 13:08:52.631263 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:52.499397 30622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47446 (request call id 1958) took 2234 ms. Trace:
W20260709 13:08:52.388144 30517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.591573 32717 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:52.411384 32701 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:52.347460 32713 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:52.515866 32751 raft_consensus.cc:493] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:52.592353 32736 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:52.479907 32540 consensus_queue.cc:260] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:52.353463 32683 log.cc:927] Time spent T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 1.990s	user 0.000s	sys 0.007s
I20260709 13:08:52.589669 32661 raft_consensus.cc:740] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:52.594888 32574 raft_consensus.cc:493] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:52.598052 30546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 1343) took 1033 ms. Trace:
I20260709 13:08:52.725414 30546 rpcz_store.cc:276] 0709 13:08:51.564853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.366291 (+801438us) service_pool.cc:224] Handling call
0709 13:08:52.366559 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.589692 (+223133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.597978 (+  8286us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:51.369625 32559 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:52.589295 32732 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.453s	user 0.041s	sys 0.087s
W20260709 13:08:52.441406 32688 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.107s	user 0.023s	sys 0.030s
I20260709 13:08:52.615028 32308 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:52.619593 32759 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:08:52.588553 32575 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.780s	user 0.007s	sys 0.017s
I20260709 13:08:52.365774 32679 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:52.353266 32741 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:08:52.737406 32688 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.403s	user 0.026s	sys 0.045s
I20260709 13:08:52.357450 32654 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.623944 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:52.657907 30616 consensus_queue.cc:260] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:52.757313 32654 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:08:52.757616 30621 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47446 (request call id 1966) took 2120 ms (client timeout 1579 ms). Trace:
I20260709 13:08:52.735478 32574 raft_consensus.cc:515] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:52.758070 30621 rpcz_store.cc:269] 0709 13:08:50.636891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.638514 (+  1623us) service_pool.cc:224] Handling call
0709 13:08:52.623753 (+1985239us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b58001a3198. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780e43b71 00007fc780e43a22 00007fc789d5cc09 00007fc788eb6ee0 00007fc788f800ab 00007fc788f80131 00007fc788f2e0a0 00007fc788f2d984 00007fc7824a86d4 00007fc7824a8662
0709 13:08:52.757517 (+133764us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31581056}
I20260709 13:08:52.758044 30616 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:52.759379 32654 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:52.616655 32737 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:08:52.636883 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 797991us
I20260709 13:08:52.761400 32594 leader_election.cc:290] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:52.624318 32550 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:51.879951 30543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 1334) took 2217 ms. Trace:
I20260709 13:08:52.763957 32550 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:52.764168 30543 rpcz_store.cc:276] 0709 13:08:49.662562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.662717 (+   155us) service_pool.cc:224] Handling call
0709 13:08:49.663080 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:49.794569 (+131489us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:51.879586 (+2085017us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b540038cf54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:51.879862 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":288967936}
I20260709 13:08:52.601579 32750 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.765668 32750 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:52.657621 32751 raft_consensus.cc:515] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:52.767915 30616 raft_consensus.cc:1275] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:52.768198 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:52.768611 32751 leader_election.cc:290] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:52.770359 32308 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:52.606480 32749 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:52.637802 30622 rpcz_store.cc:276] 0709 13:08:50.263015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.280394 (+ 17379us) service_pool.cc:224] Handling call
0709 13:08:50.280660 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:50.311226 (+ 30566us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:08:50.804380 (+493154us) log.cc:844] Serialized 14 byte log entry
0709 13:08:50.978750 (+174370us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:51.000605 (+ 21855us) log.cc:844] Serialized 26 byte log entry
0709 13:08:51.000747 (+   142us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:51.000779 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:51.000837 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:52.497591 (+1496754us) raft_consensus.cc:1685] finished
0709 13:08:52.497610 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.497728 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25290,"prepare.queue_time_us":479441,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":1432,"raft.queue_time_us":34474,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":29170,"spinlock_wait_cycles":3456,"thread_start_us":281014,"threads_started":2,"wal-append.queue_time_us":224613}
I20260709 13:08:52.736848 32540 raft_consensus.cc:3060] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:52.440608 32261 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:52.626572 32609 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:52.606966 32715 raft_consensus.cc:515] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:52.603212 32655 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:52.630566 32576 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:52.603097 32678 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:52.782303 32686 consensus_queue.cc:237] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:52.793877 32678 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:52.796005 30549 raft_consensus.cc:3060] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:08:52.768595 30616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47446 (request call id 1971) took 1735 ms. Trace:
I20260709 13:08:52.797039 30616 rpcz_store.cc:276] 0709 13:08:51.032992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.043931 (+ 10939us) service_pool.cc:224] Handling call
0709 13:08:51.078284 (+ 34353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.768331 (+1690047us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.768537 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:52.798075 32550 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:52.759867 32574 leader_election.cc:290] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:52.724329 32659 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:08:52.588882 30591 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.007s	sys 0.015s
I20260709 13:08:52.623871 32694 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:52.744290 30544 raft_consensus.cc:1240] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 2. Current term is 3. Ops: []
W20260709 13:08:52.746650 32575 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.937s	user 0.007s	sys 0.018s
I20260709 13:08:52.638034 32734 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:52.630441 32739 raft_consensus.cc:515] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:52.732518 32713 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:52.782150 32756 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:52.736268 32559 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:52.791993 32701 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:52.746776 32752 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.754835 32759 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:52.942986 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:52.920710 30549 raft_consensus.cc:2468] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
I20260709 13:08:53.006047 30516 leader_election.cc:304] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:53.128432 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:53.268105 31151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48412 (request call id 465) took 2920 ms. Trace:
W20260709 13:08:53.418819 31115 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.020s	sys 0.052s
I20260709 13:08:52.781245 32308 consensus_queue.cc:1048] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.792s
W20260709 13:08:53.448365 32540 consensus_meta.cc:287] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.665s	user 0.010s	sys 0.000s
I20260709 13:08:52.773514 32654 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:53.568887 31151 rpcz_store.cc:276] 0709 13:08:50.348104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.348293 (+   189us) service_pool.cc:224] Handling call
0709 13:08:50.646591 (+298298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:50.676107 (+ 29516us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:50.858429 (+182322us) log.cc:844] Serialized 14 byte log entry
0709 13:08:52.624012 (+1765583us) spinlock_profiling.cc:243] Waited 4.63 ms on lock 0x7b1800331720. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc783b104bc 00007fc780e5e48b 00007fc789cb8ab9 00007fc780e7a69b 00007fc780e7893f 00007fc780e78455 00007fc783f60060 00007fc783f72716 00007fc783f83287
0709 13:08:52.624093 (+    81us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:52.624134 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:52.624181 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.267700 (+643519us) spinlock_profiling.cc:243] Waited 28.8 ms on lock 0x7b54005a14d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:53.267785 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:53.267996 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59398,"prepare.queue_time_us":305888,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":56774,"raft.run_cpu_time_us":1979,"raft.run_wall_time_us":43587,"spinlock_wait_cycles":76966912,"thread_start_us":213710,"threads_started":2}
W20260709 13:08:52.839097 30591 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.878s	user 0.007s	sys 0.018s
W20260709 13:08:53.583118 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 1.62271e+06us
W20260709 13:08:52.844724 30517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.577354 30545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 407) took 1986 ms. Trace:
I20260709 13:08:53.583720 30545 rpcz_store.cc:276] 0709 13:08:51.590974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.349595 (+758621us) service_pool.cc:224] Handling call
0709 13:08:52.349859 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.782767 (+432908us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:52.782810 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:52.782877 (+    67us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:52.782922 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.577130 (+794208us) spinlock_profiling.cc:243] Waited 433 ms on lock 0x7b5400358754. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:53.577167 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:53.577296 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":995009920}
W20260709 13:08:53.585696 30517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.802294 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:53.568923 31149 raft_consensus.cc:2468] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 2.
I20260709 13:08:53.025640 31114 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:08:53.569240 31115 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.023s	sys 0.059s
W20260709 13:08:53.097625 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.925478 32753 raft_consensus.cc:493] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:53.576629 32632 raft_consensus.cc:2749] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:08:53.569183 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 563117us
I20260709 13:08:53.587574 32753 raft_consensus.cc:515] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:53.588064 32609 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:08:53.581045 30589 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.173.2:34733 timed out after 1.564s (SENT) [suppressed 10 similar messages]
W20260709 13:08:52.813831 32765 log.cc:927] Time spent T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:08:53.569666 30617 raft_consensus.cc:2410] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:08:53.111963 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:08:53.590190 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 847584us
I20260709 13:08:52.785151 32640 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:52.814033 32764 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:53.241243 31142 raft_consensus.cc:1240] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:53.382566 32583 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.004630 32737 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:52.995169 32642 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:52.781942 32750 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:53.049961 32715 leader_election.cc:290] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:52.829746 32717 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:53.592085 31147 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
W20260709 13:08:53.593492 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 567892us
I20260709 13:08:53.617035 30618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 281) took 3403 ms. Trace:
I20260709 13:08:53.592963 30516 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:53.102381 32694 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.006579 32655 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:52.941864 32679 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:53.050117 32656 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:53.071439 31148 raft_consensus.cc:1240] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:53.597886 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:53.005640 32594 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.190995 32550 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:53.566759 32762 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:53.352891 32261 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:53.569576 32736 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:53.158610 32763 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:53.047187 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:53.567735 32759 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:08:53.602483 31150 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.005s	sys 0.005s
I20260709 13:08:53.579100 32734 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:53.601969   303 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.606010 32750 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.571220 32752 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:53.606613 32753 leader_election.cc:290] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133)
I20260709 13:08:52.828223 32661 consensus_queue.cc:260] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:52.812992 32741 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:53.601946 32654 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:53.597159 32609 consensus_queue.cc:1048] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:08:53.609498 32713 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:53.591399   300 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.597446 32659 raft_consensus.cc:493] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:53.591580 32756 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:53.602566 32764 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:53.612385 32583 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:53.617434 30618 rpcz_store.cc:276] 0709 13:08:50.213398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.213505 (+   107us) service_pool.cc:224] Handling call
0709 13:08:50.213754 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:50.678428 (+464674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.616657 (+2938229us) spinlock_profiling.cc:243] Waited 464 ms on lock 0x7b54001d8654. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:53.616839 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1067025664}
I20260709 13:08:52.781725 32749 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:53.648276 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 55397.3us
I20260709 13:08:53.647367 30620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 288) took 3398 ms. Trace:
I20260709 13:08:53.598469 32718 raft_consensus.cc:2749] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:53.650442 30440 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.039s	sys 0.014s
I20260709 13:08:53.699714 32261 consensus_queue.cc:1048] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:53.701129 32261 consensus_queue.cc:1048] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:08:53.681775 31150 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.006s	sys 0.006s
I20260709 13:08:53.652595 32679 raft_consensus.cc:2749] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:53.657495 32732 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.660849 32763 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:53.649055 32694 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:53.706959 32694 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:53.656037 32594 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:53.709475 32749 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:53.710662 32739 leader_election.cc:290] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:53.711341 32594 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:53.713829 32583 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:53.715298 30622 raft_consensus.cc:2393] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 3: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:08:53.716439 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:53.682886 30616 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 5.
I20260709 13:08:53.697801 30516 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
W20260709 13:08:53.700001 30440 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.040s	sys 0.014s
I20260709 13:08:53.653174 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:53.703331 32732 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:53.657205 32762 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:53.696578 30620 rpcz_store.cc:276] 0709 13:08:50.249259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.250456 (+  1197us) service_pool.cc:224] Handling call
0709 13:08:50.462440 (+211984us) spinlock_profiling.cc:243] Waited 6.39 ms on lock 0x7b58001a3198. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780e43b71 00007fc780e43a22 00007fc789d5cc09 00007fc788eb6ee0 00007fc788f800ab 00007fc788f80131 00007fc788f41fc0 00007fc788f2c929 00007fc788f2c3d2 00007fc7824a3bd4
0709 13:08:52.308903 (+1846463us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b58001a3198. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780e43e9c 00007fc780e43a5b 00007fc789d5cc09 00007fc788eb6ee0 00007fc788f800ab 00007fc788f80131 00007fc788f41fc0 00007fc788f2c929 00007fc788f2c3d2 00007fc7824a3bd4
0709 13:08:52.309103 (+   200us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:52.596404 (+287301us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:52.596450 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:52.617344 (+ 20894us) log.cc:844] Serialized 26 byte log entry
0709 13:08:52.750164 (+132820us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:52.750214 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.750282 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:53.647111 (+896829us) raft_consensus.cc:1685] finished
0709 13:08:53.647138 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:53.647299 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":185971,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":8730,"spinlock_wait_cycles":40151296,"thread_start_us":316259,"threads_started":2,"wal-append.queue_time_us":113927}
I20260709 13:08:53.725670 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:53.726238 30620 raft_consensus.cc:2468] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
I20260709 13:08:53.726938 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:53.727276 30620 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:53.729858 30549 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39952 (request call id 1338) took 2166 ms (client timeout 1592 ms). Trace:
I20260709 13:08:53.602689 32640 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:53.723385 30516 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:53.739153 32654 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:53.685192   303 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:53.739696 32752 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:53.698740 32659 raft_consensus.cc:515] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:53.740696 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:53.694986   300 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:53.741603 32764 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:53.743404 32762 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:53.743554 32763 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:53.686846 32750 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:53.743877 30617 raft_consensus.cc:2468] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 2.
I20260709 13:08:53.782829 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:53.783528 30624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 289) took 2948 ms. Trace:
I20260709 13:08:53.725057 32713 raft_consensus.cc:2764] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:08:53.784092 30624 rpcz_store.cc:276] 0709 13:08:50.835127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.835391 (+   264us) service_pool.cc:224] Handling call
0709 13:08:50.835666 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.636483 (+1800817us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.783205 (+1146722us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b54001d8b54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:53.783450 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4139856256}
I20260709 13:08:53.783567 30619 raft_consensus.cc:2393] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 5: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:08:53.747740 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:08:53.730372 30549 rpcz_store.cc:269] 0709 13:08:51.563390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.566016 (+  2626us) service_pool.cc:224] Handling call
0709 13:08:53.729633 (+2163617us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b54003d9fd4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:08:53.729751 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1110793984}
I20260709 13:08:53.754210 30516 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:53.796695 30516 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:53.755937 32759 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:53.756264 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:53.757265 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 170166us
W20260709 13:08:53.761878 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:53.769891 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 188853us
I20260709 13:08:53.787837 30620 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 5.
I20260709 13:08:53.759593 32609 raft_consensus.cc:2749] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:53.764678 32736 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:53.760480   304 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:53.800282 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:53.805148 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:53.802580 32717 raft_consensus.cc:2804] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:53.813463 30620 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:53.813519 32717 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.814069 32717 raft_consensus.cc:3060] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:53.786269 30616 raft_consensus.cc:3060] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:53.764925 32594 consensus_queue.cc:1059] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:08:53.821547 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:53.823046 30624 raft_consensus.cc:2468] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 3.
I20260709 13:08:53.823968 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:53.764365 32261 consensus_queue.cc:1059] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:08:53.824687 30624 raft_consensus.cc:2468] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 4.
I20260709 13:08:53.782451 32504 consensus_queue.cc:1048] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:08:53.825567 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:53.830000 30619 raft_consensus.cc:2468] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 1.
I20260709 13:08:53.828608 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:53.808629 32540 raft_consensus.cc:2804] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:53.808497 31144 raft_consensus.cc:2468] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:08:53.819113   315 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:53.823298 32762 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:53.842922 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:53.846576 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:53.847159 30619 raft_consensus.cc:2468] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 3.
I20260709 13:08:53.811510 32759 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:53.833622 32594 raft_consensus.cc:3055] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:53.836794 32540 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.850857 31115 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:53.820681 32736 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:53.822084   304 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:53.831769 32261 consensus_queue.cc:1243] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer fe2b7d73f8c743c1ba570cfd981c4e79 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:08:53.873742 30623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36130 (request call id 1575) took 1052 ms. Trace:
I20260709 13:08:53.882328 32583 consensus_queue.cc:1048] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:53.883060 32583 consensus_queue.cc:1243] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer f639301059e24dc5b0d88a46dc683326 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:08:53.885068 32700 raft_consensus.cc:2804] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:53.859293 32594 raft_consensus.cc:740] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:53.886584 31144 raft_consensus.cc:1240] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 6 LEADER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 4. Current term is 6. Ops: [4.7-4.7]
I20260709 13:08:53.886439 32594 consensus_queue.cc:260] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:53.856395 32741 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:53.827569 32679 consensus_queue.cc:1048] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:08:53.863858 32701 consensus_queue.cc:1059] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:08:53.888950 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:53.889382 32701 raft_consensus.cc:3055] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:53.890093 32701 raft_consensus.cc:740] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:53.892596 32640 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:53.838725 32756 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:53.847503 32762 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:53.909900 32762 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:53.912915 32576 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:53.865314 31115 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:08:53.867280   309 log.cc:927] Time spent T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:08:53.915431 30542 raft_consensus.cc:1275] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:08:53.915843 30542 pending_rounds.cc:85] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd: Aborting all ops after (but not including) 5
I20260709 13:08:53.885496 32700 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:53.916093 30542 pending_rounds.cc:107] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:08:53.916304 32700 raft_consensus.cc:3060] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:53.920600 32736 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:53.865912 32540 raft_consensus.cc:3060] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:53.889492 30619 raft_consensus.cc:3060] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:53.848232   315 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:53.901774   303 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:53.903163   300 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:53.916397 30542 raft_consensus.cc:2889] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:53.898366   304 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:53.929630 32594 raft_consensus.cc:3060] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:53.930141 30625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 300) took 1195 ms. Trace:
I20260709 13:08:53.930552 30542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43088 (request call id 1599) took 3042 ms. Trace:
I20260709 13:08:53.930518 30625 rpcz_store.cc:276] 0709 13:08:52.734578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.734716 (+   138us) service_pool.cc:224] Handling call
0709 13:08:52.734994 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.771602 (+ 36608us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:52.771631 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:52.771670 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:52.771699 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.929935 (+1158236us) spinlock_profiling.cc:243] Waited 36.4 ms on lock 0x7b5400344ed4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:53.929975 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:53.930087 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83789056}
I20260709 13:08:53.931052 30542 rpcz_store.cc:276] 0709 13:08:50.888332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.890518 (+  2186us) service_pool.cc:224] Handling call
0709 13:08:50.988101 (+ 97583us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.929781 (+2941680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.930313 (+   532us) spinlock_profiling.cc:243] Waited 2.93 s on lock 0x7b5400357d54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:53.930489 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6731135872}
I20260709 13:08:53.932164 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:53.874239 30623 rpcz_store.cc:276] 0709 13:08:52.822321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.822716 (+   395us) service_pool.cc:224] Handling call
0709 13:08:53.872865 (+1050149us) spinlock_profiling.cc:243] Waited 63.2 ms on lock 0x7b58001a3198. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780e43b71 00007fc780e43a22 00007fc789d5cc09 00007fc788eb6ee0 00007fc788f800ab 00007fc788f80131 00007fc788f41fc0 00007fc788f2c929 00007fc788f2c3d2 00007fc7824a3bd4
0709 13:08:53.873102 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.873325 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:53.873361 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:53.873424 (+    63us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:53.873474 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.873546 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:53.873674 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":145328384}
W20260709 13:08:53.924665 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 59450.8us
I20260709 13:08:53.926601 32759 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:53.927985 32749 raft_consensus.cc:2804] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:53.936893 32749 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.937386 32749 raft_consensus.cc:3060] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:53.938701 32717 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:53.832595 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:53.941076 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:53.941823 30622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36130 (request call id 1572) took 1140 ms. Trace:
I20260709 13:08:53.942071 30624 raft_consensus.cc:2468] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 4.
I20260709 13:08:53.942257 30622 rpcz_store.cc:276] 0709 13:08:52.801565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.802002 (+   437us) service_pool.cc:224] Handling call
0709 13:08:53.941643 (+1139641us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54003d9ad4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:08:53.941768 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":296449792}
I20260709 13:08:53.943727 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:53.846086 30620 raft_consensus.cc:2468] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 4.
I20260709 13:08:53.944859 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:53.948498 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:53.944304 30623 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 3.
I20260709 13:08:53.950559 31115 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:53.952944 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:08:53.953212 30441 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.953539 30625 raft_consensus.cc:2468] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 4.
I20260709 13:08:53.954154 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:53.954501 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:53.955291 30625 raft_consensus.cc:2468] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 5.
I20260709 13:08:53.955696 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:53.956472 30624 raft_consensus.cc:2468] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 1.
I20260709 13:08:53.957468 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:53.958479 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:53.958633 32648 raft_consensus.cc:2804] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:53.958945 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:53.959319 32648 raft_consensus.cc:697] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:53.959548 30625 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
I20260709 13:08:53.960268 30625 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99c151771be541b19017860da4f7218d"
dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
mode: GRACEFUL
new_leader_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:49382
I20260709 13:08:53.960793 30625 raft_consensus.cc:606] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Received request to transfer leadership to TS 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:53.961158 30625 raft_consensus.cc:614] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:53.962021 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:53.962778 30623 raft_consensus.cc:2468] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 4.
I20260709 13:08:53.964612 31115 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:53.960973   315 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:53.891162 32701 consensus_queue.cc:260] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:53.969703 32701 raft_consensus.cc:3060] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:53.958683 32717 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:53.961302   304 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:53.972525   304 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:53.974505 30616 raft_consensus.cc:2468] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
I20260709 13:08:53.975046   304 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:53.950515 32759 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.976022 32759 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:53.978621 32759 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:08:53.988209 30441 connection.cc:256] RPC call timeout handler was delayed by -2.795452783000087s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1534s for a response
W20260709 13:08:53.988581 30441 connection.cc:256] RPC call timeout handler was delayed by -2.7009527830000479s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16390000000000002s for a response
I20260709 13:08:53.988608 30619 raft_consensus.cc:2468] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 3.
W20260709 13:08:53.988945 30441 connection.cc:256] RPC call timeout handler was delayed by -2.5902527830000963s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17620000000000002s for a response
W20260709 13:08:53.989260 30441 connection.cc:256] RPC call timeout handler was delayed by -2.5803527830000803s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1773s for a response
W20260709 13:08:53.989517 30441 connection.cc:256] RPC call timeout handler was delayed by -2.5614527830000497s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1794s for a response
W20260709 13:08:53.990006 30441 connection.cc:256] RPC call timeout handler was delayed by -2.4336527830000705s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1936s for a response
W20260709 13:08:53.990371 30441 connection.cc:256] RPC call timeout handler was delayed by -2.3789550440000085s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1517s for a response
W20260709 13:08:53.990639 30441 connection.cc:256] RPC call timeout handler was delayed by -2.3483016790000875s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1773s for a response
W20260709 13:08:53.990912 30441 connection.cc:256] RPC call timeout handler was delayed by -2.3229527830000052s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20590000000000003s for a response
W20260709 13:08:53.991178 30441 connection.cc:256] RPC call timeout handler was delayed by -2.3211527830000023s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2061s for a response
I20260709 13:08:53.991375 30619 raft_consensus.cc:1275] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:53.991617 32698 raft_consensus.cc:2804] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:53.992086 32698 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:53.992455 32698 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:53.996284 32741 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.996731 32741 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:53.997457 32661 raft_consensus.cc:3060] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:53.998724 32741 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:53.999986 32656 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:54.000440 32656 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:54.002285 32656 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:54.002702 32656 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:54.003135 32656 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:53.991432 30441 connection.cc:256] RPC call timeout handler was delayed by -2.2246917439999834s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17310000000000003s for a response
I20260709 13:08:53.967427 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:54.008138 30622 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 3.
I20260709 13:08:54.013269 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.014175 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.014768 30545 raft_consensus.cc:1275] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:54.014600 32641 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.015661 32694 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:54.016281 32694 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:54.016563 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.017331 30543 raft_consensus.cc:2368] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 4. Current term is 5.
I20260709 13:08:54.018266 32694 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:54.024025 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.028601   315 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:54.030582   315 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:54.031335 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.032579   315 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:54.014195 32576 consensus_queue.cc:1059] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:08:54.032546 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.021169 32739 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:54.029043 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.015481 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.035000 30475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 366) took 2943 ms. Trace:
I20260709 13:08:54.034185 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.014590   303 consensus_queue.cc:1059] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:54.037214 30617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36130 (request call id 1577) took 1212 ms. Trace:
I20260709 13:08:54.003966 32686 raft_consensus.cc:493] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:54.051116 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:54.142108 30617 rpcz_store.cc:276] 0709 13:08:52.824439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.652943 (+828504us) service_pool.cc:224] Handling call
0709 13:08:54.037065 (+384122us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b54002debd4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:08:54.037163 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50678528}
I20260709 13:08:54.149607 30548 raft_consensus.cc:2376] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5. Re-sending same reply.
I20260709 13:08:54.033269   315 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:54.051374 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.029307 30550 raft_consensus.cc:3055] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:54.150723 30550 raft_consensus.cc:740] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:54.035445 32732 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:54.151654 30543 raft_consensus.cc:2393] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 3: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:54.034617 30544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 402) took 3036 ms. Trace:
I20260709 13:08:54.011849   304 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:54.152208 30544 rpcz_store.cc:276] 0709 13:08:50.998334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.999520 (+  1186us) service_pool.cc:224] Handling call
0709 13:08:51.009561 (+ 10041us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.026048 (+2016487us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.034407 (+1008359us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b5400258ad4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:54.034558 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3792340352}
I20260709 13:08:54.152750   304 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:54.153554 32072 consensus_queue.cc:1048] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:54.155556 32659 leader_election.cc:290] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:54.156896 31143 raft_consensus.cc:1240] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 5 LEADER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:54.157599 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:08:54.158334 30621 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36130 (request call id 1573) took 1356 ms (client timeout 1534 ms). Trace:
I20260709 13:08:54.158725 31143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48426 (request call id 539) took 1393 ms. Trace:
W20260709 13:08:54.158658 30621 rpcz_store.cc:269] 0709 13:08:52.801882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.807697 (+  5815us) service_pool.cc:224] Handling call
0709 13:08:54.157467 (+1349770us) spinlock_profiling.cc:243] Waited 63.7 ms on lock 0x7b58001a3198. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780e43b71 00007fc780e43a22 00007fc789d5cc09 00007fc788eb6ee0 00007fc788f800ab 00007fc788f80131 00007fc788f2e0a0 00007fc788f2d984 00007fc7824a86d4 00007fc7824a8662
0709 13:08:54.158279 (+   812us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":146566912}
I20260709 13:08:54.159109 31143 rpcz_store.cc:276] 0709 13:08:52.765064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.770854 (+  5790us) service_pool.cc:224] Handling call
0709 13:08:52.942120 (+171266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:54.157458 (+1215338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.158509 (+  1051us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b5400477cd4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:54.158667 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2793212800}
W20260709 13:08:54.077603 30441 connection.cc:256] RPC call timeout handler was delayed by -2.005097534000015s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19630000000000003s for a response
I20260709 13:08:54.160686 30441 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:54.160812 32501 raft_consensus.cc:3055] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:54.161316 32501 raft_consensus.cc:740] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:54.161787 30441 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:54.162890 30441 leader_election.cc:304] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:54.162439 32501 consensus_queue.cc:260] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:54.082351 30623 raft_consensus.cc:1240] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 4. Current term is 6. Ops: [4.7-4.7]
I20260709 13:08:54.062178 30624 raft_consensus.cc:2410] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:54.052562 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.166972 30549 raft_consensus.cc:2468] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:54.086680 32736 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:54.035390 30589 leader_election.cc:400] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 4. Current term is 5.
I20260709 13:08:54.169804 30589 leader_election.cc:403] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:08:54.012820 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 193347us
I20260709 13:08:54.151595 30550 consensus_queue.cc:260] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:54.171105 30550 raft_consensus.cc:3060] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:54.018784 32761 log.cc:927] Time spent T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.413s	user 0.000s	sys 0.003s
I20260709 13:08:54.039575 31116 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:54.054067 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.156973 30468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 1897) took 4187 ms. Trace:
I20260709 13:08:54.176470 30468 rpcz_store.cc:276] 0709 13:08:49.969834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.090318 (+120484us) service_pool.cc:224] Handling call
0709 13:08:51.593926 (+1503608us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:52.346614 (+752688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.156781 (+1810167us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b5400176bd0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f678ad 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:08:54.156916 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3457032448}
I20260709 13:08:54.178079 30545 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:08:54.023627 31150 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48426 (request call id 537) took 1259 ms. Trace:
W20260709 13:08:54.181232 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 141722us
I20260709 13:08:54.182343 31116 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:54.172962 30475 rpcz_store.cc:276] 0709 13:08:51.091678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.091794 (+   116us) service_pool.cc:224] Handling call
0709 13:08:51.095201 (+  3407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:51.095525 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:51.095561 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:53.745188 (+2649627us) spinlock_profiling.cc:243] Waited 955 ms on lock 0x7b2c000014c8. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc782861a11 00007fc782871372 00007fc783fa3a01 00007fc783f6843a 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2
0709 13:08:53.745561 (+   373us) log.cc:844] Serialized 26 byte log entry
0709 13:08:53.762299 (+ 16738us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:54.034224 (+271925us) spinlock_profiling.cc:243] Waited 5.92 ms on lock 0x7b18001c4da0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc783b104bc 00007fc780e5e48b 00007fc789cb8ab9 00007fc780e7a69b 00007fc780e7893f 00007fc780e78455 00007fc7879603c7 00007fc783f729a7 00007fc783f820bf
0709 13:08:54.034385 (+   161us) log.cc:844] Serialized 14 byte log entry
0709 13:08:54.034637 (+   252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.034735 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:54.034787 (+    52us) raft_consensus.cc:1685] finished
0709 13:08:54.034804 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:54.034938 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":91113,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":23140,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":139432,"spinlock_wait_cycles":2210749696,"thread_start_us":69398,"threads_started":2,"wal-append.queue_time_us":86560}
W20260709 13:08:54.197228 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.006418 32752 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.163379 32711 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:54.179162 31150 rpcz_store.cc:276] 0709 13:08:52.764480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.769350 (+  4870us) service_pool.cc:224] Handling call
0709 13:08:52.769606 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:52.952329 (+182723us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:53.702551 (+750222us) log.cc:844] Serialized 14 byte log entry
0709 13:08:53.809584 (+107033us) log.cc:844] Serialized 14 byte log entry
0709 13:08:53.809840 (+   256us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:53.809898 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:53.809958 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.908351 (+ 98393us) spinlock_profiling.cc:243] Waited 7.13 ms on lock 0x7b1800075220. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e7b3f3 00007fc780e7d7c1 00007fc780e7d779 00007fc780e7d709 00007fc780e7d6d1 00007fc780e7c9cd 000000000038f354 000000000038f199 00007fc780e5e83a
0709 13:08:54.023431 (+115080us) spinlock_profiling.cc:243] Waited 31.9 ms on lock 0x7b5400573d54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:54.023473 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:54.023575 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12595,"prepare.queue_time_us":751991,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":67,"raft.queue_time_us":578,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"spinlock_wait_cycles":89824896,"thread_start_us":778463,"threads_started":2,"wal-append.queue_time_us":147920}
W20260709 13:08:54.202371 30517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:54.238471 30517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.047570 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:54.028410 32640 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:53.960544 32648 consensus_queue.cc:237] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:54.033929 32751 raft_consensus.cc:3055] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:54.035645 32760 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:54.042819   300 consensus_queue.cc:1048] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.199s
I20260709 13:08:54.237478 30516 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
W20260709 13:08:54.210198 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.257293 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.094090 32632 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:54.245256 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 63028.2us
I20260709 13:08:54.236097 32732 raft_consensus.cc:2804] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:08:54.226955 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 191684us
I20260709 13:08:54.167833 32737 raft_consensus.cc:2749] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:54.153529 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.252028 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.167964 32756 raft_consensus.cc:2749] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:54.179217 32694 raft_consensus.cc:2804] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:08:54.255941 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.013495 32759 raft_consensus.cc:493] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.012307 32583 consensus_queue.cc:1059] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.231s
I20260709 13:08:54.201347 32688 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:54.258229 32501 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:54.247562 32713 consensus_queue.cc:1059] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:08:54.324395 32576 raft_consensus.cc:3055] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:54.324811 32576 raft_consensus.cc:740] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:54.324553 32688 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:54.325662 32576 consensus_queue.cc:260] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:54.327028 32576 raft_consensus.cc:3060] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:54.245708 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 43933.7us
I20260709 13:08:54.015561 32641 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:54.329803 32641 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:54.261309 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.330958 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.331537 30548 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 4.
I20260709 13:08:54.167917 32686 raft_consensus.cc:515] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:54.332401 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.332970 30548 raft_consensus.cc:2468] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 2.
I20260709 13:08:54.333364 32686 leader_election.cc:290] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:54.334589 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.174136 30542 raft_consensus.cc:2468] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:08:54.339165 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.339779 30542 raft_consensus.cc:2468] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 6.
I20260709 13:08:54.241421 32659 raft_consensus.cc:3060] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:08:54.287658 30589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:54.354161 30589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.356236 30589 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:54.294845 30546 raft_consensus.cc:3055] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:54.294435 32540 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:54.299677 30544 raft_consensus.cc:2393] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 3: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:08:54.300380 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:54.288751 32694 raft_consensus.cc:493] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:54.239101 32736 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:54.309403 30469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 367) took 3217 ms. Trace:
I20260709 13:08:54.309489 32698 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:54.250432 32397 raft_consensus.cc:2749] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:54.314381 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:54.353609 32261 raft_consensus.cc:2804] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:54.373888 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.166481 32739 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:54.361450 32501 raft_consensus.cc:2749] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:54.378368 32750 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:54.320724 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.379873 32540 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:54.251142 32751 raft_consensus.cc:740] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:54.381281 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:54.381122 32751 consensus_queue.cc:260] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:08:54.382426 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.382386 32751 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:54.382653 32698 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:54.183996   315 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:54.261713 30550 raft_consensus.cc:1275] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:08:54.383975 30550 pending_rounds.cc:85] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd: Aborting all ops after (but not including) 4
I20260709 13:08:54.384511 30550 pending_rounds.cc:107] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:08:54.384734 30550 raft_consensus.cc:2889] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:54.384828 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.385584 30544 raft_consensus.cc:2468] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 2.
I20260709 13:08:54.386538 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.387144 30544 raft_consensus.cc:2468] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 2.
I20260709 13:08:54.388535   315 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:54.389600 30549 raft_consensus.cc:2468] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:08:54.334903 32759 raft_consensus.cc:515] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:54.390817 32736 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:54.391467 32559 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:54.336340 32329 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:54.287019 32632 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:54.340590 30548 raft_consensus.cc:2468] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 3.
I20260709 13:08:54.392930 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.393559 30548 raft_consensus.cc:2393] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 5: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:08:54.394291 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.394819 30548 raft_consensus.cc:2468] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:54.336119 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:08:54.346361 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.401310 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:54.291236 32732 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:54.357033 30546 raft_consensus.cc:740] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:54.296625 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.359836 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:54.360996 30551 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:54.262411 32760 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:54.251267 32741 consensus_queue.cc:1048] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 13:08:54.362497 30589 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:54.366161 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:54.312278 32700 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:54.369818 30469 rpcz_store.cc:276] 0709 13:08:51.091962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.092617 (+   655us) service_pool.cc:224] Handling call
0709 13:08:51.097906 (+  5289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:51.098198 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:51.098227 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:54.040184 (+2941957us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b2c000014c8. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc782861a11 00007fc782871372 00007fc783fa3a01 00007fc783f6843a 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2
0709 13:08:54.040529 (+   345us) log.cc:844] Serialized 26 byte log entry
0709 13:08:54.184860 (+144331us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:54.184908 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.185065 (+   157us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:54.309115 (+124050us) raft_consensus.cc:1685] finished
0709 13:08:54.309134 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:54.309330 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":138112,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":10650,"spinlock_wait_cycles":52075392,"thread_start_us":144042,"threads_started":1,"wal-append.queue_time_us":267238}
I20260709 13:08:54.199561 32575 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.383981 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.396522 30547 raft_consensus.cc:2468] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 2.
I20260709 13:08:54.343773 30440 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:08:54.413347 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 69650.3us
I20260709 13:08:54.415184 30440 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:54.395565 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.240178 32752 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:54.401850 30620 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:54.370731 32694 raft_consensus.cc:3060] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:54.259054 32640 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:54.405951 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.433143 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.410852 32732 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:54.408249 30546 consensus_queue.cc:260] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:08:54.411320 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 248465us
W20260709 13:08:54.422039 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 59623.4us
I20260709 13:08:54.411549 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.393262 32261 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:54.424647 30440 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:54.359576 32749 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:54.428488 30625 raft_consensus.cc:1240] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 2. Current term is 3. Ops: []
W20260709 13:08:54.434293 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.434978 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:54.436923 30620 raft_consensus.cc:2468] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 5.
I20260709 13:08:54.430465 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:54.437813 30545 raft_consensus.cc:2468] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 5.
W20260709 13:08:54.407585 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 92439us
I20260709 13:08:54.410444 32739 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:54.440577 30546 raft_consensus.cc:3060] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:54.423338 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.430070 32736 raft_consensus.cc:2804] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:54.427879   323 raft_consensus.cc:2804] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:54.435748 32501 raft_consensus.cc:2804] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:54.426738 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:08:54.485323 30517 leader_election.cc:336] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.579s (SENT)
I20260709 13:08:54.500615 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.488512 30441 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:54.501268 31115 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:54.501408 30545 raft_consensus.cc:2468] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 4.
I20260709 13:08:54.502158 30441 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:08:54.502211 30517 leader_election.cc:336] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.660s (SENT)
I20260709 13:08:54.502414 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.502833 30517 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:54.470894 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:54.452145 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:54.504873 30548 raft_consensus.cc:2468] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 2.
I20260709 13:08:54.505061 30468 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 3.
I20260709 13:08:54.505800 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.506153 30469 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 4.
I20260709 13:08:54.506548 30548 raft_consensus.cc:2368] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 2. Current term is 3.
I20260709 13:08:54.428992 32656 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:08:54.507187 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 66427.7us
I20260709 13:08:54.458505 30551 raft_consensus.cc:2468] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 6.
I20260709 13:08:54.507747 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:08:54.512633 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.510592 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.510329 30440 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:54.454777 30618 raft_consensus.cc:2468] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 2.
I20260709 13:08:54.512136 30589 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:54.518363 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:54.518923 30475 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 4.
I20260709 13:08:54.519053 30589 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:54.519544 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:54.512677 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.520463 30545 raft_consensus.cc:2468] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 4.
I20260709 13:08:54.520665 30440 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:54.521512 30440 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:54.522059 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.523327 30441 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:54.526604 30589 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:54.526746 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:54.527393 32656 raft_consensus.cc:2804] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:54.500031 32501 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:54.527794 32656 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:54.528162 32750 raft_consensus.cc:2749] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:54.528381   303 consensus_queue.cc:1048] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:54.528263 32656 raft_consensus.cc:3060] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:54.529461 32632 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:54.530376 30589 leader_election.cc:400] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 2. Current term is 3.
I20260709 13:08:54.530889 30589 leader_election.cc:403] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:54.530344 32694 raft_consensus.cc:515] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:54.428061 32575 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:54.532646 32694 leader_election.cc:290] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:54.533373 32694 raft_consensus.cc:2804] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:54.533751 32694 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:54.534170 32694 raft_consensus.cc:3060] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:54.534202 32700 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:54.528627 32739 raft_consensus.cc:2804] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:54.540818 30546 raft_consensus.cc:1275] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:08:54.537479 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:54.541739 30625 raft_consensus.cc:3060] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:54.542330 30546 pending_rounds.cc:85] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd: Aborting all ops after (but not including) 1
I20260709 13:08:54.539286 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:54.542645 30546 pending_rounds.cc:107] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:08:54.543893 30546 raft_consensus.cc:2889] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:54.522624 30548 raft_consensus.cc:2468] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 5.
I20260709 13:08:54.470532 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:54.509464 32736 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:54.545934 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.467567 32686 raft_consensus.cc:2804] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:54.517310 32737 raft_consensus.cc:2764] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:08:54.548889 30620 raft_consensus.cc:1275] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:54.549047 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:54.543139 31146 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
W20260709 13:08:54.563886 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.642290 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:08:54.707486 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.623387 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:54.606717 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:54.705941 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.697114 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:08:54.565274 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.709509 30550 raft_consensus.cc:2393] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 3: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
W20260709 13:08:54.583945 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:54.710672 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:54.592442 30517 leader_election.cc:336] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.757s (SENT)
W20260709 13:08:54.711570 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 119173us
W20260709 13:08:54.629632 30516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:54.712857 30517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.712803 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.528113 32501 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:54.713696 30551 raft_consensus.cc:2468] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 2.
W20260709 13:08:54.659552 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.710553 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.641901 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:54.708837 30548 raft_consensus.cc:2468] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:54.641527 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:54.590505 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:54.717619 30622 raft_consensus.cc:1240] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 LEADER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 6. Current term is 7. Ops: [6.5-6.5]
W20260709 13:08:54.714784 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 191497us
I20260709 13:08:54.525677 32576 raft_consensus.cc:2804] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:54.525554 32661 raft_consensus.cc:2804] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:54.549471 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:54.721362 30441 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:54.511382   323 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:54.725651 30516 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:54.721915 31149 raft_consensus.cc:2468] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
I20260709 13:08:54.723033 30624 raft_consensus.cc:2468] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:08:54.578991 31114 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:54.722321 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.729948 30548 raft_consensus.cc:2468] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:08:54.537487 32648 raft_consensus.cc:2804] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:54.511231 32261 raft_consensus.cc:3060] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:54.718179 30546 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 5.
W20260709 13:08:54.723979   318 log.cc:927] Time spent T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:08:54.756736 30544 raft_consensus.cc:1275] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:54.616012 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:54.545418   303 raft_consensus.cc:3060] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:08:54.525272 32756 raft_consensus.cc:3060] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:54.517182 32713 raft_consensus.cc:2749] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:54.730786 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.764357 30548 raft_consensus.cc:1240] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:54.717865 32640 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:08:54.590786 32600 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:08:54.541121 32739 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:54.767390 32739 raft_consensus.cc:3060] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:54.768433 32688 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:54.769120 30589 leader_election.cc:304] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:08:54.770020 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.771232 32688 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.771593 32575 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:54.771704 32688 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:54.728493 32641 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.732659 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.773542 32641 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:54.733611 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 154706us
I20260709 13:08:54.642894 31148 raft_consensus.cc:1240] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:54.776302 32750 consensus_queue.cc:1048] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:54.777103 32688 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:54.778002 32750 raft_consensus.cc:2804] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:54.778373 32750 raft_consensus.cc:493] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:54.778716 32750 raft_consensus.cc:3060] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:54.779553 32759 leader_election.cc:290] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:08:54.784204 30618 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36130 (request call id 1579) took 1954 ms (client timeout 1773 ms). Trace:
W20260709 13:08:54.784652 30618 rpcz_store.cc:269] 0709 13:08:52.830059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.716190 (+886131us) service_pool.cc:224] Handling call
0709 13:08:54.784046 (+1067856us) spinlock_profiling.cc:243] Waited 738 ms on lock 0x7b54003467d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:08:54.784139 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1696447360}
I20260709 13:08:54.785730 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:54.722410 30619 raft_consensus.cc:2468] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
I20260709 13:08:54.737007 32397 raft_consensus.cc:2804] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:54.737371 30621 raft_consensus.cc:1240] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:54.738821 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.788657 30546 raft_consensus.cc:2468] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
I20260709 13:08:54.591010 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:54.617498 32749 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:54.706569 32686 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:54.727005 32540 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:54.741321 32679 raft_consensus.cc:2804] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:54.743108   316 raft_consensus.cc:3055] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:54.727841 32576 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:54.819686 32576 raft_consensus.cc:3060] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.744549 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:54.747663 30551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
mode: GRACEFUL
new_leader_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:45906
I20260709 13:08:54.820844 30551 raft_consensus.cc:606] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Received request to transfer leadership to TS f639301059e24dc5b0d88a46dc683326
I20260709 13:08:54.821179 30551 raft_consensus.cc:614] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:54.617835 32656 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:54.548930 32559 consensus_queue.cc:1059] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.194s
I20260709 13:08:54.749785 32760 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:54.644332 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:54.723032 32736 raft_consensus.cc:3060] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:54.737370 32737 raft_consensus.cc:2749] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:54.732328 32741 raft_consensus.cc:2804] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:54.731402 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.843849 30547 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 4.
I20260709 13:08:54.723505 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:54.789842 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.814958 32679 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:54.793560 32397 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:54.784264 30589 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:08:54.861835 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 77650.4us
I20260709 13:08:54.796017 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:54.775583 32641 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:54.799649 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:54.804656 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:54.868307 30619 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
I20260709 13:08:54.792727 30516 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:54.730563 32661 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:54.811517 30549 raft_consensus.cc:1240] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 4. Current term is 5. Ops: []
W20260709 13:08:54.813071 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.730911   323 raft_consensus.cc:3060] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:54.791683 32648 raft_consensus.cc:697] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 5 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:54.825402 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:54.812412 32686 raft_consensus.cc:3060] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:54.813297 32759 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:54.840845 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 319368us
I20260709 13:08:54.928297 30440 leader_election.cc:304] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:54.817262   316 raft_consensus.cc:740] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:54.845108 30620 raft_consensus.cc:3060] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:54.932152 30623 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
I20260709 13:08:54.861460 30616 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
I20260709 13:08:54.845398 30550 raft_consensus.cc:2393] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 5: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:08:54.936141 30440 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:54.936774 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:54.790856 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:54.846760 31144 raft_consensus.cc:2393] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 4: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:08:54.847119 30370 catalog_manager.cc:5697] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 3 to 4, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 4 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:54.867120 32751 raft_consensus.cc:2804] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:54.856670 32736 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:54.857537 32741 raft_consensus.cc:697] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 5 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:54.862486 30589 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:54.945529 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:54.946316 30551 raft_consensus.cc:2393] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 5: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:08:54.904539 32641 raft_consensus.cc:2804] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:54.863250 32397 raft_consensus.cc:3060] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:54.817839 32540 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:54.872925 32395 consensus_queue.cc:1059] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.078s
W20260709 13:08:54.920554 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.937827 30440 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:54.865571   304 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:54.941037 30370 catalog_manager.cc:5697] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 1 to 4, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 4 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:54.849685 30374 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57546 (request call id 304) took 8128 ms. Trace:
I20260709 13:08:54.873574 32752 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:54.865609 30543 raft_consensus.cc:2468] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
I20260709 13:08:54.968118 30440 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:54.943184 32760 raft_consensus.cc:2804] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:08:54.871649 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 78976us
I20260709 13:08:54.947113 30620 raft_consensus.cc:2468] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 4.
I20260709 13:08:54.994127 30620 raft_consensus.cc:1240] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:54.994146 31115 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:54.993156 30440 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:54.944794   328 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.944867 32737 raft_consensus.cc:2804] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:08:54.945425 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 83008us
I20260709 13:08:54.950891 32736 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:54.951689 32741 consensus_queue.cc:237] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:54.952476   316 consensus_queue.cc:260] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:54.953562 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:55.014176 30550 raft_consensus.cc:2468] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 4.
I20260709 13:08:54.954581 30623 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb22806325394ba386d8549bc4a64701"
dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
mode: GRACEFUL
new_leader_uuid: "cd669586cff44d4bbfcc007e213faab6"
 from {username='slave'} at 127.0.0.1:49382
I20260709 13:08:55.014973 30623 raft_consensus.cc:606] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 LEADER]: Received request to transfer leadership to TS cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:54.948580 32648 consensus_queue.cc:237] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:54.955235   303 raft_consensus.cc:2749] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 2. Current term is 3.
I20260709 13:08:54.959193 32750 raft_consensus.cc:515] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:54.959925 31147 raft_consensus.cc:2468] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
I20260709 13:08:54.948025 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:54.842933 30542 raft_consensus.cc:2468] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7.
W20260709 13:08:54.962625 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:54.963452 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.027032 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:54.861766 32679 raft_consensus.cc:3060] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:54.939096 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:54.943509 32751 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:54.903913 32661 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:54.945168 32329 raft_consensus.cc:3055] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:55.038759 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:55.039666 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:55.026919 32736 raft_consensus.cc:2804] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:54.989683 30370 catalog_manager.cc:5697] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 1 to 2, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 2 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:54.993108 30516 leader_election.cc:304] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:08:55.048062 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 55018.1us
I20260709 13:08:55.049494 32575 raft_consensus.cc:2804] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:55.050201 32575 raft_consensus.cc:697] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 3 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:55.050223 30516 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:55.033280   316 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:55.001195 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:08:55.001291 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 272607us
I20260709 13:08:55.085785 30441 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:55.086866 30441 leader_election.cc:304] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:54.961971 32641 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:54.934998 32759 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:54.988910 32688 raft_consensus.cc:2804] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:54.967092 32261 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:55.008530 32752 raft_consensus.cc:2804] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:54.992161 32760 raft_consensus.cc:493] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.012092 32726 raft_consensus.cc:2804] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:55.002344 32737 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.128263 32737 raft_consensus.cc:3060] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:55.128350   331 raft_consensus.cc:2804] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:55.128831   331 raft_consensus.cc:493] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:55.129199   331 raft_consensus.cc:3060] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:54.982646 30374 rpcz_store.cc:276] 0709 13:08:46.721099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.721289 (+   190us) service_pool.cc:224] Handling call
0709 13:08:54.849624 (+8128335us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:49.014886 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:49.043850 (+ 28964us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:49.043915 (+    65us) write_op.cc:435] Acquired schema lock
0709 13:08:49.043940 (+    25us) tablet.cc:662] Decoding operations
0709 13:08:49.045764 (+  1824us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:49.045869 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:49.045908 (+    39us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:08:49.047642 (+  1734us) tablet.cc:701] Row locks acquired
0709 13:08:49.047699 (+    57us) write_op.cc:260] PREPARE: finished
0709 13:08:49.099773 (+ 52074us) write_op.cc:270] Start()
0709 13:08:49.123266 (+ 23493us) write_op.cc:276] Timestamp: P: 1783602529090806 usec, L: 0
0709 13:08:49.132748 (+  9482us) op_driver.cc:348] REPLICATION: starting
0709 13:08:49.225943 (+ 93195us) log.cc:844] Serialized 7079 byte log entry
0709 13:08:49.653424 (+427481us) op_driver.cc:464] REPLICATION: finished
0709 13:08:49.756832 (+103408us) write_op.cc:301] APPLY: starting
0709 13:08:49.760842 (+  4010us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:49.800635 (+ 39793us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:49.821676 (+ 21041us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:49.912127 (+ 90451us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:49.912389 (+   262us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=17
0709 13:08:49.912434 (+    45us) write_op.cc:312] APPLY: finished
0709 13:08:49.912773 (+   339us) log.cc:844] Serialized 119 byte log entry
0709 13:08:49.912923 (+   150us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:49.913064 (+   141us) write_op.cc:454] Released schema lock
0709 13:08:49.913111 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:49.913458 (+   347us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:49.913484 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6631,"reported_tablets":25,"child_traces":[["op",{"apply.queue_time_us":84576,"apply.run_cpu_time_us":5447,"apply.run_wall_time_us":170820,"num_ops":17,"prepare.queue_time_us":405379,"prepare.run_cpu_time_us":43443,"prepare.run_wall_time_us":359545,"raft.queue_time_us":151304,"raft.run_cpu_time_us":9419,"raft.run_wall_time_us":47102,"replication_time_us":520521,"thread_start_us":563310,"threads_started":4,"wal-append.queue_time_us":169431,"wal-append.run_cpu_time_us":30703,"wal-append.run_wall_time_us":1545973}]]}
I20260709 13:08:55.068174 31114 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:08:55.070211 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:55.132489 31147 raft_consensus.cc:1240] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 4. Current term is 5. Ops: []
W20260709 13:08:55.137818 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.084234 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:55.014658 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:54.996873 30620 raft_consensus.cc:1240] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 LEADER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:08:55.071171 30370 catalog_manager.cc:5697] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:55.143991 30370 catalog_manager.cc:5697] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 1 to 4, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 4 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:55.145962 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:55.145730 30370 catalog_manager.cc:5697] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 4 to 6, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 6 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
W20260709 13:08:55.087149 30625 consensus_meta.cc:287] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.530s	user 0.007s	sys 0.001s
I20260709 13:08:55.146904 30625 raft_consensus.cc:2468] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 5.
I20260709 13:08:55.087211 30440 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:08:55.147804 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 60660.5us
I20260709 13:08:55.100247 32575 consensus_queue.cc:237] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:55.150079 30621 raft_consensus.cc:1240] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:55.036428 32751 raft_consensus.cc:3060] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:55.090893 30516 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:08:55.097558   315 raft_consensus.cc:2804] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:08:55.151319 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 60473.8us
I20260709 13:08:55.036981   303 raft_consensus.cc:2804] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:55.152436   303 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:55.152825   303 raft_consensus.cc:3060] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:55.155267   333 log.cc:927] Time spent T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
W20260709 13:08:55.155917 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:55.096509 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.099758 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:08:55.156767 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 88704.7us
W20260709 13:08:55.044591 32659 consensus_meta.cc:287] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.687s	user 0.007s	sys 0.003s
I20260709 13:08:55.101569 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:55.157780 31151 raft_consensus.cc:2410] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:08:55.012730   328 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:55.158286 31114 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:08:55.096092 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:55.068575 32736 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.074146 31150 raft_consensus.cc:1240] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:55.103943 30623 consensus_queue.cc:237] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:55.038165 32329 raft_consensus.cc:740] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:55.151346   315 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:55.160128 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.159592 30370 catalog_manager.cc:5697] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 2 to 3, leader changed from cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 3 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:55.196691 30370 catalog_manager.cc:5697] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 2 to 3, leader changed from cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 3 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:55.163524 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:55.097667 32600 consensus_queue.cc:1048] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 13:08:55.165285 32632 raft_consensus.cc:2804] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:55.098024 32641 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:55.088770   304 raft_consensus.cc:2749] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:55.100919 32688 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.106491 32656 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:55.165436 32659 raft_consensus.cc:2749] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 4. Current term is 5.
W20260709 13:08:55.140447   325 log.cc:927] Time spent T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:08:55.106091 32752 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:08:55.188596 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.170681   328 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:08:55.136377   332 log.cc:927] Time spent T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:08:55.124436 32760 raft_consensus.cc:3060] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:55.193864 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:08:55.199536 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:55.201517 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.177521 30618 raft_consensus.cc:2468] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 3.
W20260709 13:08:55.223827 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 230660us
I20260709 13:08:55.206642 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:55.165525 32736 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:55.185933 32700 raft_consensus.cc:2804] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:55.165706 32325 raft_consensus.cc:2804] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:08:55.142107 32732 consensus_meta.cc:287] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.625s	user 0.009s	sys 0.000s
I20260709 13:08:55.186074 32726 raft_consensus.cc:697] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
W20260709 13:08:55.230471 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.256528 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:08:55.257889 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 87775.4us
I20260709 13:08:55.202894   315 raft_consensus.cc:3060] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:55.204908 32632 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:08:55.174125 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:55.240051 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:55.221494 32688 raft_consensus.cc:3060] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:55.259879 29364 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:55.179638 32739 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:08:55.229745 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 226948us
W20260709 13:08:55.313979 30591 leader_election.cc:336] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.729s (SENT)
W20260709 13:08:55.281745 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:55.357161 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.265656 32540 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:55.266716 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:55.189373 32737 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:55.372179 32737 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:08:55.373641 32694 consensus_meta.cc:287] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.839s	user 0.009s	sys 0.000s
I20260709 13:08:55.374058 32694 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:55.374449 32661 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:55.230928 32576 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:55.376999 32661 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:55.377321 32576 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:08:55.369061 32756 consensus_meta.cc:287] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.566s	user 0.007s	sys 0.000s
I20260709 13:08:55.378732 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:55.378868 32756 raft_consensus.cc:2749] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:55.379580 32397 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:55.379896 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:55.380451 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:55.380607 31147 raft_consensus.cc:2376] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5. Re-sending same reply.
I20260709 13:08:55.379940 32694 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:55.381188 31144 raft_consensus.cc:2393] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 4: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:08:55.381683 32397 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:08:55.369072 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.382020 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:55.383256 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:55.385524 31115 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:08:55.387791 30517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.388962 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:55.389458 30548 raft_consensus.cc:3060] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:55.389885 32501 consensus_meta.cc:287] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.656s	user 0.005s	sys 0.002s
I20260709 13:08:55.390264 32501 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:55.390661 32698 raft_consensus.cc:2804] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:55.391139 32698 raft_consensus.cc:697] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 5 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
W20260709 13:08:55.392572 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:55.394299 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 131521us
I20260709 13:08:55.380088 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:55.233654 32752 raft_consensus.cc:3060] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:55.380653 31148 raft_consensus.cc:1240] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:55.246693   328 raft_consensus.cc:2804] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:55.421916 30589 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:55.423309 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:55.381549 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:08:55.420944 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:55.426780 30590 leader_election.cc:336] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453): Timed out: RequestConsensusVote RPC to 127.28.173.4:34453 timed out after 1.531s (SENT)
I20260709 13:08:55.427454 30590 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:55.170809 32329 consensus_queue.cc:260] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:55.399906 30620 raft_consensus.cc:1240] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 3. Current term is 4. Ops: []
W20260709 13:08:55.438752 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 351922us
W20260709 13:08:55.451918 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.407155 30624 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
I20260709 13:08:55.439266 30468 raft_consensus.cc:1275] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:08:55.431349 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 279282us
I20260709 13:08:55.511634 30516 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:55.509442 30441 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:55.449999 30590 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:55.440096 30548 raft_consensus.cc:2468] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 6.
I20260709 13:08:55.513599 30440 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:55.438412 30589 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
W20260709 13:08:55.486444 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 100975us
I20260709 13:08:55.246857 32700 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:55.531909 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 93567.8us
I20260709 13:08:55.420274 32632 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:55.455629 32576 raft_consensus.cc:2749] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:55.440886 32750 leader_election.cc:290] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133)
I20260709 13:08:55.430143   328 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:55.263636 32325 raft_consensus.cc:697] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 6 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
W20260709 13:08:55.530939 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 80976.8us
W20260709 13:08:55.586382 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.455317 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
W20260709 13:08:55.545816 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.446074 32754 raft_consensus.cc:2804] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:55.540992 32737 raft_consensus.cc:2804] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:55.514365 32501 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:08:55.536773   332 log.cc:927] Time spent T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:08:55.586222 30590 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:55.441663   339 consensus_queue.cc:1048] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.166s
I20260709 13:08:55.534889 30441 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
W20260709 13:08:55.580114 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 68543.2us
I20260709 13:08:55.537060 32640 raft_consensus.cc:2749] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:55.413552   331 raft_consensus.cc:515] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:55.585320   328 raft_consensus.cc:3060] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:55.470955 32329 raft_consensus.cc:3060] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:55.627686 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:55.631740 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.541205 32700 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:55.541811 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:55.545833   335 raft_consensus.cc:2804] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:55.605118 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:55.607282 30590 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:55.259555 32732 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:55.561781 32759 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:55.562016   300 raft_consensus.cc:2804] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:55.578281 31142 raft_consensus.cc:1240] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 5 LEADER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:55.612087 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:55.737186 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:55.739004 30551 raft_consensus.cc:1275] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:55.740589 32739 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:08:55.741791   346 log.cc:927] Time spent T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:08:55.620685 32741 raft_consensus.cc:2804] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:55.748260 32741 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:55.748402   340 log.cc:927] Time spent T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.282s	user 0.000s	sys 0.000s
I20260709 13:08:55.748772 32741 raft_consensus.cc:3060] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:55.750229   329 log.cc:927] Time spent T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.321s	user 0.001s	sys 0.000s
I20260709 13:08:55.751464 30622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47446 (request call id 1993) took 1127 ms. Trace:
I20260709 13:08:55.621846 32737 raft_consensus.cc:697] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 6 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
W20260709 13:08:55.753437   337 log.cc:927] Time spent T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.218s	user 0.000s	sys 0.000s
I20260709 13:08:55.752933 32737 consensus_queue.cc:237] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:55.754503 30619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47446 (request call id 1998) took 1069 ms. Trace:
I20260709 13:08:55.754840 30619 rpcz_store.cc:276] 0709 13:08:54.684908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.869392 (+184484us) service_pool.cc:224] Handling call
0709 13:08:54.869906 (+   514us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:54.870396 (+   490us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:54.870436 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:54.871007 (+   571us) log.cc:844] Serialized 26 byte log entry
0709 13:08:55.220296 (+349289us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:55.220335 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:55.220402 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:55.754315 (+533913us) raft_consensus.cc:1685] finished
0709 13:08:55.754337 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:55.754452 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8697,"raft.queue_time_us":100,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":43571,"thread_start_us":232113,"threads_started":1,"wal-append.queue_time_us":507890}
W20260709 13:08:55.713935   323 consensus_meta.cc:287] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.775s	user 0.010s	sys 0.000s
I20260709 13:08:55.616350 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
W20260709 13:08:55.653728 30591 leader_election.cc:336] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.814s (SENT)
W20260709 13:08:55.830327 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 176652us
W20260709 13:08:55.831017 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.535948 32600 consensus_queue.cc:1059] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.080s
W20260709 13:08:55.691939 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.462836 32698 consensus_queue.cc:237] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:55.841470   349 log.cc:927] Time spent T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
W20260709 13:08:55.842940   334 log.cc:927] Time spent T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.448s	user 0.001s	sys 0.000s
I20260709 13:08:55.601737 32754 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:55.713899 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 106678us
I20260709 13:08:55.849809 30590 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
W20260709 13:08:55.731776   332 log.cc:927] Time spent T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:08:55.600843 32575 raft_consensus.cc:2749] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:55.719726 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:55.608597 32576 raft_consensus.cc:2749] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:08:55.779240 30517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.857587   358 raft_consensus.cc:2749] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:08:55.787894 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 74389.4us
I20260709 13:08:55.860630 31116 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:55.751780 30622 rpcz_store.cc:276] 0709 13:08:54.623709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.726969 (+103260us) service_pool.cc:224] Handling call
0709 13:08:54.727234 (+   265us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:54.735896 (+  8662us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:08:54.735955 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:54.741072 (+  5117us) log.cc:844] Serialized 26 byte log entry
0709 13:08:55.001248 (+260176us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:55.001286 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:55.001347 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:55.751259 (+749912us) raft_consensus.cc:1685] finished
0709 13:08:55.751287 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:55.751412 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2650,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":5859,"thread_start_us":259817,"threads_started":1,"wal-append.queue_time_us":492117}
W20260709 13:08:55.813530 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:55.864655 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.844264 30545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 1381) took 1301 ms. Trace:
I20260709 13:08:55.865304 30545 rpcz_store.cc:276] 0709 13:08:54.543108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.801979 (+258871us) service_pool.cc:224] Handling call
0709 13:08:54.802371 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:54.807708 (+  5337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:54.807757 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:54.816638 (+  8881us) log.cc:844] Serialized 26 byte log entry
0709 13:08:55.037417 (+220779us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:55.037454 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:55.037518 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:55.844007 (+806489us) raft_consensus.cc:1685] finished
0709 13:08:55.844035 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:55.844196 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4790,"raft.queue_time_us":4949,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":5423,"thread_start_us":183748,"threads_started":1,"wal-append.queue_time_us":397156}
I20260709 13:08:55.541389 32726 consensus_queue.cc:237] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:55.854029 32754 raft_consensus.cc:3060] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:55.733996 30543 raft_consensus.cc:2468] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 5.
W20260709 13:08:55.885553 30589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.874323 31143 raft_consensus.cc:1240] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 4. Current term is 5. Ops: []
W20260709 13:08:55.862787 32686 consensus_meta.cc:287] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.929s	user 0.007s	sys 0.003s
W20260709 13:08:55.901641 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.916455 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:55.917886 30542 raft_consensus.cc:2410] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:08:55.877975 32679 consensus_meta.cc:287] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.841s	user 0.009s	sys 0.000s
I20260709 13:08:55.921236 30617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47446 (request call id 1995) took 1296 ms. Trace:
W20260709 13:08:55.611111 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 76311us
I20260709 13:08:55.926993 30441 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:55.930976 30441 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:55.875439   341 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.874617 30616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47446 (request call id 1999) took 1175 ms. Trace:
I20260709 13:08:55.878918 32576 raft_consensus.cc:2749] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:55.923439 30617 rpcz_store.cc:276] 0709 13:08:54.624384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.723615 (+ 99231us) service_pool.cc:224] Handling call
0709 13:08:54.723940 (+   325us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:54.724257 (+   317us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:54.724282 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:54.724777 (+   495us) log.cc:844] Serialized 52 byte log entry
0709 13:08:54.864069 (+139292us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:54.928464 (+ 64395us) log.cc:844] Serialized 14 byte log entry
0709 13:08:54.928985 (+   521us) log.cc:844] Serialized 14 byte log entry
0709 13:08:55.055679 (+126694us) spinlock_profiling.cc:243] Waited 37.2 ms on lock 0x7b18004603c0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e7b522 00007fc780e7d7c1 00007fc780e7d779 00007fc780e7d709 00007fc780e7d6d1 00007fc780e7c9cd 000000000038f354 000000000038f199 00007fc780e5e83a
0709 13:08:55.059560 (+  3881us) spinlock_profiling.cc:243] Waited 2.68 ms on lock 0x7b18004603c0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e7b3f3 00007fc780e7d7c1 00007fc780e7d779 00007fc780e7d709 00007fc780e7d6d1 00007fc780e7c9cd 000000000038f354 000000000038f199 00007fc780e5e83a
0709 13:08:55.102553 (+ 42993us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b18004603c0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e7b522 00007fc780e7d7c1 00007fc780e7d779 00007fc780e7d709 00007fc780e7d6d1 00007fc780e7c9cd 000000000038f354 000000000038f199 00007fc780e5e83a
0709 13:08:55.161772 (+ 59219us) spinlock_profiling.cc:243] Waited 6.85 ms on lock 0x7b18004603c0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc783b104bc 00007fc780e5e48b 00007fc789cb8ab9 00007fc780e7a69b 00007fc780e7893f 00007fc780e78455 00007fc783f60060 00007fc783f72716 00007fc783f83287
0709 13:08:55.161890 (+   118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:55.161950 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:55.921038 (+759088us) raft_consensus.cc:1685] finished
0709 13:08:55.921058 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:55.921181 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7589,"prepare.queue_time_us":85445,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":5734,"raft.queue_time_us":27289,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":16441,"spinlock_wait_cycles":144582912,"thread_start_us":239322,"threads_started":2,"wal-append.queue_time_us":251236}
I20260709 13:08:55.855155 32540 consensus_queue.cc:1059] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 13:08:55.852911   323 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:55.964033 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 101023us
I20260709 13:08:55.960461 30441 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:08:55.961254 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 103397us
I20260709 13:08:55.899256   358 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:55.967267 30517 leader_election.cc:336] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.547s (SENT)
I20260709 13:08:55.937265 32759 raft_consensus.cc:2804] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:55.850674 32325 consensus_queue.cc:237] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:55.969704   300 raft_consensus.cc:697] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:55.968690 32600 raft_consensus.cc:493] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.964056 32640 raft_consensus.cc:2749] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:55.962426   304 raft_consensus.cc:493] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:08:55.999912   348 log.cc:927] Time spent T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:08:56.000481 32732 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:56.003669 32661 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:56.004189 32661 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:56.006116 32661 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:55.960552   341 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:56.008493   341 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:56.013016   360 raft_consensus.cc:3055] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:55.999795   331 leader_election.cc:290] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:56.013614   360 raft_consensus.cc:740] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:56.014748   360 consensus_queue.cc:260] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:55.925061 32686 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:55.932628 32679 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:55.966570 32656 raft_consensus.cc:2749] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:55.972091 32731 raft_consensus.cc:2804] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:08:56.011658   316 consensus_meta.cc:287] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.913s	user 0.007s	sys 0.000s
I20260709 13:08:55.995787 32600 raft_consensus.cc:515] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:56.013073   323 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:08:56.016392 32736 consensus_meta.cc:287] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.756s	user 0.006s	sys 0.002s
I20260709 13:08:55.973675 32759 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:56.043970 32759 raft_consensus.cc:3060] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:56.044642 32736 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:55.969518   335 raft_consensus.cc:697] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:56.048586   335 consensus_queue.cc:237] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:56.023499 32751 consensus_meta.cc:287] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.869s	user 0.003s	sys 0.007s
I20260709 13:08:55.971299   358 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:56.052138 32751 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:56.053591   358 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:56.038929   300 consensus_queue.cc:237] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:56.034307 32731 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
W20260709 13:08:56.032310   315 consensus_meta.cc:287] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.601s	user 0.008s	sys 0.001s
I20260709 13:08:56.024479   304 raft_consensus.cc:515] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:56.076053   303 consensus_meta.cc:287] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.923s	user 0.006s	sys 0.005s
I20260709 13:08:56.076941   303 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:56.042268 32698 consensus_queue.cc:1048] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:08:56.078307 32751 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:56.094070   315 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:56.138640 30440 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:08:56.140475 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 179919us
I20260709 13:08:56.143148 30475 raft_consensus.cc:1240] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:56.144135 30469 raft_consensus.cc:1240] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:56.142980 30468 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:56.155794 30468 raft_consensus.cc:1275] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
W20260709 13:08:56.159009 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:56.161784 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.163311 30468 pending_rounds.cc:85] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326: Aborting all ops after (but not including) 6
I20260709 13:08:56.163960 30549 raft_consensus.cc:2393] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 5: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:08:56.165141 30468 pending_rounds.cc:107] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:08:56.165927 30543 raft_consensus.cc:1275] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:08:56.166244 30468 raft_consensus.cc:2889] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:56.166553 30543 pending_rounds.cc:85] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd: Aborting all ops after (but not including) 3
I20260709 13:08:56.167111 30543 pending_rounds.cc:107] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:08:56.167452 30543 raft_consensus.cc:2889] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:56.168735 30546 raft_consensus.cc:2368] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 2. Current term is 3.
W20260709 13:08:56.176072 30516 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.003s	sys 0.006s
W20260709 13:08:56.176558 30516 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.003s	sys 0.006s
W20260709 13:08:56.176935 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 566731us
W20260709 13:08:56.177757 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:56.181777 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:56.182499 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:56.181797 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 274674us
I20260709 13:08:55.955762 30616 rpcz_store.cc:276] 0709 13:08:54.699538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.967763 (+268225us) service_pool.cc:224] Handling call
0709 13:08:55.017209 (+ 49446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:55.034927 (+ 17718us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:08:55.516786 (+481859us) log.cc:844] Serialized 14 byte log entry
0709 13:08:55.717049 (+200263us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:55.759455 (+ 42406us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:55.772350 (+ 12895us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:55.845304 (+ 72954us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:55.861316 (+ 16012us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29943,"prepare.queue_time_us":47559,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":2175,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":42177,"thread_start_us":469714,"threads_started":2,"wal-append.queue_time_us":387783}
W20260709 13:08:56.192351 30591 leader_election.cc:336] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.101s (SENT)
I20260709 13:08:56.192528 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:56.193356 30591 leader_election.cc:304] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
W20260709 13:08:56.196491 30590 leader_election.cc:336] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453): Timed out: RequestConsensusVote RPC to 127.28.173.4:34453 timed out after 1.728s (SENT)
W20260709 13:08:56.030421 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 100585us
W20260709 13:08:56.205016 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 63081us
W20260709 13:08:56.206512 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:56.208519 30591 leader_election.cc:336] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.123s (SENT)
I20260709 13:08:56.231102   363 raft_consensus.cc:2749] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:08:56.231861 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.232259 32751 raft_consensus.cc:493] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.233076 32751 raft_consensus.cc:515] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:56.234097   315 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:56.235198   365 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:56.209525 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
W20260709 13:08:56.070233 32641 consensus_meta.cc:287] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.847s	user 0.010s	sys 0.000s
I20260709 13:08:56.238216 32641 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:56.073786 32679 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:56.072108 32686 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:56.070086 32700 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:56.070767 32731 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:56.247133 32640 consensus_queue.cc:1048] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:08:56.247680 32700 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:56.258503 30550 raft_consensus.cc:2368] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 4. Current term is 5.
I20260709 13:08:56.258319   363 consensus_queue.cc:1048] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:08:56.259948 30517 leader_election.cc:336] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.925s (SENT)
W20260709 13:08:56.260654 32752 consensus_meta.cc:287] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.823s	user 0.013s	sys 0.001s
I20260709 13:08:56.264449 30441 leader_election.cc:304] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
W20260709 13:08:56.266340 32329 consensus_meta.cc:287] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.556s	user 0.013s	sys 0.004s
I20260709 13:08:56.212916 32600 leader_election.cc:290] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:56.217067 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:56.217654 31144 raft_consensus.cc:1275] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:08:56.217581 31114 leader_election.cc:336] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Timed out: RequestConsensusVote RPC to 127.28.173.2:34733 timed out after 1.512s (SENT)
W20260709 13:08:56.273276 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 57231.5us
I20260709 13:08:56.273516 32641 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:56.219605 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:56.219774 32736 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:56.220242 32656 raft_consensus.cc:2804] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:56.098050 32759 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:56.279183 32759 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:56.094686 32754 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:56.070770 32741 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:56.279980 32656 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.280478 32656 raft_consensus.cc:3060] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:56.281638 32754 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:56.282308 32741 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:08:56.095515 32760 consensus_meta.cc:287] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.835s	user 0.003s	sys 0.008s
I20260709 13:08:56.068280   328 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:56.285360 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:56.285777 30622 raft_consensus.cc:1275] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:56.286372 30619 raft_consensus.cc:1275] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:08:56.224221   303 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:56.287242   328 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:56.224393   304 leader_election.cc:290] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:56.267270 32686 raft_consensus.cc:2804] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:56.288403 32686 raft_consensus.cc:493] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:56.288872 32686 raft_consensus.cc:3060] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:56.268008 32640 consensus_queue.cc:1048] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:56.292107 32700 consensus_queue.cc:1048] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:56.292935 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:56.293553   366 consensus_queue.cc:1048] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:56.270987 31146 raft_consensus.cc:2468] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:56.294977 32760 raft_consensus.cc:515] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:56.297463 32760 leader_election.cc:290] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:56.299065 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:56.261271 32752 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:56.293620   354 consensus_queue.cc:1048] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:56.211525 32632 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:56.255524 32688 consensus_meta.cc:287] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.741s	user 0.008s	sys 0.003s
I20260709 13:08:56.307956 30550 raft_consensus.cc:2468] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 4.
I20260709 13:08:56.260659 30517 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:56.312060   365 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:56.312541 32751 leader_election.cc:290] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:08:56.313506   370 log.cc:927] Time spent T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.217s	user 0.004s	sys 0.010s
W20260709 13:08:56.312101 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 115733us
I20260709 13:08:56.318011 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:56.319089 30468 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:56.318940 32688 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:56.321336 32688 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:56.351064 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:56.351222 30468 raft_consensus.cc:2468] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 5.
W20260709 13:08:56.355790 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 111116us
I20260709 13:08:56.356563 30589 leader_election.cc:400] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 election: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 4. Current term is 5.
I20260709 13:08:56.350610 32688 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:56.356925 30589 leader_election.cc:403] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:08:56.358305   300 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:56.357295   372 raft_consensus.cc:2749] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:56.362315 30517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:56.353492 30590 leader_election.cc:336] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453): Timed out: RequestConsensusVote RPC to 127.28.173.4:34453 timed out after 1.814s (SENT)
W20260709 13:08:56.371922 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.357307 32688 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:56.372709 32632 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:56.374912 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:56.377586 31116 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:56.378952 32700 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:56.379179   366 raft_consensus.cc:2804] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:56.379621 32700 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:56.381904   366 raft_consensus.cc:697] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 5 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:56.384518 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:56.383708 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:56.387326 30617 raft_consensus.cc:2468] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 3.
W20260709 13:08:56.388828 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.388906 31115 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:56.389629 30550 raft_consensus.cc:2368] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 4. Current term is 5.
I20260709 13:08:56.390169 32749 raft_consensus.cc:2804] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:56.390642 32749 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:56.391052 32749 raft_consensus.cc:3060] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:56.391743 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:08:56.394922 31114 leader_election.cc:336] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Timed out: RequestConsensusVote RPC to 127.28.173.2:34733 timed out after 1.527s (SENT)
I20260709 13:08:56.393424   351 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:56.396162 32698 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:56.396939 32698 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:56.396785   351 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:56.399147 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:56.399346 32698 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:56.399968 30617 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:08:56.400381 30619 raft_consensus.cc:1240] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:08:56.392946 30550 raft_consensus.cc:2468] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 2.
I20260709 13:08:56.365159 30590 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
W20260709 13:08:56.408517 30516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.410032   351 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:56.410516   365 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:56.418655 32641 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:56.394039   366 consensus_queue.cc:237] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:56.419414 32641 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:56.411860 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:56.413159 32752 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:56.414486 30622 raft_consensus.cc:1275] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:08:56.415068 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 65840.8us
I20260709 13:08:56.421232 30547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 1384) took 1873 ms. Trace:
W20260709 13:08:56.421603 30590 leader_election.cc:336] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453): Timed out: RequestConsensusVote RPC to 127.28.173.4:34453 timed out after 1.829s (SENT)
W20260709 13:08:56.423053 30590 leader_election.cc:336] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453): Timed out: RequestConsensusVote RPC to 127.28.173.4:34453 timed out after 1.886s (SENT)
I20260709 13:08:56.421633 30547 rpcz_store.cc:276] 0709 13:08:54.547665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.844506 (+296841us) service_pool.cc:224] Handling call
0709 13:08:55.026829 (+182323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:55.029710 (+  2881us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:55.029776 (+    66us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:55.030276 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 13:08:55.222031 (+191755us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:55.222071 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:55.222133 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:55.749541 (+527408us) raft_consensus.cc:1685] finished
0709 13:08:55.749570 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:56.420819 (+671249us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b54002f12d0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f678ad 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:08:56.421061 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3480,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":3811,"spinlock_wait_cycles":418495232,"thread_start_us":190871,"threads_started":1,"wal-append.queue_time_us":390849}
I20260709 13:08:56.414947   303 raft_consensus.cc:2749] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:56.414496 32731 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:56.427006 32731 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:56.411914 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:56.428191 30473 raft_consensus.cc:1240] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:56.415680 32632 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.428964 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:56.423508 30590 leader_election.cc:304] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:56.416846   372 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.417038 32600 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:56.382413 32700 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:56.417652 32679 raft_consensus.cc:493] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
W20260709 13:08:56.412423 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 46829.6us
W20260709 13:08:56.447232 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:56.447439 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 52580.8us
I20260709 13:08:56.417378 30516 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:56.429497 30620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 330) took 1499 ms. Trace:
I20260709 13:08:56.431006 30476 raft_consensus.cc:2468] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 5.
I20260709 13:08:56.433135 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:56.448145 30620 rpcz_store.cc:276] 0709 13:08:54.929687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:55.144263 (+214576us) service_pool.cc:224] Handling call
0709 13:08:55.144545 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:55.429303 (+284758us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:56.429030 (+999727us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b54002c9a54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:56.429320 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":586772352}
I20260709 13:08:56.458523 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:56.460040 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:56.460546 32679 raft_consensus.cc:515] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:56.462152   372 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:56.463789 30623 raft_consensus.cc:1275] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:56.429432 32632 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:56.466321 30589 leader_election.cc:400] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 election: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 4. Current term is 5.
I20260709 13:08:56.466406 32632 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:56.466856 30589 leader_election.cc:403] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:08:56.467516 30468 raft_consensus.cc:1240] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:56.468767 32261 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:56.446727 32686 raft_consensus.cc:515] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:56.469465   303 raft_consensus.cc:2749] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:56.471040 32686 leader_election.cc:290] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:56.472044 30472 raft_consensus.cc:2468] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 2.
W20260709 13:08:56.473855 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.475759   365 raft_consensus.cc:3060] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:56.471134 30473 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:56.434194 30517 leader_election.cc:336] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.848s (SENT)
I20260709 13:08:56.421694 32641 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:56.387702 32656 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:56.492252 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:56.493677 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:56.495113 30471 raft_consensus.cc:1275] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:08:56.496574 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:56.504009 32397 consensus_queue.cc:1059] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:08:56.504174 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 81191.6us
I20260709 13:08:56.504577 30625 raft_consensus.cc:3060] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:56.505354 32397 raft_consensus.cc:3055] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:56.505760 32397 raft_consensus.cc:740] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:56.507145 30590 leader_election.cc:304] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:56.506963 32397 consensus_queue.cc:260] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:56.508510 32397 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:56.498713 32261 raft_consensus.cc:2764] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:08:56.500070 32679 leader_election.cc:290] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:56.500085 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:56.433904 32731 consensus_queue.cc:1048] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.059s
W20260709 13:08:56.498077 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 80774us
I20260709 13:08:56.512272   372 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:56.512921   303 raft_consensus.cc:2749] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:56.515609 32656 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:56.516732 30590 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:56.504189 30621 raft_consensus.cc:2468] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 3.
I20260709 13:08:56.518551 32754 consensus_queue.cc:1048] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:56.523306   300 raft_consensus.cc:2749] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 4. Current term is 5.
I20260709 13:08:56.545917 30475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 385) took 1152 ms. Trace:
I20260709 13:08:56.539070 29364 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:56.548381 30469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 386) took 1154 ms. Trace:
I20260709 13:08:56.541361 30516 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
W20260709 13:08:57.041802 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 500514us
W20260709 13:08:56.550155 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:57.057479 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:56.526661 30589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.060724 30589 leader_election.cc:304] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:56.545782 30590 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:56.489434 30517 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:56.586931   365 raft_consensus.cc:2749] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 4. Current term is 5.
I20260709 13:08:57.064270 32501 raft_consensus.cc:2804] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:56.590050 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:57.064469 32713 raft_consensus.cc:2749] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:57.064778 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 661924us
W20260709 13:08:57.067297 30517 leader_election.cc:336] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.710s (SENT)
I20260709 13:08:57.067770 30517 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:56.554920 32575 raft_consensus.cc:3055] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:56.523377 32600 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:57.073143 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 527393us
I20260709 13:08:56.537204 32395 consensus_queue.cc:1059] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:56.534202 31116 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:57.076642 32395 raft_consensus.cc:3055] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:08:57.076912 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 544708us
I20260709 13:08:57.077060 32395 raft_consensus.cc:740] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:57.077934 32559 raft_consensus.cc:2804] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:57.078346 32559 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:57.078106 32395 consensus_queue.cc:260] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:56.534090 32749 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:57.080233 32660 consensus_queue.cc:1059] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:57.081372 32660 raft_consensus.cc:3055] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:57.081574 31147 raft_consensus.cc:1240] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:57.081697 32660 raft_consensus.cc:740] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:57.082034 32749 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:57.083199 32600 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:56.763732 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:57.082790 32660 consensus_queue.cc:260] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:56.778152 30475 rpcz_store.cc:276] 0709 13:08:55.393162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:55.393937 (+   775us) service_pool.cc:224] Handling call
0709 13:08:55.438834 (+ 44897us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:56.143784 (+704950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:56.545665 (+401881us) spinlock_profiling.cc:243] Waited 704 ms on lock 0x7b54001761d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:56.545863 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1618386816}
W20260709 13:08:56.805003 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.815321 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:08:56.815902 31146 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48414 (request call id 600) took 1549 ms (client timeout 1614 ms). Trace:
I20260709 13:08:56.839725 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:08:56.846498 30441 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:50430 dropped due to backpressure: service queue is full with 50 items
I20260709 13:08:56.846292 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:56.879173 31148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48414 (request call id 597) took 1653 ms. Trace:
I20260709 13:08:56.880209 30546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39952 (request call id 1389) took 1264 ms. Trace:
I20260709 13:08:56.889150 30468 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:56.897953 30473 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 4.
W20260709 13:08:56.909003 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.910988 30469 rpcz_store.cc:276] 0709 13:08:55.393463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:55.394007 (+   544us) service_pool.cc:224] Handling call
0709 13:08:55.394261 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:56.144590 (+750329us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:56.548064 (+403474us) spinlock_profiling.cc:243] Waited 749 ms on lock 0x7b5400028ad4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:56.548313 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1723252992}
I20260709 13:08:56.924569 31143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48426 (request call id 558) took 1850 ms. Trace:
I20260709 13:08:56.930377 30625 raft_consensus.cc:2468] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 3.
I20260709 13:08:56.544301 30467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 388) took 1140 ms. Trace:
I20260709 13:08:56.940964 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:56.953096   360 raft_consensus.cc:3060] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:56.958083 32737 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.073s	user 0.010s	sys 0.014s
I20260709 13:08:56.960274 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:56.961344 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:56.964928 31150 raft_consensus.cc:1275] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:56.968371 32688 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:08:56.976676 30549 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43088 (request call id 1629) took 1888 ms (client timeout 2092 ms). Trace:
W20260709 13:08:56.980901 31114 leader_election.cc:336] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Timed out: RequestConsensusVote RPC to 127.28.173.2:34733 timed out after 1.860s (SENT)
I20260709 13:08:56.990339 32659 raft_consensus.cc:993] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79: : Instructing follower cd669586cff44d4bbfcc007e213faab6 to start an election
I20260709 13:08:56.995379 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:08:57.017179 30624 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47446 (request call id 2001) took 2291 ms (client timeout 1791 ms). Trace:
I20260709 13:08:57.018493 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
W20260709 13:08:57.027079 30474 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.012s	sys 0.017s
W20260709 13:08:57.029913 31115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.041890 32540 raft_consensus.cc:2804] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:57.042853 30516 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:56.549796 30550 raft_consensus.cc:2393] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 6: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
W20260709 13:08:57.045207 31149 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48414 (request call id 590) took 2014 ms (client timeout 1620 ms). Trace:
I20260709 13:08:57.046068 31144 raft_consensus.cc:1240] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 13:08:57.049471 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.054997 30370 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57542 (request call id 299) took 10157 ms. Trace:
I20260709 13:08:56.571056 31142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48426 (request call id 559) took 1496 ms. Trace:
I20260709 13:08:57.070112 32575 raft_consensus.cc:740] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:57.070850 32713 raft_consensus.cc:2749] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:57.076009   335 raft_consensus.cc:2749] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:57.064798 32501 raft_consensus.cc:493] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:57.078732 32559 raft_consensus.cc:3060] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:56.544356   303 raft_consensus.cc:2749] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:57.079936 30439 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:60026 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1916)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1942)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1931)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1936)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1941)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1956)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1961)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1919)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1932)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1934)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1951)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1947)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1939)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1963)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1933)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1938)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1964)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1917)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1952)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1927)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1943)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1920)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1923)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1955)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1928)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1953)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1950)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1929)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1954)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1944)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1946)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1945)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1958)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1949)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1940)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1935)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1962)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1948)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1959)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1930)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1957)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1960)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 1913)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 1914)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 1915)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 1921)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 1922)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 1924)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 1926)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 404)
I20260709 13:08:56.705145 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:57.168596 32660 raft_consensus.cc:3060] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:57.169113 30467 rpcz_store.cc:276] 0709 13:08:55.403239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:55.403679 (+   440us) service_pool.cc:224] Handling call
0709 13:08:55.403989 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:55.421946 (+ 17957us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:55.421981 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:55.422019 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:55.422054 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:56.543794 (+1121740us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b54000285d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:56.543882 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:56.544083 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40801024}
W20260709 13:08:57.168682 30591 leader_election.cc:336] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.474s (SENT)
I20260709 13:08:57.166973 30439 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:60026 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1916)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1942)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1931)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1936)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1941)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1956)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1961)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1919)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1932)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1934)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1951)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1947)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1939)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1963)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1933)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1938)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1964)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1917)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1952)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1927)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1943)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1920)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1923)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1955)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1928)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1953)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1950)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1929)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1954)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1944)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1946)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1945)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1958)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1949)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1940)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1935)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1962)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1948)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1959)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1930)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1957)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1960)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 1913)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 1914)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 1915)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 1921)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 1922)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 1924)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 1926)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 404)
I20260709 13:08:57.209157 30546 rpcz_store.cc:276] 0709 13:08:55.615959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:55.616112 (+   153us) service_pool.cc:224] Handling call
0709 13:08:56.879952 (+1263840us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b54000dd9d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:08:56.880137 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":777114368}
W20260709 13:08:57.170573 31149 rpcz_store.cc:269] 0709 13:08:55.031115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:55.031418 (+   303us) service_pool.cc:224] Handling call
0709 13:08:57.044726 (+2013308us) spinlock_profiling.cc:243] Waited 998 ms on lock 0x7b540045e7d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:08:57.044992 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2296324992}
I20260709 13:08:57.215392 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:57.172289 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:57.216786 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:57.216951 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:57.217414 30546 raft_consensus.cc:3060] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:57.218490 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:57.173539 30470 raft_consensus.cc:2393] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 3: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
W20260709 13:08:57.171881 30474 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.015s	sys 0.018s
I20260709 13:08:57.219969 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:57.221029 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:57.221661 30474 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:08:57.221833 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:57.222502 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:57.223191 30474 raft_consensus.cc:2393] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 3: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:57.223261 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:57.224104 30470 raft_consensus.cc:2393] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 3: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:57.176551   365 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.224762   355 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.224717   365 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:57.225435   355 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:57.176214 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:57.226953   365 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:08:57.170763 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.227725 31144 raft_consensus.cc:1275] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:08:57.228065 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:08:57.177976 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.228688 30545 raft_consensus.cc:2468] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 5.
I20260709 13:08:57.229363   355 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:57.229674 30545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35278 (request call id 429) took 1026 ms. Trace:
I20260709 13:08:57.230008   365 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:57.230083 30545 rpcz_store.cc:276] 0709 13:08:56.203183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.292550 (+ 89367us) service_pool.cc:224] Handling call
0709 13:08:57.229535 (+936985us) spinlock_profiling.cc:243] Waited 935 ms on lock 0x7b5400357854. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:08:57.229626 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2150294784}
I20260709 13:08:57.231006 32713 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.088604 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:57.231310 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:57.231513 32713 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:57.177944 31114 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:57.232056 30545 raft_consensus.cc:3060] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:57.233148 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 252333us
I20260709 13:08:57.233640 32713 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:57.234186 32648 raft_consensus.cc:2749] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:57.234458 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:57.235208 30474 raft_consensus.cc:2393] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 3: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:57.235934 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:08:57.127876 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:57.236944 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.236974 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:08:57.178629 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 135940us
I20260709 13:08:57.197209   335 raft_consensus.cc:1081] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 LEADER]: Signalling peer cd669586cff44d4bbfcc007e213faab6 to start an election
I20260709 13:08:57.198594 31148 rpcz_store.cc:276] 0709 13:08:55.226125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:55.230086 (+  3961us) service_pool.cc:224] Handling call
0709 13:08:55.353415 (+123329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:55.430349 (+ 76934us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:56.878634 (+1448285us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b5400715a54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:56.878996 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28999936}
I20260709 13:08:57.190513 30620 raft_consensus.cc:2393] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 5: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
W20260709 13:08:57.167374 30624 rpcz_store.cc:269] 0709 13:08:54.726287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.729338 (+  3051us) service_pool.cc:224] Handling call
0709 13:08:57.016806 (+2287468us) spinlock_profiling.cc:243] Waited 368 ms on lock 0x7b540027ea54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:08:57.016981 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":845590400}
I20260709 13:08:57.200099 30544 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 4.
I20260709 13:08:57.239116 30544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35278 (request call id 424) took 1037 ms. Trace:
I20260709 13:08:57.178771 32600 raft_consensus.cc:2804] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:08:57.151026 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 82260.7us
I20260709 13:08:57.200528 31143 rpcz_store.cc:276] 0709 13:08:55.073754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:55.080486 (+  6732us) service_pool.cc:224] Handling call
0709 13:08:55.137620 (+ 57134us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:55.922965 (+785345us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:56.924139 (+1001174us) spinlock_profiling.cc:243] Waited 711 ms on lock 0x7b540045f454. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:56.924392 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1634322816}
I20260709 13:08:57.201813 30476 raft_consensus.cc:1240] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 3. Current term is 4. Ops: [1.3-3.4]
I20260709 13:08:57.240020 32600 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:57.239447 30516 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:57.240629 32600 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:57.171890 31142 rpcz_store.cc:276] 0709 13:08:55.074083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:55.079662 (+  5579us) service_pool.cc:224] Handling call
0709 13:08:55.103644 (+ 23982us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:55.735945 (+632301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:56.570520 (+834575us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b54006338d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:56.570830 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":980250880}
I20260709 13:08:57.203358 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:57.242400 30550 raft_consensus.cc:3060] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:57.201896 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:57.243853 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:57.200243 32575 consensus_queue.cc:260] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:57.244949 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:57.245770 32575 raft_consensus.cc:3060] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:57.245975 30473 raft_consensus.cc:2393] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 5: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:57.246917 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:57.180708 32750 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
W20260709 13:08:57.180408 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:57.208660 32737 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.324s	user 0.013s	sys 0.016s
I20260709 13:08:57.200192 30471 raft_consensus.cc:2393] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 3: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:57.212330 30551 raft_consensus.cc:2393] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 5: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:08:57.212858 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:57.213523 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:57.214192 30623 raft_consensus.cc:1275] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:08:57.170629 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:57.215390 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:57.172802 32501 raft_consensus.cc:3060] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:57.173743 31146 rpcz_store.cc:269] 0709 13:08:55.266332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:55.266509 (+   177us) service_pool.cc:224] Handling call
0709 13:08:56.815659 (+1549150us) spinlock_profiling.cc:243] Waited 900 ms on lock 0x7b54006c7854. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:08:56.815790 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2070058752}
I20260709 13:08:57.079696 32395 raft_consensus.cc:3060] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:57.253230 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:57.220599 30472 raft_consensus.cc:1217] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Deduplicated request from leader. Original: 3.5->[4.6-4.6]   Dedup: 4.6->[]
I20260709 13:08:57.214249 30547 raft_consensus.cc:2393] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 5: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
W20260709 13:08:57.174608 30549 rpcz_store.cc:269] 0709 13:08:55.088026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:55.089129 (+  1103us) service_pool.cc:224] Handling call
0709 13:08:56.976435 (+1887306us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b540002eed4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:08:56.976617 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2306296704}
I20260709 13:08:57.274507 30472 raft_consensus.cc:1240] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:08:57.175938 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:57.249955 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:57.231711 31151 raft_consensus.cc:2468] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:57.176301 30441 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:50430 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1931)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1936)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1941)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1956)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1961)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1919)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1932)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1934)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1951)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1947)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1939)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1963)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1933)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1938)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1964)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1917)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1952)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1927)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1943)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1920)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1923)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1955)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1928)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1953)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1950)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1929)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1954)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1944)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1946)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1945)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1958)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1949)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1940)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1935)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1962)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1948)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1959)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1930)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1957)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1960)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 1913)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 1914)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 1915)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 1921)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 1922)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 1924)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 1926)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 404)
I20260709 13:08:57.236117 30470 raft_consensus.cc:2393] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 3: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
W20260709 13:08:57.237191 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.177086 32659 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.083933 30542 raft_consensus.cc:2468] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:57.240047 30474 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:08:57.241770 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:57.278378 30476 raft_consensus.cc:3060] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:57.090384 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:57.091159 32739 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.247794 30473 raft_consensus.cc:2410] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:08:57.248476 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.156664 30372 catalog_manager.cc:5697] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: config changed from index 2 to 4, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1), VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2), VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3), VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 4 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:57.249812 30551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39952 (request call id 1397) took 1050 ms. Trace:
I20260709 13:08:57.275630 30471 raft_consensus.cc:2468] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 2.
I20260709 13:08:57.282684 30546 raft_consensus.cc:2410] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:57.249413 30589 leader_election.cc:400] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 election: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 2. Current term is 3.
I20260709 13:08:57.250762 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:57.252282 30622 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
I20260709 13:08:57.230656   365 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:57.282951 30468 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
I20260709 13:08:57.283926 30589 leader_election.cc:403] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 13:08:57.297042 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 47467.2us
I20260709 13:08:57.282837 30551 rpcz_store.cc:276] 0709 13:08:56.199548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.199819 (+   271us) service_pool.cc:224] Handling call
0709 13:08:56.940543 (+740724us) spinlock_profiling.cc:243] Waited 7.34 ms on lock 0x7b5800028598. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780e43b71 00007fc780e43a22 00007fc789d5cc09 00007fc788eb6ee0 00007fc788f800ab 00007fc788f80131 00007fc788f2e0a0 00007fc788f2d984 00007fc7824a86d4 00007fc7824a8662
0709 13:08:57.249711 (+309168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16871808}
I20260709 13:08:57.308634   350 consensus_queue.cc:1059] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:57.310060   350 raft_consensus.cc:3055] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:57.310490   350 raft_consensus.cc:740] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:57.308751   353 consensus_queue.cc:1059] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:57.312004   355 raft_consensus.cc:3055] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:57.311465   350 consensus_queue.cc:260] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:57.312431   355 raft_consensus.cc:740] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:57.313301   350 raft_consensus.cc:3060] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:57.313447   355 consensus_queue.cc:260] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:57.317476 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 137147us
I20260709 13:08:57.321415 30545 raft_consensus.cc:2468] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 5.
I20260709 13:08:57.322497 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:57.332410 31147 raft_consensus.cc:2393] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 4: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:08:57.332669 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:57.333043 30550 raft_consensus.cc:2468] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
I20260709 13:08:57.333928 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:57.334196 30547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35278 (request call id 430) took 1098 ms. Trace:
I20260709 13:08:57.334561 30547 rpcz_store.cc:276] 0709 13:08:56.203510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.995068 (+791558us) service_pool.cc:224] Handling call
0709 13:08:57.301395 (+306327us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:57.335614 30467 raft_consensus.cc:2393] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 3: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:57.334576 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:57.251163 30543 raft_consensus.cc:3060] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:57.337136 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:57.341537 30468 raft_consensus.cc:2393] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 5: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:57.342521 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:57.342757 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:57.343235 30550 raft_consensus.cc:2393] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 3: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:08:57.344004 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:57.344126 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:57.345793 30545 raft_consensus.cc:2393] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 5: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:08:57.340552 30590 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:57.349829 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:08:57.350265 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 101012us
I20260709 13:08:57.350692 30472 raft_consensus.cc:2393] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 5: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:57.239497 30544 rpcz_store.cc:276] 0709 13:08:56.201349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.201626 (+   277us) service_pool.cc:224] Handling call
0709 13:08:56.845989 (+644363us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b5800028598. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780e43b71 00007fc780e43a22 00007fc789d5cc09 00007fc788eb6ee0 00007fc788f800ab 00007fc788f80131 00007fc788f2e0a0 00007fc788f2d984 00007fc7824a86d4 00007fc7824a8662
0709 13:08:57.239053 (+393064us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37847808}
W20260709 13:08:57.352708 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 113406us
I20260709 13:08:57.348142 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:57.354102 30474 raft_consensus.cc:2368] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 4. Current term is 6.
I20260709 13:08:57.355221 30551 raft_consensus.cc:1275] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:08:57.283464 32713 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:57.359057 30545 raft_consensus.cc:1240] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:57.360476 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:57.319463 30542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39952 (request call id 1396) took 1120 ms. Trace:
I20260709 13:08:57.361176 30473 raft_consensus.cc:2393] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 3: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:57.361114 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:57.171942 30370 rpcz_store.cc:276] 0709 13:08:46.897533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.897721 (+   188us) service_pool.cc:224] Handling call
0709 13:08:57.054787 (+10157066us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:56.605915 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:56.606742 (+   827us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:56.606821 (+    79us) write_op.cc:435] Acquired schema lock
0709 13:08:56.606872 (+    51us) tablet.cc:662] Decoding operations
0709 13:08:56.607953 (+  1081us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:56.608041 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:56.608075 (+    34us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:08:56.608950 (+   875us) tablet.cc:701] Row locks acquired
0709 13:08:56.609003 (+    53us) write_op.cc:260] PREPARE: finished
0709 13:08:56.609192 (+   189us) write_op.cc:270] Start()
0709 13:08:56.609344 (+   152us) write_op.cc:276] Timestamp: P: 1783602536609133 usec, L: 0
0709 13:08:56.609364 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:08:56.610204 (+   840us) log.cc:844] Serialized 3199 byte log entry
0709 13:08:56.615479 (+  5275us) op_driver.cc:464] REPLICATION: finished
0709 13:08:56.620634 (+  5155us) write_op.cc:301] APPLY: starting
0709 13:08:56.620711 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:56.620925 (+   214us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:56.621089 (+   164us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:56.622320 (+  1231us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:56.623389 (+  1069us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:08:56.623425 (+    36us) write_op.cc:312] APPLY: finished
0709 13:08:56.623857 (+   432us) log.cc:844] Serialized 65 byte log entry
0709 13:08:56.625500 (+  1643us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:56.625634 (+   134us) write_op.cc:454] Released schema lock
0709 13:08:56.625702 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:56.626156 (+   454us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:56.626199 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":515222,"reported_tablets":29,"spinlock_wait_cycles":16128,"child_traces":[["op",{"apply.queue_time_us":4878,"apply.run_cpu_time_us":3314,"apply.run_wall_time_us":5474,"num_ops":8,"prepare.queue_time_us":8246,"prepare.run_cpu_time_us":5504,"prepare.run_wall_time_us":5789,"raft.queue_time_us":876,"raft.run_cpu_time_us":4835,"raft.run_wall_time_us":5137,"replication_time_us":5927,"thread_start_us":13265,"threads_started":4,"wal-append.queue_time_us":1061}]]}
I20260709 13:08:57.283746   360 consensus_queue.cc:1059] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:08:57.362023 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:57.382556 30471 raft_consensus.cc:2393] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 3: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:57.374764 30546 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:08:57.375013 30545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 432) took 1084 ms. Trace:
I20260709 13:08:57.383033 30545 rpcz_store.cc:276] 0709 13:08:56.274877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.346491 (+1071614us) service_pool.cc:224] Handling call
0709 13:08:57.358905 (+ 12414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:57.359411 (+   506us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:57.359582 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:57.375113 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:57.374460 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:57.376631 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:57.377319 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:57.357487 31146 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb22806325394ba386d8549bc4a64701"
dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
 from {username='slave'} at 127.0.0.1:48414
I20260709 13:08:57.386477 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:57.387311 30468 raft_consensus.cc:2393] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 5: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:57.386700 30549 raft_consensus.cc:2393] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 3: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
W20260709 13:08:57.378069 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 306234us
I20260709 13:08:57.377045 30469 raft_consensus.cc:2468] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 5.
I20260709 13:08:57.384953 30475 raft_consensus.cc:2393] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 6: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:57.375697 30551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 431) took 1154 ms. Trace:
I20260709 13:08:57.387378 30467 raft_consensus.cc:2393] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 3: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:57.385912 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:57.388118 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:57.388033 30549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43088 (request call id 1639) took 1030 ms. Trace:
I20260709 13:08:57.389304 30474 raft_consensus.cc:2393] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 6: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:57.386193 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:57.389489 30549 rpcz_store.cc:276] 0709 13:08:56.358016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.274985 (+916969us) service_pool.cc:224] Handling call
0709 13:08:57.387983 (+112998us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:57.388345 30551 rpcz_store.cc:276] 0709 13:08:56.225444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.341957 (+1116513us) service_pool.cc:224] Handling call
0709 13:08:57.346760 (+  4803us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:57.358352 (+ 11592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:57.358574 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:57.393198 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:57.393533 30472 raft_consensus.cc:2393] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 3: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
W20260709 13:08:57.394227 31113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.397480 30473 raft_consensus.cc:2393] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 5: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:57.390856 32540 raft_consensus.cc:697] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 5 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:57.401834 30550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 434) took 1115 ms. Trace:
I20260709 13:08:57.248128 32750 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:08:57.396523 30517 leader_election.cc:336] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.121s (SENT)
I20260709 13:08:57.374569   355 raft_consensus.cc:3060] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:57.402191 30550 rpcz_store.cc:276] 0709 13:08:56.275589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.347222 (+1071633us) service_pool.cc:224] Handling call
0709 13:08:57.375593 (+ 28371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:57.382061 (+  6468us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:57.382079 (+    18us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:57.390357 (+  8278us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:57.390396 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:57.390466 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:57.390560 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:57.412072 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:57.409142 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:57.412763 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:57.403383 31116 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:57.410449 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:57.409930 30589 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:57.417323 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:57.411805 30470 raft_consensus.cc:2468] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 2.
I20260709 13:08:57.375612   406 raft_consensus.cc:2749] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 2. Current term is 3.
I20260709 13:08:57.419720 30546 raft_consensus.cc:1240] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:57.425508 30551 raft_consensus.cc:1275] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:57.415633 30467 raft_consensus.cc:2468] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 2.
I20260709 13:08:57.425956 30546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 437) took 1149 ms. Trace:
I20260709 13:08:57.424681 30550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 439) took 1147 ms. Trace:
I20260709 13:08:57.426302 30546 rpcz_store.cc:276] 0709 13:08:56.276710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.401106 (+1124396us) service_pool.cc:224] Handling call
0709 13:08:57.419568 (+ 18462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:57.425734 (+  6166us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:57.425908 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:57.426699 30550 rpcz_store.cc:276] 0709 13:08:56.277411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.412251 (+1134840us) service_pool.cc:224] Handling call
0709 13:08:57.424138 (+ 11887us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:57.424329 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:57.424356 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:57.424418 (+    62us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:57.424463 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:57.424519 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:57.424628 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:57.433768 30551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 436) took 1157 ms. Trace:
I20260709 13:08:57.434213 30551 rpcz_store.cc:276] 0709 13:08:56.276340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.392020 (+1115680us) service_pool.cc:224] Handling call
0709 13:08:57.413988 (+ 21968us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:57.425865 (+ 11877us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:57.433705 (+  7840us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:57.433121 30475 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:08:57.441416 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:57.442238 30470 raft_consensus.cc:2393] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 5: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:57.443284 30471 raft_consensus.cc:2393] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 5: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:57.439678 30472 raft_consensus.cc:1240] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:57.462980 30467 raft_consensus.cc:1240] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:08:57.463101 30474 raft_consensus.cc:1240] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 5 LEADER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:08:57.463413 30551 raft_consensus.cc:1240] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:57.389768 32713 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:57.466670 30551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 1400) took 1092 ms. Trace:
I20260709 13:08:57.424553   354 consensus_queue.cc:1048] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:08:57.381538 32739 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:57.437593 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:08:57.466965 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 60086.6us
W20260709 13:08:57.517324 31113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.375669 30542 rpcz_store.cc:276] 0709 13:08:56.199140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.200042 (+   902us) service_pool.cc:224] Handling call
0709 13:08:56.763503 (+563461us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b5800028598. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780e43f8c 00007fc780e43ef6 0000000000375939 00007fc788eb71e0 00007fc788f800c4 00007fc788f80131 00007fc788f2e0a0 00007fc788f2d984 00007fc7824a86d4 00007fc7824a8662
0709 13:08:57.303710 (+540207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25888000}
W20260709 13:08:57.504000 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 107526us
I20260709 13:08:57.513458 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:57.383551 32659 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:57.514797 30545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 438) took 1237 ms. Trace:
I20260709 13:08:57.520970 30545 rpcz_store.cc:276] 0709 13:08:56.277059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.404018 (+1126959us) service_pool.cc:224] Handling call
0709 13:08:57.432227 (+ 28209us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:57.514151 (+ 81924us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:57.514558 (+   407us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:57.514592 (+    34us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:57.514620 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:57.514667 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:57.514741 (+    74us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:57.522006   415 raft_consensus.cc:2804] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:57.522432   415 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:08:57.515190 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 98416.7us
I20260709 13:08:57.487982 30472 raft_consensus.cc:1240] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:57.471364 30548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 1386) took 1741 ms. Trace:
I20260709 13:08:57.524571 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:57.529178 30467 raft_consensus.cc:2393] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 3: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:57.532665 30468 raft_consensus.cc:1275] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:57.533895 30470 raft_consensus.cc:1275] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:08:57.527376 30548 rpcz_store.cc:276] 0709 13:08:55.542769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:55.543177 (+   408us) service_pool.cc:224] Handling call
0709 13:08:55.550739 (+  7562us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:55.613515 (+ 62776us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:55.613545 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:56.898825 (+1285280us) spinlock_profiling.cc:243] Waited 52.5 ms on lock 0x7b1800406cc0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e492a6 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc782861a11 00007fc782871372 00007fc783fa3a01 00007fc783f6843a
0709 13:08:57.035000 (+136175us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b2c000f5468. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc782861a11 00007fc782871372 00007fc783fa3a01 00007fc783f6843a 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2
0709 13:08:57.035588 (+   588us) log.cc:844] Serialized 26 byte log entry
0709 13:08:57.280100 (+244512us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:57.280166 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:57.280277 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:57.283903 (+  3626us) raft_consensus.cc:1685] finished
0709 13:08:57.283919 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:57.284056 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28789,"raft.queue_time_us":165242,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":39290,"spinlock_wait_cycles":579680384,"thread_start_us":277624,"threads_started":2,"wal-append.queue_time_us":244530}
I20260709 13:08:57.545454 30470 raft_consensus.cc:1240] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:57.525606 30474 raft_consensus.cc:1240] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:57.466029 30469 raft_consensus.cc:1240] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:57.461278 30372 catalog_manager.cc:5697] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 1 to 5, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 5 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:57.511518 30551 rpcz_store.cc:276] 0709 13:08:56.374666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.435056 (+1060390us) service_pool.cc:224] Handling call
0709 13:08:57.462001 (+ 26945us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:57.466440 (+  4439us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:57.466614 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:57.522770   415 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:57.460057   399 raft_consensus.cc:2804] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:57.473384   353 raft_consensus.cc:2804] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:57.553064 30473 raft_consensus.cc:1240] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:57.554649 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:57.566831 30469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 1915) took 1013 ms. Trace:
I20260709 13:08:57.567539 30469 rpcz_store.cc:276] 0709 13:08:56.540694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.412784 (+872090us) service_pool.cc:224] Handling call
0709 13:08:57.431549 (+ 18765us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:57.553182 (+121633us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:57.553377 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:57.523542   303 raft_consensus.cc:2749] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:57.570739 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:57.575994 30467 raft_consensus.cc:2393] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 5: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
W20260709 13:08:57.579105 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 175812us
I20260709 13:08:57.587265 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:57.587911 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:57.566654   353 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:57.437283 32540 consensus_queue.cc:237] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:57.487118 32559 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:57.601272 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:57.595588 30469 raft_consensus.cc:2376] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5. Re-sending same reply.
W20260709 13:08:57.602368 30517 leader_election.cc:336] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.177s (SENT)
W20260709 13:08:57.608425 30591 leader_election.cc:336] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.554s (SENT)
I20260709 13:08:57.612562 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:57.613013 32750 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:57.613835 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:57.614897 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:57.616722 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:57.617488 32659 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:57.617852 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:57.618841 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:08:57.613161 30405 debug-util.cc:398] Leaking SignalData structure 0x7b080008a300 after lost signal to thread 29367
I20260709 13:08:57.620503 30591 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:57.599768   353 raft_consensus.cc:3060] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:57.682541 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 70908.5us
I20260709 13:08:57.684996 31146 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:57.685389 31146 raft_consensus.cc:3060] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:57.685352 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:57.688977 30469 raft_consensus.cc:2368] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 4. Current term is 5.
W20260709 13:08:57.689473   393 log.cc:927] Time spent T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 13:08:57.684628 32659 raft_consensus.cc:2749] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:57.684407   414 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.691665   414 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:57.694240   414 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:57.698571   402 raft_consensus.cc:3055] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:57.699079   402 raft_consensus.cc:740] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:57.700165   402 consensus_queue.cc:260] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:57.708813 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.709403   399 raft_consensus.cc:697] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 3 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
W20260709 13:08:57.718048 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.611040   365 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:08:57.748766 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 53849.6us
I20260709 13:08:57.745240 30475 raft_consensus.cc:1240] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:57.778769 30469 raft_consensus.cc:1240] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 1. Current term is 2. Ops: []
W20260709 13:08:57.769040 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 177058us
W20260709 13:08:57.813119 30405 debug-util.cc:398] Leaking SignalData structure 0x7b080008a2c0 after lost signal to thread 30408
I20260709 13:08:57.727869 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:57.814050 30472 raft_consensus.cc:2393] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 5: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
W20260709 13:08:57.814347 30405 debug-util.cc:398] Leaking SignalData structure 0x7b080039ac20 after lost signal to thread 30500
W20260709 13:08:57.768217 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 168922us
I20260709 13:08:57.712564 32737 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.803761 30470 raft_consensus.cc:3055] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:08:57.814704 30405 debug-util.cc:398] Leaking SignalData structure 0x7b0800218a20 after lost signal to thread 30501
W20260709 13:08:57.747925 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.770699 31146 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:57.797921 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 278515us
W20260709 13:08:57.818639 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 442715us
W20260709 13:08:57.817299 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 407430us
I20260709 13:08:57.796404 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:57.819253 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 478755us
I20260709 13:08:57.820771 30470 raft_consensus.cc:740] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
W20260709 13:08:57.822571 30405 debug-util.cc:398] Leaking SignalData structure 0x7b08003e6580 after lost signal to thread 30575
W20260709 13:08:57.830331 30405 debug-util.cc:398] Leaking SignalData structure 0x7b08002cd2e0 after lost signal to thread 30649
W20260709 13:08:57.832074 30405 debug-util.cc:398] Leaking SignalData structure 0x7b0800242860 after lost signal to thread 31175
W20260709 13:08:57.832401 30405 debug-util.cc:398] Leaking SignalData structure 0x7b08002e7e60 after lost signal to thread 31176
W20260709 13:08:57.868304 31115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.878934 30474 raft_consensus.cc:1240] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 4. Current term is 5. Ops: []
W20260709 13:08:57.879873 30589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:57.881023 31113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.796347 30544 raft_consensus.cc:1275] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:57.826205 30372 catalog_manager.cc:5697] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 1 to 2, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 2 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:57.797664   402 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:57.682087 32600 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:08:57.890198 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 68640.1us
W20260709 13:08:57.898613 30517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:57.890807 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 62898.3us
W20260709 13:08:57.902918 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:57.903744 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.801002 32739 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:57.910777 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:57.895776 31145 raft_consensus.cc:1240] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 5. Current term is 7. Ops: []
I20260709 13:08:57.910589 30372 catalog_manager.cc:5697] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 1 to 2, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 2 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:57.918035 30546 raft_consensus.cc:1240] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:08:57.915982 30619 raft_consensus.cc:2410] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:08:57.907243 30470 consensus_queue.cc:260] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:57.923916 30589 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:08:57.908574 30543 consensus_meta.cc:287] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.531s	user 0.008s	sys 0.000s
I20260709 13:08:57.928737   427 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:57.932317 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 63172.6us
W20260709 13:08:57.930675 30591 leader_election.cc:336] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.595s (SENT)
I20260709 13:08:57.933212 30591 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:57.867282 32737 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:57.949525 30590 leader_election.cc:304] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:57.743346   399 consensus_queue.cc:237] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:08:57.953550   421 log.cc:927] Time spent T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:08:57.955083 32713 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:57.955849 30550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 1399) took 1581 ms. Trace:
I20260709 13:08:57.956210 30550 rpcz_store.cc:276] 0709 13:08:56.374363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.427706 (+1053343us) service_pool.cc:224] Handling call
0709 13:08:57.465784 (+ 38078us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:57.466120 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:57.466146 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:57.528335 (+ 62189us) log.cc:844] Serialized 494 byte log entry
0709 13:08:57.817691 (+289356us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:57.817734 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:57.817802 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:57.955599 (+137797us) raft_consensus.cc:1685] finished
0709 13:08:57.955621 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:57.955765 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":230135,"threads_started":1,"wal-append.queue_time_us":348200}
I20260709 13:08:57.957293 32737 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:08:57.961508 31113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.962937 32750 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
W20260709 13:08:57.963748 30591 leader_election.cc:336] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.718s (SENT)
I20260709 13:08:57.963572 32750 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:57.964378 30591 leader_election.cc:304] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:57.966327   427 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:57.967156 32659 consensus_queue.cc:1059] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:57.967869   335 raft_consensus.cc:2804] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:57.968210 32659 raft_consensus.cc:2749] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:57.968487   427 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:57.968799   365 raft_consensus.cc:2749] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:57.968490   335 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:57.969776 30372 catalog_manager.cc:5697] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 1 to 3, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 3 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:57.970605   335 raft_consensus.cc:3060] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:57.970255   425 raft_consensus.cc:2955] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 3 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:57.972142 32732 consensus_queue.cc:1048] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.106s
I20260709 13:08:57.973512 32732 consensus_queue.cc:1059] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:57.914371   426 consensus_queue.cc:1048] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:08:57.930696 30543 raft_consensus.cc:2468] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
I20260709 13:08:57.968912 32659 raft_consensus.cc:3055] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:57.966714 32750 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:57.988767 30549 raft_consensus.cc:1240] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:57.961696 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:58.041343 30542 raft_consensus.cc:3060] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:58.044085   303 raft_consensus.cc:2764] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:08:57.990875 32600 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:57.992005 30546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43088 (request call id 1638) took 1634 ms. Trace:
I20260709 13:08:58.045152 30546 rpcz_store.cc:276] 0709 13:08:56.357690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.427040 (+1069350us) service_pool.cc:224] Handling call
0709 13:08:57.444832 (+ 17792us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:57.922663 (+477831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:57.991670 (+ 69007us) spinlock_profiling.cc:243] Waited 473 ms on lock 0x7b54000c4c54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:57.991928 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1087676288}
W20260709 13:08:57.994982 30476 consensus_meta.cc:287] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.676s	user 0.006s	sys 0.000s
I20260709 13:08:57.997645 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:58.000172 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:58.048122 30550 raft_consensus.cc:2393] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 2: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:08:58.049350 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:58.050307 30550 raft_consensus.cc:2393] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 5: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:08:58.004746 30475 raft_consensus.cc:1240] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 4. Current term is 5. Ops: []
W20260709 13:08:58.007346   411 log.cc:927] Time spent T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.323s	user 0.001s	sys 0.000s
I20260709 13:08:58.007925 30473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 1913) took 1480 ms. Trace:
I20260709 13:08:58.005740   335 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:58.012656 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
W20260709 13:08:58.016745 32501 consensus_meta.cc:287] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.673s	user 0.009s	sys 0.000s
W20260709 13:08:57.961570 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 52923.4us
W20260709 13:08:58.019268 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.018062 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:58.024142 30470 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:58.019781 32659 raft_consensus.cc:740] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:58.027503 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:58.028713 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:58.063119 30474 raft_consensus.cc:2368] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 2. Current term is 3.
I20260709 13:08:58.063244 30469 raft_consensus.cc:2393] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 3: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:58.064066 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:58.064469 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:58.065236 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:08:58.029485 30591 leader_election.cc:336] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.832s (SENT)
W20260709 13:08:58.031410   350 consensus_meta.cc:287] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.718s	user 0.003s	sys 0.004s
W20260709 13:08:57.985594 32575 consensus_meta.cc:287] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.739s	user 0.011s	sys 0.000s
W20260709 13:08:57.987023   355 consensus_meta.cc:287] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.565s	user 0.009s	sys 0.000s
I20260709 13:08:58.018781 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:58.084674 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:58.085522 30546 raft_consensus.cc:2410] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:58.089393   335 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:08:58.092726 31114 leader_election.cc:336] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Timed out: RequestConsensusVote RPC to 127.28.173.2:34733 timed out after 1.623s (SENT)
I20260709 13:08:58.076314 32501 raft_consensus.cc:515] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:58.094539 30550 raft_consensus.cc:1240] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:58.094916 32501 leader_election.cc:290] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:58.095846 30616 raft_consensus.cc:2393] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 3: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
W20260709 13:08:58.095880 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 152478us
I20260709 13:08:58.076928 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:58.039208   353 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:58.040729 30543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43088 (request call id 1636) took 1666 ms (client timeout 1803 ms). Trace:
W20260709 13:08:58.053234 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 185599us
I20260709 13:08:58.054281 30476 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
I20260709 13:08:58.105525 30476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 1938) took 1267 ms. Trace:
I20260709 13:08:58.052384 30473 rpcz_store.cc:276] 0709 13:08:56.527770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.407777 (+880007us) service_pool.cc:224] Handling call
0709 13:08:57.438395 (+ 30618us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:57.565174 (+126779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:58.007694 (+442520us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54001220d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:58.007870 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":263295360}
I20260709 13:08:58.066390 30591 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
W20260709 13:08:58.067103 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 115923us
I20260709 13:08:58.066015 30474 raft_consensus.cc:2393] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 4: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:58.065986 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:08:58.076658 30517 leader_election.cc:336] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.982s (SENT)
I20260709 13:08:58.077533 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:58.079078 30467 raft_consensus.cc:2468] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
I20260709 13:08:58.080539 30471 raft_consensus.cc:2393] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 4: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
W20260709 13:08:58.101665 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 215072us
I20260709 13:08:58.105907 30476 rpcz_store.cc:276] 0709 13:08:56.838324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.241534 (+403210us) service_pool.cc:224] Handling call
0709 13:08:58.105467 (+863933us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:58.114514 30547 raft_consensus.cc:2410] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:08:58.116081 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:58.116842 30517 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:58.117084 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:58.118098 30467 raft_consensus.cc:2410] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:58.118688 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:58.122982 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:58.116524 30468 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 8.
I20260709 13:08:58.120518 30440 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:58.127208 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:58.128113 30476 raft_consensus.cc:2368] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 4. Current term is 5.
I20260709 13:08:58.131354 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:58.135991 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:58.137630 30469 raft_consensus.cc:2393] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 5: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:58.132566 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:58.141602 30474 raft_consensus.cc:2368] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 2. Current term is 3.
W20260709 13:08:58.147748 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:58.148311 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:58.155447 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.155545 30516 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:08:58.155897 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:58.156276 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.156631 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:58.157416 30467 raft_consensus.cc:2368] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 4. Current term is 5.
I20260709 13:08:58.158911 30469 pending_rounds.cc:85] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326: Aborting all ops after (but not including) 2
I20260709 13:08:58.159286 30469 pending_rounds.cc:107] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:08:58.159546 30469 raft_consensus.cc:2889] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:58.159660 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:58.164215 30474 raft_consensus.cc:1240] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:58.164342 30468 raft_consensus.cc:2368] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 4. Current term is 5.
I20260709 13:08:58.165551 30475 raft_consensus.cc:1240] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:58.166224 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:58.172474 30473 raft_consensus.cc:1275] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:58.173396 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:08:58.105149 30543 rpcz_store.cc:269] 0709 13:08:56.357037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.208509 (+851472us) service_pool.cc:224] Handling call
0709 13:08:58.023321 (+814812us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:58.116631 32501 consensus_queue.cc:1059] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:08:58.174510 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:58.176394 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:58.173594 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:58.150839 32737 raft_consensus.cc:2804] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:58.131196   350 consensus_queue.cc:1059] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:08:58.176623 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:58.150018   426 raft_consensus.cc:2749] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:58.184890 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 155442us
I20260709 13:08:58.185847 30546 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
I20260709 13:08:58.180764 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:58.182626 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:58.183089   428 raft_consensus.cc:2749] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:58.183230 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:58.186542 30545 raft_consensus.cc:3060] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:58.180743 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 118777us
W20260709 13:08:58.188740 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.165196   406 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:58.189610 31150 raft_consensus.cc:2393] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 4: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:08:58.194695 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:58.190192 31147 raft_consensus.cc:1240] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:08:58.190249 31151 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:08:58.174012 32540 raft_consensus.cc:2804] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:58.097998 32659 consensus_queue.cc:260] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:58.263463 30591 leader_election.cc:336] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.845s (SENT)
W20260709 13:08:58.263772 31114 leader_election.cc:336] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Timed out: RequestConsensusVote RPC to 127.28.173.2:34733 timed out after 1.759s (SENT)
W20260709 13:08:58.268853 30591 leader_election.cc:336] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.884s (SENT)
W20260709 13:08:58.269892 30591 leader_election.cc:336] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.949s (SENT)
I20260709 13:08:58.270292 30591 leader_election.cc:304] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
W20260709 13:08:58.271471 30591 leader_election.cc:336] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.958s (SENT)
I20260709 13:08:58.278321   300 raft_consensus.cc:2749] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:58.280112   409 log.cc:927] Time spent T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.567s	user 0.002s	sys 0.000s
I20260709 13:08:58.382355 30625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 351) took 1180 ms. Trace:
I20260709 13:08:58.332028 30591 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
W20260709 13:08:58.271965 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 97786us
I20260709 13:08:58.260705 32540 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:58.384152 32540 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:58.384449 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 112999us
W20260709 13:08:58.385414 30591 leader_election.cc:336] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.993s (SENT)
W20260709 13:08:58.386615 30591 leader_election.cc:336] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.995s (SENT)
I20260709 13:08:58.259999 32737 raft_consensus.cc:697] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 5 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
W20260709 13:08:58.277252 30517 leader_election.cc:336] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.065s (SENT)
I20260709 13:08:58.388070 30517 leader_election.cc:304] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:58.388089   428 consensus_queue.cc:1048] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:58.388902   402 raft_consensus.cc:2749] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:58.389731 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:58.389253 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 112063us
W20260709 13:08:58.289899 31113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.383271 30542 raft_consensus.cc:2468] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
W20260709 13:08:58.287603   415 consensus_meta.cc:287] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.711s	user 0.008s	sys 0.000s
I20260709 13:08:58.168372   439 consensus_queue.cc:1059] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:08:58.288158 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:58.334692   303 consensus_queue.cc:1059] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:58.330847 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:58.340173 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:58.187331 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:58.384605 30516 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:58.265125   406 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:58.284870 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 48041.8us
I20260709 13:08:58.411384 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:58.285768   353 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:08:58.393834 30517 leader_election.cc:336] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.218s (SENT)
I20260709 13:08:58.382753 30625 rpcz_store.cc:276] 0709 13:08:57.202435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.202597 (+   162us) service_pool.cc:224] Handling call
0709 13:08:57.202908 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:57.203334 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:57.305796 (+102462us) log.cc:844] Serialized 14 byte log entry
0709 13:08:57.464563 (+158767us) log.cc:844] Serialized 14 byte log entry
0709 13:08:57.464721 (+   158us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:57.523209 (+ 58488us) log.cc:844] Serialized 26 byte log entry
0709 13:08:57.523337 (+   128us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:57.523369 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:57.523456 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:58.279334 (+755878us) spinlock_profiling.cc:243] Waited 64 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:08:58.382135 (+102801us) raft_consensus.cc:1685] finished
0709 13:08:58.382156 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:58.382291 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":51451,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":65,"raft.queue_time_us":127918,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":23981,"spinlock_wait_cycles":147222784,"thread_start_us":179770,"threads_started":2,"wal-append.queue_time_us":332214}
I20260709 13:08:58.334064 32395 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.409489 30474 raft_consensus.cc:2376] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5. Re-sending same reply.
I20260709 13:08:58.413067 30473 raft_consensus.cc:2393] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 4: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:08:58.416157 30545 raft_consensus.cc:2468] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:08:58.414888 30475 raft_consensus.cc:2468] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 2.
W20260709 13:08:58.418138 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.423935 30517 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:58.424993   444 raft_consensus.cc:2749] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:08:58.425695 30517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.428030 30516 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:58.428797 32739 consensus_queue.cc:1059] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:58.429126 30516 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:58.429886   444 raft_consensus.cc:2804] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:58.429986 30516 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:58.430449   444 raft_consensus.cc:697] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 3 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:58.431317   444 consensus_queue.cc:237] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:58.431941   402 raft_consensus.cc:2764] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:08:58.432566   439 raft_consensus.cc:3055] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:58.433156   402 raft_consensus.cc:2804] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:08:58.433745 31115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.433851   402 raft_consensus.cc:697] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 5 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:58.434821   303 raft_consensus.cc:3055] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:58.435436   303 raft_consensus.cc:740] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:58.437045 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:58.436618   303 consensus_queue.cc:260] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:58.437832 31151 raft_consensus.cc:2393] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 6: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:08:58.438432   303 raft_consensus.cc:3060] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:58.435061   445 raft_consensus.cc:2804] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:58.439009 31146 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:58.439303   445 raft_consensus.cc:697] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 5 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:58.439541 31146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:48414 (request call id 620) took 1099 ms. Trace:
I20260709 13:08:58.440284   445 consensus_queue.cc:237] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:58.440968 30549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 435) took 2165 ms. Trace:
I20260709 13:08:58.415978 30543 raft_consensus.cc:3060] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:58.451402 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.433112   439 raft_consensus.cc:740] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:58.453737 31146 rpcz_store.cc:276] 0709 13:08:57.342107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.342527 (+   420us) service_pool.cc:224] Handling call
0709 13:08:58.437853 (+1095326us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b5400780354. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f5fa3d 00007fc788f2fcd0 00007fc7824b4254 00007fc7824b41e2 00007fc7824b4111 00007fc7824b408c 00007fc7824b3342 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:08:58.439426 (+  1573us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":674561792}
I20260709 13:08:58.387763 32737 consensus_queue.cc:237] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:58.455374 30440 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:58.455336 30470 raft_consensus.cc:1275] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:08:58.458048 30517 leader_election.cc:336] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.608s (SENT)
I20260709 13:08:58.466912 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:58.468452 30470 raft_consensus.cc:2368] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 2. Current term is 3.
W20260709 13:08:58.460704 30591 leader_election.cc:336] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.049s (SENT)
I20260709 13:08:58.469239 30591 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:58.459513 30549 rpcz_store.cc:276] 0709 13:08:56.275961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.391489 (+1115528us) service_pool.cc:224] Handling call
0709 13:08:57.987680 (+596191us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:58.027058 (+ 39378us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:58.440783 (+413725us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b54001441d0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f678ad 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:08:58.440908 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1320116608}
I20260709 13:08:58.476310 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:58.480290 30475 raft_consensus.cc:2393] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 3: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:58.478063 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:58.480662 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:58.421679   300 raft_consensus.cc:2749] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:58.482275 31151 raft_consensus.cc:1240] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 3. Current term is 4. Ops: []
W20260709 13:08:58.482381 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 294838us
W20260709 13:08:58.475108 30516 connection.cc:256] RPC call timeout handler was delayed by -1.7109769260000576s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1836s for a response
I20260709 13:08:58.488473 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:58.489064 30470 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
I20260709 13:08:58.452826   406 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:58.494014 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:58.412760   415 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:58.497638 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
W20260709 13:08:58.488955 30517 leader_election.cc:336] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.609s (SENT)
I20260709 13:08:58.498518 30474 raft_consensus.cc:2393] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 5: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:58.499385 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:58.500001 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:08:58.502617 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.502784 30475 raft_consensus.cc:2468] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:58.506767 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:58.507841 30472 raft_consensus.cc:2393] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 5: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:58.508659 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:58.484385 31149 raft_consensus.cc:2955] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:58.461758 32395 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:58.513923 30620 raft_consensus.cc:1240] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:58.512035 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:58.434860   402 consensus_queue.cc:237] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:58.486039 32501 raft_consensus.cc:2749] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:58.504084 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:58.514788 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:58.491039 32750 consensus_queue.cc:1048] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:08:58.521519 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:58.486936 32648 consensus_queue.cc:1048] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:08:58.525585 31151 raft_consensus.cc:2468] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 7.
I20260709 13:08:58.520522 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:58.530333 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:58.531054 30470 raft_consensus.cc:2368] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 2. Current term is 3.
I20260709 13:08:58.527164 30474 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
I20260709 13:08:58.528031   450 raft_consensus.cc:2804] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:58.533774 30470 raft_consensus.cc:1275] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:08:58.520731 32739 raft_consensus.cc:3055] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:08:58.539603 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 84337.9us
I20260709 13:08:58.540398 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
W20260709 13:08:58.542052 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 53111us
I20260709 13:08:58.511088 32575 consensus_queue.cc:1048] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:08:58.504171   420 consensus_queue.cc:1059] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:08:58.543509 30474 raft_consensus.cc:1275] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:58.548970 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
W20260709 13:08:58.547222 30517 leader_election.cc:336] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.714s (SENT)
I20260709 13:08:58.549803 30517 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
W20260709 13:08:58.542624 31113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.552145 30475 raft_consensus.cc:2368] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 4. Current term is 5.
I20260709 13:08:58.543855 32739 raft_consensus.cc:740] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:58.546590   450 raft_consensus.cc:697] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:58.570755 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:58.571908 30474 raft_consensus.cc:2393] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 4: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
W20260709 13:08:58.573297 30517 leader_election.cc:336] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.746s (SENT)
I20260709 13:08:58.573851 30517 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
W20260709 13:08:58.559192   425 consensus_meta.cc:287] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.558s	user 0.011s	sys 0.000s
I20260709 13:08:58.574672   444 raft_consensus.cc:2749] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:58.579337 30517 leader_election.cc:336] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.791s (SENT)
I20260709 13:08:58.587381   420 raft_consensus.cc:2749] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:58.588546 32395 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:58.592520   415 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:58.593726 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:58.594609 30549 raft_consensus.cc:2410] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:58.594673 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:58.550892   355 consensus_queue.cc:1059] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:08:58.595498 30542 raft_consensus.cc:2376] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3. Re-sending same reply.
I20260709 13:08:58.596582   355 raft_consensus.cc:3055] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:58.596999   355 raft_consensus.cc:740] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:58.546780   439 consensus_queue.cc:260] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:58.597932 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:58.598261   439 raft_consensus.cc:3060] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:58.597946   355 consensus_queue.cc:260] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:58.597997   447 consensus_queue.cc:1059] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.109s
I20260709 13:08:58.600594 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:58.601729 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:58.602643 31142 raft_consensus.cc:2393] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 4: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
W20260709 13:08:58.602949 30591 leader_election.cc:336] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.147s (SENT)
I20260709 13:08:58.601764   447 raft_consensus.cc:3055] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:58.603474 30591 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:58.603574   447 raft_consensus.cc:740] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:58.573621   353 consensus_queue.cc:1048] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:08:58.605593 32501 raft_consensus.cc:2749] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:08:58.608522   448 log.cc:927] Time spent T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
W20260709 13:08:58.615641 30517 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.882s (SENT) [suppressed 87 similar messages]
I20260709 13:08:58.618250 30440 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:08:58.619488 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.622700   455 raft_consensus.cc:2804] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:58.577451 32713 consensus_queue.cc:1059] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:08:58.623459   455 raft_consensus.cc:697] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:58.624604   455 consensus_queue.cc:237] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:58.625927 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.627130   427 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.631201   450 consensus_queue.cc:237] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:58.633818   440 raft_consensus.cc:3055] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:58.634313   440 raft_consensus.cc:740] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:58.595649 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
W20260709 13:08:58.621083   434 consensus_queue.cc:1175] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "092f6eb694fc4bbeab49677cccd880fd" responder_term: 2 status { last_received { term: 2 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 2 index: 5 } }
W20260709 13:08:58.625046   452 log.cc:927] Time spent T 00000000000000000000000000000000 P 045170a35afe4845987482e49e9e1eb9: Append to log took a long time: real 0.052s	user 0.001s	sys 0.001s
I20260709 13:08:58.638577 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:58.638985 32540 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:58.677909 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:58.616289 32739 consensus_queue.cc:260] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:08:58.641363 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.684470 30472 raft_consensus.cc:2468] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
W20260709 13:08:58.685328 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.685597 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:08:58.643548 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:58.655988 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.661315 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:58.661702 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:58.662599 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:08:58.638334 30547 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35278 (request call id 428) took 2435 ms (client timeout 3229 ms). Trace:
W20260709 13:08:58.688678 31114 leader_election.cc:336] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Timed out: RequestConsensusVote RPC to 127.28.173.2:34733 timed out after 1.971s (SENT)
W20260709 13:08:58.670486 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 112014us
I20260709 13:08:58.689232 31114 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:08:58.689122 30547 rpcz_store.cc:269] 0709 13:08:56.202826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.344728 (+1141902us) service_pool.cc:224] Handling call
0709 13:08:58.638089 (+1293361us) spinlock_profiling.cc:243] Waited 726 ms on lock 0x7b5400358254. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:08:58.638282 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1670363392}
W20260709 13:08:58.668666   448 log.cc:927] Time spent T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.059s	user 0.000s	sys 0.002s
I20260709 13:08:58.688266 30475 raft_consensus.cc:2468] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 2.
I20260709 13:08:58.691501 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
W20260709 13:08:58.684955 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 198346us
I20260709 13:08:58.700562 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:58.703109 30589 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:58.627686   427 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:58.707326 32739 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:58.709345   367 raft_consensus.cc:493] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.635275   440 consensus_queue.cc:260] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:58.712200 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:58.713007 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:58.714151 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:58.712314 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:58.690312 32559 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:58.724057 30622 raft_consensus.cc:3055] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:58.724234 30472 raft_consensus.cc:3060] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:58.725647 30622 raft_consensus.cc:740] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:58.695961   355 raft_consensus.cc:3060] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:58.729358 30589 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:08:58.735952 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.785071 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:58.798218 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:58.799152 30617 raft_consensus.cc:2468] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 4.
I20260709 13:08:58.799516   345 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.800046   345 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:58.800176 30622 consensus_queue.cc:260] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:58.801051 30622 raft_consensus.cc:3060] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:08:58.802126   345 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:58.802433 30543 raft_consensus.cc:2468] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:58.803540 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:58.804175 32395 raft_consensus.cc:2749] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:58.805809 32540 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:58.722951   406 raft_consensus.cc:2804] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:58.806600   406 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.806995   406 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:58.725579   367 raft_consensus.cc:515] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:58.828090 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 98850.8us
I20260709 13:08:58.834007 30622 raft_consensus.cc:2468] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 7.
I20260709 13:08:58.832424 30589 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:58.837284 30589 leader_election.cc:304] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:58.705971   429 consensus_queue.cc:1059] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
W20260709 13:08:58.847198 30589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.841204 31115 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:58.840660 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:08:58.849077 30517 leader_election.cc:336] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.434s (SENT)
I20260709 13:08:58.851045 30624 raft_consensus.cc:2368] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 6. Current term is 7.
W20260709 13:08:58.851603 30589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.852973   444 raft_consensus.cc:3055] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:58.853377   444 raft_consensus.cc:740] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:58.854277   444 consensus_queue.cc:260] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:58.855279   444 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:58.833033 32501 raft_consensus.cc:2804] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:58.861217 32501 raft_consensus.cc:697] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:58.860498 30551 raft_consensus.cc:2955] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:58.861491   463 raft_consensus.cc:2804] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:58.862015   463 raft_consensus.cc:697] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:58.862149 32501 consensus_queue.cc:237] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:58.862879   463 consensus_queue.cc:237] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:58.790082   399 consensus_queue.cc:1059] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:08:58.864310 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:58.864771   427 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:58.864925 31148 raft_consensus.cc:3060] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:58.865470 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:58.856052 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:58.856305   449 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:58.857029   468 raft_consensus.cc:3055] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:08:58.859333   457 log.cc:927] Time spent T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:08:58.867688 31115 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:08:58.868566 30589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:58.874182 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 180356us
I20260709 13:08:58.908812 30516 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
W20260709 13:08:58.885274 30616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47446 (request call id 2013) took 2392 ms (client timeout 2965 ms). Trace:
W20260709 13:08:58.885689 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:58.910475 30616 rpcz_store.cc:269] 0709 13:08:56.492438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.704734 (+212296us) service_pool.cc:224] Handling call
0709 13:08:58.885082 (+2180348us) spinlock_profiling.cc:243] Waited 917 ms on lock 0x7b54003467d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:08:58.885219 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2108305280}
I20260709 13:08:58.889467   447 consensus_queue.cc:260] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:58.890986   407 raft_consensus.cc:3055] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:08:58.913931 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 46316.6us
I20260709 13:08:58.895748   335 raft_consensus.cc:2955] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:08:58.859547   440 raft_consensus.cc:3060] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:58.912014 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:58.848510   415 raft_consensus.cc:493] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:58.912523 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:58.914660 31115 leader_election.cc:400] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 election: Vote denied by peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) with higher term. Message: Invalid argument: T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 6. Current term is 7.
I20260709 13:08:58.969051 31115 leader_election.cc:403] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:08:58.915140 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:58.916978 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:58.906490 31142 raft_consensus.cc:2468] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
W20260709 13:08:58.948868 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.917481   407 raft_consensus.cc:740] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:58.973369   407 consensus_queue.cc:260] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:58.974597   407 raft_consensus.cc:3060] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:58.964098 32395 raft_consensus.cc:2804] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:58.976133 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:58.979225 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:58.980706 30544 raft_consensus.cc:1275] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:58.981824 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:58.982982 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
W20260709 13:08:58.971185   303 consensus_meta.cc:287] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.532s	user 0.009s	sys 0.006s
I20260709 13:08:58.912974   367 leader_election.cc:290] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:08:58.944793 31113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.904057   429 raft_consensus.cc:2804] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:58.988242 30589 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
W20260709 13:08:58.947956 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.966392 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:58.903631   468 raft_consensus.cc:740] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
W20260709 13:08:58.935000 30517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.969628 30550 raft_consensus.cc:2393] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 5: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
W20260709 13:08:58.971679 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:59.022670 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.988343 30625 raft_consensus.cc:2410] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:08:58.962581 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:58.992717 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:59.023471 30622 raft_consensus.cc:2468] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 3.
I20260709 13:08:59.024339 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:59.024602 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:59.025313 30622 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:59.025930 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:59.026674 30618 raft_consensus.cc:2468] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 4.
I20260709 13:08:58.994779 30543 raft_consensus.cc:2468] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 5.
I20260709 13:08:58.963308   447 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:58.964946   461 raft_consensus.cc:2804] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:08:59.003988 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 89449.1us
I20260709 13:08:59.035919 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
W20260709 13:08:59.036376 31115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.970498   415 raft_consensus.cc:515] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:08:59.036772 31115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.027738 30624 raft_consensus.cc:2393] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 4: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:08:59.028359 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:59.032305 30622 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 6.
I20260709 13:08:59.037619 30618 raft_consensus.cc:2393] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 3: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:08:59.033087 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:59.040035 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:59.003988 32395 raft_consensus.cc:697] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 7 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:59.046938 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:59.051126 30624 raft_consensus.cc:2468] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 4.
I20260709 13:08:59.047559 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:59.013407   429 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.029695 32750 raft_consensus.cc:3060] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:59.049096 31115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.049240 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:58.991945 30542 raft_consensus.cc:2376] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3. Re-sending same reply.
I20260709 13:08:59.053059 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:08:59.054512 31113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:59.054469 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 365808us
I20260709 13:08:59.038671   461 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:59.062069 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:59.028033 31143 raft_consensus.cc:2468] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 3.
I20260709 13:08:58.990221   406 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:59.065716 31115 leader_election.cc:304] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:59.069475 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:59.107445 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:59.113778 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:59.114455 30551 raft_consensus.cc:2468] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
I20260709 13:08:59.062229 31142 raft_consensus.cc:2468] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
I20260709 13:08:59.112601   303 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:59.117578   467 log.cc:927] Time spent T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:08:59.117831   303 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:59.119942   303 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:59.120064 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:59.069268   461 raft_consensus.cc:3060] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:59.123978   450 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.124650   450 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:59.127136 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.120837 30543 raft_consensus.cc:2393] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 5: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:08:59.113232 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
W20260709 13:08:59.128082 31113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:59.129323 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:59.116333 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 55319.2us
I20260709 13:08:59.058612   429 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:59.165866 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 100243us
I20260709 13:08:59.147163 31148 raft_consensus.cc:2468] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
I20260709 13:08:59.170290   439 raft_consensus.cc:2804] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:59.048255   468 consensus_queue.cc:260] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:59.212450 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.173840 30551 raft_consensus.cc:1240] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:59.171254 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:59.193621 30616 raft_consensus.cc:1240] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:59.188161 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:59.220854 30543 raft_consensus.cc:2468] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 6.
I20260709 13:08:59.221613 30624 raft_consensus.cc:2393] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 5: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
W20260709 13:08:59.221809 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:59.194003   465 log.cc:927] Time spent T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
W20260709 13:08:59.194442   473 log.cc:927] Time spent T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:08:59.229278 32659 raft_consensus.cc:3060] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:59.230713   406 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:08:59.340080 30517 leader_election.cc:336] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 3.090s (SENT)
I20260709 13:08:59.233649 32750 raft_consensus.cc:2749] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:59.234836 30472 raft_consensus.cc:2468] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:59.236155 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:59.239336 30440 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:59.240352 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:59.244103 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:59.244380   468 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:59.245424   475 log.cc:927] Time spent T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:08:59.251160   444 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:08:59.254190 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.254299 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:59.260628   415 leader_election.cc:290] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:59.188378   450 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:08:59.291917 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:59.349231 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:59.328704 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.332679 30617 raft_consensus.cc:2468] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
I20260709 13:08:59.213317   439 raft_consensus.cc:493] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:59.336159 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 271433us
I20260709 13:08:59.162101   445 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.347363 31150 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:08:59.370774 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:59.371610 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:59.193608 32395 consensus_queue.cc:237] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:59.383219 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:59.383983   444 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:59.388469 30544 raft_consensus.cc:2468] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 5.
I20260709 13:08:59.372421   450 raft_consensus.cc:2804] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:08:59.391489 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.373348   478 raft_consensus.cc:493] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.387625 30545 raft_consensus.cc:1240] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:59.406350 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:59.407099 30472 raft_consensus.cc:3060] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:08:59.408612 30471 raft_consensus.cc:1240] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:59.394078 30617 raft_consensus.cc:2393] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 5: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:08:59.351649   449 raft_consensus.cc:2749] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:59.369973   439 raft_consensus.cc:3060] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:59.389295 30547 raft_consensus.cc:1240] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 4. Current term is 5. Ops: []
W20260709 13:08:59.425467 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.425513 30467 raft_consensus.cc:1240] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 5 LEADER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:59.426460 30467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 422) took 1243 ms. Trace:
I20260709 13:08:59.426889 30467 rpcz_store.cc:276] 0709 13:08:58.182827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.398983 (+1216156us) service_pool.cc:224] Handling call
0709 13:08:59.425280 (+ 26297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:59.426162 (+   882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:59.426396 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:59.429559 30551 raft_consensus.cc:3060] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:59.431706 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:59.432482 30469 raft_consensus.cc:2468] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 3.
W20260709 13:08:59.415663 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.411147 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:59.441821 31114 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:59.442618 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:59.443022 31114 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:59.443166 30476 raft_consensus.cc:3060] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:59.370880   445 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:59.432878   484 log.cc:927] Time spent T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.060s	user 0.002s	sys 0.001s
I20260709 13:08:59.402318   450 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.448697 30468 raft_consensus.cc:1240] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:59.449129 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:08:59.444842   438 log.cc:927] Time spent T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 1.358s	user 0.009s	sys 0.012s
I20260709 13:08:59.451987 30621 raft_consensus.cc:1240] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:59.409838   360 raft_consensus.cc:3055] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:59.452291 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:59.453275 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:59.424819   463 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:59.455787 30467 raft_consensus.cc:2468] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 5.
W20260709 13:08:59.455987 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 216707us
I20260709 13:08:59.456670 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:59.460098 30617 raft_consensus.cc:3060] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:59.461259 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:08:59.456638 30517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.433772 32750 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:59.461840 30550 raft_consensus.cc:1275] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:08:59.464668 31115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.463172 30516 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:59.469583 30551 raft_consensus.cc:2468] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 4.
I20260709 13:08:59.445530 32732 raft_consensus.cc:2749] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:59.461854 30543 raft_consensus.cc:2468] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 3.
I20260709 13:08:59.452519   367 raft_consensus.cc:2749] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:59.477794 30617 raft_consensus.cc:2468] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 5.
I20260709 13:08:59.457212   450 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:59.479838 30472 raft_consensus.cc:2468] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 7.
I20260709 13:08:59.477530   499 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:59.485886 30550 raft_consensus.cc:1275] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:08:59.488091 30543 raft_consensus.cc:1275] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:59.452414   407 consensus_queue.cc:1048] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:08:59.457577   360 raft_consensus.cc:740] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:59.495252 30476 raft_consensus.cc:2468] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 6.
I20260709 13:08:59.495962 30545 raft_consensus.cc:2468] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 5.
W20260709 13:08:59.503695 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 66305.3us
I20260709 13:08:59.475979 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:59.506438 30547 raft_consensus.cc:1275] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:08:59.508074 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:59.510495 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:59.511164 30617 raft_consensus.cc:2368] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 5. Current term is 6.
I20260709 13:08:59.513614 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:08:59.514777 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 51669.6us
I20260709 13:08:59.515434 30543 raft_consensus.cc:1275] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:59.470134   463 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:59.477123 32750 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:59.517160 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:59.518608 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:59.507902   500 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:59.524137 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:59.525755   445 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:59.520406   498 raft_consensus.cc:2804] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:59.526991   498 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.527307   498 raft_consensus.cc:3060] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:59.528482   491 log.cc:927] Time spent T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:08:59.530059   495 log.cc:927] Time spent T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:08:59.532159 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:59.532488 30544 raft_consensus.cc:2410] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:08:59.533221 32750 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:59.533455 30550 raft_consensus.cc:1275] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:08:59.533794 30550 pending_rounds.cc:85] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd: Aborting all ops after (but not including) 4
I20260709 13:08:59.534010 30550 pending_rounds.cc:107] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:08:59.534227 30550 raft_consensus.cc:2889] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:59.496387   429 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:59.534421   461 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:59.536723   429 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:59.538511   463 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:59.448698   487 consensus_queue.cc:1048] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.097s
I20260709 13:08:59.540781   444 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:08:59.542275   447 consensus_meta.cc:287] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.504s	user 0.009s	sys 0.000s
I20260709 13:08:59.533241 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:59.543224 30618 raft_consensus.cc:2393] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 6: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:08:59.543035   496 consensus_queue.cc:1048] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:08:59.544039 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:59.549440 30618 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:59.546458 31143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 570) took 1078 ms. Trace:
I20260709 13:08:59.547644 30517 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:59.550590 31143 rpcz_store.cc:276] 0709 13:08:58.467797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.470592 (+  2795us) service_pool.cc:224] Handling call
0709 13:08:59.546298 (+1075706us) spinlock_profiling.cc:243] Waited 487 ms on lock 0x7b54005afad4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:08:59.546394 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1119204736}
I20260709 13:08:59.544409 31150 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:08:59.558130 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:59.559228 30469 raft_consensus.cc:2410] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:08:59.531971   500 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:59.560401 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:59.561539   500 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:59.561779 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:59.504141   499 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:59.562760 30467 raft_consensus.cc:2393] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 3: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:59.547885   335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:36118 (request call id 80) took 4696 ms. Trace:
I20260709 13:08:59.564069 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:59.565120 30470 raft_consensus.cc:2393] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 7: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:59.564208   335 rpcz_store.cc:276] 0709 13:08:54.850744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:55.085695 (+234951us) service_pool.cc:224] Handling call
0709 13:08:55.162227 (+ 76532us) log.cc:844] Serialized 494 byte log entry
0709 13:08:59.547485 (+4385258us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":185,"mutex_wait_us":100646,"raft.queue_time_us":105858,"raft.run_cpu_time_us":988,"raft.run_wall_time_us":1040,"thread_start_us":75065,"threads_started":1,"wal-append.queue_time_us":183156,"wal-append.run_cpu_time_us":1678,"wal-append.run_wall_time_us":1003992}
I20260709 13:08:59.566079 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:59.566821 30476 raft_consensus.cc:2468] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
I20260709 13:08:59.433873   478 raft_consensus.cc:515] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:59.567981 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:59.568701   502 raft_consensus.cc:2749] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:59.563706 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:59.569764   478 leader_election.cc:290] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:59.569540   502 consensus_queue.cc:1059] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:59.571179   502 raft_consensus.cc:3055] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:59.522965   360 consensus_queue.cc:260] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:59.571516   502 raft_consensus.cc:740] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:59.572777   502 consensus_queue.cc:260] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:59.573927   502 raft_consensus.cc:3060] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:59.566875   461 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:59.568747 30473 raft_consensus.cc:2468] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 3.
I20260709 13:08:59.546202 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:59.579450 30617 raft_consensus.cc:2393] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 5: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:08:59.580188 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:59.581156 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:59.582151 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:59.545374   496 consensus_queue.cc:1059] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:08:59.582757 30360 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1560cc6404764454b2843cec97934e6b with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:59.583252 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:59.583385 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:59.583582   439 raft_consensus.cc:515] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:59.583796 30617 raft_consensus.cc:3060] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:59.584609 30473 raft_consensus.cc:2410] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:08:59.548715 31116 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:08:59.586361   439 leader_election.cc:290] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:59.588188   485 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:59.590618   500 consensus_queue.cc:1048] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:59.592136   478 raft_consensus.cc:2804] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:59.592517   478 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.592862   478 raft_consensus.cc:3060] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:59.594868   450 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:59.596627 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 73295.3us
I20260709 13:08:59.588907   485 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:59.603199   485 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:59.604569 30542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43088 (request call id 1652) took 1007 ms. Trace:
I20260709 13:08:59.604949 30542 rpcz_store.cc:276] 0709 13:08:58.597428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.597600 (+   172us) service_pool.cc:224] Handling call
0709 13:08:59.604391 (+1006791us) spinlock_profiling.cc:243] Waited 393 ms on lock 0x7b54001441d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:08:59.604496 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":904339840}
I20260709 13:08:59.606491   498 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:08:59.608131 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:59.608662 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.610576   447 consensus_queue.cc:1048] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:59.612120 30589 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:59.612752   478 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:59.613555 30589 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:59.614647   478 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:59.615039 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:59.615762 30473 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:08:59.617892   447 consensus_queue.cc:1048] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:59.618269 32750 raft_consensus.cc:2749] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:59.620445   300 raft_consensus.cc:2804] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:59.620874   300 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.621088 31145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48414 (request call id 615) took 2532 ms. Trace:
I20260709 13:08:59.621287   300 raft_consensus.cc:3060] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:59.621542   498 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:08:59.621774   303 consensus_queue.cc:1059] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:08:59.640755 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:59.641510 30472 raft_consensus.cc:2393] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 5: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:59.644176   489 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.644678   489 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:59.621515 31145 rpcz_store.cc:276] 0709 13:08:57.088444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.189506 (+101062us) service_pool.cc:224] Handling call
0709 13:08:57.189912 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:57.929639 (+739727us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:59.620842 (+1691203us) spinlock_profiling.cc:243] Waited 635 ms on lock 0x7b5400780354. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:08:59.621005 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1460732800}
I20260709 13:08:59.634263 30551 raft_consensus.cc:1240] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 3. Current term is 4. Ops: []
W20260709 13:08:59.624248 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.647370 30618 raft_consensus.cc:2468] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 5.
I20260709 13:08:59.660367 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:59.623750 30440 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:08:59.648113 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 49784.3us
I20260709 13:08:59.630502 30617 raft_consensus.cc:2468] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 4.
I20260709 13:08:59.662268 31115 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:08:59.649171 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.663231 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:59.667578 32750 raft_consensus.cc:493] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:59.668354 32750 raft_consensus.cc:515] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:59.666965 31116 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:08:59.670687 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 47039.9us
I20260709 13:08:59.671514 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:59.672353 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:59.676060 30621 raft_consensus.cc:3060] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:59.673302 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:59.674387 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:59.676445 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:59.676050 30473 raft_consensus.cc:2468] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 2.
I20260709 13:08:59.677500 30469 raft_consensus.cc:2393] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 3: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:08:59.679349 30623 raft_consensus.cc:2393] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 3: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:08:59.680230 30618 raft_consensus.cc:2393] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 3: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:08:59.681571 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:59.682452 30618 raft_consensus.cc:2393] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 5: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:08:59.683411 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:59.685612 30471 raft_consensus.cc:1275] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:59.688659 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:59.689652 30472 raft_consensus.cc:2393] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 3: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:59.691617 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:59.658618 32659 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:59.695794 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:59.686864 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:59.699121 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:59.697845 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:59.694828 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:59.701510 30470 raft_consensus.cc:2393] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 7: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:59.704301 30471 raft_consensus.cc:2393] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 3: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:59.704392 30467 raft_consensus.cc:1275] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:59.673717   447 raft_consensus.cc:2804] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:59.674171   487 raft_consensus.cc:2804] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:59.715104 30467 raft_consensus.cc:1240] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:08:59.712241   489 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:59.688089   303 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:08:59.716389   303 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:59.718232 30468 raft_consensus.cc:1275] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:59.718391   303 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:59.694470   478 raft_consensus.cc:2804] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:59.714099   450 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:59.719187 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:59.719928 32659 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:59.720583 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:59.721640 30467 raft_consensus.cc:2393] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 7: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:59.724699 30476 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 6.
I20260709 13:08:59.719940 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:59.725303 30621 raft_consensus.cc:2468] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 6.
I20260709 13:08:59.726318 30517 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:59.727653 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:59.728214 30473 raft_consensus.cc:3060] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:59.730413 30471 raft_consensus.cc:1240] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 3. Current term is 4. Ops: [1.3-3.4]
I20260709 13:08:59.725492 32659 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:59.732733 32750 leader_election.cc:290] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:59.729913 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:59.733932 31115 leader_election.cc:304] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:59.735347 30472 raft_consensus.cc:2468] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 7.
W20260709 13:08:59.742131 30591 leader_election.cc:336] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.875s (SENT)
I20260709 13:08:59.743615 30517 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:59.745150 32648 raft_consensus.cc:2804] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:59.745689 32648 raft_consensus.cc:697] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 6 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:59.727288   447 raft_consensus.cc:697] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:08:59.749413 30624 raft_consensus.cc:1240] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:59.727152   487 raft_consensus.cc:697] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 5 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:59.750689 30624 raft_consensus.cc:1275] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:59.750357   487 consensus_queue.cc:237] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:08:59.757757 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.757668 30517 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:59.748976   447 consensus_queue.cc:237] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:59.765616   445 raft_consensus.cc:2749] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:59.734521   498 raft_consensus.cc:2749] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:59.767210   426 raft_consensus.cc:3055] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:59.767758   426 raft_consensus.cc:740] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:08:59.768846   426 consensus_queue.cc:260] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:08:59.734695   478 raft_consensus.cc:697] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 6 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:08:59.772783   478 consensus_queue.cc:237] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:59.746547 32648 consensus_queue.cc:237] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:59.778070 30616 raft_consensus.cc:1240] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:59.764830   461 raft_consensus.cc:2804] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:59.780617 30517 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:08:59.762701   506 log.cc:927] Time spent T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:08:59.782292 30517 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:59.784106   498 raft_consensus.cc:2804] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:59.784539   498 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:59.784888   498 raft_consensus.cc:3060] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:59.780628 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:59.786360 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:59.786942 30591 leader_election.cc:336] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.599s (SENT)
I20260709 13:08:59.787359 30591 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
W20260709 13:08:59.788731 31114 leader_election.cc:336] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Timed out: RequestConsensusVote RPC to 127.28.173.2:34733 timed out after 1.801s (SENT)
I20260709 13:08:59.789196 31114 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:59.784152 30517 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:08:59.791651 30476 raft_consensus.cc:3060] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:08:59.791402 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:59.794883 30471 raft_consensus.cc:2393] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 4: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:59.770450   426 raft_consensus.cc:3060] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:59.811940 30476 raft_consensus.cc:1275] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:59.795845 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:08:59.816355 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.820358 30441 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:08:59.820866 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:59.821398 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:59.781314   461 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:08:59.821925 30472 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:08:59.823031 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:08:59.823282 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.825421 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:08:59.826325 30476 raft_consensus.cc:2393] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 5: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:08:59.827172 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:59.828975 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:59.823724 30471 raft_consensus.cc:2468] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 2.
I20260709 13:08:59.833150 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:59.794055 32600 raft_consensus.cc:2749] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:59.833895 30471 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
I20260709 13:08:59.807955 32659 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.829532 30467 raft_consensus.cc:2468] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:08:59.806049   463 raft_consensus.cc:2749] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:59.842276 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:59.842867 30468 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
W20260709 13:08:59.845737 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 61677.9us
I20260709 13:08:59.848225 30624 raft_consensus.cc:1240] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:59.828234   461 raft_consensus.cc:3060] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:59.828712 32749 raft_consensus.cc:2749] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:59.830376   445 raft_consensus.cc:2804] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:59.854847 30517 leader_election.cc:304] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:59.856938 30473 raft_consensus.cc:2468] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 6.
W20260709 13:08:59.863951 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.866410 31150 raft_consensus.cc:1240] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:59.867552 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:59.868638 31145 raft_consensus.cc:1240] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 5 LEADER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:59.871281 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:59.871488 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:59.872181   433 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.872653 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:59.872702   433 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:59.864761 32713 raft_consensus.cc:2749] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:59.875113   433 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:08:59.859642 32600 consensus_queue.cc:1048] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:08:59.855827   445 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.877846   445 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:59.883219 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:08:59.884057 30546 raft_consensus.cc:2393] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 6: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:08:59.885360 30517 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:08:59.886790   420 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:59.888863   514 log.cc:927] Time spent T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:08:59.889698 32739 raft_consensus.cc:2804] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:59.890147 32739 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:08:59.890511 32739 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:59.890717 30441 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:59.892130 30441 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:08:59.893091 30441 leader_election.cc:304] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:08:59.894075 30517 leader_election.cc:304] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:08:59.894866 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:59.896690 31116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.888911 30622 raft_consensus.cc:1275] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:59.898540 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:08:59.908809 30472 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:08:59.841951   300 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:59.915721 30620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 372) took 1229 ms. Trace:
I20260709 13:08:59.918135   513 raft_consensus.cc:2749] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:59.918315   425 raft_consensus.cc:3055] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:59.932687 30548 raft_consensus.cc:1275] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:59.918741 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:59.920184 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:59.920785 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:59.921494 31142 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
I20260709 13:08:59.921749 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
W20260709 13:08:59.922161   507 log.cc:927] Time spent T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.101s	user 0.001s	sys 0.001s
W20260709 13:08:59.924209 31115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.921494 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:59.843729 32659 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:59.930781 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:08:59.923592 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:59.933414 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:59.933620 31146 raft_consensus.cc:2468] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
W20260709 13:08:59.936071 31114 leader_election.cc:336] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Timed out: RequestConsensusVote RPC to 127.28.173.2:34733 timed out after 1.745s (SENT)
I20260709 13:08:59.937012 30551 raft_consensus.cc:2468] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:08:59.922194 32575 raft_consensus.cc:3060] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:59.943789 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:59.944443 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:59.941514 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:59.932590   425 raft_consensus.cc:740] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:08:59.955651 31147 raft_consensus.cc:2468] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 5.
I20260709 13:08:59.954280 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:59.960219 30551 raft_consensus.cc:2468] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
I20260709 13:08:59.927636 30620 rpcz_store.cc:276] 0709 13:08:58.686423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.692964 (+  6541us) service_pool.cc:224] Handling call
0709 13:08:58.710081 (+ 17117us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:59.784460 (+1074379us) spinlock_profiling.cc:243] Waited 3.82 ms on lock 0x7b1800274600. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc783b104bc 00007fc780e5e48b 00007fc789cb8ab9 00007fc780e7a69b 00007fc780e7893f 00007fc780e78455 00007fc783f60060 00007fc783f60bfb 00007fc783f6b64b
0709 13:08:59.784578 (+   118us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:59.784603 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:59.785031 (+   428us) log.cc:844] Serialized 26 byte log entry
0709 13:08:59.804229 (+ 19198us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:59.804268 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:59.804356 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:59.899966 (+ 95610us) raft_consensus.cc:1685] finished
0709 13:08:59.899984 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:59.915664 (+ 15680us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7569,"raft.queue_time_us":69001,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":47513,"spinlock_wait_cycles":8788864,"thread_start_us":135533,"threads_started":2,"wal-append.queue_time_us":35118}
I20260709 13:08:59.912480 32600 consensus_queue.cc:1048] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:08:59.939872   455 raft_consensus.cc:2749] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:59.958853 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:08:59.961946 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:59.931526   478 consensus_queue.cc:1059] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:08:59.962106 31148 raft_consensus.cc:2368] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 5. Current term is 6.
W20260709 13:08:59.976692 30625 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57140 (request call id 373) took 1289 ms (client timeout 1522 ms). Trace:
I20260709 13:08:59.977226   445 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:08:59.984158 31114 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:00.018904 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:08:59.984515 30618 raft_consensus.cc:1275] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:59.985548 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:08:59.987607   513 raft_consensus.cc:2764] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:08:59.989171   300 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:59.992172   499 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:59.993784   406 consensus_queue.cc:1059] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:00.036109 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:08:59.996582   420 raft_consensus.cc:2749] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:59.998332 32659 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:08:59.937403   463 consensus_queue.cc:1059] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:08:59.999581 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:00.000154 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.004452   425 consensus_queue.cc:260] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:00.064966   425 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:00.010051 30625 rpcz_store.cc:269] 0709 13:08:58.686813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.687659 (+   846us) service_pool.cc:224] Handling call
0709 13:08:59.976491 (+1288832us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b54001d8b54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:08:59.976615 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":659308928}
I20260709 13:09:00.007226 32739 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:00.013298 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.016721 32750 consensus_queue.cc:1048] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:00.069818 32739 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:00.017874 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:00.071270 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:00.015652 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:00.071913 30542 raft_consensus.cc:3060] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:00.072139 30619 raft_consensus.cc:2468] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:09:00.073366 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:00.020787 30621 raft_consensus.cc:1240] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:00.074118 30545 raft_consensus.cc:2468] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
W20260709 13:09:00.037081 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 53003.8us
I20260709 13:09:00.041087 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:00.075305   406 raft_consensus.cc:3055] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:00.046685 30547 raft_consensus.cc:2393] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 6: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:00.075700   406 raft_consensus.cc:740] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:00.075903 31114 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:00.076593   406 consensus_queue.cc:260] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:00.051038 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:00.077777   406 raft_consensus.cc:3060] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:00.077857 30624 raft_consensus.cc:3060] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:00.078703   468 raft_consensus.cc:2749] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:00.080194 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:00.080354   468 consensus_queue.cc:1048] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:00.086305 30589 leader_election.cc:304] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:00.086139   426 consensus_queue.cc:1048] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:00.087270 30589 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:00.088860 30550 raft_consensus.cc:1275] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:00.048669 30543 raft_consensus.cc:2468] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:09:00.095121 30624 raft_consensus.cc:2468] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:09:00.092012   407 consensus_queue.cc:1048] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:09:00.101910 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 57019.3us
I20260709 13:09:00.104754 30591 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:00.048141   478 raft_consensus.cc:2749] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:00.100203   335 raft_consensus.cc:2764] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:09:00.112591 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:00.107288 31146 raft_consensus.cc:2468] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 7.
I20260709 13:09:00.101951   489 raft_consensus.cc:2804] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:00.100405 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:00.115855 30591 leader_election.cc:304] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
W20260709 13:09:00.116677 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 223645us
I20260709 13:09:00.106580   416 consensus_queue.cc:1048] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:09:00.117493 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
W20260709 13:09:00.123674 30516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.125870 30589 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:00.127197 30516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.131310 30516 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:09:00.134307 30589 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:00.134985 30441 leader_election.cc:400] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Vote denied by peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) with higher term. Message: Invalid argument: T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 5. Current term is 6.
I20260709 13:09:00.135306 30441 leader_election.cc:403] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:00.115331   489 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:00.124547   426 raft_consensus.cc:2804] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:00.142189 30441 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:00.138283 30516 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:00.140682 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:00.143180 31146 raft_consensus.cc:2368] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 3. Current term is 4.
I20260709 13:09:00.124678   420 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.145574   365 raft_consensus.cc:2804] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:00.146126   365 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:00.146612   365 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:00.116956   478 consensus_queue.cc:1048] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:09:00.151419 30591 leader_election.cc:400] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 2 election: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 2. Current term is 3.
W20260709 13:09:00.176239 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.139017   471 raft_consensus.cc:2804] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:00.139496   489 raft_consensus.cc:3060] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:00.153165 30623 raft_consensus.cc:1275] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:00.139612   428 raft_consensus.cc:2804] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:00.127976   498 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:00.196897 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:00.197585 30624 raft_consensus.cc:2368] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 4. Current term is 5.
I20260709 13:09:00.194856 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:00.143448   300 raft_consensus.cc:2749] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:09:00.187673 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 49499.9us
I20260709 13:09:00.144357   303 consensus_queue.cc:1048] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
W20260709 13:09:00.201687 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 51320.9us
I20260709 13:09:00.142666   426 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:00.202402 30591 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:00.217511   498 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:00.218353 30546 raft_consensus.cc:1240] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:00.191535 32750 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.221351 32750 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:00.213292 32659 raft_consensus.cc:2804] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:00.224684 32659 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:00.212677   455 consensus_queue.cc:1059] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:09:00.225124 32659 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:00.153548   524 raft_consensus.cc:2749] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) with higher term. Message: Invalid argument: T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 5. Current term is 6.
W20260709 13:09:00.244141 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 102003us
I20260709 13:09:00.199023   471 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:00.232369 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:00.148615   420 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:00.201407   447 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.223568 32750 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:00.246474 30591 leader_election.cc:400] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 election: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 4. Current term is 5.
I20260709 13:09:00.208844   426 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:00.243561 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:00.248426   471 raft_consensus.cc:3060] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:00.317762 31147 raft_consensus.cc:2468] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
I20260709 13:09:00.211360   517 raft_consensus.cc:2749] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:00.332252 30441 leader_election.cc:304] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:00.332408 31146 raft_consensus.cc:2468] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
I20260709 13:09:00.212791   355 raft_consensus.cc:2749] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 7 LEADER]: Leader election lost for term 6. Reason: Vote denied by peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) with higher term. Message: Invalid argument: T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 6. Current term is 7.
W20260709 13:09:00.333199 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 86869us
I20260709 13:09:00.334298 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:00.353344 30591 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:00.213800   461 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:00.354880 31144 raft_consensus.cc:2468] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 5.
I20260709 13:09:00.357682   427 raft_consensus.cc:2804] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:00.358071   427 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:00.359104 30441 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:00.248662   303 consensus_queue.cc:1048] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.096s
I20260709 13:09:00.364920 30591 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:00.365645 30441 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:00.365872 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:00.366472 31147 raft_consensus.cc:3060] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:00.363224 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:00.364063 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 163576us
I20260709 13:09:00.374909 30548 raft_consensus.cc:1275] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:00.379907   498 consensus_queue.cc:1048] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:00.380607 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:00.381238 31143 raft_consensus.cc:2468] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:09:00.384460 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:00.362031   427 raft_consensus.cc:3060] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:00.392656   500 consensus_queue.cc:1059] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:00.397051 31147 raft_consensus.cc:2468] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:09:00.320325   447 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:00.337260   428 raft_consensus.cc:697] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 6 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:00.408818   445 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:00.406455   531 raft_consensus.cc:2749] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:00.413127 30516 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:00.414510 30516 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:00.415907   445 consensus_queue.cc:1048] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:00.416471 31144 raft_consensus.cc:1240] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:09:00.417162   445 raft_consensus.cc:2764] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:09:00.417830   445 raft_consensus.cc:2804] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:00.418232   445 raft_consensus.cc:697] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:00.419044   445 consensus_queue.cc:237] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:00.421362   500 consensus_queue.cc:1048] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:00.428375   517 raft_consensus.cc:2749] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:09:00.429665   527 log.cc:927] Time spent T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:09:00.430430 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:00.431726   420 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:00.432935 30547 raft_consensus.cc:1275] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:00.435350 32648 raft_consensus.cc:3055] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:00.435860 32648 raft_consensus.cc:740] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:00.436945 32648 consensus_queue.cc:260] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:00.438403 32648 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:00.451048   471 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:00.441428   455 raft_consensus.cc:2749] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:00.444164 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:00.467363 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:00.468412 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:00.469035 31150 raft_consensus.cc:2393] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 4: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:00.446878 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:00.372418 31148 raft_consensus.cc:2468] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
I20260709 13:09:00.469950 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:00.448975 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:00.471006   335 consensus_queue.cc:1059] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:00.407090 32575 raft_consensus.cc:2749] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:00.452661 30619 raft_consensus.cc:1275] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:00.470517 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:00.440894   447 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:00.451666 30621 raft_consensus.cc:1275] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:09:00.473930   353 consensus_queue.cc:1048] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:00.474794 30550 raft_consensus.cc:1240] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:00.481357   418 consensus_queue.cc:1048] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:00.482592   471 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:00.483969   471 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:00.484522   471 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:00.440892   461 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:00.454973   426 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:00.457142 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:00.458931 30542 raft_consensus.cc:2468] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:09:00.459724 30544 raft_consensus.cc:2468] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 7.
I20260709 13:09:00.460217 32659 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:00.461090   428 consensus_queue.cc:237] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:00.427678   427 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:00.463101   365 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:00.403512 32750 raft_consensus.cc:2749] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:00.464757   489 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:00.465801   532 consensus_queue.cc:1048] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:00.413244   485 raft_consensus.cc:3055] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:00.472025   335 raft_consensus.cc:3055] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:00.450680 30617 raft_consensus.cc:1275] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:09:00.537973 30617 pending_rounds.cc:85] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79: Aborting all ops after (but not including) 5
I20260709 13:09:00.538295 30617 pending_rounds.cc:107] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:09:00.538610 30617 raft_consensus.cc:2889] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:00.472877 31150 raft_consensus.cc:2393] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 7: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:00.485282   528 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:00.453613 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.486443 31149 raft_consensus.cc:1240] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 5. Current term is 7. Ops: []
W20260709 13:09:00.492161 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:00.520243 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 154651us
I20260709 13:09:00.528309 31144 raft_consensus.cc:2468] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
I20260709 13:09:00.535385 30440 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:00.514173   476 raft_consensus.cc:2764] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:09:00.543416 30623 raft_consensus.cc:1240] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:00.541648 30441 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:00.550283 30589 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:00.550702 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:00.551352 30551 raft_consensus.cc:3060] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:00.555838   303 raft_consensus.cc:2804] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:00.556383   303 raft_consensus.cc:697] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:00.556874 32575 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.557632 32713 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.557319   303 consensus_queue.cc:237] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:00.558115 32713 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:00.557343 32575 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:00.565492 32659 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:00.568090   524 raft_consensus.cc:3055] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:00.568478   455 raft_consensus.cc:2804] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:00.568567   524 raft_consensus.cc:740] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:00.580034 30441 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:00.536465   485 raft_consensus.cc:740] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:00.537757   335 raft_consensus.cc:740] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:00.583432 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:00.588662 30551 raft_consensus.cc:2468] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
I20260709 13:09:00.584903   450 raft_consensus.cc:2749] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:00.579681   455 raft_consensus.cc:697] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 7 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:00.577350   345 consensus_queue.cc:1048] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:09:00.591039   455 consensus_queue.cc:237] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:00.593695   427 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:00.547421   528 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:00.587564 32648 consensus_queue.cc:1059] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:09:00.596051 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:00.596648 32648 raft_consensus.cc:3055] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:00.596995 32648 raft_consensus.cc:740] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:00.597189   528 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:00.598034 32648 consensus_queue.cc:260] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:00.599067 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:00.599392 32648 raft_consensus.cc:3060] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:00.578106   533 raft_consensus.cc:2749] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:00.600979   489 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:00.602918   335 consensus_queue.cc:260] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:00.604080   335 raft_consensus.cc:3060] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:00.609396 31115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.610338 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:00.610976 30550 raft_consensus.cc:3060] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:00.612739 30549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 1421) took 1762 ms. Trace:
W20260709 13:09:00.614543 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:00.620997 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 205530us
I20260709 13:09:00.623062 30516 leader_election.cc:400] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Vote denied by peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) with higher term. Message: Invalid argument: T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 4. Current term is 5.
I20260709 13:09:00.613204 30549 rpcz_store.cc:276] 0709 13:08:58.851290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.851458 (+   168us) service_pool.cc:224] Handling call
0709 13:08:58.903663 (+ 52205us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:58.904103 (+   440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:58.904144 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:58.911916 (+  7772us) log.cc:844] Serialized 26 byte log entry
0709 13:08:59.548390 (+636474us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b18004076e0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e5de07 00007fc789cb8ab9 00007fc780e7a69b 00007fc780e7893f 00007fc780e7ac02 00007fc783b0220b 00007fc783b07d23 00007fc783b080d1 00007fc783f23a0f
0709 13:08:59.703408 (+155018us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:59.703457 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:59.703524 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:59.921491 (+217967us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:09:00.605888 (+684397us) spinlock_profiling.cc:243] Waited 51.1 ms on lock 0x7b24002650e8. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780d019c4 00007fc780cffacb 00007fc780ebadc9 00007fc780ebaa55 00007fc780eb9fb0 00007fc783b30488 00007fc783b30be8 00007fc783b08398 00007fc783b0376a 00007fc783b02bb6
0709 13:09:00.612459 (+  6571us) raft_consensus.cc:1685] finished
0709 13:09:00.612488 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:00.612653 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1924,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":5098,"spinlock_wait_cycles":155933568,"thread_start_us":154765,"threads_started":1,"wal-append.queue_time_us":908180}
I20260709 13:09:00.623415 30516 leader_election.cc:403] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:00.569679   524 consensus_queue.cc:260] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:00.629141 30516 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:00.630841   470 raft_consensus.cc:2804] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:00.631242   470 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:00.638024 30470 raft_consensus.cc:1275] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:09:00.638319 30475 raft_consensus.cc:1275] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:09:00.640823 30472 raft_consensus.cc:1275] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:09:00.641091 30516 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:00.642683 30623 raft_consensus.cc:1240] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:00.631595   470 raft_consensus.cc:3060] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:00.648437 30441 leader_election.cc:304] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:00.667133 32575 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:00.668056 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:00.623721   489 raft_consensus.cc:493] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
W20260709 13:09:00.669710 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.671669 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:00.672456 31150 raft_consensus.cc:3060] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:00.647843   445 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:09:00.698886 31150 raft_consensus.cc:2468] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
W20260709 13:09:00.701067 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 60055.4us
I20260709 13:09:00.702042 30590 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:00.702486 30372 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47208 (request call id 185) took 11889 ms (client timeout 15000 ms). Trace:
I20260709 13:09:00.705940 30546 raft_consensus.cc:1275] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:09:00.720423 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 131786us
I20260709 13:09:00.721360 30441 leader_election.cc:304] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:00.718096 30550 raft_consensus.cc:2468] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
W20260709 13:09:00.723624 30517 leader_election.cc:336] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.807s (SENT)
I20260709 13:09:00.724079 30517 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:00.726981 30371 catalog_manager.cc:5697] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 3 to 4, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 4 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:00.732612 30371 catalog_manager.cc:5697] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 2 to 3, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 3 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:00.734845 30371 catalog_manager.cc:5697] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 4 to 5, leader changed from cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 5 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:00.736931 31116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.723064   528 raft_consensus.cc:2804] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:00.740454   528 raft_consensus.cc:697] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:00.741291   528 consensus_queue.cc:237] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:00.683008   532 consensus_queue.cc:1059] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.069s
I20260709 13:09:00.752770   532 raft_consensus.cc:3055] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:00.753146   532 raft_consensus.cc:740] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:00.754015   532 consensus_queue.cc:260] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:00.755213   532 raft_consensus.cc:3060] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:00.778116 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 54520.3us
W20260709 13:09:00.781057 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 78735.3us
I20260709 13:09:00.782693 30516 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:00.783034 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 61754.1us
I20260709 13:09:00.784135 30441 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:00.789091 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:00.789799 31146 raft_consensus.cc:2468] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 3.
I20260709 13:09:00.699316 32739 raft_consensus.cc:2804] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:00.801033 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:00.804036 31150 raft_consensus.cc:2393] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 6: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:00.703631   524 raft_consensus.cc:3060] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:00.722371   530 raft_consensus.cc:2804] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:00.804842 30441 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:00.671043 32749 consensus_queue.cc:1059] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.114s
I20260709 13:09:00.806689 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:00.777634   427 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.831118 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:00.831662 30441 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:00.685184   416 consensus_queue.cc:1048] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.118s
I20260709 13:09:00.683641   490 consensus_queue.cc:1048] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.123s
I20260709 13:09:00.704809   353 consensus_queue.cc:1048] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.108s
I20260709 13:09:00.840082 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:00.700304   489 raft_consensus.cc:515] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:00.702996 30372 rpcz_store.cc:269] 0709 13:08:48.794800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.795114 (+   314us) service_pool.cc:224] Handling call
0709 13:09:00.684342 (+11889228us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:58.288786 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:58.291129 (+  2343us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:58.291179 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:08:58.291210 (+    31us) tablet.cc:662] Decoding operations
0709 13:08:58.292188 (+   978us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:58.292268 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:58.292314 (+    46us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:08:58.293054 (+   740us) tablet.cc:701] Row locks acquired
0709 13:08:58.293081 (+    27us) write_op.cc:260] PREPARE: finished
0709 13:08:58.293270 (+   189us) write_op.cc:270] Start()
0709 13:08:58.293418 (+   148us) write_op.cc:276] Timestamp: P: 1783602538293202 usec, L: 0
0709 13:08:58.293448 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:08:58.448013 (+154565us) log.cc:844] Serialized 2112 byte log entry
0709 13:08:59.048150 (+600137us) op_driver.cc:464] REPLICATION: finished
0709 13:08:59.375120 (+326970us) write_op.cc:301] APPLY: starting
0709 13:08:59.392809 (+ 17689us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:59.433399 (+ 40590us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:59.440829 (+  7430us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:59.514439 (+ 73610us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:59.524115 (+  9676us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:08:59.528022 (+  3907us) write_op.cc:312] APPLY: finished
0709 13:08:59.528295 (+   273us) log.cc:844] Serialized 47 byte log entry
0709 13:08:59.528465 (+   170us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:59.528573 (+   108us) write_op.cc:454] Released schema lock
0709 13:08:59.528618 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:59.529024 (+   406us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:59.529055 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":111156,"reported_tablets":22,"child_traces":[["op",{"apply.queue_time_us":299707,"apply.run_cpu_time_us":3630,"apply.run_wall_time_us":160729,"num_ops":5,"prepare.queue_time_us":137684,"prepare.run_cpu_time_us":24759,"prepare.run_wall_time_us":259278,"raft.queue_time_us":235294,"raft.run_cpu_time_us":28832,"raft.run_wall_time_us":187963,"replication_time_us":751691,"thread_start_us":388848,"threads_started":4,"wal-append.queue_time_us":120205,"wal-append.run_cpu_time_us":14557,"wal-append.run_wall_time_us":1959916}]]}
I20260709 13:09:00.794981   529 raft_consensus.cc:2749] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:00.848930 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:00.856424 30549 raft_consensus.cc:3060] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:00.680892   485 consensus_queue.cc:260] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:00.807582   426 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:00.852720 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
W20260709 13:09:00.853063 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 106565us
I20260709 13:09:00.799036   535 raft_consensus.cc:2749] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:00.830644   450 raft_consensus.cc:2749] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:00.837561   530 raft_consensus.cc:697] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 5 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:00.806429   537 raft_consensus.cc:2749] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:00.873912 30441 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:00.842311   471 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:00.850905 32749 raft_consensus.cc:3055] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:00.843773 32739 raft_consensus.cc:697] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 4 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:00.843340   427 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:00.846194   497 raft_consensus.cc:2749] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:00.892676 30551 raft_consensus.cc:2393] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 6: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:00.893599 31143 raft_consensus.cc:1240] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:00.864207   513 raft_consensus.cc:2749] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:00.911386 31114 leader_election.cc:304] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:00.929366 31114 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:00.903160 32749 raft_consensus.cc:740] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:00.909559   485 raft_consensus.cc:3060] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:00.864714   365 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:00.918648 30441 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:00.914335   535 raft_consensus.cc:2749] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:09:00.942881 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:00.941156 30589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.945290 30516 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:00.948827 30589 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:00.956668 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:00.957373 30623 raft_consensus.cc:2393] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 6: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:00.954612 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:09:00.971149   538 log.cc:927] Time spent T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:09:00.951236   355 raft_consensus.cc:2749] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:00.951093   531 raft_consensus.cc:2749] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:00.955986   354 raft_consensus.cc:2749] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:00.983783 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:00.989302   427 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:00.989859   489 leader_election.cc:290] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:00.979311 32739 consensus_queue.cc:237] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:00.960000   335 raft_consensus.cc:2804] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:01.027930 30616 raft_consensus.cc:1240] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:09:01.052098 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.001181   365 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.025010   499 raft_consensus.cc:2804] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:00.999989 32749 consensus_queue.cc:260] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:01.065358   539 log.cc:927] Time spent T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 13:09:00.954080 30441 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:01.036190   335 raft_consensus.cc:697] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:01.065007   365 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:01.097805 31115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.116802 30549 raft_consensus.cc:2468] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 4.
I20260709 13:09:01.009867 30621 raft_consensus.cc:2468] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
W20260709 13:09:01.119110 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 339476us
W20260709 13:09:01.121946 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:01.131374 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.142035 31114 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:09:01.000669   530 consensus_queue.cc:237] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:01.145268 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:01.149322 30621 raft_consensus.cc:2468] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 6.
I20260709 13:09:01.155885 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:01.140688   470 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:01.166608   470 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:01.170326   360 raft_consensus.cc:3060] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:01.172075 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:01.142278 32749 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:01.172935 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:01.173555 30542 raft_consensus.cc:1240] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:09:01.173672 31147 raft_consensus.cc:2393] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 3: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:01.175112 30542 raft_consensus.cc:1240] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:09:01.144411   513 raft_consensus.cc:2749] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:01.194343   557 log.cc:927] Time spent T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 13:09:01.200196   544 log.cc:927] Time spent T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
I20260709 13:09:01.201341   335 consensus_queue.cc:237] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:01.134138 32600 raft_consensus.cc:493] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:01.220520 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 266590us
I20260709 13:09:01.221356 30441 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:01.215831 31114 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:01.226715 30543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 1444) took 1084 ms. Trace:
I20260709 13:09:01.228067 32713 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:01.227195 30543 rpcz_store.cc:276] 0709 13:09:00.142795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.146236 (+  3441us) service_pool.cc:224] Handling call
0709 13:09:00.146587 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:00.191900 (+ 45313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:00.191932 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:00.450975 (+259043us) spinlock_profiling.cc:243] Waited 2.38 ms on lock 0x7b2c000f5468. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc782861a11 00007fc782871372 00007fc783fa3a01 00007fc783f6843a 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2
0709 13:09:00.451390 (+   415us) log.cc:844] Serialized 26 byte log entry
0709 13:09:00.644705 (+193315us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:00.644739 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:00.644805 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:01.224213 (+579408us) raft_consensus.cc:1685] finished
0709 13:09:01.224233 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:01.226647 (+  2414us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44926,"raft.queue_time_us":45354,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":6980,"spinlock_wait_cycles":5464832,"thread_start_us":192923,"threads_started":1,"wal-append.queue_time_us":358287}
I20260709 13:09:01.158972   416 raft_consensus.cc:2804] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:01.239449 30617 raft_consensus.cc:1240] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:01.241478 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:01.242853 30441 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:01.249580 30617 raft_consensus.cc:1240] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:01.236860   345 raft_consensus.cc:2749] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:01.245261   531 raft_consensus.cc:2749] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:01.249236   416 raft_consensus.cc:697] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:01.229987 32600 raft_consensus.cc:515] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:01.254838   426 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
W20260709 13:09:01.327950 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.328660 30623 raft_consensus.cc:1275] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
W20260709 13:09:01.336445   532 consensus_meta.cc:287] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.581s	user 0.011s	sys 0.004s
W20260709 13:09:01.338119   546 log.cc:927] Time spent T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:09:01.353861 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:01.354090 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:01.354368 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:01.355055 31149 raft_consensus.cc:2393] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 3: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:01.355667 31150 raft_consensus.cc:1275] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:01.363965 32756 raft_consensus.cc:2749] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:01.365197 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:01.366209   499 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:01.366787   499 raft_consensus.cc:3060] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:01.371587 31148 raft_consensus.cc:1275] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:01.322190   365 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:01.381829 31145 raft_consensus.cc:2468] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:09:01.382747 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:01.383612 31148 raft_consensus.cc:2468] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:09:01.411397 31144 raft_consensus.cc:2468] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
W20260709 13:09:01.415923 30547 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.000s	sys 0.030s
W20260709 13:09:01.416250 30547 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.000s	sys 0.030s
W20260709 13:09:01.425784 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 151710us
I20260709 13:09:01.426697 30441 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:01.435564 30621 raft_consensus.cc:1275] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:01.436192 30441 leader_election.cc:304] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:01.423442   455 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.326634   426 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:01.424970   461 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:01.436141   445 consensus_meta.cc:287] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.710s	user 0.007s	sys 0.004s
I20260709 13:09:01.468016   445 raft_consensus.cc:2749] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) with higher term. Message: Invalid argument: T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 4. Current term is 5.
I20260709 13:09:01.401157   532 consensus_queue.cc:1048] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:09:01.397085   497 consensus_queue.cc:1048] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:09:01.431870 32540 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.424304   406 consensus_queue.cc:1048] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:09:01.449772 32756 raft_consensus.cc:2749] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:01.439862   558 log.cc:927] Time spent T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.243s	user 0.003s	sys 0.000s
W20260709 13:09:01.500298 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.424710   489 consensus_queue.cc:1048] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
W20260709 13:09:01.504673 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.462278   533 raft_consensus.cc:2749] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:01.489275 32540 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:01.509368 30590 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:01.509598   485 consensus_meta.cc:287] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.565s	user 0.010s	sys 0.000s
I20260709 13:09:01.533473 30590 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:01.548432 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:01.568553 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 97997.9us
I20260709 13:09:01.569555 30441 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:01.475469   461 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:01.518774   426 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:01.525084   420 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.470316   455 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:01.576471 30616 raft_consensus.cc:1275] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:01.577903   455 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:01.565915   427 raft_consensus.cc:2804] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:01.575547   420 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:01.579846   559 log.cc:927] Time spent T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.438s	user 0.001s	sys 0.007s
I20260709 13:09:01.580535 30516 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:01.581653 30591 leader_election.cc:336] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.840s (SENT)
I20260709 13:09:01.582111 30591 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:01.545809   489 raft_consensus.cc:2804] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:01.582576 30546 raft_consensus.cc:2468] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 5.
I20260709 13:09:01.639060 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:01.647109 30543 raft_consensus.cc:2468] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:09:01.626351   426 raft_consensus.cc:493] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.633396   406 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.631664 30550 raft_consensus.cc:1275] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:09:01.630861   565 log.cc:927] Time spent T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:09:01.636274 32600 leader_election.cc:290] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:01.640458 30545 raft_consensus.cc:1275] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:09:01.629619   563 log.cc:927] Time spent T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:09:01.588193   500 raft_consensus.cc:2749] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:01.583842 30516 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:01.670171 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 86444.5us
I20260709 13:09:01.671063 30516 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:01.581341   537 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:01.626327 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:01.624804 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:01.591001 30441 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:01.470611   416 consensus_queue.cc:237] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:01.588714 32756 raft_consensus.cc:2749] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:01.591568 32713 consensus_queue.cc:1059] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:01.587563   524 consensus_meta.cc:287] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.776s	user 0.001s	sys 0.009s
I20260709 13:09:01.583668   427 raft_consensus.cc:697] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:01.594713 30544 raft_consensus.cc:1240] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:01.584805   489 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:01.680135 30616 raft_consensus.cc:1275] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:09:01.685860 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 94923.4us
I20260709 13:09:01.686828 30441 leader_election.cc:304] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:01.729115 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:01.735438 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.671339   528 raft_consensus.cc:2749] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:01.681296 32600 raft_consensus.cc:2804] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:01.763465   353 consensus_queue.cc:1048] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:09:01.682114   425 raft_consensus.cc:2804] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:01.770609   414 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.773573 30551 raft_consensus.cc:1275] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:09:01.778090   562 log.cc:927] Time spent T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.270s	user 0.001s	sys 0.000s
W20260709 13:09:01.780030 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 93290.2us
I20260709 13:09:01.785102 30589 leader_election.cc:304] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:01.787305   497 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:01.790481 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 104243us
I20260709 13:09:01.836474 30441 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:01.667536   426 raft_consensus.cc:515] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:01.792862 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:09:01.840590 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 55574.9us
I20260709 13:09:01.667922   406 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:01.683135   455 raft_consensus.cc:2749] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:01.690133   489 raft_consensus.cc:3060] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:01.802582   580 raft_consensus.cc:493] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.798272 32749 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.742055   303 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:01.841163   543 log.cc:927] Time spent T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:09:01.805440   414 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:01.808614   528 consensus_queue.cc:1048] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:01.841970   471 raft_consensus.cc:2749] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:01.812595   420 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:01.799121 32713 consensus_queue.cc:1048] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:09:01.683226   335 consensus_queue.cc:1048] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.109s
I20260709 13:09:01.821519 30551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 480) took 1013 ms. Trace:
I20260709 13:09:01.876602 30551 rpcz_store.cc:276] 0709 13:09:00.807952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.260925 (+452973us) service_pool.cc:224] Handling call
0709 13:09:01.773230 (+512305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:01.799507 (+ 26277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.821249 (+ 21742us) spinlock_profiling.cc:243] Waited 511 ms on lock 0x7b5400339ad0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f678ad 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:01.821441 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1176192896}
I20260709 13:09:01.734441   360 consensus_queue.cc:1059] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.094s
W20260709 13:09:01.793154   530 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.011s	sys 0.029s
I20260709 13:09:01.794554   524 raft_consensus.cc:2749] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:01.683084   537 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:01.892056   414 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:01.863756 32749 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:01.893466   537 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:01.893981 32749 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:09:01.894575 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 58218.5us
I20260709 13:09:01.734297   445 consensus_queue.cc:1059] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.107s
I20260709 13:09:01.895454 30441 leader_election.cc:400] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Vote denied by peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453) with higher term. Message: Invalid argument: T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 5. Current term is 6.
I20260709 13:09:01.896039   445 raft_consensus.cc:3055] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:01.896447   445 raft_consensus.cc:740] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:01.896479 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:01.799072   425 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:01.799858 32540 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:01.810894   427 consensus_queue.cc:237] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:01.850553   532 raft_consensus.cc:2749] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:01.865792 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 339314us
W20260709 13:09:01.866359 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 299255us
I20260709 13:09:01.867421 30542 raft_consensus.cc:1275] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:09:01.858668   461 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:01.850274   500 consensus_queue.cc:1048] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:09:01.861325   580 raft_consensus.cc:515] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:01.861584   303 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:01.883982   360 consensus_queue.cc:1048] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:01.885481 32713 raft_consensus.cc:3055] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:01.951634 32713 raft_consensus.cc:740] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:01.952531   303 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:01.952570 32713 consensus_queue.cc:260] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:01.850409   497 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:01.953939 32713 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:01.955659   497 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:01.956053 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 117860us
I20260709 13:09:01.888212   426 leader_election.cc:290] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:01.889010   402 raft_consensus.cc:3055] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:01.896522 30441 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:01.959175   402 raft_consensus.cc:740] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:01.959338 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:09:01.959791 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 63343.2us
I20260709 13:09:01.960180 31145 raft_consensus.cc:2468] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:09:01.960116   402 consensus_queue.cc:260] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:01.961541   524 raft_consensus.cc:2749] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:01.960526 30441 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:01.962387   580 leader_election.cc:290] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133)
I20260709 13:09:01.963017   497 raft_consensus.cc:2804] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:01.963668   497 raft_consensus.cc:697] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 7 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:01.963913 30441 leader_election.cc:400] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Vote denied by peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453) with higher term. Message: Invalid argument: T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 3. Current term is 4.
I20260709 13:09:01.964720 30441 leader_election.cc:304] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:01.897194 30619 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 5.
I20260709 13:09:01.964538   497 consensus_queue.cc:237] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:01.966298 31115 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:01.966959   360 raft_consensus.cc:493] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.966322   455 raft_consensus.cc:2749] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:01.967485   360 raft_consensus.cc:515] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:01.961408   402 raft_consensus.cc:3060] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:01.968520   345 raft_consensus.cc:2804] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:01.969002   345 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:01.969444   345 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:01.969946   360 leader_election.cc:290] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:01.971532 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:01.972270 31145 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
W20260709 13:09:01.974064 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 123098us
W20260709 13:09:01.978068 30516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:01.981952 30516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.982712 30542 raft_consensus.cc:1275] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:01.985716 30441 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:01.897444   530 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.011s	sys 0.030s
I20260709 13:09:01.921700 32749 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.005218 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:02.009720 30516 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:01.922273   425 raft_consensus.cc:3060] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:02.010929 30591 leader_election.cc:336] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.135s (SENT)
W20260709 13:09:02.011760 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 155498us
I20260709 13:09:02.013633 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:02.010303 30441 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:02.014277 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:02.017411 30547 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 6.
I20260709 13:09:01.944656   335 raft_consensus.cc:493] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.985545   455 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.020732 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:02.022686 30545 raft_consensus.cc:2468] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 7.
I20260709 13:09:02.022778 30591 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:01.985056 32600 raft_consensus.cc:697] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:02.023658 30542 raft_consensus.cc:1275] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:02.000370   524 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
W20260709 13:09:02.022192 30517 leader_election.cc:336] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.247s (SENT)
I20260709 13:09:02.039055 30440 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:09:02.021034   499 consensus_meta.cc:287] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.653s	user 0.013s	sys 0.000s
I20260709 13:09:02.016556   532 raft_consensus.cc:2804] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:02.024703 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:02.047853 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:02.050732 30547 raft_consensus.cc:2468] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
I20260709 13:09:02.052111 30546 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 6.
I20260709 13:09:02.056039 30517 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:02.056195 31144 raft_consensus.cc:1275] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:02.058246 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:02.058880 30547 raft_consensus.cc:2468] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
W20260709 13:09:02.062021 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.026787 32540 raft_consensus.cc:2804] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:02.070534 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:02.073731 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:02.074617 30616 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 6.
W20260709 13:09:02.085124 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 46141.4us
I20260709 13:09:02.089366 30619 raft_consensus.cc:1275] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:09:02.089552 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 78647.5us
W20260709 13:09:02.090312 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.091563 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:02.092338 30545 raft_consensus.cc:2468] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
I20260709 13:09:02.040810   535 raft_consensus.cc:2804] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:02.048571 30544 raft_consensus.cc:1240] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:09:02.081157 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:02.013409 32749 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:02.098106 30617 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 6.
I20260709 13:09:02.099771 31114 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:02.035528   485 consensus_queue.cc:1059] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:09:02.027104   335 raft_consensus.cc:515] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:02.065759 31145 raft_consensus.cc:1275] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:02.037101   455 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:02.066879 32540 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:02.046412 32756 consensus_queue.cc:1048] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:09:02.041633   524 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:02.139104 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 110845us
I20260709 13:09:02.057371   499 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:02.025230   445 consensus_queue.cc:260] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:02.150065 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 56935.7us
I20260709 13:09:02.156796 30591 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:02.100953   533 raft_consensus.cc:2804] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:02.153013 30616 raft_consensus.cc:1275] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:02.154765 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:02.134966   555 raft_consensus.cc:2804] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:02.095170 32559 consensus_queue.cc:1048] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:09:02.136046   528 raft_consensus.cc:3055] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:02.160570 30543 raft_consensus.cc:2376] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 5. Re-sending same reply.
I20260709 13:09:02.135156   426 raft_consensus.cc:2749] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:02.131203   535 raft_consensus.cc:697] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
W20260709 13:09:02.161850 30589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.163091 30591 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:02.137960   500 raft_consensus.cc:2749] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:02.150753 32540 raft_consensus.cc:3060] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:02.164300 30549 raft_consensus.cc:1240] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:02.150902   530 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:09:02.157130   569 log.cc:927] Time spent T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.474s	user 0.001s	sys 0.003s
I20260709 13:09:02.131273   596 consensus_queue.cc:1048] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:09:02.164270   555 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:02.187384   587 log.cc:927] Time spent T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.163s	user 0.001s	sys 0.001s
I20260709 13:09:02.183696   406 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:02.161399   533 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:02.168138   528 raft_consensus.cc:740] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:02.167701   303 raft_consensus.cc:2749] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:02.211199   589 log.cc:927] Time spent T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:09:02.211910   535 consensus_queue.cc:237] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:02.170773   597 consensus_queue.cc:1048] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:09:02.216038 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:09:02.217248   585 log.cc:927] Time spent T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:09:02.138116 32600 consensus_queue.cc:237] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:02.172088   497 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.230077 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:02.230475 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:02.230800 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:02.335589 30624 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:09:02.235673 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:02.336822 30619 raft_consensus.cc:2468] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
I20260709 13:09:02.236631 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:09:02.243854   599 log.cc:927] Time spent T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:09:02.221048   555 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:02.227451   533 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:02.204069   530 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:02.342020 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:02.253194   503 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.246831   425 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:02.353466 30589 leader_election.cc:304] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:02.354625 30516 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:02.355796 30516 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:02.345731   588 log.cc:927] Time spent T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.285s	user 0.001s	sys 0.000s
I20260709 13:09:02.338207 30625 raft_consensus.cc:2468] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 6.
I20260709 13:09:02.334497 30616 raft_consensus.cc:2468] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
I20260709 13:09:02.227952   406 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.342876 30624 raft_consensus.cc:2468] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:09:02.254583   601 consensus_queue.cc:1048] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.093s
I20260709 13:09:02.226171   426 raft_consensus.cc:2804] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:02.344000   497 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:02.375854 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:02.372720 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 209727us
I20260709 13:09:02.379411 30551 raft_consensus.cc:1240] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:09:02.382915 30624 raft_consensus.cc:1275] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:02.378978 30589 leader_election.cc:304] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:02.364197   594 raft_consensus.cc:2804] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:02.389227 30589 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:02.391672 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:02.392674 30470 raft_consensus.cc:3060] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:02.390413 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 302366us
I20260709 13:09:02.394037 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:02.395068 30476 raft_consensus.cc:3060] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:02.363346 32756 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:02.397900 30516 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:02.377344   608 raft_consensus.cc:493] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.404455 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:02.408375 30468 raft_consensus.cc:1275] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:02.372198   611 raft_consensus.cc:2804] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:02.407096 30516 leader_election.cc:304] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:02.419589 30476 raft_consensus.cc:2468] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 6.
I20260709 13:09:02.420065 30516 leader_election.cc:304] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:02.349128   503 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:02.420943   608 raft_consensus.cc:515] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:02.422679   609 log.cc:927] Time spent T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:09:02.389227   580 raft_consensus.cc:2804] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:02.416159 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:02.423189   580 raft_consensus.cc:493] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:02.418426 30474 raft_consensus.cc:1275] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:09:02.423617   580 raft_consensus.cc:3060] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:02.424579 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:02.426885   602 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.427380   602 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } }
I20260709 13:09:02.427973   524 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:02.428464   524 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.423405 30468 raft_consensus.cc:2468] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
I20260709 13:09:02.429509 30472 raft_consensus.cc:1240] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:02.423430 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:02.384227   426 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:02.432503 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:02.435593 30471 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:09:02.398025   594 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:02.439776 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:02.439116 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:02.444286 30467 raft_consensus.cc:2393] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 6: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:02.382088   406 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:02.422922   600 log.cc:927] Time spent T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:09:02.419553   611 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:02.404064   471 raft_consensus.cc:2804] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:02.404951   335 leader_election.cc:290] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:02.454562 30470 raft_consensus.cc:2468] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
W20260709 13:09:02.457990 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 76116.7us
I20260709 13:09:02.413630   532 raft_consensus.cc:697] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:02.358448   528 consensus_queue.cc:260] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:02.418552   420 raft_consensus.cc:2804] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:02.417559   455 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:02.460348 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:02.463294 30441 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:02.422672   503 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:02.438993   426 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:02.433254   593 raft_consensus.cc:2804] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:02.471170 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:02.487668 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:02.488950 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:02.444928   461 raft_consensus.cc:2804] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:02.439752   606 raft_consensus.cc:476] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 7 LEADER]: Not starting pre-election -- already a leader
I20260709 13:09:02.428880   524 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:02.472940 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:02.445241   594 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:02.420953 32756 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:02.506194 32756 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:02.485164   617 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
W20260709 13:09:02.509660   345 consensus_meta.cc:287] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.540s	user 0.001s	sys 0.010s
I20260709 13:09:02.510123   345 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:02.511332 31148 raft_consensus.cc:2393] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 6: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:02.507436   617 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:02.515049   617 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:02.516073 32749 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:02.516348   345 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:02.444808   613 raft_consensus.cc:2804] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:02.516966   613 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:02.517298   613 raft_consensus.cc:3060] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:02.456501   499 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:02.520219   530 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:02.515563   617 raft_consensus.cc:2804] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:02.524211   602 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:02.524662   617 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:02.525084   617 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:02.467974   471 raft_consensus.cc:493] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:02.537016   471 raft_consensus.cc:3060] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:02.467592   611 raft_consensus.cc:3060] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:02.486660   593 raft_consensus.cc:493] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:02.538406   593 raft_consensus.cc:3060] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:02.495225 30470 raft_consensus.cc:2393] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 6: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
W20260709 13:09:02.495633   598 log.cc:927] Time spent T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:09:02.492336   461 raft_consensus.cc:493] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:02.541632   461 raft_consensus.cc:3060] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:02.496726   425 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:02.496905   524 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:02.497586 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:02.543143 30467 raft_consensus.cc:3060] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:02.497702   532 consensus_queue.cc:237] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:02.481367   420 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:02.544081   420 raft_consensus.cc:3060] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:02.545708 32540 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:02.546052   497 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:02.483318 30471 raft_consensus.cc:2393] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 5: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:02.548776 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:02.549616 30470 raft_consensus.cc:2468] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 3.
I20260709 13:09:02.550617 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:02.556280 30467 raft_consensus.cc:2468] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:09:02.557222 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:02.557942 30471 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:02.561064 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:02.562040 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:02.563021 30470 raft_consensus.cc:2468] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:09:02.565426 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:02.494798   528 raft_consensus.cc:3060] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:02.607125 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
W20260709 13:09:02.608412 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:02.616464 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 175786us
I20260709 13:09:02.627629 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:09:02.633201   402 consensus_meta.cc:287] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.665s	user 0.009s	sys 0.003s
I20260709 13:09:02.639139 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:02.639925 30470 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
I20260709 13:09:02.601151   425 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:02.644951   616 consensus_queue.cc:1059] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:09:02.645740 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:02.635943   402 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:02.652544 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:02.661597 30470 raft_consensus.cc:2468] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
I20260709 13:09:02.662382 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:02.633422   530 consensus_queue.cc:1048] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:02.606599 32540 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:02.625011   584 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.670214 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:02.671046 30473 raft_consensus.cc:2468] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
I20260709 13:09:02.672325 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:02.673061 30467 raft_consensus.cc:2468] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:09:02.559767   555 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:02.677621 30473 raft_consensus.cc:1275] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:09:02.678046 30473 pending_rounds.cc:85] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326: Aborting all ops after (but not including) 1
I20260709 13:09:02.678259 30473 pending_rounds.cc:107] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:09:02.678468 30473 raft_consensus.cc:2889] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:02.608230   580 raft_consensus.cc:515] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:02.681951 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:02.687525 30470 raft_consensus.cc:1240] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:09:02.689484 30473 raft_consensus.cc:1275] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:02.630800   524 consensus_queue.cc:1059] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:09:02.696990 30473 raft_consensus.cc:1240] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 5. Current term is 6. Ops: [3.2-5.4]
I20260709 13:09:02.699671 30471 raft_consensus.cc:2468] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:09:02.705035 30470 raft_consensus.cc:1240] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 13:09:02.706795 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 243627us
I20260709 13:09:02.709034 30441 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:02.702382   524 raft_consensus.cc:3055] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:02.714268 30441 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:02.677719   584 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:02.665910   425 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:02.676020   402 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:02.715752   632 raft_consensus.cc:2749] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:02.724282   402 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:02.724643   616 raft_consensus.cc:2804] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:02.725056   616 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:02.725536   616 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:02.727434 30589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.727960   532 consensus_queue.cc:1048] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:02.717149 30591 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
W20260709 13:09:02.718300   489 consensus_meta.cc:287] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.857s	user 0.010s	sys 0.000s
I20260709 13:09:02.732967   489 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:02.719170 32713 consensus_meta.cc:287] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.765s	user 0.010s	sys 0.001s
I20260709 13:09:02.736805   427 raft_consensus.cc:2749] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:02.721187   584 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:02.738540 30617 raft_consensus.cc:2393] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 5: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:02.722679   425 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:02.731084 30589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.713393   524 raft_consensus.cc:740] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:02.745154   524 consensus_queue.cc:260] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:02.746713   524 raft_consensus.cc:3060] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:02.713728   497 consensus_queue.cc:1048] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:09:02.697113   613 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:02.762423   613 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:02.764097   555 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:02.712291   406 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:02.780042   594 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:02.781435   533 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:02.782353   627 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:02.782892   627 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:02.783536   617 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:02.787125 30467 raft_consensus.cc:1240] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:02.783175   594 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:02.789172   617 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:02.794479   533 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:02.785229   627 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:02.735536   489 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:02.796590 30591 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:02.791077   471 raft_consensus.cc:515] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:02.805677 30591 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:02.808733 30591 leader_election.cc:304] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:02.814745   614 raft_consensus.cc:2749] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:02.818470   608 leader_election.cc:290] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:02.820237   580 leader_election.cc:290] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:02.822501   445 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:02.813059   406 raft_consensus.cc:2804] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:02.827257   406 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:02.827765   406 raft_consensus.cc:3060] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:02.828469 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:02.811131   489 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:02.834014   426 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:02.836086   611 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:02.860688 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:02.861476 30620 raft_consensus.cc:3060] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:02.801968   420 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:02.864152 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:02.864883 30625 raft_consensus.cc:2468] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 6.
I20260709 13:09:02.865470   420 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:02.865907 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:02.870718 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:02.873067 30591 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:02.884013   416 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:02.884773   416 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:02.875412   500 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:02.888684   500 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:02.889613 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:02.891139   500 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:02.892565   416 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:02.896487   555 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.897096   555 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:02.898165   611 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:02.900610 32559 raft_consensus.cc:493] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:02.901238 32559 raft_consensus.cc:515] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:02.823287   461 raft_consensus.cc:515] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:02.906039   461 leader_election.cc:290] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:02.907929   616 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:02.909418   614 raft_consensus.cc:2749] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:02.910902 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:02.914674 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:02.915432 31147 raft_consensus.cc:3060] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:02.918030 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:02.919014 31146 raft_consensus.cc:2393] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 5: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:02.920642 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:02.924631 31151 raft_consensus.cc:1240] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:02.855535   628 raft_consensus.cc:3055] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:02.933523 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:02.945478 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:02.946044 30548 raft_consensus.cc:2468] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 4.
I20260709 13:09:02.946658 30549 raft_consensus.cc:2410] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:09:02.947045 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:02.934319 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:02.899550   555 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:02.903638 32559 leader_election.cc:290] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:02.947602 30548 raft_consensus.cc:1813] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Handling vote request from an unknown peer f639301059e24dc5b0d88a46dc683326
I20260709 13:09:02.966662 30548 raft_consensus.cc:2410] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:09:02.953311 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:02.967310 30625 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:02.951350 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:02.968407 31144 raft_consensus.cc:3060] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:02.951958 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:02.949200 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:02.965333 30542 raft_consensus.cc:2393] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 5: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:02.969813 31151 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 6.
I20260709 13:09:02.965083 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:02.970506 31150 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:02.970723 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:02.971241 31151 raft_consensus.cc:1813] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Handling vote request from an unknown peer f639301059e24dc5b0d88a46dc683326
I20260709 13:09:02.971971 31151 raft_consensus.cc:2410] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:09:02.971095 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:02.969780 31146 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 6.
I20260709 13:09:02.948294 30468 raft_consensus.cc:2368] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 6. Current term is 7.
I20260709 13:09:02.972214 31147 raft_consensus.cc:2468] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:09:02.974255 31149 raft_consensus.cc:1240] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:02.979194 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:02.982312 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:02.986109 30516 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:02.987254 31146 raft_consensus.cc:1275] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:02.985764 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
W20260709 13:09:02.990195 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:02.989981 30517 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:02.990851 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:02.998515 30542 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:02.999087 30548 raft_consensus.cc:1275] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:03.000327 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:03.002140 30549 raft_consensus.cc:1240] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:09:03.009646 30548 raft_consensus.cc:1240] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:03.010823 30619 raft_consensus.cc:2368] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 6. Current term is 7.
I20260709 13:09:03.007540 30591 leader_election.cc:304] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:02.945806   628 raft_consensus.cc:740] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:02.952127   537 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.014945 32713 consensus_queue.cc:1059] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:09:03.027783   613 consensus_queue.cc:1048] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:03.031921   608 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:03.035964   580 raft_consensus.cc:2749] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:03.040154 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 54115.9us
I20260709 13:09:03.082249 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:03.082978 31146 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:03.064332   628 consensus_queue.cc:260] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:03.044021 31142 raft_consensus.cc:1240] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:03.020180 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:02.996188   593 raft_consensus.cc:515] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:03.004436   530 consensus_queue.cc:1048] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:09:03.051400   489 raft_consensus.cc:2749] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:03.052845   611 raft_consensus.cc:2804] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:03.054162 30544 raft_consensus.cc:2468] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 4.
I20260709 13:09:03.055308   490 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.055606   616 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:03.014904   524 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:03.015213   402 raft_consensus.cc:2749] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:03.015190   461 consensus_queue.cc:1048] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:09:03.013427   614 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:03.070433 30620 raft_consensus.cc:2468] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 7.
I20260709 13:09:03.076079 31150 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
I20260709 13:09:03.076504 30625 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
I20260709 13:09:03.078661 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:03.157095 30471 raft_consensus.cc:2376] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4. Re-sending same reply.
I20260709 13:09:03.158118 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:03.065785 32540 consensus_queue.cc:1048] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:09:03.158777 30471 raft_consensus.cc:3060] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:03.158833 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 134916us
I20260709 13:09:03.076679 31144 raft_consensus.cc:2468] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
I20260709 13:09:03.092075 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:03.161238 30469 raft_consensus.cc:2468] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:09:03.092509 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:03.162110 30470 raft_consensus.cc:2376] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4. Re-sending same reply.
I20260709 13:09:03.092880 30542 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 7.
I20260709 13:09:03.092677   608 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:03.102348 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:03.114336 31146 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 7.
I20260709 13:09:03.120046 30516 leader_election.cc:400] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Vote denied by peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) with higher term. Message: Invalid argument: T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 6. Current term is 7.
W20260709 13:09:03.121367 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.164018 30516 leader_election.cc:403] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 13:09:03.165326 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 45501us
W20260709 13:09:03.167264 30516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.167337 30471 raft_consensus.cc:2468] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:09:03.168552 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:03.170032 30616 raft_consensus.cc:1275] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:03.169425 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:03.171177 30620 raft_consensus.cc:3060] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:03.168254 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:03.172081 30591 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:03.172215 30471 raft_consensus.cc:3060] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:03.122462   628 raft_consensus.cc:3060] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:03.173466 30591 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:03.175218 30591 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:03.121223   611 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:09:03.175482 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 175293us
I20260709 13:09:03.177057 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:03.081532   537 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:03.181383 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:03.183882 30469 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:03.187466 30471 raft_consensus.cc:2468] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7.
I20260709 13:09:03.184568 30516 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:03.191069 30516 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:03.185300 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:03.192312 30623 raft_consensus.cc:3060] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:03.121106   535 consensus_queue.cc:1048] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:09:03.197207 30516 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:03.202886 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:03.178916   580 raft_consensus.cc:2804] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:03.203472 30542 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:03.148306   497 consensus_queue.cc:1059] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:09:03.181041 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:03.182019   532 raft_consensus.cc:493] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.183168   611 raft_consensus.cc:3060] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:03.149858   490 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:03.157626   533 consensus_queue.cc:1048] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:09:03.186534   594 raft_consensus.cc:3060] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:03.152990   624 consensus_queue.cc:1048] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:09:03.185845   632 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:03.211457 30620 raft_consensus.cc:2468] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 6.
I20260709 13:09:03.225497 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:03.226307 30470 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
I20260709 13:09:03.173380   614 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:03.192595   524 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:03.242429 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:03.212926 31148 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:03.223737 30542 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 7.
I20260709 13:09:03.229315   616 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:09:03.247040 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 71888.3us
I20260709 13:09:03.249570 30591 leader_election.cc:304] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:03.239117   530 raft_consensus.cc:2749] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:03.207073   406 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:03.266026 30475 raft_consensus.cc:2410] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:09:03.227913   532 raft_consensus.cc:515] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:03.247025   613 raft_consensus.cc:2804] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:03.247686 32713 raft_consensus.cc:2749] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:03.281738 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 84607us
I20260709 13:09:03.279479 30591 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:03.284647 30516 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326
W20260709 13:09:03.291141   646 log.cc:927] Time spent T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:09:03.292730   608 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:03.232951   632 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:03.281637   613 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.270150   650 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:03.305994 30591 leader_election.cc:336] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.761s (SENT)
I20260709 13:09:03.267936   649 raft_consensus.cc:2804] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:03.308574 30591 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:03.309625 30516 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:03.285804   580 raft_consensus.cc:697] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:03.301450   497 consensus_queue.cc:1243] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer cd669586cff44d4bbfcc007e213faab6 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:09:03.313597 30516 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:03.328565   490 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:03.328704 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:03.329306 31146 raft_consensus.cc:2468] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 2.
I20260709 13:09:03.330273   632 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:03.307540   613 raft_consensus.cc:3060] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:03.301151   608 raft_consensus.cc:493] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:03.334329 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:03.338056 30440 leader_election.cc:304] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:03.338992 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:03.342669 30547 raft_consensus.cc:2468] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 5.
I20260709 13:09:03.281608   616 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:03.307791   593 leader_election.cc:290] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:03.346896 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:03.312680   445 raft_consensus.cc:2804] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:03.352689 30473 raft_consensus.cc:2376] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4. Re-sending same reply.
I20260709 13:09:03.353585 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:03.354444 30473 raft_consensus.cc:2393] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 6: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:03.347018 31146 raft_consensus.cc:1240] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:03.355350 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:03.349004 30516 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:03.312546   654 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:03.347430   632 raft_consensus.cc:2804] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:03.361601   632 raft_consensus.cc:493] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.361963   632 raft_consensus.cc:3060] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:03.366106 31148 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 7.
I20260709 13:09:03.367501   532 leader_election.cc:290] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:03.367566 30441 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:03.368718   532 raft_consensus.cc:2804] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:03.369457   532 raft_consensus.cc:697] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 7 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
W20260709 13:09:03.369802   625 log.cc:927] Time spent T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.667s	user 0.002s	sys 0.000s
I20260709 13:09:03.370513   616 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:03.370640   532 consensus_queue.cc:237] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:03.371155 30618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47446 (request call id 2064) took 1134 ms. Trace:
I20260709 13:09:03.371670   524 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:03.371598 30618 rpcz_store.cc:276] 0709 13:09:02.236589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.236706 (+   117us) service_pool.cc:224] Handling call
0709 13:09:02.236982 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:02.350264 (+113282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:02.350306 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:02.365177 (+ 14871us) log.cc:844] Serialized 26 byte log entry
0709 13:09:02.604141 (+238964us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:02.604202 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.604295 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:02.886128 (+281833us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b480024c258. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc788e91aa1 00007fc788e88b37 00007fc788e889ca 00007fc788f8026f 00007fc788f7ff37 00007fc788f9455c 00007fc788f94508 00007fc788f94488 00007fc788f94443 00007fc788f936ec 00007fc787ebda96
0709 13:09:03.369268 (+483140us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:09:03.370941 (+  1673us) raft_consensus.cc:1685] finished
0709 13:09:03.370961 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:03.371095 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":179128,"raft.queue_time_us":135299,"raft.run_cpu_time_us":2648,"raft.run_wall_time_us":509885,"spinlock_wait_cycles":8902272,"thread_start_us":205164,"threads_started":1,"wal-append.queue_time_us":320405}
I20260709 13:09:03.321517   530 raft_consensus.cc:2804] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:03.377429 30440 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:03.378446 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:03.384248 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:03.337273 30542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a418ef882d34180817469c4e2495268"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
mode: GRACEFUL
new_leader_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:45906
I20260709 13:09:03.368817   614 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:03.385505 30542 raft_consensus.cc:606] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Received request to transfer leadership to TS f639301059e24dc5b0d88a46dc683326
I20260709 13:09:03.386013 30542 raft_consensus.cc:614] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:03.384790 30468 raft_consensus.cc:2376] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 6. Re-sending same reply.
I20260709 13:09:03.379828 30469 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:09:03.388188 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:03.389391 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:03.348181 32713 raft_consensus.cc:2749] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:03.390246 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:03.375991   654 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:03.397991 30473 raft_consensus.cc:2468] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:09:03.399708 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:03.400238 30473 raft_consensus.cc:3060] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:03.397303 30468 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:03.407238 30473 raft_consensus.cc:2468] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 6.
I20260709 13:09:03.408094 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:03.408169 30618 raft_consensus.cc:1240] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:03.408735 30473 raft_consensus.cc:2368] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 6. Current term is 7.
I20260709 13:09:03.371155   537 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:03.382083   590 raft_consensus.cc:2749] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:03.410386 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:03.391192   530 raft_consensus.cc:697] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 5 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:03.434923 30473 raft_consensus.cc:2368] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 6. Current term is 7.
I20260709 13:09:03.412976   658 raft_consensus.cc:2749] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:03.414110   535 raft_consensus.cc:3055] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:03.353334   661 raft_consensus.cc:2804] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:03.420770 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:03.403398   660 raft_consensus.cc:493] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:03.436693   535 raft_consensus.cc:740] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:03.437366 30475 raft_consensus.cc:2393] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 6: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:03.427024 30467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 2014) took 1028 ms. Trace:
I20260709 13:09:03.438813 30467 rpcz_store.cc:276] 0709 13:09:02.398544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.673794 (+275250us) service_pool.cc:224] Handling call
0709 13:09:02.688749 (+ 14955us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.787511 (+ 98762us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.426746 (+639235us) spinlock_profiling.cc:243] Waited 98.2 ms on lock 0x7b540010f4d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:03.426955 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":225844608}
I20260709 13:09:03.429011   630 raft_consensus.cc:3055] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:03.439743   630 raft_consensus.cc:740] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:03.440299 30467 raft_consensus.cc:1240] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:09:03.441425 30467 raft_consensus.cc:1240] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:03.440806   630 consensus_queue.cc:260] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:03.436944   661 raft_consensus.cc:697] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:03.442363   630 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:03.383864   335 raft_consensus.cc:2749] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:03.442721   661 consensus_queue.cc:237] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:03.436089 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:03.387698   461 raft_consensus.cc:2804] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:03.433632   654 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:03.347951   608 raft_consensus.cc:515] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:03.435400   530 consensus_queue.cc:237] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:03.437904   535 consensus_queue.cc:260] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:03.403769 32559 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.398859   656 consensus_queue.cc:1059] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:09:03.437338   660 raft_consensus.cc:515] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:03.449350   633 log.cc:927] Time spent T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.747s	user 0.000s	sys 0.001s
I20260709 13:09:03.449509 30620 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 6.
I20260709 13:09:03.430181   406 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:03.450073 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 44133.4us
I20260709 13:09:03.602591   624 consensus_queue.cc:1048] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:03.603294 30440 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:03.450794   524 consensus_queue.cc:1059] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:03.451565   655 raft_consensus.cc:493] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:03.463840   461 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:03.604195   655 raft_consensus.cc:515] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:03.606900   655 leader_election.cc:290] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:03.458395   580 consensus_queue.cc:237] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:03.607877   524 raft_consensus.cc:3055] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:03.608144   608 leader_election.cc:290] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:03.608328   524 raft_consensus.cc:740] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:03.609481   524 consensus_queue.cc:260] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:03.610690   524 raft_consensus.cc:3060] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:03.385051   445 raft_consensus.cc:697] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
W20260709 13:09:03.459791 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:03.620715 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.429054 30623 raft_consensus.cc:2468] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
I20260709 13:09:03.622653 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:03.464030 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:03.466171 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:03.466568 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:03.466681 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:03.406111   614 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.473448 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:09:03.385530   612 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.002s	sys 0.036s
I20260709 13:09:03.598842 30468 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
I20260709 13:09:03.459035 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:03.598822 32559 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:03.625097 30469 raft_consensus.cc:2468] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
W20260709 13:09:03.658255 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 55015.1us
W20260709 13:09:03.688083 30516 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.173.3:32851 timed out after 1.729s (SENT) [suppressed 27 similar messages]
W20260709 13:09:03.689181 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:03.731778 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 43742.5us
I20260709 13:09:03.732627 30440 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:09:03.742965 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.442791   632 raft_consensus.cc:515] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:03.751363 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:03.726842   612 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.002s	sys 0.036s
I20260709 13:09:03.604214   461 raft_consensus.cc:3060] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:03.753783 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.643627   360 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.760468 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:03.644796   658 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:03.733415   608 raft_consensus.cc:2804] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:03.476372   611 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:03.766702   360 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:03.780006   360 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:03.781980 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:03.782127 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:03.784049   445 consensus_queue.cc:237] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:03.789160 31148 raft_consensus.cc:2410] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:09:03.755506   535 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:03.757514   532 raft_consensus.cc:2804] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:09:03.798568 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.748202   418 consensus_queue.cc:1059] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:09:03.733613   614 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:03.832522 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:03.963876 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:03.965214 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:03.871340 30543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
mode: GRACEFUL
new_leader_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:45906
I20260709 13:09:03.969292 30543 raft_consensus.cc:606] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Received request to transfer leadership to TS f639301059e24dc5b0d88a46dc683326
I20260709 13:09:03.972607 30543 raft_consensus.cc:614] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:03.977118 30545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 1474) took 1620 ms. Trace:
I20260709 13:09:03.979595 30545 rpcz_store.cc:276] 0709 13:09:02.356667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.356795 (+   128us) service_pool.cc:224] Handling call
0709 13:09:03.976259 (+1619464us) spinlock_profiling.cc:243] Waited 3.29 ms on lock 0x7b5800028598. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780e43b71 00007fc780e43a22 00007fc789d5cc09 00007fc788eb6ee0 00007fc788f800ab 00007fc788f80131 00007fc788f41fc0 00007fc788f2c929 00007fc788f2c3d2 00007fc7824a3bd4
0709 13:09:03.976511 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:03.976724 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:03.976760 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:03.976812 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:03.976855 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.976924 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:03.977051 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7568128}
W20260709 13:09:03.995349 30475 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.006s	sys 0.014s
W20260709 13:09:03.952787   613 consensus_meta.cc:287] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.621s	user 0.009s	sys 0.000s
W20260709 13:09:03.953967   650 consensus_meta.cc:287] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.620s	user 0.002s	sys 0.007s
W20260709 13:09:03.954941   645 log.cc:927] Time spent T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.626s	user 0.004s	sys 0.000s
W20260709 13:09:03.868080   594 consensus_meta.cc:287] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.639s	user 0.002s	sys 0.006s
I20260709 13:09:03.815917   532 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:03.815442   608 raft_consensus.cc:697] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 7 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:03.772670   658 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:04.003398 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:03.924274   360 raft_consensus.cc:493] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:03.924561   537 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:04.006075   614 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:09:04.014165 30475 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.006s	sys 0.015s
I20260709 13:09:03.958964 32559 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:03.971511   660 leader_election.cc:290] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:03.971951 32713 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:03.876591   402 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:04.050624 30467 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.025s	sys 0.105s
I20260709 13:09:04.033607   650 raft_consensus.cc:2749] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:04.051602 30467 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.025s	sys 0.105s
I20260709 13:09:04.037799   532 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:04.038988   594 raft_consensus.cc:2749] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) with higher term. Message: Invalid argument: T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 6. Current term is 7.
I20260709 13:09:04.038621   628 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:04.069866   628 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:04.072393   628 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:04.064339   658 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:04.048475 32713 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:04.074169   630 consensus_meta.cc:287] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.631s	user 0.008s	sys 0.000s
I20260709 13:09:04.075155 32713 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:04.040028   360 raft_consensus.cc:515] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:04.077713   360 leader_election.cc:290] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:04.069165   611 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:04.094924 30544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43088 (request call id 1681) took 1695 ms (client timeout 2102 ms). Trace:
W20260709 13:09:04.095513 30544 rpcz_store.cc:269] 0709 13:09:02.399766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.423205 (+ 23439us) service_pool.cc:224] Handling call
0709 13:09:04.094691 (+1671486us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b54000d84d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:04.094835 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1434826112}
W20260709 13:09:04.141834 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.213650 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:04.214663 30476 raft_consensus.cc:2393] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 6: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:04.035251   613 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:04.236644 30474 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.004s	sys 0.010s
W20260709 13:09:04.239006 30474 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.004s	sys 0.010s
I20260709 13:09:04.212978   658 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.042179   537 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:04.052260   402 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:04.213241   628 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:04.240751   632 leader_election.cc:290] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:04.259392 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:04.261700 31146 raft_consensus.cc:2393] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 5: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:04.263978 30544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
mode: GRACEFUL
new_leader_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:45906
I20260709 13:09:04.264580 30544 raft_consensus.cc:606] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 5 LEADER]: Received request to transfer leadership to TS f639301059e24dc5b0d88a46dc683326
W20260709 13:09:04.241887   580 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.038s	sys 0.038s
I20260709 13:09:04.264819 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:04.266232 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:04.266505 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:04.268815 30621 raft_consensus.cc:2393] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 5: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:04.269997 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:04.271713 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:04.271904 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:04.274425 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:04.276126 30623 raft_consensus.cc:2393] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 4: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:04.276357 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:04.277012 30621 raft_consensus.cc:2393] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 6: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:04.282248 30551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43088 (request call id 1673) took 2295 ms. Trace:
I20260709 13:09:04.282850 30551 rpcz_store.cc:276] 0709 13:09:01.983634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.983949 (+   315us) service_pool.cc:224] Handling call
0709 13:09:01.984298 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:02.380086 (+395788us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:04.278374 (+1898288us) spinlock_profiling.cc:243] Waited 395 ms on lock 0x7b54002288d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:04.278610 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":908075904}
I20260709 13:09:04.282552 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:09:04.267495   580 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.039s	sys 0.038s
I20260709 13:09:04.256623   658 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:04.287197 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.285951 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:04.286218 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:04.290619 30621 raft_consensus.cc:2393] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 5: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:04.286367 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:09:04.283836   649 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.907s	user 0.008s	sys 0.015s
W20260709 13:09:04.292490   649 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.916s	user 0.009s	sys 0.015s
I20260709 13:09:04.292763   649 raft_consensus.cc:697] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:04.293687   649 consensus_queue.cc:237] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:04.294291 30468 raft_consensus.cc:2410] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:09:04.294886 31145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48414 (request call id 654) took 2086 ms. Trace:
I20260709 13:09:04.275871   628 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:04.298739   628 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:04.301469 30621 raft_consensus.cc:1240] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:09:04.305223 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:04.306869 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:04.313766 30623 raft_consensus.cc:1240] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
W20260709 13:09:04.321496   461 consensus_meta.cc:287] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.557s	user 0.007s	sys 0.001s
I20260709 13:09:04.324007   461 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:04.256757   608 consensus_queue.cc:237] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:04.329964 31115 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.026s	sys 0.059s
W20260709 13:09:04.436998 31115 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.027s	sys 0.059s
I20260709 13:09:04.315554   445 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:04.452310 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:04.454172 30473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 2038) took 1034 ms. Trace:
W20260709 13:09:04.463449 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 320555us
I20260709 13:09:04.463219 30475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 2028) took 1127 ms. Trace:
I20260709 13:09:04.449868   660 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:04.454639 30473 rpcz_store.cc:276] 0709 13:09:03.420156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.464023 (+ 43867us) service_pool.cc:224] Handling call
0709 13:09:03.464419 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:03.464838 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:03.464873 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:03.465417 (+   544us) log.cc:844] Serialized 26 byte log entry
0709 13:09:03.965885 (+500468us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:04.385229 (+419344us) log.cc:844] Serialized 14 byte log entry
0709 13:09:04.452488 (+ 67259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:04.453875 (+  1387us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:04.453929 (+    54us) raft_consensus.cc:1685] finished
0709 13:09:04.453946 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:04.454107 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54074,"prepare.queue_time_us":358573,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":1386,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":13278,"thread_start_us":621681,"threads_started":2,"wal-append.queue_time_us":612555}
I20260709 13:09:04.476956 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:04.452896   490 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:04.462670   628 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:04.486049 30473 raft_consensus.cc:1275] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:04.461575   445 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:04.479748   537 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:04.509284 31149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48412 (request call id 502) took 1586 ms. Trace:
W20260709 13:09:04.489012 30440 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.006s	sys 0.011s
W20260709 13:09:04.510605 30440 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.007s	sys 0.011s
I20260709 13:09:04.509971 31149 rpcz_store.cc:276] 0709 13:09:02.922476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.922596 (+   120us) service_pool.cc:224] Handling call
0709 13:09:02.974020 (+ 51424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.974694 (+   674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:04.509034 (+1534340us) spinlock_profiling.cc:243] Waited 51.1 ms on lock 0x7b5400694450. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f678ad 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:04.509206 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117432192}
W20260709 13:09:04.510901 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 539597us
I20260709 13:09:04.513765 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:04.514364 30544 raft_consensus.cc:2468] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 5.
I20260709 13:09:04.515309 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:04.516384 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:04.517117 30545 raft_consensus.cc:2410] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:04.502027 30467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 2036) took 1142 ms. Trace:
W20260709 13:09:04.489493 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 356194us
I20260709 13:09:04.519876 30621 raft_consensus.cc:1240] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:04.520164 30467 rpcz_store.cc:276] 0709 13:09:03.360148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.446526 (+ 86378us) service_pool.cc:224] Handling call
0709 13:09:03.446930 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:03.447224 (+   294us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:04.054760 (+607536us) log.cc:844] Serialized 14 byte log entry
0709 13:09:04.501620 (+446860us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:04.501685 (+    65us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:04.501741 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:04.501830 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:04.501963 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":876820,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":85,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":4372,"thread_start_us":1053435,"threads_started":2}
I20260709 13:09:04.522854 30467 raft_consensus.cc:1275] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:09:04.523207 30467 pending_rounds.cc:85] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326: Aborting all ops after (but not including) 5
I20260709 13:09:04.523481 30467 pending_rounds.cc:107] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:09:04.523864 30467 raft_consensus.cc:2889] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:04.529609 30618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 455) took 1046 ms. Trace:
I20260709 13:09:04.530089 30618 rpcz_store.cc:276] 0709 13:09:03.483623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.483757 (+   134us) service_pool.cc:224] Handling call
0709 13:09:03.540991 (+ 57234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:03.759839 (+218848us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:03.759881 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:03.759933 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:03.759976 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:04.529377 (+769401us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b5400163ad4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:04.529432 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:04.529547 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":502667648}
I20260709 13:09:04.478413   660 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:04.489207   461 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:04.502754   613 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:04.485863   490 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:04.503762   628 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:04.565564 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.467161 30475 rpcz_store.cc:276] 0709 13:09:03.335644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.437936 (+102292us) service_pool.cc:224] Handling call
0709 13:09:03.438255 (+   319us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:03.452925 (+ 14670us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:03.452956 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:03.453488 (+   532us) log.cc:844] Serialized 52 byte log entry
0709 13:09:04.038688 (+585200us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:04.379119 (+340431us) log.cc:844] Serialized 14 byte log entry
0709 13:09:04.440300 (+ 61181us) log.cc:844] Serialized 14 byte log entry
0709 13:09:04.462913 (+ 22613us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:04.462995 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:04.463035 (+    40us) raft_consensus.cc:1685] finished
0709 13:09:04.463049 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:04.463166 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36481,"prepare.queue_time_us":295465,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":65,"raft.queue_time_us":94792,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":5803,"thread_start_us":921262,"threads_started":2,"wal-append.queue_time_us":788092}
W20260709 13:09:04.570624 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.584223 30441 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:04.535007 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:04.585577 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:04.586213 30546 raft_consensus.cc:3060] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:04.586623 30475 raft_consensus.cc:2468] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
I20260709 13:09:04.588577 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:04.536375 30474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 2037) took 1118 ms. Trace:
I20260709 13:09:04.599723 30589 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:04.600798   670 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:04.596825 30474 rpcz_store.cc:276] 0709 13:09:03.417655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.457959 (+ 40304us) service_pool.cc:224] Handling call
0709 13:09:03.458315 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:03.458540 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:04.240126 (+781586us) log.cc:844] Serialized 14 byte log entry
0709 13:09:04.534728 (+294602us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:04.534785 (+    57us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:04.534831 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:04.534886 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:04.536319 (+  1433us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26086,"prepare.queue_time_us":865737,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":27548,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":15342,"thread_start_us":1048250,"threads_started":2}
W20260709 13:09:04.576578   532 consensus_meta.cc:287] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.510s	user 0.008s	sys 0.008s
W20260709 13:09:04.561215   672 log.cc:927] Time spent T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
W20260709 13:09:04.584041 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 159042us
I20260709 13:09:04.589180 30475 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
I20260709 13:09:04.560652   402 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:04.550181   535 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.570142   678 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.536698   658 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:04.564363   471 leader_election.cc:290] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133)
I20260709 13:09:04.624450 30475 raft_consensus.cc:1275] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:09:04.606611   418 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.295284 31145 rpcz_store.cc:276] 0709 13:09:02.208692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.223008 (+ 14316us) service_pool.cc:224] Handling call
0709 13:09:02.248658 (+ 25650us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:02.333214 (+ 84556us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:02.338639 (+  5425us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:02.851319 (+512680us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b2c00047988. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc782861a11 00007fc782871372 00007fc783fa3a01 00007fc783f6843a 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2
0709 13:09:02.851873 (+   554us) log.cc:844] Serialized 52 byte log entry
0709 13:09:03.166238 (+314365us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:03.301891 (+135653us) log.cc:844] Serialized 14 byte log entry
0709 13:09:03.307704 (+  5813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.321848 (+ 14144us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:03.954309 (+632461us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:09:04.288156 (+333847us) raft_consensus.cc:1685] finished
0709 13:09:04.288177 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:04.294828 (+  6651us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":326088,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":50,"raft.queue_time_us":77965,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":10787,"spinlock_wait_cycles":39568384,"thread_start_us":369202,"threads_started":2,"wal-append.queue_time_us":451956}
I20260709 13:09:04.631364 30546 raft_consensus.cc:2468] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 5.
I20260709 13:09:04.617126   532 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:04.641381   658 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:04.628240   402 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:04.655618   658 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:04.656191   402 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:04.657733   658 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:04.639581   655 raft_consensus.cc:2749] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:04.658345   402 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:04.632272   671 log.cc:927] Time spent T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:09:04.645787   418 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:04.644291   524 consensus_meta.cc:287] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.915s	user 0.010s	sys 0.002s
I20260709 13:09:04.659917 30474 raft_consensus.cc:1240] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 5. Current term is 6. Ops: []
W20260709 13:09:04.670250 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 86071.1us
W20260709 13:09:04.641517   677 log.cc:927] Time spent T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:09:04.681092 30440 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:04.688352 30441 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:04.691098 30441 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:04.691211 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 81949.9us
I20260709 13:09:04.626067   530 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:04.637053   692 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.635100   670 raft_consensus.cc:2749] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:04.706728 30440 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:04.719075 30440 leader_election.cc:304] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:04.644987   445 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:04.707159 30441 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:04.680640   461 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.630404   535 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:04.642050   355 consensus_queue.cc:1048] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:09:04.628438   678 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:04.764724 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.784468 30547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43088 (request call id 1698) took 1033 ms. Trace:
I20260709 13:09:04.826483 30547 rpcz_store.cc:276] 0709 13:09:03.751554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.753342 (+  1788us) service_pool.cc:224] Handling call
0709 13:09:03.753637 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:03.753951 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:03.753976 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:03.761517 (+  7541us) log.cc:844] Serialized 26 byte log entry
0709 13:09:04.243307 (+481790us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:04.243344 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:04.243427 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:04.784207 (+540780us) raft_consensus.cc:1685] finished
0709 13:09:04.784232 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:04.784396 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60919,"raft.queue_time_us":3307,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":5825,"thread_start_us":382923,"threads_started":1,"wal-append.queue_time_us":694331}
I20260709 13:09:04.779003   660 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:04.778970   608 raft_consensus.cc:2804] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:04.834129   608 raft_consensus.cc:697] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 5 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:04.824486   697 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:04.834515   644 log.cc:927] Time spent T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 1.532s	user 0.009s	sys 0.041s
I20260709 13:09:04.835196   426 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:04.834903   697 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:04.835021   608 consensus_queue.cc:237] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:04.704466   658 raft_consensus.cc:2749] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:04.696313   655 raft_consensus.cc:2764] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 13:09:04.762248   684 log.cc:927] Time spent T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:09:04.721808   648 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:04.798441   698 raft_consensus.cc:2804] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:04.717568   524 consensus_queue.cc:1059] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.123s
I20260709 13:09:04.804610   490 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:04.778303   418 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:04.720995   530 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:04.785127   628 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:04.803133   699 raft_consensus.cc:2749] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:04.779561   532 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:04.766079   686 raft_consensus.cc:2749] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:04.905817   697 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:04.906993   530 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:04.907708   678 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:04.909601   535 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:04.878468   660 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:04.845708   698 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:04.722215   692 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:04.878819 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 171747us
I20260709 13:09:04.847671   648 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:04.880122   627 raft_consensus.cc:3055] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:04.880852 30620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57140 (request call id 446) took 1497 ms. Trace:
I20260709 13:09:04.885275 31143 raft_consensus.cc:1240] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 13:09:04.885958   647 log.cc:927] Time spent T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 1.764s	user 0.002s	sys 0.011s
I20260709 13:09:04.888001   702 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.832408   461 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:04.852690 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 205708us
W20260709 13:09:04.852129 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 207254us
I20260709 13:09:04.892259 30468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60026 (request call id 478) took 1023 ms. Trace:
I20260709 13:09:04.898293 31149 raft_consensus.cc:1275] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:04.933074 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:04.899127 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:04.902797 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:04.847721   655 raft_consensus.cc:3055] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:09:04.913264 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 297703us
I20260709 13:09:04.934927 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:04.914582 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:04.935988 30546 raft_consensus.cc:2393] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 5: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:04.915782 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:04.917126 30551 raft_consensus.cc:1275] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:09:04.933320 30468 rpcz_store.cc:276] 0709 13:09:03.868732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.994893 (+126161us) service_pool.cc:224] Handling call
0709 13:09:04.892006 (+897113us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b54000424d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:04.892181 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":589928576}
I20260709 13:09:04.936476 30545 raft_consensus.cc:2468] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:09:04.920517   698 raft_consensus.cc:3060] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:04.939167 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:04.940394 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:04.941072 30618 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 6.
I20260709 13:09:04.940454 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:04.926925 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:04.926611   627 raft_consensus.cc:740] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:04.917686 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:04.916149 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:04.917958 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:04.916420 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:04.949576 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:04.950172 30621 raft_consensus.cc:2468] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 2.
W20260709 13:09:04.951037 31148 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 599) took 1567 ms (client timeout 2026 ms). Trace:
I20260709 13:09:04.951259 31144 raft_consensus.cc:1275] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:09:04.951470 31148 rpcz_store.cc:269] 0709 13:09:03.383621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.389861 (+  6240us) service_pool.cc:224] Handling call
0709 13:09:04.950851 (+1560990us) spinlock_profiling.cc:243] Waited 30.8 ms on lock 0x7b5400573d54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:04.950984 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70890752}
W20260709 13:09:04.952821 30517 leader_election.cc:336] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.616s (SENT)
I20260709 13:09:04.953322 30544 raft_consensus.cc:2468] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7.
I20260709 13:09:04.956578 30549 raft_consensus.cc:2393] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 5: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:04.922434 30516 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:04.926817 30620 rpcz_store.cc:276] 0709 13:09:03.383796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.384025 (+   229us) service_pool.cc:224] Handling call
0709 13:09:04.880639 (+1496614us) spinlock_profiling.cc:243] Waited 64.6 ms on lock 0x7b54001649d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:04.880780 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":148602752}
I20260709 13:09:04.926505   533 consensus_queue.cc:1059] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:09:04.934999   655 raft_consensus.cc:740] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:04.968008 30474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 483) took 1098 ms. Trace:
I20260709 13:09:04.968389 30474 rpcz_store.cc:276] 0709 13:09:03.870072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.611529 (+741457us) service_pool.cc:224] Handling call
0709 13:09:04.623961 (+ 12432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:04.687281 (+ 63320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:04.967742 (+280461us) spinlock_profiling.cc:243] Waited 35.8 ms on lock 0x7b540011dd54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:04.967949 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82236800}
I20260709 13:09:04.964221   650 raft_consensus.cc:2804] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:04.969970   650 raft_consensus.cc:697] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 7 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:04.962863 30516 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:04.924578 30441 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:04.910808   660 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:04.933344 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:04.917550 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:04.944361 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:04.951840 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:04.978513 30550 raft_consensus.cc:2393] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 6: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:04.932556   702 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:04.979545 30616 raft_consensus.cc:2368] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 6. Current term is 7.
I20260709 13:09:04.973784   603 raft_consensus.cc:2804] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:04.962231 32756 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
W20260709 13:09:05.015158 30517 leader_election.cc:336] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.683s (SENT)
I20260709 13:09:05.015801 30517 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:04.927589 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 208585us
I20260709 13:09:04.976526 30516 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:04.978544 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 54055.1us
I20260709 13:09:05.058441 30622 raft_consensus.cc:3060] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:04.976173   402 consensus_queue.cc:1048] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.094s
I20260709 13:09:04.962170   701 consensus_queue.cc:1059] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:09:05.079154 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:09:05.079754 30617 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47446 (request call id 2059) took 2849 ms (client timeout 1729 ms). Trace:
W20260709 13:09:05.080245 30617 rpcz_store.cc:269] 0709 13:09:02.229961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.230247 (+   286us) service_pool.cc:224] Handling call
0709 13:09:05.079526 (+2849279us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b54001e3054. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:05.079687 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":926640896}
W20260709 13:09:05.086243 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 145022us
I20260709 13:09:05.088081 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:05.090157 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:05.090823 30624 raft_consensus.cc:2468] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 5.
I20260709 13:09:04.981328   617 raft_consensus.cc:2749] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:05.096626 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:05.097800 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:05.099470 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:05.098100 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:05.103137 30619 raft_consensus.cc:2393] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 5: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:05.098057 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:05.097837 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:05.104015 30472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 1504) took 2112 ms. Trace:
I20260709 13:09:05.099040 30591 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:05.106117 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:05.106700 30471 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 4.
I20260709 13:09:05.107450 30441 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:05.107745 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:05.107455 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:05.108565 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:05.108773 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:05.109181 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:05.113312 30617 raft_consensus.cc:2393] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 6: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:05.071018   608 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:05.109835 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:05.117283 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:05.121346 30622 raft_consensus.cc:1275] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:05.109850 30441 leader_election.cc:304] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:05.110507 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:05.122967 30621 raft_consensus.cc:2468] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 7.
I20260709 13:09:05.112010 30591 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:05.104518 30472 rpcz_store.cc:276] 0709 13:09:02.991894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.077109 (+ 85215us) service_pool.cc:224] Handling call
0709 13:09:03.077560 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:03.082895 (+  5335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:03.082938 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:03.083484 (+   546us) log.cc:844] Serialized 26 byte log entry
0709 13:09:03.264741 (+181257us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:03.297487 (+ 32746us) log.cc:844] Serialized 14 byte log entry
0709 13:09:03.299895 (+  2408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.299965 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:03.331112 (+ 31147us) spinlock_profiling.cc:243] Waited 4.73 ms on lock 0x7b1800250000. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e7b3f3 00007fc780e7d7c1 00007fc780e7d779 00007fc780e7d709 00007fc780e7d6d1 00007fc780e7c9cd 000000000038f354 000000000038f199 00007fc780e5e83a
0709 13:09:05.101732 (+1770620us) spinlock_profiling.cc:243] Waited 7.89 ms on lock 0x7b1800250000. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e7b3f3 00007fc780e7d7c1 00007fc780e7d779 00007fc780e7d709 00007fc780e7d6d1 00007fc780e7c9cd 000000000038f354 000000000038f199 00007fc780e5e83a
0709 13:09:05.103797 (+  2065us) raft_consensus.cc:1685] finished
0709 13:09:05.103834 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:05.103961 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5173,"prepare.queue_time_us":23376,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":1520,"raft.queue_time_us":16731,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":25654,"spinlock_wait_cycles":29022848,"thread_start_us":112432,"threads_started":1,"wal-append.queue_time_us":192799}
I20260709 13:09:05.124914 30441 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:05.093704   426 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:05.093554   580 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.083752   533 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.129240 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:05.104843   528 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.975607   627 consensus_queue.cc:260] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:05.165920   627 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:04.971925   650 consensus_queue.cc:237] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:05.157330   580 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:05.145171 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:05.171610 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:05.145499 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:05.145860 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:05.149477 30441 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:05.149907   697 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.136180   705 raft_consensus.cc:2804] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:05.146572   426 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:05.153616 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 138509us
I20260709 13:09:05.073745 32756 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:05.094229   708 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:05.131599   710 raft_consensus.cc:2804] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:05.131661   617 raft_consensus.cc:2749] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:05.144173   678 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:05.161826   461 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:05.162379   533 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:05.163070   698 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:05.164175   692 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:05.105505   661 raft_consensus.cc:493] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:05.164793   648 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:05.117825   655 consensus_queue.cc:260] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:05.172765 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.172717 30473 raft_consensus.cc:2468] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:09:05.118191   535 raft_consensus.cc:2804] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:05.173434 30619 raft_consensus.cc:2410] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:05.174146 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
W20260709 13:09:05.175897 30517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:05.195868 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 46489.5us
I20260709 13:09:05.129794   706 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:05.158456 31142 raft_consensus.cc:1275] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:09:05.198944 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 222972us
I20260709 13:09:05.303627 30474 raft_consensus.cc:1240] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:05.200042   715 raft_consensus.cc:2749] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:05.201069   426 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:05.209421 30589 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:05.191401   603 raft_consensus.cc:697] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 5 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:05.299255 30475 raft_consensus.cc:2468] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 8.
I20260709 13:09:05.190984   705 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:05.201960   686 raft_consensus.cc:2749] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:05.131307   608 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:05.302963 32756 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:05.264536 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:05.322556 30473 raft_consensus.cc:3060] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:05.299592 30441 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:05.206563   402 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:09:05.316359 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 107035us
I20260709 13:09:05.319700 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:05.324951 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 193220us
I20260709 13:09:05.310165 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:05.197767   697 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:05.349629 30591 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:05.301347   461 raft_consensus.cc:2804] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:05.352003 30471 raft_consensus.cc:1275] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:05.303416   655 raft_consensus.cc:3060] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:05.303571   701 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.352941 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:05.320477   303 raft_consensus.cc:2749] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:05.299223   535 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:05.359154 31144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48414 (request call id 663) took 1088 ms. Trace:
I20260709 13:09:05.359833 30548 raft_consensus.cc:2393] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 6: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
W20260709 13:09:05.343685 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 44161us
I20260709 13:09:05.360985 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:05.308624   617 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:05.192255   528 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:05.362574 30472 raft_consensus.cc:2468] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:09:05.358901 30591 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
W20260709 13:09:05.364441 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 59540.3us
I20260709 13:09:05.366547 30591 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:05.367082 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:05.367430 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:05.359534 31144 rpcz_store.cc:276] 0709 13:09:04.270505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.270911 (+   406us) service_pool.cc:224] Handling call
0709 13:09:04.950971 (+680060us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:04.951660 (+   689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:05.358994 (+407334us) spinlock_profiling.cc:243] Waited 680 ms on lock 0x7b5400573d50. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f678ad 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:05.359105 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1563227008}
I20260709 13:09:05.367622 30591 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:05.368237 30548 raft_consensus.cc:2468] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:09:05.363512   426 raft_consensus.cc:2749] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:05.217971   613 consensus_queue.cc:1048] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.137s
I20260709 13:09:05.213541   710 raft_consensus.cc:697] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:05.326063   532 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:05.362143   664 log.cc:927] Time spent T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.227s	user 0.000s	sys 0.000s
I20260709 13:09:05.373884 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:05.382225   702 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:05.385474   710 consensus_queue.cc:237] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:05.386963 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:05.387633 31145 raft_consensus.cc:2468] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 6.
I20260709 13:09:05.388746 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:05.389863 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:05.390951 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:05.392784   533 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:05.307086   661 raft_consensus.cc:515] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:05.396193   532 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:05.397698   649 raft_consensus.cc:2804] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:05.373401   617 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:05.398183   649 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:05.398635   649 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:05.320657   705 raft_consensus.cc:3060] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:05.399742 30470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 1515) took 2094 ms. Trace:
I20260709 13:09:05.355479 32756 raft_consensus.cc:2804] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:05.401340 32756 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:05.364681   535 raft_consensus.cc:3060] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:05.401750 32756 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:05.370183   701 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:05.383742 31144 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 4.
I20260709 13:09:05.206099   708 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:05.404016 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:05.404860   613 consensus_queue.cc:1048] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:05.307312   706 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:05.364375 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:05.407738   698 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:05.372383   670 raft_consensus.cc:2804] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:05.409137   670 raft_consensus.cc:697] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:05.397842 30542 raft_consensus.cc:1240] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:05.405031 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:05.383471   426 raft_consensus.cc:2749] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:05.407423 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:05.370451   660 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:05.324673   530 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:05.469125 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 102735us
I20260709 13:09:05.372300   723 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:05.380316   580 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:09:05.468427 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 106928us
I20260709 13:09:05.473431 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:05.358752   402 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:05.470381   729 log.cc:927] Time spent T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:09:05.445845   407 raft_consensus.cc:3055] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:05.468187   461 raft_consensus.cc:697] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 6 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:05.500202 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:09:05.463403 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 201262us
I20260709 13:09:05.400120 30470 rpcz_store.cc:276] 0709 13:09:03.305363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.305531 (+   168us) service_pool.cc:224] Handling call
0709 13:09:03.322549 (+ 17018us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:03.322841 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:03.322869 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:03.323341 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 13:09:03.352403 (+ 29062us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:03.396011 (+ 43608us) log.cc:844] Serialized 14 byte log entry
0709 13:09:03.401013 (+  5002us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.401211 (+   198us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:04.947524 (+1546313us) spinlock_profiling.cc:243] Waited 46.5 ms on lock 0x7b1800137800. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e7b522 00007fc780e7d7c1 00007fc780e7d779 00007fc780e7d709 00007fc780e7d6d1 00007fc780e7c9cd 000000000038f354 000000000038f199 00007fc780e5e83a
0709 13:09:04.953153 (+  5629us) spinlock_profiling.cc:243] Waited 48.6 ms on lock 0x7b1800137800. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e7b522 00007fc780e7d7c1 00007fc780e7d779 00007fc780e7d709 00007fc780e7d6d1 00007fc780e7c9cd 000000000038f354 000000000038f199 00007fc780e5e83a
0709 13:09:05.076335 (+123182us) spinlock_profiling.cc:243] Waited 5.05 ms on lock 0x7b1800137800. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e7b3f3 00007fc780e7d7c1 00007fc780e7d779 00007fc780e7d709 00007fc780e7d6d1 00007fc780e7c9cd 000000000038f354 000000000038f199 00007fc780e5e83a
0709 13:09:05.399559 (+323224us) raft_consensus.cc:1685] finished
0709 13:09:05.399579 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:05.399691 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4448,"prepare.queue_time_us":36347,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":12709,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":8569,"spinlock_wait_cycles":230412160,"thread_start_us":28591,"threads_started":1,"wal-append.queue_time_us":68777}
W20260709 13:09:05.531996 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 163104us
I20260709 13:09:05.512312 31115 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:05.374783 30548 raft_consensus.cc:1275] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:09:05.473500   603 consensus_queue.cc:237] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:05.475217   628 consensus_queue.cc:1048] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:09:05.474363   530 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:05.537180 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:05.584393 30545 raft_consensus.cc:2468] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
I20260709 13:09:05.541085 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:05.586359 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:05.491542   407 raft_consensus.cc:740] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:05.553625 30473 raft_consensus.cc:2468] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7.
W20260709 13:09:05.542747 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 71640.8us
I20260709 13:09:05.585325 30548 pending_rounds.cc:85] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd: Aborting all ops after (but not including) 1
I20260709 13:09:05.588083 30516 leader_election.cc:304] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:05.588419 30548 pending_rounds.cc:107] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:09:05.588768 30548 raft_consensus.cc:2889] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:05.590787 30624 raft_consensus.cc:1240] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:05.591562 31147 raft_consensus.cc:1275] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:05.591629 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:09:05.532581   721 log.cc:927] Time spent T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:09:05.477991   723 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:05.513811   584 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.533481 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:05.588420 30543 raft_consensus.cc:1275] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:05.594990 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:05.595934 31144 raft_consensus.cc:2468] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 8.
I20260709 13:09:05.492868   670 consensus_queue.cc:237] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:05.597121 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 229555us
I20260709 13:09:05.597366 30516 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:05.598295 30551 raft_consensus.cc:1275] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:05.598407 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:05.589131 31143 raft_consensus.cc:1275] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:09:05.540818   661 leader_election.cc:290] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:05.582271   706 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:09:05.592264 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 80036.2us
I20260709 13:09:05.603858 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:05.596048   648 raft_consensus.cc:2804] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:05.623831 30516 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:05.624207 30623 raft_consensus.cc:2468] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
I20260709 13:09:05.623862 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:05.634840 30470 raft_consensus.cc:2468] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
I20260709 13:09:05.626834 30591 leader_election.cc:304] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:05.599009   700 raft_consensus.cc:2804] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:05.606446   407 consensus_queue.cc:260] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:05.629099   528 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:05.599855   707 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:05.629827   533 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.642210   707 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:05.642375   533 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:05.644382   533 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:05.631876   461 consensus_queue.cc:237] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:05.644924 30621 raft_consensus.cc:1275] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:09:05.640610 30591 leader_election.cc:304] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:05.645855 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:05.646613 32756 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:05.647344   528 raft_consensus.cc:2749] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:05.638291 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:05.648145 30617 raft_consensus.cc:2468] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 5.
I20260709 13:09:05.649080 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:05.641132   706 raft_consensus.cc:2749] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:05.639619   700 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.641462   407 raft_consensus.cc:3060] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:05.649834   700 raft_consensus.cc:3060] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:05.650641   736 raft_consensus.cc:2804] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:05.651077   736 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.651394   736 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:05.639920 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:05.656231 30620 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 5.
I20260709 13:09:05.656507   700 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:05.656246 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:05.657923   628 consensus_queue.cc:1048] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:05.658504   700 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:05.644413   707 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:05.648608 30591 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:05.660254   628 raft_consensus.cc:493] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.663120 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:05.663942 30616 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 6.
I20260709 13:09:05.664263 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:05.665089 30548 raft_consensus.cc:2468] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:09:05.667032 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:05.667538 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:05.668165 30543 raft_consensus.cc:2376] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7. Re-sending same reply.
I20260709 13:09:05.669400 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:05.671903 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:05.660951 30441 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:05.682960 30591 leader_election.cc:304] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:05.681684 30441 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:05.685401   686 raft_consensus.cc:2804] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:05.685889   686 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:05.686362   686 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:05.687290 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:05.605275   608 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:05.640950 30516 leader_election.cc:400] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Vote denied by peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) with higher term. Message: Invalid argument: T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 6. Current term is 7.
W20260709 13:09:05.693531 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 394005us
I20260709 13:09:05.693907 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:05.695129 30517 leader_election.cc:336] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.736s (SENT)
I20260709 13:09:05.694317 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:05.605928 31145 raft_consensus.cc:2468] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 4.
I20260709 13:09:05.601835   584 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:05.702211 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:05.702737 30624 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:05.704715   617 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:05.683168   701 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:05.660981   648 raft_consensus.cc:697] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 5 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:05.706118   648 consensus_queue.cc:237] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:05.681458   628 raft_consensus.cc:515] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:05.633517   718 raft_consensus.cc:2749] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:05.627760   708 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:05.712706 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:05.711028 30591 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:05.692538   533 raft_consensus.cc:2804] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:05.696709   580 raft_consensus.cc:2804] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:05.746233 30624 raft_consensus.cc:2468] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 8.
I20260709 13:09:05.747745 30441 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:05.738437   533 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.749262   533 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:05.751087   705 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:05.751998 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 89243us
I20260709 13:09:05.752338 30617 raft_consensus.cc:2393] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 6: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:05.694335 30516 leader_election.cc:403] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:09:05.754194 30591 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:05.743592   580 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:05.780419 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 139591us
I20260709 13:09:05.788271 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:05.788923 30547 raft_consensus.cc:2468] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 3.
I20260709 13:09:05.790114 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:05.791357 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:05.792207 30542 raft_consensus.cc:2410] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:09:05.793723 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:05.795233 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:05.795795 30543 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:05.796036 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:05.795917 30472 raft_consensus.cc:1275] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:09:05.796815 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:05.797523 30475 raft_consensus.cc:2393] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 7: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:05.717455   528 consensus_queue.cc:1048] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:09:05.798966 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:05.799577 30472 raft_consensus.cc:2468] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:09:05.800555 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:09:05.784013 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 88902.3us
I20260709 13:09:05.801271 30547 raft_consensus.cc:2393] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 7: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
W20260709 13:09:05.801801 30517 leader_election.cc:336] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.757s (SENT)
I20260709 13:09:05.802462 30517 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:05.804422 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:05.802698 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:05.808136 30547 raft_consensus.cc:2393] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 3: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:05.800472 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:05.810580 30517 leader_election.cc:400] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 6. Current term is 7.
I20260709 13:09:05.810945 30475 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
I20260709 13:09:05.813248 30517 leader_election.cc:400] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 6. Current term is 7.
I20260709 13:09:05.753594   738 raft_consensus.cc:2804] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:05.814628 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:05.814155 30517 leader_election.cc:304] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:05.825341 31150 raft_consensus.cc:2393] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 8: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:05.817975 30441 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:05.825495   718 raft_consensus.cc:2749] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:05.752986   628 leader_election.cc:290] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:05.824564 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:05.826254   708 raft_consensus.cc:2804] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:05.814713 30624 raft_consensus.cc:2468] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 5.
I20260709 13:09:05.828203   718 consensus_queue.cc:1059] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:05.827076 32749 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:05.826771   708 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:05.829916   650 consensus_queue.cc:1059] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:05.840229 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:05.779206 32756 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:05.779662   402 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:05.773850   742 raft_consensus.cc:2804] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:05.832473 30517 leader_election.cc:304] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:05.833534 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:05.853093 30470 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 8.
I20260709 13:09:05.834967 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:05.853442 30543 raft_consensus.cc:2410] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:09:05.786028   420 raft_consensus.cc:3060] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:05.794502   580 raft_consensus.cc:3060] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:05.836999 30441 leader_election.cc:304] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:05.785077   500 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:05.846447 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:05.818512   613 raft_consensus.cc:2804] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:05.862095   613 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:05.862552   613 raft_consensus.cc:3060] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:05.864529   723 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:05.822009   461 raft_consensus.cc:2749] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:05.846621   738 raft_consensus.cc:697] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:05.860893   500 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:05.872818 30517 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:05.846910   718 consensus_queue.cc:1243] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer f639301059e24dc5b0d88a46dc683326 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:09:05.847790   708 raft_consensus.cc:3060] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:05.753369   722 consensus_queue.cc:1059] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 13:09:05.874646 30550 raft_consensus.cc:1275] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:05.847378 32749 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:05.869618   742 raft_consensus.cc:697] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 8 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:05.869479   628 raft_consensus.cc:2804] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:05.869894   627 raft_consensus.cc:2749] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:05.874137   445 consensus_queue.cc:1048] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:09:05.899616   705 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:05.901970   686 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:05.903918   584 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:09:05.905627 30501 heartbeater.cc:646] Failed to heartbeat to 127.28.173.62:33437 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.28.173.62:33437 timed out after 15.000s (SENT)
W20260709 13:09:05.907281   741 log.cc:927] Time spent T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:09:05.910629   720 raft_consensus.cc:3055] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:05.911067   720 raft_consensus.cc:740] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:05.911892   720 consensus_queue.cc:260] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:05.913066   720 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:05.913067   718 consensus_queue.cc:1048] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
W20260709 13:09:05.921725   535 consensus_meta.cc:287] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.520s	user 0.008s	sys 0.008s
I20260709 13:09:05.922171   535 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:05.925626 30476 raft_consensus.cc:2393] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 6: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
W20260709 13:09:05.926280   724 log.cc:927] Time spent T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.384s	user 0.000s	sys 0.002s
I20260709 13:09:05.926986   697 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:05.927682 30469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60026 (request call id 472) took 2157 ms (client timeout 2316 ms). Trace:
I20260709 13:09:05.891848   530 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:05.928112 30469 rpcz_store.cc:269] 0709 13:09:03.732078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.734469 (+  2391us) service_pool.cc:224] Handling call
0709 13:09:05.889244 (+2154775us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54001225d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:05.889475 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2341098880}
I20260709 13:09:05.930274   736 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:05.886065   461 raft_consensus.cc:2804] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:05.932243   461 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:05.932602   461 raft_consensus.cc:3060] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:05.933804   532 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:05.936885   704 consensus_queue.cc:1059] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:05.937779   674 raft_consensus.cc:3055] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:05.938186   674 raft_consensus.cc:740] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:05.887578   628 raft_consensus.cc:493] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.938853   628 raft_consensus.cc:3060] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:05.939010   674 consensus_queue.cc:260] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:05.939452   614 consensus_queue.cc:1048] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:05.877586   650 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:05.945685   650 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:05.946761   737 log.cc:927] Time spent T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.375s	user 0.001s	sys 0.000s
I20260709 13:09:05.937952   738 consensus_queue.cc:237] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:05.963474 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:05.953925 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:05.966849 30469 raft_consensus.cc:2410] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:05.955195 31147 raft_consensus.cc:1275] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:05.957177 31146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695"
dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
mode: GRACEFUL
new_leader_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:42956
I20260709 13:09:05.956233 31151 raft_consensus.cc:1275] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:05.956650 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:05.967772 31146 raft_consensus.cc:606] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Received request to transfer leadership to TS f639301059e24dc5b0d88a46dc683326
I20260709 13:09:05.968163 30621 raft_consensus.cc:2468] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 6.
I20260709 13:09:05.962263 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:05.969066 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:05.962543 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:05.963218 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:05.970619 30473 raft_consensus.cc:2410] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:09:05.951709 30441 leader_election.cc:304] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:05.972107 30441 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:05.973632 30441 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:05.968166 31146 raft_consensus.cc:614] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:05.975682 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:05.980262 30441 leader_election.cc:304] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:06.008500 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:06.026593 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 46395.4us
I20260709 13:09:06.026906 30550 raft_consensus.cc:2410] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:09:05.988243 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:09:05.964581 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 80111.7us
I20260709 13:09:06.030966 30517 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:06.032636 30517 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:06.034680 30441 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:06.034868 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:06.037030 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:06.036478 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:06.038091 30550 raft_consensus.cc:2410] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 8 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:09:06.038172 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:06.039989 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:06.040580 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:06.041893 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:06.042686 30516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.042753 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:06.043597 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:09:06.047737 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.947779   650 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:06.047744 30544 raft_consensus.cc:1275] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:09:06.050882 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 51151.8us
I20260709 13:09:05.955251   656 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:09:05.993026   655 consensus_meta.cc:287] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.627s	user 0.008s	sys 0.000s
I20260709 13:09:06.052386 30516 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:05.953611   500 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:06.054672 30516 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:05.982597   632 raft_consensus.cc:2749] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:05.987092   420 raft_consensus.cc:2749] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) with higher term. Message: Invalid argument: T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 6. Current term is 7.
I20260709 13:09:05.915656   580 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:06.029793   702 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:05.995766   532 raft_consensus.cc:2749] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:06.046962   611 raft_consensus.cc:2764] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:09:06.069835 31150 raft_consensus.cc:1275] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:09:06.029822   661 raft_consensus.cc:2749] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:06.031272 32756 raft_consensus.cc:2749] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:06.071746   678 consensus_meta.cc:287] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.866s	user 0.009s	sys 0.007s
I20260709 13:09:05.991328   628 raft_consensus.cc:515] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:06.056237 31114 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:09:06.033877   555 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.953245   698 consensus_queue.cc:1048] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.102s
I20260709 13:09:06.047156   530 raft_consensus.cc:2804] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:06.090217 30441 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:05.993170   697 raft_consensus.cc:2749] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:05.982415   674 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:06.069459 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:06.054044   699 raft_consensus.cc:2749] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:06.051307   686 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:06.079510 30516 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:06.055848   627 raft_consensus.cc:2749] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:05.991986   613 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:06.130261   613 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:09:06.131323 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 51906.7us
I20260709 13:09:06.133157 30516 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:06.135035 30621 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1"
dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
mode: GRACEFUL
new_leader_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:49382
I20260709 13:09:06.135603 30621 raft_consensus.cc:606] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Received request to transfer leadership to TS f639301059e24dc5b0d88a46dc683326
I20260709 13:09:06.136121 30621 raft_consensus.cc:614] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:06.138674 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:06.139456 30544 raft_consensus.cc:2468] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 4.
I20260709 13:09:06.110488 32756 raft_consensus.cc:2804] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:06.087857   549 consensus_queue.cc:1059] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
W20260709 13:09:06.103153 30371 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57538 (request call id 301) took 15349 ms (client timeout 15000 ms). Trace:
I20260709 13:09:06.115044   736 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:06.073611   656 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:06.103878   402 raft_consensus.cc:3055] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:06.085528   303 consensus_queue.cc:1048] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:09:06.105870 30441 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:09:06.172587 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 66813.7us
I20260709 13:09:06.174860 30441 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:06.106889   530 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.075294   535 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:06.102125 30370 catalog_manager.cc:5697] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 4 to 5, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 5 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:06.184302 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 430830us
I20260709 13:09:06.185249 30589 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:06.185145 30370 catalog_manager.cc:5697] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 4 to 5, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 5 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:05.992100   533 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:06.111860 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:05.949241   742 consensus_queue.cc:237] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:06.112607   584 raft_consensus.cc:2804] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:06.088016   650 raft_consensus.cc:2749] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:06.112728 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 56563.1us
W20260709 13:09:06.114192 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.114033 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:06.097085   649 consensus_meta.cc:287] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.698s	user 0.010s	sys 0.006s
I20260709 13:09:06.056226   720 consensus_queue.cc:1048] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:09:06.114831   555 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:06.096562   678 raft_consensus.cc:2749] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:06.105486   655 consensus_queue.cc:1048] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:09:06.088560   702 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:06.121811   708 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:06.140223 32600 raft_consensus.cc:2804] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:06.146502 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:06.147626 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:06.150895 30547 raft_consensus.cc:1275] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:09:06.153240 30371 rpcz_store.cc:269] 0709 13:08:50.753497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.771915 (+ 18418us) service_pool.cc:224] Handling call
0709 13:09:06.103083 (+15331168us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:00.986432 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:00.987174 (+   742us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:00.987222 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:09:00.987247 (+    25us) tablet.cc:662] Decoding operations
0709 13:09:01.020621 (+ 33374us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:01.023287 (+  2666us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:01.031719 (+  8432us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:09:01.101930 (+ 70211us) tablet.cc:701] Row locks acquired
0709 13:09:01.110805 (+  8875us) write_op.cc:260] PREPARE: finished
0709 13:09:01.145253 (+ 34448us) write_op.cc:270] Start()
0709 13:09:01.153214 (+  7961us) write_op.cc:276] Timestamp: P: 1783602541141967 usec, L: 0
0709 13:09:01.158884 (+  5670us) op_driver.cc:348] REPLICATION: starting
0709 13:09:01.253600 (+ 94716us) log.cc:844] Serialized 1293 byte log entry
0709 13:09:02.046249 (+792649us) op_driver.cc:464] REPLICATION: finished
0709 13:09:02.198700 (+152451us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc780e5e0ac 00007fc789cb8ab9 00007fc780e7a69b 00007fc780e7893f 00007fc780e7ac02 00007fc78799eef0
0709 13:09:02.413151 (+214451us) write_op.cc:301] APPLY: starting
0709 13:09:02.417274 (+  4123us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:02.420546 (+  3272us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:02.420574 (+    28us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:02.421078 (+   504us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:02.421242 (+   164us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:09:02.421291 (+    49us) write_op.cc:312] APPLY: finished
0709 13:09:02.421496 (+   205us) log.cc:844] Serialized 35 byte log entry
0709 13:09:02.421645 (+   149us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:02.421731 (+    86us) write_op.cc:454] Released schema lock
0709 13:09:02.421771 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:02.422123 (+   352us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:02.422165 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3225304,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":329302,"apply.run_cpu_time_us":1903,"apply.run_wall_time_us":31363,"num_ops":3,"prepare.queue_time_us":234782,"prepare.run_cpu_time_us":35868,"prepare.run_wall_time_us":477336,"raft.queue_time_us":412704,"raft.run_cpu_time_us":11261,"raft.run_wall_time_us":333015,"replication_time_us":861340,"spinlock_wait_cycles":42698496,"thread_start_us":878105,"threads_started":4,"wal-append.queue_time_us":328037,"wal-append.run_cpu_time_us":17197,"wal-append.run_wall_time_us":2007898}]]}
I20260709 13:09:06.103720   580 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:06.133786   627 raft_consensus.cc:2749] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:06.160154 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:06.244112 30544 raft_consensus.cc:2468] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 8.
I20260709 13:09:06.244189 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:06.102032 30546 raft_consensus.cc:2468] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7.
I20260709 13:09:06.135572 30516 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:06.158833   402 raft_consensus.cc:740] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:06.166258   701 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.169673   656 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:06.171089   628 leader_election.cc:290] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:06.172461 30548 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 4.
I20260709 13:09:06.086809 30591 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:06.153851 32756 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.110116   426 raft_consensus.cc:3055] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:06.093475   461 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:06.189080 30550 raft_consensus.cc:2468] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 4.
I20260709 13:09:06.187367 30370 catalog_manager.cc:5697] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 1 to 4, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 4 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:06.233484 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 48360.6us
I20260709 13:09:06.234048 30441 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:06.236392 31114 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:06.240659 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:06.184170   530 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:06.236366   698 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:06.231317   584 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.249842 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:09:06.250705 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 181118us
W20260709 13:09:06.251968 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 116471us
I20260709 13:09:06.251117 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:06.233780   535 raft_consensus.cc:2749] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:06.233474   686 raft_consensus.cc:2804] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:06.255995 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:06.261885 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:06.240532 32600 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:06.236788   697 consensus_queue.cc:1048] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:09:06.342756 30440 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:06.350019 30440 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:06.278306 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:06.329051 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
W20260709 13:09:06.329387 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 95409.4us
W20260709 13:09:06.264810 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 178067us
I20260709 13:09:06.330381 30370 catalog_manager.cc:5697] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 4 to 6, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 6 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:06.353222 30546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39952 (request call id 1490) took 1418 ms. Trace:
I20260709 13:09:06.332027 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:06.332407 31116 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:06.236024   532 consensus_queue.cc:1048] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:09:06.360980 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:06.361554 30624 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:06.361861 30543 raft_consensus.cc:1275] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:09:06.241330   649 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:06.353004 30370 catalog_manager.cc:5697] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 reported cstate change: config changed from index 4 to 5, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New cstate: current_term: 2 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:09:06.335429 30589 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:06.335158 30544 raft_consensus.cc:2468] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 7.
I20260709 13:09:06.345109 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:06.239331   749 raft_consensus.cc:2804] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:06.247313 32749 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:06.256160   611 raft_consensus.cc:2749] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:06.256263   733 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.353637 30546 rpcz_store.cc:276] 0709 13:09:04.934455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.817415 (+882960us) service_pool.cc:224] Handling call
0709 13:09:06.353077 (+535662us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b54003d9fd4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:06.353171 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":543423232}
I20260709 13:09:06.356889 30616 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:06.356184 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:09:06.336355 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 100136us
I20260709 13:09:06.377799 30476 raft_consensus.cc:1275] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:09:06.378161 30476 pending_rounds.cc:85] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326: Aborting all ops after (but not including) 3
I20260709 13:09:06.378365 30476 pending_rounds.cc:107] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:09:06.378574 30476 raft_consensus.cc:2889] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:06.363869 30589 leader_election.cc:304] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:06.264072 32756 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:06.367991 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:06.379030 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:06.379447 30617 raft_consensus.cc:3060] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:06.379828 30469 raft_consensus.cc:2468] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:09:06.378964 30624 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 6.
I20260709 13:09:06.381728 30440 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:06.382894 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:06.383800 30473 raft_consensus.cc:2368] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 6. Current term is 7.
I20260709 13:09:06.385156 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:06.386034 30473 raft_consensus.cc:2368] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 5. Current term is 6.
I20260709 13:09:06.343724   584 raft_consensus.cc:3060] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:06.386914 30551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
mode: GRACEFUL
new_leader_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:45906
I20260709 13:09:06.387466 30551 raft_consensus.cc:606] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 7 LEADER]: Received request to transfer leadership to TS f639301059e24dc5b0d88a46dc683326
I20260709 13:09:06.344455   628 raft_consensus.cc:2804] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:09:06.356107   751 log.cc:927] Time spent T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:09:06.388671 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:06.389779 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:06.382668 30370 catalog_manager.cc:5697] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:06.397284 30473 raft_consensus.cc:2376] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5. Re-sending same reply.
I20260709 13:09:06.390647 30589 leader_election.cc:304] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:06.391556 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:06.398701 30474 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:06.399096 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:06.332440   426 raft_consensus.cc:740] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:06.344381   686 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.334112   753 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:06.348614 32600 raft_consensus.cc:3060] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:06.407403 30441 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:06.396076 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:06.408146 30470 raft_consensus.cc:2468] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:09:06.390285 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:06.395443 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:06.400864 30620 raft_consensus.cc:2393] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 7: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:06.396539 31114 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:06.410156 31114 leader_election.cc:304] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:06.386855   738 raft_consensus.cc:2804] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:06.361142   699 raft_consensus.cc:2749] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:06.401636 30543 raft_consensus.cc:1275] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:06.348300   427 consensus_queue.cc:1048] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:09:06.386735 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:06.365020   749 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:06.260429   701 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:06.424321 30618 raft_consensus.cc:1240] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:09:06.424815 30623 raft_consensus.cc:1275] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:06.384549 31116 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:06.347339   698 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:06.347929   627 consensus_queue.cc:1048] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:09:06.349265   303 consensus_queue.cc:1048] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:09:06.415634 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:06.415308 30517 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:06.398481 30370 catalog_manager.cc:5697] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:06.845453   656 consensus_queue.cc:1048] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:06.421530 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:06.419677 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:06.417706 30550 raft_consensus.cc:1275] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:06.428810 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:06.420068 30617 raft_consensus.cc:2468] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 6.
I20260709 13:09:06.868638   614 raft_consensus.cc:2749] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:06.428328 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:06.872777 30618 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:06.854787   656 raft_consensus.cc:2804] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:06.874912   656 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.875404   656 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:06.423367 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:06.877664 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:06.452009 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:06.422839 30621 raft_consensus.cc:1240] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 LEADER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:06.452610 30622 raft_consensus.cc:1240] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:06.425755 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:06.428140 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:09:06.921499 30440 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.007s	sys 0.015s
W20260709 13:09:06.922014 30440 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.007s	sys 0.015s
I20260709 13:09:06.922084   764 consensus_queue.cc:1059] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:06.923554   764 raft_consensus.cc:3055] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:09:06.923853 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 542138us
I20260709 13:09:06.924129   764 raft_consensus.cc:740] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
W20260709 13:09:06.568887 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 157750us
I20260709 13:09:06.450498 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:06.425441 31142 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:09:06.926646 31114 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:06.637055 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:06.713321 32756 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:06.449330 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:06.480836   420 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.427876   426 consensus_queue.cc:260] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:06.394344   628 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.933406 31150 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
I20260709 13:09:06.934057   628 raft_consensus.cc:3060] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:06.934459 32756 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:06.405860   632 consensus_queue.cc:1048] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:09:06.362759   402 consensus_queue.cc:260] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:06.937956   402 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:06.467252   649 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:06.940035   528 consensus_queue.cc:1175] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "cd669586cff44d4bbfcc007e213faab6" responder_term: 2 status { last_received { term: 2 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 2 index: 5 } }
I20260709 13:09:06.406754   678 raft_consensus.cc:2804] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:06.393710   707 raft_consensus.cc:2749] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:06.405079   686 raft_consensus.cc:3060] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:06.853749   535 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:06.393028   723 raft_consensus.cc:2749] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:06.419278   738 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.502697   753 raft_consensus.cc:2749] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:06.366534   758 raft_consensus.cc:2749] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:09:06.989069 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 62814.6us
I20260709 13:09:06.401027   759 raft_consensus.cc:2749] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:06.469633   532 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:06.992504 30468 raft_consensus.cc:2393] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 6: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:06.991871   532 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:06.568246   533 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:06.501865   555 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:06.420326   613 consensus_queue.cc:1048] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:09:06.433729   692 raft_consensus.cc:2749] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:06.500890   698 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:06.456956   699 raft_consensus.cc:2804] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:07.013182   699 raft_consensus.cc:697] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 6 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:07.014544   699 consensus_queue.cc:237] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:06.419970   700 raft_consensus.cc:2749] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:06.419881   704 raft_consensus.cc:2749] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:09:06.486694   755 log.cc:927] Time spent T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:09:06.660744   461 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:06.472535   490 raft_consensus.cc:3055] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:07.019610   490 raft_consensus.cc:740] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:07.021070   490 consensus_queue.cc:260] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:06.977003   535 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:07.023468   490 raft_consensus.cc:3060] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:06.933420   420 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:06.696105   674 consensus_meta.cc:287] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.580s	user 0.006s	sys 0.003s
I20260709 13:09:06.710474   701 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:06.620093   702 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:06.573375   708 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:06.425055   749 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:07.050529 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:07.051373 30476 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 5.
W20260709 13:09:06.496279   750 log.cc:927] Time spent T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
I20260709 13:09:07.052268 31149 raft_consensus.cc:2468] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 6.
W20260709 13:09:06.660255   752 log.cc:927] Time spent T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260709 13:09:07.054593 31149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 612) took 1012 ms. Trace:
I20260709 13:09:07.055346 30471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 495) took 1750 ms. Trace:
I20260709 13:09:07.055006 31149 rpcz_store.cc:276] 0709 13:09:06.042103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.043405 (+  1302us) service_pool.cc:224] Handling call
0709 13:09:07.054366 (+1010961us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540045f454. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:07.054518 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2317632896}
I20260709 13:09:06.812577 30472 raft_consensus.cc:1240] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 8 LEADER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:06.835687 32600 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:06.840780 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
W20260709 13:09:06.843400 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 427978us
W20260709 13:09:06.857384 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.904266 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:06.853474   742 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:06.916358 30441 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.014s	sys 0.001s
I20260709 13:09:06.916882 30619 raft_consensus.cc:1240] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:06.922472 30624 raft_consensus.cc:2468] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
I20260709 13:09:06.941444   678 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:06.393249   733 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:07.064031 30622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 481) took 1194 ms. Trace:
I20260709 13:09:07.064420 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:07.064502 30622 rpcz_store.cc:276] 0709 13:09:05.866813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.866956 (+   143us) service_pool.cc:224] Handling call
0709 13:09:06.452442 (+585486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:06.916737 (+464295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.060122 (+143385us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b54002df0d0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f678ad 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:07.060964 (+   842us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1345843456}
I20260709 13:09:07.065343 30619 raft_consensus.cc:2468] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 5.
I20260709 13:09:07.066123 30468 raft_consensus.cc:1275] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:07.066203   733 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:06.925450 30440 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
W20260709 13:09:07.067685 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 142579us
I20260709 13:09:07.068523 30517 leader_election.cc:400] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 6. Current term is 7.
I20260709 13:09:07.062747   678 raft_consensus.cc:3060] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:06.971717 30618 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 7.
I20260709 13:09:07.070129 30517 leader_election.cc:400] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 election: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 5. Current term is 6.
W20260709 13:09:06.979482 30467 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.032s	sys 0.043s
W20260709 13:09:07.070796 30467 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.032s	sys 0.044s
I20260709 13:09:07.062656   742 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:07.072636 30475 raft_consensus.cc:2393] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 4: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:07.073987 30475 raft_consensus.cc:1275] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:06.980116 30623 raft_consensus.cc:1240] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:06.990549 31114 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:06.935796   763 raft_consensus.cc:3060] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:06.995517   532 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:07.006946   738 raft_consensus.cc:3060] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:07.008551 30516 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:07.011488   533 raft_consensus.cc:493] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:06.703506   530 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:07.113943   530 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:06.744917   584 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:07.114974   656 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:07.116619   584 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:07.117811 30551 raft_consensus.cc:1275] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:09:07.007615 30621 raft_consensus.cc:1240] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:06.847748 30370 catalog_manager.cc:5697] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:09:07.121439 30542 raft_consensus.cc:2393] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 6: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:07.120787 30370 catalog_manager.cc:5697] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:07.027660 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 675163us
I20260709 13:09:07.045370 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:07.055791 30471 rpcz_store.cc:276] 0709 13:09:05.304786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.356095 (+ 51309us) service_pool.cc:224] Handling call
0709 13:09:05.356376 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:05.359055 (+  2679us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:05.359081 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:05.359484 (+   403us) log.cc:844] Serialized 26 byte log entry
0709 13:09:05.862396 (+502912us) spinlock_profiling.cc:243] Waited 4.5 ms on lock 0x7b180045d660. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e5de07 00007fc789cb8ab9 00007fc780e7a69b 00007fc780e7893f 00007fc780e7ac02 00007fc783b0220b 00007fc783b07d23 00007fc783b080d1 00007fc783f23a0f
0709 13:09:06.137449 (+275053us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:06.137494 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:06.137556 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:07.054799 (+917243us) raft_consensus.cc:1685] finished
0709 13:09:07.054835 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:07.055108 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":108730,"raft.queue_time_us":2369,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":10346240,"thread_start_us":274859,"threads_started":1,"wal-append.queue_time_us":876762}
W20260709 13:09:06.650064   762 log.cc:927] Time spent T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:09:07.073906   742 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:07.082947 30543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
mode: GRACEFUL
new_leader_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:45906
I20260709 13:09:07.083870 32600 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:07.084357 30470 raft_consensus.cc:3060] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:07.084904   420 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:07.088925   533 raft_consensus.cc:515] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:07.097170   686 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:07.078733   535 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:07.047595   426 raft_consensus.cc:3060] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:07.070122 30440 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:07.105808   702 consensus_queue.cc:1048] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:07.109539   628 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:07.171715 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 67881.9us
I20260709 13:09:07.180733   736 raft_consensus.cc:2749] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:07.173723 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 165417us
I20260709 13:09:07.150005 31151 raft_consensus.cc:1240] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 13:09:07.181989 30474 consensus_meta.cc:287] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.783s	user 0.008s	sys 0.006s
I20260709 13:09:07.188107 31115 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:07.151955 30543 raft_consensus.cc:606] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 5 LEADER]: Received request to transfer leadership to TS f639301059e24dc5b0d88a46dc683326
W20260709 13:09:07.189090   777 log.cc:927] Time spent T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:09:07.129892   774 consensus_queue.cc:1048] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:09:07.190459   701 raft_consensus.cc:2749] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:07.191361 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 201125us
I20260709 13:09:07.184800 30591 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:07.189577   418 consensus_queue.cc:1059] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:09:07.174659 30625 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 5.
W20260709 13:09:07.174101 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 766700us
W20260709 13:09:07.241240 30616 consensus_meta.cc:287] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.771s	user 0.007s	sys 0.007s
I20260709 13:09:07.147455   656 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:07.254801   533 leader_election.cc:290] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:07.300529   686 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:07.300758 30616 raft_consensus.cc:1275] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:07.254607   678 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:07.302453 30441 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:07.302744   678 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:07.303371   678 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:07.304013   775 log.cc:927] Time spent T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 13:09:07.303908 30441 leader_election.cc:304] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:07.256927   698 raft_consensus.cc:2749] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:07.305043   698 raft_consensus.cc:2804] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:07.305634   698 raft_consensus.cc:697] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 6 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:07.306782   698 consensus_queue.cc:237] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:07.060562   764 consensus_queue.cc:260] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:07.270998   628 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:07.271677 30473 raft_consensus.cc:1240] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:07.308557   764 raft_consensus.cc:3060] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:07.291661   580 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.317340   670 consensus_queue.cc:1048] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:07.318063   580 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:07.320407   580 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:07.321097 29364 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:09:07.324750 29364 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:07.324846 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:07.325449 30472 raft_consensus.cc:1240] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:07.325556 30548 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
W20260709 13:09:07.276348 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 206345us
I20260709 13:09:07.252432   742 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.328009   742 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:07.328914 30440 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:07.280522 30551 raft_consensus.cc:1240] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:09:07.330075   686 raft_consensus.cc:2804] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:07.330358   742 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:07.330420   686 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.282198 30542 raft_consensus.cc:1240] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:07.331050   686 raft_consensus.cc:3060] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:07.252437 30370 catalog_manager.cc:5697] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 5 to 7, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 7 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:07.333078 30517 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:07.332906 30370 catalog_manager.cc:5697] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 1 to 3, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 3 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:09:07.279456   749 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:07.334290 30517 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:07.334549   420 raft_consensus.cc:2804] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:07.335016   420 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:07.335079 30619 raft_consensus.cc:1240] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:07.335429   420 raft_consensus.cc:3060] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:07.291639   535 raft_consensus.cc:2749] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:07.291641 30469 raft_consensus.cc:1240] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:09:07.337021   749 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:07.338313   702 raft_consensus.cc:2749] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:07.292009 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:07.293061   303 consensus_queue.cc:1048] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:09:07.348806 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 164103us
I20260709 13:09:07.349671 30591 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:07.334565 30370 catalog_manager.cc:5697] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 4 to 5, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 5 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:07.360239   733 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:07.362516 30516 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:07.356029 30474 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 7.
I20260709 13:09:07.366297 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:07.374856 30370 catalog_manager.cc:5697] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 3 to 6, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 6 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:09:07.375916 31114 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:07.376648   733 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:07.378753   674 raft_consensus.cc:3055] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:07.379030   733 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:07.379209   674 raft_consensus.cc:740] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:07.366626   303 raft_consensus.cc:2804] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:07.379972   303 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.380347   303 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:07.381392 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:07.382090 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 253407us
I20260709 13:09:07.382815   530 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:07.383471   701 raft_consensus.cc:2804] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:07.383541   530 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:07.393115   701 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.393563   701 raft_consensus.cc:3060] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:07.394758 30551 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:07.386894 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 59312.1us
I20260709 13:09:07.376720 30370 catalog_manager.cc:5697] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 1 to 3, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 3 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:07.396052 30474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2061) took 1005 ms. Trace:
I20260709 13:09:07.396452 30474 rpcz_store.cc:276] 0709 13:09:06.391110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.391257 (+   147us) service_pool.cc:224] Handling call
0709 13:09:07.368556 (+977299us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:07.384003   749 raft_consensus.cc:2804] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:07.402272   749 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:07.402673   749 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:07.402390 30370 catalog_manager.cc:5697] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:07.408453 30470 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:09:07.401126 30440 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:07.407243 31115 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:07.406536   692 consensus_queue.cc:1059] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:09:07.414646   692 raft_consensus.cc:3055] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:07.415005   692 raft_consensus.cc:740] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:07.416033   692 consensus_queue.cc:260] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:07.417351   692 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:07.420210 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:07.420331   674 consensus_queue.cc:260] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:07.420913 31149 raft_consensus.cc:2468] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 4.
I20260709 13:09:07.421804   674 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:07.426311 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 76772.1us
I20260709 13:09:07.427325 30591 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:07.430770   471 raft_consensus.cc:2749] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:07.406894   418 raft_consensus.cc:2749] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:07.432039   723 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:07.432592   723 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:07.434686   723 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:07.438833   678 raft_consensus.cc:2749] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:07.410282 30370 catalog_manager.cc:5697] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:07.397120   530 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:07.445142 30551 raft_consensus.cc:2468] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
W20260709 13:09:07.449362 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 73588.3us
I20260709 13:09:07.450212 31114 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:07.445541 30470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50446 (request call id 1535) took 1040 ms. Trace:
W20260709 13:09:07.451610 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 46937.7us
I20260709 13:09:07.452176 30470 rpcz_store.cc:276] 0709 13:09:06.404650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.427920 (+ 23270us) service_pool.cc:224] Handling call
0709 13:09:07.413820 (+985900us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:07.404559   670 consensus_queue.cc:1059] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:09:07.455801   670 raft_consensus.cc:3055] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:07.456286   670 raft_consensus.cc:740] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:07.456466 31145 raft_consensus.cc:1240] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:09:07.457515   670 consensus_queue.cc:260] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:07.458953   670 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:07.463831 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.394497   738 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:07.386994   758 consensus_queue.cc:1059] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:09:07.460659   678 raft_consensus.cc:2749] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:07.477433 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 115106us
I20260709 13:09:07.453950   733 raft_consensus.cc:2749] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:07.482769 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 113867us
W20260709 13:09:07.500380 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 50252us
I20260709 13:09:07.502386   763 raft_consensus.cc:2749] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:07.501791   303 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:07.504347 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:07.504693 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:07.505355 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:07.516875 31114 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:07.517621 31150 raft_consensus.cc:2393] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 4: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:07.519794 32749 raft_consensus.cc:2804] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:07.519678   763 consensus_queue.cc:1048] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:07.519097   490 raft_consensus.cc:2749] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:07.520612 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:07.471920   420 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:07.511077   418 raft_consensus.cc:2749] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:07.530597 31149 raft_consensus.cc:2468] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:09:07.547961 30625 raft_consensus.cc:2393] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 4: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:07.527835 32749 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.545042 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:07.560307 30589 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:07.564486 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:07.565155 31144 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:07.571843 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.575464 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:09:07.576129 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 163297us
I20260709 13:09:07.583144 30589 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:07.548651   580 raft_consensus.cc:493] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:07.554208 32749 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:07.588943 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 43569.8us
I20260709 13:09:07.592077 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:07.599977 30621 raft_consensus.cc:1813] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Handling vote request from an unknown peer f639301059e24dc5b0d88a46dc683326
I20260709 13:09:07.600728 30621 raft_consensus.cc:2410] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:09:07.593863   580 raft_consensus.cc:515] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:07.551689 31145 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:09:07.591524 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:07.612766 30625 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:07.581784   426 raft_consensus.cc:2804] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:07.616067 31114 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
W20260709 13:09:07.628083 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 98201.4us
I20260709 13:09:07.636737   723 raft_consensus.cc:2804] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:07.637315   723 raft_consensus.cc:697] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:07.638229   723 consensus_queue.cc:237] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:07.640571 32559 raft_consensus.cc:2749] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:07.642228   733 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:07.642866   733 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:07.644625   420 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:07.645058   733 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:07.645536   613 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.646020   613 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:07.647716   584 raft_consensus.cc:3055] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:07.648214   584 raft_consensus.cc:740] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:07.649205   584 consensus_queue.cc:260] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:07.651294   678 consensus_queue.cc:1048] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:07.601881   686 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:07.655740   686 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:07.658452   420 consensus_queue.cc:1059] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:07.659298   420 consensus_queue.cc:1243] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer f639301059e24dc5b0d88a46dc683326 log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:09:07.659768   420 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.664945 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:07.671181 30625 raft_consensus.cc:2468] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 6.
I20260709 13:09:07.618031   426 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.681660 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:07.671048   530 raft_consensus.cc:3055] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:07.683910 30548 raft_consensus.cc:1275] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:07.684906 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:07.683166   530 raft_consensus.cc:740] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:07.686828   530 consensus_queue.cc:260] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:07.688115   530 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:07.688143 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:07.599411   701 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:07.697175 30591 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:07.698141 30440 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:07.696543   784 log.cc:927] Time spent T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 13:09:07.702622 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:07.691928   426 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:07.707247   706 raft_consensus.cc:3060] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:07.667515   420 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:07.714190   420 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:07.717002   303 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:07.717156 30468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 1536) took 1312 ms. Trace:
I20260709 13:09:07.717573 30468 rpcz_store.cc:276] 0709 13:09:06.405227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.067005 (+661778us) service_pool.cc:224] Handling call
0709 13:09:07.067428 (+   423us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:07.108144 (+ 40716us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:07.108172 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:07.108986 (+   814us) log.cc:844] Serialized 52 byte log entry
0709 13:09:07.265613 (+156627us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:07.269917 (+  4304us) log.cc:844] Serialized 14 byte log entry
0709 13:09:07.270349 (+   432us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.270415 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:07.716959 (+446544us) raft_consensus.cc:1685] finished
0709 13:09:07.716979 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:07.717104 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":220,"prepare.queue_time_us":5317,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":31313,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":198,"thread_start_us":156078,"threads_started":1,"wal-append.queue_time_us":291727}
I20260709 13:09:07.720988   749 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:07.723106   749 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:07.725013   702 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.725554   702 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:07.704285   738 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:07.729703   584 raft_consensus.cc:3060] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:07.732860   686 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:07.733497   686 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:07.734809   580 leader_election.cc:290] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:07.735441   686 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:07.735666 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 60777.8us
I20260709 13:09:07.693046   733 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.712184 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:07.740617 31144 raft_consensus.cc:2468] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9.
I20260709 13:09:07.743134 31149 raft_consensus.cc:3060] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:07.748625 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 51507.8us
I20260709 13:09:07.727593   702 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:07.756552 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 168268us
I20260709 13:09:07.711254   698 raft_consensus.cc:2804] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:07.761034 30468 raft_consensus.cc:1240] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 3. Current term is 4. Ops: []
W20260709 13:09:07.761727 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 56799.4us
I20260709 13:09:07.763952 30617 raft_consensus.cc:2468] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 7.
I20260709 13:09:07.753084   706 raft_consensus.cc:2749] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:07.767552 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:07.773454 30471 raft_consensus.cc:1240] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:07.752802   686 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.756292   614 consensus_queue.cc:1048] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:09:07.780237 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:07.780898 30617 raft_consensus.cc:2468] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 2.
I20260709 13:09:07.781695 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:07.782311 30624 raft_consensus.cc:3060] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:07.759383   678 consensus_queue.cc:1048] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:09:07.785377 30469 raft_consensus.cc:1240] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 6 LEADER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:07.791342 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:07.792104 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:07.798331   426 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:07.800501   686 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:07.801527 30472 raft_consensus.cc:2393] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 6: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:07.802632   686 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:07.767407   738 consensus_queue.cc:1048] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:09:07.805389   613 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:07.805469 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:09:07.773456   786 log.cc:927] Time spent T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.244s	user 0.001s	sys 0.000s
W20260709 13:09:07.813032   792 log.cc:927] Time spent T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:09:07.813947   787 log.cc:927] Time spent T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 13:09:07.815528   701 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:07.817714 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 60452.6us
I20260709 13:09:07.818542 30516 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:07.820073   764 raft_consensus.cc:2749] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:07.821756   764 consensus_queue.cc:1059] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:07.822670   420 raft_consensus.cc:3055] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:07.823048   420 raft_consensus.cc:740] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:07.823998   420 consensus_queue.cc:260] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:07.758389   733 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:07.825001   420 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:07.826539   733 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:07.828724 31114 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:07.830174 31114 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:07.824266 30516 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:07.831552   736 raft_consensus.cc:2804] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:07.832118   736 raft_consensus.cc:697] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 7 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:07.832959   736 consensus_queue.cc:237] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:07.835002   764 consensus_queue.cc:1059] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:07.836130   656 raft_consensus.cc:3055] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:07.836488   656 raft_consensus.cc:740] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:07.837532   584 raft_consensus.cc:2749] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:07.837347   656 consensus_queue.cc:260] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:07.841522 31151 raft_consensus.cc:1240] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:09:07.763540   698 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.844403   698 raft_consensus.cc:3060] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:07.845471   656 raft_consensus.cc:3060] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:07.850307   791 log.cc:927] Time spent T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:09:07.852165   426 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:07.853363 31149 raft_consensus.cc:2468] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 5.
I20260709 13:09:07.853300 32749 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:07.854183   704 raft_consensus.cc:2749] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:07.854735 31144 raft_consensus.cc:2393] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 6: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:07.856590   614 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:07.856650 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 77799.3us
I20260709 13:09:07.857228   614 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:07.858968 31151 raft_consensus.cc:1240] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 4. Current term is 5. Ops: [3.6-4.7]
I20260709 13:09:07.859362   614 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:07.859771 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 71718.2us
I20260709 13:09:07.860746 31142 raft_consensus.cc:1240] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:07.861955 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:07.862742 30470 raft_consensus.cc:2393] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 6: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:07.862757 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:07.863672 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:07.864225 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:07.864780 30549 raft_consensus.cc:3060] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:07.865173 30620 raft_consensus.cc:1240] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:07.866973 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:07.867527 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:07.867751 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:07.868480 31148 raft_consensus.cc:2468] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:09:07.868721 30620 raft_consensus.cc:1275] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:07.868960 30623 raft_consensus.cc:1240] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:07.869923 30618 raft_consensus.cc:1240] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:07.872531 30468 raft_consensus.cc:1275] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:09:07.859390 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:07.873595 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:07.875669 30590 leader_election.cc:304] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:07.876637   749 raft_consensus.cc:2804] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:07.876780 30617 raft_consensus.cc:1240] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:07.877110   749 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.877558   749 raft_consensus.cc:3060] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:07.877789 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:07.878341 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:07.879261 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:07.879804 30544 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:07.880517 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:07.881050 30548 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:07.867558 31145 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:07.884127 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:07.884445   774 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:07.885056   774 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:07.887291   774 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:07.878561 30543 raft_consensus.cc:2393] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 6: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:07.887467   749 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:07.888942 30474 raft_consensus.cc:1240] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 6 LEADER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:07.893546 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:07.895751 30549 raft_consensus.cc:2468] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7.
I20260709 13:09:07.905227 30544 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7.
I20260709 13:09:07.904631 31146 raft_consensus.cc:2468] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 5.
I20260709 13:09:07.906735 30548 raft_consensus.cc:2468] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9.
I20260709 13:09:07.897761 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:07.896757   749 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:07.912662 30624 raft_consensus.cc:2468] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 7.
I20260709 13:09:07.908056 31148 raft_consensus.cc:3060] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:07.917876 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:07.931630 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:07.923657 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:07.933480 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:07.934232 30474 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:07.939294 30624 raft_consensus.cc:1240] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:07.940919 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:07.941627 31149 raft_consensus.cc:2393] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 6: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:07.945688   420 raft_consensus.cc:493] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.946220   420 raft_consensus.cc:515] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:07.946614 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:07.948141 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:07.949950 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:07.950738 30619 raft_consensus.cc:2410] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:07.951686 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:07.952406 30616 raft_consensus.cc:2393] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 6: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:07.952641 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:07.953019 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:07.953151 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:07.953601 30624 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 7.
I20260709 13:09:07.953727 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:07.954084 31148 raft_consensus.cc:2468] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
I20260709 13:09:07.954363 30625 raft_consensus.cc:1240] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:07.954460 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:07.954670 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:07.955199 30545 raft_consensus.cc:1813] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Handling vote request from an unknown peer f639301059e24dc5b0d88a46dc683326
I20260709 13:09:07.955646 30545 raft_consensus.cc:2393] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 3: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:07.955585 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:07.956156 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:07.956581 30624 raft_consensus.cc:2393] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 7: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:07.959091 31145 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7.
I20260709 13:09:07.955360 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:07.955441 30590 leader_election.cc:304] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:07.964846 32749 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:07.953750 30616 raft_consensus.cc:2468] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 3.
I20260709 13:09:07.965329   426 raft_consensus.cc:2804] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:07.965839   426 raft_consensus.cc:697] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:07.966822   426 consensus_queue.cc:237] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:07.967285 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:07.968428 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:07.968963 30472 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:07.953344 30623 raft_consensus.cc:2393] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 7: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:07.970153 30589 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:07.972401 30590 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:07.971803 31114 connection.cc:256] RPC call timeout handler was delayed by -1.3167817099998729s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19010000000000002s for a response
I20260709 13:09:07.964902   420 leader_election.cc:290] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:07.980939   614 raft_consensus.cc:2804] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:07.968535   774 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:07.982012   774 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:07.982903 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:07.983309 30516 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:09:07.983565 31148 raft_consensus.cc:2468] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 3.
I20260709 13:09:07.984915 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:07.985002 30546 raft_consensus.cc:2468] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 8.
I20260709 13:09:07.986056 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:07.987361 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:07.987987 30542 raft_consensus.cc:3060] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:07.990041   764 raft_consensus.cc:2804] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:07.990463   764 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:07.990829   764 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:07.940171 31142 raft_consensus.cc:2468] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 6.
I20260709 13:09:07.976450   678 raft_consensus.cc:493] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:07.994069   420 consensus_queue.cc:1059] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:08.000020 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:07.999693   614 raft_consensus.cc:697] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:08.016115 30470 raft_consensus.cc:1240] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:08.017098 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:08.017235 30516 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:08.018380 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:08.018087   614 consensus_queue.cc:237] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:08.024008   530 consensus_queue.cc:1059] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:08.025715   656 consensus_queue.cc:1059] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:08.026818   656 raft_consensus.cc:2804] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:08.027249   656 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.001048 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:08.031332 30542 raft_consensus.cc:2468] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 4.
I20260709 13:09:08.032349 31114 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:08.027695   656 raft_consensus.cc:3060] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:07.979518   723 raft_consensus.cc:2749] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:07.983978   774 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:08.028625   420 raft_consensus.cc:3055] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:08.066032 30472 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 6.
W20260709 13:09:08.067354 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 73369.4us
I20260709 13:09:08.070508 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:08.069571   584 consensus_queue.cc:1059] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:09:08.061966   420 raft_consensus.cc:740] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:08.080945   584 raft_consensus.cc:3055] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:08.081375   584 raft_consensus.cc:740] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:08.081228   420 consensus_queue.cc:260] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:08.082743   420 raft_consensus.cc:3060] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:08.086905 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:08.087957 30470 raft_consensus.cc:2393] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 5: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:08.088352 30474 raft_consensus.cc:2468] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
I20260709 13:09:07.990052   698 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:07.994724   678 raft_consensus.cc:515] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:08.060534   701 raft_consensus.cc:2804] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:08.103754 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:08.105053   678 leader_election.cc:290] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:08.059439   764 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:08.090840   736 raft_consensus.cc:3055] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:08.114390 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:08.117025 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 84769us
I20260709 13:09:08.097229   701 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:08.087531   584 consensus_queue.cc:260] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:08.120982 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:09:08.119361 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 102168us
I20260709 13:09:08.124862 30617 raft_consensus.cc:2393] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 6: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:08.126169 30547 raft_consensus.cc:1240] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:09:08.128448 30516 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:08.113891   736 raft_consensus.cc:740] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:08.133965 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:08.119094   701 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:08.234127 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:08.235107 30474 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 7.
I20260709 13:09:08.235256 30470 raft_consensus.cc:2468] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 6.
W20260709 13:09:08.234872 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.237166 30548 raft_consensus.cc:1275] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:09:08.238816 30441 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:08.243338 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:08.245652 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:08.248152   733 raft_consensus.cc:3055] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:08.248579   733 raft_consensus.cc:740] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:08.249396   733 consensus_queue.cc:260] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:08.250744   733 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:08.253172   678 raft_consensus.cc:2749] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:08.251247   698 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:08.239100 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 122484us
I20260709 13:09:08.267303 31114 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:08.273942   656 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:08.279800 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 45103us
W20260709 13:09:08.290216 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 51571.6us
W20260709 13:09:08.297065 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:08.300432 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.275902   702 raft_consensus.cc:2804] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:08.307507 30547 raft_consensus.cc:1240] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:08.308298 30545 raft_consensus.cc:1240] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:08.306746 30589 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:08.318547   722 raft_consensus.cc:2804] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:08.319100   722 raft_consensus.cc:697] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:08.319824 30589 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:08.319998   722 consensus_queue.cc:237] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:08.321574   753 raft_consensus.cc:2804] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:08.321925   753 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.322266   753 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:08.324126   764 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:08.325138 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 57935.4us
I20260709 13:09:08.325897 31114 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:08.326658   692 raft_consensus.cc:2749] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:08.327505 31114 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:09:08.343327 30441 leader_election.cc:304] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:08.345266 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:08.346081 30542 raft_consensus.cc:2410] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:09:08.310791   808 raft_consensus.cc:2749] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:08.332790   702 raft_consensus.cc:697] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 6 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:08.359062   806 consensus_queue.cc:1059] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:08.340507   420 consensus_queue.cc:1059] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
W20260709 13:09:08.368320 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 48594us
I20260709 13:09:08.347612   763 raft_consensus.cc:2804] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:08.355010   678 raft_consensus.cc:2804] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:08.351227   656 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:08.379185 30547 raft_consensus.cc:1275] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:08.397604 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:08.398816 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:08.347877   698 consensus_queue.cc:1059] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
W20260709 13:09:08.401918 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.368986   686 consensus_queue.cc:1059] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:09:08.366114   764 consensus_queue.cc:1048] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:09:08.395498   678 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:08.424355 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:08.376928   426 consensus_queue.cc:1059] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
W20260709 13:09:08.412545   809 log.cc:927] Time spent T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 13:09:08.435109 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 60946us
I20260709 13:09:08.438126 30441 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:08.430778   678 raft_consensus.cc:3060] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:08.405035   656 consensus_queue.cc:1059] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:09:08.442692   702 consensus_queue.cc:237] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:08.442458   426 raft_consensus.cc:3055] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:08.459214   426 raft_consensus.cc:740] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:08.461524 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:08.461895   753 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:08.467358   584 raft_consensus.cc:3060] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:08.491314 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:08.492455 30440 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:08.497895 30547 raft_consensus.cc:1275] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:09:08.502327 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 131838us
I20260709 13:09:08.506966 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:08.505540 30516 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:08.484418   733 raft_consensus.cc:3055] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:08.516928 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:08.517511 30542 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:08.493517   753 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:08.460217   426 consensus_queue.cc:260] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:08.513875   733 raft_consensus.cc:740] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:08.519620   698 raft_consensus.cc:2804] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:08.523891   764 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.497431   701 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:08.547628 30542 raft_consensus.cc:2468] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
I20260709 13:09:08.555653   807 raft_consensus.cc:3055] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:08.556147   807 raft_consensus.cc:740] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:08.556332   824 raft_consensus.cc:2804] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:08.556790   824 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.557096   824 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:08.557006   807 consensus_queue.cc:260] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:08.558351   807 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:08.544936   818 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.544721   764 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:08.564361   818 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:08.551595   827 raft_consensus.cc:2749] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:08.569092   698 raft_consensus.cc:697] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 9 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
W20260709 13:09:08.589464 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 97071.5us
I20260709 13:09:08.582455   530 consensus_queue.cc:1059] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:09:08.590386 30440 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:08.580457   763 raft_consensus.cc:697] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:08.593984   822 raft_consensus.cc:3055] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:08.594393   822 raft_consensus.cc:740] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:08.595220   822 consensus_queue.cc:260] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:08.596799   698 consensus_queue.cc:237] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:08.602840   701 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:08.603896   818 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:08.607076   763 consensus_queue.cc:237] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:08.609406   764 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:08.630014 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:08.641369 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 185478us
I20260709 13:09:08.642109 30441 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd
W20260709 13:09:08.646932 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 135681us
I20260709 13:09:08.648502 30516 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:08.651407 30516 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:08.641868   614 raft_consensus.cc:493] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:08.664549 30516 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:08.659984   764 raft_consensus.cc:2749] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:08.669405   828 raft_consensus.cc:3060] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:08.672571   420 raft_consensus.cc:3055] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:08.672987   420 raft_consensus.cc:740] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:08.673913   420 consensus_queue.cc:260] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:08.674959   420 raft_consensus.cc:3060] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:08.697134 30517 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.898s (SENT) [suppressed 14 similar messages]
W20260709 13:09:08.699041 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 64176.6us
I20260709 13:09:08.665236   807 raft_consensus.cc:2749] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:08.704588 30516 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:08.704020   764 raft_consensus.cc:2749] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:08.705767   835 raft_consensus.cc:2749] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:08.706126   471 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.706657   471 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:08.708822   471 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:08.713593   580 consensus_queue.cc:1048] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:08.713802   829 consensus_queue.cc:1059] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:09:08.714928   829 raft_consensus.cc:2804] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:08.715498   829 raft_consensus.cc:697] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 5 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:08.716663   829 consensus_queue.cc:237] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:08.720136 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:08.724226 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:08.725340 30551 raft_consensus.cc:2410] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:09:08.726425   686 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.727118   686 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:08.736824 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:08.734359 30589 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:08.653465   733 consensus_queue.cc:260] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:08.746308 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:08.747234 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:08.747882 31149 raft_consensus.cc:3060] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:08.750231 30516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:08.750761 30516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.754091 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:08.754665 30620 raft_consensus.cc:3060] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:08.754884 31114 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:08.755232 30625 raft_consensus.cc:1240] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:08.755983   763 raft_consensus.cc:2749] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:08.756691 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:08.757267 30625 raft_consensus.cc:2468] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
I20260709 13:09:08.761559 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:08.761826 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:08.762588 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:08.677196   614 raft_consensus.cc:515] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:08.821110 30621 raft_consensus.cc:1275] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:08.823041   736 consensus_queue.cc:260] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:08.824162   736 raft_consensus.cc:3060] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:08.712028   753 consensus_queue.cc:1059] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:09:08.823797 31149 raft_consensus.cc:2468] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:09:08.713841   678 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:08.766134   749 raft_consensus.cc:2804] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:08.829030 30516 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:08.835438 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:08.838542 30472 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:08.832129 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 135042us
W20260709 13:09:08.832012 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 189971us
I20260709 13:09:08.841939 30441 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:08.744547   670 consensus_queue.cc:1048] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 13:09:08.849926 30620 raft_consensus.cc:2468] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:09:08.850266 30516 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:08.764617   825 consensus_queue.cc:1048] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 13:09:08.855908 31149 raft_consensus.cc:1275] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:08.857918 30620 raft_consensus.cc:1240] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:08.846701   807 raft_consensus.cc:2804] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:08.867070 30472 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 5.
W20260709 13:09:08.867753 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 56835.3us
I20260709 13:09:08.861604   807 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.860649   580 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.846688   702 consensus_queue.cc:1048] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:09:08.859699   835 raft_consensus.cc:2804] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:09:08.885908 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.887187 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:09:08.896821 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:08.897850 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 157233us
I20260709 13:09:08.878664   807 raft_consensus.cc:3060] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:08.912637 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.914014 31115 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:08.873045   764 consensus_queue.cc:1059] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:09:08.927891 31115 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:08.928673 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 67421us
I20260709 13:09:08.917887 31145 raft_consensus.cc:2468] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 6.
I20260709 13:09:08.924660 31144 raft_consensus.cc:1275] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:08.924764   614 leader_election.cc:290] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:08.880796   420 consensus_queue.cc:1059] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:09:08.926301   686 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:08.896591   749 raft_consensus.cc:697] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:08.934777 30546 raft_consensus.cc:1240] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:09:08.934981   821 raft_consensus.cc:2749] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:08.935710   820 raft_consensus.cc:3055] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:08.935911 31151 raft_consensus.cc:1240] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:09:08.908629   835 raft_consensus.cc:697] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:09.056306   835 consensus_queue.cc:237] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:08.994098 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:09:08.992519 30517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.979063 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:09:09.067504   840 log.cc:927] Time spent T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.245s	user 0.000s	sys 0.001s
I20260709 13:09:09.071254   774 raft_consensus.cc:3055] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:09.071749   774 raft_consensus.cc:740] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:09.072351   426 raft_consensus.cc:3060] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:09.072675   774 consensus_queue.cc:260] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:09.073748   774 raft_consensus.cc:3060] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:09.075771   807 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:09.083653   822 raft_consensus.cc:3060] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:08.930245   839 raft_consensus.cc:2804] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:09.084013   698 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:09.084606   698 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:09.031733   829 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:09.084649   839 raft_consensus.cc:697] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 5 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:09.086229   829 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:09.086843   698 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:09.087102   839 consensus_queue.cc:237] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:08.932027   674 raft_consensus.cc:2749] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:09.051155 30625 raft_consensus.cc:1275] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:09:09.053956 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.091902 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:09.092334   753 raft_consensus.cc:493] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:09.092546 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:09.092929   753 raft_consensus.cc:515] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:09.093847   692 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:09.094691   818 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:09.095252   753 leader_election.cc:290] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133)
I20260709 13:09:09.095182   818 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:09.096191 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:09.097244 30625 raft_consensus.cc:2410] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:09:09.080854   846 raft_consensus.cc:493] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:09.077020   749 consensus_queue.cc:237] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:09.082319   828 raft_consensus.cc:2749] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:08.898833   580 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:08.978699 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:09.088354   829 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:09.094363   692 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:09.097187   818 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:09.081832 31149 raft_consensus.cc:1275] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:08.879855   824 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:09.109696 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:09.111575 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:09.054940   820 raft_consensus.cc:740] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:09.118676 30620 raft_consensus.cc:2393] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 9: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
W20260709 13:09:09.125182 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 119622us
I20260709 13:09:09.126163 30441 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:09.116225   698 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.106814   753 consensus_queue.cc:1048] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:09:09.107719   846 raft_consensus.cc:515] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:09.132436   692 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:09.135874   797 consensus_queue.cc:1048] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.153s
I20260709 13:09:09.137632   824 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:09.139236 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:09.181843 30620 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 7.
I20260709 13:09:09.139371   698 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:09.140718   841 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:09.141811 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:09.143915 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.146111   580 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:09.123557   828 consensus_queue.cc:1048] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:09:09.121249 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:09.156093   820 consensus_queue.cc:260] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:09.157119 31148 raft_consensus.cc:1240] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:09.159214   678 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:09.206775 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:09.207472 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:09.165257 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:09.124576   829 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:09.178589 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 55112us
I20260709 13:09:09.183282 30548 raft_consensus.cc:1240] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:09.153851   807 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:09.201431 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 76003.9us
I20260709 13:09:09.204048 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:09.226151 30616 raft_consensus.cc:2410] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:09:09.205041 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:09.227941 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.177920   686 raft_consensus.cc:2804] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:09.160166 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:09.208581 31149 raft_consensus.cc:2410] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:09:09.212455   846 leader_election.cc:290] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:09.214720   845 log.cc:927] Time spent T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
W20260709 13:09:09.220655   844 log.cc:927] Time spent T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.226s	user 0.003s	sys 0.000s
I20260709 13:09:09.176826   798 consensus_queue.cc:1048] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:09:09.240504 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:09.240567 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:09.242122 30547 raft_consensus.cc:1275] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:09.244287   798 raft_consensus.cc:493] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.257040 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:09.257243 30441 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:09.259660 30549 raft_consensus.cc:1275] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:09:09.249172   686 raft_consensus.cc:697] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 6 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:09.262646   686 consensus_queue.cc:237] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:09.244783   530 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.248142   828 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:09.276687 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 88525.7us
I20260709 13:09:09.278331 30589 leader_election.cc:304] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:09.281370   846 raft_consensus.cc:2749] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:09.234069   829 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:09.193639   841 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:09.251569   670 consensus_queue.cc:1059] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:09:09.306550 30589 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:09.251251   839 consensus_queue.cc:1059] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:09:09.282099   828 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:09.309216   614 raft_consensus.cc:2749] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:09:09.348681   736 consensus_meta.cc:287] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.516s	user 0.006s	sys 0.003s
I20260709 13:09:09.348579   580 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:09.352480   580 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:09.250437   798 raft_consensus.cc:515] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:09.349237   722 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.360761   847 raft_consensus.cc:3055] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:09.361199   847 raft_consensus.cc:740] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:09.361721   798 leader_election.cc:290] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:09.361985   847 consensus_queue.cc:260] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:09.279134   530 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:09.351354   749 raft_consensus.cc:2749] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:09.372792 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.385469   847 raft_consensus.cc:3060] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:09.385653   831 log.cc:927] Time spent T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.563s	user 0.000s	sys 0.002s
I20260709 13:09:09.393307   798 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.406322   471 raft_consensus.cc:3055] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:09.451006   471 raft_consensus.cc:740] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:09.452436   530 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:09.452210   471 consensus_queue.cc:260] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:09.453706 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.360777   722 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:09.455929   798 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:09.545785 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 288570us
I20260709 13:09:09.546659 30441 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:09.589797   736 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.590538   736 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:09.603685 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 325642us
W20260709 13:09:09.616554 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:09.620813 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 74245.6us
I20260709 13:09:09.621917 30441 leader_election.cc:304] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:09.623155 30441 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:09.613163   471 raft_consensus.cc:3060] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:09.613839   698 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:09.607909   847 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:09:09.652930 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.660975 30441 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:09.662875 30517 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:09.620934   820 raft_consensus.cc:3060] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:09.615032   733 raft_consensus.cc:3060] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:09.624246   706 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.010s	sys 0.025s
I20260709 13:09:09.625725   736 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:09.670897 30441 leader_election.cc:304] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:09.626091   774 raft_consensus.cc:2804] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:09.666659   807 raft_consensus.cc:2749] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:09.691217   764 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.625454   836 raft_consensus.cc:2804] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:09.690373 30517 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:09.664613   846 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.676419   678 raft_consensus.cc:2749] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:09.677845   698 raft_consensus.cc:2804] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:09.699700 30517 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:09.693372   706 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.011s	sys 0.051s
I20260709 13:09:09.697418   774 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
W20260709 13:09:09.701763   843 log.cc:927] Time spent T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.707s	user 0.000s	sys 0.002s
I20260709 13:09:09.690518   829 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:09.708814   846 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:09.696331   580 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:09.697636   764 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:09.669390   847 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:09.754868 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 55243.8us
I20260709 13:09:09.785185 30517 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
W20260709 13:09:09.770455 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.698850   836 raft_consensus.cc:493] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:09.789587   836 raft_consensus.cc:3060] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:09.753387   807 raft_consensus.cc:2749] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:09.763878   736 raft_consensus.cc:2804] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:09.771912   678 raft_consensus.cc:2749] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:09.791402   678 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.773041   774 raft_consensus.cc:3060] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:09.791857   678 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:09.793829   678 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:09.788628   764 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:09.795038   736 raft_consensus.cc:697] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 5 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:09.795974   736 consensus_queue.cc:237] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:09.802414   818 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.802951   818 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:09.804339 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:09.806356 32749 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:09.806862 32749 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:09.807525   846 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:09.764552   851 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.808279 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:09.771340   698 raft_consensus.cc:697] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 7 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:09.810143   698 consensus_queue.cc:237] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:09.813007   821 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
W20260709 13:09:09.818888 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.821099 30517 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:09.811571   830 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:09.830137 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 159303us
I20260709 13:09:09.831141 30441 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:09.704123   834 consensus_queue.cc:1048] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.122s
I20260709 13:09:09.808238   851 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:09.825309   764 raft_consensus.cc:2749] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:09.826393   733 raft_consensus.cc:2764] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:09:09.813692   821 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:09.829270   829 consensus_queue.cc:1048] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:09:09.859416   722 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:09.854974 31148 raft_consensus.cc:1240] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:09:09.860627 32749 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:09.849990   870 consensus_queue.cc:1048] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:09:09.865916   851 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:09.856698   764 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.866899   764 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:09.871061 30516 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:09.872957   847 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:09.874132   847 raft_consensus.cc:2804] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:09.874617   847 raft_consensus.cc:697] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 6 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:09.875751   828 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:09.878162 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:09.880141 31114 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:09.881624   846 raft_consensus.cc:2749] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:09.883267   821 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:09.883697 31146 raft_consensus.cc:1275] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:09.884719 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:09.887068   798 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:09.875507   847 consensus_queue.cc:237] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:09.887926   841 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:09.890441 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:09.891232 30542 raft_consensus.cc:2410] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:09:09.892222 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:09.894212 30543 raft_consensus.cc:1275] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:09.894445   701 raft_consensus.cc:2749] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:09.899466   825 raft_consensus.cc:3055] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:09.899922   825 raft_consensus.cc:740] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:09.900749   825 consensus_queue.cc:260] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:09.901682   825 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:09.904734 31151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48426 (request call id 628) took 1191 ms. Trace:
I20260709 13:09:09.905122 31151 rpcz_store.cc:276] 0709 13:09:08.712926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.713053 (+   127us) service_pool.cc:224] Handling call
0709 13:09:08.713784 (+   731us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:09.069506 (+355722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.904483 (+834977us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b5400500354. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:09.904653 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":510298368}
I20260709 13:09:09.907253 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:09.907737 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:09.909157   774 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:09.913667 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:09.914268 30549 raft_consensus.cc:2468] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 7.
I20260709 13:09:09.914458   836 raft_consensus.cc:515] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:09.921162   580 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.921317   614 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.921841   580 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:09.833199   830 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:09.925508   580 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:09:09.921200 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 54390.3us
I20260709 13:09:09.926926   797 raft_consensus.cc:3055] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:09.927333   797 raft_consensus.cc:740] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:09.921911   614 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:09.929394 30545 raft_consensus.cc:1275] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:09:09.929834   614 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:09.930553 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:09.931111 30620 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:09.931131 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:09.931773 30545 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:09:09.933575 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:09.937835 30620 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 8.
I20260709 13:09:09.939234 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:09.934185 30549 raft_consensus.cc:2468] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:09:09.943979   704 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.952091 30623 raft_consensus.cc:2468] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
I20260709 13:09:09.952457   704 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:09.953030 31148 raft_consensus.cc:1275] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:09:09.954023   674 consensus_queue.cc:1048] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:09.955145   704 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:09.944090 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:09.957062 30625 raft_consensus.cc:1275] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:09.957448 30616 raft_consensus.cc:3060] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:09.957772   851 consensus_queue.cc:1048] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:09.944564 31114 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:09.960503   836 leader_election.cc:290] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:09.961369 31114 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:09.963099   856 raft_consensus.cc:2749] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:09.963290 30473 raft_consensus.cc:1275] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:09:09.963594 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:09.963742   856 raft_consensus.cc:2804] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:09.963637 30473 pending_rounds.cc:85] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326: Aborting all ops after (but not including) 5
I20260709 13:09:09.964872 30473 pending_rounds.cc:107] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:09:09.965139 30473 raft_consensus.cc:2889] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:09.964614   856 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:09.966380   856 raft_consensus.cc:3060] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:09.967952 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.961470   774 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:09.972033 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:09.968948   797 consensus_queue.cc:260] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:09.980211 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:09.981420   818 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:09.983752 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:09.983790 30543 raft_consensus.cc:2468] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 4.
I20260709 13:09:09.991482 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:09.991642 30616 raft_consensus.cc:2468] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 6.
I20260709 13:09:09.999249 30625 raft_consensus.cc:2468] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 7.
I20260709 13:09:10.000809 31115 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:10.001747 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:10.002468 30623 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 9.
I20260709 13:09:09.983004 31142 raft_consensus.cc:2468] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
I20260709 13:09:10.007903 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:10.010156 31151 raft_consensus.cc:2393] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 5: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:10.011530 31114 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:09.990132 32749 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.034363 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:10.033072 30473 raft_consensus.cc:1240] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:10.037706 30589 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:10.045997 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:10.049680 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:10.057122 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:10.019012   846 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:10.059165 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 50010.9us
I20260709 13:09:10.059497 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:10.067793 31116 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:10.045727   670 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.036342   774 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.070731 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:10.055351 30589 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:10.060696 30549 raft_consensus.cc:3060] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:10.061269 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:10.072518 30545 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 6.
I20260709 13:09:10.063977 30551 raft_consensus.cc:1275] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:10.064267 30546 raft_consensus.cc:1240] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:09:10.064515 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:10.064744 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 233677us
I20260709 13:09:10.065212   876 raft_consensus.cc:493] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.080020 30441 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:10.080415   876 raft_consensus.cc:515] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:10.081594 30441 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:10.082515   870 raft_consensus.cc:2749] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:10.083216   870 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:10.083014 30441 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:10.084232   879 raft_consensus.cc:2749] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:10.086202 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:10.086458 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:10.086760 30472 raft_consensus.cc:3060] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:10.086995 30468 raft_consensus.cc:3060] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:10.090723   870 raft_consensus.cc:2749] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:10.036820   818 raft_consensus.cc:2804] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:10.093685 30472 raft_consensus.cc:2410] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:10.093775 30468 raft_consensus.cc:2468] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
W20260709 13:09:10.094547 30591 leader_election.cc:336] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.744s (SENT)
I20260709 13:09:10.099923 30440 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:10.100529 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:10.104592 30470 raft_consensus.cc:2468] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 7.
I20260709 13:09:10.113852 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:10.051873   704 raft_consensus.cc:2804] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:10.118330 30468 raft_consensus.cc:1240] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:09:10.125588 30591 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:10.128079 30548 raft_consensus.cc:2368] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 5. Current term is 6.
W20260709 13:09:10.130343 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 60950us
I20260709 13:09:10.133025   887 consensus_queue.cc:1059] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:10.066288   614 raft_consensus.cc:2804] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:09:10.140836 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 129183us
I20260709 13:09:10.118726 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:10.142428 30469 raft_consensus.cc:1275] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:10.142539 30474 raft_consensus.cc:1275] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:09:10.057199   830 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:10.070163   701 raft_consensus.cc:2749] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:10.050647   867 consensus_queue.cc:1048] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:09:10.129483   736 consensus_queue.cc:1048] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:10.093523   797 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:10.047278 32749 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:10.102864   818 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.102350   814 raft_consensus.cc:2804] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:10.157912   847 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.160431   888 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.161337 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:10.184597 30470 raft_consensus.cc:2468] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:09:10.126489   704 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.142792   836 raft_consensus.cc:2804] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:10.171551 30549 raft_consensus.cc:1275] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:10.116281   670 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:10.144994   614 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.093228   846 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:10.116108   774 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:10.181174 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:10.190021 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 58758.1us
I20260709 13:09:10.201560 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:10.143443   584 consensus_queue.cc:1048] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
W20260709 13:09:10.209015 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 114512us
I20260709 13:09:10.195086 31146 raft_consensus.cc:2468] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:09:10.208230   614 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:10.193382 30547 raft_consensus.cc:2468] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
I20260709 13:09:10.178954   830 raft_consensus.cc:3055] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:10.165432   706 raft_consensus.cc:2749] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:10.186132 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:10.217476 30469 raft_consensus.cc:3060] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:10.182241   818 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:10.180392   814 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.235265 30440 leader_election.cc:400] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 5. Current term is 6.
I20260709 13:09:10.235623 30440 leader_election.cc:403] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:10.236547 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:10.215723 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:10.238418 30470 raft_consensus.cc:2393] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 6: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:10.214058 30589 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:10.151163   839 consensus_queue.cc:1048] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:09:10.188894   888 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:10.214207   830 raft_consensus.cc:740] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
W20260709 13:09:10.241639 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 94808.6us
I20260709 13:09:10.224870   846 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:10.247493 30468 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
I20260709 13:09:10.226621   774 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:10.227121   674 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.228003 30516 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:10.188844   704 raft_consensus.cc:3060] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:10.188270   836 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.253458 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:10.257632 30516 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:10.241767   701 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.241950   814 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:10.244159   698 raft_consensus.cc:3060] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:10.263034 30516 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:10.264348 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:10.267956   530 consensus_queue.cc:1048] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:10.256223   674 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:10.272802   706 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:10.273980   674 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:10.275069   830 consensus_queue.cc:260] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:10.276669   830 raft_consensus.cc:3060] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:10.277143 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:10.279443   891 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:10.279963   891 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:10.282008   891 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:10.273507   706 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:10.284646   706 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:10.259233   836 raft_consensus.cc:3060] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:10.292415   701 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:10.295207   701 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:10.262506   736 raft_consensus.cc:2804] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:10.300441   736 raft_consensus.cc:697] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 8 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:10.188154   847 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:10.301386 30469 raft_consensus.cc:2468] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7.
I20260709 13:09:10.300089   856 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:10.253410   722 raft_consensus.cc:2804] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:09:10.306061 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 43591.1us
I20260709 13:09:10.325464 30473 raft_consensus.cc:2468] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7.
W20260709 13:09:10.320864 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 57953.9us
I20260709 13:09:10.328675 30516 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:10.330084 30516 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:10.306412 30468 raft_consensus.cc:1240] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:09:10.336724 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:10.337517 30470 raft_consensus.cc:2468] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 6.
I20260709 13:09:10.248546   834 consensus_queue.cc:1048] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:09:10.342314   888 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:10.343912   847 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:10.345516   856 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:09:10.347359 31116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.351980 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:10.348491 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:10.352823 30468 raft_consensus.cc:2468] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:09:10.348409 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:10.320281   722 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.357978 31116 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:10.359225 30473 raft_consensus.cc:2468] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 6.
W20260709 13:09:10.357443 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 188589us
I20260709 13:09:10.334710   851 raft_consensus.cc:2749] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:10.365218 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:10.376705 30620 raft_consensus.cc:2468] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 7.
I20260709 13:09:10.304036   892 raft_consensus.cc:2804] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:10.347955   886 raft_consensus.cc:2804] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:10.394127 30470 raft_consensus.cc:1240] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:10.347718   889 raft_consensus.cc:2804] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:09:10.398208 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.375613   722 raft_consensus.cc:3060] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:10.394594 31116 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:10.394819 31115 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:10.399791 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:10.401829 30473 raft_consensus.cc:3060] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:10.404492 30474 raft_consensus.cc:2410] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:09:10.379366   892 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.399582   889 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.404248   856 raft_consensus.cc:2804] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:10.405009   886 raft_consensus.cc:697] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 6 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:10.419564   851 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.409492 32749 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:10.489831 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:10.498533 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
W20260709 13:09:10.505591 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 169875us
I20260709 13:09:10.424572   704 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:10.429440 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
W20260709 13:09:10.497867 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 103345us
I20260709 13:09:10.508247 30516 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:10.434695   814 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:10.436149 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:10.436333 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:10.437500   891 raft_consensus.cc:2804] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:10.437980 30475 raft_consensus.cc:1275] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:10.400890   736 consensus_queue.cc:237] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:10.439754   670 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:10.443895   614 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:10.424383   851 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:10.420753   856 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.418684   889 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:10.416179   892 raft_consensus.cc:3060] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:10.448326   763 raft_consensus.cc:2804] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:10.449090 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:10.559309 30468 raft_consensus.cc:2410] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 13:09:10.451860   861 log.cc:927] Time spent T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.418s	user 0.003s	sys 0.006s
W20260709 13:09:10.452236 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.559387 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:10.429257   886 consensus_queue.cc:237] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:10.453550 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:10.461874   836 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:10.466004   818 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:10.472054   698 raft_consensus.cc:2749] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 5. Current term is 6.
I20260709 13:09:10.553927 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:10.477706 30370 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47208 (request call id 186) took 4526 ms. Trace:
I20260709 13:09:10.463124   722 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:10.425876 30473 raft_consensus.cc:2468] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
I20260709 13:09:10.520993 30471 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7.
I20260709 13:09:10.557337   856 raft_consensus.cc:3060] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:10.544700 31148 raft_consensus.cc:1275] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:10.553772 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:10.483765   764 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:10.563557 31150 raft_consensus.cc:2468] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 6.
I20260709 13:09:10.545195   888 raft_consensus.cc:2804] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:09:10.555886   909 log.cc:927] Time spent T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:09:10.531368   891 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:10.474992 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:10.628122 30625 raft_consensus.cc:1275] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:09:10.558768   763 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.594664 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:10.647998 30472 raft_consensus.cc:1275] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:10.627204 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:10.587242 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:10.716810 30625 pending_rounds.cc:85] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79: Aborting all ops after (but not including) 2
I20260709 13:09:10.538043 30590 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:10.569053 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 174291us
I20260709 13:09:10.623587 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:10.717273 30625 pending_rounds.cc:107] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:09:10.717635 30625 raft_consensus.cc:2889] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:10.718192 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:10.719307 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:10.586905 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:10.720072 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:10.590924   860 consensus_queue.cc:1059] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 13:09:10.652064 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:10.570029 31146 raft_consensus.cc:1240] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:10.570413 30474 raft_consensus.cc:2376] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5. Re-sending same reply.
I20260709 13:09:10.568903   733 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:10.662248 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:10.665858   888 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.575256 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:10.716715 30623 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 6.
I20260709 13:09:10.626361 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:10.718412 30469 raft_consensus.cc:2410] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:09:10.858127 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:10.858460 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:10.859485 30468 raft_consensus.cc:2376] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9. Re-sending same reply.
I20260709 13:09:10.860921 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:10.861714 30468 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:10.862152 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.640434 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:10.696425 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:10.720777 30619 raft_consensus.cc:2468] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 5.
I20260709 13:09:10.651777 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:10.721838 30544 raft_consensus.cc:2468] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:09:10.695123 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:10.697770 30470 raft_consensus.cc:2368] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 6. Current term is 7.
I20260709 13:09:10.658190 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:10.725255 30543 raft_consensus.cc:2468] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:09:10.654085 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:10.866369 31151 raft_consensus.cc:2393] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 8: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:10.727943 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:10.703436 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:10.652017   704 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:09:10.784960 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 57248us
I20260709 13:09:10.869982 30469 raft_consensus.cc:2468] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 6.
I20260709 13:09:10.870878 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:10.648620 30370 rpcz_store.cc:276] 0709 13:09:05.951543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.951704 (+   161us) service_pool.cc:224] Handling call
0709 13:09:10.477610 (+4525906us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:08.088564 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:08.213047 (+124483us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:08.213102 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:09:08.213139 (+    37us) tablet.cc:662] Decoding operations
0709 13:09:08.255280 (+ 42141us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:08.255380 (+   100us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:08.255408 (+    28us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:09:08.257357 (+  1949us) tablet.cc:701] Row locks acquired
0709 13:09:08.257432 (+    75us) write_op.cc:260] PREPARE: finished
0709 13:09:08.257644 (+   212us) write_op.cc:270] Start()
0709 13:09:08.257901 (+   257us) write_op.cc:276] Timestamp: P: 1783602548257556 usec, L: 0
0709 13:09:08.257946 (+    45us) op_driver.cc:348] REPLICATION: starting
0709 13:09:08.296390 (+ 38444us) log.cc:844] Serialized 6234 byte log entry
0709 13:09:08.767242 (+470852us) op_driver.cc:464] REPLICATION: finished
0709 13:09:09.239952 (+472710us) write_op.cc:301] APPLY: starting
0709 13:09:09.240046 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:09.240369 (+   323us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:09.240485 (+   116us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:09.242437 (+  1952us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:09.242778 (+   341us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 13:09:09.242823 (+    45us) write_op.cc:312] APPLY: finished
0709 13:09:09.243291 (+   468us) log.cc:844] Serialized 113 byte log entry
0709 13:09:09.243485 (+   194us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:09.243655 (+   170us) write_op.cc:454] Released schema lock
0709 13:09:09.243728 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:09.308330 (+ 64602us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:09.327610 (+ 19280us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":54531,"reported_tablets":26,"spinlock_wait_cycles":537472,"child_traces":[["op",{"apply.queue_time_us":370996,"apply.run_cpu_time_us":4358,"apply.run_wall_time_us":27246,"num_ops":16,"prepare.queue_time_us":227511,"prepare.run_cpu_time_us":38223,"prepare.run_wall_time_us":355979,"raft.queue_time_us":149452,"raft.run_cpu_time_us":53901,"raft.run_wall_time_us":395160,"replication_time_us":480532,"thread_start_us":623883,"threads_started":4,"wal-append.queue_time_us":188990,"wal-append.run_cpu_time_us":37482,"wal-append.run_wall_time_us":1740701}]]}
I20260709 13:09:10.672008   764 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.784878 31146 raft_consensus.cc:1275] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:09:10.786114 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:10.836293   888 raft_consensus.cc:3060] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:10.872999 31114 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:10.559702   670 consensus_queue.cc:1048] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.153s
I20260709 13:09:10.557629   797 consensus_queue.cc:1048] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.143s
I20260709 13:09:10.739446 31142 raft_consensus.cc:2393] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 6: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:10.720112   891 raft_consensus.cc:3060] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:10.837453 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:10.702239   818 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:10.725237   763 raft_consensus.cc:3060] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:10.896951 30468 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 8.
I20260709 13:09:10.850126 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:10.854409 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:10.864645 30473 raft_consensus.cc:2468] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
I20260709 13:09:10.868741 30471 raft_consensus.cc:2410] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 13:09:10.855331   880 log.cc:927] Time spent T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:09:10.838649   900 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:10.875607 31114 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:10.882356 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:10.950819 30469 raft_consensus.cc:2376] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7. Re-sending same reply.
I20260709 13:09:10.851414   902 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:10.879467 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 359558us
W20260709 13:09:10.893352   910 log.cc:927] Time spent T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:09:10.953683 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:10.954267 30471 raft_consensus.cc:2468] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:09:10.954851 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:10.955214 30471 raft_consensus.cc:2468] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:09:10.894353 31150 raft_consensus.cc:2468] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
I20260709 13:09:10.880647 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:10.798784 30616 raft_consensus.cc:2393] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 7: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:10.946321 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:10.956413 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:10.956657 30468 raft_consensus.cc:2376] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 6. Re-sending same reply.
I20260709 13:09:10.957087 30471 raft_consensus.cc:2393] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 6: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:10.957444 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:10.957645 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:10.958119 30468 raft_consensus.cc:2393] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 6: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:10.959060 30620 raft_consensus.cc:1240] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 LEADER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:10.959277 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:10.952587 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:10.952962 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:10.947945 30625 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:10.961282 30467 raft_consensus.cc:2393] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 6: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:10.961561 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:10.875447   905 raft_consensus.cc:2749] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:10.962062 30473 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:10.962826 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 58232.4us
W20260709 13:09:10.963043 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 87523.5us
I20260709 13:09:10.964644 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:10.866041   733 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:10.881348   706 raft_consensus.cc:2804] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:10.967240 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:10.969300 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:10.969997 30469 raft_consensus.cc:2468] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
I20260709 13:09:10.969416 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:10.972239 30474 raft_consensus.cc:2368] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 5. Current term is 6.
I20260709 13:09:10.967779 30476 raft_consensus.cc:2376] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 7. Re-sending same reply.
I20260709 13:09:10.880227   807 consensus_queue.cc:1048] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.083s
I20260709 13:09:10.878484   764 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:10.977723 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:10.986495 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:10.954104   814 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:10.980468 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:10.991967 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:10.991154 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:10.992923 30469 raft_consensus.cc:2376] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7. Re-sending same reply.
I20260709 13:09:10.990334 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:10.988524 30467 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 9.
I20260709 13:09:10.997120 30476 raft_consensus.cc:2393] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 3: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:10.961041   614 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:10.966961 32749 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.966504   897 raft_consensus.cc:2749] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:11.008734 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:11.010041 31116 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:11.009276 30542 raft_consensus.cc:2393] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 7: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:11.009074 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:10.974853   722 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:11.034189 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:11.014124 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:11.034898 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:10.969211   706 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:11.043283 30473 raft_consensus.cc:2468] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 8.
I20260709 13:09:11.033357 30471 raft_consensus.cc:1275] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:11.033193 30467 raft_consensus.cc:1275] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:09:11.034438 30476 raft_consensus.cc:1275] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:09:11.033602   764 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:10.961906   900 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:11.049952 30476 pending_rounds.cc:85] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326: Aborting all ops after (but not including) 6
I20260709 13:09:11.057283 30476 pending_rounds.cc:107] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:09:11.057701 30476 raft_consensus.cc:2889] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:11.033212   904 log.cc:927] Time spent T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
W20260709 13:09:11.059093 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 217727us
W20260709 13:09:11.032820   908 log.cc:927] Time spent T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:09:11.056456 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:11.008131   698 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.963586   902 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:11.065052 30468 raft_consensus.cc:1240] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:11.010684   836 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:11.066524 30619 raft_consensus.cc:2368] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 5. Current term is 6.
I20260709 13:09:11.053071   706 raft_consensus.cc:3060] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:11.068140   913 log.cc:927] Time spent T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:09:11.044790   905 raft_consensus.cc:2749] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:09:11.067157 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 119140us
I20260709 13:09:11.062547   851 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:11.079608 31144 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 6.
I20260709 13:09:11.083642 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:11.084291 30616 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 6.
I20260709 13:09:11.087894 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:11.088058 30625 raft_consensus.cc:2468] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 8.
I20260709 13:09:11.088455 30616 raft_consensus.cc:2468] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 5.
I20260709 13:09:11.089175 31115 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:11.013929 32749 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:11.110020   923 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.112816   923 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:11.110293   692 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:11.116587   692 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:11.120795 30517 leader_election.cc:336] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.898s (SENT)
I20260709 13:09:11.128611 30619 raft_consensus.cc:1240] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:09:11.138334 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:11.139097 30475 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 5.
I20260709 13:09:11.093380   876 leader_election.cc:290] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:11.164783   856 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:11.074944   698 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:11.168411 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:11.169019 30468 raft_consensus.cc:3060] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:11.109321   704 raft_consensus.cc:2804] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:11.169955   704 raft_consensus.cc:697] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 8 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:11.170941   704 consensus_queue.cc:237] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:11.172596 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:11.174182 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:11.175693 31149 raft_consensus.cc:1240] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:09:11.175956 30617 raft_consensus.cc:1275] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:11.176911 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:11.187281 30468 raft_consensus.cc:2468] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 7.
W20260709 13:09:11.257200 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:11.269495   912 log.cc:927] Time spent T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
I20260709 13:09:11.274710   923 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:09:11.530369 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 76940.7us
I20260709 13:09:11.531826 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:11.532440 30620 raft_consensus.cc:2468] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 7.
I20260709 13:09:11.501108   701 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.535064 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:11.501367   887 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:11.663607 30621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47446 (request call id 2156) took 1038 ms. Trace:
I20260709 13:09:11.684943   922 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:11.685784   922 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:11.664182 30621 rpcz_store.cc:276] 0709 13:09:10.625635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.625798 (+   163us) service_pool.cc:224] Handling call
0709 13:09:10.660994 (+ 35196us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:10.661418 (+   424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:10.661458 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:10.698124 (+ 36666us) log.cc:844] Serialized 26 byte log entry
0709 13:09:10.967519 (+269395us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:10.967571 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.967657 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:11.663323 (+695666us) raft_consensus.cc:1685] finished
0709 13:09:11.663351 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:11.663534 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":52135,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"thread_start_us":129952,"threads_started":1,"wal-append.queue_time_us":281581}
I20260709 13:09:11.630380   701 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:11.692880   887 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:11.974370 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:09:11.975829 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 854985us
I20260709 13:09:11.981576 32749 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:11.999876 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:12.000763 30616 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 5.
I20260709 13:09:11.976405 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:12.006815 30475 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 6.
I20260709 13:09:11.980034   698 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:12.015463 30441 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:12.015576 30464 tablet_service.cc:1558] Processing DeleteTablet for tablet 1560cc6404764454b2843cec97934e6b with delete_type TABLET_DATA_TOMBSTONED (TS f639301059e24dc5b0d88a46dc683326 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:53858
W20260709 13:09:12.020211 30440 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.911s	user 0.057s	sys 0.077s
W20260709 13:09:12.020686 30440 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.912s	user 0.057s	sys 0.077s
W20260709 13:09:12.021020 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 928386us
I20260709 13:09:12.023654 30441 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:12.024976   926 raft_consensus.cc:2749] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:12.026623   926 raft_consensus.cc:2749] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:12.027006   798 raft_consensus.cc:3055] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:12.027489   798 raft_consensus.cc:740] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:12.034240   902 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:12.035492 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:12.034327 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:12.036165 30548 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:12.037418   918 log.cc:927] Time spent T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.969s	user 0.003s	sys 0.008s
I20260709 13:09:12.041518   931 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.042171   931 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:12.043349 30548 raft_consensus.cc:2410] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:09:12.045598 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:12.046360 30544 raft_consensus.cc:2410] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:09:12.046646 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:12.047178 30548 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:12.049485   891 consensus_meta.cc:287] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 1.101s	user 0.010s	sys 0.000s
I20260709 13:09:12.049975   891 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:12.052068   891 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:12.052269 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:12.052842 30542 raft_consensus.cc:3060] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:12.055238   929 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:12.055975   906 log.cc:927] Time spent T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 1.215s	user 0.000s	sys 0.009s
I20260709 13:09:12.055883   929 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:12.058041 30589 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:12.058872 30589 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:12.060532 30441 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:12.061721   940 raft_consensus.cc:2804] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:12.062192   940 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.062537   940 raft_consensus.cc:3060] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:12.062623   933 raft_consensus.cc:493] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:12.063290   933 raft_consensus.cc:515] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:11.959681   892 consensus_meta.cc:287] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 1.391s	user 0.009s	sys 0.003s
I20260709 13:09:12.069864 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:12.072494 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:12.074997 30548 raft_consensus.cc:2410] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:09:12.073135 30618 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 6.
I20260709 13:09:12.078415 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:09:12.065456   763 consensus_meta.cc:287] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 1.114s	user 0.007s	sys 0.003s
I20260709 13:09:12.079160 30625 raft_consensus.cc:2468] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 6.
I20260709 13:09:12.084785   931 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:12.085460   931 raft_consensus.cc:2804] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:12.085834   931 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.086181   931 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:12.090579   894 raft_consensus.cc:2804] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:12.091064   894 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:12.091439   894 raft_consensus.cc:3060] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:12.092995   898 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:12.093713   898 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:12.095613   897 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:12.096216   584 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:12.096156   897 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:12.096786   584 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:12.098182   897 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:12.093705   856 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:12.099184   856 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:12.099696   856 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:12.102371   856 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:12.103152   940 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:12.103945   898 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:12.075416   830 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:12.112576   830 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:12.114634   692 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:12.064368   876 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:12.115197   830 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:12.070209   530 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:12.116775   763 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:12.117579   940 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:12.117139   530 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:12.119041   763 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:12.119832   530 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:12.115513   876 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:12.119879 31148 raft_consensus.cc:2393] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 7: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:12.121795   876 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:12.122135 31148 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48412 (request call id 563) took 1454 ms (client timeout 1774 ms). Trace:
I20260709 13:09:12.107671   701 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:12.135116   733 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:12.110519   889 consensus_meta.cc:287] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 1.542s	user 0.006s	sys 0.005s
I20260709 13:09:12.058070   929 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:12.136368   887 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:12.109105   933 leader_election.cc:290] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:12.131563 30472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 1560) took 1699 ms. Trace:
W20260709 13:09:12.122685 31148 rpcz_store.cc:269] 0709 13:09:10.667557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.695767 (+ 28210us) service_pool.cc:224] Handling call
0709 13:09:12.121861 (+1426094us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54006eee54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:12.122030 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2887227264}
I20260709 13:09:12.144124 30616 raft_consensus.cc:2468] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 7.
W20260709 13:09:12.144342 30591 leader_election.cc:336] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.513s (SENT)
I20260709 13:09:12.084851 30542 raft_consensus.cc:2468] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:09:12.148881 30591 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:12.099566   584 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:12.147102 30472 rpcz_store.cc:276] 0709 13:09:10.432508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.435682 (+  3174us) service_pool.cc:224] Handling call
0709 13:09:10.647705 (+212023us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:10.716235 (+ 68530us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.131273 (+1415038us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b54003d3e50. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f678ad 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:12.131478 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":486875392}
W20260709 13:09:12.145110 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 84651.2us
I20260709 13:09:12.079476   892 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:12.146258   530 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:12.147830   876 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:12.177349   934 tablet_replica.cc:333] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:09:12.177716 30441 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:12.155767   929 consensus_queue.cc:1059] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:09:12.178709   926 raft_consensus.cc:2749] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:12.182811 30591 connection.cc:256] RPC call timeout handler was delayed by -1.0869077550000839s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20179999999999998s for a response
I20260709 13:09:12.154312   933 consensus_queue.cc:1048] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
W20260709 13:09:12.184300 30591 connection.cc:256] RPC call timeout handler was delayed by -1.0348653290000129s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2537s for a response
I20260709 13:09:12.146643   889 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:12.185308   933 consensus_queue.cc:1243] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer cd669586cff44d4bbfcc007e213faab6 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:09:12.161602   530 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:12.191412 30591 leader_election.cc:336] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.538s (SENT)
I20260709 13:09:12.181349   938 raft_consensus.cc:2749] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:09:12.164806   888 consensus_meta.cc:287] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 1.280s	user 0.007s	sys 0.004s
W20260709 13:09:12.331868 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 145835us
I20260709 13:09:12.334044 31115 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:12.379640   887 raft_consensus.cc:2804] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:12.404844   733 raft_consensus.cc:493] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:12.425678   911 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:12.426443   911 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:12.427263   819 raft_consensus.cc:493] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:12.427785   819 raft_consensus.cc:515] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:12.429304 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:12.181958   876 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:12.424921 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:12.425580   733 raft_consensus.cc:515] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:12.434065 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 361837us
I20260709 13:09:12.386309   701 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:12.482720   701 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:12.485720   701 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:12.487982   834 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.424846   887 raft_consensus.cc:697] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 7 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:12.497155   834 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:12.497988   887 consensus_queue.cc:237] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:12.502087   911 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:12.373492   888 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:12.524480 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 143047us
I20260709 13:09:12.532451   763 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.534296   819 leader_election.cc:290] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:12.803917 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:09:12.804138 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 626435us
I20260709 13:09:13.073508 30441 leader_election.cc:304] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:09:12.627167 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 158775us
I20260709 13:09:12.848097 30551 raft_consensus.cc:2393] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 6: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:12.527503   927 raft_consensus.cc:3055] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:09:13.079854 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 888371us
I20260709 13:09:13.087848 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:09:13.090691 30591 leader_election.cc:336] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.650s (SENT)
W20260709 13:09:12.765475   674 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.011s	sys 0.020s
I20260709 13:09:13.094406 31148 raft_consensus.cc:1275] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:09:12.927613   894 consensus_meta.cc:287] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.804s	user 0.008s	sys 0.000s
W20260709 13:09:12.974526   931 consensus_meta.cc:287] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.888s	user 0.009s	sys 0.000s
I20260709 13:09:12.544164   701 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:12.673565   706 consensus_meta.cc:287] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 1.590s	user 0.007s	sys 0.004s
I20260709 13:09:12.801224   903 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:12.644961   921 raft_consensus.cc:493] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:12.901597   530 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:13.117952 31148 pending_rounds.cc:85] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6: Aborting all ops after (but not including) 7
I20260709 13:09:13.118911 31148 pending_rounds.cc:107] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:09:13.120150 31148 raft_consensus.cc:2889] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:12.901414   821 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:12.901926   834 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:12.768692   892 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:13.062841   962 log.cc:927] Time spent T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
I20260709 13:09:13.115833 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:13.118052 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:13.059525   950 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:13.121874 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:13.122663 31146 raft_consensus.cc:1240] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:13.088302   820 raft_consensus.cc:2804] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:09:13.098223   674 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.973s	user 0.020s	sys 0.029s
I20260709 13:09:12.901654   584 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:12.552564   876 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:13.088080   911 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:13.089241   927 raft_consensus.cc:740] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:13.134387 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:13.135141 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:13.136688 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:13.138528 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:13.092444   763 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:13.190267 31147 raft_consensus.cc:1240] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 13:09:13.189884 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 332679us
I20260709 13:09:13.196285 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:13.134577   889 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:13.139957   733 leader_election.cc:290] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:13.163287   530 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:13.202912 30589 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:13.163295   892 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:13.122329   706 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:13.189280   820 raft_consensus.cc:697] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:13.190348   948 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:13.126799   903 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:13.110265   894 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:13.262271 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 70039.6us
I20260709 13:09:13.113986   931 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:13.249550 30516 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.821s	user 0.002s	sys 0.039s
I20260709 13:09:13.127986   921 raft_consensus.cc:515] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:13.125568   701 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:13.132333   821 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:13.255424 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:13.256945   951 raft_consensus.cc:2804] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:13.257438   967 raft_consensus.cc:493] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.258020   942 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.152520   950 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:13.261905 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 118915us
W20260709 13:09:13.248198 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 156223us
I20260709 13:09:13.290477 30618 raft_consensus.cc:2410] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:09:13.263136 30516 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.002s	sys 0.039s
I20260709 13:09:13.188637   584 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:13.222168   876 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:13.264176 30624 raft_consensus.cc:2468] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 6.
I20260709 13:09:13.196617   911 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:13.267561 30542 raft_consensus.cc:3060] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:13.291487 30591 leader_election.cc:336] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.766s (SENT)
I20260709 13:09:13.313593 30591 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
W20260709 13:09:13.297308 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 174016us
I20260709 13:09:13.304819   963 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:13.293262   967 raft_consensus.cc:515] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:13.245630   530 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:13.304684   876 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:13.305369 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:13.331492 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:13.332301 30549 raft_consensus.cc:2393] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 7: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:13.306900   584 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:13.336125 30624 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36130 (request call id 1709) took 2163 ms (client timeout 1774 ms). Trace:
I20260709 13:09:13.336340   530 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:13.336544 30624 rpcz_store.cc:269] 0709 13:09:11.172911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.173851 (+   940us) service_pool.cc:224] Handling call
0709 13:09:13.335927 (+2162076us) spinlock_profiling.cc:243] Waited 2.09 s on lock 0x7b54003449d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:13.336024 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4804573952}
I20260709 13:09:13.338091   876 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:13.338225   931 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:13.338478   959 log.cc:927] Time spent T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:09:13.339365 30621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47446 (request call id 2167) took 1807 ms. Trace:
I20260709 13:09:13.340179   911 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:13.339735 30621 rpcz_store.cc:276] 0709 13:09:11.532325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.765477 (+233152us) service_pool.cc:224] Handling call
0709 13:09:11.836861 (+ 71384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:11.838416 (+  1555us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:11.838459 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:11.839050 (+   591us) log.cc:844] Serialized 26 byte log entry
0709 13:09:12.386462 (+547412us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:12.386500 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.386564 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:13.339166 (+952602us) raft_consensus.cc:1685] finished
0709 13:09:13.339186 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:13.339311 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9429,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":136,"thread_start_us":466325,"threads_started":1,"wal-append.queue_time_us":1345223}
I20260709 13:09:13.293833   951 raft_consensus.cc:697] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:13.343183   951 consensus_queue.cc:237] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:13.344760   894 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:13.330469   963 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:13.344760   921 leader_election.cc:290] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:13.320358   960 log.cc:927] Time spent T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:09:13.320441   701 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:13.321436   798 consensus_queue.cc:260] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:13.323046 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:13.324326   966 log.cc:927] Time spent T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:09:13.354009 30547 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 7.
I20260709 13:09:13.354873 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
W20260709 13:09:13.324669   939 log.cc:927] Time spent T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 1.264s	user 0.014s	sys 0.010s
W20260709 13:09:13.324975   955 log.cc:927] Time spent T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:09:13.286082   888 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:13.260414   892 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:13.306370 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:13.332937 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 69549.2us
I20260709 13:09:13.334578   819 raft_consensus.cc:2749] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:13.335175 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:13.307420 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:13.333997 30591 leader_election.cc:336] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.903s (SENT)
I20260709 13:09:13.359851 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:13.360107 31116 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:13.360690 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:13.362564 30550 raft_consensus.cc:2410] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:09:13.391673 30625 raft_consensus.cc:1275] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:09:13.367197 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:13.392704 31116 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:13.266755   927 consensus_queue.cc:260] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:13.396175 30624 raft_consensus.cc:3060] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:13.362185 30542 raft_consensus.cc:2468] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
I20260709 13:09:13.361980 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:13.400054 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:13.400669 30625 raft_consensus.cc:1813] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Handling vote request from an unknown peer f639301059e24dc5b0d88a46dc683326
I20260709 13:09:13.401172 30625 raft_consensus.cc:2393] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 4: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:13.393790 30620 raft_consensus.cc:2468] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 5.
I20260709 13:09:13.397681 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:13.396660 30545 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 4.
I20260709 13:09:13.395423 30591 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:13.406311 30549 raft_consensus.cc:2468] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 3.
I20260709 13:09:13.356628   820 consensus_queue.cc:237] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:13.293422   948 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:13.394539 31116 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:13.498661 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:13.392668   798 raft_consensus.cc:3060] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:13.361173   945 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
W20260709 13:09:13.425076 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 91094.5us
I20260709 13:09:13.424821   819 raft_consensus.cc:2749] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:13.392196   701 raft_consensus.cc:493] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:13.398146   674 raft_consensus.cc:2804] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:13.508337 30624 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 7.
I20260709 13:09:13.395900   977 raft_consensus.cc:2804] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:13.302898   942 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:13.431059 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.357678   894 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:13.423120   927 raft_consensus.cc:3060] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:13.519236   963 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:13.547254 31144 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 641) took 2877 ms (client timeout 1850 ms). Trace:
W20260709 13:09:13.547729 31144 rpcz_store.cc:269] 0709 13:09:10.669884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.727628 (+ 57744us) service_pool.cc:224] Handling call
0709 13:09:13.547027 (+2819399us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b5400482bd4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:13.547156 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":488837504}
W20260709 13:09:13.427389   932 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.395s	user 0.033s	sys 0.040s
I20260709 13:09:13.499347 30550 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 7.
I20260709 13:09:13.425273   763 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:13.502414 30591 leader_election.cc:336] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.938s (SENT)
I20260709 13:09:13.556586 30591 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
W20260709 13:09:13.557538 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 55156.7us
W20260709 13:09:13.558241 30591 leader_election.cc:336] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.961s (SENT)
I20260709 13:09:13.558696 30591 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:13.559511   819 raft_consensus.cc:3060] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:13.503113 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 108852us
W20260709 13:09:13.503494 30441 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.504585 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:13.562117 30476 raft_consensus.cc:3060] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:13.562340 30441 connection.cc:256] RPC call timeout handler was delayed by -1.067232949000072s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1688s for a response
W20260709 13:09:13.562687 30441 connection.cc:256] RPC call timeout handler was delayed by -1.0582329490000575s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
I20260709 13:09:13.563408 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:13.563673 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:13.564153 30550 raft_consensus.cc:2393] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 7: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:13.564237 30472 raft_consensus.cc:2376] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5. Re-sending same reply.
I20260709 13:09:13.564935 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:13.565860 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:13.507997 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.566684 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:13.567389 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:13.505133 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:13.567667 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:13.516862   892 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:13.568092 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:13.568383 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:13.568642 30469 raft_consensus.cc:3060] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:13.568701 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:13.569020   798 raft_consensus.cc:2749] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:13.569444 30473 raft_consensus.cc:2368] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 6. Current term is 7.
I20260709 13:09:13.570147 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:13.506893   945 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:13.570677 30473 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 6.
I20260709 13:09:13.571422 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:13.520963   706 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:13.521654   981 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.517136   948 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:13.523029 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:13.523541 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:13.595204 30471 raft_consensus.cc:2468] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 5.
I20260709 13:09:13.524410 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:13.595759 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:13.596447 30542 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 7.
W20260709 13:09:13.556110   932 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.524s	user 0.033s	sys 0.040s
I20260709 13:09:13.508965   975 raft_consensus.cc:493] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:13.518334   982 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.520586   821 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:13.572301 30473 raft_consensus.cc:2468] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 9.
I20260709 13:09:13.575840 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:13.576670 30476 raft_consensus.cc:2468] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 7.
I20260709 13:09:13.577965 30469 raft_consensus.cc:2468] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:09:13.585381   950 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:13.585968   927 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:13.606557 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:13.607508 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:13.586006   985 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:13.588826 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:13.522110   701 raft_consensus.cc:515] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:13.612623 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:13.613155 30473 raft_consensus.cc:2376] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 6. Re-sending same reply.
I20260709 13:09:13.613216 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:13.614090 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:13.582664 30550 raft_consensus.cc:2468] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 5.
I20260709 13:09:13.593091 30516 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:13.508745   674 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.594129 30547 raft_consensus.cc:2468] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:09:13.565910 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:13.617194 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:13.598749 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:13.605667 30545 raft_consensus.cc:2468] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 6.
I20260709 13:09:13.608405 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:13.571511   977 raft_consensus.cc:697] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 7 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:13.612438 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:13.614814 30473 raft_consensus.cc:2410] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:13.594950   967 leader_election.cc:290] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:13.625499 30471 raft_consensus.cc:2393] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 7: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:13.600654   763 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.600116   945 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:13.628654 30473 raft_consensus.cc:1275] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:09:13.640786 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:13.641703 30473 raft_consensus.cc:2393] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 5: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:13.628300 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:13.642424 31143 raft_consensus.cc:2393] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 6: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:13.629428 30470 raft_consensus.cc:1240] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:13.576745   894 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:13.633790 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:13.604269   951 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:13.646370 30516 leader_election.cc:304] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:13.598681   981 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:13.638377 31116 leader_election.cc:304] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:13.826792 31147 raft_consensus.cc:2368] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 6. Current term is 7.
W20260709 13:09:13.647989 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 334131us
I20260709 13:09:13.806005 30441 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:13.828650 31115 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:13.616556   927 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:13.622789   950 raft_consensus.cc:2804] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:13.830010   951 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:13.721546 31114 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.173.2:34733 timed out after 1.688s (SENT) [suppressed 29 similar messages]
I20260709 13:09:13.804574   984 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.686094   911 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.707518 30473 raft_consensus.cc:1275] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:13.622352   674 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:13.838048 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 191771us
W20260709 13:09:13.839738 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:13.853348 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 215044us
I20260709 13:09:13.612852   982 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:13.647562   704 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.598s	user 0.043s	sys 0.054s
I20260709 13:09:13.874972 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:13.875771 31147 raft_consensus.cc:2393] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 8: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
W20260709 13:09:13.862920 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 141404us
I20260709 13:09:13.865875 30475 raft_consensus.cc:3060] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:13.858225 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:13.869586 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:13.867885 31116 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:13.710031   973 raft_consensus.cc:2804] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:13.851698   999 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.901964 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:13.902834 31142 raft_consensus.cc:3060] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:13.885217 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:13.904610 31114 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:09:13.854980   876 raft_consensus.cc:2804] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:13.853582   950 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.915498 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:09:13.879112   704 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.829s	user 0.056s	sys 0.066s
W20260709 13:09:13.898797 30516 connection.cc:256] RPC call timeout handler was delayed by -1.6787444110000251s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18500000000000003s for a response
I20260709 13:09:13.848819   946 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
W20260709 13:09:13.878050   924 log.cc:927] Time spent T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 2.742s	user 0.012s	sys 0.039s
I20260709 13:09:13.870648 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:13.919747 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:13.616757   985 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:13.927721 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:13.942524 30625 raft_consensus.cc:2468] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 2.
I20260709 13:09:13.623510   975 raft_consensus.cc:515] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:13.650179   763 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:13.914589 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:13.929944 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:13.946008 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:13.930564   888 consensus_queue.cc:1048] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:13.932499 31149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48426 (request call id 640) took 3248 ms. Trace:
I20260709 13:09:13.947351 31146 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 7.
I20260709 13:09:13.927899   950 raft_consensus.cc:3060] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:13.935631 30516 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:13.883090   973 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.941756 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:13.979390 31147 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 7.
I20260709 13:09:13.944304 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:13.915086   876 raft_consensus.cc:493] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.946050 30591 leader_election.cc:304] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:13.948330 31149 rpcz_store.cc:276] 0709 13:09:10.669572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.726350 (+ 56778us) service_pool.cc:224] Handling call
0709 13:09:10.726703 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:11.176292 (+449589us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.917557 (+2741265us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b5400477cd4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:13.917772 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1031810944}
W20260709 13:09:13.935027 30517 connection.cc:256] RPC call timeout handler was delayed by -1.8409475759998486s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2147s for a response
I20260709 13:09:13.943410   471 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:13.951416   985 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:13.951740 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:13.953261 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:13.955368   818 raft_consensus.cc:2804] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:13.926673 31142 raft_consensus.cc:2468] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 6.
I20260709 13:09:13.935079   902 raft_consensus.cc:2804] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:13.980149 31150 raft_consensus.cc:2468] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 6.
I20260709 13:09:13.975642   958 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:13.993337 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 88780.4us
I20260709 13:09:13.869516   984 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:14.006907 30544 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.008s	sys 0.007s
W20260709 13:09:13.994881 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 127082us
I20260709 13:09:13.995448 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:14.009126 30618 raft_consensus.cc:3060] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:14.009913 30544 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.008s	sys 0.007s
I20260709 13:09:13.869355   911 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:13.983150 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:13.917037   999 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:13.994959 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:13.997881 31146 raft_consensus.cc:2468] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
W20260709 13:09:14.006789 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 200940us
I20260709 13:09:13.948057   945 consensus_queue.cc:1048] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:09:13.988726   876 raft_consensus.cc:3060] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:14.051951 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:14.053045 30472 raft_consensus.cc:1240] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 13:09:14.035573   989 log.cc:927] Time spent T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.259s	user 0.000s	sys 0.000s
W20260709 13:09:14.022845 30517 connection.cc:256] RPC call timeout handler was delayed by -1.7671475759999566s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22290000000000001s for a response
I20260709 13:09:14.025521 30441 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:14.064854 30441 leader_election.cc:304] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:13.984896   973 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:14.069020 30441 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:14.070078 30441 leader_election.cc:304] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:14.027160 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 91620.5us
I20260709 13:09:13.996928   471 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:13.997679   961 raft_consensus.cc:3060] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:14.024351 30620 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
I20260709 13:09:14.030874 31114 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:14.032265   934 raft_consensus.cc:2243] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:14.032619   990 raft_consensus.cc:2749] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:14.032774   944 raft_consensus.cc:2804] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:14.033099   701 leader_election.cc:290] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:14.033490 30623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36130 (request call id 1701) took 3047 ms. Trace:
W20260709 13:09:14.033824   978 log.cc:927] Time spent T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.490s	user 0.000s	sys 0.000s
I20260709 13:09:14.023214   894 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:14.036558   986 log.cc:927] Time spent T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.465s	user 0.000s	sys 0.000s
I20260709 13:09:14.036666   963 raft_consensus.cc:2804] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:14.007543   974 consensus_queue.cc:1048] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.104s
I20260709 13:09:14.038829 30474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 573) took 1610 ms. Trace:
I20260709 13:09:13.864764   977 consensus_queue.cc:237] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:14.042850   994 log.cc:927] Time spent T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:09:14.003566   902 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:14.121745   902 raft_consensus.cc:3060] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:14.124104 31148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48412 (request call id 566) took 1007 ms. Trace:
I20260709 13:09:14.124555 31148 rpcz_store.cc:276] 0709 13:09:13.117123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.117469 (+   346us) service_pool.cc:224] Handling call
0709 13:09:13.117760 (+   291us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:13.599534 (+481774us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:13.599564 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:13.600076 (+   512us) log.cc:844] Serialized 52 byte log entry
0709 13:09:13.672825 (+ 72749us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:13.758975 (+ 86150us) log.cc:844] Serialized 14 byte log entry
0709 13:09:13.804685 (+ 45710us) log.cc:844] Serialized 14 byte log entry
0709 13:09:13.805312 (+   627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.805397 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:14.123880 (+318483us) raft_consensus.cc:1685] finished
0709 13:09:14.123906 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:14.124047 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76806,"prepare.queue_time_us":192555,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":66,"raft.queue_time_us":264870,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":37733,"spinlock_wait_cycles":11044224,"thread_start_us":598099,"threads_started":3,"wal-append.queue_time_us":302016}
I20260709 13:09:14.044703   888 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.003842  1002 consensus_queue.cc:1048] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.114s
I20260709 13:09:14.128154   888 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:14.026367   958 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:14.116000   963 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.130297 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:14.019640   818 raft_consensus.cc:697] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 7 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:14.130618   963 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:14.131873   818 consensus_queue.cc:237] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:14.132638   975 leader_election.cc:290] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:14.046370 30590 leader_election.cc:400] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 election: Vote denied by peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453) with higher term. Message: Invalid argument: T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 6. Current term is 7.
I20260709 13:09:14.047003 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:14.046375 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:13.941622   946 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:14.135576 30621 raft_consensus.cc:2468] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
W20260709 13:09:14.067593 30517 leader_election.cc:336] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.603s (SENT)
W20260709 13:09:14.072889 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.095168   921 raft_consensus.cc:2749] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:14.099570 30441 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:14.100049 30516 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
W20260709 13:09:14.106087 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 75253.2us
I20260709 13:09:14.105126 30623 rpcz_store.cc:276] 0709 13:09:10.986432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.986576 (+   144us) service_pool.cc:224] Handling call
0709 13:09:10.986954 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:11.002034 (+ 15080us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:11.002074 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:11.034438 (+ 32364us) log.cc:844] Serialized 26 byte log entry
0709 13:09:11.063168 (+ 28730us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:11.257253 (+194085us) log.cc:844] Serialized 14 byte log entry
0709 13:09:11.257489 (+   236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.257559 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:13.639740 (+2382181us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:09:14.027970 (+388230us) raft_consensus.cc:1685] finished
0709 13:09:14.033189 (+  5219us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:14.033378 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26953,"prepare.queue_time_us":1002587,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":22941,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":37247,"spinlock_wait_cycles":39985024,"thread_start_us":185177,"threads_started":2,"wal-append.queue_time_us":42961}
I20260709 13:09:14.107551   934 raft_consensus.cc:2272] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:14.153864 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:09:14.155079   819 consensus_meta.cc:287] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.595s	user 0.011s	sys 0.000s
W20260709 13:09:14.155790 30551 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35278 (request call id 533) took 3649 ms (client timeout 2692 ms). Trace:
I20260709 13:09:14.108654   903 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:14.156147 30475 raft_consensus.cc:2468] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
I20260709 13:09:14.101734   944 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:14.182235 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:14.183099 30623 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:14.116359 30474 rpcz_store.cc:276] 0709 13:09:12.428585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.429278 (+   693us) service_pool.cc:224] Handling call
0709 13:09:12.804208 (+374930us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:13.295880 (+491672us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:13.295921 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:13.295970 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:13.296004 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.038563 (+742559us) spinlock_profiling.cc:243] Waited 491 ms on lock 0x7b54003d3954. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:14.038621 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:14.038766 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1130183936}
I20260709 13:09:14.115684   701 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:14.134493 30590 leader_election.cc:403] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 13:09:14.187842 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 141594us
I20260709 13:09:14.138579 30517 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:14.146520 31114 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
W20260709 13:09:14.189942 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 89947.8us
I20260709 13:09:14.191072 30516 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
W20260709 13:09:14.191527 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 124404us
I20260709 13:09:14.148741   985 raft_consensus.cc:2749] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:14.149654  1016 raft_consensus.cc:2749] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:14.150317   975 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:14.150801   820 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:14.151438 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 51939.8us
I20260709 13:09:14.152045   933 raft_consensus.cc:2749] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:14.113480 30618 raft_consensus.cc:2468] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 6.
W20260709 13:09:14.173147 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.116219 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:14.156634   819 raft_consensus.cc:2749] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:09:14.192580 30517 connection.cc:256] RPC call timeout handler was delayed by -1.6723504770000091s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2154s for a response
I20260709 13:09:14.194139   945 raft_consensus.cc:3060] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:14.379693 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:09:14.896242 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 749715us
W20260709 13:09:14.896692 30623 consensus_meta.cc:287] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.713s	user 0.018s	sys 0.007s
I20260709 13:09:14.897049 30468 raft_consensus.cc:2410] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:09:14.897189 30623 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 10.
I20260709 13:09:14.897603   471 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:14.771296 30591 leader_election.cc:336] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.741s (SENT)
I20260709 13:09:14.182437   927 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:14.202529   951 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:14.201565  1018 raft_consensus.cc:2749] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:09:14.900256 30517 leader_election.cc:336] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.890s (SENT)
I20260709 13:09:14.435927   888 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:14.737432   974 raft_consensus.cc:493] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:14.901732 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:14.301422 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:14.281900   922 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:14.901435   974 raft_consensus.cc:515] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:14.225857   948 raft_consensus.cc:2804] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:14.241423   973 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:14.903537   948 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:14.904215   948 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:14.226533   967 raft_consensus.cc:2749] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:14.187425   944 raft_consensus.cc:3060] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:14.906255   973 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:14.635267   900 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:14.227049   911 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:14.132642   763 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:14.266019 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:14.929039 31148 raft_consensus.cc:2468] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:09:14.227718   958 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:14.910290 30618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47446 (request call id 2173) took 1028 ms. Trace:
I20260709 13:09:14.203804  1012 raft_consensus.cc:2804] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:14.548032   876 raft_consensus.cc:515] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:14.910815   975 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:14.898913 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 127682us
W20260709 13:09:14.930644   818 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.000s	sys 0.018s
I20260709 13:09:14.911158   984 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:14.897904 31114 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:14.924132 30620 raft_consensus.cc:2468] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 3.
W20260709 13:09:14.946805 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 48992.6us
W20260709 13:09:14.927556 30476 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.013s	sys 0.001s
I20260709 13:09:14.914394   820 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:14.210536 30467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 571) took 2184 ms. Trace:
I20260709 13:09:14.923657 30516 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:14.916496 30441 leader_election.cc:400] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Vote denied by peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) with higher term. Message: Invalid argument: T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 5. Current term is 6.
I20260709 13:09:14.933432 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:09:14.287911   991 log.cc:927] Time spent T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.608s	user 0.000s	sys 0.002s
I20260709 13:09:14.938515 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:14.938448 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:14.935456 30618 rpcz_store.cc:276] 0709 13:09:13.882031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.974995 (+ 92964us) service_pool.cc:224] Handling call
0709 13:09:14.910218 (+935223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:14.953050 30516 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:14.790977   982 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:14.900823 30517 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:14.944844 30624 raft_consensus.cc:2410] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:14.826328  1017 raft_consensus.cc:2749] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:09:14.156173 30551 rpcz_store.cc:269] 0709 13:09:10.506648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.507621 (+   973us) service_pool.cc:224] Handling call
0709 13:09:14.155543 (+3647922us) spinlock_profiling.cc:243] Waited 2.19 s on lock 0x7b5400358754. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:14.155670 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5037265280}
W20260709 13:09:14.947585 30476 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.014s	sys 0.001s
I20260709 13:09:14.985325   934 ts_tablet_manager.cc:1916] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:14.947472 31114 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326
W20260709 13:09:14.934734   950 consensus_meta.cc:287] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.949s	user 0.009s	sys 0.002s
I20260709 13:09:14.986946   950 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:14.987463 31114 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:14.988344   963 consensus_meta.cc:287] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.857s	user 0.006s	sys 0.009s
I20260709 13:09:14.989060   950 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:14.202641   981 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:14.989953   973 raft_consensus.cc:2804] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:14.990360   973 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:14.990782   973 raft_consensus.cc:3060] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:14.991209   977 raft_consensus.cc:2804] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:14.991603   977 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:14.991990   977 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:14.999164   977 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:15.001880 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:15.002434 30474 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:14.956342   911 raft_consensus.cc:2804] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:14.951076 30441 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:14.951764 30622 raft_consensus.cc:2468] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 8.
I20260709 13:09:14.954210 30516 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
W20260709 13:09:14.945485   818 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.000s	sys 0.019s
W20260709 13:09:15.004132 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 50017.1us
W20260709 13:09:15.004454 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 53470.3us
I20260709 13:09:15.006070 30441 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:15.007354 30441 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:15.007565 30544 raft_consensus.cc:1240] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:15.008168 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:15.008790 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:15.009780 30548 raft_consensus.cc:2410] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:09:15.009555   981 consensus_queue.cc:1059] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:15.010504   981 raft_consensus.cc:2749] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:15.010736 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:15.011224   971 consensus_queue.cc:1048] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:14.938134  1012 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:15.011952 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:15.012107  1012 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:15.012990   971 raft_consensus.cc:3055] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:15.013381   971 raft_consensus.cc:740] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:15.014163   971 consensus_queue.cc:260] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:15.015331   971 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:15.016233 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:15.017616   950 raft_consensus.cc:2804] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:15.018301   950 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:15.018646   950 raft_consensus.cc:3060] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:15.011695 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:15.019469 30545 raft_consensus.cc:2468] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 7.
I20260709 13:09:15.020164   911 raft_consensus.cc:697] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 6 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:15.020483   977 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:15.020897   975 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:15.021329   982 raft_consensus.cc:2749] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:15.021095   911 consensus_queue.cc:237] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:14.949110 30467 rpcz_store.cc:276] 0709 13:09:12.026222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.031411 (+  5189us) service_pool.cc:224] Handling call
0709 13:09:12.031789 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:12.032118 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:12.032152 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:13.851929 (+1819777us) spinlock_profiling.cc:243] Waited 42.7 ms on lock 0x7b2c000014c8. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc782861a11 00007fc782871372 00007fc783fa3a01 00007fc783f6843a 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2
0709 13:09:13.852442 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 13:09:14.007197 (+154755us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:14.046540 (+ 39343us) log.cc:844] Serialized 14 byte log entry
0709 13:09:14.046737 (+   197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.046813 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:14.210173 (+163360us) raft_consensus.cc:1685] finished
0709 13:09:14.210288 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:14.210443 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22157,"prepare.queue_time_us":57609,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":3066,"raft.queue_time_us":3239,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":189,"spinlock_wait_cycles":98311424,"thread_start_us":97339,"threads_started":1,"wal-append.queue_time_us":230906}
W20260709 13:09:14.956334 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:14.979460 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 79239.4us
I20260709 13:09:15.025982 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:14.983039  1019 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:15.026693  1019 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:15.027166 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
W20260709 13:09:15.028432 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.935249   974 leader_election.cc:290] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:15.030346 30590 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:15.030609   974 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:15.031049   974 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:14.952430   763 raft_consensus.cc:2804] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:15.032344   763 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:15.032758   763 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:15.037071 30617 raft_consensus.cc:1275] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:15.039099 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:14.204198  1014 consensus_queue.cc:1059] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.750s
I20260709 13:09:14.929858   932 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:14.973317 30619 raft_consensus.cc:1275] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:14.986392   820 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:14.988886   963 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:14.196836   999 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:14.972644   900 raft_consensus.cc:2804] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:14.956157   970 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.008853   836 raft_consensus.cc:2804] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:09:15.026090 30517 leader_election.cc:336] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.050s (SENT)
I20260709 13:09:15.059489   970 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:15.060078 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:15.059514   836 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.061105   836 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:15.061604   970 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:15.065690   946 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:15.040115 30441 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:15.068015   820 raft_consensus.cc:2764] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:09:15.068470 30474 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 7.
I20260709 13:09:15.068701   992 consensus_queue.cc:1048] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:15.070735 30441 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:15.040495 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:14.976337 30620 raft_consensus.cc:1275] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:15.042645 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:15.073938   973 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:15.043550 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:15.043962 31150 raft_consensus.cc:1240] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:15.037645 30617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47446 (request call id 2177) took 1094 ms. Trace:
I20260709 13:09:15.045563 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:15.045784 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:14.581986   902 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:14.978629   922 raft_consensus.cc:2749] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:15.113829 30621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 572) took 1241 ms. Trace:
I20260709 13:09:15.051601 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:15.055056 31115 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:15.055958 31114 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:15.118244 30617 rpcz_store.cc:276] 0709 13:09:13.943564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.036504 (+1092940us) service_pool.cc:224] Handling call
0709 13:09:15.036773 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:15.037433 (+   660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.037597 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:15.136334 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 80416.7us
I20260709 13:09:15.137761 31114 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:09:15.049129   819 raft_consensus.cc:2804] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:15.058209 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:15.058729   974 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:15.072593   876 leader_election.cc:290] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:15.073406 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:15.074651   836 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:15.075886   934 ts_tablet_manager.cc:1929] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:09:15.076570 31146 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 7.
I20260709 13:09:15.042006 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:15.104254   931 raft_consensus.cc:2804] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:15.105218 30441 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:15.106153   961 consensus_meta.cc:287] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 1.011s	user 0.004s	sys 0.004s
I20260709 13:09:15.106967 30620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 574) took 1117 ms. Trace:
I20260709 13:09:15.109831 30472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 1591) took 1544 ms. Trace:
I20260709 13:09:15.111694 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:15.047434  1006 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.057030   900 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:15.111778 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:15.056717   888 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:15.134923 30621 rpcz_store.cc:276] 0709 13:09:13.872201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.111162 (+1238961us) service_pool.cc:224] Handling call
0709 13:09:15.111452 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:15.111607 (+   155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:15.111632 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:15.111669 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:15.111699 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.111747 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:15.113778 (+  2031us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:15.139396 30618 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:15.107105   950 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:15.140595 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 80223.3us
I20260709 13:09:15.228507 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:15.225239 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:09:15.265528 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 127831us
I20260709 13:09:15.206101 30476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 1589) took 1641 ms. Trace:
I20260709 13:09:15.223987 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:15.295011 30619 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 5.
W20260709 13:09:15.147912 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 90368.1us
I20260709 13:09:15.223683 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:15.295384 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:15.145395 30543 raft_consensus.cc:2393] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 7: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:15.142454 30625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47446 (request call id 2176) took 1206 ms. Trace:
I20260709 13:09:15.225509 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:15.147061 30472 rpcz_store.cc:276] 0709 13:09:13.565464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.618103 (+ 52639us) service_pool.cc:224] Handling call
0709 13:09:13.805626 (+187523us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:14.053595 (+247969us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.109575 (+1055980us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b54003d2f54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:15.109777 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":568347904}
I20260709 13:09:15.257995 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:15.168188 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:09:15.294806 30517 connection.cc:256] RPC call timeout handler was delayed by -1.3702040559999205s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17470000000000002s for a response
W20260709 13:09:15.321552 30517 connection.cc:256] RPC call timeout handler was delayed by -1.2775040559999979s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18500000000000003s for a response
W20260709 13:09:15.321835 30517 connection.cc:256] RPC call timeout handler was delayed by -1.2001040559999865s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1936s for a response
W20260709 13:09:15.322100 30517 connection.cc:256] RPC call timeout handler was delayed by -1.0655438909999475s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1884s for a response
I20260709 13:09:15.323161 30517 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:15.151520 31149 raft_consensus.cc:1240] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:15.172698 30591 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
W20260709 13:09:15.324342 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 151754us
I20260709 13:09:15.154366   934 log.cc:1199] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326: Deleting WAL directory at /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-0-root/wals/1560cc6404764454b2843cec97934e6b
I20260709 13:09:15.317975 30625 rpcz_store.cc:276] 0709 13:09:13.935688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.073136 (+1137448us) service_pool.cc:224] Handling call
0709 13:09:15.142396 (+ 69260us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:15.265132 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:15.146929 30620 rpcz_store.cc:276] 0709 13:09:13.993225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.947291 (+954066us) service_pool.cc:224] Handling call
0709 13:09:14.973002 (+ 25711us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:15.094200 (+121198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.106384 (+ 12184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:15.329831 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:15.330616 30620 raft_consensus.cc:2410] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:09:15.331471 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:15.333524 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:15.335824 30619 raft_consensus.cc:2393] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 5: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:15.334152 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:15.337440 30616 raft_consensus.cc:2393] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 10: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
W20260709 13:09:15.338534 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 232731us
W20260709 13:09:15.141983   674 consensus_meta.cc:287] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 1.262s	user 0.010s	sys 0.002s
I20260709 13:09:15.341104 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:15.346359 31150 raft_consensus.cc:2468] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 4.
I20260709 13:09:15.346722 31143 raft_consensus.cc:1240] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:15.342003 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:15.342605 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:15.347349 30546 raft_consensus.cc:3060] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:15.146976   977 raft_consensus.cc:2804] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:15.223444   967 raft_consensus.cc:2749] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:15.146808   945 raft_consensus.cc:2749] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453) with higher term. Message: Invalid argument: T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 6. Current term is 7.
I20260709 13:09:15.348389 30620 raft_consensus.cc:1240] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:15.347285 30551 raft_consensus.cc:2468] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 9.
I20260709 13:09:15.144666  1019 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:15.349808 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:09:15.350133 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.356874 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:15.207661  1001 raft_consensus.cc:2749] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:15.317121   900 raft_consensus.cc:3060] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:15.146075   988 raft_consensus.cc:2749] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:15.144347   836 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:15.264833   973 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:15.143301   902 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:09:15.369065   701 consensus_meta.cc:287] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 1.174s	user 0.007s	sys 0.004s
I20260709 13:09:15.379487   701 raft_consensus.cc:2749] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:15.154471   948 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:15.383033 30622 raft_consensus.cc:2468] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 7.
I20260709 13:09:15.383464   948 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:15.384087   948 raft_consensus.cc:2749] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:15.384652   948 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:15.384826   950 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:15.057387   932 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:15.385145   948 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:15.387036   932 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:15.351951   977 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.350504  1014 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:15.387952   977 raft_consensus.cc:3060] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:15.388056  1014 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:15.390178  1014 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:15.357343   674 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:15.394416 31147 raft_consensus.cc:2368] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 5. Current term is 6.
I20260709 13:09:15.397764   944 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:15.399706   944 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:15.332656  1022 log.cc:927] Time spent T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:09:15.206910   961 raft_consensus.cc:2749] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:15.146631   931 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.400867   931 raft_consensus.cc:3060] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:15.145211   819 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:15.404060   819 raft_consensus.cc:3060] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:15.406018 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:15.407953 31145 raft_consensus.cc:1275] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:15.408582 30441 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:15.347113 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:15.354658 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:15.409263   975 consensus_queue.cc:1059] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:15.409566 30617 raft_consensus.cc:2468] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 7.
I20260709 13:09:15.155646   970 raft_consensus.cc:2804] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:09:15.357860 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 216931us
I20260709 13:09:15.410360   975 raft_consensus.cc:3055] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:15.410480   970 raft_consensus.cc:697] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 7 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:15.410742   975 raft_consensus.cc:740] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:15.136860   704 consensus_queue.cc:1059] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.211s
I20260709 13:09:15.411432   970 consensus_queue.cc:237] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:15.315066 30476 rpcz_store.cc:276] 0709 13:09:13.564926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.614075 (+ 49149us) service_pool.cc:224] Handling call
0709 13:09:13.614366 (+   291us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:13.629800 (+ 15434us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:13.706526 (+ 76726us) log.cc:844] Serialized 14 byte log entry
0709 13:09:14.134425 (+427899us) spinlock_profiling.cc:243] Waited 35.2 ms on lock 0x7b4800240258. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc788e91aa1 00007fc788e88b37 00007fc788e889ca 00007fc788f8026f 00007fc788f7ff37 00007fc788f9455c 00007fc788f94508 00007fc788f94488 00007fc788f94443 00007fc788f936ec 00007fc787ebda96
0709 13:09:14.300896 (+166471us) spinlock_profiling.cc:243] Waited 6.7 ms on lock 0x7b1800289e40. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e5de07 00007fc789cb8ab9 00007fc780e7a69b 00007fc780e7893f 00007fc780e7ac02 00007fc783b0220b 00007fc783b07d23 00007fc783b0823a 00007fc783f72a2a
0709 13:09:14.985450 (+684554us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:14.986059 (+   609us) log.cc:844] Serialized 52 byte log entry
0709 13:09:14.986199 (+   140us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:15.146994 (+160795us) log.cc:844] Serialized 14 byte log entry
0709 13:09:15.147614 (+   620us) log.cc:844] Serialized 14 byte log entry
0709 13:09:15.205574 (+ 57960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.205689 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:15.205756 (+    67us) raft_consensus.cc:1685] finished
0709 13:09:15.205774 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:15.206030 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79128,"prepare.queue_time_us":436244,"prepare.run_cpu_time_us":141,"prepare.run_wall_time_us":10243,"raft.queue_time_us":93886,"raft.run_cpu_time_us":2493,"raft.run_wall_time_us":529178,"spinlock_wait_cycles":169575296,"thread_start_us":844655,"threads_started":2,"wal-append.queue_time_us":1160581}
I20260709 13:09:15.330720   996 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:15.413378   996 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:15.357833 30616 raft_consensus.cc:2468] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 6.
I20260709 13:09:15.340603   974 raft_consensus.cc:2749] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:15.364123 30550 raft_consensus.cc:2393] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 6: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:15.345381   911 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.417019   911 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:15.419157   911 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:15.371973 30624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57140 (request call id 568) took 1511 ms. Trace:
I20260709 13:09:15.419996 30624 rpcz_store.cc:276] 0709 13:09:13.856882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.858001 (+  1119us) service_pool.cc:224] Handling call
0709 13:09:15.368490 (+1510489us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54002debd4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:15.368655 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2453963520}
I20260709 13:09:15.350701   922 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:15.421271   922 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:15.395582   674 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:15.357051   870 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.424248 30625 raft_consensus.cc:1275] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:15.424129   870 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:15.426693 30546 raft_consensus.cc:2468] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 4.
I20260709 13:09:15.328356  1006 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:15.400038 31148 raft_consensus.cc:1240] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 6. Current term is 7. Ops: [6.9-6.9]
I20260709 13:09:15.408685 30548 raft_consensus.cc:3055] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:15.358165 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:15.433084 30548 raft_consensus.cc:740] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:15.433259 30620 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:15.409283 30441 raft_consensus.cc:2686] T 1560cc6404764454b2843cec97934e6b P f639301059e24dc5b0d88a46dc683326: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:09:15.433925 30548 consensus_queue.cc:260] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:15.328630   888 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:15.438707 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:15.438992 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:15.375087 30618 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 7.
I20260709 13:09:15.435061 30548 raft_consensus.cc:3060] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:15.439684 30473 raft_consensus.cc:2393] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 6: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:15.440558 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:15.436091 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:15.441416 30476 raft_consensus.cc:2376] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6. Re-sending same reply.
I20260709 13:09:15.368981  1019 consensus_queue.cc:1048] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:09:15.436951 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:15.383213  1012 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:15.427363   870 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:15.456854 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:15.464968 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:15.465798 30472 raft_consensus.cc:2410] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:09:15.466248 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:15.466813 30470 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:15.399447   763 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:15.469103 30620 raft_consensus.cc:2410] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:15.455884 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:15.469987 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:15.472494 30476 raft_consensus.cc:2393] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 8: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:15.473024   963 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:15.476821 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.423748   922 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:15.488413 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:15.489019 30476 raft_consensus.cc:3060] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:15.491802 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 436744us
I20260709 13:09:15.387033   948 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:15.495621 30542 raft_consensus.cc:2393] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 8: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
W20260709 13:09:15.486274  1018 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:09:15.503459 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:15.411553   975 consensus_queue.cc:260] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:15.502566 30440 leader_election.cc:336] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Timed out: RequestConsensusVote RPC to 127.28.173.2:34733 timed out after 1.619s (SENT)
I20260709 13:09:15.506810 30440 leader_election.cc:304] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:15.501341 31147 raft_consensus.cc:1240] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:15.484056   988 raft_consensus.cc:3055] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:15.505798 30470 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 6.
I20260709 13:09:15.508711 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:15.511318 31115 leader_election.cc:304] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:09:15.511835 30472 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7.
I20260709 13:09:15.517194 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:15.456853   961 consensus_queue.cc:1059] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:09:15.516693   836 raft_consensus.cc:2749] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:15.523057   999 consensus_queue.cc:1059] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:15.524688   996 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:15.526748   888 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:15.530558   977 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:15.531937   970 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.543151   970 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:15.545416   970 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:15.549113   934 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53858 (request call id 77) took 3534 ms. Trace:
I20260709 13:09:15.534368   900 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:15.549608   934 rpcz_store.cc:276] 0709 13:09:12.015067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.015262 (+   195us) service_pool.cc:224] Handling call
0709 13:09:12.155971 (+140709us) ts_tablet_manager.cc:1151] Deleting tablet 1560cc6404764454b2843cec97934e6b
0709 13:09:12.177044 (+ 21073us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:09:15.018132 (+2841088us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:15.075729 (+ 57597us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:15.549035 (+473306us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1674325,"tablet-delete.queue_time_us":132643,"thread_start_us":47624,"threads_started":1}
I20260709 13:09:15.551157   900 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:15.551888 30476 raft_consensus.cc:2468] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 6.
I20260709 13:09:15.553120 31115 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:15.542066   931 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:15.536945   763 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:15.531572   836 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:15.517093   988 raft_consensus.cc:740] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:15.559960 31115 leader_election.cc:304] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:15.568765 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:15.564963  1006 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:15.559173   973 raft_consensus.cc:2804] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:15.575314   973 raft_consensus.cc:493] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.559314   958 raft_consensus.cc:3055] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:15.559428   704 raft_consensus.cc:2749] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:15.566272   942 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:15.566510   819 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:15.556200 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 233090us
I20260709 13:09:15.568158 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:15.598730 30470 raft_consensus.cc:2376] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6. Re-sending same reply.
I20260709 13:09:15.569384 30471 raft_consensus.cc:2468] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 8.
I20260709 13:09:15.568154 30469 raft_consensus.cc:1240] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:09:15.569854 31116 leader_election.cc:304] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:15.571640 31115 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:15.574101 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:15.574754 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:15.598174 30517 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:15.600713 30472 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 8.
I20260709 13:09:15.600765 30468 raft_consensus.cc:2376] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5. Re-sending same reply.
I20260709 13:09:15.582497 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:15.600294 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:15.602201 30545 raft_consensus.cc:1240] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:15.602476 30469 raft_consensus.cc:2410] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:09:15.585009 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:15.588038 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:15.588990 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:15.579706   973 raft_consensus.cc:3060] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:15.604825 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:15.605230 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:15.584600 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:15.606098 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:15.602968 30544 raft_consensus.cc:2468] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7.
I20260709 13:09:15.604867 30547 raft_consensus.cc:1275] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:09:15.605816 30467 raft_consensus.cc:2468] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:09:15.610865 30517 leader_election.cc:400] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 6. Current term is 7.
I20260709 13:09:15.612151 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:15.612316 30517 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:15.583184   701 raft_consensus.cc:2804] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:15.614969  1034 consensus_queue.cc:1048] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:15.615751 31146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10b0408011914710a008d9e9b58f002c"
dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
mode: GRACEFUL
new_leader_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:42956
I20260709 13:09:15.616338  1034 consensus_queue.cc:1059] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:15.617305  1034 raft_consensus.cc:3055] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:15.613327   888 raft_consensus.cc:2749] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:15.617640  1034 raft_consensus.cc:740] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:15.570531   836 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:15.618505  1034 consensus_queue.cc:260] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:15.619894   836 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:15.620450 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.620287 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:15.579927   958 raft_consensus.cc:740] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:15.621804   958 consensus_queue.cc:260] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:15.622304   931 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:15.622957   958 raft_consensus.cc:3060] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:15.623097   999 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.609103   967 raft_consensus.cc:2804] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:15.623594   999 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:15.625782   999 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:15.627202 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 55619.7us
I20260709 13:09:15.627498   704 raft_consensus.cc:2749] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:15.627553 30589 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:15.628010   967 raft_consensus.cc:697] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 6 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:15.628484   999 raft_consensus.cc:2804] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:15.620971 30543 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7.
I20260709 13:09:15.644177 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:15.645516 31148 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7.
I20260709 13:09:15.644497 31151 raft_consensus.cc:1240] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:15.643303 30589 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:15.644667 31115 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:15.649842 30517 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:15.652437 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:15.654202 31115 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:15.653873 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:15.665412 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:15.658372  1034 raft_consensus.cc:3060] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:15.653860   911 raft_consensus.cc:2804] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:15.633442   701 raft_consensus.cc:493] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:15.669258   977 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:15.642498   999 raft_consensus.cc:697] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:15.672796 31115 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:15.654031   945 raft_consensus.cc:2804] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:15.666229 30467 raft_consensus.cc:2376] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 6. Re-sending same reply.
I20260709 13:09:15.680269 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:15.679880 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:15.830363 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:15.830767 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:15.831175 31151 raft_consensus.cc:2393] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 6: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:15.829663 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:15.679154 31115 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:15.832851 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:15.655284  1030 raft_consensus.cc:2749] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:15.657096   900 raft_consensus.cc:2749] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:15.684000 31114 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326
W20260709 13:09:15.771435 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 123718us
I20260709 13:09:15.684554  1036 raft_consensus.cc:2749] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:15.667043   948 consensus_queue.cc:1048] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.095s
I20260709 13:09:15.629038   967 consensus_queue.cc:237] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:15.822089 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:15.844673 30548 raft_consensus.cc:2410] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:15.823827 30544 raft_consensus.cc:1240] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 6 LEADER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:15.677340   701 raft_consensus.cc:3060] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:15.672518   902 raft_consensus.cc:2749] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:15.676256   911 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:09:15.827845 30440 leader_election.cc:336] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Timed out: RequestConsensusVote RPC to 127.28.173.2:34733 timed out after 1.699s (SENT)
I20260709 13:09:15.828586 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:15.829293 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:15.667734   988 consensus_queue.cc:260] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:15.833679 30546 raft_consensus.cc:1240] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:15.833773 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:15.852057 31144 raft_consensus.cc:3060] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:15.751458   996 consensus_queue.cc:1059] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.092s
I20260709 13:09:15.832074 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
W20260709 13:09:15.853590 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 192041us
I20260709 13:09:15.830416 30473 raft_consensus.cc:2376] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 8. Re-sending same reply.
I20260709 13:09:15.751099   922 consensus_queue.cc:1059] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.088s
I20260709 13:09:15.677203   888 consensus_queue.cc:1048] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.141s
I20260709 13:09:15.839744 30545 raft_consensus.cc:1240] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 3. Current term is 4. Ops: []
W20260709 13:09:15.840219 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 161190us
I20260709 13:09:15.856416 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:15.835456 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:15.841640 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:15.861021 31143 raft_consensus.cc:2393] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 7: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:15.842661 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:15.861810 30472 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:15.842839 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 158903us
W20260709 13:09:15.867249 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.867918 31114 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:15.869091 31114 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:09:15.780025  1012 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:15.845429 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:15.870038 30470 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 6.
I20260709 13:09:15.841933 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:15.870775 30550 raft_consensus.cc:3060] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:15.831990 30471 raft_consensus.cc:2468] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:09:15.847775 31148 raft_consensus.cc:2393] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 8: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:15.849583 30440 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:15.849208 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:15.852010 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:15.875211 30548 raft_consensus.cc:2393] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 6: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
W20260709 13:09:15.827023  1042 log.cc:927] Time spent T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:09:15.847775   911 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:15.878474 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:15.880194 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:15.883515 30623 raft_consensus.cc:2393] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 5: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
W20260709 13:09:15.883975 30623 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57140 (request call id 577) took 1774 ms (client timeout 2099 ms). Trace:
W20260709 13:09:15.884331 30623 rpcz_store.cc:269] 0709 13:09:14.109316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.879979 (+1770663us) service_pool.cc:224] Handling call
0709 13:09:15.883910 (+  3931us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:15.880560 30467 raft_consensus.cc:2393] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 6: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:15.846205   674 raft_consensus.cc:2804] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:09:15.882174 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 54389.3us
I20260709 13:09:15.847523   942 raft_consensus.cc:2804] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:15.904657 30546 raft_consensus.cc:1275] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:09:15.905143 30546 pending_rounds.cc:85] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd: Aborting all ops after (but not including) 3
I20260709 13:09:15.905381 30546 pending_rounds.cc:107] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:09:15.905601 30546 raft_consensus.cc:2889] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:15.888154 30472 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 10.
I20260709 13:09:15.908056 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:15.850903   945 raft_consensus.cc:697] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:15.909171 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:15.910954 31144 raft_consensus.cc:2468] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 7.
I20260709 13:09:15.852550   944 consensus_queue.cc:1048] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:09:15.872198   888 consensus_queue.cc:1243] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer f639301059e24dc5b0d88a46dc683326 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:09:15.920389 31115 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:15.913441 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:15.912757 31150 raft_consensus.cc:1240] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:15.913992 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:15.924472 30546 raft_consensus.cc:1240] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:15.913949 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:15.882706   902 raft_consensus.cc:2749] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:15.927021 30549 raft_consensus.cc:1240] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:15.934120 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:15.931033 30589 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:15.934985 30545 raft_consensus.cc:2393] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 5: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:15.931675 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:15.881222   836 raft_consensus.cc:2749] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:15.933216 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:15.904778   942 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:15.932507 30548 raft_consensus.cc:2410] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:15.950980   945 consensus_queue.cc:237] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:15.922358   958 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.954087 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:15.954770 30471 raft_consensus.cc:2393] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 8: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:15.954849 30543 raft_consensus.cc:1240] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:15.955611 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:15.938252 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:15.956563 31148 raft_consensus.cc:2393] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 6: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:15.857770   999 consensus_queue.cc:237] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:15.958403 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:16.038304 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:16.000037 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:16.040248 30542 raft_consensus.cc:2393] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 10: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:15.986999 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:16.042063 30549 raft_consensus.cc:2410] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:09:15.937438  1030 raft_consensus.cc:3060] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:16.003506 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:16.020689 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 184667us
I20260709 13:09:15.929199  1007 raft_consensus.cc:2804] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:15.910182  1012 raft_consensus.cc:3055] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:09:16.037683 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 168652us
I20260709 13:09:16.036168 30545 raft_consensus.cc:1240] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:16.059525 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:15.976119   819 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:16.062909 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:16.056334 30516 leader_election.cc:400] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Vote denied by peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453) with higher term. Message: Invalid argument: T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 5. Current term is 6.
I20260709 13:09:16.064042 30516 leader_election.cc:403] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:15.965198   942 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:15.990444  1043 raft_consensus.cc:2749] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:16.034643   674 raft_consensus.cc:697] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 7 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:16.053450 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:16.062988 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:16.067230 31115 leader_election.cc:336] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Timed out: RequestConsensusVote RPC to 127.28.173.3:32851 timed out after 1.816s (SENT)
I20260709 13:09:16.068142 30545 raft_consensus.cc:2393] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 6: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:16.075765 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:16.076742 30545 raft_consensus.cc:2393] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 6: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:16.073150   948 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:09:16.079878 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:16.072995  1007 raft_consensus.cc:697] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:16.080971 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:16.077803 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:16.081072  1007 consensus_queue.cc:237] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:16.072773   674 consensus_queue.cc:237] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.4, Last appended by leader: 4, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:16.083494   938 raft_consensus.cc:3055] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:16.084039 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:15.989259  1040 log.cc:927] Time spent T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:09:16.068907 30440 leader_election.cc:336] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Timed out: RequestConsensusVote RPC to 127.28.173.2:34733 timed out after 1.822s (SENT)
I20260709 13:09:16.085513 30440 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:16.086282 30441 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.066334 30516 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
W20260709 13:09:16.119191 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 52946.1us
I20260709 13:09:16.121346 30516 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:16.084297 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:16.061146  1012 raft_consensus.cc:740] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:16.101238 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
W20260709 13:09:16.125010 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 56131.5us
I20260709 13:09:15.988963 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:16.107234 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:16.108479 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:16.129514 30620 raft_consensus.cc:2410] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:09:16.109854 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:16.041589   958 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:16.111936 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:16.131146 30624 raft_consensus.cc:2393] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 6: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:16.119232 30441 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:16.106325 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 175355us
I20260709 13:09:16.127271 30516 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:16.133193 30516 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:16.085670   938 raft_consensus.cc:740] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:16.128119  1018 raft_consensus.cc:2749] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:16.072723   888 consensus_queue.cc:1059] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:09:16.128432   922 raft_consensus.cc:2804] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:16.150750 30618 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 5.
I20260709 13:09:16.128314  1006 raft_consensus.cc:2749] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:16.151791 30361 catalog_manager.cc:5028] TS f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): tablet 1560cc6404764454b2843cec97934e6b (table test-workload [id=887057791fed41a884abbab3e8d4b49f]) successfully deleted
W20260709 13:09:16.153656 30361 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 97577.8us
I20260709 13:09:16.155581 30550 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 7.
I20260709 13:09:16.161629 30542 raft_consensus.cc:1275] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:16.145510  1017 raft_consensus.cc:2804] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:16.167881 30516 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:16.168639 30589 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
W20260709 13:09:16.173987 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:16.172153  1034 consensus_meta.cc:287] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.502s	user 0.008s	sys 0.001s
I20260709 13:09:16.178604 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:16.178962 31147 raft_consensus.cc:1240] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 5. Current term is 6. Ops: [3.6-5.7]
I20260709 13:09:16.179437 31144 raft_consensus.cc:2468] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 6.
I20260709 13:09:16.145543  1041 raft_consensus.cc:2804] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:09:16.189103 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 56967.1us
I20260709 13:09:16.167196   963 raft_consensus.cc:2804] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:16.190549   900 raft_consensus.cc:2804] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:16.202288   900 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:16.202682   900 raft_consensus.cc:3060] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:16.172305  1017 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:16.204612  1017 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:16.216434 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 47871.5us
I20260709 13:09:16.173913   922 raft_consensus.cc:697] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 7 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:16.222400 30622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57140 (request call id 579) took 1180 ms. Trace:
I20260709 13:09:16.222987 30622 rpcz_store.cc:276] 0709 13:09:15.041701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.041810 (+   109us) service_pool.cc:224] Handling call
0709 13:09:16.222200 (+1180390us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b54003449d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:16.222332 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":506203904}
I20260709 13:09:16.229357  1058 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:16.229903  1058 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:16.232048  1058 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:16.233070  1062 consensus_queue.cc:1059] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:16.233829  1062 consensus_queue.cc:1243] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer 092f6eb694fc4bbeab49677cccd880fd log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:09:16.234335  1006 raft_consensus.cc:3055] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:16.234678  1006 raft_consensus.cc:740] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:16.235020   940 raft_consensus.cc:3055] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:16.235376   940 raft_consensus.cc:740] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:16.235445  1006 consensus_queue.cc:260] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:16.237020  1006 raft_consensus.cc:3060] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:16.245370   937 consensus_queue.cc:1059] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:16.246122   937 consensus_queue.cc:1243] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer 092f6eb694fc4bbeab49677cccd880fd log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:09:16.246918   937 raft_consensus.cc:3055] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:16.184868   945 consensus_queue.cc:1059] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:09:16.247258   937 raft_consensus.cc:740] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:16.247565  1012 consensus_queue.cc:260] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:16.248248   937 consensus_queue.cc:260] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:16.248807  1012 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:16.249336   937 raft_consensus.cc:3060] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:16.253510   958 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:16.254436  1038 log.cc:927] Time spent T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.599s	user 0.002s	sys 0.000s
I20260709 13:09:16.255349 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:16.257835   701 raft_consensus.cc:515] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:16.189733   931 consensus_queue.cc:1059] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 13:09:16.260403   980 raft_consensus.cc:3055] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:16.260792   980 raft_consensus.cc:740] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:16.261504   980 consensus_queue.cc:260] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:16.262782 30618 raft_consensus.cc:2468] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 6.
I20260709 13:09:16.263290  1018 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.263729  1018 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:16.265609  1018 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:16.266044   973 consensus_meta.cc:287] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.657s	user 0.007s	sys 0.001s
I20260709 13:09:16.266301 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:16.266549   973 raft_consensus.cc:515] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:16.267648 31146 raft_consensus.cc:606] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Received request to transfer leadership to TS f639301059e24dc5b0d88a46dc683326
I20260709 13:09:16.268018 31146 raft_consensus.cc:614] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:16.270260 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:16.270982 30622 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:16.272229 31116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.217658 30589 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:16.275003 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 57407.9us
I20260709 13:09:16.198438  1034 consensus_queue.cc:1048] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:09:16.215987   974 raft_consensus.cc:2749] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:16.219230 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.280416 30618 raft_consensus.cc:1275] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:16.281178 30589 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:16.213901   938 consensus_queue.cc:260] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:16.298954 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:16.224521   948 raft_consensus.cc:2749] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453) with higher term. Message: Invalid argument: T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 5. Current term is 6.
I20260709 13:09:16.289647  1051 raft_consensus.cc:2804] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:16.243300 30372 catalog_manager.cc:5697] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 4 to 5, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 5 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:16.266055  1018 raft_consensus.cc:493] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:16.310464 30545 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 6.
I20260709 13:09:16.312896   973 leader_election.cc:290] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:16.314860 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:16.315541 30618 raft_consensus.cc:3060] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:16.315430   922 consensus_queue.cc:237] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:16.318183 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:16.318747 30616 raft_consensus.cc:3060] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:16.299288   836 consensus_queue.cc:1048] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:09:16.297550 30591 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:16.305680   945 consensus_queue.cc:1059] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:09:16.320327   996 raft_consensus.cc:2749] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:16.311829   818 consensus_queue.cc:1048] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:09:16.308372   974 raft_consensus.cc:2804] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:16.321043   701 leader_election.cc:290] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:16.321451   974 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:16.321862   974 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:16.289827   819 consensus_queue.cc:1048] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:09:16.308578  1051 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.327741   911 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:16.329664 30591 leader_election.cc:304] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:16.330066 30544 raft_consensus.cc:2393] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 10: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:16.321043   945 raft_consensus.cc:3055] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:16.330587   945 raft_consensus.cc:740] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:16.331323 30591 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:16.331462   945 consensus_queue.cc:260] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:16.332031   819 raft_consensus.cc:2749] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:16.286195 30622 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 6.
I20260709 13:09:16.214303   888 consensus_queue.cc:1048] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 13:09:16.296132  1006 consensus_queue.cc:1059] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:09:16.321753 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:16.332683   945 raft_consensus.cc:3060] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:16.333853   819 raft_consensus.cc:3060] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:16.295881   900 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:16.333549 31145 raft_consensus.cc:2393] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 6: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:16.333626  1006 raft_consensus.cc:3055] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:16.336328  1006 raft_consensus.cc:740] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:16.336788   900 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:16.337096  1006 consensus_queue.cc:260] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:16.337616   940 consensus_queue.cc:260] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:16.337994 31115 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:16.338299  1006 raft_consensus.cc:3060] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:16.338833   946 raft_consensus.cc:2804] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:16.338920   940 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:16.339422   946 raft_consensus.cc:697] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 6 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:16.340657 30591 leader_election.cc:304] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:16.301047 30440 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:16.297293 30517 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
W20260709 13:09:16.348057 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 47125.9us
W20260709 13:09:16.348712 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 51495.1us
I20260709 13:09:16.349607 30440 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:16.350098 30372 catalog_manager.cc:5697] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 1 to 6, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 6 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:16.351218 30440 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:16.349611 30517 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:16.354377   992 raft_consensus.cc:2749] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:16.310139   970 consensus_queue.cc:1059] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:09:16.355136  1062 raft_consensus.cc:2749] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:16.355849   937 raft_consensus.cc:2749] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:16.357054 30591 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:16.304375   958 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.357883   988 raft_consensus.cc:3060] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:16.358431  1048 raft_consensus.cc:2804] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:16.358232   958 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:16.358829  1048 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:16.359200  1048 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:16.360401   958 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:16.363978   900 raft_consensus.cc:3060] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:16.366978   975 raft_consensus.cc:3060] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:16.367902  1048 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:16.368798 30616 raft_consensus.cc:2468] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 4.
I20260709 13:09:16.370649   819 raft_consensus.cc:2749] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:16.327661  1051 raft_consensus.cc:3060] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:16.372215   970 consensus_queue.cc:1059] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:16.372514 31115 leader_election.cc:304] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:16.373373   870 raft_consensus.cc:3055] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:16.373320   942 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:16.373893   870 raft_consensus.cc:740] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:16.375123  1007 raft_consensus.cc:2804] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:16.374722   870 consensus_queue.cc:260] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:16.376085  1018 raft_consensus.cc:515] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:16.357651  1045 raft_consensus.cc:2749] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:16.377919 30591 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:16.378985  1056 raft_consensus.cc:2804] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:16.379362  1056 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.379483 30591 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:16.375620  1007 raft_consensus.cc:697] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:16.379873  1056 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:16.380668 30591 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:16.380580  1007 consensus_queue.cc:237] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:16.384079   870 raft_consensus.cc:3060] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:16.391449   992 consensus_queue.cc:1059] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:16.392642  1062 raft_consensus.cc:3055] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:16.393004  1062 raft_consensus.cc:740] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:16.393826  1062 consensus_queue.cc:260] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:16.395215   946 consensus_queue.cc:237] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:16.396550  1018 leader_election.cc:290] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:16.398849  1048 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:16.345084 30618 raft_consensus.cc:2468] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 4.
I20260709 13:09:16.405942 30591 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:16.412290 30591 leader_election.cc:304] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:16.414079 31115 leader_election.cc:304] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:16.412506  1050 raft_consensus.cc:2749] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:09:16.411945 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 62437.8us
I20260709 13:09:16.412216 30372 catalog_manager.cc:5697] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:16.418887 30517 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:16.431406  1014 raft_consensus.cc:2749] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:16.433175 30517 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:16.433909  1014 raft_consensus.cc:2804] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:16.434280  1014 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:16.434639  1014 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:16.443259  1014 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:16.445259  1014 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:16.395262  1062 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:16.329787   911 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:16.375540   942 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:16.391101  1051 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:16.450712 30591 leader_election.cc:304] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:16.453512 30517 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:16.412761  1045 raft_consensus.cc:2749] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:16.418040  1018 raft_consensus.cc:2749] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:16.418198  1030 raft_consensus.cc:2749] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:16.456439 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.446606   973 raft_consensus.cc:2804] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:16.446741  1055 raft_consensus.cc:2804] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:16.460144 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
W20260709 13:09:16.463263 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 182178us
I20260709 13:09:16.464663 30618 raft_consensus.cc:1240] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:16.465801 30616 raft_consensus.cc:1240] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:16.467453 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:16.467509 30517 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:16.467870 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:09:16.469805 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 284029us
I20260709 13:09:16.495122 30516 leader_election.cc:304] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:16.470150 31144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a418ef882d34180817469c4e2495268"
dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
mode: GRACEFUL
new_leader_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:42956
W20260709 13:09:16.495805 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 353881us
I20260709 13:09:16.497989 30618 raft_consensus.cc:1240] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:16.481271 30372 catalog_manager.cc:5697] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
I20260709 13:09:16.496461 31144 raft_consensus.cc:606] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Received request to transfer leadership to TS f639301059e24dc5b0d88a46dc683326
I20260709 13:09:16.541450 31144 raft_consensus.cc:614] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:09:16.497406 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:16.539476 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 44433.1us
I20260709 13:09:16.499006 30620 raft_consensus.cc:1240] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:16.544348 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:16.545773 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:16.546478 30542 raft_consensus.cc:2393] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 8: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:16.546339 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:16.454501  1041 raft_consensus.cc:697] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 10 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:16.457026  1048 raft_consensus.cc:2749] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:16.541805 30441 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:16.505930 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:16.577346 30544 raft_consensus.cc:1240] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 7 LEADER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:16.577831 30622 raft_consensus.cc:2393] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 7: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:16.577931 30441 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:16.578619 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:16.579329 30441 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:16.581230 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 85720.6us
I20260709 13:09:16.550397 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:16.465314   922 raft_consensus.cc:2804] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:16.506121 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:16.584290 30619 raft_consensus.cc:3060] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:16.454826   945 raft_consensus.cc:2749] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:16.540759   948 raft_consensus.cc:2749] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:16.463312  1055 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:16.540503   933 consensus_queue.cc:1048] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:09:16.542557   973 raft_consensus.cc:697] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:16.496801  1014 raft_consensus.cc:2749] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:16.553095 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:16.553956 30372 catalog_manager.cc:5697] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
I20260709 13:09:16.557670   900 raft_consensus.cc:2749] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:16.561213  1051 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:16.561448 30547 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 6.
I20260709 13:09:16.553790   937 raft_consensus.cc:493] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:16.561861 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:16.570294 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:16.570924 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:16.571720 30551 raft_consensus.cc:1240] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:16.584630 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:16.587831 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:16.587921 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:16.593921 30622 raft_consensus.cc:2468] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 7.
I20260709 13:09:16.597793 30624 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 8.
I20260709 13:09:16.597805 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:09:16.501087 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:16.623353 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.607311 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:16.594583  1055 raft_consensus.cc:3060] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:16.636096 30550 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7.
I20260709 13:09:16.638355 30617 raft_consensus.cc:2393] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 7: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:16.588634   870 raft_consensus.cc:2804] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:16.657527 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:16.658950 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:16.660626 30619 raft_consensus.cc:2468] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 8.
I20260709 13:09:16.585500   836 raft_consensus.cc:2804] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:16.641147 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:16.672449 30551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
mode: GRACEFUL
new_leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
 from {username='slave'} at 127.0.0.1:45906
I20260709 13:09:16.673144 30551 raft_consensus.cc:606] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Received request to transfer leadership to TS fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:16.673569 30551 raft_consensus.cc:614] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:16.641738 30542 raft_consensus.cc:2393] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 8: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:16.644089 30550 raft_consensus.cc:1240] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:16.645129 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:16.645464 30548 pending_rounds.cc:85] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd: Aborting all ops after (but not including) 7
I20260709 13:09:16.675583 30548 pending_rounds.cc:107] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:09:16.675908 30548 raft_consensus.cc:2889] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:16.654166   931 raft_consensus.cc:2749] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:16.655679 30469 raft_consensus.cc:3060] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:16.680744 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:16.681737 31146 raft_consensus.cc:1275] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:09:16.682761 31114 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:16.656175   980 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:16.639209 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:16.506649 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:16.662177 30589 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:16.660657 31151 raft_consensus.cc:1275] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:16.585914   922 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:16.459115   963 raft_consensus.cc:697] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 6 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:16.684111 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:09:16.710449 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 48340.1us
I20260709 13:09:16.689841  1041 consensus_queue.cc:237] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:16.691373 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 44501.4us
I20260709 13:09:16.693063 30547 raft_consensus.cc:3060] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:16.693172 30372 catalog_manager.cc:5697] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:16.711663 30621 raft_consensus.cc:2393] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 8: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:16.713253 30589 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:16.685847 30469 raft_consensus.cc:2468] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 9.
I20260709 13:09:16.717818 31149 raft_consensus.cc:2410] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:09:16.720268 30547 raft_consensus.cc:2468] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
W20260709 13:09:16.721393 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 142114us
I20260709 13:09:16.723248 30589 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:16.657220   870 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.752051   870 raft_consensus.cc:3060] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:16.752331  1067 log.cc:927] Time spent T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:09:16.753414 31146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb22806325394ba386d8549bc4a64701"
dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
mode: GRACEFUL
new_leader_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:42956
I20260709 13:09:16.754070 31146 raft_consensus.cc:606] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 7 LEADER]: Received request to transfer leadership to TS f639301059e24dc5b0d88a46dc683326
I20260709 13:09:16.657035   937 raft_consensus.cc:515] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:16.756044   937 leader_election.cc:290] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:16.724440  1058 raft_consensus.cc:2804] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:16.756749  1058 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.757082  1058 raft_consensus.cc:3060] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:16.758241 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:16.657986   970 consensus_queue.cc:1048] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 13:09:16.731977  1065 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.731894   819 consensus_queue.cc:1059] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:09:16.760286  1065 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:16.760701   819 raft_consensus.cc:3055] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:16.761116   819 raft_consensus.cc:740] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:16.762006   819 consensus_queue.cc:260] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:16.762732  1065 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:16.763116   819 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:16.742098 31145 raft_consensus.cc:1240] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:16.742484   963 consensus_queue.cc:237] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:16.721483   922 raft_consensus.cc:3060] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:16.743637   961 raft_consensus.cc:2749] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:16.767975   973 consensus_queue.cc:237] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:16.733450  1052 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:16.733861  1014 consensus_queue.cc:1059] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.011s
W20260709 13:09:16.748363  1066 log.cc:927] Time spent T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 13:09:16.677109   958 consensus_queue.cc:1059] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
W20260709 13:09:16.709070  1072 log.cc:927] Time spent T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:09:16.753661   974 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:16.768030 31114 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:16.744292 30589 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:16.675880   975 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.731964   951 consensus_queue.cc:1048] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:09:16.771502   938 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:16.671535   836 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:16.747535  1056 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:16.816275   948 raft_consensus.cc:3055] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:16.816830   948 raft_consensus.cc:740] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:16.817899   948 consensus_queue.cc:260] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:16.819388   948 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:16.807224   911 consensus_queue.cc:1059] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:09:16.821327   961 raft_consensus.cc:3055] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:16.821795   911 raft_consensus.cc:3055] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:16.821866   961 raft_consensus.cc:740] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:16.822357   911 raft_consensus.cc:740] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:16.823031   961 consensus_queue.cc:260] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:16.826785 30469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60026 (request call id 608) took 1174 ms. Trace:
I20260709 13:09:16.827172 30469 rpcz_store.cc:276] 0709 13:09:15.652079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.652219 (+   140us) service_pool.cc:224] Handling call
0709 13:09:16.826597 (+1174378us) spinlock_profiling.cc:243] Waited 999 ms on lock 0x7b54002170d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:16.826707 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2298826496}
I20260709 13:09:16.771649   900 consensus_queue.cc:1059] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:09:16.828260   888 raft_consensus.cc:3055] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:16.806068   975 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:16.828652   888 raft_consensus.cc:740] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:16.829558   888 consensus_queue.cc:260] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:16.830153   975 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:16.803275   990 raft_consensus.cc:2749] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:09:16.799466 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 55269.4us
I20260709 13:09:16.724283  1045 raft_consensus.cc:2749] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:16.808641   836 raft_consensus.cc:3060] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:16.781581  1017 consensus_meta.cc:287] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.576s	user 0.009s	sys 0.000s
I20260709 13:09:16.771778 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:16.865085 30618 raft_consensus.cc:1240] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:09:16.804986 30372 catalog_manager.cc:5697] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:16.782271  1012 consensus_meta.cc:287] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.533s	user 0.006s	sys 0.004s
I20260709 13:09:16.835049 31115 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:16.780160 30441 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:16.847254 30550 raft_consensus.cc:1275] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:16.849043 30547 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
mode: GRACEFUL
new_leader_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:45906
I20260709 13:09:16.849896 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:16.865000 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:16.850590 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:16.851229 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:16.851858 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:16.852478 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:16.852954 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:16.830687   888 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:16.854064 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:16.874327 30543 raft_consensus.cc:2468] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 8.
I20260709 13:09:16.809810   958 raft_consensus.cc:2804] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:16.802312 30516 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:16.861601 30472 raft_consensus.cc:1275] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:09:16.881433 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 79180us
W20260709 13:09:16.882527 30516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:16.886399 31149 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48414 (request call id 732) took 1235 ms (client timeout 1584 ms). Trace:
W20260709 13:09:16.886777 31149 rpcz_store.cc:269] 0709 13:09:15.650887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:15.651011 (+   124us) service_pool.cc:224] Handling call
0709 13:09:16.886223 (+1235212us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54000ad7d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:16.886348 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2439656320}
I20260709 13:09:16.748317  1055 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:16.823263   911 consensus_queue.cc:260] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:16.889334 30372 catalog_manager.cc:5697] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:16.890314 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.805611  1064 consensus_queue.cc:1059] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:09:16.897992 30372 catalog_manager.cc:5697] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
I20260709 13:09:16.894080 30516 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:16.895318 30469 raft_consensus.cc:1275] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:09:16.896347 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.891180 31116 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:16.891114 30590 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:16.892437 30472 raft_consensus.cc:1275] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:09:16.888240 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 148572us
I20260709 13:09:16.902220 30441 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:16.903074 30441 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:16.903640 30547 raft_consensus.cc:606] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 10 LEADER]: Received request to transfer leadership to TS f639301059e24dc5b0d88a46dc683326
I20260709 13:09:16.877640   967 raft_consensus.cc:2804] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:16.906085 30543 raft_consensus.cc:1275] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:09:16.906502 30543 pending_rounds.cc:85] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd: Aborting all ops after (but not including) 4
I20260709 13:09:16.906725 30543 pending_rounds.cc:107] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:09:16.906952 30543 raft_consensus.cc:2889] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:16.907073 30441 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:16.910306 31144 raft_consensus.cc:1240] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:16.894855   931 raft_consensus.cc:2749] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:16.895692  1080 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.936245 30441 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:16.895779   958 raft_consensus.cc:697] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:16.876730  1017 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:16.940506 30618 raft_consensus.cc:1240] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:16.944708 30441 leader_election.cc:304] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:16.915675 30516 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:16.896385  1014 consensus_queue.cc:1048] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:09:16.946766  1080 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:16.875720  1043 consensus_queue.cc:1048] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:09:16.953235   974 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:16.890316   963 raft_consensus.cc:2749] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:16.961987 30441 leader_election.cc:304] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:16.961050 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 45453.3us
W20260709 13:09:17.040175 30516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.916040  1045 raft_consensus.cc:2749] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:16.954777   970 raft_consensus.cc:2749] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:16.964300  1018 raft_consensus.cc:2749] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:16.965000   958 consensus_queue.cc:237] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:16.943620   967 raft_consensus.cc:697] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 8 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:16.974539  1056 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:16.914710   990 consensus_queue.cc:1048] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:09:16.961155  1007 consensus_queue.cc:1048] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:09:16.962363   942 consensus_queue.cc:1048] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:09:16.978160  1046 consensus_queue.cc:1059] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:16.938398  1041 raft_consensus.cc:2749] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:16.981246 30616 raft_consensus.cc:2468] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 7.
I20260709 13:09:16.983039  1058 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:16.914405  1079 raft_consensus.cc:2749] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:17.162317  1050 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.995985 30617 raft_consensus.cc:1275] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:16.933147  1062 raft_consensus.cc:2764] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:09:17.005777  1055 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:16.895932   922 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:17.012351  1017 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:16.908114  1006 raft_consensus.cc:2749] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:16.914992   946 raft_consensus.cc:2804] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:09:17.145807 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 190582us
I20260709 13:09:17.159683  1034 consensus_queue.cc:1059] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:09:17.076877   975 raft_consensus.cc:2749] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:16.899943  1012 consensus_queue.cc:1059] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:09:16.967546   870 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:17.171036   963 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.210497   963 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:17.212522   963 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:17.200153  1041 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.213223  1041 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:17.214051   961 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:17.214952  1041 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:17.212452   922 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:17.198091  1050 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:17.200817   988 consensus_queue.cc:1048] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:09:17.222920  1070 raft_consensus.cc:3055] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:17.232529  1050 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:17.233686  1058 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:17.220382   967 consensus_queue.cc:237] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:17.236786  1087 log.cc:927] Time spent T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.303s	user 0.003s	sys 0.000s
I20260709 13:09:17.227680   973 raft_consensus.cc:3055] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:09:17.273568 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:17.276839 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 314709us
I20260709 13:09:17.012980 30474 raft_consensus.cc:1240] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 5. Current term is 6. Ops: []
W20260709 13:09:17.018484 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.390515 29364 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:17.288901 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:17.392376 30549 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:17.278007 30440 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:09:17.393479 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 115989us
I20260709 13:09:17.292835 30548 raft_consensus.cc:1275] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:09:17.293474 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:17.293529 30545 raft_consensus.cc:1240] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:17.397292  1017 raft_consensus.cc:2804] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:17.397756  1017 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.398237  1017 raft_consensus.cc:3060] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:17.290577 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:17.402334 30547 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 7.
I20260709 13:09:17.303794 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:17.154544 31149 raft_consensus.cc:1275] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:09:17.237828  1070 raft_consensus.cc:740] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:17.409006  1091 consensus_queue.cc:1048] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:17.410872  1070 consensus_queue.cc:260] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:17.418136  1070 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:17.419142 30440 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:17.345839   977 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.421278   977 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:17.421970  1103 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:17.422896  1103 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:17.423647   970 raft_consensus.cc:2804] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:17.425570   970 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.427040 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:17.427666  1103 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:17.350157   836 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:17.428812 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.431021   836 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:17.354869   870 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:17.432556 30476 raft_consensus.cc:1240] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:17.355369   975 raft_consensus.cc:2749] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:17.369557 30441 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:17.377115   946 raft_consensus.cc:697] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 9 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:17.435827   946 consensus_queue.cc:237] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:17.437368 30618 raft_consensus.cc:1275] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:09:17.440804 30474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 616) took 1161 ms. Trace:
I20260709 13:09:17.443856   970 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:17.377439 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 223321us
W20260709 13:09:17.379871   819 consensus_meta.cc:287] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.616s	user 0.008s	sys 0.003s
I20260709 13:09:17.385628   973 raft_consensus.cc:740] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:17.388108  1048 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.388226   974 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:17.392135 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:17.302378 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:17.228866  1080 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:17.408296   900 raft_consensus.cc:3055] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:17.324128  1065 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:17.456599   900 raft_consensus.cc:740] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:17.457144  1065 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:17.457701   977 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:17.458068   900 consensus_queue.cc:260] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:17.459652  1065 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:17.460407 30622 raft_consensus.cc:1240] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 3. Current term is 4. Ops: []
W20260709 13:09:17.416000 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.405339 29364 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:17.461822   975 raft_consensus.cc:2749] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:17.461620   974 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:17.462333 30622 raft_consensus.cc:1275] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 13:09:17.463327 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 94142.8us
I20260709 13:09:17.464159 30617 raft_consensus.cc:2376] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 8. Re-sending same reply.
I20260709 13:09:17.441325 30474 rpcz_store.cc:276] 0709 13:09:16.279194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.279457 (+   263us) service_pool.cc:224] Handling call
0709 13:09:16.279789 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.414399 (+1134610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.440300 (+ 25901us) spinlock_profiling.cc:243] Waited 733 ms on lock 0x7b540029aed4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:17.440575 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1685590784}
I20260709 13:09:17.411296  1091 consensus_queue.cc:1059] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:09:17.465500 30441 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:17.471840 30549 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 8.
I20260709 13:09:17.488075  1018 consensus_queue.cc:1059] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:17.487569  1048 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:17.496472  1048 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:17.497421   704 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:17.498191  1109 log.cc:927] Time spent T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.118s	user 0.002s	sys 0.000s
I20260709 13:09:17.497402   973 consensus_queue.cc:260] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:17.498454   704 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:17.502750 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.503539  1007 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.504343  1007 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:17.504884   903 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:17.511418   974 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:17.511312 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:17.512531 30620 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 7.
I20260709 13:09:17.514972   902 consensus_queue.cc:1048] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:17.515303   903 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:17.507006  1007 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:17.508708 30621 raft_consensus.cc:1275] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:09:17.520953   903 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:17.521478 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:17.525547  1018 consensus_queue.cc:1243] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Peer cd669586cff44d4bbfcc007e213faab6 log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:09:17.526177   704 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:17.528450 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 61255.4us
I20260709 13:09:17.525444 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:17.455878  1017 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:17.543468 30616 raft_consensus.cc:2468] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 7.
I20260709 13:09:17.545755   975 raft_consensus.cc:493] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.546589   975 raft_consensus.cc:515] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:17.548461  1065 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:17.549386   975 leader_election.cc:290] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:17.549293  1065 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:17.550894  1075 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.551539  1075 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:17.552416 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:17.552593 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 87301.9us
I20260709 13:09:17.553606 30624 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 7.
I20260709 13:09:17.554004 30441 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:17.554265  1075 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:17.556165  1080 raft_consensus.cc:2749] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:17.557596 30623 raft_consensus.cc:1275] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:17.499730   973 raft_consensus.cc:3060] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:17.573140 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:17.573956 30621 raft_consensus.cc:2468] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 7.
I20260709 13:09:17.559481   931 raft_consensus.cc:2804] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:17.576054   931 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.576465   931 raft_consensus.cc:3060] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:17.560138  1108 consensus_queue.cc:1048] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:17.560876 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:17.579063 30546 raft_consensus.cc:2468] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 7.
I20260709 13:09:17.549405   900 raft_consensus.cc:3060] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:17.562623   911 raft_consensus.cc:3060] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:17.564203 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:17.584133 30440 leader_election.cc:304] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:17.584501 30550 raft_consensus.cc:2393] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 5: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:17.585085   937 raft_consensus.cc:2804] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:17.585449   937 raft_consensus.cc:493] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.585781   937 raft_consensus.cc:3060] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:17.568076  1052 consensus_meta.cc:287] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.789s	user 0.009s	sys 0.011s
I20260709 13:09:17.568717  1080 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.571115 30616 raft_consensus.cc:1275] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:17.599177  1080 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:17.600507 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:17.600973 31115 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:17.571002 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:17.578362 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:17.551474  1065 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:17.587512 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:17.601770   903 consensus_queue.cc:1048] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:09:17.606112 30621 raft_consensus.cc:2393] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 8: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:17.608436   958 raft_consensus.cc:3055] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:17.608911   958 raft_consensus.cc:740] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:17.610054   958 consensus_queue.cc:260] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:17.603029  1108 raft_consensus.cc:2804] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:17.613404  1108 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.613754  1108 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:17.611639   958 raft_consensus.cc:3060] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:17.622110 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:17.623714 30618 raft_consensus.cc:2468] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 8.
I20260709 13:09:17.601490  1080 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:17.627077 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.629492 30546 raft_consensus.cc:2468] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 6.
W20260709 13:09:17.631247 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 75631.9us
W20260709 13:09:17.633349 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 51057us
I20260709 13:09:17.642385   870 consensus_queue.cc:1048] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:17.643070 30441 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:17.644812   870 raft_consensus.cc:2804] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:17.645185   870 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.645517   870 raft_consensus.cc:3060] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:17.649029 30517 leader_election.cc:336] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.556s (SENT)
I20260709 13:09:17.649253  1030 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.649957  1030 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:17.651013  1017 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:17.652534 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:17.653441 30546 raft_consensus.cc:3060] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:17.656471   911 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.621910   704 consensus_queue.cc:1048] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:09:17.657173   911 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:17.660051 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:17.660266 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:17.660835 31149 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:17.661278 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:17.661909 31146 raft_consensus.cc:2468] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:09:17.664083   870 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:17.621264  1052 raft_consensus.cc:2749] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:17.666065 30440 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:17.635309 31115 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:17.659332   911 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:17.682736 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 47501.4us
W20260709 13:09:17.691166 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 48246.5us
I20260709 13:09:17.679049  1080 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:17.696336 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 48351.3us
I20260709 13:09:17.680063   836 raft_consensus.cc:2804] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:17.694622   903 raft_consensus.cc:2804] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:17.702570   836 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.711617 31149 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 8.
I20260709 13:09:17.713927   836 raft_consensus.cc:3060] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:17.708124   911 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.694458   937 raft_consensus.cc:515] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:17.715085   911 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:17.720875 30470 raft_consensus.cc:3055] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:17.721314 30470 raft_consensus.cc:740] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:17.718743 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:17.723610  1080 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:17.732052 30441 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:17.732280 30543 raft_consensus.cc:1275] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:09:17.725893 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:17.734042 30550 raft_consensus.cc:3060] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:17.722256 30470 consensus_queue.cc:260] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:17.707257   903 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.737968 30470 raft_consensus.cc:3060] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:17.733531   975 raft_consensus.cc:2749] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:17.738502   903 raft_consensus.cc:3060] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:17.748498 30619 raft_consensus.cc:2468] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 10.
I20260709 13:09:17.750895 30546 raft_consensus.cc:2468] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9.
I20260709 13:09:17.754526   870 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:17.766637 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:17.775111 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:17.776450 30467 raft_consensus.cc:2410] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:17.712658   931 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:17.780471 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:17.781090   931 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:17.780501 30440 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:17.781111 30542 raft_consensus.cc:3060] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:09:17.805039   931 raft_consensus.cc:2804] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:17.810541   931 raft_consensus.cc:697] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 9 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:17.811874   931 consensus_queue.cc:237] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:17.813386 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:17.814339 30620 raft_consensus.cc:2410] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:17.816888 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:17.828596 31149 raft_consensus.cc:1240] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:17.829249   704 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.829856   704 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:17.831097  1031 consensus_queue.cc:1059] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:17.831283   763 consensus_queue.cc:1059] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:17.831801  1030 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:17.832302 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:17.834851   704 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:17.836217   946 raft_consensus.cc:3055] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:17.836634   946 raft_consensus.cc:740] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:17.836797   763 raft_consensus.cc:3055] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:17.837256   763 raft_consensus.cc:740] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:17.837563 30617 raft_consensus.cc:1275] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:17.837932  1080 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:17.837603   946 consensus_queue.cc:260] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:17.838145   763 consensus_queue.cc:260] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:17.839248   946 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:17.805964   911 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:17.841264 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:17.842326 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:17.843048 30471 raft_consensus.cc:2468] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 7.
I20260709 13:09:17.844005 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:17.844094  1052 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.835250 30590 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:17.844834 30473 raft_consensus.cc:2393] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 5: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:17.839507 30620 raft_consensus.cc:1240] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:17.847757 30542 raft_consensus.cc:2468] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 7.
I20260709 13:09:17.848203 31144 raft_consensus.cc:2468] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7.
I20260709 13:09:17.856694 30470 raft_consensus.cc:1275] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:09:17.857134 30470 pending_rounds.cc:85] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326: Aborting all ops after (but not including) 5
I20260709 13:09:17.857455 30470 pending_rounds.cc:107] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:09:17.857796 30470 raft_consensus.cc:2889] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:17.839675   763 raft_consensus.cc:3060] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:17.805387   937 leader_election.cc:290] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:17.884742 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 49669.9us
W20260709 13:09:17.888053 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:17.888489  1115 log.cc:927] Time spent T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 13:09:17.886050   973 consensus_queue.cc:1048] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:09:17.890264 30440 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:17.893227   961 raft_consensus.cc:2804] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:17.893282  1080 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.893821   961 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.894273   961 raft_consensus.cc:3060] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:17.894220  1080 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:17.897233 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.897891  1065 raft_consensus.cc:2804] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:17.898408  1065 raft_consensus.cc:697] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 7 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:17.898901 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:17.899329  1065 consensus_queue.cc:237] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:17.900637 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:17.901309 30545 raft_consensus.cc:2468] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 6.
I20260709 13:09:17.902168 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:17.902940 30543 raft_consensus.cc:2393] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 8: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:17.902787 30590 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:17.897120  1080 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:17.823530   970 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:17.917718 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:17.844867  1052 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:17.934248 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:17.936852 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:17.937199 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:17.914810   819 raft_consensus.cc:2804] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:17.944655 30619 raft_consensus.cc:2468] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 8.
I20260709 13:09:17.950487 30544 raft_consensus.cc:1275] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:09:17.951983 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:17.948046 30516 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:17.956051 30549 raft_consensus.cc:2468] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 8.
I20260709 13:09:17.959287 30543 raft_consensus.cc:2468] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 7.
I20260709 13:09:17.964120 30516 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:17.964191 31116 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:17.965023  1070 raft_consensus.cc:2749] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:17.965204 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 84277.9us
I20260709 13:09:17.965948 30516 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:17.966121 31116 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:17.967017   973 raft_consensus.cc:2749] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:17.968683 30547 raft_consensus.cc:1275] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:09:17.983217 30545 raft_consensus.cc:1275] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:09:17.964131  1117 log.cc:927] Time spent T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 13:09:17.985966 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:17.986807 30549 raft_consensus.cc:2410] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 8 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:09:17.972554  1070 raft_consensus.cc:2749] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:17.967948   819 raft_consensus.cc:697] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:17.995613 31116 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:18.004045 30517 leader_election.cc:336] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.849s (SENT)
I20260709 13:09:17.972456  1031 consensus_queue.cc:1048] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:09:18.009346   701 raft_consensus.cc:2804] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:18.009758   701 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.010097   701 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:18.010834 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:18.011530 31145 raft_consensus.cc:2468] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 6.
W20260709 13:09:18.011884 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.020370 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:18.024542  1058 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.025120  1058 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:18.000368   911 raft_consensus.cc:2749] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:17.994360  1075 consensus_queue.cc:1048] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
W20260709 13:09:18.043413 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 77545.9us
I20260709 13:09:18.051139 31149 raft_consensus.cc:2468] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 8.
I20260709 13:09:18.058507 30516 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:18.060422  1098 raft_consensus.cc:3060] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:18.060663 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 61814.1us
I20260709 13:09:18.060680   819 consensus_queue.cc:237] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:18.064029  1052 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:18.060236 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:18.074539  1103 raft_consensus.cc:2804] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:18.075057  1103 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:18.075444  1103 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:18.075994 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:18.068219  1108 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:18.076756 30542 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:18.078613  1108 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:18.082705  1070 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.083305  1070 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:18.085716  1070 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:18.091727 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:18.092623 30624 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:18.096024   970 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:18.097493  1058 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:18.097822  1103 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:18.098716  1125 log.cc:927] Time spent T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:09:18.100066 30617 raft_consensus.cc:1240] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:09:18.130046 30550 raft_consensus.cc:2468] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 8.
I20260709 13:09:18.134690  1103 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:18.131047  1092 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.147320  1092 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:18.153957 30542 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 8.
W20260709 13:09:18.160483 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.167311 30624 raft_consensus.cc:2468] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 8.
I20260709 13:09:18.170032 31144 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 6.
I20260709 13:09:18.162312   836 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:18.170061 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:18.174283 31151 raft_consensus.cc:3060] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:18.137207   961 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:18.177348 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 128415us
I20260709 13:09:18.171357  1098 raft_consensus.cc:2749] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:18.192772 30516 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:18.194861 30516 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:18.217069  1045 raft_consensus.cc:493] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:18.217787  1045 raft_consensus.cc:515] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:18.220369 31151 raft_consensus.cc:2468] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 7.
I20260709 13:09:18.187717  1092 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:18.241478 31149 raft_consensus.cc:2468] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 5.
I20260709 13:09:18.228494  1103 raft_consensus.cc:2804] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:18.228300  1070 raft_consensus.cc:2764] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:09:18.248682   961 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:18.252166 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 188108us
I20260709 13:09:18.253058  1062 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:18.253547   970 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.253867  1080 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:18.254331   931 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.257591   870 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:18.257071   902 raft_consensus.cc:2955] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 7 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:09:18.264456 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:18.265040 30470 raft_consensus.cc:1275] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:18.230731  1045 leader_election.cc:290] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133)
I20260709 13:09:18.244485   836 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:18.208874   911 consensus_queue.cc:1048] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:09:18.290938 30440 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:09:18.305893 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 262701us
W20260709 13:09:18.312371 30517 leader_election.cc:336] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.101s (SENT)
I20260709 13:09:18.310675 30590 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:18.316212 30440 leader_election.cc:304] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:09:18.325709 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.323797 30440 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:18.332157 30470 raft_consensus.cc:1275] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:09:18.332810 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:18.322129   975 raft_consensus.cc:493] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:09:18.334532  1135 log.cc:927] Time spent T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:09:18.334359 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:18.334748   975 raft_consensus.cc:515] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:18.336066 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:18.336647 30617 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 7.
I20260709 13:09:18.337088   975 leader_election.cc:290] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:18.337307 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:18.337615   967 consensus_queue.cc:1048] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:09:18.303850  1080 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:18.322074   937 raft_consensus.cc:2804] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:18.341522  1080 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:18.341595   937 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.342118   937 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:18.342988 30472 raft_consensus.cc:2955] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:09:18.316917   931 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:18.346413   931 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:18.306306  1062 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:18.347926  1045 raft_consensus.cc:2804] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:09:18.348232   903 consensus_meta.cc:287] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.558s	user 0.010s	sys 0.000s
I20260709 13:09:18.348474  1045 raft_consensus.cc:697] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:18.348675   903 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:18.349519  1045 consensus_queue.cc:237] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:18.350175   937 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:18.328373   836 raft_consensus.cc:2804] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:18.317143   970 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:18.337744   911 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.298283   701 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:18.355916 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 51639.2us
I20260709 13:09:18.356959   701 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:18.343894  1070 consensus_queue.cc:1048] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:18.359135 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:18.359717 30470 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:18.360208   937 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:18.364084   911 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:18.355691 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:18.308751   870 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:18.372229 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:18.373178 30470 raft_consensus.cc:2468] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 8.
W20260709 13:09:18.329785 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 130191us
W20260709 13:09:18.374285 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 50577.6us
I20260709 13:09:18.375991 31116 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:18.378944 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:18.380882 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:09:18.386483 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:18.386922 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:18.387306 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.380331   974 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.398422   974 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:18.399446   870 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:18.400796 30551 raft_consensus.cc:1240] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:18.401031  1062 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:18.374042   836 raft_consensus.cc:697] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 8 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:18.402237   836 consensus_queue.cc:237] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:18.402997 31145 raft_consensus.cc:1217] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Deduplicated request from leader. Original: 2.5->[3.6-3.6]   Dedup: 3.6->[]
I20260709 13:09:18.400702 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:18.403278 30468 raft_consensus.cc:1275] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:09:18.438838 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:18.460393 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:18.421525 30517 leader_election.cc:336] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.735s (SENT)
I20260709 13:09:18.441107 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:18.461347 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:18.460446 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:18.441107 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:18.464026 30546 raft_consensus.cc:3060] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:18.403972 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:18.465912 30473 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:18.406744 30516 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:18.464543 30616 raft_consensus.cc:2468] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 6.
I20260709 13:09:18.387496  1103 raft_consensus.cc:697] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 8 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:18.472150 30544 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 8.
I20260709 13:09:18.381613   975 raft_consensus.cc:2804] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:18.424273   911 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:18.403594 31145 raft_consensus.cc:1240] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:09:18.423966   903 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:18.424678 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
W20260709 13:09:18.485692 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.496080 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:18.381496   973 raft_consensus.cc:2804] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:18.484323 30467 raft_consensus.cc:3060] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:18.489763 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 68306.3us
W20260709 13:09:18.493026 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 117335us
I20260709 13:09:18.499245 30473 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 8.
I20260709 13:09:18.421132   970 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:18.475847 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
W20260709 13:09:18.488835  1139 log.cc:927] Time spent T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.200s	user 0.000s	sys 0.003s
I20260709 13:09:18.503563 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:18.505599 30616 raft_consensus.cc:2468] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 5.
I20260709 13:09:18.468045   946 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.515447 30469 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:18.516526 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:18.505072 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:18.483274   974 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:18.527982 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:18.500571   911 raft_consensus.cc:2804] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:18.536582 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:18.540283 30616 raft_consensus.cc:3060] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:18.514693   973 raft_consensus.cc:697] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 8 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:18.545289 30542 raft_consensus.cc:2468] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:09:18.546676 30516 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:18.542811 30474 raft_consensus.cc:2468] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:09:18.550311   973 consensus_queue.cc:237] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:18.473075  1103 consensus_queue.cc:237] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:18.529760   911 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.556111   911 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:18.557571 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:18.562239 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:18.563043 30589 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:18.578150 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:18.539696   975 raft_consensus.cc:697] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 8 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:18.593509 30546 raft_consensus.cc:2468] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 7.
I20260709 13:09:18.519486   946 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:18.685859 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 122873us
I20260709 13:09:18.688079 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:18.692163 30516 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:18.694412 30617 raft_consensus.cc:2393] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 5: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
W20260709 13:09:18.701957 30517 leader_election.cc:336] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.939s (SENT)
I20260709 13:09:18.704845 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:18.705633 30621 raft_consensus.cc:3060] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:09:18.712467 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:09:18.693648  1127 log.cc:927] Time spent T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 13:09:18.715353  1147 raft_consensus.cc:2804] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:18.715435  1050 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:18.716159  1050 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:18.717298 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 48563.2us
I20260709 13:09:18.694406   974 raft_consensus.cc:2804] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:18.732359  1141 raft_consensus.cc:2804] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:18.732071   975 consensus_queue.cc:237] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:18.745277 30616 raft_consensus.cc:2468] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9.
I20260709 13:09:18.758476   946 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:18.762882 30469 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
I20260709 13:09:18.778787 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:18.733597   974 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:18.801697 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 99815.4us
I20260709 13:09:18.803247 30616 raft_consensus.cc:1275] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:09:18.806183 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:18.809597 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:18.810060 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:18.811003 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:18.812110 31149 raft_consensus.cc:2368] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 6. Current term is 7.
I20260709 13:09:18.804968 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:09:18.808113 30591 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.821s (SENT) [suppressed 43 similar messages]
I20260709 13:09:18.815662 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:18.816865 30440 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:18.811069 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:18.817835 30471 raft_consensus.cc:2393] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 5: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:18.819010 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:18.819558 30620 raft_consensus.cc:2368] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 7. Current term is 8.
I20260709 13:09:18.819785 31151 raft_consensus.cc:2368] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 7. Current term is 8.
I20260709 13:09:18.822511 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:18.801030   974 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:18.832115 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:18.836381 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:18.837066 30622 raft_consensus.cc:2468] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
I20260709 13:09:18.837811 30617 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 8.
I20260709 13:09:18.824059 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:18.825613 31150 raft_consensus.cc:2468] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7.
I20260709 13:09:18.826006 30440 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:18.823093 31146 raft_consensus.cc:2468] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
I20260709 13:09:18.826805 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:18.812027  1062 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.851435 30621 raft_consensus.cc:2468] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 8.
I20260709 13:09:18.856035 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:18.826115   937 raft_consensus.cc:2804] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:09:18.870136 30516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.871299 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:18.821700  1103 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.874090 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:18.875445 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:18.821610   870 consensus_queue.cc:1059] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:09:18.877868  1062 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:18.880043 30471 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
I20260709 13:09:18.881361  1146 consensus_queue.cc:1048] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:09:18.882812  1146 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.814623   903 consensus_queue.cc:1048] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:09:18.882846 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:18.885263 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:18.898355   870 raft_consensus.cc:3055] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:18.913542   870 raft_consensus.cc:740] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:18.914580   870 consensus_queue.cc:260] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:18.915282 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:18.900532  1062 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:18.916441 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:18.917069 30550 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:18.917971  1050 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:18.900874 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:18.857806  1141 raft_consensus.cc:697] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 10 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:18.920193 30545 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:18.921128  1141 consensus_queue.cc:237] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:18.909660 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:18.922371 30469 raft_consensus.cc:2468] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:09:18.884649 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:18.924738   870 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:18.911612   911 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:18.939540 30467 raft_consensus.cc:2468] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
I20260709 13:09:18.852576  1092 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.912955 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:18.921622 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:18.910832   974 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:18.924474 30547 raft_consensus.cc:2393] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 7: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:18.924157 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:18.924753 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:18.928861 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:18.966084 30471 raft_consensus.cc:2393] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 6: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:18.910307 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:09:18.949647 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.963621 30476 raft_consensus.cc:1275] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:09:18.964430 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.965931 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:18.966301 30472 raft_consensus.cc:2393] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 5: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:18.885377 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:18.969180 30473 raft_consensus.cc:2376] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9. Re-sending same reply.
I20260709 13:09:18.883391  1146 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:18.873495   937 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.904508  1156 raft_consensus.cc:2804] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:18.922014  1103 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:18.976327 30590 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
W20260709 13:09:18.979233 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.984071 30549 raft_consensus.cc:2393] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 8: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:18.984719 30548 raft_consensus.cc:3060] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:18.985903 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 172442us
I20260709 13:09:18.986074  1103 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:18.963630  1147 raft_consensus.cc:697] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 7 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:19.007297 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:19.016068 30550 raft_consensus.cc:2468] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 8.
I20260709 13:09:19.047742 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:18.977828   937 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:19.048899 31114 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:19.061525 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:19.063206 30550 raft_consensus.cc:2468] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 5.
I20260709 13:09:19.063692 30545 raft_consensus.cc:2410] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 8 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:09:19.064365  1161 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:19.067397   961 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:19.050657  1103 consensus_queue.cc:1048] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:09:19.064370   967 raft_consensus.cc:2749] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:19.068342  1147 consensus_queue.cc:237] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:19.069707 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:19.070472 30473 raft_consensus.cc:2410] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:09:19.071192 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:19.067022  1161 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:18.990695  1156 raft_consensus.cc:697] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 7 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
W20260709 13:09:19.074764 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 203901us
I20260709 13:09:18.975574  1092 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:19.084275 30545 raft_consensus.cc:1275] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:09:19.087199 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:19.097142 30550 raft_consensus.cc:1275] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:19.101418 30516 leader_election.cc:400] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 election: Vote denied by peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) with higher term. Message: Invalid argument: T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 7. Current term is 8.
I20260709 13:09:19.101871 30516 leader_election.cc:403] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:09:19.103276 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:09:19.111315  1150 log.cc:927] Time spent T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:09:19.085108   967 consensus_queue.cc:1048] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:09:19.089309  1031 consensus_queue.cc:1048] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:09:19.084803   961 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:19.140892  1051 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:19.141685  1051 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:19.142426  1070 raft_consensus.cc:2749] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) with higher term. Message: Invalid argument: T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 7. Current term is 8.
W20260709 13:09:19.129176 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:19.127904 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 124598us
I20260709 13:09:19.140628   974 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:19.140333  1170 raft_consensus.cc:493] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.155949 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:19.157044 30473 raft_consensus.cc:2368] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 8. Current term is 9.
I20260709 13:09:19.158139 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:19.125057  1091 raft_consensus.cc:493] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:19.162302 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:19.163101 31146 raft_consensus.cc:2393] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 6: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:19.142696   961 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:19.171880 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 91231.8us
I20260709 13:09:19.172012 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:19.172591 30516 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:19.168430 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:19.146723  1161 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:19.178088 30621 raft_consensus.cc:2468] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 5.
W20260709 13:09:19.177475 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.173848 30516 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:19.181368 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:19.181788 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.196282 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:19.198331 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:19.199152 30547 raft_consensus.cc:1275] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:19.201949  1172 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.172654  1091 raft_consensus.cc:515] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:19.202648  1172 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:18.557132 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:19.207384 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:19.207985 30474 raft_consensus.cc:2468] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
I20260709 13:09:19.208763 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:19.209275 30474 raft_consensus.cc:2468] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 6.
I20260709 13:09:19.210026 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:19.210611 30474 raft_consensus.cc:2368] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 8. Current term is 9.
I20260709 13:09:19.211498 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:19.210507  1172 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:19.184046   911 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:19.232082   911 raft_consensus.cc:2804] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:19.232191 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:19.232666   911 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.233155   911 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:19.233795 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:19.235031 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:19.224854  1146 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:19.177827   974 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:19.160316  1170 raft_consensus.cc:515] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:19.236541   974 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:19.238346  1170 leader_election.cc:290] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:19.230858 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:19.240298 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:19.241580 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:19.242589 30473 raft_consensus.cc:2393] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 8: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:19.243628 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:19.243921 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:19.244756 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:19.171403  1156 consensus_queue.cc:237] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:19.372145 30548 raft_consensus.cc:1275] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:19.245894 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:19.320892 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:19.579231 30545 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:19.249830 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:09:19.588586 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:19.304888 30591 leader_election.cc:336] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.673s (SENT)
I20260709 13:09:19.580135 30474 raft_consensus.cc:2468] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
I20260709 13:09:19.258723 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:19.245515 31115 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:19.610129 30623 raft_consensus.cc:3060] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:19.611559 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:19.611984 30619 raft_consensus.cc:1240] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:19.612259 30625 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:19.611701  1174 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.613147 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:19.612951  1174 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:19.613775 30618 raft_consensus.cc:2468] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 7.
I20260709 13:09:19.614521  1143 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:19.615142  1174 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:19.615094  1143 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:19.616200 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:19.616767 30474 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 8.
I20260709 13:09:19.383876  1181 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:19.617623  1143 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:19.617565 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:19.200500  1161 raft_consensus.cc:2804] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:19.618510 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
W20260709 13:09:19.576970   870 consensus_meta.cc:287] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.565s	user 0.005s	sys 0.005s
W20260709 13:09:19.625293 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 379915us
I20260709 13:09:19.626986 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:19.627609 30551 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7.
I20260709 13:09:19.624679  1161 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.628440  1161 raft_consensus.cc:3060] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:19.628571 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:19.629173 30551 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:09:19.632773 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:09:19.633265   937 consensus_meta.cc:287] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.556s	user 0.010s	sys 0.000s
I20260709 13:09:19.633903   937 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:19.635003 30467 raft_consensus.cc:2368] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 8. Current term is 9.
I20260709 13:09:19.312342  1091 leader_election.cc:290] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:19.383365  1178 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.638657 30625 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 8.
I20260709 13:09:19.638993  1178 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:19.639609 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:19.640559 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:19.641548  1058 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:19.641677 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:19.642095  1058 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:19.642318 30473 raft_consensus.cc:2468] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 6.
I20260709 13:09:19.643323 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:19.644222  1058 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:19.646632   958 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:19.647156   958 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:19.648047 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:19.649191 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:19.649228   958 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:19.649840 30619 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 10.
I20260709 13:09:19.650450 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:19.633315 30618 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:19.650517 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:19.618037  1181 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:19.358642  1166 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.652096 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:19.650992 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:19.644382 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:19.358840  1176 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:19.657441  1166 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:19.655189 31115 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:19.659034 30625 raft_consensus.cc:2393] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 10: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:19.657621  1176 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:19.595955  1185 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:19.661211 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:19.661679 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:19.663136 30474 raft_consensus.cc:2393] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 8: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:19.520442   911 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:19.662689 30551 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 8.
I20260709 13:09:19.624533  1174 raft_consensus.cc:493] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:19.663913   967 raft_consensus.cc:2804] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:19.685423 30441 leader_election.cc:304] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:19.686321 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 385905us
I20260709 13:09:19.687425 30473 raft_consensus.cc:1240] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:09:19.690160 30621 raft_consensus.cc:1275] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:09:19.691252 30545 raft_consensus.cc:2468] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7.
I20260709 13:09:19.666925  1065 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:19.694355 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:19.694787 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.666694   870 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:19.687743   967 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.701323 30473 raft_consensus.cc:1240] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:09:19.702097 30474 raft_consensus.cc:1240] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:19.705300  1179 raft_consensus.cc:2804] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:19.664156  1185 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:19.697688  1143 raft_consensus.cc:2749] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:19.774320 30474 raft_consensus.cc:1240] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 8. Current term is 9. Ops: [6.4-8.5]
W20260709 13:09:19.775496 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 110422us
I20260709 13:09:19.774976 30473 raft_consensus.cc:1240] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 6. Current term is 8. Ops: [6.9-6.9]
I20260709 13:09:19.689543  1174 raft_consensus.cc:515] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:19.706265   967 raft_consensus.cc:3060] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:19.705868  1179 raft_consensus.cc:697] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 8 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
W20260709 13:09:19.789693 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 86251.9us
I20260709 13:09:19.774030   937 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:19.697937  1065 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:19.706207   870 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:19.782917   958 raft_consensus.cc:493] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:09:19.815572 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.780640  1183 consensus_queue.cc:1048] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:09:19.818041 30473 raft_consensus.cc:1275] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:09:19.821151 30441 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:19.818841   958 raft_consensus.cc:515] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:19.822757  1186 log.cc:927] Time spent T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:09:19.824498   958 leader_election.cc:290] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:19.825023 30473 raft_consensus.cc:1275] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:09:19.829587 30474 raft_consensus.cc:1275] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:09:19.831943 30441 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:19.832661 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:19.838660 30618 raft_consensus.cc:2468] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 8.
I20260709 13:09:19.843886  1193 raft_consensus.cc:2749] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:19.844308 30441 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:19.813539  1178 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:19.819867   937 raft_consensus.cc:493] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:19.847147 30441 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:19.850342 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:19.852057   870 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:19.856033  1191 raft_consensus.cc:2749] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:19.856424  1185 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:19.856807  1191 raft_consensus.cc:2804] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:19.857196  1191 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:19.848560   911 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:19.857553  1191 raft_consensus.cc:3060] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:19.861099   836 raft_consensus.cc:2749] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:19.863986  1181 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:19.864854  1176 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:19.866588  1065 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:19.832844  1179 consensus_queue.cc:237] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:19.868050  1175 log.cc:927] Time spent T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.487s	user 0.010s	sys 0.000s
I20260709 13:09:19.844156  1197 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:09:19.878460  1187 log.cc:927] Time spent T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:09:19.878683  1174 leader_election.cc:290] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:19.847496  1166 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:19.880311 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:19.881364 30616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47446 (request call id 2218) took 1068 ms. Trace:
I20260709 13:09:19.884652 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:19.901929 31149 raft_consensus.cc:2393] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 8: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:19.887552 31150 raft_consensus.cc:1275] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:19.890027  1051 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:19.894471 30623 raft_consensus.cc:2468] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 9.
I20260709 13:09:19.894693 30546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43088 (request call id 1860) took 1039 ms. Trace:
I20260709 13:09:19.849233  1058 consensus_queue.cc:1048] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:09:19.901435 30591 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:19.902863 30546 rpcz_store.cc:276] 0709 13:09:18.855478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.857704 (+  2226us) service_pool.cc:224] Handling call
0709 13:09:19.894423 (+1036719us) spinlock_profiling.cc:243] Waited 739 ms on lock 0x7b5400359154. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:19.894585 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1700830464}
I20260709 13:09:19.907052 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:19.907986 30542 raft_consensus.cc:2468] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
I20260709 13:09:19.909695 30467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2140) took 1007 ms. Trace:
I20260709 13:09:19.910238 30467 rpcz_store.cc:276] 0709 13:09:18.902441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.965707 (+ 63266us) service_pool.cc:224] Handling call
0709 13:09:19.909437 (+943730us) spinlock_profiling.cc:243] Waited 667 ms on lock 0x7b540011e254. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:19.909597 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1533589760}
I20260709 13:09:19.900668 30616 rpcz_store.cc:276] 0709 13:09:18.805626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.808032 (+  2406us) service_pool.cc:224] Handling call
0709 13:09:18.808416 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:18.965122 (+156706us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:18.965161 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:18.982959 (+ 17798us) log.cc:844] Serialized 26 byte log entry
0709 13:09:19.136814 (+153855us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:19.136873 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:19.136947 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:19.867323 (+730376us) spinlock_profiling.cc:243] Waited 83 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:09:19.870678 (+  3355us) raft_consensus.cc:1685] finished
0709 13:09:19.870700 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:19.874176 (+  3476us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4392,"raft.queue_time_us":21640,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":7501,"spinlock_wait_cycles":190871936,"thread_start_us":188937,"threads_started":2,"wal-append.queue_time_us":181851}
I20260709 13:09:19.872651   937 raft_consensus.cc:515] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:19.926908 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 79814.6us
I20260709 13:09:19.928419 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:19.930857 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:19.931239  1196 consensus_queue.cc:1059] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:19.933207 30591 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:19.933360 30441 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:19.922187  1051 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.936096 30441 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:19.923195  1065 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:19.924737  1183 raft_consensus.cc:2804] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:19.938305 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:19.928431  1143 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:19.929970  1080 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:19.934049  1196 raft_consensus.cc:3055] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:19.943334 30591 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:19.920992   967 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:19.950480   958 raft_consensus.cc:2749] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:19.950697   937 leader_election.cc:290] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:19.951346   937 raft_consensus.cc:2804] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:19.951711   937 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.952072   937 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:19.954208   967 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:19.940979  1183 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:19.956117  1183 raft_consensus.cc:3060] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:19.956925 30473 raft_consensus.cc:1275] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:19.938995  1051 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:19.960983 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:19.961699  1051 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:19.962522 31150 raft_consensus.cc:1275] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:19.962260  1080 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:19.962378 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:19.963307 30544 raft_consensus.cc:2468] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 8.
I20260709 13:09:19.964421  1164 raft_consensus.cc:2804] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:19.948446  1196 raft_consensus.cc:740] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:19.965677  1196 consensus_queue.cc:260] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:19.966892  1196 raft_consensus.cc:3060] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:19.946537  1176 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:19.968308  1176 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:19.970382  1176 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:19.971376   836 raft_consensus.cc:2749] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:19.972119  1065 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:19.973120  1051 consensus_queue.cc:1048] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:19.973994 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:19.987118 30472 raft_consensus.cc:2468] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 6.
I20260709 13:09:19.987730 30472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2146) took 1017 ms. Trace:
I20260709 13:09:19.974265  1065 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:19.974772  1143 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:19.942946  1185 raft_consensus.cc:2749] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:19.924144  1161 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:19.983963 30591 leader_election.cc:304] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:19.991546 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:19.988132 30472 rpcz_store.cc:276] 0709 13:09:18.970582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:19.973660 (+1003078us) service_pool.cc:224] Handling call
0709 13:09:19.987644 (+ 13984us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:20.021018 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 84959.3us
I20260709 13:09:20.021914 30441 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:20.022346 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 72703.7us
I20260709 13:09:20.023051 30591 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:20.023051 30441 leader_election.cc:304] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:20.012964 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:20.024758 30517 leader_election.cc:336] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.216s (SENT)
I20260709 13:09:19.916884  1197 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:20.026579  1045 raft_consensus.cc:2749] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:20.069072  1197 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:20.069882  1143 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:20.071743  1161 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:20.026692  1065 raft_consensus.cc:2749] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:09:20.073359 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 48628.3us
I20260709 13:09:20.075738 30591 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
W20260709 13:09:20.079651 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 109692us
I20260709 13:09:20.080856 30624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47446 (request call id 2219) took 1271 ms. Trace:
I20260709 13:09:20.081403 30624 rpcz_store.cc:276] 0709 13:09:18.809331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.813122 (+  3791us) service_pool.cc:224] Handling call
0709 13:09:18.825166 (+ 12044us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:18.850800 (+ 25634us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:18.850843 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:18.860878 (+ 10035us) log.cc:844] Serialized 26 byte log entry
0709 13:09:19.911016 (+1050138us) spinlock_profiling.cc:243] Waited 8.56 ms on lock 0x7b18001ebec0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e5de07 00007fc789cb8ab9 00007fc780e7a69b 00007fc780e7893f 00007fc780e7ac02 00007fc783b0220b 00007fc783b07d23 00007fc783b080d1 00007fc783f23a0f
0709 13:09:19.936982 (+ 25966us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:19.937036 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:19.937116 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:20.075885 (+138769us) raft_consensus.cc:1685] finished
0709 13:09:20.075910 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:20.080794 (+  4884us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22943,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":38985,"spinlock_wait_cycles":19695872,"thread_start_us":25765,"threads_started":1,"wal-append.queue_time_us":1195448}
I20260709 13:09:20.083411  1051 raft_consensus.cc:2749] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:20.025499  1193 raft_consensus.cc:2749] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:20.080801  1185 raft_consensus.cc:2804] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:09:20.086556 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 60625us
I20260709 13:09:20.090237 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:20.088940 30441 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:20.094703 30440 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:20.091207  1197 consensus_queue.cc:1048] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:09:20.088356  1185 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.100872  1185 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:20.101136  1162 consensus_queue.cc:1048] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:09:20.093257  1045 consensus_queue.cc:1048] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
W20260709 13:09:20.107990 30475 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2134) took 1207 ms (client timeout 1571 ms). Trace:
I20260709 13:09:20.108359  1191 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:20.109928 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:20.110489 30469 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:20.110587  1191 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:20.115269  1092 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:20.117671 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:20.118194 30471 raft_consensus.cc:2376] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 8. Re-sending same reply.
I20260709 13:09:20.118634 30471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50446 (request call id 1653) took 1237 ms. Trace:
I20260709 13:09:20.118935 30471 rpcz_store.cc:276] 0709 13:09:18.881671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.117452 (+1235781us) service_pool.cc:224] Handling call
0709 13:09:20.118578 (+  1126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:20.120333   974 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:20.121163   937 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:20.123322   937 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:20.130170 30517 leader_election.cc:336] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.861s (SENT)
I20260709 13:09:20.130633 30517 leader_election.cc:304] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:20.108438 30475 rpcz_store.cc:269] 0709 13:09:18.901029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.921375 (+ 20346us) service_pool.cc:224] Handling call
0709 13:09:20.107764 (+1186389us) spinlock_profiling.cc:243] Waited 959 ms on lock 0x7b54000285d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:20.107914 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2205193600}
I20260709 13:09:20.131412  1172 raft_consensus.cc:2749] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:20.131597  1198 raft_consensus.cc:2804] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:20.132233  1198 raft_consensus.cc:697] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 8 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:20.133363  1172 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:20.133106  1198 consensus_queue.cc:237] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:20.133867  1172 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:20.131417  1183 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:20.135959  1172 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:20.136969  1183 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:20.138058 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
W20260709 13:09:20.140067 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 44612.4us
I20260709 13:09:20.140911 30591 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
W20260709 13:09:20.144011 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 45496us
I20260709 13:09:20.144647 30441 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
W20260709 13:09:20.148140 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 53530us
I20260709 13:09:20.150920 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:20.165547 30469 raft_consensus.cc:2468] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 10.
I20260709 13:09:20.167557 30469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2144) took 1264 ms. Trace:
I20260709 13:09:20.162045 30543 raft_consensus.cc:1275] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:20.167932 30469 rpcz_store.cc:276] 0709 13:09:18.930032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.109650 (+1179618us) service_pool.cc:224] Handling call
0709 13:09:20.167286 (+ 57636us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:20.173354 30441 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:20.150755  1197 raft_consensus.cc:2749] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:20.150120  1183 raft_consensus.cc:2749] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:20.183794 30441 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:20.185036  1193 raft_consensus.cc:2804] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:20.185636  1193 raft_consensus.cc:697] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 6 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:20.151096  1172 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.188643 30441 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:20.191102 30543 raft_consensus.cc:1275] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:09:20.191713 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 45873.6us
I20260709 13:09:20.192211 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:20.195060 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:20.150249  1185 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:20.195593 30473 raft_consensus.cc:2376] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9. Re-sending same reply.
I20260709 13:09:20.200181 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:20.200768 30467 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:20.202780 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:20.151634  1191 consensus_queue.cc:1059] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:09:20.204823 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:20.190364  1196 raft_consensus.cc:2804] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:20.163085   937 consensus_queue.cc:1048] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:09:20.203302 30473 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7.
I20260709 13:09:20.208628 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:20.196231  1065 raft_consensus.cc:2804] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:20.213999 30475 raft_consensus.cc:2393] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 7: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:20.215427 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:20.217815 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:20.219002 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:20.219544 31149 raft_consensus.cc:3060] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:20.196056  1201 raft_consensus.cc:2749] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:20.214563  1045 consensus_queue.cc:1048] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:09:20.221436 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:20.223330 30475 raft_consensus.cc:3060] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:20.186775  1193 consensus_queue.cc:237] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:20.233402 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:20.234233 30471 raft_consensus.cc:2468] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
I20260709 13:09:20.231602 30589 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:20.235333 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:20.237239 30471 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:09:20.237452 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:20.238085 31145 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 8.
I20260709 13:09:20.238444 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:20.236445 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:20.240692 30589 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:20.242125  1045 raft_consensus.cc:2804] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:20.242614  1045 raft_consensus.cc:697] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:20.244400  1080 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:20.245249 30549 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43088 (request call id 1858) took 1738 ms (client timeout 1535 ms). Trace:
W20260709 13:09:20.245633 30549 rpcz_store.cc:269] 0709 13:09:18.507026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.516299 (+  9273us) service_pool.cc:224] Handling call
0709 13:09:20.245023 (+1728724us) spinlock_profiling.cc:243] Waited 467 ms on lock 0x7b540038ca54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:20.245137 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1073232128}
I20260709 13:09:20.197547  1172 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:20.249539  1172 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:20.236459 31144 raft_consensus.cc:1275] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:20.252229 30475 raft_consensus.cc:2468] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7.
I20260709 13:09:20.253774 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:20.255646 31149 raft_consensus.cc:2468] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 7.
I20260709 13:09:20.255646 30469 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 8.
I20260709 13:09:20.257905 30474 raft_consensus.cc:1275] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:20.263998 30471 raft_consensus.cc:1275] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:20.264962 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:20.265815 30549 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:20.271407 30467 raft_consensus.cc:2468] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7.
I20260709 13:09:20.272976 30475 raft_consensus.cc:2468] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:09:20.272698  1172 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:20.272949  1196 raft_consensus.cc:697] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 8 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:20.282117  1196 consensus_queue.cc:237] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:20.259637  1065 raft_consensus.cc:697] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 5 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:20.292063 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:09:20.294149   975 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.540s	user 0.043s	sys 0.060s
W20260709 13:09:20.294588   975 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.541s	user 0.043s	sys 0.060s
I20260709 13:09:20.296087 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:20.296679 31144 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:20.299355 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:20.299949 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:20.276624  1045 consensus_queue.cc:237] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:20.300740 31151 raft_consensus.cc:2410] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:09:20.300695 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:20.301429 30625 raft_consensus.cc:2468] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 8.
I20260709 13:09:20.301533 30591 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:20.316156 31147 raft_consensus.cc:1240] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 7. Current term is 8. Ops: []
W20260709 13:09:20.308531 30441 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.310703 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:20.310809 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:20.277243  1172 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:20.311975 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:20.324586 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:20.325094 30469 raft_consensus.cc:3060] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:20.325489 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:20.325868 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:20.326762 30545 raft_consensus.cc:2393] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 5: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
W20260709 13:09:20.328837 30517 leader_election.cc:336] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.571s (SENT)
I20260709 13:09:20.319690 30617 raft_consensus.cc:2468] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 2.
I20260709 13:09:20.319715 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:20.323573 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:20.324412 30624 raft_consensus.cc:1275] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:09:20.313247 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:20.318704 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:20.334697 30551 raft_consensus.cc:2393] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 8: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:20.339166 30517 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:20.340878 30469 raft_consensus.cc:2468] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7.
I20260709 13:09:20.343230 30591 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:20.346632 30549 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9.
I20260709 13:09:20.347764 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:20.348186 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 105549us
I20260709 13:09:20.348361 30550 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 6.
I20260709 13:09:20.350327 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:20.350831 30542 raft_consensus.cc:2468] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 5.
I20260709 13:09:20.351547 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:20.352911 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:20.353370 30469 raft_consensus.cc:2468] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 7.
I20260709 13:09:20.353960 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:20.354692 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:20.355070 30469 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:20.355999 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:20.356709 30625 raft_consensus.cc:2393] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 7: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:20.357275 30616 raft_consensus.cc:2393] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 11: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:20.361089 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:20.362660 30589 leader_election.cc:304] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:20.363606 30441 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:20.366087 31144 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9.
W20260709 13:09:20.366947 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.334771  1050 raft_consensus.cc:2804] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:20.369098 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:20.370579 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:20.374043 30441 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:20.379864 30591 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:20.370901 30589 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:20.381155  1180 raft_consensus.cc:2804] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:20.381680   961 raft_consensus.cc:2804] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:20.389336 30476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 1645) took 1537 ms. Trace:
I20260709 13:09:20.390174 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:20.347450   975 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:20.391769 30591 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:20.386512 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:20.388103 30469 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 9.
I20260709 13:09:20.383196 30441 leader_election.cc:304] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:20.382632   870 raft_consensus.cc:2804] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:20.389721 30476 rpcz_store.cc:276] 0709 13:09:18.852050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.852714 (+   664us) service_pool.cc:224] Handling call
0709 13:09:18.940216 (+ 87502us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:18.966769 (+ 26553us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:20.389171 (+1422402us) spinlock_profiling.cc:243] Waited 70.5 ms on lock 0x7b54003d2f50. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f678ad 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:20.389286 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":162186496}
I20260709 13:09:20.393849 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:20.395068 30469 raft_consensus.cc:2393] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 5: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
W20260709 13:09:20.394865 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 66067.3us
W20260709 13:09:20.395866 30517 leader_election.cc:336] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.739s (SENT)
I20260709 13:09:20.396785 30591 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:20.396550 30517 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:20.372632   911 raft_consensus.cc:2749] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:20.403631 30623 raft_consensus.cc:2468] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 5.
I20260709 13:09:20.368532  1156 raft_consensus.cc:2749] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:20.405192 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:20.406553 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:20.361248  1143 consensus_queue.cc:1048] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:09:20.392122  1173 raft_consensus.cc:2804] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:20.386494  1180 raft_consensus.cc:493] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:20.409224 30469 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 9.
I20260709 13:09:20.388906   961 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:20.414059 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:20.419283 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:20.366057  1197 consensus_queue.cc:1048] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:09:20.408030 30476 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 8.
I20260709 13:09:20.420717 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:20.414737 30441 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:20.397322   870 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:20.404323  1045 raft_consensus.cc:2804] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:20.398747  1050 raft_consensus.cc:697] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:20.404703  1191 raft_consensus.cc:2804] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:20.424011  1197 consensus_queue.cc:1243] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer 092f6eb694fc4bbeab49677cccd880fd log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:09:20.424131 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:20.425278 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:20.425994 30467 raft_consensus.cc:2368] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 8. Current term is 9.
I20260709 13:09:20.426709 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:20.427269 30620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47446 (request call id 2221) took 1567 ms. Trace:
I20260709 13:09:20.428030 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:20.425341  1197 raft_consensus.cc:2749] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:20.428952 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.430342 30469 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:20.440964 30467 raft_consensus.cc:1275] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:09:20.416059  1161 raft_consensus.cc:2749] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:20.423944 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:20.419024  1173 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.428920  1191 raft_consensus.cc:493] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:20.420941  1180 raft_consensus.cc:3060] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:20.427632 30620 rpcz_store.cc:276] 0709 13:09:18.860240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.860411 (+   171us) service_pool.cc:224] Handling call
0709 13:09:18.884340 (+ 23929us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:18.905714 (+ 21374us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:19.093449 (+187735us) log.cc:844] Serialized 14 byte log entry
0709 13:09:20.104133 (+1010684us) spinlock_profiling.cc:243] Waited 35.1 ms on lock 0x7b180026b960. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e7b3f3 00007fc780e7d7c1 00007fc780e7d779 00007fc780e7d709 00007fc780e7d6d1 00007fc780e7c9cd 000000000038f354 000000000038f199 00007fc780e5e83a
0709 13:09:20.424528 (+320395us) spinlock_profiling.cc:243] Waited 35.4 ms on lock 0x7b180026b960. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780df5c0a 00007fc78a535219 00007fc787e3c58f 00007fc780e7b571 00007fc780e7d7c1 00007fc780e7d779 00007fc780e7d709 00007fc780e7d6d1 00007fc780e7c9cd
0709 13:09:20.426778 (+  2250us) log.cc:844] Serialized 14 byte log entry
0709 13:09:20.426955 (+   177us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:20.427002 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:20.427044 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:20.427106 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:20.427215 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":876114,"prepare.queue_time_us":232455,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":31,"raft.queue_time_us":38428,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":69976,"spinlock_wait_cycles":162187392,"thread_start_us":645157,"threads_started":3,"wal-append.queue_time_us":118523}
I20260709 13:09:20.408511   975 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:20.422055   961 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:20.422412   870 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:20.396353  1065 consensus_queue.cc:237] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:20.471581  1191 raft_consensus.cc:3060] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:20.487646 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 90919.6us
I20260709 13:09:20.488726 30591 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:20.476246  1173 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:20.431443  1166 raft_consensus.cc:3060] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:20.476543  1185 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:20.470415  1045 raft_consensus.cc:697] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:20.431023   836 consensus_queue.cc:1048] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:09:20.419186  1196 consensus_queue.cc:1048] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.070s
W20260709 13:09:20.496330 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 85974.6us
I20260709 13:09:20.494108 30591 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:20.504217  1050 consensus_queue.cc:237] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:20.507895  1215 raft_consensus.cc:2804] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:20.507411 30591 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:20.494374  1222 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:20.509490  1172 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:20.516952   975 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:20.520546 30591 leader_election.cc:304] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:20.521354  1051 raft_consensus.cc:2804] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:20.518232  1045 consensus_queue.cc:237] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:20.521770  1051 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.522149  1051 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:20.508361  1215 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.526084 30591 leader_election.cc:304] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:20.542446   961 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:20.543777  1166 raft_consensus.cc:2749] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:20.532553  1215 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:20.532835  1185 raft_consensus.cc:2749] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:20.566246 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 151553us
I20260709 13:09:20.568316 30441 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:20.570641 30441 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:20.571548 30441 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:20.578526  1080 raft_consensus.cc:2749] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:20.575042   704 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:20.579607   704 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:20.582049   704 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:20.577648   975 raft_consensus.cc:2804] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:20.596508   975 raft_consensus.cc:697] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 9 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:20.597401   975 consensus_queue.cc:237] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:20.594130  1185 raft_consensus.cc:2749] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:20.615620   961 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:20.621353  1051 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:20.623428  1051 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:20.625772  1180 raft_consensus.cc:515] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:20.628610  1180 leader_election.cc:290] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:20.619688   870 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:20.572187  1228 raft_consensus.cc:2749] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:20.632622  1164 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
W20260709 13:09:20.645588 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 249757us
I20260709 13:09:20.646149 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:09:20.646417 30517 leader_election.cc:336] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.810s (SENT)
I20260709 13:09:20.646952 30517 leader_election.cc:304] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:20.648579 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 122598us
I20260709 13:09:20.656239 30624 raft_consensus.cc:1275] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:09:20.656553 30591 leader_election.cc:304] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
W20260709 13:09:20.658027 30517 leader_election.cc:336] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.849s (SENT)
I20260709 13:09:20.660931 30517 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:20.662029  1103 raft_consensus.cc:2749] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:20.643769  1164 raft_consensus.cc:3060] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:20.671528 30591 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:20.672575  1051 raft_consensus.cc:2804] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:20.672979   870 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:20.672999  1051 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:20.673677  1051 raft_consensus.cc:3060] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:20.674515 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:20.675786 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:20.676406 30624 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:20.666764  1169 raft_consensus.cc:2749] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:20.704217 30624 raft_consensus.cc:2468] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9.
I20260709 13:09:20.704950 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:20.707249 30472 raft_consensus.cc:2393] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 11: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:20.708741 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:20.700021  1045 raft_consensus.cc:2804] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:20.718024 31149 raft_consensus.cc:1275] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:20.718173 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:20.705793  1180 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:09:20.733932 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 70484.8us
W20260709 13:09:20.737707 30517 leader_election.cc:336] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.941s (SENT)
I20260709 13:09:20.719890   958 raft_consensus.cc:2804] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:20.740571   974 raft_consensus.cc:2749] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:20.712703  1231 consensus_queue.cc:1048] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:09:20.739403  1180 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:20.720890  1228 consensus_queue.cc:1048] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:09:20.772959 30591 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:20.780447  1191 raft_consensus.cc:515] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:20.781405  1180 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:20.782720  1191 leader_election.cc:290] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:20.786520  1230 log.cc:927] Time spent T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:09:20.746471  1185 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:20.788630  1185 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:20.790820  1185 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:20.791772  1173 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:20.793917 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:20.742740  1051 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:20.795902 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:20.792309  1233 log.cc:927] Time spent T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:09:20.798240 31114 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:20.799396 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:20.814046 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:20.815070 31114 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:20.815762 30622 raft_consensus.cc:3060] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:20.814378 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:20.814600 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:09:20.817225 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 79526.7us
W20260709 13:09:20.811146 30516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:20.819981 30517 leader_election.cc:336] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.990s (SENT)
I20260709 13:09:20.820389 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:20.820574 30517 leader_election.cc:304] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:20.822110 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:20.825153 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:20.825222   902 raft_consensus.cc:2749] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:20.772351  1045 raft_consensus.cc:697] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
W20260709 13:09:20.833767 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.804560  1051 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:20.806355  1222 raft_consensus.cc:2749] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:20.851649 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:20.876969 30470 raft_consensus.cc:2468] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 6.
W20260709 13:09:20.878114 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 105207us
I20260709 13:09:20.856178 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:20.879516 30547 raft_consensus.cc:3060] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:20.857012 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:20.880411 30551 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:20.859032 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:20.881394 30543 raft_consensus.cc:2468] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
I20260709 13:09:20.882534 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:20.883203 30543 raft_consensus.cc:2468] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 4.
W20260709 13:09:20.864430  1223 log.cc:927] Time spent T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.360s	user 0.000s	sys 0.004s
I20260709 13:09:20.864245 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:20.836330 30548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 605) took 1967 ms. Trace:
I20260709 13:09:20.819216  1162 raft_consensus.cc:2749] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:20.873121 30545 raft_consensus.cc:1275] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 13:09:20.876214 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:20.887549 31151 raft_consensus.cc:2393] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 6: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:20.884997 30548 rpcz_store.cc:276] 0709 13:09:18.857437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.865590 (+  8153us) service_pool.cc:224] Handling call
0709 13:09:18.900171 (+ 34581us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:19.575975 (+675804us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:20.749129 (+1173154us) spinlock_profiling.cc:243] Waited 84.4 ms on lock 0x7b540002e4d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:20.824406 (+ 75277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":194065280}
W20260709 13:09:20.889925 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 71833.2us
W20260709 13:09:20.890758 30517 leader_election.cc:336] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.012s (SENT)
I20260709 13:09:20.891204 30517 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:20.893671 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:20.886965 30545 pending_rounds.cc:85] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd: Aborting all ops after (but not including) 8
I20260709 13:09:20.898464 30545 pending_rounds.cc:107] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd: Aborting uncommitted NO_OP operation due to leader change: 6.9
I20260709 13:09:20.898797 30545 raft_consensus.cc:2889] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:20.835508   946 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.900568 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:20.901849 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:20.902658 31142 raft_consensus.cc:1240] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 9. Current term is 10. Ops: []
W20260709 13:09:20.903158 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 97510.2us
I20260709 13:09:20.910282  1164 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:20.912323  1164 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:20.916988  1180 consensus_queue.cc:1048] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:20.918419  1180 consensus_queue.cc:1048] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:20.919945 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:20.922065   946 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:20.923281 30372 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57546 (request call id 305) took 16161 ms (client timeout 15000 ms). Trace:
I20260709 13:09:20.924175   946 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:20.925287   937 raft_consensus.cc:3055] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:20.925666   937 raft_consensus.cc:740] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:20.926461   937 consensus_queue.cc:260] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:20.927493   937 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:20.889322  1176 raft_consensus.cc:2749] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:20.819092  1108 consensus_queue.cc:1048] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:09:20.931828 30441 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:20.915509 30622 raft_consensus.cc:2468] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
I20260709 13:09:20.937449 30441 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:20.941393 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:20.941677 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:20.942381 30616 raft_consensus.cc:2393] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 8: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:20.943449 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:20.946429 30551 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 8.
I20260709 13:09:20.944473 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:20.952822 30441 leader_election.cc:304] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:20.891916  1231 raft_consensus.cc:3060] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:20.959404 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:20.919548  1242 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:20.967325 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:20.968104 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:20.971871 31115 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:20.976691 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:20.951627  1143 raft_consensus.cc:2804] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:20.947428  1176 raft_consensus.cc:2749] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:20.994207 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:20.979174 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 88468.4us
I20260709 13:09:20.990832  1091 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.963963   836 raft_consensus.cc:2804] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:20.980296   975 raft_consensus.cc:2804] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:21.011432 30517 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:21.001992 30622 raft_consensus.cc:1240] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:21.013082 30619 raft_consensus.cc:1240] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:21.013172 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:20.978494  1162 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.018579 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:21.045063 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
W20260709 13:09:21.035310 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 82551.6us
I20260709 13:09:21.054162 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:21.067859 30542 raft_consensus.cc:2393] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 6: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
W20260709 13:09:21.072906 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 61566.4us
I20260709 13:09:21.073215 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:21.073493 30624 raft_consensus.cc:1240] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:21.073657 30517 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:20.964773  1065 consensus_queue.cc:1048] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:09:20.983428  1108 raft_consensus.cc:2804] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:21.048882 30621 raft_consensus.cc:2468] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:09:21.075160 30622 raft_consensus.cc:1240] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:09:20.975950  1242 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:21.152034 30620 raft_consensus.cc:1240] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:21.153056 30619 raft_consensus.cc:2393] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 8: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:21.019445  1143 raft_consensus.cc:697] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 5 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:21.064450  1169 raft_consensus.cc:2749] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:21.157982  1229 raft_consensus.cc:2804] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:21.158941 30589 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:21.196259 30589 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
W20260709 13:09:21.091205  1215 consensus_meta.cc:287] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.521s	user 0.011s	sys 0.000s
I20260709 13:09:21.159966 30624 raft_consensus.cc:1240] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:21.070813  1173 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:21.150197 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:21.065418  1162 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:21.159236   958 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:20.993705  1045 consensus_queue.cc:237] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:21.015533  1091 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:21.180814 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 107229us
W20260709 13:09:20.923626 30372 rpcz_store.cc:269] 0709 13:09:04.761826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.762175 (+   349us) service_pool.cc:224] Handling call
0709 13:09:20.923083 (+16160908us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:17.242659 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:17.246951 (+  4292us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:17.246974 (+    23us) write_op.cc:435] Acquired schema lock
0709 13:09:17.246984 (+    10us) tablet.cc:662] Decoding operations
0709 13:09:17.247582 (+   598us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:17.247620 (+    38us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:17.247637 (+    17us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:09:17.344352 (+ 96715us) tablet.cc:701] Row locks acquired
0709 13:09:17.344427 (+    75us) write_op.cc:260] PREPARE: finished
0709 13:09:17.344714 (+   287us) write_op.cc:270] Start()
0709 13:09:17.344910 (+   196us) write_op.cc:276] Timestamp: P: 1783602557344631 usec, L: 0
0709 13:09:17.344949 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 13:09:17.346330 (+  1381us) log.cc:844] Serialized 3614 byte log entry
0709 13:09:17.681623 (+335293us) op_driver.cc:464] REPLICATION: finished
0709 13:09:17.807357 (+125734us) write_op.cc:301] APPLY: starting
0709 13:09:17.807486 (+   129us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:17.874827 (+ 67341us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:17.875014 (+   187us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:17.979538 (+104524us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:18.068600 (+ 89062us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:09:18.072471 (+  3871us) write_op.cc:312] APPLY: finished
0709 13:09:18.086503 (+ 14032us) log.cc:844] Serialized 71 byte log entry
0709 13:09:18.086724 (+   221us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:18.086877 (+   153us) write_op.cc:454] Released schema lock
0709 13:09:18.086944 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:18.087440 (+   496us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:18.087473 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1271946,"reported_tablets":35,"child_traces":[["op",{"apply.queue_time_us":118984,"apply.run_cpu_time_us":8843,"apply.run_wall_time_us":280056,"num_ops":9,"prepare.queue_time_us":248686,"prepare.run_cpu_time_us":7489,"prepare.run_wall_time_us":157844,"raft.queue_time_us":114090,"raft.run_cpu_time_us":49516,"raft.run_wall_time_us":125725,"replication_time_us":336503,"thread_start_us":452231,"threads_started":4,"wal-append.queue_time_us":130149,"wal-append.run_cpu_time_us":14720,"wal-append.run_wall_time_us":1604208}]]}
I20260709 13:09:21.185431 30617 raft_consensus.cc:1240] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:21.201045 30589 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:21.187572  1176 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:21.219717 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:21.221055 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:21.358867 30546 raft_consensus.cc:1275] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:09:21.273789 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.219328  1241 raft_consensus.cc:2749] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:09:21.552524 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 351541us
W20260709 13:09:21.531890 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 238192us
I20260709 13:09:21.555426 30589 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:21.215896  1166 raft_consensus.cc:2804] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:21.556231   836 raft_consensus.cc:697] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 9 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:21.556510  1166 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:21.556898  1051 raft_consensus.cc:2749] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:21.556974  1166 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:21.557281   836 consensus_queue.cc:237] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:21.559067 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:21.559444 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:21.239665 30547 raft_consensus.cc:2468] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
I20260709 13:09:21.560096 30546 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:21.481621 30544 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.005s	sys 0.005s
W20260709 13:09:21.590194 30544 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.010s	sys 0.009s
W20260709 13:09:21.562120 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:21.249531 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:21.273042 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.593961 30517 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:21.593961 30551 raft_consensus.cc:1240] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:09:21.250845 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
W20260709 13:09:21.588686   937 consensus_meta.cc:287] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.641s	user 0.010s	sys 0.000s
W20260709 13:09:21.600172 30360 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 5610a33c644c4e539ad503631763aa40 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica fe2b7d73f8c743c1ba570cfd981c4e79 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
W20260709 13:09:21.601127 30360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 333893us
I20260709 13:09:21.602584 30549 raft_consensus.cc:1275] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:21.603003   944 consensus_queue.cc:1059] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.121s
I20260709 13:09:21.603849   944 raft_consensus.cc:3055] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:21.604166   944 raft_consensus.cc:740] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:21.604925   944 consensus_queue.cc:260] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:21.605993   944 raft_consensus.cc:3060] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:21.606678 30546 raft_consensus.cc:2468] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
W20260709 13:09:21.608433  1254 log.cc:927] Time spent T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.272s	user 0.000s	sys 0.000s
W20260709 13:09:21.609246  1258 log.cc:927] Time spent T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.359s	user 0.001s	sys 0.000s
I20260709 13:09:21.198580   975 raft_consensus.cc:697] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:21.624009 30624 raft_consensus.cc:1240] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:21.617321 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
W20260709 13:09:21.279526  1252 log.cc:927] Time spent T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 13:09:21.280148  1247 log.cc:927] Time spent T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260709 13:09:21.209836  1229 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:21.637080 30616 raft_consensus.cc:3060] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:21.639930 30543 raft_consensus.cc:2368] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 8. Current term is 9.
I20260709 13:09:21.588970  1173 raft_consensus.cc:2804] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:21.653388 30616 raft_consensus.cc:2468] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 6.
I20260709 13:09:21.654248 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:21.592454   958 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:21.630813  1256 raft_consensus.cc:493] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:21.677325 30543 raft_consensus.cc:1240] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:21.677637 30620 raft_consensus.cc:1275] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:21.210253  1108 raft_consensus.cc:697] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 9 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:21.674185 30550 raft_consensus.cc:2468] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 8.
I20260709 13:09:21.668907 30624 raft_consensus.cc:1275] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:21.649240  1169 raft_consensus.cc:2749] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:21.823410  1169 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:21.646878   975 consensus_queue.cc:237] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:21.824075  1169 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:21.690518 30516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:21.826798 30516 connection.cc:256] RPC call timeout handler was delayed by -1.5396563109999306s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1563s for a response
W20260709 13:09:21.827334 30516 connection.cc:256] RPC call timeout handler was delayed by -1.3443563109999559s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17800000000000002s for a response
W20260709 13:09:21.827721 30516 connection.cc:256] RPC call timeout handler was delayed by -1.2768563109999604s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1855s for a response
W20260709 13:09:21.828099 30516 connection.cc:256] RPC call timeout handler was delayed by -1.246256310999911s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1889s for a response
W20260709 13:09:21.828459 30516 connection.cc:256] RPC call timeout handler was delayed by -1.2066563109999606s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19330000000000003s for a response
W20260709 13:09:21.828802 30516 connection.cc:256] RPC call timeout handler was delayed by -1.1567902749999348s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15000000000000002s for a response
W20260709 13:09:21.829146 30516 connection.cc:256] RPC call timeout handler was delayed by -1.1567902749999348s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15000000000000002s for a response
W20260709 13:09:21.829530 30516 connection.cc:256] RPC call timeout handler was delayed by -1.0478902749999861s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16210000000000002s for a response
I20260709 13:09:21.695680  1162 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:21.249965  1143 consensus_queue.cc:237] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:21.482215  1165 consensus_queue.cc:1059] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 2, Time since last communication: 0.200s
I20260709 13:09:21.219827  1215 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:21.629071  1176 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:21.643177  1229 raft_consensus.cc:3060] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:21.657706  1173 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:21.700569  1253 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:09:21.709925 30440 leader_election.cc:336] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Timed out: RequestConsensusVote RPC to 127.28.173.2:34733 timed out after 1.535s (SENT)
I20260709 13:09:21.668223  1251 consensus_queue.cc:1059] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
W20260709 13:09:21.835474 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 125588us
I20260709 13:09:21.747606 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:21.749365 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:21.751855 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:21.695444  1166 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:21.771320 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:21.787683 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:21.774564  1051 raft_consensus.cc:493] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:21.774439  1180 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.809093 30470 raft_consensus.cc:1275] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:09:21.809396 30468 raft_consensus.cc:1240] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:21.809438 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:21.809800 30473 raft_consensus.cc:1275] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:21.810271  1256 raft_consensus.cc:515] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:21.810930  1108 consensus_queue.cc:237] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:21.812040 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:21.602635  1092 consensus_queue.cc:1059] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
W20260709 13:09:21.829893 30516 connection.cc:256] RPC call timeout handler was delayed by -1.0478902749999861s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16210000000000002s for a response
I20260709 13:09:21.831965  1162 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:21.656383  1203 consensus_queue.cc:1059] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:09:21.806833  1196 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:21.832675  1191 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:21.835521  1231 consensus_meta.cc:287] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.870s	user 0.010s	sys 0.002s
I20260709 13:09:21.833680   870 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:21.834671  1165 raft_consensus.cc:3055] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:21.834867  1173 raft_consensus.cc:3060] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:21.871721 30472 raft_consensus.cc:2468] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7.
W20260709 13:09:21.872826 30516 connection.cc:256] RPC call timeout handler was delayed by -1.0064902749999192s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16670000000000001s for a response
I20260709 13:09:21.897791 30516 leader_election.cc:400] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Vote denied by peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453) with higher term. Message: Invalid argument: T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 6. Current term is 7.
I20260709 13:09:21.898226 30516 leader_election.cc:403] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:21.835310  1169 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:21.885257 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
W20260709 13:09:21.873028 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 230055us
I20260709 13:09:21.839234  1198 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:09:21.887270 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 248990us
I20260709 13:09:21.872529  1251 raft_consensus.cc:3055] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:21.912256 30469 raft_consensus.cc:1240] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 9 LEADER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:21.908156 30516 leader_election.cc:400] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 election: Vote denied by peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453) with higher term. Message: Invalid argument: T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 7. Current term is 8.
I20260709 13:09:21.871275  1266 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:21.911463 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:21.900128 30589 leader_election.cc:304] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:21.840374  1253 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:21.929133 31148 raft_consensus.cc:2468] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7.
I20260709 13:09:21.915336  1198 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:21.869597  1051 raft_consensus.cc:515] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:21.937093 30589 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:21.931977 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:21.956458 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:21.895473   836 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:09:21.957414 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.871398  1180 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:21.871224  1260 consensus_queue.cc:1048] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:09:21.888346  1162 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:21.893862  1196 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:21.907574  1165 raft_consensus.cc:740] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:21.922185   974 raft_consensus.cc:2804] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:21.923641  1176 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:21.930195  1256 leader_election.cc:290] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:21.932626  1241 consensus_queue.cc:1048] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:09:21.896554  1191 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:21.912514  1251 raft_consensus.cc:740] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:21.900398  1231 raft_consensus.cc:2749] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:22.161888 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 247449us
W20260709 13:09:21.988369 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:22.087476 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 493964us
W20260709 13:09:22.017654 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 57854.9us
W20260709 13:09:21.991703 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.925256  1091 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:21.920267  1092 raft_consensus.cc:3055] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:21.910849   870 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:22.206125 30621 raft_consensus.cc:2468] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 8.
I20260709 13:09:21.924625  1271 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:21.962579  1058 raft_consensus.cc:2804] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:22.086980  1253 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:22.085884  1166 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:21.962364  1051 leader_election.cc:290] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133)
I20260709 13:09:22.165082  1176 raft_consensus.cc:493] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:21.953226  1266 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:22.198167  1092 raft_consensus.cc:740] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:22.206032   974 raft_consensus.cc:697] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:22.182935  1169 raft_consensus.cc:2749] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453) with higher term. Message: Invalid argument: T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 6. Current term is 7.
I20260709 13:09:22.054558   836 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:22.249846  1176 raft_consensus.cc:515] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:22.222424  1269 raft_consensus.cc:493] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:22.240332  1260 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.253101  1058 raft_consensus.cc:697] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
W20260709 13:09:22.286695 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 399506us
I20260709 13:09:22.290916 30469 raft_consensus.cc:1240] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 2. Current term is 3. Ops: []
W20260709 13:09:22.307603 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 408032us
I20260709 13:09:22.275309  1215 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:22.310118 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:22.313735 30620 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 6.
I20260709 13:09:22.222285  1271 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:22.310932 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:22.312026 30619 raft_consensus.cc:1240] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:22.262813  1274 consensus_queue.cc:1059] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:09:22.264889  1251 consensus_queue.cc:260] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:22.320251  1270 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.260527  1165 consensus_queue.cc:260] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:22.333298  1165 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:22.281499  1260 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:22.320905  1281 consensus_queue.cc:1059] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:09:22.346349  1198 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:22.328133   974 consensus_queue.cc:237] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:22.348112  1271 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:22.349279  1162 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:22.275889  1269 raft_consensus.cc:515] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:22.362618 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 444823us
W20260709 13:09:22.395303 31149 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.007s	sys 0.006s
W20260709 13:09:22.395747 31149 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.007s	sys 0.006s
W20260709 13:09:22.396289 30617 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.004s	sys 0.041s
W20260709 13:09:22.396703 30617 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.004s	sys 0.041s
W20260709 13:09:22.398774 30471 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.001s	sys 0.014s
I20260709 13:09:22.325253  1229 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:22.399154 30542 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.016s	sys 0.011s
W20260709 13:09:22.402814 30542 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.016s	sys 0.011s
W20260709 13:09:22.402844 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 62168.4us
W20260709 13:09:22.399114 30471 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.002s	sys 0.014s
W20260709 13:09:22.421295  1286 log.cc:927] Time spent T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:09:22.394938  1080 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.011s	sys 0.005s
I20260709 13:09:22.304580  1092 consensus_queue.cc:260] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:22.353940  1251 raft_consensus.cc:3060] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:22.397769  1255 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.004s	sys 0.005s
I20260709 13:09:22.402472  1274 raft_consensus.cc:3055] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:09:22.433917 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 260550us
W20260709 13:09:22.427255  1080 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.012s	sys 0.006s
W20260709 13:09:22.430610 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 141611us
I20260709 13:09:22.458627  1051 consensus_queue.cc:1048] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:22.458914  1166 consensus_queue.cc:1059] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:22.459507  1051 consensus_queue.cc:1243] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer f639301059e24dc5b0d88a46dc683326 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:09:22.462091  1166 raft_consensus.cc:3055] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:22.462473  1166 raft_consensus.cc:740] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:22.462809 30591 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:22.463105 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:22.463661 30543 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:22.461912  1091 consensus_queue.cc:1048] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:22.464023 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:22.464713 30544 raft_consensus.cc:2393] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 6: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:22.464901  1091 raft_consensus.cc:2804] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:22.465287  1091 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:22.465643  1091 raft_consensus.cc:3060] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:22.466215 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.426383  1176 leader_election.cc:290] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:22.432641  1255 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.004s	sys 0.005s
I20260709 13:09:22.425145  1198 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.422050  1271 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:22.463234  1166 consensus_queue.cc:260] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:22.426005  1196 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:22.339715  1270 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:22.432796  1279 raft_consensus.cc:3055] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:09:22.466907 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 303743us
W20260709 13:09:22.479941 31115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.466377 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:22.463696 30550 raft_consensus.cc:1275] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:09:22.474576 30549 raft_consensus.cc:1240] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:22.501341  1092 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:22.433869  1274 raft_consensus.cc:740] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:22.444126  1180 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:22.499926 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:22.480000 31114 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:22.399101  1058 consensus_queue.cc:237] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:22.409873  1288 consensus_queue.cc:1048] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.100s
I20260709 13:09:22.543879 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:22.467414  1007 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:22.612519 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:22.613300 30544 raft_consensus.cc:2410] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:09:22.643117 30550 pending_rounds.cc:85] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd: Aborting all ops after (but not including) 4
I20260709 13:09:22.496223  1191 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:22.639600 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:22.612694 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 132803us
I20260709 13:09:22.647338 31114 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:22.639559 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 235946us
W20260709 13:09:22.640448 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 238461us
I20260709 13:09:22.494372 30543 raft_consensus.cc:2468] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:09:22.643442 30550 pending_rounds.cc:107] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd: Aborting uncommitted NO_OP operation due to leader change: 8.5
W20260709 13:09:22.534900 30441 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.021s	sys 0.017s
I20260709 13:09:22.651664 30550 raft_consensus.cc:2889] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:22.651780 30441 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.022s	sys 0.017s
I20260709 13:09:22.644258 31115 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:22.642314 30546 raft_consensus.cc:2468] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
I20260709 13:09:22.506554  1291 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:22.547376  1279 raft_consensus.cc:740] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
W20260709 13:09:22.683481 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.666512 30516 leader_election.cc:304] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:22.506335  1203 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.012s	sys 0.009s
W20260709 13:09:22.695766  1203 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.012s	sys 0.012s
W20260709 13:09:22.533960  1143 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.019s	sys 0.040s
W20260709 13:09:22.700941 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 58593us
I20260709 13:09:22.681849   836 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:22.523394  1198 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:22.503423  1289 consensus_queue.cc:1048] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.217s
I20260709 13:09:22.643611  1180 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:22.706038 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 140154us
I20260709 13:09:22.722260 31116 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:22.687279  1191 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:22.704306  1165 raft_consensus.cc:3060] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:22.580545  1271 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:22.740911 30618 raft_consensus.cc:1240] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 LEADER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 4. Current term is 5. Ops: []
W20260709 13:09:22.742208 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 94951.4us
W20260709 13:09:22.719756  1143 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.019s	sys 0.041s
I20260709 13:09:22.727056  1166 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:22.726687  1229 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:22.762945  1294 raft_consensus.cc:2749] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:22.763937  1283 raft_consensus.cc:493] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:22.764925  1294 raft_consensus.cc:2804] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:22.764623  1283 raft_consensus.cc:515] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:22.765331  1294 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:22.765723  1294 raft_consensus.cc:3060] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:22.766914  1283 leader_election.cc:290] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:22.768378  1198 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:22.768975  1305 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.769462  1305 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:22.771960  1278 log.cc:927] Time spent T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.409s	user 0.000s	sys 0.001s
I20260709 13:09:22.682260  1007 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:22.772509  1288 raft_consensus.cc:2804] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:22.741920  1180 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:22.703881  1291 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:22.781080  1198 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:22.772815  1305 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:22.820366 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 83181.3us
W20260709 13:09:22.819252 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 166464us
I20260709 13:09:22.827781 30517 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6
W20260709 13:09:22.803891  1173 consensus_meta.cc:287] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.884s	user 0.005s	sys 0.006s
W20260709 13:09:22.807406  1301 log.cc:927] Time spent T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:09:22.747916  1191 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:22.829571 30545 raft_consensus.cc:1240] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:22.836213 30545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 1751) took 1265 ms. Trace:
I20260709 13:09:22.777459  1203 consensus_queue.cc:1059] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:09:22.830893 30517 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:22.807540  1288 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:22.805030  1260 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:22.833873 30590 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:22.830157  1269 leader_election.cc:290] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:22.824491  1273 log.cc:927] Time spent T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.313s	user 0.000s	sys 0.001s
W20260709 13:09:22.838622 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 172193us
I20260709 13:09:22.874171 30516 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:22.836699 30545 rpcz_store.cc:276] 0709 13:09:21.571034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.571158 (+   124us) service_pool.cc:224] Handling call
0709 13:09:22.829226 (+1258068us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b5800028598. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780e43b71 00007fc780e43eee 0000000000375939 00007fc788eb71e0 00007fc788f800c4 00007fc788f80131 00007fc788f41fc0 00007fc788f2c929 00007fc788f2c3d2 00007fc7824a3bd4
0709 13:09:22.829397 (+   171us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:22.835892 (+  6495us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.836147 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29127424}
I20260709 13:09:22.771960  1304 consensus_queue.cc:1048] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.088s
I20260709 13:09:22.799337  1229 consensus_queue.cc:1048] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:09:22.732319  1274 consensus_queue.cc:260] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:22.867345 31144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48412 (request call id 612) took 1990 ms. Trace:
I20260709 13:09:22.914975  1274 raft_consensus.cc:3060] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:22.914577 31144 rpcz_store.cc:276] 0709 13:09:20.873880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.877800 (+  3920us) service_pool.cc:224] Handling call
0709 13:09:20.900394 (+ 22594us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:20.913314 (+ 12920us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:20.913343 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:21.693303 (+779960us) spinlock_profiling.cc:243] Waited 22.4 ms on lock 0x7b2c00047988. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc782861a11 00007fc782871372 00007fc783fa3a01 00007fc783f6843a 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2
0709 13:09:21.693669 (+   366us) log.cc:844] Serialized 26 byte log entry
0709 13:09:22.104442 (+410773us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:22.104497 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.104596 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:22.861784 (+757188us) raft_consensus.cc:1685] finished
0709 13:09:22.861807 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:22.863825 (+  2018us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5010,"raft.queue_time_us":21171,"raft.run_cpu_time_us":50,"raft.run_wall_time_us":50,"spinlock_wait_cycles":51552000,"thread_start_us":410339,"threads_started":1,"wal-append.queue_time_us":592486}
W20260709 13:09:22.834589 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 140361us
I20260709 13:09:22.864497  1283 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.920322  1270 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:22.920492  1283 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:22.922859  1284 log.cc:927] Time spent T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.381s	user 0.000s	sys 0.001s
I20260709 13:09:22.923273  1283 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:22.923550  1282 raft_consensus.cc:2749] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:22.868003  1288 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:22.925591  1293 log.cc:927] Time spent T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:09:22.938297 30589 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:22.836119  1173 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:22.952080  1270 consensus_queue.cc:1048] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:22.831512  1198 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:22.954648 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 80556.5us
I20260709 13:09:22.955633 30516 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:22.953907 30589 leader_election.cc:304] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:22.967885  1051 raft_consensus.cc:2804] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:22.968659  1051 raft_consensus.cc:697] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:22.969869  1051 consensus_queue.cc:237] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:22.955219  1270 consensus_queue.cc:1243] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer f639301059e24dc5b0d88a46dc683326 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:09:22.973402  1270 raft_consensus.cc:2804] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:22.973829  1270 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:22.974282  1270 raft_consensus.cc:3060] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:22.976137  1320 raft_consensus.cc:2804] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:09:22.976789  1285 log.cc:927] Time spent T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.383s	user 0.001s	sys 0.000s
W20260709 13:09:22.978286   958 consensus_meta.cc:287] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 1.145s	user 0.009s	sys 0.001s
I20260709 13:09:22.979327  1191 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:22.980500  1303 raft_consensus.cc:2749] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:22.984256  1271 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:22.986038  1007 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:22.987279 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:22.988492 31142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48412 (request call id 611) took 2161 ms. Trace:
I20260709 13:09:22.988969 31142 rpcz_store.cc:276] 0709 13:09:20.826765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.870674 (+ 43909us) service_pool.cc:224] Handling call
0709 13:09:20.900396 (+ 29722us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:20.947724 (+ 47328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.988151 (+2040427us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b54005a14d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:22.988388 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4653312}
I20260709 13:09:22.992230  1180 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:22.760511  1279 consensus_queue.cc:260] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:22.993266  1279 raft_consensus.cc:3060] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:22.987288  1291 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:22.999581 31113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.984174  1300 raft_consensus.cc:3055] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:22.976689  1320 raft_consensus.cc:697] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 9 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
W20260709 13:09:22.976711  1277 log.cc:927] Time spent T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.443s	user 0.000s	sys 0.001s
W20260709 13:09:23.018559 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 187723us
I20260709 13:09:22.987071 30371 catalog_manager.cc:5697] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 4 to 5, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 5 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:23.019270 30517 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:22.978840   958 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:23.006201 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 52385.2us
W20260709 13:09:23.010438 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 54885.9us
I20260709 13:09:23.021772 30516 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:23.024389 30468 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 8.
I20260709 13:09:22.953078  1305 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:23.026496 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.957569  1290 raft_consensus.cc:2749] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:23.044739  1174 raft_consensus.cc:493] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:23.045140  1288 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:23.034305 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:23.035609 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.035858 30469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 696) took 1115 ms. Trace:
I20260709 13:09:23.052585 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:23.052896 30469 rpcz_store.cc:276] 0709 13:09:21.920544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.937698 (+ 17154us) service_pool.cc:224] Handling call
0709 13:09:21.938025 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:22.291497 (+353472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.035576 (+744079us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b54003c2dd4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:23.035783 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":810844928}
I20260709 13:09:23.031073  1294 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:23.037220 30625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36130 (request call id 1784) took 1406 ms. Trace:
I20260709 13:09:23.038765  1320 consensus_queue.cc:237] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:23.039662 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:23.040270  1165 raft_consensus.cc:2749] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:23.041450  1304 raft_consensus.cc:2749] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:23.041760 30516 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:23.043383 30517 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:23.045261  1174 raft_consensus.cc:515] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:23.046511  1176 consensus_queue.cc:1059] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:23.046869  1198 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:23.016952  1303 raft_consensus.cc:2749] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:23.047461   974 consensus_queue.cc:1059] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:23.047930  1296 raft_consensus.cc:2804] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:23.048208  1321 consensus_queue.cc:1059] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:23.048870  1305 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:23.031049  1307 consensus_queue.cc:1048] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:09:23.036723 30371 catalog_manager.cc:5697] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:09:23.081796  1305 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:23.081586 30371 catalog_manager.cc:5697] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 2 to 5, leader changed from cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 5 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:23.053974 30544 raft_consensus.cc:1275] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260709 13:09:23.083679  1251 consensus_meta.cc:287] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.650s	user 0.010s	sys 0.000s
I20260709 13:09:23.045341  1290 raft_consensus.cc:2804] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:23.013366  1300 raft_consensus.cc:740] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:23.057938 30550 raft_consensus.cc:3055] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:23.089095 30550 raft_consensus.cc:740] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
W20260709 13:09:23.057947 31113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.056056 30625 rpcz_store.cc:276] 0709 13:09:21.630524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.630667 (+   143us) service_pool.cc:224] Handling call
0709 13:09:21.631006 (+   339us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:21.661634 (+ 30628us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:21.661660 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:21.676519 (+ 14859us) log.cc:844] Serialized 52 byte log entry
0709 13:09:21.951740 (+275221us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:22.058612 (+106872us) log.cc:844] Serialized 14 byte log entry
0709 13:09:22.124032 (+ 65420us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.124143 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:23.037025 (+912882us) raft_consensus.cc:1685] finished
0709 13:09:23.037057 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:23.037170 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15956,"prepare.queue_time_us":124899,"prepare.run_wall_time_us":7014,"raft.queue_time_us":173969,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":15375,"spinlock_wait_cycles":41340928,"thread_start_us":267828,"threads_started":1,"wal-append.queue_time_us":636803}
I20260709 13:09:23.068452 30517 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:23.091451 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:23.092581 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:23.072489 30620 raft_consensus.cc:1240] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:23.094084 30620 raft_consensus.cc:1240] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:23.074167 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:23.078632  1322 raft_consensus.cc:2804] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:23.095674 30542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 629) took 1408 ms. Trace:
I20260709 13:09:23.095705 31146 raft_consensus.cc:1275] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:23.086763 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:09:23.087194 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 342540us
I20260709 13:09:23.083127 30371 catalog_manager.cc:5697] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:23.090104 30550 consensus_queue.cc:260] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:23.101145 30617 raft_consensus.cc:1240] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:23.096083 30542 rpcz_store.cc:276] 0709 13:09:21.686879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.695898 (+  9019us) service_pool.cc:224] Handling call
0709 13:09:21.696307 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:22.403257 (+706950us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:22.403289 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:22.428332 (+ 25043us) log.cc:844] Serialized 26 byte log entry
0709 13:09:22.726385 (+298053us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:23.067170 (+340785us) log.cc:844] Serialized 14 byte log entry
0709 13:09:23.095413 (+ 28243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.095478 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:23.095515 (+    37us) raft_consensus.cc:1685] finished
0709 13:09:23.095525 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:23.095625 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28227,"prepare.queue_time_us":323762,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":923,"raft.queue_time_us":126592,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"thread_start_us":1251584,"threads_started":3,"wal-append.queue_time_us":437199}
I20260709 13:09:23.109728 31114 leader_election.cc:400] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 election: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 8. Current term is 9.
I20260709 13:09:23.110667 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:23.111392 30473 raft_consensus.cc:3060] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:23.085701  1296 raft_consensus.cc:493] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:23.112821 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:23.112615 30371 catalog_manager.cc:5697] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:09:23.086364  1290 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:23.119637 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:23.118927 30371 catalog_manager.cc:5697] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:23.131587 31145 raft_consensus.cc:1275] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:09:23.107045  1007 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.106822  1307 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.139112 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:23.140136 30473 raft_consensus.cc:2468] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 7.
W20260709 13:09:23.141076 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 69396.3us
I20260709 13:09:23.141288 31116 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:09:23.142793 30360 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 5610a33c644c4e539ad503631763aa40 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica fe2b7d73f8c743c1ba570cfd981c4e79 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:09:23.118896  1296 raft_consensus.cc:3060] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:23.129071  1290 raft_consensus.cc:3060] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:23.106956  1305 consensus_queue.cc:1048] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:09:23.109421  1251 consensus_queue.cc:1048] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:09:23.156000 30371 catalog_manager.cc:5697] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 2 to 4, leader changed from cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 4 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:23.158064 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:23.158332 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:23.128327  1322 raft_consensus.cc:697] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 6 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
W20260709 13:09:23.151085  1091 consensus_meta.cc:287] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.685s	user 0.009s	sys 0.003s
I20260709 13:09:23.165114 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:23.186403 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:23.190840 31143 raft_consensus.cc:2393] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 6: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:23.190899 30371 catalog_manager.cc:5697] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:23.192433 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:23.192613 30590 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:23.195079  1292 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.195608  1292 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:23.196004 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:23.196614 31143 raft_consensus.cc:2376] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7. Re-sending same reply.
I20260709 13:09:23.197428 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:23.197705  1292 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:23.198371 30548 raft_consensus.cc:2468] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7.
I20260709 13:09:23.198498 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:23.198603  1322 consensus_queue.cc:237] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:23.202539 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:23.203903 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:23.204177 30590 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:23.205351 30590 leader_election.cc:304] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:09:23.207497 30371 catalog_manager.cc:5697] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 3 to 4, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 4 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:23.203152 31143 raft_consensus.cc:2468] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
I20260709 13:09:23.216128 31151 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 8.
I20260709 13:09:23.164031  1092 raft_consensus.cc:2804] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:23.151192  1007 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:23.151295  1307 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:23.334380 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:23.215720  1279 raft_consensus.cc:493] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.356209  1092 raft_consensus.cc:697] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 7 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:23.215842  1180 raft_consensus.cc:2804] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:09:23.242337 31116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.321125  1321 raft_consensus.cc:2804] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:23.358950  1007 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:09:23.347597 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 279199us
I20260709 13:09:23.360913 30517 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:23.361202 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:23.362145 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:23.363180 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:23.363763 30547 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 9.
I20260709 13:09:23.363873 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:23.365047 30543 raft_consensus.cc:3055] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:23.365125 30517 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:23.365423 30543 raft_consensus.cc:740] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:23.366253 30543 consensus_queue.cc:260] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:23.356650  1279 raft_consensus.cc:515] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:23.320951 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:23.282087  1215 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.368747 31151 raft_consensus.cc:2393] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 10: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:23.187053  1091 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:23.372490 31143 raft_consensus.cc:1275] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:09:23.374271  1289 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.214051  1305 raft_consensus.cc:2749] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:23.219987  1303 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:23.380059 30543 raft_consensus.cc:3060] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:23.302102 30371 catalog_manager.cc:5697] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: config changed from index 2 to 3, term changed from 1 to 5, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to <none>, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New cstate: current_term: 5 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:09:23.384492  1303 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:23.186110  1326 raft_consensus.cc:2749] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:23.374946  1327 log.cc:927] Time spent T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.237s	user 0.000s	sys 0.000s
I20260709 13:09:23.434976 30371 catalog_manager.cc:5697] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 2 to 3, leader changed from cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 3 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:09:23.438884 30371 catalog_manager.cc:5697] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 1 to 4, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 4 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:23.372660  1342 raft_consensus.cc:2749] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:23.376103  1215 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:23.385630  1289 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:23.385382  1288 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:23.385452  1176 raft_consensus.cc:2749] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:23.447888  1305 raft_consensus.cc:493] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:23.450429  1279 leader_election.cc:290] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:23.451134  1215 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:23.190065  1300 consensus_queue.cc:260] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:23.449364  1237 raft_consensus.cc:2749] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:09:23.459777 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 109154us
I20260709 13:09:23.451630  1289 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:23.464564 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:23.466006 30542 raft_consensus.cc:2410] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:09:23.460263  1174 leader_election.cc:290] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:23.468245 30543 raft_consensus.cc:1275] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:09:23.456718  1305 raft_consensus.cc:515] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:23.473305 30543 pending_rounds.cc:85] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd: Aborting all ops after (but not including) 7
I20260709 13:09:23.476586 30543 pending_rounds.cc:107] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:09:23.436208  1341 consensus_queue.cc:1059] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
W20260709 13:09:23.477094 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.477125 30543 raft_consensus.cc:2889] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:23.449640  1092 consensus_queue.cc:237] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:23.478806 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 113121us
I20260709 13:09:23.481415 30517 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:23.483757 30517 leader_election.cc:400] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 8. Current term is 9.
I20260709 13:09:23.484057 30517 leader_election.cc:403] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:09:23.477567  1180 raft_consensus.cc:697] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
W20260709 13:09:23.508279 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.509258 30590 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:23.485072  1322 raft_consensus.cc:3055] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:23.484603  1342 raft_consensus.cc:2749] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:23.511452 30517 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:23.535661 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:23.545053 30517 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:23.547204 31113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.507154  1198 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.512678  1240 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.510563  1215 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:09:23.556448 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 47382.7us
I20260709 13:09:23.559286 30590 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:09:23.533252  1322 raft_consensus.cc:740] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:23.541414  1279 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:23.534757  1349 raft_consensus.cc:2749] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 8. Current term is 9.
I20260709 13:09:23.551240  1325 raft_consensus.cc:2749] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:23.564088  1174 raft_consensus.cc:2804] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:23.602582  1353 raft_consensus.cc:2804] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:23.579722  1342 consensus_queue.cc:1048] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:09:23.608408  1290 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:23.575984  1091 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:23.609200  1346 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.559250  1303 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:23.611380 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 248305us
W20260709 13:09:23.608829  1337 log.cc:927] Time spent T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:09:23.559026  1198 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:23.629671 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 70495.8us
I20260709 13:09:23.564705  1240 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:23.612303  1174 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:23.625439  1345 log.cc:927] Time spent T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:09:23.616513  1326 raft_consensus.cc:2749] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:23.635059 30546 raft_consensus.cc:2393] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 5: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:23.635406 30516 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:23.581431  1279 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:23.618139  1325 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:09:23.639120  1350 log.cc:927] Time spent T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:09:23.644775 31114 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:23.646113 31114 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:09:23.576114  1215 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:23.632521  1240 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:23.636444  1174 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:23.649458  1288 raft_consensus.cc:2749] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:23.642321  1349 raft_consensus.cc:2749] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:23.655223 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:23.650843 31143 raft_consensus.cc:1240] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 7. Current term is 8. Ops: []
W20260709 13:09:23.651250 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.660989 30542 raft_consensus.cc:2468] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 9.
I20260709 13:09:23.628346  1353 raft_consensus.cc:697] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:23.655045 30543 raft_consensus.cc:1240] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:09:23.658927 30623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 653) took 2580 ms. Trace:
I20260709 13:09:23.649928  1007 raft_consensus.cc:2804] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:23.664606 30623 rpcz_store.cc:276] 0709 13:09:21.072399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.072538 (+   139us) service_pool.cc:224] Handling call
0709 13:09:21.150471 (+ 77933us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:21.199348 (+ 48877us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:21.199391 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:21.199449 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:21.199492 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.652301 (+2452809us) spinlock_profiling.cc:243] Waited 48.6 ms on lock 0x7b54003449d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:23.652353 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:23.652462 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":111862656}
I20260709 13:09:23.637198  1303 consensus_queue.cc:1059] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:09:23.667897 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:23.668584 31114 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:23.648046  1305 leader_election.cc:290] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:23.630497  1346 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:23.630142  1322 consensus_queue.cc:260] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:23.670646  1318 consensus_queue.cc:1059] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:09:23.670867  1351 consensus_queue.cc:1059] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:09:23.653390  1275 consensus_queue.cc:1048] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:09:23.654098  1325 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:23.672991  1288 raft_consensus.cc:2804] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:23.674551  1321 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:09:23.675130  1270 consensus_meta.cc:287] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.700s	user 0.007s	sys 0.004s
I20260709 13:09:23.676033  1242 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:23.629205  1180 consensus_queue.cc:237] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:23.666339  1007 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.643937  1051 consensus_queue.cc:1048] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:09:23.687108  1288 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.692155  1270 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:23.697395  1007 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:23.712288  1296 consensus_meta.cc:287] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.549s	user 0.001s	sys 0.009s
I20260709 13:09:23.712719  1296 raft_consensus.cc:515] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:23.713383 30551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 618) took 2759 ms. Trace:
I20260709 13:09:23.713845  1266 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:23.687309 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:23.713773 30551 rpcz_store.cc:276] 0709 13:09:20.953896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.954042 (+   146us) service_pool.cc:224] Handling call
0709 13:09:21.593730 (+639688us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:21.596169 (+  2439us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.713176 (+2117007us) spinlock_profiling.cc:243] Waited 639 ms on lock 0x7b5400258ad0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f678ad 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:23.713303 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1470432640}
I20260709 13:09:23.715087 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:23.715770  1294 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:23.717787  1322 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:23.720161 30542 raft_consensus.cc:1240] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:23.697932  1198 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:23.706274 30475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 1686) took 1898 ms. Trace:
I20260709 13:09:23.724314 30475 rpcz_store.cc:276] 0709 13:09:21.807735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.807911 (+   176us) service_pool.cc:224] Handling call
0709 13:09:21.808190 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:22.208091 (+399901us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:22.208136 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:22.208199 (+    63us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:22.208247 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.706031 (+1497784us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b5400041354. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:23.706078 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:23.706214 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":919152512}
I20260709 13:09:23.714701  1296 leader_election.cc:290] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133)
I20260709 13:09:23.692490  1321 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:23.718595   973 raft_consensus.cc:3055] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:23.728895  1197 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:23.708652  1270 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:23.697654  1290 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:23.726727  1288 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:23.662449  1353 consensus_queue.cc:237] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:23.737633 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 67840.2us
I20260709 13:09:23.739360 30551 raft_consensus.cc:1275] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:23.698143  1279 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:23.727855  1198 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.717830   870 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:23.736096  1349 raft_consensus.cc:3055] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:09:23.685773  1108 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.758s	user 0.004s	sys 0.018s
I20260709 13:09:23.727823   937 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:23.749682 30516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.746479 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:23.736411   973 raft_consensus.cc:740] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
W20260709 13:09:23.726523  1263 log.cc:927] Time spent T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 1.800s	user 0.010s	sys 0.021s
I20260709 13:09:23.732436  1325 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:23.762012 30551 raft_consensus.cc:2468] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 4.
I20260709 13:09:23.762027 31151 raft_consensus.cc:1240] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 7 LEADER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:23.774349   937 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:23.777046 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:23.776891  1174 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:23.777714 30551 raft_consensus.cc:2468] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 4.
I20260709 13:09:23.778529 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:23.779004 30551 raft_consensus.cc:2376] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9. Re-sending same reply.
I20260709 13:09:23.779106  1174 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:23.741079  1197 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:23.780349 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:23.778899   937 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:23.744345 30543 pending_rounds.cc:85] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd: Aborting all ops after (but not including) 3
I20260709 13:09:23.814152 30471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 1681) took 2875 ms. Trace:
I20260709 13:09:23.870383 30543 pending_rounds.cc:107] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:09:23.871392 30543 raft_consensus.cc:2889] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:23.822484 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
W20260709 13:09:23.872777 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:23.823243 30621 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57140 (request call id 656) took 2641 ms (client timeout 2482 ms). Trace:
I20260709 13:09:23.808467 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:23.872798 30551 raft_consensus.cc:2368] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 7. Current term is 8.
W20260709 13:09:23.750803  1108 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.824s	user 0.005s	sys 0.018s
I20260709 13:09:23.747200  1176 consensus_queue.cc:1059] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.187s
I20260709 13:09:23.921591 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:23.955925 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:23.936110 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:24.106882 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:09:23.873772 30621 rpcz_store.cc:269] 0709 13:09:21.186533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.193118 (+  6585us) service_pool.cc:224] Handling call
0709 13:09:23.823002 (+2629884us) spinlock_profiling.cc:243] Waited 654 ms on lock 0x7b540027f954. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:23.823128 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1504032000}
I20260709 13:09:24.131263 30548 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 7.
I20260709 13:09:23.876976 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:23.974936 30547 raft_consensus.cc:1240] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:24.134079 30551 raft_consensus.cc:2393] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 7: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:24.130720  1288 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:24.001230  1312 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:24.135159  1312 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:23.967249 31147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48414 (request call id 773) took 2219 ms. Trace:
I20260709 13:09:24.136292 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:23.935604 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:23.972193 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:24.137372 30475 raft_consensus.cc:2468] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 10.
W20260709 13:09:24.050561 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.972954 30472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 690) took 2063 ms. Trace:
W20260709 13:09:24.079309 31113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.137876 30619 raft_consensus.cc:1240] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:09:23.809850 30616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36130 (request call id 1787) took 1997 ms. Trace:
W20260709 13:09:23.959682 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.871086 30471 rpcz_store.cc:276] 0709 13:09:20.938799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.939079 (+   280us) service_pool.cc:224] Handling call
0709 13:09:20.939370 (+   291us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:21.066329 (+126959us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:21.066357 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:21.075677 (+  9320us) log.cc:844] Serialized 52 byte log entry
0709 13:09:21.661971 (+586294us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:21.679973 (+ 18002us) log.cc:844] Serialized 14 byte log entry
0709 13:09:21.680272 (+   299us) log.cc:844] Serialized 14 byte log entry
0709 13:09:22.403618 (+723346us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.403705 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:23.721828 (+1318123us) spinlock_profiling.cc:243] Waited 34.7 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:09:23.813760 (+ 91932us) raft_consensus.cc:1685] finished
0709 13:09:23.813785 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:23.814050 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20493,"prepare.queue_time_us":40111,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":236017,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":38314,"spinlock_wait_cycles":79796096,"thread_start_us":1250877,"threads_started":3,"wal-append.queue_time_us":748330}
I20260709 13:09:24.121341 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:24.139284 30616 rpcz_store.cc:276] 0709 13:09:21.812089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.812501 (+   412us) service_pool.cc:224] Handling call
0709 13:09:21.812778 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:21.961336 (+148558us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:21.961373 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:21.961414 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:21.961445 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.809510 (+1848065us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b5400202e54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:23.809579 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:23.809775 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":341214080}
I20260709 13:09:24.140533 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:23.967970 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:24.141098 30471 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 8.
I20260709 13:09:23.921417 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:24.141873 30470 raft_consensus.cc:2376] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 9. Re-sending same reply.
I20260709 13:09:24.142007 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:24.139454 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:23.751380  1349 raft_consensus.cc:740] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:24.142745 30471 raft_consensus.cc:2468] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 7.
I20260709 13:09:24.155251 30620 raft_consensus.cc:2410] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:09:23.796739  1197 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:24.156693 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:24.185375 30625 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 8.
I20260709 13:09:24.160591 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:24.156880 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:24.163225 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:24.186599 30471 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:24.156880 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:24.187085 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:24.187167 30469 raft_consensus.cc:3060] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:24.187577 30546 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 6.
I20260709 13:09:24.157032 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:24.157533 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:23.824466  1164 raft_consensus.cc:3055] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:23.831069  1296 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.145458 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:23.762122   870 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:24.136529 31147 rpcz_store.cc:276] 0709 13:09:21.748320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.748427 (+   107us) service_pool.cc:224] Handling call
0709 13:09:21.748685 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:22.055087 (+306402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:22.055133 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:22.055190 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:22.055233 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.967022 (+1911789us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b5400500354. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:23.967064 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:23.967194 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":704084736}
I20260709 13:09:24.184742 31142 raft_consensus.cc:1240] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 9 LEADER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:23.829502  1173 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:24.138463 30472 rpcz_store.cc:276] 0709 13:09:21.910014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.910134 (+   120us) service_pool.cc:224] Handling call
0709 13:09:21.910392 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:22.212783 (+302391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:22.212817 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:22.212856 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:22.212885 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.972680 (+1759795us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b54000438d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:23.972738 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:23.972889 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":695003008}
I20260709 13:09:24.188431 30616 raft_consensus.cc:2393] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 8: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:24.146183 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:23.837081  1174 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:23.750630  1198 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:23.796581   973 consensus_queue.cc:260] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:24.188426 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:24.268985 30467 raft_consensus.cc:1240] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 6. Current term is 7. Ops: [4.7-6.8]
I20260709 13:09:24.390985 30546 raft_consensus.cc:2393] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 5: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:24.196419 30617 raft_consensus.cc:1275] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:24.304828 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:24.366021 30469 raft_consensus.cc:2468] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 7.
I20260709 13:09:24.267045 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:24.267287 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:24.160499 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:24.241273 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:24.392176 30467 raft_consensus.cc:1240] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:09:24.286716 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:24.285403 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:24.384068 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:24.305215 30475 raft_consensus.cc:1240] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 13:09:24.277750 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.402976 30622 raft_consensus.cc:2393] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 5: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:24.396693 30548 raft_consensus.cc:3060] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:24.374650 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.097492  1346 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:24.123962  1322 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:24.141927 30589 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:24.049608  1215 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:24.408825 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:24.434734 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:24.143070  1313 raft_consensus.cc:493] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.437005 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:24.437695 30546 raft_consensus.cc:2468] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
W20260709 13:09:24.437745 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 295839us
I20260709 13:09:24.126438  1307 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:23.956686  1363 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:24.143226  1165 raft_consensus.cc:493] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.411908 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:24.437129 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:23.827499  1007 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:23.913416  1321 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:24.445010 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:24.443964 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:24.159822  1092 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:24.402791  1242 raft_consensus.cc:493] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.241784  1319 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.144322  1050 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.439138 30589 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:24.390733  1164 raft_consensus.cc:740] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:24.442875   973 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:24.299121  1240 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:24.452157 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:24.456560 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:24.471220 30546 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:09:24.448796  1215 raft_consensus.cc:2804] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:24.184448  1288 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:24.458245 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:24.286232  1312 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:24.460203 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:24.297652  1051 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
W20260709 13:09:24.402132 30360 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 5610a33c644c4e539ad503631763aa40 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica fe2b7d73f8c743c1ba570cfd981c4e79 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:09:24.462430   819 raft_consensus.cc:2749] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:24.463205  1164 consensus_queue.cc:260] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:24.410418  1296 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:24.469288 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:24.461647 30589 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:24.472066 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:24.472066 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:24.407527   870 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:24.481518 30616 raft_consensus.cc:2410] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:24.241850  1367 consensus_queue.cc:1048] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.275s
I20260709 13:09:24.484169  1198 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:24.484529 30616 raft_consensus.cc:1240] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 LEADER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:24.485697  1321 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:24.454896  1165 raft_consensus.cc:515] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:24.452934  1349 consensus_queue.cc:260] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:24.488453  1349 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:24.490850   958 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:24.493312  1007 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:24.474206 31145 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 8.
I20260709 13:09:24.459120 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:24.407316  1174 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:24.475726 30591 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.809s (SENT) [suppressed 23 similar messages]
I20260709 13:09:24.476784 31143 raft_consensus.cc:1240] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:24.481518 30546 raft_consensus.cc:2410] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:09:24.475659  1240 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:24.450297  1313 raft_consensus.cc:515] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:24.475919  1215 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.501340 30548 raft_consensus.cc:2468] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:09:24.507587 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:24.444800  1322 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:24.504554 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 331308us
I20260709 13:09:24.497913 31147 raft_consensus.cc:2468] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
I20260709 13:09:24.461620  1092 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:24.461872  1242 raft_consensus.cc:515] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:24.453662  1363 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:24.517586 30548 raft_consensus.cc:1275] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:24.505105  1164 raft_consensus.cc:3060] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:24.500643  1272 raft_consensus.cc:2804] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:24.521341 30619 raft_consensus.cc:1240] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:24.461795  1319 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:24.516351 30441 leader_election.cc:304] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:24.501596  1165 leader_election.cc:290] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:24.476610  1051 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:24.540047  1174 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:09:24.500253 30360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 98188.9us
I20260709 13:09:24.509944  1215 raft_consensus.cc:3060] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:24.557371  1342 raft_consensus.cc:3055] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:24.557787  1342 raft_consensus.cc:740] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:24.558547  1342 consensus_queue.cc:260] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:24.560454 30467 pending_rounds.cc:85] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326: Aborting all ops after (but not including) 3
W20260709 13:09:24.560684  1361 log.cc:927] Time spent T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.771s	user 0.001s	sys 0.000s
I20260709 13:09:24.561439 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:24.562227 30476 raft_consensus.cc:2410] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:09:24.525359 31147 raft_consensus.cc:1275] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:24.508069 30589 leader_election.cc:304] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:24.469071  1050 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:24.526142  1065 raft_consensus.cc:2749] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:24.574769  1322 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:24.576633 30545 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:24.577720  1363 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:24.596487  1241 raft_consensus.cc:2804] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:24.597345  1241 raft_consensus.cc:697] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:24.598531  1241 consensus_queue.cc:237] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:24.527326   870 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:24.528873 30543 raft_consensus.cc:1275] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:09:24.529134  1313 leader_election.cc:290] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:24.529357  1092 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:24.531059  1240 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:24.520186  1257 consensus_queue.cc:1048] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:09:24.522964  1272 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.547394  1051 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:24.549225 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:24.550930 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:24.794962 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:09:24.551358 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.553015 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:24.796793 30621 raft_consensus.cc:2410] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:09:24.553489  1296 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:24.555059 30624 raft_consensus.cc:1240] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:24.517385  1367 consensus_queue.cc:1048] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:09:24.560729 30467 pending_rounds.cc:107] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326: Aborting uncommitted NO_OP operation due to leader change: 5.4
W20260709 13:09:24.563759 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 55826.1us
I20260709 13:09:24.564813 30471 raft_consensus.cc:2468] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 11.
I20260709 13:09:24.565321 31145 raft_consensus.cc:1240] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:24.518641 30548 raft_consensus.cc:1240] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:24.573777 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
W20260709 13:09:24.555696  1355 log.cc:927] Time spent T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:09:24.775950 30543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43088 (request call id 1888) took 1034 ms. Trace:
I20260709 13:09:24.811774 30548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43088 (request call id 1886) took 1070 ms. Trace:
I20260709 13:09:24.559695  1342 raft_consensus.cc:3060] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:24.777742 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 302029us
I20260709 13:09:24.525548 30619 raft_consensus.cc:1275] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:24.812599 30543 rpcz_store.cc:276] 0709 13:09:23.741602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.528333 (+786731us) service_pool.cc:224] Handling call
0709 13:09:24.528584 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.765447 (+236863us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.775888 (+ 10441us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:24.812835 30548 rpcz_store.cc:276] 0709 13:09:23.741102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.518352 (+777250us) service_pool.cc:224] Handling call
0709 13:09:24.518545 (+   193us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.811417 (+292872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.811696 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:24.776954 30441 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:24.814886 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:24.824074 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:24.824592 30476 raft_consensus.cc:3060] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:24.798156 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:09:24.784376 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.813114 31145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48412 (request call id 622) took 1079 ms. Trace:
I20260709 13:09:24.814206 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:24.792559 30545 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
W20260709 13:09:24.824389 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 47495.2us
I20260709 13:09:24.825636 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:24.825757 30471 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7.
I20260709 13:09:24.826388 30473 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:09:24.826772 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:24.827204 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:24.827356 30441 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:24.804934 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:24.827785 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:24.815694 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:24.828975 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:24.825520 31145 rpcz_store.cc:276] 0709 13:09:23.733678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.515852 (+782174us) service_pool.cc:224] Handling call
0709 13:09:24.525933 (+ 10081us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.812894 (+286961us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.813062 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:24.830536 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:24.831218 30471 raft_consensus.cc:2468] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7.
I20260709 13:09:24.800900 30467 raft_consensus.cc:2889] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:24.836596 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.840739 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:24.841060 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:24.800956  1288 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.846706 30551 raft_consensus.cc:1240] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:24.845857 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:24.796581  1272 raft_consensus.cc:3060] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:24.848034 30548 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 8.
I20260709 13:09:24.781077  1174 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.834275  1065 raft_consensus.cc:2804] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:24.872815 30473 raft_consensus.cc:1275] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:24.892117 30589 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:24.904915 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:24.905761 30548 raft_consensus.cc:2468] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
I20260709 13:09:24.906914 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:24.885636  1174 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:24.907708 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.910846 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:09:24.909063 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.911219 30551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 1784) took 1033 ms. Trace:
I20260709 13:09:24.912515 30551 rpcz_store.cc:276] 0709 13:09:23.877646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.846272 (+968626us) service_pool.cc:224] Handling call
0709 13:09:24.846540 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.847127 (+   587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.911161 (+ 64034us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:24.912055 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:24.871678  1065 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.914219 30475 raft_consensus.cc:1275] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:24.911888 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:24.915215 30619 raft_consensus.cc:2468] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 3.
W20260709 13:09:24.918066 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 79041.6us
I20260709 13:09:24.844199  1372 consensus_queue.cc:1048] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:09:24.924577 30624 raft_consensus.cc:2393] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 11: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:24.925719 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:24.852495  1288 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:24.928848 30621 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:24.928634 30589 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:24.930652 30591 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:24.931659  1346 raft_consensus.cc:2749] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:24.932358  1346 raft_consensus.cc:2804] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:24.932781  1346 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:24.933102 30544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 633) took 1571 ms. Trace:
I20260709 13:09:24.933255  1346 raft_consensus.cc:3060] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:24.935848 30548 raft_consensus.cc:1240] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:24.936578 30548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 1785) took 1058 ms. Trace:
I20260709 13:09:24.936946 30548 rpcz_store.cc:276] 0709 13:09:23.877980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.924283 (+1046303us) service_pool.cc:224] Handling call
0709 13:09:24.935630 (+ 11347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.936293 (+   663us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.936516 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:24.929275 30624 raft_consensus.cc:1240] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 LEADER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:09:24.919586  1065 raft_consensus.cc:3060] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:24.928352   819 raft_consensus.cc:2804] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:24.962105   819 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:24.962657   819 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:24.965283  1174 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:24.933487 30544 rpcz_store.cc:276] 0709 13:09:23.361296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.362091 (+   795us) service_pool.cc:224] Handling call
0709 13:09:23.362359 (+   268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:23.451930 (+ 89571us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:23.451977 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:23.462707 (+ 10730us) log.cc:844] Serialized 26 byte log entry
0709 13:09:23.544695 (+ 81988us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:23.584591 (+ 39896us) log.cc:844] Serialized 14 byte log entry
0709 13:09:23.613038 (+ 28447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.613130 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:24.468074 (+854944us) spinlock_profiling.cc:243] Waited 1.66 ms on lock 0x7b18000600a0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e7b3f3 00007fc780e7d7c1 00007fc780e7d779 00007fc780e7d709 00007fc780e7d6d1 00007fc780e7c9cd 000000000038f354 000000000038f199 00007fc780e5e83a
0709 13:09:24.555105 (+ 87031us) spinlock_profiling.cc:243] Waited 28.5 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:09:24.932923 (+377818us) raft_consensus.cc:1685] finished
0709 13:09:24.932943 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.933051 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28144,"prepare.queue_time_us":31025,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":49517,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":12019,"spinlock_wait_cycles":69303296,"thread_start_us":169261,"threads_started":2,"wal-append.queue_time_us":164946}
I20260709 13:09:24.968474 30474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 693) took 3057 ms. Trace:
I20260709 13:09:24.969306 30544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 1787) took 1090 ms. Trace:
I20260709 13:09:24.969822 30544 rpcz_store.cc:276] 0709 13:09:23.878581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.968353 (+1089772us) service_pool.cc:224] Handling call
0709 13:09:24.968715 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.968915 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:24.968951 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:24.969004 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:24.969048 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.969118 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.969232 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:24.951148  1319 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:24.968959 30474 rpcz_store.cc:276] 0709 13:09:21.911355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.911466 (+   111us) service_pool.cc:224] Handling call
0709 13:09:21.923100 (+ 11634us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:22.055595 (+132495us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:22.055635 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:22.055697 (+    62us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:22.055743 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.968212 (+2912469us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b540011dd54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:24.968274 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.968420 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":304176512}
I20260709 13:09:24.952392  1215 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:24.956470  1377 log.cc:927] Time spent T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:09:24.976217 30622 raft_consensus.cc:2393] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 8: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:24.958705  1288 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:24.976816 30548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 1786) took 1098 ms. Trace:
I20260709 13:09:24.961094 30546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43088 (request call id 1883) took 1221 ms. Trace:
I20260709 13:09:24.977209 30548 rpcz_store.cc:276] 0709 13:09:23.878293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.976082 (+1097789us) service_pool.cc:224] Handling call
0709 13:09:24.976376 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.976536 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:24.976559 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:24.976598 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:24.976625 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.976680 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.976768 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:24.977308 30546 rpcz_store.cc:276] 0709 13:09:23.739898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.508284 (+768386us) service_pool.cc:224] Handling call
0709 13:09:24.508579 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:24.508906 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:24.508931 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:24.515751 (+  6820us) log.cc:844] Serialized 26 byte log entry
0709 13:09:24.885907 (+370156us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:24.885961 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.886028 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:24.960881 (+ 74853us) raft_consensus.cc:1685] finished
0709 13:09:24.960905 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.961034 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2312,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":2499,"thread_start_us":353768,"threads_started":1,"wal-append.queue_time_us":415618}
I20260709 13:09:24.978943 30548 raft_consensus.cc:1275] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:09:24.979887  1281 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:09:24.967587  1300 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:24.980046  1376 log.cc:927] Time spent T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:09:24.981896 30544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 1790) took 1102 ms. Trace:
I20260709 13:09:24.981803 30543 raft_consensus.cc:1240] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:09:24.930244   958 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.985425 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:24.986207 30543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 645) took 1206 ms. Trace:
I20260709 13:09:24.988720 30543 rpcz_store.cc:276] 0709 13:09:23.780098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.836089 (+1055991us) service_pool.cc:224] Handling call
0709 13:09:24.981304 (+145215us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b5800028598. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780e43b71 00007fc780e43a22 00007fc789d5cc09 00007fc788eb6ee0 00007fc788f800ab 00007fc788f80131 00007fc788f41fc0 00007fc788f2c929 00007fc788f2c3d2 00007fc7824a3bd4
0709 13:09:24.981518 (+   214us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:24.985967 (+  4449us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.986155 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3958656}
I20260709 13:09:24.979563 30546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 646) took 1024 ms. Trace:
I20260709 13:09:24.985841 30544 rpcz_store.cc:276] 0709 13:09:23.879483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.970963 (+1091480us) service_pool.cc:224] Handling call
0709 13:09:24.971315 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.971536 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:24.971573 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:24.971623 (+    50us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:24.971665 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.971732 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.981842 (+ 10110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:24.989488 30546 rpcz_store.cc:276] 0709 13:09:23.954765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.978900 (+1024135us) service_pool.cc:224] Handling call
0709 13:09:24.979152 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.979299 (+   147us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:24.979320 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:24.979368 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:24.979396 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.979442 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.979522 (+    80us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:24.979449 30548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 1791) took 1099 ms. Trace:
I20260709 13:09:24.992496 30548 rpcz_store.cc:276] 0709 13:09:23.879760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.978405 (+1098645us) service_pool.cc:224] Handling call
0709 13:09:24.978654 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.979252 (+   598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.979405 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:24.997874 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:25.004029 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 56130.7us
I20260709 13:09:25.014568 30621 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 7.
I20260709 13:09:24.985441  1215 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:09:25.047775 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 220458us
I20260709 13:09:25.008395  1174 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.031272  1164 consensus_queue.cc:1059] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:09:25.009667   958 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:25.092464 30591 leader_election.cc:304] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:25.048300  1240 consensus_queue.cc:1048] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:09:25.085160  1050 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:25.097714 30591 leader_election.cc:304] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:25.100075 30619 raft_consensus.cc:1275] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:09:25.099536  1051 raft_consensus.cc:2749] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:25.104000 30591 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:25.082657   819 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:25.106215 30591 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:25.107394 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:25.107621 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:25.108565 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:25.109018 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:25.109541 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:25.085609  1174 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:25.110718 30474 raft_consensus.cc:3060] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:25.111495 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:25.111500 30591 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:25.113147 30475 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
I20260709 13:09:25.114095 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:09:25.117295 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 317427us
I20260709 13:09:25.123502 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:25.123842 30618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 662) took 2813 ms. Trace:
I20260709 13:09:25.124071 30473 raft_consensus.cc:3060] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:25.123132 31115 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:25.128382 31115 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:25.124223 30618 rpcz_store.cc:276] 0709 13:09:22.310316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.310419 (+   103us) service_pool.cc:224] Handling call
0709 13:09:22.310748 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:22.742628 (+431880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.123609 (+2380981us) spinlock_profiling.cc:243] Waited 430 ms on lock 0x7b54001d9054. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:25.123761 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":988645120}
I20260709 13:09:25.131987  1313 raft_consensus.cc:2749] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:25.132670  1313 raft_consensus.cc:2749] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:25.132810   944 consensus_queue.cc:1059] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:25.134068  1313 raft_consensus.cc:3055] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:25.133955   944 consensus_queue.cc:1059] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:25.134454  1313 raft_consensus.cc:740] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:25.135056  1108 raft_consensus.cc:3055] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:25.135473  1108 raft_consensus.cc:740] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:25.136371  1108 consensus_queue.cc:260] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:25.139217 30476 raft_consensus.cc:2468] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 8.
I20260709 13:09:25.142612 30474 raft_consensus.cc:1275] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:25.111096  1050 raft_consensus.cc:2749] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:25.144591 30591 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:25.113126  1164 raft_consensus.cc:2804] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:25.113767  1045 raft_consensus.cc:2804] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:25.145576 31146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48412 (request call id 614) took 2040 ms. Trace:
I20260709 13:09:25.148622 30591 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:25.153324 30473 raft_consensus.cc:2468] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 8.
I20260709 13:09:25.122448  1051 raft_consensus.cc:2749] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:25.148070 31146 rpcz_store.cc:276] 0709 13:09:23.104729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.105449 (+   720us) service_pool.cc:224] Handling call
0709 13:09:23.105808 (+   359us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:23.108226 (+  2418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:23.108268 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:23.114713 (+  6445us) log.cc:844] Serialized 52 byte log entry
0709 13:09:23.477707 (+362994us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:23.513267 (+ 35560us) log.cc:844] Serialized 14 byte log entry
0709 13:09:23.534055 (+ 20788us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.534125 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:25.136196 (+1602071us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b180018c6a0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e7b3f3 00007fc780e7d7c1 00007fc780e7d779 00007fc780e7d709 00007fc780e7d6d1 00007fc780e7c9cd 000000000038f354 000000000038f199 00007fc780e5e83a
0709 13:09:25.138370 (+  2174us) raft_consensus.cc:1685] finished
0709 13:09:25.145328 (+  6958us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:25.145503 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10162,"prepare.queue_time_us":106009,"prepare.run_cpu_time_us":446,"prepare.run_wall_time_us":653,"raft.queue_time_us":3635,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":10572,"spinlock_wait_cycles":6585600,"thread_start_us":355549,"threads_started":2,"wal-append.queue_time_us":401632}
I20260709 13:09:25.168089 30591 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:25.164888 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:25.171175 30475 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 11.
I20260709 13:09:25.153820  1164 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:25.178113  1164 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:25.178517  1050 raft_consensus.cc:2804] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:25.179075  1050 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:25.179525  1050 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:25.179956  1380 log.cc:927] Time spent T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
W20260709 13:09:25.180315  1381 log.cc:927] Time spent T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:09:25.161628  1347 raft_consensus.cc:2749] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:25.183429  1174 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:25.170586 31115 leader_election.cc:304] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:25.143671  1241 consensus_queue.cc:1048] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:09:25.135241  1313 consensus_queue.cc:260] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:25.201030   870 raft_consensus.cc:2749] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:25.293663   958 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:25.173879  1045 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:09:25.302770 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 132241us
I20260709 13:09:25.314980 31149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48414 (request call id 779) took 3448 ms. Trace:
I20260709 13:09:25.300573 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:09:25.290449  1382 log.cc:927] Time spent T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.303s	user 0.001s	sys 0.000s
I20260709 13:09:25.174683   973 consensus_queue.cc:1048] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.130s
I20260709 13:09:25.315943 31149 rpcz_store.cc:276] 0709 13:09:21.866203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.866370 (+   167us) service_pool.cc:224] Handling call
0709 13:09:21.866781 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:21.867045 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:25.165977 (+3298932us) spinlock_profiling.cc:243] Waited 3.84 ms on lock 0x7b1800278860. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc783b104bc 00007fc780e5e48b 00007fc789cb8ab9 00007fc780e7a69b 00007fc780e7893f 00007fc780e78455 00007fc7879603c7 00007fc783f729a7 00007fc783f820bf
0709 13:09:25.166152 (+   175us) log.cc:844] Serialized 14 byte log entry
0709 13:09:25.314393 (+148241us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:25.314470 (+    77us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:25.314515 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.314763 (+   248us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:25.314911 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":464266,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":58,"raft.queue_time_us":151,"spinlock_wait_cycles":8833920,"thread_start_us":664525,"threads_started":2}
I20260709 13:09:25.176926  1392 raft_consensus.cc:2749] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:25.331476  1164 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:25.334721  1313 raft_consensus.cc:3060] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:25.334950 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:25.335707 30472 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 9
W20260709 13:09:25.326884 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.303504  1395 raft_consensus.cc:2804] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:25.314633  1092 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:25.328590 30542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 644) took 1557 ms. Trace:
I20260709 13:09:25.340251 30542 rpcz_store.cc:276] 0709 13:09:23.771337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.551693 (+780356us) service_pool.cc:224] Handling call
0709 13:09:24.552014 (+   321us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:24.552348 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:24.552374 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:24.552896 (+   522us) log.cc:844] Serialized 52 byte log entry
0709 13:09:24.859195 (+306299us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:24.859248 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.859337 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:25.328365 (+469028us) raft_consensus.cc:1685] finished
0709 13:09:25.328398 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:25.328536 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18747,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"thread_start_us":305980,"threads_started":1,"wal-append.queue_time_us":465697}
I20260709 13:09:25.328924   819 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:25.316592  1045 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:25.342396 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
W20260709 13:09:25.347054 30516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.342301  1092 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:25.355369  1092 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:25.358278 30619 raft_consensus.cc:1240] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 9. Current term is 10. Ops: []
W20260709 13:09:25.358644 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.359865  1164 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:25.361629 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:25.338708  1395 raft_consensus.cc:493] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:25.376156 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:25.388923 30625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36130 (request call id 1795) took 1238 ms. Trace:
I20260709 13:09:25.390374 30625 rpcz_store.cc:276] 0709 13:09:24.145938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.244409 (+ 98471us) service_pool.cc:224] Handling call
0709 13:09:25.361464 (+1117055us) spinlock_profiling.cc:243] Waited 1.81 ms on lock 0x7b58001a3198. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780e43b71 00007fc780e43a22 00007fc789d5cc09 00007fc788eb6ee0 00007fc788f800ab 00007fc788f80131 00007fc788f2e0a0 00007fc788f2d984 00007fc7824a86d4 00007fc7824a8662
0709 13:09:25.384671 (+ 23207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4169088}
I20260709 13:09:25.393525 30472 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
I20260709 13:09:25.393008 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:25.388835  1395 raft_consensus.cc:3060] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:25.398830 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:25.388140  1281 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.373450  1229 raft_consensus.cc:493] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:25.430344 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:25.430735 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:25.391510  1169 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.433025 30625 raft_consensus.cc:2393] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 9: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:25.434459 30623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57140 (request call id 669) took 1141 ms. Trace:
W20260709 13:09:25.434599 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 119448us
I20260709 13:09:25.434866 30623 rpcz_store.cc:276] 0709 13:09:24.293498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.434265 (+140767us) service_pool.cc:224] Handling call
0709 13:09:25.430166 (+995901us) spinlock_profiling.cc:243] Waited 4.38 ms on lock 0x7b58001a3198. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780e43b71 00007fc780e43a22 00007fc789d5cc09 00007fc788eb6ee0 00007fc788f800ab 00007fc788f80131 00007fc788f2e0a0 00007fc788f2d984 00007fc7824a86d4 00007fc7824a8662
0709 13:09:25.434397 (+  4231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10064640}
I20260709 13:09:25.389178  1092 consensus_queue.cc:1059] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:09:25.437685 31115 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:25.438814 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:25.439566 30625 raft_consensus.cc:2468] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 6.
I20260709 13:09:25.441183 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:25.442140 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:25.443150 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:25.444116 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:25.444589 30625 raft_consensus.cc:2468] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 8.
I20260709 13:09:25.445066 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:09:25.433620  1342 consensus_meta.cc:287] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.597s	user 0.010s	sys 0.003s
I20260709 13:09:25.449313 30625 raft_consensus.cc:1240] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:09:25.446906 30623 raft_consensus.cc:1275] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:25.453575  1406 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.453655 30517 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:25.452270  1272 consensus_meta.cc:287] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.563s	user 0.011s	sys 0.000s
I20260709 13:09:25.435184  1229 raft_consensus.cc:515] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:25.436662  1169 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:25.456627  1342 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:25.481794  1092 raft_consensus.cc:2749] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:25.433549  1281 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:25.496696 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 59091.7us
I20260709 13:09:25.497622 31115 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:25.464423  1065 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:25.454473  1406 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:25.504451 31115 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:09:25.480841  1272 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:25.510766  1169 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:25.534010  1169 raft_consensus.cc:2749] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:25.511243  1313 raft_consensus.cc:2804] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:25.534536  1065 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:25.534688  1313 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:25.517028  1357 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:25.535090  1272 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:25.535323  1357 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:25.536055 30622 raft_consensus.cc:1240] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:25.522126 30550 raft_consensus.cc:3060] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:25.508157  1393 log.cc:927] Time spent T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:09:25.537431  1357 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:25.538192 31142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48426 (request call id 694) took 2444 ms. Trace:
I20260709 13:09:25.523298  1050 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:25.538203 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:25.538549 31142 rpcz_store.cc:276] 0709 13:09:23.093856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.094823 (+   967us) service_pool.cc:224] Handling call
0709 13:09:23.113952 (+ 19129us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.391023 (+1277071us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.537997 (+1146974us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54000ad7d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:25.538139 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2462022912}
I20260709 13:09:25.480582  1045 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:25.540418  1050 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:25.543136 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:25.543655 30471 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:25.526224  1406 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:25.506322  1294 raft_consensus.cc:2804] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:25.544310  1294 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:25.544680  1294 raft_consensus.cc:3060] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:25.545604 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:09:25.546320 30617 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36130 (request call id 1797) took 1305 ms (client timeout 1645 ms). Trace:
I20260709 13:09:25.528990 31143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48412 (request call id 617) took 1816 ms. Trace:
W20260709 13:09:25.531418  1300 consensus_meta.cc:287] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.546s	user 0.005s	sys 0.004s
W20260709 13:09:25.532033  1346 consensus_meta.cc:287] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.598s	user 0.006s	sys 0.007s
I20260709 13:09:25.492136  1342 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:25.533208  1281 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:25.523739  1229 leader_election.cc:290] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:25.548890 30516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.550477 30471 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
W20260709 13:09:25.546689 30617 rpcz_store.cc:269] 0709 13:09:24.240810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.407664 (+166854us) service_pool.cc:224] Handling call
0709 13:09:25.545467 (+1137803us) spinlock_profiling.cc:243] Waited 6.06 ms on lock 0x7b58001a3198. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780e43b71 00007fc780e43a22 00007fc789d5cc09 00007fc788eb6ee0 00007fc788f800ab 00007fc788f80131 00007fc788f2e0a0 00007fc788f2d984 00007fc7824a86d4 00007fc7824a8662
0709 13:09:25.546266 (+   799us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13946752}
I20260709 13:09:25.557282 30550 raft_consensus.cc:1275] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:25.547745 31143 rpcz_store.cc:276] 0709 13:09:23.712226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.716882 (+  4656us) service_pool.cc:224] Handling call
0709 13:09:23.717098 (+   216us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.500060 (+782962us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.528747 (+1028687us) spinlock_profiling.cc:243] Waited 757 ms on lock 0x7b54005749d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:25.528931 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1741905280}
I20260709 13:09:25.552608 30591 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:25.563925 30591 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:25.567075 30550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 1780) took 2511 ms. Trace:
I20260709 13:09:25.567652 30550 rpcz_store.cc:276] 0709 13:09:23.055573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.055994 (+   421us) service_pool.cc:224] Handling call
0709 13:09:23.056241 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:25.521902 (+2465661us) spinlock_profiling.cc:243] Waited 739 ms on lock 0x7b58005234d0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783ec40aa 00007fc783f46447 00007fc783f5efe7 00007fc783f607de 00007fc783f6ab49 00007fc783f6b416 00007fc783f67d8f 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4
0709 13:09:25.565584 (+ 43682us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.567007 (+  1423us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1699980672}
I20260709 13:09:25.571596 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:25.572465 30550 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:09:25.574060 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:25.575027 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:25.576642 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:25.535086  1313 raft_consensus.cc:3060] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:25.577183 30543 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:25.575791 30544 raft_consensus.cc:2468] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 7.
I20260709 13:09:25.589761 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:25.589848 30591 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:25.580619 31144 raft_consensus.cc:2468] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:09:25.588058 30549 raft_consensus.cc:3055] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:25.591555 30549 raft_consensus.cc:740] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:25.604254 30550 raft_consensus.cc:2468] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 11.
W20260709 13:09:25.626665 30440 connection.cc:256] RPC call timeout handler was delayed by -2.3585715820000814s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16040000000000001s for a response
I20260709 13:09:25.625257 30591 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:25.628754 30440 connection.cc:256] RPC call timeout handler was delayed by -2.107783239000014s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1613s for a response
W20260709 13:09:25.629379 30440 connection.cc:256] RPC call timeout handler was delayed by -2.0378426919999129s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1513s for a response
W20260709 13:09:25.629860 30440 connection.cc:256] RPC call timeout handler was delayed by -1.7963832389999652s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19590000000000002s for a response
W20260709 13:09:25.630471 30440 connection.cc:256] RPC call timeout handler was delayed by -1.7153720740000153s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1583s for a response
W20260709 13:09:25.630921 30440 connection.cc:256] RPC call timeout handler was delayed by -1.6850426919999109s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1905s for a response
W20260709 13:09:25.631304 30440 connection.cc:256] RPC call timeout handler was delayed by -1.6134027400000832s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16100000000000003s for a response
I20260709 13:09:25.565919  1336 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.636494 30543 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 10.
W20260709 13:09:25.631718 30440 connection.cc:256] RPC call timeout handler was delayed by -1.5701808370000663s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1765s for a response
W20260709 13:09:25.637444 30440 connection.cc:256] RPC call timeout handler was delayed by -1.3535890439999321s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2069s for a response
W20260709 13:09:25.637885 30440 connection.cc:256] RPC call timeout handler was delayed by -1.2821086200000309s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2089s for a response
W20260709 13:09:25.638358 30440 connection.cc:256] RPC call timeout handler was delayed by -1.183984778000081s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22340000000000002s for a response
I20260709 13:09:25.639680 30440 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:25.627663 30549 consensus_queue.cc:260] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:25.641278 30549 raft_consensus.cc:3060] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:25.588362  1229 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.588228  1296 raft_consensus.cc:2804] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:25.561427  1272 consensus_queue.cc:1048] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:09:25.601861  1058 raft_consensus.cc:2804] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:25.656452 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:25.624723  1347 raft_consensus.cc:2804] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:25.658233 31114 leader_election.cc:304] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:25.602229  1319 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:25.651157 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 197617us
I20260709 13:09:25.659359 31114 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:25.659684 30517 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:25.561333  1346 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:25.655507 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:25.656255 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:25.656700 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:25.660179 31114 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:25.660897 30517 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:25.645993  1243 raft_consensus.cc:2804] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:25.649950  1357 raft_consensus.cc:2749] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:25.668782  1414 consensus_queue.cc:1048] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:09:25.654103  1229 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:25.676095  1289 raft_consensus.cc:2804] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:25.676316  1229 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:25.671319 30517 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:25.668780 30440 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:25.660802  1058 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:25.682092 30517 leader_election.cc:304] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:25.684597 30517 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:25.664590  1281 raft_consensus.cc:2749] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:25.661274   973 raft_consensus.cc:2749] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:25.641641  1336 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:25.664348  1296 raft_consensus.cc:697] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:25.686692 30517 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:25.687086 30440 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:25.686105  1058 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:25.668923  1300 raft_consensus.cc:2804] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:25.677120  1347 raft_consensus.cc:697] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:25.707326 30549 raft_consensus.cc:1275] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:09:25.712823 30517 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:25.686990  1229 raft_consensus.cc:2804] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:25.725643 30517 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:25.686007  1341 raft_consensus.cc:2764] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:09:25.685999  1406 raft_consensus.cc:2749] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:25.714866  1243 raft_consensus.cc:697] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:25.685878  1410 raft_consensus.cc:2749] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:25.731864  1169 raft_consensus.cc:2804] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:25.669689  1319 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:25.737215  1243 consensus_queue.cc:237] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:25.711884  1300 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:25.740965  1294 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:25.724944  1281 raft_consensus.cc:2804] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:09:25.749224 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 63501.1us
I20260709 13:09:25.764410 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:25.749534 31114 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:25.769420 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:25.770172 30619 raft_consensus.cc:3060] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:25.750478 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:09:25.751050 30516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.773017 30516 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:25.751601 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:25.753304 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:25.774911 30549 raft_consensus.cc:3060] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:25.726094  1229 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:25.682366  1395 raft_consensus.cc:515] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:25.754597 30543 raft_consensus.cc:1275] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:09:25.755582 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:25.730309  1176 raft_consensus.cc:2749] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:25.757560 31113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.749013  1169 raft_consensus.cc:697] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 7 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
W20260709 13:09:25.785689 31113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:25.786118 31113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.786437 30622 raft_consensus.cc:1240] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 LEADER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:25.788196 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:25.791988 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:25.792174 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:25.793296 31146 raft_consensus.cc:2410] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:09:25.784370 30516 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:25.794818  1341 raft_consensus.cc:2804] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:25.795347  1341 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:25.795833  1341 raft_consensus.cc:3060] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:25.800765 30549 raft_consensus.cc:2468] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 8.
I20260709 13:09:25.803243 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:25.805167 30549 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:25.805011 30516 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:25.760586  1300 raft_consensus.cc:3060] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:25.789044 31143 raft_consensus.cc:2468] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
I20260709 13:09:25.812557 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:25.826762 30549 raft_consensus.cc:2410] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 13:09:25.819902 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 89866.9us
I20260709 13:09:25.766654  1357 raft_consensus.cc:2804] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:25.752554  1406 consensus_queue.cc:1059] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:09:25.892300 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:25.896781 30544 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:25.890913 30517 leader_election.cc:304] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:25.892922 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:25.768118  1289 raft_consensus.cc:697] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 11 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:25.900857 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:25.901686 31148 raft_consensus.cc:2393] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 8: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:25.766644  1392 consensus_queue.cc:1048] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.130s
I20260709 13:09:25.762197  1281 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:25.907737 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:25.911937 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:25.912942 30549 raft_consensus.cc:2468] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 8.
I20260709 13:09:25.808111  1342 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:25.895638  1176 raft_consensus.cc:2749] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:25.895898  1357 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:25.790457  1410 raft_consensus.cc:2749] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:25.915470 30619 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9.
I20260709 13:09:25.790570  1229 raft_consensus.cc:3060] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:25.790279   973 raft_consensus.cc:2804] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:25.925966 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:25.910055  1418 consensus_queue.cc:1048] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:09:25.937814 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:25.928340 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:25.929580 31150 raft_consensus.cc:2393] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 7: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:25.807919  1296 consensus_queue.cc:237] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:25.940609 30544 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
I20260709 13:09:25.790024  1092 consensus_queue.cc:1048] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.132s
I20260709 13:09:25.944288 30549 raft_consensus.cc:1240] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:25.939296 30516 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:25.958402 31147 raft_consensus.cc:1240] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:25.931945  1169 consensus_queue.cc:237] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:25.960807  1417 log.cc:927] Time spent T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
I20260709 13:09:25.915432  1281 raft_consensus.cc:3060] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:25.923202  1421 raft_consensus.cc:2749] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:25.965366 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:25.923553  1357 raft_consensus.cc:3060] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:25.899912 31146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "265fc568d5674c78833106e4eda814f4"
dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
mode: GRACEFUL
new_leader_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:42956
I20260709 13:09:25.989323 31146 raft_consensus.cc:606] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Received request to transfer leadership to TS f639301059e24dc5b0d88a46dc683326
I20260709 13:09:25.989856 31146 raft_consensus.cc:614] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:25.928807  1423 raft_consensus.cc:2749] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:25.890403  1347 consensus_queue.cc:237] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:25.980089   973 raft_consensus.cc:697] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 10 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:25.925988  1406 consensus_queue.cc:1048] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.054s
W20260709 13:09:25.999027 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 88131.8us
I20260709 13:09:26.000191 30517 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:25.981276  1410 raft_consensus.cc:2804] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:26.001688 30517 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:26.002508   973 consensus_queue.cc:237] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:26.006764  1108 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:26.009888  1294 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:26.018050 31142 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 9.
I20260709 13:09:26.022948  1229 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:26.024266  1304 raft_consensus.cc:3055] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:26.024700  1304 raft_consensus.cc:740] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
W20260709 13:09:26.018180 30468 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60026 (request call id 700) took 3032 ms (client timeout 1893 ms). Trace:
I20260709 13:09:25.986861  1346 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:26.030421 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:26.028035 30468 rpcz_store.cc:269] 0709 13:09:22.985947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.987041 (+  1094us) service_pool.cc:224] Handling call
0709 13:09:26.017956 (+3030915us) spinlock_profiling.cc:243] Waited 36.5 ms on lock 0x7b54001225d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:26.018077 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83854720}
I20260709 13:09:26.030676 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:26.039891 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:26.040585 30549 raft_consensus.cc:2393] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 8: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:26.044219 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:26.038268 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:26.031941 31116 connection.cc:256] RPC call timeout handler was delayed by -1.3245939419999786s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18930000000000002s for a response
I20260709 13:09:26.045475 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:26.046356 30549 raft_consensus.cc:2468] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
I20260709 13:09:26.046986 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:25.982082  1065 consensus_queue.cc:1048] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:09:26.047748 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:25.986999  1418 consensus_queue.cc:1059] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:09:26.053261 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:26.029999  1421 raft_consensus.cc:2749] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:26.055214 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:26.057042 30549 raft_consensus.cc:2393] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 11: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:26.044477  1420 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.026641  1410 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:26.039958  1408 raft_consensus.cc:2749] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:26.063313 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 299419us
I20260709 13:09:26.076992 30441 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:26.078939 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:26.079948 30544 raft_consensus.cc:2410] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:09:26.080219 30441 leader_election.cc:304] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:26.051298  1253 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.084630 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:25.987216  1289 consensus_queue.cc:237] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:26.085305  1423 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:26.062808  1410 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:26.086925 30619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c"
dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
mode: GRACEFUL
new_leader_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:49382
I20260709 13:09:26.098119 30619 raft_consensus.cc:606] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 LEADER]: Received request to transfer leadership to TS f639301059e24dc5b0d88a46dc683326
I20260709 13:09:26.085685  1367 raft_consensus.cc:2749] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:26.051421  1275 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.089864 30622 raft_consensus.cc:3060] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:26.025557  1304 consensus_queue.cc:260] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:26.051283  1407 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.051085  1411 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:09:26.112273 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 425207us
I20260709 13:09:26.113454 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:26.113961 30440 leader_election.cc:400] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 7. Current term is 8.
I20260709 13:09:26.114506 30440 leader_election.cc:403] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:26.112124  1275 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:26.129043 30516 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:26.077965  1420 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:26.133539 30516 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:26.134263  1421 raft_consensus.cc:2749] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:26.100595  1395 leader_election.cc:290] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:26.136487 30516 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:26.147874  1434 consensus_queue.cc:1059] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:09:26.148844  1434 raft_consensus.cc:2749] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 7. Current term is 8.
I20260709 13:09:26.149510  1434 raft_consensus.cc:3055] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:26.149883  1434 raft_consensus.cc:740] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:26.150657  1434 consensus_queue.cc:260] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:26.152242  1058 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:26.153430 30620 raft_consensus.cc:1240] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 10. Current term is 12. Ops: [10.6-10.6]
I20260709 13:09:26.090392  1428 consensus_queue.cc:1059] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:09:26.154917  1428 raft_consensus.cc:3055] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:26.155274  1428 raft_consensus.cc:740] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:26.156106  1428 consensus_queue.cc:260] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:26.157305  1428 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:26.158686  1304 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:26.134817  1281 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:26.160921 30622 raft_consensus.cc:2468] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 7.
I20260709 13:09:26.097239  1253 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:26.121280  1407 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:26.116112  1341 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:26.116364  1427 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:26.112583  1411 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:26.136258  1169 consensus_queue.cc:1048] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:09:26.134900  1421 raft_consensus.cc:2749] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:26.097090  1418 consensus_queue.cc:1059] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:09:26.207324  1418 raft_consensus.cc:3055] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:26.207680  1418 raft_consensus.cc:740] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:26.208873  1418 consensus_queue.cc:260] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:26.209954  1418 raft_consensus.cc:3060] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:26.213714 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:26.175806 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:26.216295 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:26.216641  1198 raft_consensus.cc:3055] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:26.216888 31146 raft_consensus.cc:3060] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:26.217181  1198 raft_consensus.cc:740] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:26.218051  1198 consensus_queue.cc:260] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:26.219244  1198 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:26.159574  1410 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:26.221324  1300 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:26.221839  1410 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:26.179392  1058 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:09:26.222259 31144 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48414 (request call id 783) took 3064 ms (client timeout 1821 ms). Trace:
I20260709 13:09:26.222380 31148 raft_consensus.cc:1240] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 7. Current term is 8. Ops: []
W20260709 13:09:26.222673 31144 rpcz_store.cc:269] 0709 13:09:23.157658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.157777 (+   119us) service_pool.cc:224] Handling call
0709 13:09:26.222069 (+3064292us) spinlock_profiling.cc:243] Waited 2.4 s on lock 0x7b54006338d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:26.222167 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5514739584}
I20260709 13:09:26.176692 31115 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:26.135859  1313 consensus_meta.cc:287] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.502s	user 0.008s	sys 0.002s
I20260709 13:09:26.178260 30622 raft_consensus.cc:1240] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 6. Current term is 7. Ops: []
W20260709 13:09:26.223894 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 47321.7us
I20260709 13:09:26.169193  1434 raft_consensus.cc:3060] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:26.189345  1281 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:26.193290  1433 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.194757  1253 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:26.135500  1435 consensus_queue.cc:1059] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 13:09:26.194985  1242 leader_election.cc:290] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:26.191567  1427 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:26.197680  1411 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:26.244230  1435 raft_consensus.cc:3055] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:26.244678  1435 raft_consensus.cc:740] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:26.198360 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:26.245889 30550 raft_consensus.cc:2410] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:09:26.199509 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:26.201045  1341 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:26.202220 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.202618  1407 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:26.202435  1346 consensus_queue.cc:1048] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:26.204241 30589 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:26.255611 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 51438.8us
I20260709 13:09:26.204473 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:26.256291 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:26.256701 30542 raft_consensus.cc:2393] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 8: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:26.205441 30623 raft_consensus.cc:1240] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:09:26.168905  1408 raft_consensus.cc:2749] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:26.225310 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 89638.2us
I20260709 13:09:26.258297 30543 raft_consensus.cc:1240] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:26.225575 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:26.259068 31149 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:26.190795 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:09:26.226788 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 166356us
I20260709 13:09:26.259933 30549 raft_consensus.cc:1240] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:26.163563  1357 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:26.238664  1431 raft_consensus.cc:2804] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:26.263294 30589 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:09:26.248298 31146 raft_consensus.cc:2468] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 6.
I20260709 13:09:26.249838  1427 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:26.249358  1435 consensus_queue.cc:260] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:26.269882  1435 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:26.272882 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:26.273977  1357 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:26.274854  1357 consensus_queue.cc:1059] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:26.226642  1313 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:26.262130  1242 raft_consensus.cc:2804] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:26.237697  1433 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:26.258620 30441 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:26.261240 30542 raft_consensus.cc:1240] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:26.286018 31143 raft_consensus.cc:1240] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:09:26.323354 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:26.324047 31151 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:26.301192 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:26.262382 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:26.264997 30516 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
W20260709 13:09:26.294045 30441 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:26.325830 31113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.290598 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:26.322264 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:26.325320 30543 raft_consensus.cc:3060] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:26.327283 31144 raft_consensus.cc:1240] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:26.293705 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:26.301996 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:26.290866 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:26.345777 30469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 2202) took 2227 ms. Trace:
W20260709 13:09:26.347323 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 82409.2us
W20260709 13:09:26.348362 30516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.348074 30469 rpcz_store.cc:276] 0709 13:09:24.118274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.395538 (+277264us) service_pool.cc:224] Handling call
0709 13:09:24.395735 (+   197us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:24.445128 (+ 49393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:24.445165 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:24.451417 (+  6252us) log.cc:844] Serialized 26 byte log entry
0709 13:09:25.675787 (+1224370us) spinlock_profiling.cc:243] Waited 3.47 ms on lock 0x7b18001bd4e0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e5de07 00007fc789cb8ab9 00007fc780e7a69b 00007fc780e7893f 00007fc780e7ac02 00007fc783b0220b 00007fc783b07d23 00007fc783b080d1 00007fc783f23a0f
0709 13:09:25.723972 (+ 48185us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:25.724024 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.345335 (+621311us) spinlock_profiling.cc:243] Waited 49.1 ms on lock 0x7b54003c23d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:26.345415 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:26.345479 (+    64us) raft_consensus.cc:1685] finished
0709 13:09:26.345499 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:26.345695 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3598,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":3281,"spinlock_wait_cycles":120804096,"thread_start_us":47915,"threads_started":1,"wal-append.queue_time_us":1272574}
I20260709 13:09:26.352185 31144 raft_consensus.cc:1275] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:09:26.363611 31150 raft_consensus.cc:1275] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:09:26.378623 30542 raft_consensus.cc:1275] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:26.381527 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:26.382370 30549 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:26.280189  1431 raft_consensus.cc:697] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 7 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:26.275804  1357 consensus_queue.cc:1243] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer fe2b7d73f8c743c1ba570cfd981c4e79 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:09:26.403687 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:26.285753  1313 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:26.419548 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:26.286218  1242 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.346129  1245 raft_consensus.cc:2804] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:26.421829 30589 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:26.426538 31151 raft_consensus.cc:2468] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
I20260709 13:09:26.420326 31150 raft_consensus.cc:2376] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6. Re-sending same reply.
I20260709 13:09:26.385011  1320 raft_consensus.cc:2804] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:26.432220 31144 raft_consensus.cc:1240] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:09:26.428752 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:26.433494 31150 raft_consensus.cc:2393] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 7: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:26.416281 31149 raft_consensus.cc:2468] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 6.
I20260709 13:09:26.437244 31151 raft_consensus.cc:1275] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:26.443562 30516 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:26.445927 31149 raft_consensus.cc:1240] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 5. Current term is 6. Ops: []
W20260709 13:09:26.448360 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 334487us
I20260709 13:09:26.462469 30440 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:26.385450  1304 consensus_queue.cc:1059] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:09:26.424837  1242 raft_consensus.cc:3060] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:26.464243 31145 raft_consensus.cc:1275] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:09:26.425359  1357 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:26.468891 31145 pending_rounds.cc:85] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6: Aborting all ops after (but not including) 7
I20260709 13:09:26.469161 31145 pending_rounds.cc:107] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:09:26.469404 31145 raft_consensus.cc:2889] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:26.467594 30440 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:26.475180 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:26.476260 31145 raft_consensus.cc:2468] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 8.
I20260709 13:09:26.424050  1058 consensus_queue.cc:1059] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:09:26.481372 30440 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:26.447664  1245 raft_consensus.cc:697] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:26.463984  1166 raft_consensus.cc:2749] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:26.497702 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:09:26.504880 31116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.478037  1341 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:26.441461  1051 consensus_queue.cc:1059] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:09:26.509438 30440 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:26.472940  1320 raft_consensus.cc:697] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 6 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:26.467887  1222 consensus_queue.cc:1048] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:09:26.495134  1427 raft_consensus.cc:2804] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:09:26.568630 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.482446  1443 raft_consensus.cc:2749] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:26.495412  1410 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.480212  1357 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:26.572665 30470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 710) took 2526 ms. Trace:
I20260709 13:09:26.509092  1300 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:26.512087   975 raft_consensus.cc:2749] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:26.583954  1444 raft_consensus.cc:2749] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:26.580968 30470 rpcz_store.cc:276] 0709 13:09:24.046260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.393307 (+347047us) service_pool.cc:224] Handling call
0709 13:09:24.393670 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.510350 (+116680us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:24.510378 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:24.510414 (+    36us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:24.510439 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.572383 (+2061944us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54002170d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:26.572449 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:26.572600 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":267875072}
I20260709 13:09:26.590941 30543 raft_consensus.cc:2468] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
I20260709 13:09:26.534026  1166 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.593250 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:26.598984 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 374323us
I20260709 13:09:26.610015 30547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 636) took 3247 ms. Trace:
I20260709 13:09:26.610565 30547 rpcz_store.cc:276] 0709 13:09:23.362097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.364524 (+  2427us) service_pool.cc:224] Handling call
0709 13:09:23.974702 (+610178us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.134064 (+159362us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.609762 (+2475698us) spinlock_profiling.cc:243] Waited 609 ms on lock 0x7b5400358250. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f678ad 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:26.609937 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1401709312}
I20260709 13:09:26.613297  1357 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:26.616717 30546 raft_consensus.cc:1240] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 8. Current term is 9. Ops: []
W20260709 13:09:26.616647 30545 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39952 (request call id 1793) took 2510 ms (client timeout 1852 ms). Trace:
W20260709 13:09:26.617905 30545 rpcz_store.cc:269] 0709 13:09:24.105789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.307215 (+201426us) service_pool.cc:224] Handling call
0709 13:09:26.616395 (+2309180us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b5400257bd4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:26.616537 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":294872960}
I20260709 13:09:26.618618  1237 raft_consensus.cc:3055] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:26.528221  1238 consensus_queue.cc:1059] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.172s
I20260709 13:09:26.619973  1238 raft_consensus.cc:3055] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:26.620322  1238 raft_consensus.cc:740] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:26.620700  1408 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:26.621038  1238 consensus_queue.cc:260] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:26.514822  1341 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:26.619115  1237 raft_consensus.cc:740] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:26.580185  1427 raft_consensus.cc:697] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 6 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:26.574589  1433 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:26.594637  1362 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.638316 30549 raft_consensus.cc:2410] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:09:26.641268 30623 raft_consensus.cc:1240] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 LEADER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:26.583532  1410 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:26.636014  1438 log.cc:927] Time spent T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:09:26.431736  1431 consensus_queue.cc:237] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:26.656896 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 147553us
I20260709 13:09:26.602219  1425 raft_consensus.cc:2804] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:26.601176  1256 raft_consensus.cc:2749] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:26.621338  1408 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:26.602070  1166 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:26.674068 30623 raft_consensus.cc:1275] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:26.661537  1238 raft_consensus.cc:3060] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:26.687450 30440 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:26.653002  1304 consensus_queue.cc:1059] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:09:26.645977  1411 consensus_queue.cc:1059] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:09:26.695514  1304 consensus_queue.cc:1243] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer fe2b7d73f8c743c1ba570cfd981c4e79 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:09:26.695634  1411 raft_consensus.cc:3055] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:26.696126  1304 raft_consensus.cc:3055] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:26.696492  1304 raft_consensus.cc:740] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:26.697335  1304 consensus_queue.cc:260] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:26.698485  1304 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:26.644161  1245 consensus_queue.cc:237] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:26.691155 30440 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:26.644470  1362 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:26.706701 30440 leader_election.cc:304] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:26.674914  1425 raft_consensus.cc:697] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 9 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:26.714144 30440 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:26.711724  1449 log.cc:927] Time spent T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
I20260709 13:09:26.705317  1198 raft_consensus.cc:2749] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:26.724970 30517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.721529 30440 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:26.729997 30440 leader_election.cc:304] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:26.731168 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.696133  1411 raft_consensus.cc:740] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:26.707453  1443 raft_consensus.cc:2749] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:26.761089  1166 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:26.761507  1443 raft_consensus.cc:2749] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:26.761852  1319 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:26.734054  1448 log.cc:927] Time spent T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:09:26.762226  1341 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:26.692157  1256 consensus_queue.cc:1059] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:09:26.764128  1362 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:26.764226 30621 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57140 (request call id 673) took 2200 ms (client timeout 1645 ms). Trace:
I20260709 13:09:26.764828 30624 raft_consensus.cc:1240] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 6. Current term is 7. Ops: []
W20260709 13:09:26.764797 30621 rpcz_store.cc:269] 0709 13:09:24.563657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.804610 (+240953us) service_pool.cc:224] Handling call
0709 13:09:26.763996 (+1959386us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b5400163fd4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:26.764136 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":231538432}
I20260709 13:09:26.766317 30624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36130 (request call id 1810) took 2001 ms. Trace:
I20260709 13:09:26.766517 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:26.766642 30624 rpcz_store.cc:276] 0709 13:09:24.764563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.989807 (+225244us) service_pool.cc:224] Handling call
0709 13:09:26.764672 (+1774865us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:26.765399 (+   727us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.766143 (+   744us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b5400163fd0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f678ad 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:26.766264 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4081098496}
I20260709 13:09:26.676838  1237 consensus_queue.cc:260] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:26.693889  1427 consensus_queue.cc:237] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:26.691957  1281 consensus_queue.cc:1048] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:09:26.736487 30618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:36118 (request call id 85) took 1823 ms. Trace:
I20260709 13:09:26.736749  1408 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:26.738668  1275 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:26.740643  1411 consensus_queue.cc:260] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:26.801801 30471 raft_consensus.cc:1275] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:09:26.747083   819 raft_consensus.cc:3055] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:26.802659   819 raft_consensus.cc:740] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:26.802985 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:26.748826  1418 raft_consensus.cc:3055] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:26.803799  1418 raft_consensus.cc:740] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:26.804122 30469 raft_consensus.cc:2410] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:26.804610  1418 consensus_queue.cc:260] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:26.805862  1418 raft_consensus.cc:3060] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:26.750044 30546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 650) took 1179 ms. Trace:
I20260709 13:09:26.808017 30546 rpcz_store.cc:276] 0709 13:09:25.571075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.571184 (+   109us) service_pool.cc:224] Handling call
0709 13:09:26.616536 (+1045352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:26.617351 (+   815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.749843 (+132492us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400257bd0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f678ad 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:26.749986 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2390987136}
I20260709 13:09:26.753798  1401 raft_consensus.cc:3055] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:26.809387  1401 raft_consensus.cc:740] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:26.754451  1420 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:26.810493 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:26.758244 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:26.803479   819 consensus_queue.cc:260] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:26.812458 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:26.813261 30623 raft_consensus.cc:2468] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 7.
I20260709 13:09:26.812482   819 raft_consensus.cc:3060] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:26.814255 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:26.815413  1372 raft_consensus.cc:493] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:09:26.728263  1423 consensus_meta.cc:287] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.616s	user 0.010s	sys 0.000s
I20260709 13:09:26.662300  1320 consensus_queue.cc:237] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:26.759160 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:26.759356  1357 raft_consensus.cc:2749] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:26.759761 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:26.759920 30440 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:26.760488 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:26.774446 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:26.767441 30621 raft_consensus.cc:2376] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 7. Re-sending same reply.
I20260709 13:09:26.768980 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:26.717499  1283 raft_consensus.cc:2804] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:26.787237 30618 rpcz_store.cc:276] 0709 13:09:24.913328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.132053 (+218725us) service_pool.cc:224] Handling call
0709 13:09:26.736204 (+1604151us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b54001e3f54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6e735 00007fc783f669fa 00007fc788f2e4c9 00007fc7824aac54 00007fc7824aabe2 00007fc7824aab11 00007fc7824aaa8c 00007fc7824a9d42 00007fc7822a348c 00007fc7822a28c6
0709 13:09:26.736411 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34774912}
I20260709 13:09:26.790874 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:26.721971   975 raft_consensus.cc:2749] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:26.792953  1425 consensus_queue.cc:237] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:26.794549  1435 consensus_meta.cc:287] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.524s	user 0.010s	sys 0.000s
I20260709 13:09:26.846185 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:26.846655 30619 raft_consensus.cc:2393] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 10: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:26.795258  1408 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.672397  1444 consensus_queue.cc:1048] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.115s
W20260709 13:09:26.798061 30517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.800748 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:26.847445 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:26.757148  1352 raft_consensus.cc:3055] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:09:26.733901  1201 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.038s	sys 0.055s
I20260709 13:09:26.834048 30546 raft_consensus.cc:1275] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:09:26.838126 30516 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:26.838253 31142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 704) took 1050 ms. Trace:
I20260709 13:09:26.845134 30551 raft_consensus.cc:2376] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9. Re-sending same reply.
W20260709 13:09:26.846017 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 86193.4us
I20260709 13:09:26.846894 30624 raft_consensus.cc:2468] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 11.
I20260709 13:09:26.856456 31142 rpcz_store.cc:276] 0709 13:09:25.787402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.789507 (+  2105us) service_pool.cc:224] Handling call
0709 13:09:26.838013 (+1048506us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b5400563e54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:26.838139 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":275206016}
I20260709 13:09:26.857138 30440 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:26.858297 30440 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:26.855078 31115 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:09:26.859315 30440 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:26.848273 30621 raft_consensus.cc:2410] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:09:26.850267 30542 raft_consensus.cc:2468] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
I20260709 13:09:26.852962 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:26.815516 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:26.865875 30623 raft_consensus.cc:3060] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:26.821676  1410 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:26.868347  1434 consensus_meta.cc:287] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.634s	user 0.008s	sys 0.002s
W20260709 13:09:26.855516  1201 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.038s	sys 0.056s
I20260709 13:09:26.862694  1435 raft_consensus.cc:2749] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:26.870316  1242 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:26.862335  1362 raft_consensus.cc:2804] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:26.871548  1362 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:26.871941  1362 raft_consensus.cc:3060] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:26.873164 31116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.874471 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:26.874948 30440 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:26.875276 30468 raft_consensus.cc:2468] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 7.
I20260709 13:09:26.876931 30616 raft_consensus.cc:2393] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 9: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:26.837328  1045 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:26.810442  1401 consensus_queue.cc:260] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:26.878244  1092 raft_consensus.cc:2804] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:26.897962   975 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:26.909897  1092 raft_consensus.cc:697] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 7 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:26.910825  1092 consensus_queue.cc:237] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:26.911267 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:26.912827 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:26.913941 30474 raft_consensus.cc:2410] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:09:26.916208 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:26.898343 30440 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:26.902627 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:26.904914 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:26.854398  1414 raft_consensus.cc:2749] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:09:26.876091  1428 consensus_meta.cc:287] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.704s	user 0.007s	sys 0.003s
I20260709 13:09:26.855648  1423 raft_consensus.cc:2749] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:26.872613  1443 raft_consensus.cc:2749] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:26.863580  1408 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:26.919799 30516 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:26.934244 30468 raft_consensus.cc:2468] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 7.
I20260709 13:09:26.935249 30476 raft_consensus.cc:2410] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:26.855207  1352 raft_consensus.cc:740] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:26.845033  1283 raft_consensus.cc:493] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:26.854413  1372 raft_consensus.cc:515] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:26.940407 30440 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:26.942687 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:26.947757 30623 raft_consensus.cc:2468] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 9.
I20260709 13:09:26.968466 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
W20260709 13:09:26.930889 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.969045 30542 raft_consensus.cc:3060] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:26.961242 31145 raft_consensus.cc:1240] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 7 LEADER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:26.970379 31115 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:26.878484  1434 raft_consensus.cc:2749] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:26.976230 30476 raft_consensus.cc:1240] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:26.977260 30471 raft_consensus.cc:1275] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:26.964850 30469 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 8.
I20260709 13:09:26.973156 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:26.977947 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:26.978407 30551 raft_consensus.cc:3060] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:26.964311 30470 raft_consensus.cc:2410] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:09:26.980242 30547 raft_consensus.cc:1240] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 6 LEADER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:26.941748  1357 raft_consensus.cc:2749] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:26.982347 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:26.876399  1392 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:26.986227 30551 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9.
I20260709 13:09:27.000979 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:27.001649 30551 raft_consensus.cc:2393] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 8: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:27.002324 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:27.002488 31116 leader_election.cc:304] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:26.964380  1281 raft_consensus.cc:2804] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:26.956212  1401 raft_consensus.cc:3060] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:26.972538  1283 raft_consensus.cc:3060] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:27.003589 31116 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:26.997769 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.008580 30440 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:26.982230  1414 raft_consensus.cc:2749] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:27.010286 30546 raft_consensus.cc:1240] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:09:26.985028  1431 raft_consensus.cc:2804] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:27.005779  1275 consensus_queue.cc:1048] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:09:27.008122  1253 raft_consensus.cc:2804] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:27.029287 30543 raft_consensus.cc:1240] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:27.042069 30542 raft_consensus.cc:2468] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
I20260709 13:09:27.007248  1281 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.027367 31116 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:26.995414  1352 consensus_queue.cc:260] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:27.020514  1412 log.cc:927] Time spent T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 1.291s	user 0.006s	sys 0.005s
W20260709 13:09:27.010100  1450 log.cc:927] Time spent T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:09:27.047976 31116 leader_election.cc:304] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:27.040066  1357 raft_consensus.cc:2749] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:27.040292  1253 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.004207  1392 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:27.040179  1275 consensus_queue.cc:1243] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer f639301059e24dc5b0d88a46dc683326 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:09:27.011579  1420 raft_consensus.cc:2749] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:27.011796  1242 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:27.049257  1281 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:27.063297  1460 log.cc:927] Time spent T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:09:27.054402  1300 raft_consensus.cc:2749] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:09:27.068317 30360 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 5610a33c644c4e539ad503631763aa40 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica fe2b7d73f8c743c1ba570cfd981c4e79 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:09:27.054647  1431 raft_consensus.cc:697] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 9 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:27.051427  1092 raft_consensus.cc:2804] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:27.058385  1253 raft_consensus.cc:3060] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:27.059505  1288 consensus_queue.cc:1059] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:09:27.074322  1392 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:27.080226 30468 raft_consensus.cc:1240] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:27.082417  1275 consensus_queue.cc:1048] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:09:27.081267 30471 pending_rounds.cc:85] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326: Aborting all ops after (but not including) 6
I20260709 13:09:27.049955  1414 consensus_queue.cc:1059] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
W20260709 13:09:27.084288 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.087325  1092 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:27.070101  1352 raft_consensus.cc:3060] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:27.087788 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:27.089805  1288 raft_consensus.cc:3055] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:27.094019 30471 pending_rounds.cc:107] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:09:27.088513 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:27.097460 30471 raft_consensus.cc:2889] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:27.088814 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:27.088925 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:27.098625 31142 raft_consensus.cc:2393] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 4: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:27.095875 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:27.097713 31146 raft_consensus.cc:2468] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
W20260709 13:09:27.104503 30441 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.002s	sys 0.048s
W20260709 13:09:27.104822 30441 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.002s	sys 0.048s
I20260709 13:09:27.105675  1385 raft_consensus.cc:493] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:27.106329   975 raft_consensus.cc:2749] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:27.069240  1372 leader_election.cc:290] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:27.113150 30625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 680) took 1675 ms. Trace:
I20260709 13:09:27.113209 30544 raft_consensus.cc:1275] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:09:27.113785 30544 pending_rounds.cc:85] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd: Aborting all ops after (but not including) 5
I20260709 13:09:27.114194 30544 pending_rounds.cc:107] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:09:27.114661 30544 raft_consensus.cc:2889] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:27.086040 30590 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:27.097349  1288 raft_consensus.cc:740] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:27.106993 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:27.108940 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:27.109153 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:09:27.109522 31116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.109822 31147 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
I20260709 13:09:27.084360  1431 consensus_queue.cc:237] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:27.137116 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.118513 30590 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:09:27.142364 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:27.142969 31142 raft_consensus.cc:3060] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:27.143622 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:27.090569  1408 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:27.148036 30472 raft_consensus.cc:2468] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
I20260709 13:09:27.148864 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:27.150681 30468 raft_consensus.cc:2393] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 8: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:27.097448  1092 raft_consensus.cc:3060] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:27.113660 30625 rpcz_store.cc:276] 0709 13:09:25.437249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.451789 (+ 14540us) service_pool.cc:224] Handling call
0709 13:09:25.455530 (+  3741us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:25.456105 (+   575us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:25.456146 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:25.456905 (+   759us) log.cc:844] Serialized 52 byte log entry
0709 13:09:25.642856 (+185951us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:25.642923 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.643013 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:27.019988 (+1376975us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:09:27.112913 (+ 92925us) raft_consensus.cc:1685] finished
0709 13:09:27.112932 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:27.113096 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":113,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":3136,"spinlock_wait_cycles":4147584,"thread_start_us":156891,"threads_started":1,"wal-append.queue_time_us":250051}
I20260709 13:09:27.151198 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:27.158691 30474 raft_consensus.cc:3060] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:27.152525 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:27.151971 30441 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:27.158047 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:27.159862 30472 raft_consensus.cc:2468] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 11.
I20260709 13:09:27.139740  1392 raft_consensus.cc:2749] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:27.164883 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:27.166031 30472 raft_consensus.cc:2468] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 9.
W20260709 13:09:27.167299 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 48844.5us
I20260709 13:09:27.168207 30474 raft_consensus.cc:2468] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 8.
I20260709 13:09:27.167456 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:27.169148 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:27.169808  1392 consensus_queue.cc:1048] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:27.170586 30474 raft_consensus.cc:1275] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:09:27.170672 30589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.170723 30472 raft_consensus.cc:1240] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 9. Current term is 10. Ops: [7.5-7.5]
I20260709 13:09:27.139905  1304 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:27.140096  1427 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:27.116040  1197 consensus_queue.cc:1059] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:09:27.174216 30590 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:27.159983   958 raft_consensus.cc:2804] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:09:27.178323 31115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.151278  1401 consensus_queue.cc:1059] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:09:27.183801  1245 consensus_queue.cc:1059] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:27.184280  1395 raft_consensus.cc:3055] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:27.184682  1395 raft_consensus.cc:740] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:27.184930  1415 raft_consensus.cc:3055] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:27.185397  1415 raft_consensus.cc:740] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:27.144893   974 consensus_queue.cc:1048] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:09:27.141974  1242 consensus_queue.cc:1048] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:09:27.106202  1385 raft_consensus.cc:515] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:27.195715 30517 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:27.178831  1282 raft_consensus.cc:2749] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:27.197343 30590 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:27.198948 30517 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:27.185593  1395 consensus_queue.cc:260] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:27.200636 30517 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:27.181070   975 raft_consensus.cc:2749] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:27.203490 30590 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:27.207901 30517 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:27.196542   958 raft_consensus.cc:697] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:27.177166  1304 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:27.202167  1410 raft_consensus.cc:2804] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:27.201923  1058 raft_consensus.cc:2749] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:27.205556  1320 raft_consensus.cc:2804] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:27.227232 30590 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:27.186352  1415 consensus_queue.cc:260] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:27.200572  1347 consensus_queue.cc:1048] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:09:27.236047  1395 raft_consensus.cc:3060] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:27.212287  1358 raft_consensus.cc:2804] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:09:27.245172  1442 log.cc:927] Time spent T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.669s	user 0.000s	sys 0.002s
I20260709 13:09:27.201740  1357 consensus_queue.cc:1059] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:09:27.265144  1385 leader_election.cc:290] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:27.276408   958 consensus_queue.cc:237] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:27.230003  1215 raft_consensus.cc:2804] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:27.232335  1410 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:27.278424 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:27.178881  1427 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:27.281363 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 54166.7us
I20260709 13:09:27.179385  1288 consensus_queue.cc:260] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:27.239583  1336 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:27.307705 30621 raft_consensus.cc:1240] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 LEADER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:27.356631 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:27.358021 30621 raft_consensus.cc:1275] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:27.308502 30618 raft_consensus.cc:1240] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:09:27.326376  1415 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:27.362965  1275 consensus_queue.cc:1048] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:09:27.330382 31116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.243072  1320 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:27.234395  1283 raft_consensus.cc:515] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:27.347412  1304 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:27.369131 31142 raft_consensus.cc:2468] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
I20260709 13:09:27.371948 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:27.358121  1215 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.296900  1346 raft_consensus.cc:2804] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:27.358274  1410 raft_consensus.cc:3060] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:27.385915 30473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 1719) took 2278 ms. Trace:
I20260709 13:09:27.392148 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:27.392973  1283 leader_election.cc:290] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:27.392704  1092 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:27.393643  1288 raft_consensus.cc:3060] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:27.394733 30441 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:27.365569  1253 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:27.396162 31143 raft_consensus.cc:1240] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:27.396956  1253 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:27.399102 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:27.399950 31150 raft_consensus.cc:1240] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:09:27.400099 30476 raft_consensus.cc:2393] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 4: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:27.386322 30473 rpcz_store.cc:276] 0709 13:09:25.107346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.168652 (+ 61306us) service_pool.cc:224] Handling call
0709 13:09:26.026227 (+857575us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:26.026434 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:26.110411 (+ 83977us) log.cc:844] Serialized 14 byte log entry
0709 13:09:26.257423 (+147012us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:26.257477 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:26.257517 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.257581 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:27.244594 (+987013us) spinlock_profiling.cc:243] Waited 9.66 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:09:27.385705 (+141111us) spinlock_profiling.cc:243] Waited 855 ms on lock 0x7b54001225d0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f678ad 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:27.385845 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":83970,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":17184,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"spinlock_wait_cycles":1988278016,"thread_start_us":205264,"threads_started":2,"wal-append.queue_time_us":377151}
I20260709 13:09:27.404868 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:27.405421 30473 raft_consensus.cc:2376] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 8. Re-sending same reply.
I20260709 13:09:27.406369 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:27.407413 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:27.375123  1385 raft_consensus.cc:3055] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:27.407924  1229 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:27.408124  1385 raft_consensus.cc:740] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:27.408995  1385 consensus_queue.cc:260] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:27.408124 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:27.411473  1272 raft_consensus.cc:493] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:27.412959  1272 raft_consensus.cc:515] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:27.415123  1272 leader_election.cc:290] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:27.415657  1346 raft_consensus.cc:697] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:27.379910  1215 raft_consensus.cc:3060] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:27.416584  1346 consensus_queue.cc:237] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:27.417878  1434 consensus_queue.cc:1059] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:27.418576  1434 consensus_queue.cc:1243] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer fe2b7d73f8c743c1ba570cfd981c4e79 log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:09:27.419512  1434 raft_consensus.cc:2749] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:27.420138  1434 consensus_queue.cc:1059] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:09:27.411839 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.412202 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:27.399415  1281 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:27.429695  1281 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:27.435907 31116 leader_election.cc:304] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:27.436918  1275 raft_consensus.cc:2749] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:27.437548 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:27.438282 30473 raft_consensus.cc:2468] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7.
I20260709 13:09:27.439327 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:27.394846  1092 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:27.443122 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:27.443862 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:27.374409  1320 raft_consensus.cc:3060] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:27.449191 30473 raft_consensus.cc:2410] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:27.451140 30590 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:27.455351  1242 raft_consensus.cc:993] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79: : Instructing follower f639301059e24dc5b0d88a46dc683326 to start an election
I20260709 13:09:27.455821  1242 raft_consensus.cc:2804] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:27.456346  1242 raft_consensus.cc:697] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:27.457195  1242 consensus_queue.cc:237] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:27.459965  1058 consensus_queue.cc:1059] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:27.460752  1058 raft_consensus.cc:1081] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 LEADER]: Signalling peer f639301059e24dc5b0d88a46dc683326 to start an election
I20260709 13:09:27.461644  1058 raft_consensus.cc:3055] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:27.462009  1058 raft_consensus.cc:740] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:27.462721  1058 consensus_queue.cc:260] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:27.463773 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:27.464664   975 raft_consensus.cc:493] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.467870   975 raft_consensus.cc:515] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:27.469900   975 leader_election.cc:290] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:27.473196  1414 raft_consensus.cc:3055] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:27.473590  1414 raft_consensus.cc:740] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:27.473799 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:27.474385 30475 raft_consensus.cc:3060] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:27.477474  1427 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:27.484170 30475 raft_consensus.cc:2468] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 8.
I20260709 13:09:27.485435 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:27.486524 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:27.487020 30475 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:27.487937 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 63005.5us
I20260709 13:09:27.488581 31144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48412 (request call id 633) took 1129 ms. Trace:
I20260709 13:09:27.488955 31144 rpcz_store.cc:276] 0709 13:09:26.359529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.365623 (+  6094us) service_pool.cc:224] Handling call
0709 13:09:26.431597 (+ 65974us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:26.433962 (+  2365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.488402 (+1054440us) spinlock_profiling.cc:243] Waited 64.3 ms on lock 0x7b5400447ad0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f678ad 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:27.488527 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":147998976}
W20260709 13:09:27.489621  1362 consensus_meta.cc:287] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.617s	user 0.006s	sys 0.004s
I20260709 13:09:27.490032  1362 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:27.492626  1362 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:27.493044  1411 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:27.488600 30591 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:27.528103 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:27.531565 30591 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:27.533247 30591 leader_election.cc:304] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:27.534300 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:27.535051 30616 raft_consensus.cc:2468] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 3.
I20260709 13:09:27.537281 30475 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 12.
I20260709 13:09:27.463653  1058 raft_consensus.cc:3060] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:27.539475 31116 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:27.557968 30471 raft_consensus.cc:1240] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 7. Current term is 8. Ops: []
W20260709 13:09:27.563022 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:27.565354 31115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.543406  1407 raft_consensus.cc:2804] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:27.439440  1215 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:27.572808  1408 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:09:27.581697 31116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.541249  1166 raft_consensus.cc:3060] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:27.550436  1272 raft_consensus.cc:2804] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:27.550699  1348 raft_consensus.cc:2804] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:27.597142  1408 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:27.597638  1414 consensus_queue.cc:260] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:27.598786  1372 raft_consensus.cc:3055] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:27.599241  1372 raft_consensus.cc:740] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:27.562299  1304 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.598805  1348 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:27.607748  1407 raft_consensus.cc:697] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 8 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:27.609611  1336 raft_consensus.cc:2749] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:27.609486  1272 raft_consensus.cc:697] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:27.648334  1272 consensus_queue.cc:237] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:27.652177  1215 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:27.628695  1348 raft_consensus.cc:3060] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:27.617507  1304 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:27.655258  1410 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:27.658660  1414 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:27.652192  1407 consensus_queue.cc:237] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:27.696125  1408 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:27.698302  1410 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:27.562904 30441 leader_election.cc:304] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:27.744639 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 181638us
W20260709 13:09:27.753979 30441 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.754964 30468 raft_consensus.cc:1275] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:27.756649 30475 raft_consensus.cc:1275] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:27.840688 30475 raft_consensus.cc:1275] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:09:27.842916 30475 raft_consensus.cc:1275] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:09:27.843333 30475 pending_rounds.cc:85] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326: Aborting all ops after (but not including) 6
I20260709 13:09:27.757881 30472 raft_consensus.cc:1275] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:09:27.768626 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.769088 30591 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:27.856314 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 87675.2us
W20260709 13:09:27.771026 30589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.776522 30621 raft_consensus.cc:1275] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:09:27.776680 30624 raft_consensus.cc:1240] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 9. Current term is 10. Ops: []
W20260709 13:09:27.784585 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 149329us
I20260709 13:09:27.787796 30619 raft_consensus.cc:1217] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 LEADER]: Deduplicated request from leader. Original: 6.5->[8.6-8.6]   Dedup: 8.6->[]
I20260709 13:09:27.789189 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:27.861759 30619 raft_consensus.cc:1240] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 LEADER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:09:27.862371 30550 raft_consensus.cc:2410] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:09:27.864580 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:27.864773 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:27.865515 30621 raft_consensus.cc:2368] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 8. Current term is 9.
I20260709 13:09:27.865923 30618 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:27.822523   975 raft_consensus.cc:2804] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:27.866400   975 raft_consensus.cc:493] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.866859   975 raft_consensus.cc:3060] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:27.870473   974 raft_consensus.cc:2804] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:27.871083   974 raft_consensus.cc:697] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:27.833323 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:27.833829 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:27.872506 30549 raft_consensus.cc:2393] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 9: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:27.873466 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:27.873893 30544 raft_consensus.cc:1275] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:09:27.875093 30549 raft_consensus.cc:1275] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:27.863230 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:27.863358 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:27.876098   958 consensus_queue.cc:1059] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:27.877885  1045 raft_consensus.cc:3055] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:27.878567  1045 raft_consensus.cc:740] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:27.872480   974 consensus_queue.cc:237] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:27.820930 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:27.880316 30544 raft_consensus.cc:1275] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:09:27.880647 30544 pending_rounds.cc:85] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd: Aborting all ops after (but not including) 6
I20260709 13:09:27.880023  1045 consensus_queue.cc:260] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:27.791476 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:27.882536 31146 raft_consensus.cc:3060] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:27.819099 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:27.864769 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:27.888468 30546 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 8.
I20260709 13:09:27.880903 30544 pending_rounds.cc:107] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:09:27.889322 30544 raft_consensus.cc:2889] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:27.893872   975 raft_consensus.cc:515] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:27.843684 30475 pending_rounds.cc:107] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:09:27.895613 31146 raft_consensus.cc:2468] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:09:27.894287  1092 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:27.898191  1201 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.903184 31150 raft_consensus.cc:1275] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:09:27.904793 30472 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c"
dest_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:50446
W20260709 13:09:27.908874 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.909744  1283 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.910682  1409 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.911509  1357 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.631083  1372 consensus_queue.cc:260] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:27.946700 30618 raft_consensus.cc:2468] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 12.
I20260709 13:09:27.943387 30475 raft_consensus.cc:2889] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:28.007974 30475 raft_consensus.cc:1275] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:09:28.012763  1261 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.013805  1261 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:28.015766  1410 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:28.016844 30470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60026 (request call id 717) took 1217 ms. Trace:
I20260709 13:09:28.016747  1410 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:28.017277 30470 rpcz_store.cc:276] 0709 13:09:26.799695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.810194 (+ 10499us) service_pool.cc:224] Handling call
0709 13:09:28.016351 (+1206157us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b540011e254. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:28.016622 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":351203200}
I20260709 13:09:28.019189 30469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60026 (request call id 726) took 1109 ms. Trace:
I20260709 13:09:28.019315  1410 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:28.019711 30469 rpcz_store.cc:276] 0709 13:09:26.910414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.910941 (+   527us) service_pool.cc:224] Handling call
0709 13:09:28.018867 (+1107926us) spinlock_profiling.cc:243] Waited 52.7 ms on lock 0x7b54000438d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:28.019015 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":121196800}
I20260709 13:09:28.020678 30468 raft_consensus.cc:1275] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:09:28.022010  1510 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:28.022878 30550 raft_consensus.cc:1275] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:09:28.022728  1510 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:28.024910  1411 consensus_meta.cc:287] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.531s	user 0.012s	sys 0.000s
I20260709 13:09:28.025564  1510 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:28.028151 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:28.028028  1409 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:28.028815 30549 raft_consensus.cc:1275] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:28.027226  1510 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:28.030014 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:28.030260 30544 raft_consensus.cc:1275] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:09:28.029906  1510 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:28.030645 30543 raft_consensus.cc:3060] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:28.032742  1510 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:28.065313  1357 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:28.030655  1409 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:28.003259 30472 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:28.083159 30472 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:28.067736  1503 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.084653  1283 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:28.096321 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.100406  1456 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.101246  1456 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:28.102275 30471 raft_consensus.cc:1240] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:28.100430  1503 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:28.103991  1304 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:28.107537 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:28.109593 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.081619  1092 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:28.111007  1201 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:28.115890 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 106580us
W20260709 13:09:28.114970 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:28.112262  1320 consensus_meta.cc:287] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.628s	user 0.009s	sys 0.002s
I20260709 13:09:27.669806  1358 raft_consensus.cc:697] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 8 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:28.128392  1357 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:28.128605  1045 raft_consensus.cc:3060] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:28.134866 30543 raft_consensus.cc:2468] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:09:28.155920 30590 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:28.156821 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 88756.5us
I20260709 13:09:28.157204  1456 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:28.157894  1392 raft_consensus.cc:2804] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:28.158515  1392 raft_consensus.cc:697] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:28.159045   870 consensus_queue.cc:1048] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:28.159578  1392 consensus_queue.cc:237] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:28.146360  1320 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:28.162933   974 consensus_queue.cc:1048] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:28.164863  1320 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:28.165504  1353 consensus_queue.cc:1048] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:28.166082  1282 consensus_queue.cc:1048] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:28.167009   819 consensus_queue.cc:1048] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:28.167287  1353 consensus_queue.cc:1048] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:28.168037  1407 consensus_queue.cc:1048] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:09:28.169795  1426 log.cc:927] Time spent T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 2.237s	user 0.001s	sys 0.004s
I20260709 13:09:28.170332 30516 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:28.172212 30516 leader_election.cc:400] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: Vote denied by peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) with higher term. Message: Invalid argument: T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 8. Current term is 9.
I20260709 13:09:28.172554  1385 raft_consensus.cc:3060] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:28.176018  1166 consensus_meta.cc:287] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.538s	user 0.005s	sys 0.013s
I20260709 13:09:28.176652  1166 raft_consensus.cc:2749] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:28.177201 30548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 1812) took 2424 ms. Trace:
I20260709 13:09:28.177627 30548 rpcz_store.cc:276] 0709 13:09:25.752385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.752500 (+   115us) service_pool.cc:224] Handling call
0709 13:09:25.752785 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:25.753092 (+   307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:25.753125 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:25.753527 (+   402us) log.cc:844] Serialized 26 byte log entry
0709 13:09:25.904392 (+150865us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:25.904445 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.904534 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:28.168946 (+2264412us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:09:28.176695 (+  7749us) raft_consensus.cc:1685] finished
0709 13:09:28.176718 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:28.176993 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5355,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":6088,"spinlock_wait_cycles":5413760,"thread_start_us":118643,"threads_started":1,"wal-append.queue_time_us":169355}
W20260709 13:09:28.179280  1447 log.cc:927] Time spent T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 1.705s	user 0.000s	sys 0.006s
I20260709 13:09:28.179512  1336 raft_consensus.cc:2749] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:28.172551 30516 leader_election.cc:403] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:09:28.182410  1406 raft_consensus.cc:2749] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) with higher term. Message: Invalid argument: T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 8. Current term is 9.
I20260709 13:09:28.184980  1358 consensus_queue.cc:237] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:28.155736 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:09:28.150662 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 51868.1us
I20260709 13:09:28.142375   975 leader_election.cc:290] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:28.231957 30616 raft_consensus.cc:2393] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 7: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
W20260709 13:09:28.238095  1431 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.006s	sys 0.031s
I20260709 13:09:28.234925  1435 consensus_queue.cc:1059] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:09:28.239013  1435 raft_consensus.cc:3055] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:28.239333 30516 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:28.239413  1435 raft_consensus.cc:740] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:28.240330  1336 raft_consensus.cc:2804] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:28.240854  1336 raft_consensus.cc:697] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 12 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:28.240706  1435 consensus_queue.cc:260] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:28.241791  1336 consensus_queue.cc:237] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:28.242172  1435 raft_consensus.cc:3060] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:28.243593 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 938328us
I20260709 13:09:28.210057 31114 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:28.246953  1510 consensus_queue.cc:1048] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
W20260709 13:09:28.256593 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 46752.6us
I20260709 13:09:28.257494 31114 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:28.258342  1411 raft_consensus.cc:2749] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:28.228459  1346 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:28.263437 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 82808.8us
I20260709 13:09:28.259007 31114 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:28.249732 30472 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:28.271461 30620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47446 (request call id 2247) took 4130 ms. Trace:
I20260709 13:09:28.271663  1092 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:28.271903 30542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43088 (request call id 1922) took 1297 ms. Trace:
I20260709 13:09:28.273500 30471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 1751) took 1060 ms. Trace:
I20260709 13:09:28.276568  1283 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:28.265239 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:28.279063  1346 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:28.280083 30543 raft_consensus.cc:1240] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 5. Current term is 6. Ops: []
W20260709 13:09:28.284746 31115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.280905 30620 rpcz_store.cc:276] 0709 13:09:24.140526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.277825 (+137299us) service_pool.cc:224] Handling call
0709 13:09:25.738913 (+1461088us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b58001a3198. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780e43b71 00007fc780e43a22 00007fc789d5cc09 00007fc788eb6ee0 00007fc788f800ab 00007fc788f80131 00007fc788f41fc0 00007fc788f2c929 00007fc788f2c3d2 00007fc7824a3bd4
0709 13:09:25.739126 (+   213us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:26.153899 (+414773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:28.270972 (+2117073us) spinlock_profiling.cc:243] Waited 414 ms on lock 0x7b54002c9054. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:28.271277 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":956214912}
W20260709 13:09:28.288988 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 54681.9us
I20260709 13:09:28.283864 30471 rpcz_store.cc:276] 0709 13:09:27.212900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:27.575369 (+362469us) service_pool.cc:224] Handling call
0709 13:09:28.101841 (+526472us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:28.102755 (+   914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:28.273329 (+170574us) spinlock_profiling.cc:243] Waited 458 ms on lock 0x7b54003c32d0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f678ad 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:28.273440 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1052446464}
I20260709 13:09:28.290467 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:28.259055  1411 raft_consensus.cc:2749] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:28.295567  1201 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:28.296082 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 132588us
I20260709 13:09:28.296662  1503 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:28.297785 30517 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:28.299022 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:28.308246 31149 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7.
I20260709 13:09:28.315747 30472 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:28.320703  1424 raft_consensus.cc:2749] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:09:28.320711  1348 consensus_meta.cc:287] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.648s	user 0.012s	sys 0.000s
I20260709 13:09:28.321935  1346 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:28.322009  1348 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:28.283793 30542 rpcz_store.cc:276] 0709 13:09:26.974830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:27.044866 (+ 70036us) service_pool.cc:224] Handling call
0709 13:09:27.045134 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:27.045331 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:27.048858 (+  3527us) log.cc:844] Serialized 14 byte log entry
0709 13:09:28.033109 (+984251us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b1800361060. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e5de07 00007fc789cb8ab9 00007fc780e7a69b 00007fc780e7893f 00007fc780e7ac02 00007fc783b0220b 00007fc783b07d23 00007fc783b0823a 00007fc783f72a2a
0709 13:09:28.270756 (+237647us) log.cc:844] Serialized 14 byte log entry
0709 13:09:28.271125 (+   369us) log.cc:844] Serialized 14 byte log entry
0709 13:09:28.271282 (+   157us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:28.271336 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:28.271402 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:28.271499 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:28.271721 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":32209,"prepare.run_cpu_time_us":116,"prepare.run_wall_time_us":3294,"raft.queue_time_us":11253,"raft.run_cpu_time_us":386,"raft.run_wall_time_us":37377,"spinlock_wait_cycles":8338176,"thread_start_us":127138,"threads_started":1}
I20260709 13:09:28.327517 30618 raft_consensus.cc:2393] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 6: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:28.312340  1320 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:28.309962  1510 raft_consensus.cc:493] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:28.339157 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:28.341288 30623 raft_consensus.cc:1275] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:28.343403  1420 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.344053  1420 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:28.346248  1420 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:28.347867 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:28.335803  1503 raft_consensus.cc:2749] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:28.358176 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 99251.5us
I20260709 13:09:28.349484 30620 raft_consensus.cc:2468] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 6.
W20260709 13:09:28.356415 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 58792.9us
I20260709 13:09:28.356931  1510 raft_consensus.cc:515] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:28.357591 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:28.337303  1348 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:28.364503 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:28.375248 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:28.381645 31148 raft_consensus.cc:2468] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 8.
I20260709 13:09:28.383965 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:28.384754 31147 raft_consensus.cc:2468] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 4.
I20260709 13:09:28.347976  1392 consensus_queue.cc:1048] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:09:28.393713 30621 raft_consensus.cc:1240] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:28.395614 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:28.397013 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:28.396937  1319 consensus_queue.cc:1048] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:28.399971 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:28.402537  1346 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.403162  1346 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:28.405424  1346 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:09:28.405719 31149 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48414 (request call id 816) took 1317 ms (client timeout 1716 ms). Trace:
W20260709 13:09:28.406211 31149 rpcz_store.cc:269] 0709 13:09:27.088448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:27.088561 (+   113us) service_pool.cc:224] Handling call
0709 13:09:28.405495 (+1316934us) spinlock_profiling.cc:243] Waited 927 ms on lock 0x7b5400727254. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:28.405642 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2132981632}
I20260709 13:09:28.409004  1503 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:28.409659  1503 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:28.411479  1215 consensus_queue.cc:1059] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:28.412799  1045 raft_consensus.cc:3055] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:28.413167  1045 raft_consensus.cc:740] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:28.413594  1510 leader_election.cc:290] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:28.414294  1261 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:28.415372 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:28.414095  1045 consensus_queue.cc:260] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:28.416378 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:28.417245 31144 raft_consensus.cc:1275] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:28.417392  1045 raft_consensus.cc:3060] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:28.418761 30617 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47446 (request call id 2255) took 2773 ms (client timeout 1556 ms). Trace:
W20260709 13:09:28.419164 30617 rpcz_store.cc:269] 0709 13:09:25.644933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.645136 (+   203us) service_pool.cc:224] Handling call
0709 13:09:28.418380 (+2773244us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b54002c8b54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:28.418575 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1562230528}
I20260709 13:09:28.421098 30547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 1846) took 1460 ms. Trace:
I20260709 13:09:28.421875 31143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48414 (request call id 813) took 1335 ms. Trace:
I20260709 13:09:28.422140 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:28.422660 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:28.425243 31144 raft_consensus.cc:1275] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:09:28.426971 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:28.417485 30472 raft_consensus.cc:1275] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:09:28.428735 30472 pending_rounds.cc:85] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326: Aborting all ops after (but not including) 7
I20260709 13:09:28.429014 30472 pending_rounds.cc:107] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:09:28.429252 30472 raft_consensus.cc:2889] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:28.430027 31147 raft_consensus.cc:1275] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:09:28.432449 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:28.434347  1372 raft_consensus.cc:3060] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:28.415707 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:28.436820 31145 raft_consensus.cc:2393] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 7: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:28.437482 30474 raft_consensus.cc:1275] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:09:28.437948 30474 pending_rounds.cc:85] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326: Aborting all ops after (but not including) 8
I20260709 13:09:28.438192 30474 pending_rounds.cc:107] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:09:28.438439 30474 raft_consensus.cc:2889] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:28.432514 30467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 722) took 1631 ms. Trace:
I20260709 13:09:28.358668  1320 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:28.440615 30517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.442415  1304 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.442525 30542 raft_consensus.cc:1275] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:09:28.442931  1304 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:28.422299 31143 rpcz_store.cc:276] 0709 13:09:27.086209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:27.086346 (+   137us) service_pool.cc:224] Handling call
0709 13:09:27.086617 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:27.396525 (+309908us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:28.421438 (+1024913us) spinlock_profiling.cc:243] Waited 309 ms on lock 0x7b5400653954. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:28.421689 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":711407360}
I20260709 13:09:28.444900 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:28.445549 30542 raft_consensus.cc:3060] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:28.445936 31142 raft_consensus.cc:1275] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:09:28.445839  1424 consensus_queue.cc:1048] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:28.446925 31115 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:28.447454  1395 consensus_meta.cc:287] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 1.029s	user 0.009s	sys 0.008s
I20260709 13:09:28.421519 30547 rpcz_store.cc:276] 0709 13:09:26.960327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.961702 (+  1375us) service_pool.cc:224] Handling call
0709 13:09:26.961989 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:26.981907 (+ 19918us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:28.420694 (+1438787us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b54002576d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:28.420938 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41455360}
I20260709 13:09:28.440073 30467 rpcz_store.cc:276] 0709 13:09:26.801329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.853123 (+ 51794us) service_pool.cc:224] Handling call
0709 13:09:26.853463 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:27.005064 (+151601us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:27.005091 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:27.005125 (+    34us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:27.005156 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:28.432050 (+1426894us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b5400042ed4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:28.432127 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:28.432341 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":348252416}
I20260709 13:09:28.445441 31114 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:28.452090  1424 raft_consensus.cc:2749] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:28.452466 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:28.453112 30624 raft_consensus.cc:3060] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:28.411727 30441 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:28.456113 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.427526 31144 raft_consensus.cc:2468] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:09:28.459441  1401 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.460080  1401 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:28.462013  1304 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:28.462387  1401 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:28.464975 30468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 1757) took 1226 ms. Trace:
I20260709 13:09:28.465533 30468 rpcz_store.cc:276] 0709 13:09:27.238729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:27.837117 (+598388us) service_pool.cc:224] Handling call
0709 13:09:28.020066 (+182949us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:28.021205 (+  1139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:28.463752 (+442547us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b54000438d0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f678ad 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:28.464899 (+  1147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":419293056}
I20260709 13:09:28.471030 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:28.476689 30622 raft_consensus.cc:1275] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:09:28.476933 30516 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:28.477191 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:28.466719  1395 raft_consensus.cc:2804] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:28.479525  1237 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:28.479566  1499 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.480268  1395 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.480762  1395 raft_consensus.cc:3060] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:28.480412  1499 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:28.481554 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:28.482122 30517 leader_election.cc:304] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:28.482152 30545 raft_consensus.cc:2468] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 5.
I20260709 13:09:28.482777  1499 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:28.483356  1499 raft_consensus.cc:2749] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:28.483448 31146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e"
dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
mode: GRACEFUL
new_leader_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:42956
I20260709 13:09:28.483994 30547 raft_consensus.cc:1240] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:28.484115 31146 raft_consensus.cc:606] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 7 LEADER]: Received request to transfer leadership to TS f639301059e24dc5b0d88a46dc683326
I20260709 13:09:28.484437 30551 raft_consensus.cc:1240] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:09:28.485124 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:28.485764  1320 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:28.486104 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:28.486701 30548 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 10.
I20260709 13:09:28.487103 31114 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:28.488142  1506 raft_consensus.cc:2749] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:28.488204 30360 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 5610a33c644c4e539ad503631763aa40 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica fe2b7d73f8c743c1ba570cfd981c4e79 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:09:28.490037 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:28.490641 31145 raft_consensus.cc:2468] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 10.
I20260709 13:09:28.490738 30617 raft_consensus.cc:1275] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:28.491544 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:28.492353 31149 raft_consensus.cc:2393] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 9: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:28.485775 30543 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9.
I20260709 13:09:28.488672 31151 raft_consensus.cc:1275] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:28.500118 30467 raft_consensus.cc:1240] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:28.471031 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:28.502444 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:28.503108 30470 raft_consensus.cc:2468] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 8.
I20260709 13:09:28.503204 30441 leader_election.cc:304] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:28.504256 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:28.504535 30470 raft_consensus.cc:1275] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:09:28.504997 30476 raft_consensus.cc:3060] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:28.482520 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:28.508240 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:28.486338  1320 consensus_queue.cc:1048] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:09:28.508590 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:28.509156 30544 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:28.511822  1346 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.512331  1346 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:28.514523  1346 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:28.515064 30440 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:28.508229 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:28.515657  1401 consensus_queue.cc:1048] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:28.465093  1503 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:28.488484 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:28.516770 31143 raft_consensus.cc:3060] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:28.517444 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:28.517908  1506 consensus_queue.cc:1048] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:28.511343  1243 consensus_queue.cc:1048] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:09:28.518318  1065 consensus_queue.cc:1048] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:28.519699  1065 raft_consensus.cc:2804] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:28.520126  1065 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.520498  1065 raft_consensus.cc:3060] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:28.521512 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:28.521646 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:28.522081 30618 raft_consensus.cc:3055] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:28.522409 30618 raft_consensus.cc:740] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:28.523377 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:28.523969 30621 raft_consensus.cc:2468] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 6.
I20260709 13:09:28.516870 30542 raft_consensus.cc:2468] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 4.
I20260709 13:09:28.523205 30618 consensus_queue.cc:260] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:28.549929 30476 raft_consensus.cc:2468] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 8.
I20260709 13:09:28.552556 30624 raft_consensus.cc:2468] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 5.
I20260709 13:09:28.529726  1410 raft_consensus.cc:2749] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:28.558411 30516 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:28.555747 31114 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:28.564419 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:28.571723 30440 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:28.575614 30470 raft_consensus.cc:1275] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:28.575057 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:28.535024  1435 consensus_queue.cc:1059] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:09:28.576308 30440 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:28.583850 30590 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:28.534754  1503 consensus_queue.cc:1048] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:09:28.577219  1358 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.567466  1320 raft_consensus.cc:2749] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:28.550460  1215 consensus_queue.cc:1048] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:09:28.567324  1385 raft_consensus.cc:2749] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:28.595727  1414 raft_consensus.cc:2804] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:28.596313  1414 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.596658  1414 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:28.595854  1358 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:28.600076 30624 raft_consensus.cc:1275] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:09:28.600834 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 97722us
I20260709 13:09:28.595566 30440 leader_election.cc:304] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:28.605018 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:28.605681 31149 raft_consensus.cc:2468] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:09:28.609263 30441 leader_election.cc:304] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:28.610414 31143 raft_consensus.cc:2468] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 5.
I20260709 13:09:28.607402 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:28.611351 30618 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:28.593827  1243 raft_consensus.cc:2804] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:28.624486  1243 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.624922  1243 raft_consensus.cc:3060] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:28.626237  1197 raft_consensus.cc:2749] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:28.627475  1197 raft_consensus.cc:2804] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:28.628091  1197 raft_consensus.cc:697] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 4 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:28.614240  1108 raft_consensus.cc:2804] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:28.612527  1506 consensus_queue.cc:1048] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:09:28.614697  1242 consensus_queue.cc:1048] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:09:28.607110  1499 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:28.591908  1401 consensus_queue.cc:1048] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:09:28.602837  1411 consensus_queue.cc:1048] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:09:28.616942  1358 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:28.641778 30617 raft_consensus.cc:1275] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:28.643430  1499 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:28.646248  1499 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:28.617182 30374 catalog_manager.cc:5697] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 5 to 6, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 6 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:28.615739 30589 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:28.615769 30441 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:28.623891 30542 raft_consensus.cc:1275] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:09:28.624010 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 68338.7us
I20260709 13:09:28.636538 30473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 1750) took 1314 ms. Trace:
W20260709 13:09:28.635116 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 81738.7us
I20260709 13:09:28.648372 30590 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:28.634914  1108 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:28.664619 31143 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67"
dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
mode: GRACEFUL
new_leader_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:42956
I20260709 13:09:28.663173 30470 raft_consensus.cc:2468] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 7.
I20260709 13:09:28.668020 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:28.670861 30476 raft_consensus.cc:1275] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:09:28.666363 31143 raft_consensus.cc:606] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Received request to transfer leadership to TS f639301059e24dc5b0d88a46dc683326
I20260709 13:09:28.649554 30473 rpcz_store.cc:276] 0709 13:09:27.212648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:27.571471 (+358823us) service_pool.cc:224] Handling call
0709 13:09:27.756047 (+184576us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:28.180801 (+424754us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:28.181228 (+   427us) log.cc:844] Serialized 14 byte log entry
0709 13:09:28.376330 (+195102us) log.cc:844] Serialized 14 byte log entry
0709 13:09:28.376500 (+   170us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:28.376542 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:28.376576 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:28.386053 (+  9477us) spinlock_profiling.cc:243] Waited 9.16 ms on lock 0x7b18003df900. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e7b3f3 00007fc780e7d7c1 00007fc780e7d779 00007fc780e7d709 00007fc780e7d6d1 00007fc780e7c9cd 000000000038f354 000000000038f199 00007fc780e5e83a
0709 13:09:28.432578 (+ 46525us) spinlock_profiling.cc:243] Waited 24.1 ms on lock 0x7b4800240258. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc788e91aa1 00007fc788e88b37 00007fc788e889ca 00007fc788f8026f 00007fc788f7ff37 00007fc788f9455c 00007fc788f94508 00007fc788f94488 00007fc788f94443 00007fc788f936ec 00007fc787ebda96
0709 13:09:28.526495 (+ 93917us) spinlock_profiling.cc:243] Waited 424 ms on lock 0x7b540010efd4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:28.526546 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:28.526649 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":4635,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":68,"raft.queue_time_us":36247,"raft.run_cpu_time_us":1260,"raft.run_wall_time_us":137555,"spinlock_wait_cycles":1053182720,"thread_start_us":150035,"threads_started":1,"wal-append.queue_time_us":269326}
I20260709 13:09:28.671301 30476 pending_rounds.cc:85] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326: Aborting all ops after (but not including) 6
I20260709 13:09:28.679620 30476 pending_rounds.cc:107] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:09:28.680006 30476 raft_consensus.cc:2889] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:28.635445  1346 consensus_queue.cc:1048] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:09:28.687091 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:28.687645 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:28.666774  1108 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:28.689553 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.690587  1347 raft_consensus.cc:2804] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:28.676617  1372 raft_consensus.cc:2804] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:28.687708 30550 raft_consensus.cc:2468] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 8.
I20260709 13:09:28.670359  1045 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.692551 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:28.669507  1499 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:28.679315  1242 raft_consensus.cc:2749] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:09:28.697427 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 81832.7us
W20260709 13:09:28.723160 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 107487us
I20260709 13:09:28.692619 30544 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9.
I20260709 13:09:28.637861  1197 consensus_queue.cc:237] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:28.668169  1431 consensus_queue.cc:1059] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:09:28.695999  1347 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.698457  1372 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:28.724924  1357 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.747298  1435 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:28.734987  1347 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:28.750696 31114 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:28.726871  1499 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:28.747509  1283 raft_consensus.cc:2804] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:28.703157  1045 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:28.741742  1372 raft_consensus.cc:3060] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:28.756863 31143 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695"
dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
mode: GRACEFUL
new_leader_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:42956
I20260709 13:09:28.747437  1201 raft_consensus.cc:3055] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:28.759897 31143 raft_consensus.cc:606] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 7 LEADER]: Received request to transfer leadership to TS f639301059e24dc5b0d88a46dc683326
I20260709 13:09:28.755085  1357 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:28.747926  1431 raft_consensus.cc:3055] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:28.748700 30441 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:28.765524 30618 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9.
I20260709 13:09:28.773342 30441 leader_election.cc:304] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:28.776301  1045 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:28.747895  1435 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:28.779598  1435 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:28.768136  1431 raft_consensus.cc:740] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:28.780684  1319 raft_consensus.cc:2804] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:28.761245  1201 raft_consensus.cc:740] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:28.771013   975 raft_consensus.cc:2804] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:28.799084 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:28.800644 31144 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:28.808707 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:28.781116  1319 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.825551 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:28.827837 30624 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 7.
I20260709 13:09:28.790896  1435 raft_consensus.cc:2804] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:28.835850 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:09:28.837139 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.838222 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:28.815277   975 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.839502 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:28.829303   870 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:28.847322 31150 raft_consensus.cc:2393] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 8: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:28.842682 30617 raft_consensus.cc:2468] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 8.
I20260709 13:09:28.831456  1319 raft_consensus.cc:3060] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:28.845989 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:28.846801 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:28.850324 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:28.856164 30589 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:28.841686  1435 raft_consensus.cc:697] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 5 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:28.845441   975 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:28.879624 30589 leader_election.cc:304] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:28.875833 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:28.877226 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:28.879305  1240 raft_consensus.cc:2749] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:28.876572  1521 log.cc:927] Time spent T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:09:28.894109 30470 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:28.839690  1395 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:28.875744  1272 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.936367 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:28.896426 30472 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 12.
I20260709 13:09:28.948299 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:28.879782  1045 consensus_queue.cc:1048] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:09:28.953162 31142 raft_consensus.cc:1240] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:09:28.953531  1410 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.955118 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:28.893651   870 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:28.961683  1410 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:28.876711  1435 consensus_queue.cc:237] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:28.963735  1410 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:28.963845  1357 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:28.964063 30476 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 6.
I20260709 13:09:28.948402  1261 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:28.960156 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 80618.8us
I20260709 13:09:28.965533  1261 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:28.966408  1058 consensus_queue.cc:1048] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:28.937685  1503 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:28.968139  1503 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:28.968326 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:28.965479 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:28.967711  1058 consensus_queue.cc:1048] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:09:28.970176  1503 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:28.965464   870 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:28.970119  1058 consensus_queue.cc:1243] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer 092f6eb694fc4bbeab49677cccd880fd log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:09:28.971922  1395 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:28.938836  1201 consensus_queue.cc:260] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:28.973438  1201 raft_consensus.cc:3060] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:28.946419  1348 raft_consensus.cc:2749] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:28.977043 30516 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:28.978750  1283 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:28.978899 30516 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:28.979213  1283 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:28.980000  1410 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:28.983968  1358 consensus_queue.cc:1048] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:28.985405  1358 raft_consensus.cc:2749] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:28.987429 30516 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:28.988127  1336 consensus_queue.cc:1059] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:28.988919  1336 consensus_queue.cc:1048] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:28.989581  1431 consensus_queue.cc:260] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:28.990352  1304 raft_consensus.cc:3055] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:28.990742  1304 raft_consensus.cc:740] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:28.991640  1304 consensus_queue.cc:260] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:28.992813  1304 raft_consensus.cc:3060] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:28.994454  1237 consensus_queue.cc:1048] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:28.996263  1410 raft_consensus.cc:2749] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:29.007714  1240 consensus_queue.cc:1048] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:29.007836  1045 consensus_queue.cc:1048] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:29.016821  1283 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:29.019169  1283 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:29.022507 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:29.023126 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:29.024026 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:29.024757 30623 raft_consensus.cc:1275] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:09:29.025226 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:29.026017 30620 raft_consensus.cc:1275] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:09:29.026810  1410 consensus_queue.cc:1059] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:29.027745  1410 raft_consensus.cc:3055] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:29.028187  1410 raft_consensus.cc:740] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:28.990702 30470 raft_consensus.cc:2468] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 12.
I20260709 13:09:28.892588  1346 consensus_queue.cc:1048] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.057s
W20260709 13:09:29.047860  1523 log.cc:927] Time spent T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:09:29.047216  1410 consensus_queue.cc:260] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:29.048472 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:29.048749  1410 raft_consensus.cc:3060] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:29.049141 30549 raft_consensus.cc:2376] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10. Re-sending same reply.
I20260709 13:09:29.049299 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:29.050267  1414 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:28.942895  1406 raft_consensus.cc:493] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:28.948954  1272 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:29.052173  1406 raft_consensus.cc:515] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:29.053066 30618 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 10.
I20260709 13:09:29.055944 30591 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:29.058714  1348 raft_consensus.cc:2804] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:29.058775 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:29.059196  1348 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.059609  1348 raft_consensus.cc:3060] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:29.058775 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:29.062613  1065 consensus_meta.cc:287] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.542s	user 0.002s	sys 0.005s
I20260709 13:09:29.062537  1243 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:29.063103  1065 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:29.066347 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:28.967674  1261 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:29.068382 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:29.072569 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:29.083861 30591 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:29.092841 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:29.093147  1237 raft_consensus.cc:2804] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:29.093622 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:29.093727  1237 raft_consensus.cc:697] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:29.094373 30472 raft_consensus.cc:2393] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 11: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:29.094189 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:29.094694  1237 consensus_queue.cc:237] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:29.095172 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:29.095381 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:29.096107 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:29.096400 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:29.096454 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:29.097541 30468 raft_consensus.cc:1275] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:09:29.098456 30472 raft_consensus.cc:2393] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 5: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:29.099310 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:29.100479 30550 raft_consensus.cc:1275] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:09:29.097246 30471 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 9.
I20260709 13:09:29.103987  1261 raft_consensus.cc:493] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:29.104630  1261 raft_consensus.cc:515] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:29.106812  1261 leader_election.cc:290] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:29.107751 30618 raft_consensus.cc:1240] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:09:29.086246  1346 consensus_queue.cc:1048] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:09:29.112092 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:29.113787 30476 raft_consensus.cc:1240] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:09:29.096132 31142 raft_consensus.cc:2468] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
I20260709 13:09:29.118381 30441 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:29.123222 30441 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:29.125886 30469 raft_consensus.cc:2368] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 6. Current term is 7.
I20260709 13:09:29.132031 30516 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:29.067857  1499 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:29.068492  1406 leader_election.cc:290] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:29.135764 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:29.135761 30516 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:29.138404  1320 consensus_queue.cc:1048] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:09:29.149832 30543 raft_consensus.cc:2468] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 8.
I20260709 13:09:29.151871 31144 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9.
W20260709 13:09:29.138162  1527 log.cc:927] Time spent T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
W20260709 13:09:29.173713 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 50572us
I20260709 13:09:29.028767  1372 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:29.175956 30441 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:29.070117  1108 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:29.086469  1347 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:29.193413 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:29.194527 30624 raft_consensus.cc:2393] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 7: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:29.134807  1283 raft_consensus.cc:2749] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:29.191131 30517 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:29.192431 30476 raft_consensus.cc:1240] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:09:29.211256 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:29.196942 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:29.203966  1456 raft_consensus.cc:2804] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:29.216302  1456 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:29.216749  1456 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:29.205602  1372 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:29.183199  1357 raft_consensus.cc:2804] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:29.218420  1357 raft_consensus.cc:697] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 9 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:29.219396  1357 consensus_queue.cc:237] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:29.207334 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:29.172107  1414 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:29.177120  1320 raft_consensus.cc:2804] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:29.230899 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:29.231693 30470 raft_consensus.cc:2468] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7.
I20260709 13:09:29.153311  1304 raft_consensus.cc:2749] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:29.234584 30616 raft_consensus.cc:1240] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 6. Current term is 7. Ops: [6.9-6.9]
I20260709 13:09:29.237804 30441 leader_election.cc:304] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:29.150382  1348 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:29.210193 30516 leader_election.cc:304] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:29.250658 30516 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:29.153319  1499 consensus_queue.cc:1048] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:09:29.251668  1358 raft_consensus.cc:2749] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:29.244747 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 53738.7us
W20260709 13:09:29.226161 31116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:29.244103 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 487818us
I20260709 13:09:29.252616  1358 raft_consensus.cc:2804] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:29.256893 30591 leader_election.cc:304] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:29.260138 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:29.262633 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:29.264757 31150 raft_consensus.cc:2393] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 7: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:29.229808  1320 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.265858 30517 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:29.266952 30618 raft_consensus.cc:1240] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:09:29.266937 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:29.265125 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:29.268576 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:29.275929 30517 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:29.277159 30517 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:29.278733  1503 raft_consensus.cc:2749] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:29.279480  1503 raft_consensus.cc:2749] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:29.280122  1503 raft_consensus.cc:2749] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:29.278287 30517 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:29.281997 30517 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:29.283022 30517 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:29.283203  1431 raft_consensus.cc:3060] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:29.283953  1499 raft_consensus.cc:2749] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:29.247014  1406 raft_consensus.cc:2749] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:29.284652  1499 raft_consensus.cc:2804] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:29.289129  1499 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.289520  1499 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:29.259428  1372 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.262013  1261 raft_consensus.cc:2804] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:29.273044  1232 raft_consensus.cc:2804] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:29.301191  1347 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:29.305054 31147 raft_consensus.cc:2468] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 8.
I20260709 13:09:29.319907 30475 raft_consensus.cc:1240] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:29.272920  1320 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:29.261758  1358 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:09:29.331197 31115 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.038s	sys 0.022s
W20260709 13:09:29.342729 31115 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.038s	sys 0.022s
W20260709 13:09:29.350715 30547 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.004s	sys 0.013s
W20260709 13:09:29.351233 30547 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.004s	sys 0.013s
W20260709 13:09:29.351884 31149 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.003s	sys 0.015s
W20260709 13:09:29.352334 31149 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.003s	sys 0.016s
W20260709 13:09:29.355408 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 97793.1us
I20260709 13:09:29.258993 31114 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
W20260709 13:09:29.376127 30440 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.020s	sys 0.023s
I20260709 13:09:29.285755  1503 raft_consensus.cc:2749] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:09:29.377779 30440 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.020s	sys 0.023s
W20260709 13:09:29.377719 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 118787us
I20260709 13:09:29.319397  1261 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:29.320418  1232 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:29.377094  1197 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.011s	sys 0.006s
W20260709 13:09:29.413313 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 110673us
I20260709 13:09:29.414074 30470 raft_consensus.cc:1275] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:09:29.328226  1304 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.420164 30517 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:29.375989  1358 raft_consensus.cc:3060] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:29.422092 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:09:29.412598 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.427137 30624 raft_consensus.cc:2393] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 7: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:29.429419 30545 raft_consensus.cc:2410] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:09:29.421037  1197 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.011s	sys 0.007s
I20260709 13:09:29.401865  1395 raft_consensus.cc:2749] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:29.448887  1272 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:09:29.450472 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.450942 30589 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:09:29.437749  1503 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:29.432125  1304 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:29.413895  1261 raft_consensus.cc:3060] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:29.418831  1232 raft_consensus.cc:3060] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:29.329689  1372 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:29.467877 30517 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:29.384764  1411 consensus_queue.cc:1048] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
W20260709 13:09:29.523492 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 55772.7us
I20260709 13:09:29.525473 30517 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:29.466670  1410 raft_consensus.cc:2749] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:09:29.529819 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 91988.4us
W20260709 13:09:29.536258 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 83298.2us
W20260709 13:09:29.552209 30551 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.001s	sys 0.018s
I20260709 13:09:29.534050  1406 raft_consensus.cc:2749] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:29.540393  1435 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.012s	sys 0.044s
I20260709 13:09:29.536521  1272 raft_consensus.cc:2804] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:09:29.534611  1392 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.008s	sys 0.011s
W20260709 13:09:29.568154 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 117271us
I20260709 13:09:29.553817  1197 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.533061  1503 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:29.563213 30551 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.001s	sys 0.018s
W20260709 13:09:29.566296  1435 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.012s	sys 0.045s
W20260709 13:09:29.590740  1392 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.008s	sys 0.011s
I20260709 13:09:29.600279 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:29.612346 30474 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
I20260709 13:09:29.605077  1385 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:29.601877  1410 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:29.599611  1215 consensus_queue.cc:1048] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:09:29.608978  1108 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:29.605532  1395 consensus_queue.cc:1048] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:09:29.601078  1197 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:29.612958  1385 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:29.642755  1534 log.cc:927] Time spent T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
W20260709 13:09:29.643618  1535 log.cc:927] Time spent T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:09:29.645294  1237 consensus_queue.cc:1059] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:29.624752  1538 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.624117  1499 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:29.651358 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 125996us
I20260709 13:09:29.666998 30517 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:29.654248 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:09:29.655370  1319 consensus_meta.cc:287] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.785s	user 0.011s	sys 0.000s
I20260709 13:09:29.677430 30517 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:29.714725 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
W20260709 13:09:29.717904 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 184275us
I20260709 13:09:29.724591 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:29.684947  1406 raft_consensus.cc:2749] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:29.684413  1272 raft_consensus.cc:697] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:29.737950 31150 raft_consensus.cc:1240] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:29.742172 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:29.745406 31146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48414 (request call id 845) took 1066 ms. Trace:
I20260709 13:09:29.750275 31144 raft_consensus.cc:2468] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 8.
W20260709 13:09:29.735670  1533 log.cc:927] Time spent T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:09:29.729595  1372 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:29.746059 31146 rpcz_store.cc:276] 0709 13:09:28.679444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.679567 (+   123us) service_pool.cc:224] Handling call
0709 13:09:28.690857 (+ 11290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:28.722383 (+ 31526us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:28.722445 (+    62us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:28.732795 (+ 10350us) log.cc:844] Serialized 26 byte log entry
0709 13:09:29.037545 (+304750us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:29.037585 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:29.037644 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:29.745173 (+707529us) raft_consensus.cc:1685] finished
0709 13:09:29.745214 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:29.745349 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8957,"raft.queue_time_us":10484,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":6390,"thread_start_us":291146,"threads_started":1,"wal-append.queue_time_us":658527}
I20260709 13:09:29.762027 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:29.711472  1319 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:29.687438  1538 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:29.757956  1541 log.cc:927] Time spent T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:09:29.761152  1336 raft_consensus.cc:2749] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:29.732555  1108 consensus_queue.cc:1059] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:09:29.750025  1304 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:29.777230 30546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 684) took 1101 ms. Trace:
I20260709 13:09:29.777642 30546 rpcz_store.cc:276] 0709 13:09:28.675907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.676022 (+   115us) service_pool.cc:224] Handling call
0709 13:09:28.687210 (+ 11188us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:28.725385 (+ 38175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:28.725428 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:28.742280 (+ 16852us) log.cc:844] Serialized 26 byte log entry
0709 13:09:29.235680 (+493400us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:29.615295 (+379615us) log.cc:844] Serialized 14 byte log entry
0709 13:09:29.626750 (+ 11455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:29.627596 (+   846us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:29.777026 (+149430us) raft_consensus.cc:1685] finished
0709 13:09:29.777046 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:29.777174 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1434,"prepare.queue_time_us":449217,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":39597,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":19142,"spinlock_wait_cycles":33280,"thread_start_us":835842,"threads_started":2,"wal-append.queue_time_us":742168}
I20260709 13:09:29.780433 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:29.783937  1572 raft_consensus.cc:2749] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:29.784359  1544 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:29.785038 31148 raft_consensus.cc:2368] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 8. Current term is 9.
I20260709 13:09:29.784914  1544 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:29.766935  1540 log.cc:927] Time spent T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
W20260709 13:09:29.786739 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 109718us
I20260709 13:09:29.787479 30517 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:29.765868  1395 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.797582  1406 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:29.806084  1548 log.cc:927] Time spent T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 13:09:29.813226 30517 leader_election.cc:304] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:29.801386  1572 raft_consensus.cc:2749] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:29.811228 30547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 686) took 1134 ms. Trace:
W20260709 13:09:29.820902 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 281957us
I20260709 13:09:29.796303  1272 consensus_queue.cc:237] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:29.827433 30473 raft_consensus.cc:2468] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 8.
W20260709 13:09:29.829536  1561 log.cc:927] Time spent T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:09:29.833268  1542 log.cc:927] Time spent T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
W20260709 13:09:29.836302  1559 log.cc:927] Time spent T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
W20260709 13:09:29.833716  1547 log.cc:927] Time spent T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:09:29.834052  1562 consensus_queue.cc:1059] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:09:29.837985 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:29.798537  1395 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:29.844605 30441 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:29.846766 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:29.851167 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:29.823230 30547 rpcz_store.cc:276] 0709 13:09:28.676496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.701767 (+ 25271us) service_pool.cc:224] Handling call
0709 13:09:28.733600 (+ 31833us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:28.733920 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:28.733947 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:28.743093 (+  9146us) log.cc:844] Serialized 26 byte log entry
0709 13:09:29.351707 (+608614us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:29.760702 (+408995us) log.cc:844] Serialized 14 byte log entry
0709 13:09:29.760968 (+   266us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:29.761072 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:29.808382 (+ 47310us) raft_consensus.cc:1685] finished
0709 13:09:29.808401 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:29.810783 (+  2382us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7165,"prepare.queue_time_us":388734,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":2287,"raft.queue_time_us":15823,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":8060,"thread_start_us":917435,"threads_started":2,"wal-append.queue_time_us":782514}
I20260709 13:09:29.857951 30547 pending_rounds.cc:85] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd: Aborting all ops after (but not including) 5
I20260709 13:09:29.858211 30547 pending_rounds.cc:107] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:09:29.858449 30547 raft_consensus.cc:2889] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:29.819406  1197 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:29.808115  1304 consensus_queue.cc:1048] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:09:29.862458 31145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48414 (request call id 844) took 1203 ms. Trace:
I20260709 13:09:29.865628 31150 raft_consensus.cc:1275] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:09:29.875801  1574 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
W20260709 13:09:29.876130  1551 log.cc:927] Time spent T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
W20260709 13:09:29.876549  1576 log.cc:927] Time spent T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:09:29.876516  1574 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:29.878108 30542 raft_consensus.cc:1240] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:29.880285  1319 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:29.865147  1572 raft_consensus.cc:2749] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:29.882022  1572 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.882423  1572 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:29.878196  1556 log.cc:927] Time spent T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
W20260709 13:09:29.887187  1456 consensus_meta.cc:287] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.670s	user 0.011s	sys 0.000s
I20260709 13:09:29.888777  1544 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:29.889096  1572 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:29.889621  1572 raft_consensus.cc:493] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:29.890110  1572 raft_consensus.cc:515] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:29.892496  1581 log.cc:927] Time spent T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:09:29.896728  1538 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:29.897437  1395 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:29.900625  1558 log.cc:927] Time spent T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.171s	user 0.002s	sys 0.000s
I20260709 13:09:29.887614  1456 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:29.904498  1537 log.cc:927] Time spent T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.290s	user 0.001s	sys 0.001s
I20260709 13:09:29.906451 31149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48426 (request call id 726) took 1249 ms. Trace:
I20260709 13:09:29.906819 31149 rpcz_store.cc:276] 0709 13:09:28.657219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.657633 (+   414us) service_pool.cc:224] Handling call
0709 13:09:28.666183 (+  8550us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:28.684394 (+ 18211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:28.684424 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:28.699649 (+ 15225us) log.cc:844] Serialized 26 byte log entry
0709 13:09:29.378973 (+679324us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:29.379014 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:29.379085 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:29.903703 (+524618us) spinlock_profiling.cc:243] Waited 3.88 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:09:29.906117 (+  2414us) raft_consensus.cc:1685] finished
0709 13:09:29.906147 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:29.906386 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3141,"raft.queue_time_us":4294,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":7954,"spinlock_wait_cycles":8915328,"thread_start_us":611330,"threads_started":1,"wal-append.queue_time_us":835261}
W20260709 13:09:29.909010  1550 log.cc:927] Time spent T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 13:09:29.910398 30551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 681) took 1235 ms. Trace:
I20260709 13:09:29.911075  1065 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:29.866048 31145 rpcz_store.cc:276] 0709 13:09:28.658654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.658829 (+   175us) service_pool.cc:224] Handling call
0709 13:09:28.665602 (+  6773us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:28.694258 (+ 28656us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:28.694289 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:28.726399 (+ 32110us) log.cc:844] Serialized 26 byte log entry
0709 13:09:29.153710 (+427311us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:29.153876 (+   166us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:29.153944 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:29.862170 (+708226us) raft_consensus.cc:1685] finished
0709 13:09:29.862199 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:29.862383 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21317,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":8938,"thread_start_us":396861,"threads_started":1,"wal-append.queue_time_us":799236}
I20260709 13:09:29.913268   973 raft_consensus.cc:3055] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:29.913784   973 raft_consensus.cc:740] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
W20260709 13:09:29.903052   975 consensus_meta.cc:287] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.964s	user 0.009s	sys 0.001s
I20260709 13:09:29.925217   975 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:29.926433 30472 raft_consensus.cc:1240] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:09:29.819653  1406 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:29.852344  1499 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:29.933143  1346 raft_consensus.cc:3055] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:29.901964 30468 raft_consensus.cc:1275] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:29.933610  1346 raft_consensus.cc:740] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:29.923373   973 consensus_queue.cc:260] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:29.924431 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 146661us
I20260709 13:09:29.924041 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:29.934950 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:29.935669 30542 raft_consensus.cc:2468] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 6.
I20260709 13:09:29.910766 30551 rpcz_store.cc:276] 0709 13:09:28.674834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.674935 (+   101us) service_pool.cc:224] Handling call
0709 13:09:28.691406 (+ 16471us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:28.697845 (+  6439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:28.697878 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:29.021038 (+323160us) spinlock_profiling.cc:243] Waited 3.94 ms on lock 0x7b2c000f5468. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc782861a11 00007fc782871372 00007fc783fa3a01 00007fc783f6843a 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2
0709 13:09:29.021589 (+   551us) log.cc:844] Serialized 26 byte log entry
0709 13:09:29.600785 (+579196us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:29.600860 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:29.601089 (+   229us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:29.910085 (+308996us) raft_consensus.cc:1685] finished
0709 13:09:29.910104 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:29.910338 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2289,"raft.queue_time_us":2427,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":27901,"spinlock_wait_cycles":9069696,"thread_start_us":575257,"threads_started":1,"wal-append.queue_time_us":641765}
I20260709 13:09:29.932634  1243 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:29.933009  1406 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:29.919507 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.937188   973 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:29.937104  1346 consensus_queue.cc:260] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:29.942732 30476 raft_consensus.cc:1240] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 7. Current term is 8. Ops: []
W20260709 13:09:29.935237  1431 consensus_meta.cc:287] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.652s	user 0.009s	sys 0.002s
I20260709 13:09:29.967042 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:29.968464 30542 raft_consensus.cc:3060] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:29.958658 31116 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
W20260709 13:09:29.966214 30360 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 5610a33c644c4e539ad503631763aa40 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica fe2b7d73f8c743c1ba570cfd981c4e79 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:09:29.974545  1431 raft_consensus.cc:2749] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:29.976526  1410 raft_consensus.cc:2749] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:29.971259  1539 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:29.978332  1539 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:29.980014  1574 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:29.981158  1539 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:29.981314 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:29.981472  1456 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:29.979269  1232 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:29.984977  1346 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:29.988085  1261 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:29.988144  1232 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:29.988675   975 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:29.942121  1562 raft_consensus.cc:3055] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:09:30.001036 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 141573us
I20260709 13:09:30.019927 30516 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:30.002859  1572 leader_election.cc:290] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:30.029170 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 55064.1us
I20260709 13:09:30.012498  1562 raft_consensus.cc:740] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:30.035189 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:30.096524 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:30.097496 31149 raft_consensus.cc:2393] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 7: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
W20260709 13:09:30.097527 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 47242us
I20260709 13:09:30.098094 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:30.098790 31146 raft_consensus.cc:3060] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:30.112425  1592 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:30.113075  1592 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:30.115337  1592 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:30.120689  1261 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:30.121613  1562 consensus_queue.cc:260] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:30.123304  1562 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:30.126350  1320 consensus_meta.cc:287] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.742s	user 0.006s	sys 0.005s
I20260709 13:09:30.140574 30542 raft_consensus.cc:2468] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 9.
W20260709 13:09:30.148977 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.027952  1565 consensus_queue.cc:1059] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 13:09:30.032413  1499 consensus_queue.cc:1059] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.098s
I20260709 13:09:30.164517 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:30.168412 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:30.171949 30543 raft_consensus.cc:3060] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:09:30.126745  1320 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:30.158767  1592 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:30.185357 31146 raft_consensus.cc:2468] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
W20260709 13:09:30.174588  1358 consensus_meta.cc:287] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.675s	user 0.011s	sys 0.000s
I20260709 13:09:30.182369  1565 consensus_queue.cc:1243] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer 092f6eb694fc4bbeab49677cccd880fd log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:09:30.204191  1592 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:30.205323 30545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39952 (request call id 1861) took 1176 ms. Trace:
I20260709 13:09:30.206996 30543 raft_consensus.cc:2468] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 7.
I20260709 13:09:30.207636 30545 rpcz_store.cc:276] 0709 13:09:29.029353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.044750 (+ 15397us) service_pool.cc:224] Handling call
0709 13:09:30.196122 (+1151372us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b54001450d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:30.205237 (+  9115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":809107712}
I20260709 13:09:30.215035 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:30.216578 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:30.217180 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:30.209343  1592 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:30.230794 30544 raft_consensus.cc:2468] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 7.
I20260709 13:09:30.232393  1320 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:30.231900 30543 raft_consensus.cc:2393] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 11: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:30.232708 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:30.233361 30544 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 7.
I20260709 13:09:30.234021 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:30.235563 30544 raft_consensus.cc:1240] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:30.235908  1272 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:30.219305 30547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 1873) took 1081 ms. Trace:
I20260709 13:09:30.221449 30473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2225) took 1386 ms. Trace:
I20260709 13:09:30.220846 30549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 1869) took 1132 ms. Trace:
I20260709 13:09:30.238775 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:30.228163 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:30.240926 30542 raft_consensus.cc:2368] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 8. Current term is 9.
I20260709 13:09:30.240341 30473 rpcz_store.cc:276] 0709 13:09:28.834960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.949182 (+114222us) service_pool.cc:224] Handling call
0709 13:09:30.221292 (+1272110us) spinlock_profiling.cc:243] Waited 462 ms on lock 0x7b5400043654. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:30.221392 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1061614976}
I20260709 13:09:30.216701 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:30.242590 30545 raft_consensus.cc:2410] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:09:30.237752 30547 rpcz_store.cc:276] 0709 13:09:29.137812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.857393 (+719581us) service_pool.cc:224] Handling call
0709 13:09:29.857742 (+   349us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:30.003407 (+145665us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:30.003435 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:30.004129 (+   694us) log.cc:844] Serialized 52 byte log entry
0709 13:09:30.161576 (+157447us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:30.161628 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:30.161730 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:30.218952 (+ 57222us) raft_consensus.cc:1685] finished
0709 13:09:30.218979 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:30.219135 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":41206,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":111,"thread_start_us":281108,"threads_started":2,"wal-append.queue_time_us":198668}
I20260709 13:09:30.225282 30374 catalog_manager.cc:5697] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
I20260709 13:09:30.229588  1092 raft_consensus.cc:993] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6: : Instructing follower f639301059e24dc5b0d88a46dc683326 to start an election
I20260709 13:09:30.250277  1092 raft_consensus.cc:1081] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 7 LEADER]: Signalling peer f639301059e24dc5b0d88a46dc683326 to start an election
I20260709 13:09:30.250608 30547 raft_consensus.cc:1275] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:30.243181  1584 raft_consensus.cc:2749] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:30.251124 30374 catalog_manager.cc:5697] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 2 to 3, leader changed from cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 3 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:30.239058 30549 rpcz_store.cc:276] 0709 13:09:29.088678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.101181 (+ 12503us) service_pool.cc:224] Handling call
0709 13:09:29.737481 (+636300us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b5800028598. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780e43b71 00007fc780e43a22 00007fc789d5cc09 00007fc788eb6ee0 00007fc788f800ab 00007fc788f80131 00007fc788f41fc0 00007fc788f2c929 00007fc788f2c3d2 00007fc7824a3bd4
0709 13:09:29.737694 (+   213us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:29.854018 (+116324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:29.854053 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:29.854550 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 13:09:30.015416 (+160866us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:30.015475 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:30.015570 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:30.220506 (+204936us) raft_consensus.cc:1685] finished
0709 13:09:30.220532 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:30.220780 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25766,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":5023,"spinlock_wait_cycles":27921792,"thread_start_us":253883,"threads_started":2,"wal-append.queue_time_us":312683}
I20260709 13:09:30.236428  1272 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:30.265451 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 153051us
I20260709 13:09:30.269369  1565 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:30.270141  1565 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:30.235936  1237 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:30.243494  1506 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.193881  1358 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:30.279371  1358 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:30.280146 30543 raft_consensus.cc:2468] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 5.
I20260709 13:09:30.292824  1565 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:30.299036  1604 raft_consensus.cc:493] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.300959  1604 raft_consensus.cc:515] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:30.253405 30374 catalog_manager.cc:5697] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 3 to 6, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 6 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:30.309888  1604 leader_election.cc:290] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:30.310732  1272 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:30.283592  1506 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:30.276046  1237 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:30.319325 30546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 1874) took 1165 ms. Trace:
I20260709 13:09:30.319921 30546 rpcz_store.cc:276] 0709 13:09:29.154248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.859009 (+704761us) service_pool.cc:224] Handling call
0709 13:09:29.859340 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:30.019004 (+159664us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:30.019024 (+    20us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:30.024351 (+  5327us) log.cc:844] Serialized 26 byte log entry
0709 13:09:30.240851 (+216500us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:30.240882 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:30.240953 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:30.318996 (+ 78043us) raft_consensus.cc:1685] finished
0709 13:09:30.319023 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:30.319243 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":40719,"raft.run_cpu_time_us":63,"raft.run_wall_time_us":64,"thread_start_us":366612,"threads_started":2,"wal-append.queue_time_us":260914}
I20260709 13:09:30.320945  1237 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:30.321688 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:30.322310 30546 raft_consensus.cc:2468] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 6.
I20260709 13:09:30.315570  1506 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:30.349648 31143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:42956 (request call id 7) took 1590 ms. Trace:
I20260709 13:09:30.350275 31143 rpcz_store.cc:276] 0709 13:09:28.749733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.749859 (+   126us) service_pool.cc:224] Handling call
0709 13:09:30.337874 (+1588015us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b5400694c20. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783ee5520 00007fc783f62652 00007fc788f3060a 00007fc7824b67d4 00007fc7824b6762 00007fc7824b6691 00007fc7824b660c 00007fc7824b58c2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:30.339787 (+  1913us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":993575168}
I20260709 13:09:30.354763 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:30.358528  1503 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:30.361519 31114 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:30.364596  1092 raft_consensus.cc:2749] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:30.363466 31114 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:30.366107 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:30.366451  1411 raft_consensus.cc:993] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6: : Instructing follower f639301059e24dc5b0d88a46dc683326 to start an election
I20260709 13:09:30.366941  1358 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:30.367089  1411 raft_consensus.cc:2804] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:30.367724  1411 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.367549  1358 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:30.368363  1411 raft_consensus.cc:3060] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:30.370945  1320 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.371553  1320 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:30.371984  1536 raft_consensus.cc:1081] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Signalling peer f639301059e24dc5b0d88a46dc683326 to start an election
I20260709 13:09:30.374080  1320 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:30.374742  1320 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.381604 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:30.383965 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:30.385826 30516 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:30.386656 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:30.388000 31114 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:30.392249 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:30.392378 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:30.393211 31146 raft_consensus.cc:2468] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 7.
I20260709 13:09:30.395929 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:30.396932 31145 raft_consensus.cc:2393] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 8: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:30.370424  1358 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:30.395074 31114 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:30.398442 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:30.398980 30620 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:30.399582 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:30.401069 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:30.401715 30625 raft_consensus.cc:2468] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 5.
I20260709 13:09:30.402534 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:30.404479 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:30.405521 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:30.375308  1320 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:30.355647  1406 raft_consensus.cc:3055] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:30.408227 30469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2229) took 1562 ms. Trace:
I20260709 13:09:30.408617 30469 rpcz_store.cc:276] 0709 13:09:28.852791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.954851 (+102060us) service_pool.cc:224] Handling call
0709 13:09:30.408088 (+1453237us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b5400121bd4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:30.408181 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":363174144}
W20260709 13:09:30.409694 30589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.410419 30590 leader_election.cc:304] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:30.392138  1503 raft_consensus.cc:2749] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:30.415637  1320 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:30.416949 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:30.417326 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:30.417920 30622 raft_consensus.cc:2468] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 7.
W20260709 13:09:30.422485 30517 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.039s (SENT) [suppressed 15 similar messages]
W20260709 13:09:30.424347 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 579791us
I20260709 13:09:30.424592 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:30.426708 31115 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:30.428087  1506 raft_consensus.cc:2804] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:30.428195  1570 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:30.428515  1506 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:30.402922  1539 raft_consensus.cc:2804] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:30.433512 30472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 1780) took 1222 ms. Trace:
I20260709 13:09:30.439399 30472 rpcz_store.cc:276] 0709 13:09:29.211422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.211539 (+   117us) service_pool.cc:224] Handling call
0709 13:09:29.215087 (+  3548us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:29.926792 (+711705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:30.433348 (+506556us) spinlock_profiling.cc:243] Waited 711 ms on lock 0x7b540029b3d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:30.433468 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1635381120}
I20260709 13:09:30.440774  1544 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:30.441313  1544 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:30.428930  1506 raft_consensus.cc:3060] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:30.443287  1544 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:30.443888 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:30.444414 30470 raft_consensus.cc:3060] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:30.410050  1092 raft_consensus.cc:2804] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:30.444895  1092 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.444928 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:30.445361  1092 raft_consensus.cc:3060] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:30.447980 30474 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67"
dest_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:60026
I20260709 13:09:30.448462 30474 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:30.448765 30474 raft_consensus.cc:3060] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:30.438186   973 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.449543   973 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:30.452337 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:30.452643 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:30.452414 30471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e"
dest_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:60026
I20260709 13:09:30.434470 31115 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:30.454571 30471 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:30.454926 30471 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:30.458897  1108 consensus_queue.cc:1059] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:30.460286 30440 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:30.460582  1414 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:30.461057  1414 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:30.461387 30440 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:30.461547  1348 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:30.462213 30440 leader_election.cc:304] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:30.462419  1197 raft_consensus.cc:2749] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:30.463069  1197 raft_consensus.cc:2804] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:30.463559  1197 raft_consensus.cc:697] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 7 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:30.463824  1538 raft_consensus.cc:3055] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:30.408015  1406 raft_consensus.cc:740] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:30.464838  1538 raft_consensus.cc:740] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:30.463263 30440 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:09:30.464569 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 43867.7us
I20260709 13:09:30.471138 31143 raft_consensus.cc:2468] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
I20260709 13:09:30.471905 30542 raft_consensus.cc:1275] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:30.474408 30440 leader_election.cc:400] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 election: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 8. Current term is 9.
I20260709 13:09:30.474836 30440 leader_election.cc:403] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:09:30.472282 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:30.478854 30620 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 11.
W20260709 13:09:30.478924 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 44512.1us
I20260709 13:09:30.473129 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:30.480185 30441 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:30.486424 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:30.487614 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:30.488353 30549 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 7.
W20260709 13:09:30.491581 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 69120.3us
I20260709 13:09:30.496635 30517 leader_election.cc:400] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 6. Current term is 7.
I20260709 13:09:30.496927 30517 leader_election.cc:403] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:30.493093 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:30.497925 30517 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:30.500492 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:30.501076 30620 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 7.
I20260709 13:09:30.501500 30470 raft_consensus.cc:2468] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 9.
I20260709 13:09:30.478281  1456 raft_consensus.cc:2804] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:30.504243 30618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47446 (request call id 2300) took 1342 ms. Trace:
I20260709 13:09:30.482197  1539 raft_consensus.cc:697] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 9 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:30.484368  1407 raft_consensus.cc:2749] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:30.505645 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:30.465065  1197 consensus_queue.cc:237] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:30.539182 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:30.499035  1503 raft_consensus.cc:2749] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 6. Current term is 7.
I20260709 13:09:30.502871   975 raft_consensus.cc:2749] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 8. Current term is 9.
I20260709 13:09:30.498795   973 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:30.549185 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:30.505877 30618 rpcz_store.cc:276] 0709 13:09:29.156323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.156521 (+   198us) service_pool.cc:224] Handling call
0709 13:09:29.183182 (+ 26661us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:29.270038 (+ 86856us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:30.498722 (+1228684us) spinlock_profiling.cc:243] Waited 83.5 ms on lock 0x7b54003458d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:30.498888 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":191946624}
I20260709 13:09:30.504505  1595 raft_consensus.cc:2749] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:30.560058 30547 raft_consensus.cc:2468] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 10.
I20260709 13:09:30.576130 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:30.578576 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:30.579130 30475 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:09:30.584698 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:30.585433 30546 raft_consensus.cc:2393] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 10: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:30.498586  1320 consensus_queue.cc:1048] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:09:30.548004  1566 raft_consensus.cc:2749] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:30.566943 30474 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:30.597559 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:30.600660 30517 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
W20260709 13:09:30.602125 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 95814.8us
I20260709 13:09:30.505853  1456 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.608364 31116 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:30.608786 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:30.609362 30469 raft_consensus.cc:2468] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 10.
I20260709 13:09:30.598747  1570 raft_consensus.cc:2749] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:30.499177  1406 consensus_queue.cc:260] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:30.611951  1610 log.cc:927] Time spent T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:09:30.612270  1406 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:30.620101  1407 raft_consensus.cc:2749] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:30.620919  1539 consensus_queue.cc:237] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:30.625880 30470 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 7.
I20260709 13:09:30.628387 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:30.628934 30547 raft_consensus.cc:3060] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:30.605083  1503 raft_consensus.cc:2749] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:30.629662 30471 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:30.632951  1552 log.cc:927] Time spent T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.947s	user 0.006s	sys 0.000s
I20260709 13:09:30.634953  1385 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:30.610499  1456 raft_consensus.cc:3060] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:30.639973  1595 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:30.548616  1538 consensus_queue.cc:260] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:30.641613 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 107680us
I20260709 13:09:30.642663 30471 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:30.644650 30550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 1871) took 1555 ms. Trace:
I20260709 13:09:30.627861  1411 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:30.649780 31114 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:30.647428  1092 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:30.650781 30550 rpcz_store.cc:276] 0709 13:09:29.089252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.101169 (+ 11917us) service_pool.cc:224] Handling call
0709 13:09:29.101471 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:29.101787 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:29.101814 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:29.102256 (+   442us) log.cc:844] Serialized 26 byte log entry
0709 13:09:29.531872 (+429616us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:29.531969 (+    97us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:29.532061 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:30.621095 (+1089034us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:09:30.644370 (+ 23275us) raft_consensus.cc:1685] finished
0709 13:09:30.644392 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:30.644596 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":77,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"spinlock_wait_cycles":64271104,"thread_start_us":428755,"threads_started":1,"wal-append.queue_time_us":525227}
I20260709 13:09:30.652400  1595 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:30.670672  1595 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:30.671489  1092 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:30.672366 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:30.673642 30616 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 9.
I20260709 13:09:30.657702  1538 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:30.657226  1283 raft_consensus.cc:2749] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:30.676826 30475 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 11.
I20260709 13:09:30.663937  1411 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:30.680517  1319 raft_consensus.cc:2804] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:30.680945  1319 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.681300  1319 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:30.681471 30547 raft_consensus.cc:2468] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 5.
I20260709 13:09:30.682381 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:30.683828  1574 raft_consensus.cc:493] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.684274  1574 raft_consensus.cc:515] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:30.686645  1574 leader_election.cc:290] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:30.687523 30547 raft_consensus.cc:1240] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:30.665249  1506 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:30.688750 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:30.683724 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:30.695235 30550 raft_consensus.cc:3060] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:30.692847 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:30.693864 30440 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:30.697530 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:30.698179 30471 raft_consensus.cc:2376] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 8. Re-sending same reply.
I20260709 13:09:30.699268 30475 raft_consensus.cc:2393] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 5: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:30.702747 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:30.701495 30440 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:30.706240 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:30.706785 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:30.707285   870 raft_consensus.cc:2749] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:30.710675  1620 consensus_queue.cc:1059] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:30.711591  1599 raft_consensus.cc:3055] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:30.711949  1599 raft_consensus.cc:740] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:30.712925 31146 raft_consensus.cc:2393] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 6: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:30.712741  1599 consensus_queue.cc:260] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:30.713915  1599 raft_consensus.cc:3060] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:30.714243  1506 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:30.708341  1283 consensus_queue.cc:1048] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:09:30.717978 30516 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
W20260709 13:09:30.718400 31113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.719563  1410 raft_consensus.cc:2804] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:30.719980  1410 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.720314  1410 raft_consensus.cc:3060] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:30.723217 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:30.719431 30516 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:30.708582 30440 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:30.708734   975 raft_consensus.cc:2804] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:30.729157 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:30.731171 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:30.731967 31143 raft_consensus.cc:2368] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 8. Current term is 9.
I20260709 13:09:30.732892 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:30.736775 31143 raft_consensus.cc:1275] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:30.736856 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:30.737574 31142 raft_consensus.cc:2468] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 5.
I20260709 13:09:30.738585 31143 raft_consensus.cc:1275] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:30.726450  1570 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:30.742777 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:30.742624  1570 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:30.733001   975 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.733453  1456 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:30.743981   975 raft_consensus.cc:3060] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:30.744570 30476 raft_consensus.cc:2368] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 8. Current term is 9.
I20260709 13:09:30.747484  1456 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:30.733197  1499 raft_consensus.cc:2804] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:30.752836 30550 raft_consensus.cc:2468] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 7.
I20260709 13:09:30.754817 31149 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6646800b690458391bbff6a6bba535c"
dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
mode: GRACEFUL
new_leader_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:42956
I20260709 13:09:30.755453 31149 raft_consensus.cc:606] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 8 LEADER]: Received request to transfer leadership to TS f639301059e24dc5b0d88a46dc683326
I20260709 13:09:30.755141 31114 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:09:30.734170  1283 raft_consensus.cc:2804] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:30.757787 30441 leader_election.cc:400] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 election: Vote denied by peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453) with higher term. Message: Invalid argument: T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 8. Current term is 9.
I20260709 13:09:30.975353 30441 leader_election.cc:403] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:09:30.793013 30467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 768) took 1023 ms. Trace:
I20260709 13:09:30.939944  1414 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:30.827339 30474 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:30.976649  1456 raft_consensus.cc:3060] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:30.777426 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:30.976260 30467 rpcz_store.cc:276] 0709 13:09:29.769429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.880854 (+111425us) service_pool.cc:224] Handling call
0709 13:09:29.881139 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:30.429247 (+548108us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:30.429275 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:30.429685 (+   410us) log.cc:844] Serialized 26 byte log entry
0709 13:09:30.653189 (+223504us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:30.653246 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:30.653354 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:30.792826 (+139472us) raft_consensus.cc:1685] finished
0709 13:09:30.792844 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:30.792960 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":547774,"raft.queue_time_us":548445,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":8562,"thread_start_us":206034,"threads_started":1,"wal-append.queue_time_us":292794}
I20260709 13:09:30.804211 31147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48414 (request call id 846) took 1075 ms. Trace:
W20260709 13:09:30.805220 31148 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48412 (request call id 654) took 1547 ms (client timeout 1725 ms). Trace:
I20260709 13:09:30.836160 31146 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 8.
I20260709 13:09:30.780476 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:30.986101 31142 raft_consensus.cc:2393] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 9: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
W20260709 13:09:30.986202 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 230396us
W20260709 13:09:30.984614 31148 rpcz_store.cc:269] 0709 13:09:29.257547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.257671 (+   124us) service_pool.cc:224] Handling call
0709 13:09:30.805039 (+1547368us) spinlock_profiling.cc:243] Waited 506 ms on lock 0x7b5400477cd4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:30.805154 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1164128128}
I20260709 13:09:30.778594 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:30.989969 30551 raft_consensus.cc:3060] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:09:30.989775 30441 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:09:30.993919 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 163433us
W20260709 13:09:30.994812 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.984295 31147 rpcz_store.cc:276] 0709 13:09:29.728391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.728544 (+   153us) service_pool.cc:224] Handling call
0709 13:09:29.736864 (+  8320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:29.805743 (+ 68879us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:29.805776 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:29.812827 (+  7051us) log.cc:844] Serialized 26 byte log entry
0709 13:09:29.853653 (+ 40826us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:29.853699 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:30.803860 (+950161us) spinlock_profiling.cc:243] Waited 55.9 ms on lock 0x7b54006eee54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:30.803907 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:30.803950 (+    43us) raft_consensus.cc:1685] finished
0709 13:09:30.803963 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:30.804153 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4623,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":4390,"spinlock_wait_cycles":128480512,"thread_start_us":38867,"threads_started":1,"wal-append.queue_time_us":159201}
W20260709 13:09:30.839159  1626 log.cc:927] Time spent T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:09:30.808051  1431 raft_consensus.cc:993] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6: : Instructing follower f639301059e24dc5b0d88a46dc683326 to start an election
I20260709 13:09:30.838692  1385 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:30.778924  1543 raft_consensus.cc:2804] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:30.759872  1499 raft_consensus.cc:697] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 5 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:31.015314 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:30.781543   870 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:30.997056  1261 raft_consensus.cc:2804] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:31.024482 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:31.017536  1065 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:30.975244  1410 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:31.025748 30468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 1778) took 1816 ms. Trace:
I20260709 13:09:31.013144  1372 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:31.015872  1544 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:31.026119 30468 rpcz_store.cc:276] 0709 13:09:29.210662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.210778 (+   116us) service_pool.cc:224] Handling call
0709 13:09:29.211048 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:29.933742 (+722694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:31.025522 (+1091780us) spinlock_profiling.cc:243] Waited 691 ms on lock 0x7b5400175cd4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:31.025691 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1588157824}
I20260709 13:09:30.902879  1319 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:31.027266 30544 raft_consensus.cc:2393] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 8: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:31.030814  1536 raft_consensus.cc:1081] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 7 LEADER]: Signalling peer f639301059e24dc5b0d88a46dc683326 to start an election
I20260709 13:09:31.025254 29364 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:09:30.994467  1357 consensus_queue.cc:1048] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:09:31.023531  1261 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.028009  1065 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:31.046584  1065 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:31.050902 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 640487us
I20260709 13:09:31.050969 30516 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:31.026988  1543 raft_consensus.cc:697] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 7 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:31.028811  1592 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.052726 30516 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:31.054634 30516 leader_election.cc:304] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:31.021610  1385 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:31.042583  1372 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:31.041285  1544 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:31.058885  1503 raft_consensus.cc:2749] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:31.059584  1372 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:31.059899  1544 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:31.061424 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:31.059908  1595 raft_consensus.cc:2804] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:31.062215  1595 raft_consensus.cc:697] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 11 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:31.062330 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:31.062878 31146 raft_consensus.cc:3060] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:31.063066  1595 consensus_queue.cc:237] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:31.052513  1577 raft_consensus.cc:2804] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:31.064241  1577 raft_consensus.cc:697] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:31.064759  1385 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:31.065121  1577 consensus_queue.cc:237] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:31.053640  1584 raft_consensus.cc:2749] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:31.059979  1406 consensus_queue.cc:1059] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:31.048079  1261 raft_consensus.cc:3060] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:31.025575   870 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:31.069772 31146 raft_consensus.cc:2468] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 8.
I20260709 13:09:31.072722 30516 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:31.073748 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:31.073863 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:31.074329 30616 raft_consensus.cc:3060] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:31.077895 30617 raft_consensus.cc:2410] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:31.078734 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:31.047852   975 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:31.061451  1410 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:31.086040  1058 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.089687  1058 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:31.091996 30616 raft_consensus.cc:2468] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 6.
I20260709 13:09:31.093559 31115 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:31.080085  1503 raft_consensus.cc:2804] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:31.105254 31115 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:09:31.103382 29364 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:31.068687  1592 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:31.110781 31115 leader_election.cc:304] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:31.079314  1392 consensus_queue.cc:1048] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:09:31.106719  1573 raft_consensus.cc:2749] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:31.112643  1401 raft_consensus.cc:2749] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:31.114421  1431 raft_consensus.cc:2804] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:31.080888  1499 consensus_queue.cc:237] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:31.079244  1543 consensus_queue.cc:237] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:31.113583  1503 raft_consensus.cc:697] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 8 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:31.143365  1578 raft_consensus.cc:3055] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:31.149219  1431 raft_consensus.cc:697] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 6 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
W20260709 13:09:31.155988 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 83325.2us
I20260709 13:09:31.176754 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:31.183934 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:31.183216 30543 raft_consensus.cc:1275] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:31.184621 30547 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:31.183833 30617 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:31.167254  1456 raft_consensus.cc:2749] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453) with higher term. Message: Invalid argument: T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 8. Current term is 9.
I20260709 13:09:31.165969  1319 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:31.164877  1578 raft_consensus.cc:740] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:31.174616  1283 raft_consensus.cc:697] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 5 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:31.199028 30551 raft_consensus.cc:2468] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9.
I20260709 13:09:31.152410   870 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:31.191417 30591 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:31.202616 30517 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:31.204708 30547 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 8.
I20260709 13:09:31.212700 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:31.213176 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:31.213532  1240 raft_consensus.cc:2764] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:09:31.213680 31143 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:31.214249  1630 raft_consensus.cc:2804] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:31.214685  1630 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.214996  1630 raft_consensus.cc:3060] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:31.205715  1456 raft_consensus.cc:493] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:31.216882  1456 raft_consensus.cc:515] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:31.218962  1456 leader_election.cc:290] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:31.219444 31147 raft_consensus.cc:2468] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 5.
I20260709 13:09:31.220216 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:31.219936  1283 consensus_queue.cc:237] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:31.225919 31143 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9.
I20260709 13:09:31.220220 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:31.229975 31142 raft_consensus.cc:3060] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:31.224895 30374 catalog_manager.cc:5697] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:31.241197 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 165274us
I20260709 13:09:31.191035  1407 consensus_queue.cc:1048] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:09:31.246026 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:31.225201   975 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:31.187513  1503 consensus_queue.cc:237] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:31.266072  1506 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:31.261857  1578 consensus_queue.cc:260] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:31.269268  1506 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:31.269905  1578 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:31.274600  1261 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:31.275911  1215 consensus_queue.cc:1059] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:31.261736  1431 consensus_queue.cc:237] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:31.278604 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:31.278676 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:31.282271  1392 consensus_queue.cc:1048] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:31.282933 30472 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695"
dest_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:60026
I20260709 13:09:31.283496 30472 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:31.283668 31114 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:31.285797 30468 raft_consensus.cc:1275] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:31.283876 30472 raft_consensus.cc:3060] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:31.286757 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:31.287338 30467 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:31.288179  1240 raft_consensus.cc:3055] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:31.288602  1240 raft_consensus.cc:740] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:31.289394  1240 consensus_queue.cc:260] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:31.290529  1240 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:31.292017  1347 consensus_queue.cc:1175] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f639301059e24dc5b0d88a46dc683326" responder_term: 12 status { last_received { term: 12 index: 6 } last_committed_idx: 5 last_received_current_leader { term: 12 index: 6 } }
I20260709 13:09:31.271677  1506 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:31.296626 30472 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:31.292271  1456 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.300671 30617 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 8.
I20260709 13:09:31.302032 31115 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:31.304670 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 59228.9us
I20260709 13:09:31.320528 30517 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:31.321851 30440 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:31.323606 30517 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:31.325320 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 274887us
I20260709 13:09:31.325785 30472 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:31.326349 30589 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
W20260709 13:09:31.327191 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 99564.7us
I20260709 13:09:31.264611  1566 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:31.291965  1632 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.338619 30517 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:31.340940 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:31.319340  1592 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:31.332031  1410 raft_consensus.cc:2749] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:31.344754 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:09:31.343802 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 103158us
I20260709 13:09:31.346509 30441 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:31.346828 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:31.354997 30517 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:31.359606 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:31.360385 30472 raft_consensus.cc:2393] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 8: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:31.360478 30517 leader_election.cc:400] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 8. Current term is 9.
I20260709 13:09:31.360803 30517 leader_election.cc:403] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:31.381151 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:31.336946  1406 raft_consensus.cc:2804] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:31.382071 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:31.340513  1506 raft_consensus.cc:2749] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:31.340273   975 raft_consensus.cc:2804] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:31.385044 31149 raft_consensus.cc:1240] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:09:31.336730  1536 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:31.342360  1058 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:31.319552  1456 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:31.383066 30473 raft_consensus.cc:2468] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
I20260709 13:09:31.401926  1201 raft_consensus.cc:2764] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
W20260709 13:09:31.401862 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 55442.4us
W20260709 13:09:31.404403 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:31.432195 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.338644   870 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:31.405283 31142 raft_consensus.cc:2468] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9.
I20260709 13:09:31.342839  1584 raft_consensus.cc:2749] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:31.340546  1573 raft_consensus.cc:493] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:09:31.409196 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 82915.3us
I20260709 13:09:31.356215  1319 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:09:31.413486 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 86963.9us
I20260709 13:09:31.436992 30441 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:31.447131 30441 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:31.364213  1592 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:31.339854  1566 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:31.412664  1410 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:31.450544 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:31.455477 30624 raft_consensus.cc:3060] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:31.456275 30468 raft_consensus.cc:1275] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:31.470901 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:31.408663  1045 raft_consensus.cc:493] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:31.412984  1406 raft_consensus.cc:697] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 8 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:31.358907  1634 consensus_queue.cc:1048] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.095s
I20260709 13:09:31.421427   975 raft_consensus.cc:697] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 9 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:31.500274 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:31.427959  1595 raft_consensus.cc:2749] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 8. Current term is 9.
I20260709 13:09:31.501284 30621 raft_consensus.cc:1275] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:09:31.487182 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 44546.7us
I20260709 13:09:31.435336  1401 raft_consensus.cc:2804] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:31.341579  1632 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:31.442696  1577 raft_consensus.cc:2749] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:09:31.496201 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 135833us
I20260709 13:09:31.501856 30474 raft_consensus.cc:1240] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:31.448326  1620 consensus_queue.cc:1048] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:09:31.505659 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:31.505986 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:31.417582  1536 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:31.479617  1357 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:31.508958 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:31.509660 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:31.455322  1201 raft_consensus.cc:2804] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:31.487722  1503 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:31.488736  1584 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:31.508014 30624 raft_consensus.cc:2468] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 7.
I20260709 13:09:31.517961 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:31.478827  1385 raft_consensus.cc:2749] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:31.508108 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:31.526628 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: true dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:31.532270 30467 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 8.
I20260709 13:09:31.491626  1562 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:31.514583 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:31.539785 30441 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:31.491967  1261 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:31.446344   870 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:31.543395 31149 raft_consensus.cc:3060] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:31.543584 31142 raft_consensus.cc:3055] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:31.549608 31142 raft_consensus.cc:740] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:31.513326  1499 raft_consensus.cc:493] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:31.475530  1592 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:31.544426 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:31.460333  1319 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:31.551921 30441 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:31.553987 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:31.449309  1573 raft_consensus.cc:515] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:31.492240  1045 raft_consensus.cc:515] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:31.543763  1595 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:31.527755  1401 raft_consensus.cc:697] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 8 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:31.554430 31142 consensus_queue.cc:260] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:31.564527 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 111013us
I20260709 13:09:31.578315 31146 raft_consensus.cc:1240] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 6 LEADER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:31.581169 30591 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:31.582603 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:31.549155  1201 raft_consensus.cc:697] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 9 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:31.585796 30591 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:31.590241 31149 raft_consensus.cc:2468] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 6.
I20260709 13:09:31.554986  1065 raft_consensus.cc:2749] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:31.544529  1435 consensus_queue.cc:1048] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:09:31.558808  1407 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.563885  1261 raft_consensus.cc:3060] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:31.612339 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:31.613010 30617 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:09:31.613317  1592 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:31.613853  1592 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:31.614336  1592 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:31.544888  1357 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:31.583639  1406 consensus_queue.cc:237] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:31.620493  1348 raft_consensus.cc:2749] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:31.621178  1348 consensus_queue.cc:1059] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:31.598836   975 consensus_queue.cc:237] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:31.621986  1348 raft_consensus.cc:3055] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:31.622326  1348 raft_consensus.cc:740] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:31.623132  1348 consensus_queue.cc:260] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:31.574420  1657 consensus_queue.cc:1059] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:09:31.558236  1499 raft_consensus.cc:515] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:31.624917  1630 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:31.552013  1562 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:31.625196  1201 consensus_queue.cc:237] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:31.549813  1503 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:31.642488 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 126799us
I20260709 13:09:31.596096  1608 raft_consensus.cc:2749] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:31.666812 30617 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9.
I20260709 13:09:31.626585  1570 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:31.599956  1651 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.677979 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:31.626071  1401 consensus_queue.cc:237] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:31.550714  1584 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:31.681522 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.583639  1595 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:31.684902 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 149622us
I20260709 13:09:31.702433 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:09:31.702803 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 400825us
I20260709 13:09:31.704779 30589 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:31.683862  1348 raft_consensus.cc:3060] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:31.634524  1407 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:31.762066 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:31.765928 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:31.773808 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 69141.2us
I20260709 13:09:31.775053 30544 raft_consensus.cc:2393] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 13: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:31.775533 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:31.776263  1566 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:31.710561  1456 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:31.772629  1643 log.cc:927] Time spent T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.274s	user 0.001s	sys 0.000s
I20260709 13:09:31.782588 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:31.761962  1653 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.687477  1651 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:31.784934  1632 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:31.825345  1653 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:31.815567 30371 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57542 (request call id 300) took 24451 ms (client timeout 15000 ms). Trace:
I20260709 13:09:31.828449 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:31.829084 30547 raft_consensus.cc:2468] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 9.
W20260709 13:09:31.785037  1647 log.cc:927] Time spent T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:09:31.830145 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:31.831539 30619 raft_consensus.cc:1240] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:31.827488  1653 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:31.831858 31114 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:31.785522  1499 leader_election.cc:290] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:31.832742  1620 raft_consensus.cc:2804] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:31.833119  1620 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:31.833494  1620 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:31.786590  1583 raft_consensus.cc:2749] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:31.787882  1654 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.789526  1671 consensus_queue.cc:1048] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:31.790561  1045 leader_election.cc:290] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:31.837486  1654 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:31.793951   870 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:31.797135  1319 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:31.766757  1592 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:31.798393  1536 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:31.798247 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:31.831941  1357 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:31.802506  1320 raft_consensus.cc:3055] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:09:31.802987  1240 consensus_meta.cc:287] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.512s	user 0.009s	sys 0.000s
I20260709 13:09:31.798302  1407 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:31.806581  1578 consensus_meta.cc:287] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.536s	user 0.005s	sys 0.005s
I20260709 13:09:31.807338  1503 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:31.807145 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:09:31.808313  1642 log.cc:927] Time spent T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.272s	user 0.001s	sys 0.000s
I20260709 13:09:31.809296  1630 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:31.810707  1584 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:31.811648  1573 leader_election.cc:290] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:31.812503 30617 raft_consensus.cc:2410] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:09:31.813009  1595 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:31.813421  1562 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:31.817842 30374 catalog_manager.cc:5697] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 4 to 7, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 7 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:31.776506 30543 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 10.
W20260709 13:09:31.810724  1641 log.cc:927] Time spent T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.367s	user 0.000s	sys 0.001s
I20260709 13:09:31.824740  1651 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:31.840468 30619 raft_consensus.cc:1275] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:31.853585 30441 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:09:32.030076 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 176590us
I20260709 13:09:32.030292 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:32.030925 30543 raft_consensus.cc:2468] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 7.
I20260709 13:09:32.032963 30620 raft_consensus.cc:2410] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:09:31.857885 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:31.858999 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:32.033911 30546 raft_consensus.cc:2468] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 7.
I20260709 13:09:32.034199 30548 raft_consensus.cc:2393] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 11: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:31.801290 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:32.036474 30473 raft_consensus.cc:1240] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:31.889392 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:31.882333 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:32.025331 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:31.870512 30542 raft_consensus.cc:1275] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:32.037943 30474 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 10.
I20260709 13:09:32.021425  1654 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:31.856155 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:32.040390 30547 raft_consensus.cc:2368] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 6. Current term is 7.
I20260709 13:09:32.037954 30468 raft_consensus.cc:2393] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 10: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
W20260709 13:09:31.826830 30371 rpcz_store.cc:269] 0709 13:09:07.364186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.364491 (+   305us) service_pool.cc:224] Handling call
0709 13:09:31.815265 (+24450774us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:23.717803 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:23.718440 (+   637us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:23.718487 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:09:23.718506 (+    19us) tablet.cc:662] Decoding operations
0709 13:09:23.719681 (+  1175us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:23.719774 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:23.719803 (+    29us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:09:23.721058 (+  1255us) tablet.cc:701] Row locks acquired
0709 13:09:23.721077 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:09:23.721228 (+   151us) write_op.cc:270] Start()
0709 13:09:23.721342 (+   114us) write_op.cc:276] Timestamp: P: 1783602563721168 usec, L: 0
0709 13:09:23.721364 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:09:23.722059 (+   695us) log.cc:844] Serialized 4772 byte log entry
0709 13:09:24.482789 (+760730us) op_driver.cc:464] REPLICATION: finished
0709 13:09:24.938702 (+455913us) write_op.cc:301] APPLY: starting
0709 13:09:24.943375 (+  4673us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:25.048993 (+105618us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:25.086419 (+ 37426us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:25.181038 (+ 94619us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:25.181289 (+   251us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:09:25.181344 (+    55us) write_op.cc:312] APPLY: finished
0709 13:09:25.181640 (+   296us) log.cc:844] Serialized 89 byte log entry
0709 13:09:25.342015 (+160375us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:25.359865 (+ 17850us) write_op.cc:454] Released schema lock
0709 13:09:25.384633 (+ 24768us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:25.431794 (+ 47161us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:25.432872 (+  1078us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":51258,"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":442774,"apply.run_cpu_time_us":78003,"apply.run_wall_time_us":467764,"num_ops":12,"prepare.queue_time_us":77806,"prepare.run_cpu_time_us":13701,"prepare.run_wall_time_us":96943,"raft.queue_time_us":613685,"raft.run_cpu_time_us":9101,"raft.run_wall_time_us":335056,"replication_time_us":749467,"spinlock_wait_cycles":22400,"thread_start_us":598104,"threads_started":5,"wal-append.queue_time_us":360946,"wal-append.run_cpu_time_us":4849,"wal-append.run_wall_time_us":2093236}]]}
I20260709 13:09:32.032029 30621 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 13.
I20260709 13:09:31.859010  1499 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.987730   870 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.878063 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: true dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:31.840869  1410 raft_consensus.cc:2749] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:32.045485 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:32.056190 30551 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9.
I20260709 13:09:32.056316 30542 raft_consensus.cc:2468] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 5.
I20260709 13:09:32.045576 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:32.047226 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:32.057273 30543 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9.
I20260709 13:09:32.051270 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:32.059073 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:32.060194 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:32.052621 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:32.053570  1620 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:32.062551 30548 raft_consensus.cc:2410] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:09:32.048002 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:31.947482  1538 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:31.930825  1045 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:32.064649  1045 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:32.064582  1538 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:32.066840  1045 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:32.063612  1620 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:32.054826 30469 raft_consensus.cc:1275] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:09:32.050233 30550 raft_consensus.cc:3060] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:32.067135  1538 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:32.050298 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:32.068799 30473 raft_consensus.cc:2468] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
I20260709 13:09:32.055466 30374 catalog_manager.cc:5697] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 1 to 7. New cstate: current_term: 7 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:32.073526 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:32.074431 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.074738 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:09:32.075091 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.076079 30550 raft_consensus.cc:2468] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 8.
I20260709 13:09:32.076982 30468 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 11.
I20260709 13:09:32.074365 30374 catalog_manager.cc:5697] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 6 to 7, leader changed from cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 7 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:32.091849 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:32.093688 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:32.118459 30622 raft_consensus.cc:2393] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 9: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:32.022490  1320 raft_consensus.cc:740] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:32.098658 30550 raft_consensus.cc:1275] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:32.121768 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:09:32.123528 31116 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.004s	sys 0.012s
W20260709 13:09:32.125454 31116 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.004s	sys 0.012s
I20260709 13:09:31.970482  1506 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:32.101477 30440 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:32.128516 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:32.104588 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:32.138929 30440 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:32.140192 30440 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:32.100314 30374 catalog_manager.cc:5697] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 7 to 8, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 8 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:32.106838  1584 consensus_queue.cc:1059] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:32.107939 30517 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:32.050452  1503 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:32.045675  1357 raft_consensus.cc:2804] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:32.076565  1632 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.081707 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:32.038926 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:32.101980  1410 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:32.138762 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:32.141126  1065 raft_consensus.cc:2804] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:32.145009 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:32.145480 30374 catalog_manager.cc:5697] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 2 to 3, leader changed from cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 3 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:32.163843 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:32.090957  1499 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:32.149115 30474 raft_consensus.cc:2393] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 11: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:32.150092 30440 leader_election.cc:400] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 6. Current term is 7.
I20260709 13:09:32.165351 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:32.167897 30440 leader_election.cc:403] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:32.148737 30517 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:32.145183  1570 raft_consensus.cc:2804] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:32.154446 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:32.168602 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:32.153738 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:32.145555  1506 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:32.156773  1679 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:32.156618  1632 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:32.122663  1406 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:32.141134  1435 raft_consensus.cc:2804] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:32.166172 30469 raft_consensus.cc:2393] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 11: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:32.169834 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:32.170787 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:32.171397 30622 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 9.
I20260709 13:09:32.161171  1065 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:32.114588   870 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:32.169010 30517 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:09:32.216252 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 63840.8us
W20260709 13:09:32.218014 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 443056us
I20260709 13:09:32.168884 30471 raft_consensus.cc:2468] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 12.
I20260709 13:09:32.222458  1592 raft_consensus.cc:2804] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:32.214691  1570 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:32.161511  1584 raft_consensus.cc:3055] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:32.155509  1667 raft_consensus.cc:2804] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:32.151800  1566 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:32.235908 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:32.266853 30468 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 11.
W20260709 13:09:32.236244 31145 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.007s	sys 0.036s
W20260709 13:09:32.267912 31145 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.007s	sys 0.036s
I20260709 13:09:32.242019 30618 raft_consensus.cc:2393] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 7: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:32.236961 31116 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:32.269816 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:32.154114   975 consensus_queue.cc:1048] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.077s
I20260709 13:09:32.157924  1595 consensus_queue.cc:1048] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:09:32.162293  1348 consensus_queue.cc:1059] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
W20260709 13:09:32.252210 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 83263.2us
I20260709 13:09:32.253064 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:32.249910 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:32.253643  1570 raft_consensus.cc:3060] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:32.161278  1503 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:32.166595  1410 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:32.265559 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:32.227062  1536 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:32.270358 31143 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
I20260709 13:09:32.227375  1320 consensus_queue.cc:260] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:32.272367 31116 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:32.226735  1644 consensus_queue.cc:1048] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:09:32.234922  1435 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:32.249534  1065 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:32.257500  1667 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:32.248517  1634 raft_consensus.cc:3060] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:09:32.248092  1456 raft_consensus.cc:493] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:32.277110 30622 raft_consensus.cc:2376] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 7. Re-sending same reply.
I20260709 13:09:32.251915  1592 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:32.253882  1584 raft_consensus.cc:740] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:32.242172  1406 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:32.233642  1679 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:32.297308 30619 raft_consensus.cc:1275] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:32.259063  1677 raft_consensus.cc:2804] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:09:32.315202 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 165289us
I20260709 13:09:32.286866  1639 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.284876  1668 raft_consensus.cc:2749] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:32.295269  1407 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:32.292671  1662 raft_consensus.cc:3055] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:09:32.228695  1261 consensus_meta.cc:287] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.595s	user 0.004s	sys 0.014s
W20260709 13:09:32.339702 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 54212.1us
I20260709 13:09:32.338351 30440 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:32.291646  1435 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:32.343354  1679 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:32.344426  1674 log.cc:927] Time spent T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:09:32.344726  1639 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:32.346112  1683 log.cc:927] Time spent T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:09:32.299121  1658 raft_consensus.cc:3055] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:32.277287  1566 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:32.366823 30440 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:32.359297  1662 raft_consensus.cc:740] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:32.287866  1536 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:32.298990  1667 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:32.370898 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 98639us
I20260709 13:09:32.315447  1677 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.374560 30589 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
W20260709 13:09:32.432490 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 58022.3us
I20260709 13:09:32.433468 30589 leader_election.cc:304] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:32.298655  1592 raft_consensus.cc:3060] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:32.384577  1621 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.930s	user 0.046s	sys 0.036s
W20260709 13:09:32.434739  1621 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.029s	user 0.047s	sys 0.036s
I20260709 13:09:32.314891  1456 raft_consensus.cc:515] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:32.434979  1595 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:32.389029   975 raft_consensus.cc:2804] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:32.435719  1595 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:32.436591   975 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:09:32.436787  1678 log.cc:927] Time spent T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:09:32.437068   975 raft_consensus.cc:3060] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:32.390612  1566 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:32.396593  1410 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:32.397833  1406 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:32.372270  1261 raft_consensus.cc:2749] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:32.454744  1065 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:32.455159  1357 raft_consensus.cc:697] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 6 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:32.484278  1357 consensus_queue.cc:237] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:32.384793  1658 raft_consensus.cc:740] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:32.494895  1658 consensus_queue.cc:260] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:32.496286  1658 raft_consensus.cc:3060] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:32.374744  1584 consensus_queue.cc:260] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:32.480661   975 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:32.499711   975 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:32.502912  1506 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:32.504150  1662 consensus_queue.cc:260] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:32.505308  1536 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:32.507509 31116 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:09:32.510583 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 77221.7us
W20260709 13:09:32.506731 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 103259us
I20260709 13:09:32.549687 30440 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:32.435010  1657 raft_consensus.cc:2749] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:32.511283 30589 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
W20260709 13:09:32.494915  1686 log.cc:927] Time spent T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:09:32.531212  1652 raft_consensus.cc:993] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6: : Instructing follower f639301059e24dc5b0d88a46dc683326 to start an election
I20260709 13:09:32.445075  1677 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:32.512113  1406 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:32.595168 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.506469  1503 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:32.444723  1681 raft_consensus.cc:3060] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:32.508546  1662 raft_consensus.cc:3060] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:32.507160  1688 raft_consensus.cc:2804] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:32.592715  1566 raft_consensus.cc:2804] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:32.506476  1065 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:32.602173 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:09:32.638190 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 126979us
I20260709 13:09:32.598405 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:32.528173  1675 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:32.512159  1536 raft_consensus.cc:2804] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:32.519711  1410 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:32.513978  1499 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:32.679643 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.684599  1456 leader_election.cc:290] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:32.511682   870 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:32.684435  1357 raft_consensus.cc:493] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:32.512499  1639 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:32.686476 31149 raft_consensus.cc:1275] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:09:32.683620 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 101205us
I20260709 13:09:32.687031 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:32.704406 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:32.704664 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:32.705340 30546 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:32.592427  1411 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:32.522969 30360 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 5610a33c644c4e539ad503631763aa40 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica fe2b7d73f8c743c1ba570cfd981c4e79 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:09:32.691872 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:32.711863 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:32.692147 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:32.692297 31150 raft_consensus.cc:1275] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:32.688434  1688 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:32.693487 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:32.696067 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:32.715564 30619 raft_consensus.cc:3060] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:32.715696 30618 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 10.
I20260709 13:09:32.600627  1573 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:32.637286  1689 consensus_queue.cc:1048] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.110s
I20260709 13:09:32.685907  1242 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.721659  1691 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:32.721865  1242 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:32.722249  1691 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:32.724120 30624 raft_consensus.cc:2393] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 9: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:32.682560  1657 raft_consensus.cc:2749] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:32.707044 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:32.725520 30622 raft_consensus.cc:1240] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:09:32.699993  1566 raft_consensus.cc:697] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 8 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:32.604718 31147 raft_consensus.cc:1240] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:32.710156 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:32.683296  1583 raft_consensus.cc:493] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:32.687903  1652 raft_consensus.cc:1081] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 8 LEADER]: Signalling peer f639301059e24dc5b0d88a46dc683326 to start an election
I20260709 13:09:32.731241 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:32.601115 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:32.731724 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:32.687793  1406 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:32.698822 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:32.717144 30618 raft_consensus.cc:1275] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:09:32.712409 30625 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 9.
I20260709 13:09:32.517570  1570 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:32.710748  1357 raft_consensus.cc:515] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:32.717729 30550 raft_consensus.cc:1275] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:32.530751  1435 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:32.727780  1634 raft_consensus.cc:2749] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 6. Current term is 7.
I20260709 13:09:32.737056  1357 leader_election.cc:290] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:32.737689 30467 raft_consensus.cc:1275] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:32.737833  1435 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:32.730834  1583 raft_consensus.cc:515] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:32.718567 30360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 195634us
I20260709 13:09:32.740222  1570 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:32.740598  1583 leader_election.cc:290] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:32.741046 30619 raft_consensus.cc:2468] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 8.
I20260709 13:09:32.728171  1573 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:32.687767  1503 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:32.700263  1536 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.719988 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:32.704036  1675 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:32.772441 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:32.782645 31150 raft_consensus.cc:2393] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 7: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:32.715322 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:32.773157 30620 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36130 (request call id 1861) took 1267 ms (client timeout 1533 ms). Trace:
I20260709 13:09:32.733843 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:09:32.783701 30620 rpcz_store.cc:269] 0709 13:09:31.505353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.507898 (+  2545us) service_pool.cc:224] Handling call
0709 13:09:32.772951 (+1265053us) spinlock_profiling.cc:243] Waited 489 ms on lock 0x7b54002df0d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:32.773077 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1124586368}
I20260709 13:09:32.784376 31147 raft_consensus.cc:2468] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 6.
I20260709 13:09:32.747042  1566 consensus_queue.cc:237] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:32.748085 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:32.756979  1406 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:32.718482  1688 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:32.719118  1595 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:32.718976  1411 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:32.706499  1410 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:32.761373 30546 raft_consensus.cc:2468] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 8.
I20260709 13:09:32.763512  1058 consensus_queue.cc:1059] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:09:32.776847 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:32.766204  1407 raft_consensus.cc:2749] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:32.781183 30619 raft_consensus.cc:1275] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:32.782989 30545 raft_consensus.cc:2468] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 6.
I20260709 13:09:32.792660  1700 consensus_queue.cc:1048] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:32.791854  1702 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:32.817299 31146 raft_consensus.cc:2393] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 9: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:32.794483 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:32.767655  1697 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:32.789677  1536 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:32.799360 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:32.821026 30550 raft_consensus.cc:3060] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:32.804363 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:32.805548  1573 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:32.811486 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:32.763731  1592 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:32.790495  1503 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:32.818581 30621 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36130 (request call id 1871) took 1308 ms (client timeout 1554 ms). Trace:
I20260709 13:09:32.819483 31145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48414 (request call id 862) took 1456 ms. Trace:
I20260709 13:09:32.821825 30542 raft_consensus.cc:2468] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 8.
I20260709 13:09:32.823930 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:32.789135  1570 consensus_queue.cc:1048] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:09:32.826273 31145 rpcz_store.cc:276] 0709 13:09:31.362827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.363741 (+   914us) service_pool.cc:224] Handling call
0709 13:09:31.406579 (+ 42838us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:31.551786 (+145207us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:31.660555 (+108769us) log.cc:844] Serialized 14 byte log entry
0709 13:09:32.268468 (+607913us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:32.268542 (+    74us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:32.268597 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.819296 (+550699us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b5400447ad4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:32.819339 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.819433 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2427,"prepare.queue_time_us":232081,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":1736,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":13807,"spinlock_wait_cycles":333316480,"thread_start_us":704747,"threads_started":2,"wal-append.queue_time_us":633408}
W20260709 13:09:32.826189 30621 rpcz_store.cc:269] 0709 13:09:31.510463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.540470 (+ 30007us) service_pool.cc:224] Handling call
0709 13:09:32.818432 (+1277962us) spinlock_profiling.cc:243] Waited 481 ms on lock 0x7b54002c9054. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:32.818530 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1106910592}
I20260709 13:09:32.818429  1595 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:32.836824 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:32.824996  1406 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:32.831415  1058 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.847388 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:32.848196 30440 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:32.849670 30440 leader_election.cc:304] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:32.850600  1689 raft_consensus.cc:2804] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:32.851150  1689 raft_consensus.cc:697] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 8 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:32.850793  1677 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:32.838548 30543 raft_consensus.cc:2393] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 6: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:32.851079 30440 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:32.852509  1634 raft_consensus.cc:2804] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:32.852947  1634 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:32.853344  1634 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:32.853865  1503 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:32.854341  1503 raft_consensus.cc:493] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:32.854756  1503 raft_consensus.cc:515] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:32.855846  1675 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:32.856616  1503 leader_election.cc:290] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:32.857689  1681 raft_consensus.cc:2749] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:32.858531  1677 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:32.849828  1058 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:32.851341  1357 raft_consensus.cc:2804] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:32.823240  1702 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:32.860008  1357 raft_consensus.cc:493] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:32.860293  1058 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:32.860417  1357 raft_consensus.cc:3060] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:32.861784  1702 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:32.791528 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 44977.5us
I20260709 13:09:32.852080  1689 consensus_queue.cc:237] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:32.864059  1667 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:32.865463 30548 raft_consensus.cc:2393] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 11: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:32.862536 30550 raft_consensus.cc:2468] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 8.
I20260709 13:09:32.839322  1691 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:32.873066  1704 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:32.873625  1704 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:32.823725  1697 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:32.876173 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:32.877036 30616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36130 (request call id 1858) took 1396 ms. Trace:
I20260709 13:09:32.884104 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:32.885263 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
W20260709 13:09:32.881946 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 625773us
I20260709 13:09:32.881899 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:32.886238 30516 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:32.886643 30619 raft_consensus.cc:2468] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 10.
I20260709 13:09:32.887084 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:32.884377 30616 rpcz_store.cc:276] 0709 13:09:31.481121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.481483 (+   362us) service_pool.cc:224] Handling call
0709 13:09:31.481741 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:31.587109 (+105368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:31.587139 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:31.587180 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:31.587208 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.876781 (+1289573us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b540027f454. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:32.876832 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.876976 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":241900416}
I20260709 13:09:32.889077 30551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43088 (request call id 1962) took 1175 ms. Trace:
I20260709 13:09:32.889480 30551 rpcz_store.cc:276] 0709 13:09:31.713660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.713791 (+   131us) service_pool.cc:224] Handling call
0709 13:09:32.888931 (+1175140us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b5400358c54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:32.889028 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":650847488}
W20260709 13:09:32.893272 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.892640 30440 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:32.900496 30621 raft_consensus.cc:1275] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:32.900321 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:32.842136  1595 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:32.852941  1592 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:32.901129 30616 raft_consensus.cc:2468] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 7.
I20260709 13:09:32.880738  1697 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:32.909528 31142 raft_consensus.cc:3060] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:32.912671  1410 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:32.898240  1691 raft_consensus.cc:2804] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:32.913858  1691 raft_consensus.cc:697] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 8 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:32.893373  1654 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:32.914721  1654 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:32.914819  1691 consensus_queue.cc:237] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:32.916189  1411 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:32.917694 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:32.918346 30622 raft_consensus.cc:2468] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 7.
I20260709 13:09:32.919245 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:32.919529 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:32.919847 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:32.920497 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:32.920876  1654 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:32.922207 31142 raft_consensus.cc:2468] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 8.
I20260709 13:09:32.922549 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:32.922989 31142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48412 (request call id 670) took 1406 ms. Trace:
I20260709 13:09:32.925298 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:32.929468 30441 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:32.875779  1704 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:32.903615 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.932350 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:32.923421 31142 rpcz_store.cc:276] 0709 13:09:31.516225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.526351 (+ 10126us) service_pool.cc:224] Handling call
0709 13:09:31.826834 (+300483us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b18000d8360. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783fa3646 00007fc783edd58e 00007fc783f5ef9e 00007fc783f607de 00007fc783f6c27c 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c
0709 13:09:32.909323 (+1082489us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b58003cfbd0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783ec40aa 00007fc783f46447 00007fc783f5efe7 00007fc783f607de 00007fc783f6c27c 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c
0709 13:09:32.922924 (+ 13601us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3063865856}
I20260709 13:09:32.933888 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:32.846604  1406 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:32.932950 30623 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 9.
I20260709 13:09:32.935032 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:09:32.935601 30617 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36130 (request call id 1873) took 1424 ms (client timeout 1868 ms). Trace:
I20260709 13:09:32.968605 30441 leader_election.cc:304] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:32.940404 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:32.969741 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:32.970104 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:09:32.968959 30617 rpcz_store.cc:269] 0709 13:09:31.510999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.685142 (+174143us) service_pool.cc:224] Handling call
0709 13:09:32.935397 (+1250255us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54001d8154. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:32.935546 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":251107584}
I20260709 13:09:32.971176 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:32.971474 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:32.971716 30620 raft_consensus.cc:2468] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 8.
I20260709 13:09:32.972582 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:32.973136  1667 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:32.973551 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:32.970418 30618 raft_consensus.cc:2468] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 4.
W20260709 13:09:32.974774 30589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.975432 30544 raft_consensus.cc:1240] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:32.976397 30620 raft_consensus.cc:1275] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:09:32.935803 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:32.935257 30546 raft_consensus.cc:1240] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:32.952193 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:32.978767 30619 raft_consensus.cc:2468] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 7.
I20260709 13:09:32.935099 31148 raft_consensus.cc:1275] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:09:32.981313 30441 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:32.932511  1435 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:32.985059 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 98857.9us
I20260709 13:09:32.987239 30551 raft_consensus.cc:1240] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:09:32.990195 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:32.990721 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:32.992690 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:32.994125 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:32.995184 30623 raft_consensus.cc:2368] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 8. Current term is 9.
I20260709 13:09:32.996047 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:32.934672   975 raft_consensus.cc:2749] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:32.933161  1539 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.997880  1539 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:33.000033 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:33.000300 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:33.000815 30622 raft_consensus.cc:2410] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:09:33.001461  1632 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:33.004400 31148 raft_consensus.cc:1240] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:32.951992  1357 raft_consensus.cc:515] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:33.007328  1357 leader_election.cc:290] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:33.007556  1595 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:33.008400  1688 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:32.976728  1634 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:33.003744  1539 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:33.010807  1688 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:32.986001   870 raft_consensus.cc:2749] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:33.012455 31145 raft_consensus.cc:1275] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:32.996145 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:33.024371 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:33.014518 30516 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:33.031543 30516 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:09:32.991484  1456 raft_consensus.cc:2749] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:32.992283  1704 raft_consensus.cc:2804] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:33.036763 30516 leader_election.cc:304] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:33.011646  1634 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:33.036444  1705 raft_consensus.cc:2749] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:33.037331  1707 raft_consensus.cc:2804] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:33.049683  1707 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:33.050081  1707 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:32.991372  1065 consensus_queue.cc:1059] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:09:33.042347  1654 consensus_queue.cc:1048] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:09:33.052402  1406 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:33.052966  1704 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.053375  1704 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:33.038125  1058 consensus_queue.cc:1059] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:09:33.058342 30516 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:33.059437 30516 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:33.061002 30516 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:33.062477 30516 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:09:33.064201 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:33.063580 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:33.061916  1705 raft_consensus.cc:2749] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:33.066533 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:33.067469  1406 consensus_queue.cc:1048] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:33.003605  1536 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:33.072324 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:33.072845 30621 raft_consensus.cc:1275] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:09:33.072964  1695 consensus_queue.cc:1048] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:33.074280  1411 consensus_queue.cc:1048] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:09:33.074674 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.074651  1456 raft_consensus.cc:3055] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:33.075224  1456 raft_consensus.cc:740] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:33.088366 30441 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:33.088136 30516 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:33.015211  1435 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:33.069839  1595 raft_consensus.cc:2749] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:33.069885  1667 raft_consensus.cc:2749] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:33.069954  1654 raft_consensus.cc:2749] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:33.090720  1410 consensus_queue.cc:1048] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:09:33.089993  1705 raft_consensus.cc:2804] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:33.095615  1584 raft_consensus.cc:3060] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:33.093334  1634 raft_consensus.cc:2749] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:33.103667 30472 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e6646800b690458391bbff6a6bba535c"
dest_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:60026
I20260709 13:09:33.104300 31144 raft_consensus.cc:2393] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 12: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:33.104754 30516 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:33.108366 30468 raft_consensus.cc:1240] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:33.118513 30516 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:33.108502 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:33.111451 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:33.092849 30441 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:33.071445  1640 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.106613 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:33.106194  1411 raft_consensus.cc:493] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:33.113404 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:33.122655 30471 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:33.117300 30472 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:33.124351 30472 raft_consensus.cc:3060] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:33.124691 30516 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:33.121996 30473 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 8.
I20260709 13:09:33.113258 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:33.129421 30441 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:33.130542 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:33.129082 30516 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:33.134200 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:33.137210 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:33.169116 30441 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:33.169330 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:09:33.170346 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.170428 30441 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:33.170758 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:33.110620  1676 raft_consensus.cc:3055] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:33.112493  1705 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.172844 30441 leader_election.cc:304] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:33.111267  1536 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:33.149010 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:33.107707  1711 raft_consensus.cc:2804] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:33.173697 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:33.129104  1357 raft_consensus.cc:2749] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:33.178480 30441 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:33.180090 30441 leader_election.cc:400] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 election: Vote denied by peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) with higher term. Message: Invalid argument: T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 8. Current term is 9.
I20260709 13:09:33.182045 30471 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 12.
I20260709 13:09:33.142560  1410 raft_consensus.cc:2749] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:33.129127  1654 raft_consensus.cc:2749] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:33.184329 30472 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:33.109369  1573 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.173923  1705 raft_consensus.cc:3060] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:33.193507  1573 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:33.183271  1407 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.189155 31116 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:33.132397  1595 raft_consensus.cc:2749] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:33.195984  1407 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:33.197355 30472 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:33.198280 30476 raft_consensus.cc:1240] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 8 LEADER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:33.201563 31116 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:33.202972  1506 raft_consensus.cc:2804] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:33.203461  1506 raft_consensus.cc:697] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 12 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:33.204350  1506 consensus_queue.cc:237] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:33.205580 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:33.206666 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:33.206804 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:33.200264  1543 consensus_queue.cc:1059] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:09:33.207257 31148 raft_consensus.cc:2468] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 11.
I20260709 13:09:33.207718  1319 raft_consensus.cc:3055] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:33.208128  1319 raft_consensus.cc:740] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:33.208989  1319 consensus_queue.cc:260] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:33.210009  1319 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:33.199734  1424 consensus_queue.cc:1048] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:09:33.212546 30590 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:33.214376  1240 raft_consensus.cc:2804] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:33.214752  1240 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.215065  1240 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:33.171319  1197 raft_consensus.cc:2804] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:33.218775  1197 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:33.221419 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:33.222523 30472 raft_consensus.cc:2410] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:09:33.174104  1261 raft_consensus.cc:2749] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:33.174635  1676 raft_consensus.cc:740] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:33.188580   975 raft_consensus.cc:2804] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:33.184110  1688 raft_consensus.cc:2804] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:33.184857  1711 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:33.233430 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:33.188428  1632 raft_consensus.cc:2749] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:33.198625  1407 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:33.147163  1634 consensus_queue.cc:1048] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.076s
I20260709 13:09:33.112445  1456 consensus_queue.cc:260] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:33.132005  1411 raft_consensus.cc:515] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:33.245024 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:33.225883  1197 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:33.225636  1684 raft_consensus.cc:2749] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:33.128341  1640 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:33.191771  1201 consensus_queue.cc:1048] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
W20260709 13:09:33.248766  1712 log.cc:927] Time spent T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.079s	user 0.004s	sys 0.000s
W20260709 13:09:33.265292 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.234225   975 raft_consensus.cc:493] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:33.239830  1688 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.240878  1711 raft_consensus.cc:3060] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:33.281292 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:33.280737 30621 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 9.
I20260709 13:09:33.296782  1688 raft_consensus.cc:3060] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:33.298161   975 raft_consensus.cc:3060] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:33.302850 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 121893us
I20260709 13:09:33.266476  1573 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:33.298084  1707 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:33.307410 30441 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:33.309333 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:33.310127 30548 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 9.
I20260709 13:09:33.311167 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:33.311293 31114 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:33.312701 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:33.313426 30545 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:33.314056 30542 raft_consensus.cc:1275] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 8. (term mismatch)
I20260709 13:09:33.314495 30542 pending_rounds.cc:85] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd: Aborting all ops after (but not including) 7
I20260709 13:09:33.314755 30542 pending_rounds.cc:107] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260709 13:09:33.315027 30542 raft_consensus.cc:2889] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:33.301460  1456 raft_consensus.cc:3060] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:33.304337  1667 raft_consensus.cc:2804] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:33.303783  1435 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:33.317685 30548 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 9.
I20260709 13:09:33.304075  1499 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.326068 30543 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 10.
I20260709 13:09:33.327073 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:33.328689 31114 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:33.280416  1676 consensus_queue.cc:260] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:33.322747  1632 raft_consensus.cc:2749] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:33.339053 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:33.340111 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:33.343063 30467 raft_consensus.cc:2468] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 8.
I20260709 13:09:33.326432  1668 raft_consensus.cc:2804] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:33.345801 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:33.352485 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:33.352135 31146 raft_consensus.cc:1275] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:33.335487  1573 raft_consensus.cc:2804] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:33.356985 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:33.357475 30548 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
I20260709 13:09:33.363308 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:33.347772  1668 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.365440 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:33.368139 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:33.335266  1435 consensus_queue.cc:1048] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:09:33.368958 30467 raft_consensus.cc:2393] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 9: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:33.368228 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:33.335681  1499 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:33.359012  1573 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:33.380955  1573 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:33.381680  1499 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:33.383615 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.384159 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:33.384503  1640 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:33.384992 30621 raft_consensus.cc:2410] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for term 14 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:09:33.385053  1242 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:33.385890  1240 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:33.389721 31115 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:33.392666  1506 raft_consensus.cc:2804] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:33.393090  1506 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.393411  1506 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:33.393666  1707 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:33.370195 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.397324 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:33.398835 30545 raft_consensus.cc:2468] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 10.
I20260709 13:09:33.370294 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:33.373155 30468 raft_consensus.cc:2393] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 12: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:33.379658  1411 leader_election.cc:290] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:33.400574 31114 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:33.401330 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:33.401937 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:33.403046 30545 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:33.404074 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:33.404654 30467 raft_consensus.cc:2468] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 7.
I20260709 13:09:33.402194 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:33.405979 30469 raft_consensus.cc:2393] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 6: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:33.369503  1668 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:33.426343 30617 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 10.
I20260709 13:09:33.411183 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:33.412113 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:33.414816  1197 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:33.416550  1577 raft_consensus.cc:3055] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:33.416896  1652 raft_consensus.cc:2804] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:33.417380 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:33.418300  1688 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:33.418817 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:33.420176 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:33.431456 30544 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:33.432614 30589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.410633 30548 raft_consensus.cc:2393] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 12: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:33.410079 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:33.427157 31146 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:33.427647 30516 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:33.433874 30467 raft_consensus.cc:2393] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 11: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:33.430073 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:33.434388 30468 raft_consensus.cc:2393] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 10: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:33.435142 30468 raft_consensus.cc:1275] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:33.401503  1240 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:33.439023  1499 raft_consensus.cc:2804] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:33.439520  1499 raft_consensus.cc:697] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 10 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:33.403190  1401 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.440397  1401 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:33.440516  1499 consensus_queue.cc:237] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:33.443300  1401 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:33.429104  1577 raft_consensus.cc:740] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:33.437340 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:33.444341 30545 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 10.
I20260709 13:09:33.372076  1646 consensus_queue.cc:1048] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:09:33.448760 30467 raft_consensus.cc:1240] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:33.438184 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:33.449304 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:33.452346 30469 raft_consensus.cc:2410] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for term 14 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:09:33.453369 30544 raft_consensus.cc:2468] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9.
I20260709 13:09:33.455288 30472 raft_consensus.cc:1240] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:33.457484  1320 raft_consensus.cc:3060] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:33.459185 31114 leader_election.cc:304] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:33.463445 31146 raft_consensus.cc:2468] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 12.
I20260709 13:09:33.464745 30590 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:33.465567 30589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.467944  1197 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:33.444468  1652 raft_consensus.cc:697] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 10 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:33.472940 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:33.426170  1704 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:33.415762  1705 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:33.473776 30474 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
I20260709 13:09:33.471067 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:33.490319 30544 raft_consensus.cc:2468] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 8.
I20260709 13:09:33.472365 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:33.465922  1319 raft_consensus.cc:2749] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:33.509301 31115 leader_election.cc:304] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:33.484521 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:33.511473 30547 raft_consensus.cc:2393] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 12: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:33.479246  1711 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:33.491786 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:33.470492  1240 raft_consensus.cc:2804] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:33.512252 30474 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 8.
I20260709 13:09:33.579540 30517 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:33.588081 30517 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:33.592419 30549 raft_consensus.cc:2368] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 7. Current term is 8.
I20260709 13:09:33.592845 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
W20260709 13:09:33.593225 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.595185 30517 leader_election.cc:304] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:33.602080 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.602943 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:33.603704 31148 raft_consensus.cc:3055] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:33.604187 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:33.605013 30544 raft_consensus.cc:2468] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 6.
I20260709 13:09:33.628834  1652 consensus_queue.cc:237] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:33.601817  1577 consensus_queue.cc:260] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:33.632572  1573 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:33.633481  1577 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:33.634660  1573 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:33.604112 31148 raft_consensus.cc:740] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:33.637337 31148 consensus_queue.cc:260] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:33.638360 31148 raft_consensus.cc:3060] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:33.640074 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:33.641131  1240 raft_consensus.cc:697] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:33.642261  1240 consensus_queue.cc:237] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:33.484004  1667 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:33.644017  1667 raft_consensus.cc:3060] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:33.628932  1654 raft_consensus.cc:2749] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:33.645042  1506 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:33.650688  1725 log.cc:927] Time spent T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.255s	user 0.001s	sys 0.000s
I20260709 13:09:33.650918  1654 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.649263 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:33.651433  1654 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:33.652562 30548 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:33.655022 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:33.655691 30619 raft_consensus.cc:3060] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:33.653553 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:33.658598 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:33.660198 31143 raft_consensus.cc:2468] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9.
W20260709 13:09:33.661267 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 66171us
I20260709 13:09:33.661972 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:33.662352 30517 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:33.662813 30625 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 10.
I20260709 13:09:33.668025 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:33.668596 30474 raft_consensus.cc:2468] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 11.
I20260709 13:09:33.670321 30474 raft_consensus.cc:1240] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 8 LEADER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 7. Current term is 8. Ops: []
W20260709 13:09:33.670555 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.673745 30517 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:33.674275 30474 raft_consensus.cc:1240] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:33.677175 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
W20260709 13:09:33.678843 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.679394 30469 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:33.678215 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:33.575199  1684 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.682195 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:33.587321  1395 raft_consensus.cc:2749] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:33.686069 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:33.686762 30544 raft_consensus.cc:3060] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:33.688973 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:33.592447  1584 raft_consensus.cc:2804] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:09:33.691500 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.692001 31143 raft_consensus.cc:1275] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:09:33.688614 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:33.653942  1654 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:33.697403 30441 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:33.700012 30547 raft_consensus.cc:1240] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:33.672577  1595 raft_consensus.cc:2749] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:33.680327  1410 raft_consensus.cc:2749] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:33.738211 30474 raft_consensus.cc:1240] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:33.744103 30546 raft_consensus.cc:1240] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:33.748726 30546 raft_consensus.cc:1240] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:33.749908 30546 raft_consensus.cc:1240] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 9. Current term is 11. Ops: []
W20260709 13:09:33.750563 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 53250.9us
I20260709 13:09:33.750792 30544 raft_consensus.cc:2468] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 7.
I20260709 13:09:33.753028 30616 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 13.
I20260709 13:09:33.696125  1584 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:33.754703 30474 raft_consensus.cc:1240] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 9. Current term is 10. Ops: []
W20260709 13:09:33.765741 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.754575 30470 raft_consensus.cc:1275] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:09:33.761672 30591 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:33.787209 30619 raft_consensus.cc:2468] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9.
W20260709 13:09:33.810999 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.812053 30474 raft_consensus.cc:1240] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 8 LEADER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 7. Current term is 8. Ops: []
W20260709 13:09:33.810770 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 49210.4us
W20260709 13:09:33.744284  1722 log.cc:927] Time spent T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:09:33.690222   975 raft_consensus.cc:515] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:33.821026 30547 raft_consensus.cc:1240] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:33.695729  1684 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:33.747159  1506 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:33.763586  1640 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.830935  1640 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:33.833501  1640 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:33.835559 30616 raft_consensus.cc:1275] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:09:33.810048  1456 raft_consensus.cc:2804] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:33.817246  1608 raft_consensus.cc:2804] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:33.813875  1584 raft_consensus.cc:3060] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:33.843763 31148 raft_consensus.cc:2468] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9.
I20260709 13:09:33.741720  1654 raft_consensus.cc:2804] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:09:33.839417 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 165760us
W20260709 13:09:33.836161  1699 log.cc:927] Time spent T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:09:33.858951 30517 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:33.836912  1688 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:33.841068  1456 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.880425 30517 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:33.882871  1595 raft_consensus.cc:2749] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:33.883980   975 leader_election.cc:290] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:33.884384  1456 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:33.885861  1705 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:33.886612  1726 log.cc:927] Time spent T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.397s	user 0.001s	sys 0.001s
W20260709 13:09:33.891899  1727 log.cc:927] Time spent T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.408s	user 0.000s	sys 0.001s
W20260709 13:09:33.896129 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 144634us
I20260709 13:09:33.848701  1608 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:33.849273  1654 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:33.923782 30469 raft_consensus.cc:2468] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 12.
I20260709 13:09:33.935071  1654 raft_consensus.cc:3060] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:33.938280 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:33.882330  1410 raft_consensus.cc:2749] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:33.956947 30441 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:33.958319 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.958233 30441 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:33.959223  1688 raft_consensus.cc:2804] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:33.959733  1688 raft_consensus.cc:697] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 13 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:33.960620  1688 consensus_queue.cc:237] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:33.961787 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:33.962446  1667 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:33.962909 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:33.964099  1711 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:33.964489   975 raft_consensus.cc:2804] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:33.965276   975 raft_consensus.cc:697] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 9 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:33.967849 30472 raft_consensus.cc:2468] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 11.
I20260709 13:09:33.898437  1608 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:33.969529 30551 raft_consensus.cc:1275] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:33.884006 30517 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:33.966086   975 consensus_queue.cc:237] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:33.976208 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 162483us
I20260709 13:09:33.931280  1704 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:33.986799 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 104093us
W20260709 13:09:34.011094 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.028213 30591 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:34.030094 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:34.030092 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:34.032325 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:34.034046 30469 raft_consensus.cc:3060] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:34.039678 30591 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:34.040387 30548 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 10.
I20260709 13:09:33.988184  1197 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.024529  1711 raft_consensus.cc:2749] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:34.043778 30469 raft_consensus.cc:2468] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 11.
I20260709 13:09:34.044996 30591 leader_election.cc:304] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:34.048890 30517 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:09:34.055830 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.053434  1640 raft_consensus.cc:2749] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:34.027988  1577 consensus_queue.cc:1048] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:09:34.045708  1242 raft_consensus.cc:2749] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:34.049015  1045 raft_consensus.cc:2804] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:34.055990  1704 raft_consensus.cc:2804] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:34.070916 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:34.036262  1736 consensus_queue.cc:1059] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
W20260709 13:09:34.067836  1320 consensus_meta.cc:287] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.600s	user 0.010s	sys 0.000s
I20260709 13:09:34.075155 30551 raft_consensus.cc:2410] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:09:34.042826  1681 consensus_queue.cc:1059] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:09:34.077765 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:34.054037  1197 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:34.068184  1667 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:34.069393  1045 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.084123 30551 raft_consensus.cc:1240] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:34.081761  1684 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:34.078974  1242 consensus_queue.cc:1059] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:09:34.072077  1740 consensus_queue.cc:1059] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:09:34.085009  1704 raft_consensus.cc:697] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 11 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:34.084422  1045 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:34.097295  1240 raft_consensus.cc:3055] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:34.096501 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:34.131594 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.140906 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:34.141259 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:34.142051 30551 raft_consensus.cc:2393] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 13: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:34.142303 30550 raft_consensus.cc:1240] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:34.143621 30550 raft_consensus.cc:1275] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:09:34.145632  1584 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:34.146811 30544 raft_consensus.cc:1240] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:34.147861 30544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 1915) took 1149 ms. Trace:
I20260709 13:09:34.148200 30544 rpcz_store.cc:276] 0709 13:09:32.998022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.751611 (+753589us) service_pool.cc:224] Handling call
0709 13:09:33.751920 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:34.147148 (+395228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.147633 (+   485us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b54002580d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:34.147792 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":901294848}
I20260709 13:09:34.147962  1704 consensus_queue.cc:237] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:34.150233  1688 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.155287 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:34.155990 31151 raft_consensus.cc:2468] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 6.
I20260709 13:09:34.157298 31114 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326
W20260709 13:09:34.157723 31115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.157796 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:34.158557 31146 raft_consensus.cc:2393] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 7: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:34.158874 31114 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:34.158504  1684 raft_consensus.cc:2804] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:34.159878 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:34.160413 31151 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:09:34.102051  1240 raft_consensus.cc:740] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:34.153671  1688 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:34.138814  1668 consensus_meta.cc:287] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.702s	user 0.007s	sys 0.003s
I20260709 13:09:34.197875 30468 raft_consensus.cc:1240] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 4. Current term is 5. Ops: []
W20260709 13:09:34.141364  1723 log.cc:927] Time spent T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.761s	user 0.006s	sys 0.008s
I20260709 13:09:34.092388  1742 consensus_queue.cc:1059] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:09:34.175462 31114 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:34.175999 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:34.184955 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:34.204963 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:34.163553  1684 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.175374  1740 consensus_queue.cc:1243] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer f639301059e24dc5b0d88a46dc683326 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:09:34.215381 30516 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:34.177917  1506 raft_consensus.cc:2804] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:34.219732 30468 raft_consensus.cc:1275] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:09:34.219985 30516 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:34.230540 30516 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:34.233183 30516 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
W20260709 13:09:34.234205 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 165470us
I20260709 13:09:34.209343  1411 raft_consensus.cc:2804] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:34.237912 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:34.238293 30441 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:34.214649  1684 raft_consensus.cc:3060] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:34.176123  1407 consensus_queue.cc:1048] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:09:34.216785  1584 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:34.197592  1395 consensus_queue.cc:1048] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:09:34.219082  1506 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:34.230118  1499 raft_consensus.cc:2749] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:34.256606 30516 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:34.256750 30548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 721) took 1083 ms. Trace:
I20260709 13:09:34.259820 30548 rpcz_store.cc:276] 0709 13:09:33.173698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.041091 (+867393us) service_pool.cc:224] Handling call
0709 13:09:34.041354 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:34.041521 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:34.047105 (+  5584us) log.cc:844] Serialized 14 byte log entry
0709 13:09:34.256448 (+209343us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:34.256491 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:34.256528 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.256587 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.256699 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11633,"prepare.queue_time_us":6816,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"thread_start_us":197314,"threads_started":1}
I20260709 13:09:34.234197  1320 raft_consensus.cc:2749] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:34.261785 30542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43088 (request call id 2001) took 1370 ms. Trace:
I20260709 13:09:34.292236 30542 rpcz_store.cc:276] 0709 13:09:32.891063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.891172 (+   109us) service_pool.cc:224] Handling call
0709 13:09:32.891398 (+   226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:33.315531 (+424133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.261533 (+946002us) spinlock_profiling.cc:243] Waited 414 ms on lock 0x7b54003381d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:34.261717 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":951250304}
I20260709 13:09:34.288120 30516 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:34.295719 30516 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:09:34.214254  1668 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:34.298411 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:34.302613 30616 raft_consensus.cc:2410] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:09:34.254694  1655 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.260555  1411 raft_consensus.cc:697] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 10 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:34.258936  1667 raft_consensus.cc:2749] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:34.262174  1506 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:34.309588  1320 raft_consensus.cc:2804] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:34.261952  1711 raft_consensus.cc:2749] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:34.293996  1410 raft_consensus.cc:2749] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:34.316918 31147 raft_consensus.cc:2368] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 9. Current term is 10.
I20260709 13:09:34.311941  1655 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:34.299059  1721 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:34.297763  1595 raft_consensus.cc:2749] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:34.345831  1721 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:34.348414  1721 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:34.257469  1240 consensus_queue.cc:260] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:34.355250 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 155916us
I20260709 13:09:34.319820  1320 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.321165  1570 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:34.383074 30548 raft_consensus.cc:1240] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:34.311553  1654 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:34.324563  1760 raft_consensus.cc:2749] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:34.384342 30542 raft_consensus.cc:1240] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:34.389981 30548 raft_consensus.cc:1240] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:34.391211 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:34.398923 30551 raft_consensus.cc:2468] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 11.
I20260709 13:09:34.394381 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:34.400106 30550 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 8.
I20260709 13:09:34.421591 30545 raft_consensus.cc:1240] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 9. Current term is 10. Ops: []
W20260709 13:09:34.414844 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 58589.1us
I20260709 13:09:34.377914  1320 raft_consensus.cc:3060] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:34.384517  1595 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:34.397143  1743 log.cc:927] Time spent T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.237s	user 0.001s	sys 0.001s
W20260709 13:09:34.452363 30549 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35278 (request call id 724) took 1250 ms (client timeout 1609 ms). Trace:
W20260709 13:09:34.452792 30549 rpcz_store.cc:269] 0709 13:09:33.201887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.280950 (+ 79063us) service_pool.cc:224] Handling call
0709 13:09:34.444211 (+1163261us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b54002576d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:34.452299 (+  8088us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":664806144}
I20260709 13:09:34.431646 31144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 743) took 1721 ms. Trace:
I20260709 13:09:34.433115 30544 raft_consensus.cc:1240] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:34.375528  1599 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:34.454746 31144 rpcz_store.cc:276] 0709 13:09:32.709789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.709897 (+   108us) service_pool.cc:224] Handling call
0709 13:09:34.431456 (+1721559us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b54005749d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:34.431595 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":857661824}
W20260709 13:09:34.439154 31116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:34.427136  1746 log.cc:927] Time spent T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:09:34.449245 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
W20260709 13:09:34.466292 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 122186us
I20260709 13:09:34.467556 30440 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:34.474756  1261 raft_consensus.cc:493] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:34.475262  1261 raft_consensus.cc:515] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:34.475889  1744 log.cc:927] Time spent T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
W20260709 13:09:34.476298 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 238330us
W20260709 13:09:34.476557  1739 log.cc:927] Time spent T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:09:34.477306  1261 leader_election.cc:290] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:34.478155  1654 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:34.478533  1745 log.cc:927] Time spent T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
W20260709 13:09:34.478214  1747 log.cc:927] Time spent T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 13:09:34.479844 30547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 1921) took 1480 ms. Trace:
I20260709 13:09:34.480167  1656 consensus_queue.cc:1048] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:34.480218 30547 rpcz_store.cc:276] 0709 13:09:32.999435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.822091 (+822656us) service_pool.cc:224] Handling call
0709 13:09:33.838010 (+ 15919us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:33.838363 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:33.838397 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:33.844273 (+  5876us) log.cc:844] Serialized 26 byte log entry
0709 13:09:34.093494 (+249221us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:34.093550 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.093645 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:34.479625 (+385980us) raft_consensus.cc:1685] finished
0709 13:09:34.479645 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.479757 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2362,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":30007,"thread_start_us":213417,"threads_started":1,"wal-append.queue_time_us":409483}
W20260709 13:09:34.481739  1456 consensus_meta.cc:287] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.597s	user 0.010s	sys 0.000s
I20260709 13:09:34.482115  1456 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:34.484037  1499 raft_consensus.cc:493] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:34.484702  1499 raft_consensus.cc:515] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:34.486754  1499 leader_election.cc:290] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:34.488394 30475 raft_consensus.cc:1240] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:34.489022  1608 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:34.491219  1608 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:34.384342  1570 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:34.493338  1577 raft_consensus.cc:3055] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:34.493430  1570 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:34.493819  1577 raft_consensus.cc:740] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:34.494624  1577 consensus_queue.cc:260] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:34.456648  1736 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.478216 30469 raft_consensus.cc:1240] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 9 LEADER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:34.491688 30470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 808) took 1391 ms. Trace:
I20260709 13:09:34.449091  1240 raft_consensus.cc:3060] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:34.460471  1595 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:34.500846  1668 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:34.502602  1655 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:34.530838 30546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 1917) took 1532 ms. Trace:
I20260709 13:09:34.497783  1667 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:34.503791  1261 raft_consensus.cc:2749] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:34.498657  1705 raft_consensus.cc:3055] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:34.509248  1676 raft_consensus.cc:3060] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:34.505976 30543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43088 (request call id 2003) took 1577 ms (client timeout 1763 ms). Trace:
I20260709 13:09:34.506790  1570 consensus_queue.cc:1048] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:34.506945  1357 consensus_queue.cc:1048] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:34.466512  1599 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:34.509138 31151 raft_consensus.cc:2468] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 8.
W20260709 13:09:34.538753 30543 rpcz_store.cc:269] 0709 13:09:32.928823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.130370 (+201547us) service_pool.cc:224] Handling call
0709 13:09:34.505810 (+1375440us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b5400337cd4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:34.505912 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":448402816}
I20260709 13:09:34.518266 30470 rpcz_store.cc:276] 0709 13:09:33.100748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.101431 (+   683us) service_pool.cc:224] Handling call
0709 13:09:33.101763 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:33.809955 (+708192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.491466 (+681511us) spinlock_profiling.cc:243] Waited 652 ms on lock 0x7b5400149954. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:34.491621 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1500633856}
I20260709 13:09:34.520263 31115 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:34.407984  1506 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:34.556596  1506 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:34.557261  1045 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:34.503178  1577 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:34.559284  1045 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:34.560015  1655 raft_consensus.cc:2749] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:34.564379  1754 log.cc:927] Time spent T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:09:34.544718 30516 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:34.504523 30441 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:09:34.530128  1748 log.cc:927] Time spent T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.278s	user 0.000s	sys 0.001s
I20260709 13:09:34.531960 30546 rpcz_store.cc:276] 0709 13:09:32.998487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.753287 (+754800us) service_pool.cc:224] Handling call
0709 13:09:33.753532 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:33.753709 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:09:33.818081 (+ 64372us) log.cc:844] Serialized 14 byte log entry
0709 13:09:34.322539 (+504458us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b180030eec0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e5de07 00007fc789cb8ab9 00007fc780e7a69b 00007fc780e7893f 00007fc780e7ac02 00007fc783b0220b 00007fc783b07d23 00007fc783b0823a 00007fc783f72a2a
0709 13:09:34.530413 (+207874us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:34.530481 (+    68us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:34.530542 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.530626 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.530764 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1783,"prepare.queue_time_us":64209,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":3546,"raft.queue_time_us":155,"spinlock_wait_cycles":5692288,"thread_start_us":207460,"threads_started":1}
I20260709 13:09:34.510159 30471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 2269) took 1190 ms. Trace:
I20260709 13:09:34.537542  1705 raft_consensus.cc:740] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:34.553378  1599 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:09:34.594491 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 90068.9us
I20260709 13:09:34.593307 30471 rpcz_store.cc:276] 0709 13:09:33.319486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.319640 (+   154us) service_pool.cc:224] Handling call
0709 13:09:33.326582 (+  6942us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:33.326845 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:33.344781 (+ 17936us) log.cc:844] Serialized 14 byte log entry
0709 13:09:34.087348 (+742567us) spinlock_profiling.cc:243] Waited 3.7 ms on lock 0x7b18000f8aa0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e5de07 00007fc789cb8ab9 00007fc780e7a69b 00007fc780e7893f 00007fc780e7ac02 00007fc783b0220b 00007fc783b07d23 00007fc783b0823a 00007fc783f72a2a
0709 13:09:34.297981 (+210633us) log.cc:844] Serialized 14 byte log entry
0709 13:09:34.509755 (+211774us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:34.509822 (+    67us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:34.509885 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.509967 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.510094 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2971,"prepare.queue_time_us":16439,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":5397,"raft.queue_time_us":87936,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":15215,"spinlock_wait_cycles":8516992,"thread_start_us":418333,"threads_started":2,"wal-append.queue_time_us":1030102}
I20260709 13:09:34.470731  1411 consensus_queue.cc:237] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:34.596467 30620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 759) took 1510 ms. Trace:
I20260709 13:09:34.602751 30620 rpcz_store.cc:276] 0709 13:09:33.085814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.085960 (+   146us) service_pool.cc:224] Handling call
0709 13:09:33.086285 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:33.089403 (+  3118us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:33.089432 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:33.092145 (+  2713us) log.cc:844] Serialized 26 byte log entry
0709 13:09:33.834957 (+742812us) spinlock_profiling.cc:243] Waited 8.06 ms on lock 0x7b18001bcdc0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e5de07 00007fc789cb8ab9 00007fc780e7a69b 00007fc780e7893f 00007fc780e7ac02 00007fc783b0220b 00007fc783b07d23 00007fc783b080d1 00007fc783f23a0f
0709 13:09:34.070821 (+235864us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:34.070875 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.070962 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:34.568103 (+497141us) raft_consensus.cc:1685] finished
0709 13:09:34.568121 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.596395 (+ 28274us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2786,"raft.queue_time_us":2873,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":2848,"spinlock_wait_cycles":18540416,"thread_start_us":235637,"threads_started":1,"wal-append.queue_time_us":1137889}
W20260709 13:09:34.600728 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 132136us
I20260709 13:09:34.521095  1736 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:34.611510 30441 leader_election.cc:304] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:34.622339 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: true dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:34.625187 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:34.626017 31144 raft_consensus.cc:2468] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9.
I20260709 13:09:34.631954 31114 leader_election.cc:400] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 7. Current term is 8.
W20260709 13:09:34.609552 31115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.632599 31114 leader_election.cc:403] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:34.570333  1456 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:34.605724 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 135550us
W20260709 13:09:34.639465 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:34.601423  1749 log.cc:927] Time spent T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:09:34.636855 30546 raft_consensus.cc:1275] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:09:34.600397  1760 raft_consensus.cc:2804] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:34.638065 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:34.594964  1499 raft_consensus.cc:2804] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:34.537761  1667 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:34.636466 30441 leader_election.cc:304] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:34.637444 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:34.639043 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:34.644076 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:34.596356  1688 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:34.648307 31148 raft_consensus.cc:1240] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:09:34.645526 30549 raft_consensus.cc:2410] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:09:34.648350 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:09:34.645642 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 176620us
I20260709 13:09:34.650471 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:34.654487 30547 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:34.654422 30440 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:34.648842 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:34.648399 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:34.638733  1261 raft_consensus.cc:2749] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:34.602373  1570 consensus_queue.cc:1048] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:09:34.642520  1599 raft_consensus.cc:2749] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 7. Current term is 8.
I20260709 13:09:34.681877 30473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 819) took 1461 ms. Trace:
I20260709 13:09:34.682890  1667 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:34.682284 30473 rpcz_store.cc:276] 0709 13:09:33.220388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.220505 (+   117us) service_pool.cc:224] Handling call
0709 13:09:33.220812 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:33.221102 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:33.221129 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:33.221533 (+   404us) log.cc:844] Serialized 26 byte log entry
0709 13:09:34.352518 (+1130985us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b180038cc80. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e5de07 00007fc789cb8ab9 00007fc780e7a69b 00007fc780e7893f 00007fc780e7ac02 00007fc783b0220b 00007fc783b07d23 00007fc783b080d1 00007fc783f23a0f
0709 13:09:34.465470 (+112952us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:34.465508 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.465574 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:34.681608 (+216034us) raft_consensus.cc:1685] finished
0709 13:09:34.681626 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.681822 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23187,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":8277,"spinlock_wait_cycles":4075776,"thread_start_us":112784,"threads_started":1,"wal-append.queue_time_us":1407302}
I20260709 13:09:34.666235  1499 raft_consensus.cc:697] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 8 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:34.677935  1688 raft_consensus.cc:2804] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:34.684330  1357 raft_consensus.cc:2804] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:34.696729 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:09:34.699098 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 59301.9us
W20260709 13:09:34.699846 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 45487.9us
I20260709 13:09:34.700021 31116 leader_election.cc:304] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:34.701316 30440 leader_election.cc:304] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:34.699098 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 54261us
I20260709 13:09:34.706849 31116 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:34.695580  1688 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.663929  1705 consensus_queue.cc:260] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:34.725155  1779 raft_consensus.cc:2749] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:34.697800  1684 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:34.752606 30440 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:34.754350 30547 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 10.
I20260709 13:09:34.743733 31116 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:34.733996  1688 raft_consensus.cc:3060] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:34.732328  1357 raft_consensus.cc:697] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 10 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:34.770650 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:34.738529  1456 raft_consensus.cc:2804] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:34.759790 31151 raft_consensus.cc:2368] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 8. Current term is 9.
I20260709 13:09:34.744195  1705 raft_consensus.cc:3060] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:34.738472  1775 consensus_queue.cc:1048] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:09:34.766669 30473 raft_consensus.cc:1240] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:09:34.789660 31143 raft_consensus.cc:1240] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:34.767216  1640 raft_consensus.cc:3055] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:34.791072 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:34.768177 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:34.759357  1499 consensus_queue.cc:237] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:34.768482  1758 raft_consensus.cc:2749] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:34.768887 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:34.769599 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:34.737528  1595 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:34.767238 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:34.807907 30475 raft_consensus.cc:2468] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 8.
I20260709 13:09:34.740547  1395 raft_consensus.cc:2749] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:34.705497  1776 consensus_queue.cc:1059] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:09:34.769924  1684 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:34.740547  1599 consensus_queue.cc:1059] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:09:34.783556  1667 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
W20260709 13:09:34.814692 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 91365.3us
I20260709 13:09:34.817410 30517 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:34.820528 30517 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:34.821816  1704 raft_consensus.cc:2804] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:34.822302  1704 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.822717  1704 raft_consensus.cc:3060] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:34.828190  1595 raft_consensus.cc:2749] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:34.788763  1782 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:34.798103  1640 raft_consensus.cc:740] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:34.831492 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:34.797442  1456 raft_consensus.cc:697] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 7 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:34.832626 30547 raft_consensus.cc:3060] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:34.814404  1772 log.cc:927] Time spent T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:09:34.796584  1767 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:09:34.833945 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 81437.1us
I20260709 13:09:34.802598  1760 raft_consensus.cc:697] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 9 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:34.812551  1736 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:34.840438 30440 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:34.819784  1781 raft_consensus.cc:2749] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:34.810139  1654 consensus_queue.cc:1059] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:09:34.844991  1654 raft_consensus.cc:3055] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:34.845338  1654 raft_consensus.cc:740] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:34.845458  1760 consensus_queue.cc:237] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:34.845899  1320 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:34.846266  1654 consensus_queue.cc:260] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:34.833576  1758 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:34.855928 30547 raft_consensus.cc:2468] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 9.
I20260709 13:09:34.835350  1357 consensus_queue.cc:237] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:34.849391  1768 log.cc:927] Time spent T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 13:09:34.876437 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:34.831516  1667 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:34.882987 30545 raft_consensus.cc:1240] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:34.881821 30547 raft_consensus.cc:1275] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:34.858063  1654 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:34.868826  1320 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:34.836845  1782 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:34.895942 30549 raft_consensus.cc:1275] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:34.898038 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:34.893999 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:34.881079  1789 consensus_queue.cc:1048] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:09:34.841858  1767 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:34.885659  1751 log.cc:927] Time spent T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.578s	user 0.004s	sys 0.002s
I20260709 13:09:34.879863  1769 raft_consensus.cc:2749] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:34.892294 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:34.916565 30545 raft_consensus.cc:1275] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:09:34.934466 30472 raft_consensus.cc:2410] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:09:34.937819 30440 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:34.941534 30550 raft_consensus.cc:1240] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:34.942731 30550 raft_consensus.cc:1240] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:09:34.878324  1640 consensus_queue.cc:260] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:34.933576  1791 log.cc:927] Time spent T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:09:34.876602  1758 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:34.890348  1456 consensus_queue.cc:237] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:34.953322  1769 raft_consensus.cc:2749] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:34.952976  1320 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.955554  1787 consensus_queue.cc:1048] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
W20260709 13:09:34.999887 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.003144  1788 raft_consensus.cc:3055] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:09:35.007584 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 53191us
I20260709 13:09:34.943874  1762 consensus_queue.cc:1059] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:09:34.952931  1776 consensus_queue.cc:1048] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:09:34.979985  1640 raft_consensus.cc:3060] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:34.994155  1320 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:35.013758  1782 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:35.014142  1784 log.cc:927] Time spent T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 13:09:35.014452  1320 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:34.988822  1357 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:34.978606  1760 consensus_queue.cc:1048] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
W20260709 13:09:35.021800  1797 log.cc:927] Time spent T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:09:35.003721  1788 raft_consensus.cc:740] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:35.024755   870 consensus_queue.cc:1059] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:09:35.036311 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:35.038908   870 raft_consensus.cc:3055] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:35.039492   870 raft_consensus.cc:740] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:35.040489   870 consensus_queue.cc:260] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:35.044747  1767 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:35.025637  1762 raft_consensus.cc:3055] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:35.047363  1762 raft_consensus.cc:740] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:35.048154  1762 consensus_queue.cc:260] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:35.025758  1760 consensus_queue.cc:1243] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer 092f6eb694fc4bbeab49677cccd880fd log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:09:35.049216  1764 raft_consensus.cc:3055] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:35.049656  1764 raft_consensus.cc:740] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:35.041965   870 raft_consensus.cc:3060] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:35.050403  1764 consensus_queue.cc:260] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:35.025799  1357 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:35.051594  1764 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:35.051935 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:35.053228  1357 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:35.054169  1667 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:35.017055  1769 consensus_queue.cc:1059] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:09:35.055649  1769 raft_consensus.cc:3055] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:35.056023  1769 raft_consensus.cc:740] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:35.056777  1769 consensus_queue.cc:260] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:35.057757  1769 raft_consensus.cc:3060] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:35.060031 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:35.063325 30549 pending_rounds.cc:85] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd: Aborting all ops after (but not including) 5
I20260709 13:09:35.063625 30549 pending_rounds.cc:107] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:09:35.063882 30549 raft_consensus.cc:2889] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:35.078804  1197 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:35.082289 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:35.089548 31115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.020889  1704 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:35.094954 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 859916us
I20260709 13:09:35.100445  1704 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:35.102164 30589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:35.102586 30589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.103756 30547 raft_consensus.cc:2368] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 9. Current term is 10.
I20260709 13:09:35.106630 30618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36130 (request call id 1907) took 1476 ms. Trace:
I20260709 13:09:35.107072 30618 rpcz_store.cc:276] 0709 13:09:33.630182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.889539 (+259357us) service_pool.cc:224] Handling call
0709 13:09:33.889922 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:33.890208 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:33.890546 (+   338us) log.cc:844] Serialized 14 byte log entry
0709 13:09:34.534572 (+644026us) log.cc:844] Serialized 14 byte log entry
0709 13:09:35.106318 (+571746us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:35.106364 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:35.106407 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.106468 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:35.106578 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":577596,"prepare.queue_time_us":228398,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":72,"raft.queue_time_us":28929,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79,"thread_start_us":635059,"threads_started":3,"wal-append.queue_time_us":402658}
W20260709 13:09:35.126804 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.098009  1671 consensus_queue.cc:1059] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:09:35.109515  1577 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:35.132311  1577 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:35.134969  1577 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:35.120321  1240 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.135990  1240 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:35.163146 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 65275.6us
I20260709 13:09:35.119417  1646 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.164321 30591 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:35.164463  1646 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:35.167191  1646 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:35.167968  1608 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:35.168747 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.172077 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:35.172008  1688 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:35.174101  1688 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:35.174288 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:35.174984 30622 raft_consensus.cc:2393] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 9: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:35.176334  1348 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:35.176831  1348 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:35.178778  1348 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:35.179267  1348 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:35.180559  1808 log.cc:927] Time spent T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:09:35.181463 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:09:35.183161  1750 log.cc:927] Time spent T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.882s	user 0.003s	sys 0.000s
I20260709 13:09:35.158249  1456 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:35.184399  1456 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:35.186373  1456 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:35.187034  1671 raft_consensus.cc:3055] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:35.187419  1671 raft_consensus.cc:740] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:35.188138  1646 raft_consensus.cc:2804] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:35.188650  1646 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.188231  1671 consensus_queue.cc:260] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:35.189010  1646 raft_consensus.cc:3060] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:35.189507  1671 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:35.192749 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:35.168421  1608 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:35.182085 30625 raft_consensus.cc:2468] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 6.
I20260709 13:09:35.203624 30546 raft_consensus.cc:1275] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:09:35.196532 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:35.208967 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:35.198021 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:35.210539 30617 raft_consensus.cc:2393] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 11: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:35.204264 30620 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 8.
I20260709 13:09:35.220477 30619 raft_consensus.cc:1275] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:35.146098  1240 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:35.229133 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:35.230006 30622 raft_consensus.cc:2468] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9.
W20260709 13:09:35.234952 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.179667  1348 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:35.242631 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:35.243177 30620 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:35.119673  1788 consensus_queue.cc:260] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:35.218637  1577 consensus_queue.cc:1059] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:09:35.255754 30548 raft_consensus.cc:2410] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 13:09:35.256748 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.258065 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:35.243774  1644 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:35.267541 30468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 824) took 1056 ms. Trace:
I20260709 13:09:35.259119  1705 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:35.268033 30468 rpcz_store.cc:276] 0709 13:09:34.211589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.211715 (+   126us) service_pool.cc:224] Handling call
0709 13:09:34.212027 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:34.225325 (+ 13298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.267314 (+1041989us) spinlock_profiling.cc:243] Waited 7.4 ms on lock 0x7b5400028fd4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:35.267484 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17010560}
I20260709 13:09:35.268384  1705 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:35.270596  1705 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:35.271636  1769 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:35.272152  1769 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:35.274076  1769 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:35.276525  1646 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:35.277922  1656 consensus_queue.cc:1048] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:35.279951 31114 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:35.254705  1410 raft_consensus.cc:493] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:35.281195  1410 raft_consensus.cc:515] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:35.282265  1775 raft_consensus.cc:2804] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:35.282807  1775 raft_consensus.cc:697] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 9 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:35.283033  1410 leader_election.cc:290] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:35.285300  1608 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:35.286823  1348 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:35.289875  1765 log.cc:927] Time spent T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.720s	user 0.001s	sys 0.001s
I20260709 13:09:35.283689  1775 consensus_queue.cc:237] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:35.294373 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:35.295029 30472 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:09:35.295099 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:35.296080 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:35.296203 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:09:35.300886 30441 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.301014 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:35.301858 31149 raft_consensus.cc:2468] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7.
I20260709 13:09:35.303700 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:35.304386 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:35.304668 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:35.297510 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:35.304394 30617 raft_consensus.cc:2393] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 13: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:35.305334 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:35.307478 30620 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 10.
I20260709 13:09:35.322757 30472 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 10.
I20260709 13:09:35.309918 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:35.312665  1577 raft_consensus.cc:3055] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:35.335207  1577 raft_consensus.cc:740] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:35.335753  1646 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:35.336112  1577 consensus_queue.cc:260] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:35.313239 31147 raft_consensus.cc:1275] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:09:35.316635 30441 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.317166 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:35.318608 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:35.318872 31149 raft_consensus.cc:1275] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:35.319403 30622 raft_consensus.cc:1275] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:09:35.323009 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:35.339359 30516 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:35.309561 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:35.334357 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:35.339787 30472 raft_consensus.cc:1240] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:09:35.340060 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:35.341014 31151 raft_consensus.cc:2468] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 9.
I20260709 13:09:35.341133 30473 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:35.324606 30590 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:35.341518 30471 raft_consensus.cc:1275] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:09:35.341939 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:35.344535 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:35.344889 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:35.345517 30474 raft_consensus.cc:2410] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:09:35.345479 30471 raft_consensus.cc:2468] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:09:35.341517 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:35.349396 30476 raft_consensus.cc:2393] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 11: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:35.349615 30620 raft_consensus.cc:1275] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:35.326198 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:35.349731 30516 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:35.348734  1705 raft_consensus.cc:2749] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:35.346542  1769 raft_consensus.cc:493] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:35.350960  1577 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:35.352106 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:35.356269 30472 raft_consensus.cc:2393] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 11: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:35.293538  1644 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:35.356498 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:35.357354 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:35.357640 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:35.364372 30618 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:35.364693 30616 raft_consensus.cc:3060] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:35.358415 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:35.365477 30621 raft_consensus.cc:3060] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:35.358688 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:35.367193 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:35.367332 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:35.367758 30624 raft_consensus.cc:2468] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 9.
I20260709 13:09:35.368535 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:35.362447 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:35.369362 30467 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 8.
I20260709 13:09:35.362807 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
W20260709 13:09:35.370725 30516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.372112 30473 raft_consensus.cc:2468] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 13.
I20260709 13:09:35.378398 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:35.379129 30546 raft_consensus.cc:3060] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:35.346266  1410 raft_consensus.cc:493] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:35.398134 30623 raft_consensus.cc:1240] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:35.398622 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:35.399443 30551 raft_consensus.cc:2468] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 8.
I20260709 13:09:35.389986 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:09:35.370265 30589 connection.cc:256] RPC call timeout handler was delayed by -1.0200987200000782s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15780000000000002s for a response
I20260709 13:09:35.417183  1410 raft_consensus.cc:515] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:35.420011 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:35.420363  1758 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:35.421238 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:35.400625 30622 raft_consensus.cc:2468] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 10.
I20260709 13:09:35.422586 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:35.356181  1671 raft_consensus.cc:2804] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:35.348621  1789 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:35.351586  1769 raft_consensus.cc:515] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:35.421814 30623 raft_consensus.cc:2468] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 4.
I20260709 13:09:35.355800  1736 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:35.429296 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:35.365922  1705 raft_consensus.cc:2804] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:09:35.491030 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.491310 30551 raft_consensus.cc:2468] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7.
W20260709 13:09:35.540617 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:35.541359 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:35.542022 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.422322  1816 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:35.426452  1764 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.572605 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:35.574117 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:35.425300  1695 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.951s	user 0.002s	sys 0.050s
W20260709 13:09:35.581951 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.442549  1671 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.572592 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:35.606413 30624 raft_consensus.cc:3060] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:35.572770 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:09:35.572844 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 148421us
I20260709 13:09:35.590989 30618 raft_consensus.cc:2468] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 8.
I20260709 13:09:35.609254 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:35.609835 30621 raft_consensus.cc:2468] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 8.
I20260709 13:09:35.611343 30618 raft_consensus.cc:1240] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:35.549352  1711 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.571300  1644 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:35.598961  1764 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:35.584409  1769 leader_election.cc:290] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:35.617928 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 200642us
I20260709 13:09:35.604400  1704 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:35.579849  1796 log.cc:927] Time spent T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:09:35.677791 30467 raft_consensus.cc:1275] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:09:35.592440 30616 raft_consensus.cc:2468] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 11.
I20260709 13:09:35.491907  1789 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:35.706308 30616 raft_consensus.cc:1275] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:09:35.549216  1736 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:35.693356 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.579934  1320 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
W20260709 13:09:35.605432  1695 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.131s	user 0.002s	sys 0.050s
I20260709 13:09:35.698490 30589 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:35.712867 30589 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:35.713971 30589 leader_election.cc:304] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:35.514616  1705 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:35.715701  1705 raft_consensus.cc:3060] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:35.688936 30546 raft_consensus.cc:2468] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 12.
I20260709 13:09:35.708838 30616 raft_consensus.cc:3055] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:35.644212  1584 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:35.615252  1671 raft_consensus.cc:3060] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:35.711162 30621 raft_consensus.cc:1275] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:09:35.723034 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:35.723733 30616 raft_consensus.cc:740] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:35.724371 30544 raft_consensus.cc:2393] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 9: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:35.694495  1711 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:35.727619  1681 raft_consensus.cc:2749] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:35.737129  1681 consensus_queue.cc:1059] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:35.738098  1711 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:35.738098  1681 raft_consensus.cc:3055] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:35.739506 30544 raft_consensus.cc:1275] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:09:35.724514 30616 consensus_queue.cc:260] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:35.740240 30616 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:35.722035  1045 raft_consensus.cc:2764] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:09:35.719903  1320 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:35.745244 30469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 825) took 1307 ms. Trace:
I20260709 13:09:35.745636 30469 rpcz_store.cc:276] 0709 13:09:34.437845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.438468 (+   623us) service_pool.cc:224] Handling call
0709 13:09:34.438792 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:34.519242 (+ 80450us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.745021 (+1225779us) spinlock_profiling.cc:243] Waited 39.2 ms on lock 0x7b54001770d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:35.745189 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90222464}
I20260709 13:09:35.747879  1705 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:35.604876  1816 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:35.751088  1705 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:35.751641  1705 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:35.752135  1705 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:35.753129  1410 leader_election.cc:290] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:35.709844  1704 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:35.734215  1815 raft_consensus.cc:2749] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:35.762017 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:35.738790  1681 raft_consensus.cc:740] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:35.763783 30472 raft_consensus.cc:3060] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:35.764824 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:35.765413 30548 raft_consensus.cc:2468] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 6.
I20260709 13:09:35.770640 30517 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:35.738659  1711 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:35.775974 30544 raft_consensus.cc:1275] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:09:35.770959 30472 raft_consensus.cc:2468] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 12.
I20260709 13:09:35.730015  1644 consensus_queue.cc:1059] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:09:35.728211  1584 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:35.780980 30624 raft_consensus.cc:2468] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 10.
I20260709 13:09:35.784907 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:35.781713  1654 raft_consensus.cc:2749] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:35.791637 30440 leader_election.cc:304] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:35.783342  1711 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:35.807073  1320 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:35.808374  1711 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:35.809862  1584 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:35.810802  1681 consensus_queue.cc:260] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:35.813452 30469 raft_consensus.cc:1240] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 10. Current term is 11. Ops: []
W20260709 13:09:35.815712  1820 log.cc:927] Time spent T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:09:35.821050  1819 log.cc:927] Time spent T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:09:35.822196  1704 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:35.825384 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:35.833902 30469 raft_consensus.cc:2393] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 9: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:35.837953  1816 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:35.796398  1758 consensus_queue.cc:1048] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:09:35.847965  1681 raft_consensus.cc:3060] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:35.845352  1787 raft_consensus.cc:2804] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:09:35.922325 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 66120.5us
I20260709 13:09:35.923434 30589 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:35.925607 30589 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:35.925783  1646 raft_consensus.cc:2804] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:35.926174  1646 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.926862  1646 raft_consensus.cc:3060] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:35.926357  1809 raft_consensus.cc:2804] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:35.928207  1809 raft_consensus.cc:697] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:35.929029  1809 consensus_queue.cc:237] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:35.894531  1789 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:35.895164  1787 raft_consensus.cc:493] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:35.932125  1787 raft_consensus.cc:3060] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:35.934401  1646 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:35.935130 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:35.935702 30544 raft_consensus.cc:2468] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
I20260709 13:09:35.894798  1736 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:35.939239 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:35.863621  1764 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:35.926141  1826 log.cc:927] Time spent T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
W20260709 13:09:35.948242 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 156661us
I20260709 13:09:35.862162  1742 consensus_queue.cc:1059] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 13:09:35.942101 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:35.939410  1829 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:09:35.950536 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:35.977300 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:35.996745 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 160851us
I20260709 13:09:35.948293  1705 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:35.948637  1816 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.923027  1704 raft_consensus.cc:493] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:35.949115  1577 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.950697  1240 raft_consensus.cc:493] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:35.995954  1640 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:36.028867 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.017083  1646 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:36.015591  1816 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:35.998796  1829 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:36.020442  1704 raft_consensus.cc:515] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:36.085872  1829 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:36.049732  1827 log.cc:927] Time spent T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:09:36.022477  1240 raft_consensus.cc:515] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:36.086452  1704 leader_election.cc:290] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:36.087361  1822 log.cc:927] Time spent T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:09:36.024228  1640 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:36.021332  1577 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:36.083179  1832 log.cc:927] Time spent T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:09:36.088017  1240 leader_election.cc:290] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:36.112697 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 103344us
W20260709 13:09:36.115175  1833 log.cc:927] Time spent T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:09:36.121269 30441 leader_election.cc:304] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:36.122520 30441 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:36.117457  1740 raft_consensus.cc:3055] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:09:36.119021  1411 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.218s	user 0.004s	sys 0.008s
W20260709 13:09:36.133440  1830 log.cc:927] Time spent T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
W20260709 13:09:36.136051  1807 log.cc:927] Time spent T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 1.037s	user 0.003s	sys 0.000s
I20260709 13:09:36.137889 31146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48412 (request call id 696) took 1490 ms. Trace:
I20260709 13:09:36.138473  1787 raft_consensus.cc:515] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:36.138235 31146 rpcz_store.cc:276] 0709 13:09:34.647346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.649002 (+  1656us) service_pool.cc:224] Handling call
0709 13:09:34.649363 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:34.797750 (+148387us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:34.974563 (+176813us) log.cc:844] Serialized 14 byte log entry
0709 13:09:35.067165 (+ 92602us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:35.067604 (+   439us) log.cc:844] Serialized 26 byte log entry
0709 13:09:35.067768 (+   164us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:35.097248 (+ 29480us) log.cc:844] Serialized 14 byte log entry
0709 13:09:35.097433 (+   185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.097502 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:36.135529 (+1038027us) spinlock_profiling.cc:243] Waited 4.5 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:09:36.137687 (+  2158us) raft_consensus.cc:1685] finished
0709 13:09:36.137707 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:36.137835 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29592,"prepare.queue_time_us":95081,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":81,"raft.queue_time_us":58530,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":25831,"spinlock_wait_cycles":13584512,"thread_start_us":375346,"threads_started":3,"wal-append.queue_time_us":119841}
I20260709 13:09:36.127542  1839 raft_consensus.cc:2804] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:36.147557  1839 raft_consensus.cc:493] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:36.147976  1839 raft_consensus.cc:3060] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:36.152400  1816 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:36.153496  1787 leader_election.cc:290] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:36.129547  1411 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.239s	user 0.004s	sys 0.008s
I20260709 13:09:36.161759 31143 raft_consensus.cc:1240] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 10 LEADER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:36.127655  1740 raft_consensus.cc:740] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:36.167110  1740 consensus_queue.cc:260] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:36.168139  1740 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:36.169061  1577 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:36.117800  1671 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:36.177563  1671 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:36.177861 30625 raft_consensus.cc:2368] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 7. Current term is 8.
I20260709 13:09:36.129345  1640 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:36.178516 31143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48414 (request call id 890) took 1365 ms. Trace:
I20260709 13:09:36.178895 31143 rpcz_store.cc:276] 0709 13:09:34.798476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.798632 (+   156us) service_pool.cc:224] Handling call
0709 13:09:34.798950 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:36.162128 (+1363178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:36.163602 (+  1474us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b5400563e54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:36.163764 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3133657472}
I20260709 13:09:36.179574 30516 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:36.179910  1704 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:36.180516  1704 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:36.183326  1704 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:36.183966  1704 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.181102 30516 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:36.184569  1704 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:36.185158  1736 raft_consensus.cc:2749] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:36.185806  1736 raft_consensus.cc:2749] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:36.186703  1704 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:36.188666  1834 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.188778  1261 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.189306  1834 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:36.189409  1261 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:36.191412  1834 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:36.191399  1261 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:36.194609  1667 consensus_queue.cc:1059] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:36.197227 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:36.197877 30551 raft_consensus.cc:2468] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 6.
W20260709 13:09:36.199048 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 76606.4us
I20260709 13:09:36.199630 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:36.199784  1721 raft_consensus.cc:2749] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:36.200413 30551 raft_consensus.cc:2393] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 8: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:36.200814 30441 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:36.194805 30516 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:36.204018  1829 raft_consensus.cc:2804] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:36.204377  1829 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.204695  1829 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:36.209911  1762 raft_consensus.cc:3060] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:36.210498 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:36.211064 30544 raft_consensus.cc:3060] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:36.212409  1829 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:36.213950  1570 consensus_queue.cc:1048] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:36.214574  1829 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:36.215428  1570 raft_consensus.cc:2804] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:36.215749 30516 leader_election.cc:304] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:09:36.215878  1570 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:36.216524  1570 raft_consensus.cc:3060] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:36.216074 30547 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43088 (request call id 2017) took 1324 ms (client timeout 1749 ms). Trace:
W20260709 13:09:36.217649 30547 rpcz_store.cc:269] 0709 13:09:34.891710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.892054 (+   344us) service_pool.cc:224] Handling call
0709 13:09:36.215895 (+1323841us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b54000dd254. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:36.216021 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":437786368}
I20260709 13:09:36.218212 30516 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:09:36.218833  1499 raft_consensus.cc:2804] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:36.219203  1499 raft_consensus.cc:493] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:36.219547  1499 raft_consensus.cc:3060] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:36.221935  1705 raft_consensus.cc:2804] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:36.222466  1705 raft_consensus.cc:697] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 8 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:36.222903  1815 raft_consensus.cc:3055] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:36.223269  1815 raft_consensus.cc:740] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:36.223415 30516 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:36.224063  1788 raft_consensus.cc:3060] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:36.225778  1829 raft_consensus.cc:2804] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:36.226465  1829 raft_consensus.cc:697] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 10 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:36.227268  1829 consensus_queue.cc:237] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:36.223287  1705 consensus_queue.cc:237] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:36.232504 30441 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:36.232825 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 885987us
I20260709 13:09:36.233842 30441 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:36.234825  1761 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.235376  1761 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:36.236197 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:36.236938 31142 raft_consensus.cc:2393] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 7: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:36.237353  1761 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:36.237861 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:36.232069  1684 consensus_queue.cc:1048] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:36.195647  1667 raft_consensus.cc:3055] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:36.244903  1667 raft_consensus.cc:740] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:36.245738  1667 consensus_queue.cc:260] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:36.246711 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:36.247350 30467 raft_consensus.cc:2468] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 12.
I20260709 13:09:36.247980  1787 raft_consensus.cc:2749] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:36.248653  1787 raft_consensus.cc:2749] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:34.177380 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:36.249352  1787 consensus_queue.cc:1048] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:36.250769  1787 consensus_queue.cc:1048] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:09:36.251180 31115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.252519 30441 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:36.253227  1787 raft_consensus.cc:3060] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:36.256436 30441 leader_election.cc:400] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 election: Vote denied by peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453) with higher term. Message: Invalid argument: T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 8. Current term is 9.
I20260709 13:09:36.257341 30441 leader_election.cc:400] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Vote denied by peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453) with higher term. Message: Invalid argument: T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 9. Current term is 10.
I20260709 13:09:36.257596 30441 leader_election.cc:403] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:36.258570 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:36.259137 31146 raft_consensus.cc:3060] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:36.263108  1787 raft_consensus.cc:2749] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:36.264914 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:36.267992  1760 raft_consensus.cc:2749] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453) with higher term. Message: Invalid argument: T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 9. Current term is 10.
I20260709 13:09:36.270752 31115 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:36.271941 31115 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:36.272840  1775 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.273340  1775 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:36.276508  1570 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:36.277421  1407 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.277900  1407 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:36.278494  1570 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:36.280467  1395 raft_consensus.cc:2749] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:36.281165  1395 raft_consensus.cc:2804] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:36.281631  1395 raft_consensus.cc:697] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 10 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:36.282580  1395 consensus_queue.cc:237] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:36.246879  1667 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:36.288369  1506 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.288885  1506 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:36.289268  1721 consensus_queue.cc:1048] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:36.291775  1506 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:36.293579 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:36.295356 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:36.295939 31147 raft_consensus.cc:2468] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
I20260709 13:09:36.298355 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:36.298854 31147 raft_consensus.cc:3060] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:36.300388 30441 leader_election.cc:304] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:36.302040  1721 raft_consensus.cc:2749] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:36.304626 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:36.306825  1815 consensus_queue.cc:260] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:36.307981  1815 raft_consensus.cc:3060] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:36.309778  1775 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:36.311287 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:36.312765 30441 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:36.313575  1760 consensus_queue.cc:1048] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:36.314193 30547 raft_consensus.cc:1240] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:09:36.314481 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:36.314877  1760 consensus_queue.cc:1048] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:36.315681 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:36.316172  1760 raft_consensus.cc:2749] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:36.317265 31145 raft_consensus.cc:1275] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:09:36.317365 30441 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:36.318104  1570 raft_consensus.cc:2749] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:36.320436  1407 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:36.321915  1741 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.322180  1499 raft_consensus.cc:515] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:36.322449  1741 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:36.324630  1741 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:36.325086  1741 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:36.325479  1741 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:36.329823 31116 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:36.330471  1761 consensus_queue.cc:1048] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:36.362634 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:36.332105 31145 raft_consensus.cc:1275] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:09:36.338670 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:36.348908 30545 raft_consensus.cc:1240] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:36.364583 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:09:36.354230 30516 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.173.3:32851 timed out after 1.574s (SENT) [suppressed 12 similar messages]
I20260709 13:09:36.354923 30440 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:36.355111 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:36.355861 30549 raft_consensus.cc:1240] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:36.365814 30475 raft_consensus.cc:3060] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:09:36.356356 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:36.357447 30620 raft_consensus.cc:1275] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:09:36.357407 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:36.367903 30621 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 10.
I20260709 13:09:36.358310 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:36.364686 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:36.368494 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:36.369020 30545 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 11.
I20260709 13:09:36.332136 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:36.370021 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:36.370754 30621 raft_consensus.cc:2468] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 7.
I20260709 13:09:36.371172 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:36.372399 31116 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:36.372936 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:36.374646 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:36.378474  1704 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:36.378696 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:36.379302  1788 raft_consensus.cc:2749] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:36.379797 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:36.380129 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:36.380393 30543 raft_consensus.cc:3060] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:36.379009  1704 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:36.383605  1704 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:36.384352 30467 raft_consensus.cc:1240] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:36.385390 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:36.386380 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:36.388447 30469 raft_consensus.cc:1275] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:09:36.388949  1684 raft_consensus.cc:2749] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:36.390132 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:36.390473 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:36.391479 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:36.391647 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:36.392030 30467 raft_consensus.cc:2468] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 6.
I20260709 13:09:36.392091 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:36.392692 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:36.393232 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:36.395511 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:36.396095 30469 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 8.
I20260709 13:09:36.398285 30475 raft_consensus.cc:2468] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 10.
I20260709 13:09:36.399444 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:36.400699 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:36.401218 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:36.401948 30549 raft_consensus.cc:2468] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:09:36.403016 30543 raft_consensus.cc:2468] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 8.
I20260709 13:09:36.401252 30471 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 11.
I20260709 13:09:36.371912 30620 raft_consensus.cc:2468] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 6.
W20260709 13:09:36.406841 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:36.408285 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 53451us
I20260709 13:09:36.410110 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:36.412107 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:36.417028 31151 raft_consensus.cc:1240] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 9 LEADER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:36.417906 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:36.420583 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:36.421324 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:36.421427 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:36.421612 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:36.424135 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:36.466056 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:36.467376 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:36.426033 30625 raft_consensus.cc:1240] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:36.430137 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:36.431078 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:36.432113 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:36.433060 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:09:36.435297 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.472383 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:36.435261 30544 raft_consensus.cc:2468] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 7.
W20260709 13:09:36.438732 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 64771.8us
I20260709 13:09:36.439458 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:36.440809  1764 raft_consensus.cc:2804] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:36.474838 30476 raft_consensus.cc:2468] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:09:36.440299 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:36.441108 31147 raft_consensus.cc:2468] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 8.
I20260709 13:09:36.475168 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:36.442092 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:36.476331 31145 raft_consensus.cc:2410] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 13 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:09:36.440825 31146 raft_consensus.cc:2468] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 10.
I20260709 13:09:36.446971 30468 raft_consensus.cc:2410] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:09:36.473688  1407 raft_consensus.cc:493] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.475574 30618 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 11.
I20260709 13:09:36.476548 30591 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:36.446028  1741 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:36.480509 31143 raft_consensus.cc:1240] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:36.481268 30544 raft_consensus.cc:1275] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:36.481129 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:36.481889 30517 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:36.494230 30440 leader_election.cc:400] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 9. Current term is 10.
I20260709 13:09:36.494486 30471 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
I20260709 13:09:36.495191  1770 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.495419  1704 raft_consensus.cc:2749] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:36.495719  1770 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:36.494554 30440 leader_election.cc:403] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:36.446357  1261 raft_consensus.cc:493] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:36.494681 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.499258 31116 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:36.504606 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:36.506666 30590 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:36.499989 30591 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:36.446686  1499 leader_election.cc:290] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:36.509677 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:36.511399 30623 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:36.496541 30517 leader_election.cc:304] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:36.476116  1775 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.440938  1773 consensus_queue.cc:1059] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:09:36.477818  1762 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.566068 30589 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:36.501166  1671 raft_consensus.cc:2749] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:36.479154  1764 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.572104 30441 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:36.573376 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 301473us
I20260709 13:09:36.525542 30590 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:36.575465 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 53708.7us
I20260709 13:09:36.527822 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:36.568171 30473 raft_consensus.cc:1275] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 10. (term mismatch)
W20260709 13:09:36.569283 30468 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60026 (request call id 833) took 1246 ms (client timeout 1509 ms). Trace:
I20260709 13:09:36.576617 30473 pending_rounds.cc:85] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326: Aborting all ops after (but not including) 9
I20260709 13:09:36.577064 30473 pending_rounds.cc:107] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326: Aborting uncommitted NO_OP operation due to leader change: 8.10
W20260709 13:09:36.576723 30468 rpcz_store.cc:269] 0709 13:09:35.322591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.322800 (+   209us) service_pool.cc:224] Handling call
0709 13:09:36.565968 (+1243168us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54001761d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:36.569206 (+  3238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2545836288}
I20260709 13:09:36.577647 30473 raft_consensus.cc:2889] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:36.521117 30440 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:09:36.570369 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 70471.1us
I20260709 13:09:36.571132 30589 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:36.579700 30591 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:36.514143  1684 raft_consensus.cc:2804] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:36.581609 30591 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:36.491973  1681 consensus_queue.cc:1048] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:09:36.526373  1753 raft_consensus.cc:2749] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 9. Current term is 10.
I20260709 13:09:36.500874  1644 consensus_queue.cc:1059] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.074s
W20260709 13:09:36.592715 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 62458.8us
I20260709 13:09:36.588943 30589 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
W20260709 13:09:36.586385 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 89911.5us
I20260709 13:09:36.585884  1762 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:36.595786  1704 consensus_queue.cc:1048] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:36.598199 30517 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:36.497144  1407 raft_consensus.cc:515] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:36.590075 31115 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:36.602005 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 80980.3us
I20260709 13:09:36.517599  1652 consensus_queue.cc:1048] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:09:36.602145 30517 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:36.605926 30591 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:36.608789 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:36.574910  1764 raft_consensus.cc:3060] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:36.579492  1757 raft_consensus.cc:2804] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:36.585003  1769 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.581110  1829 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.611621 30618 raft_consensus.cc:2468] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 8.
I20260709 13:09:36.612362  1654 raft_consensus.cc:2804] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:36.612385 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:36.629354 31115 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:36.579258  1789 consensus_queue.cc:1059] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:09:36.579870  1816 raft_consensus.cc:2804] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:36.584407  1240 raft_consensus.cc:2804] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:36.636610  1240 raft_consensus.cc:697] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
W20260709 13:09:36.636883  1861 log.cc:927] Time spent T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:09:36.638535  1668 raft_consensus.cc:2804] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:36.641167  1668 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.514293  1261 raft_consensus.cc:515] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:36.585187  1499 raft_consensus.cc:2749] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:36.584674  1684 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.570405  1841 raft_consensus.cc:2804] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:36.642957  1684 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:36.610054  1741 raft_consensus.cc:2749] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:36.645521  1261 leader_election.cc:290] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:36.617235 30625 raft_consensus.cc:1275] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:09:36.647258  1668 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:36.611644  1760 raft_consensus.cc:2804] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:36.609876  1577 consensus_queue.cc:1048] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
W20260709 13:09:36.613970 30374 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57538 (request call id 302) took 28014 ms (client timeout 15000 ms). Trace:
W20260709 13:09:36.648353 30374 rpcz_store.cc:269] 0709 13:09:08.600076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.652061 (+ 51985us) service_pool.cc:224] Handling call
0709 13:09:09.353390 (+701329us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b540033ff90. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780e43b71 00007fc780e440b2 00007fc789dbda89 00007fc789d55da6 00007fc789d27088 00007fc789e2537e 00007fc7882e62a4 00007fc7882e6232 00007fc7882e6161 00007fc7882e60dc
0709 13:09:36.613891 (+27260501us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:32.739222 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:32.739920 (+   698us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:32.739986 (+    66us) write_op.cc:435] Acquired schema lock
0709 13:09:32.740004 (+    18us) tablet.cc:662] Decoding operations
0709 13:09:32.741044 (+  1040us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:32.741122 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:32.741148 (+    26us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:09:32.742024 (+   876us) tablet.cc:701] Row locks acquired
0709 13:09:32.742076 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:09:32.742233 (+   157us) write_op.cc:270] Start()
0709 13:09:32.742368 (+   135us) write_op.cc:276] Timestamp: P: 1783602572742164 usec, L: 0
0709 13:09:32.742386 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:09:32.743032 (+   646us) log.cc:844] Serialized 4037 byte log entry
0709 13:09:33.041160 (+298128us) op_driver.cc:464] REPLICATION: finished
0709 13:09:33.187086 (+145926us) write_op.cc:301] APPLY: starting
0709 13:09:33.187200 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:33.187446 (+   246us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:33.187571 (+   125us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:33.334719 (+147148us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:33.374924 (+ 40205us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:09:33.374974 (+    50us) write_op.cc:312] APPLY: finished
0709 13:09:33.375323 (+   349us) log.cc:844] Serialized 77 byte log entry
0709 13:09:33.375504 (+   181us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:33.375617 (+   113us) write_op.cc:454] Released schema lock
0709 13:09:33.375682 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:33.376102 (+   420us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:33.376132 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3345700,"reported_tablets":45,"spinlock_wait_cycles":49609984,"child_traces":[["op",{"apply.queue_time_us":145607,"apply.run_cpu_time_us":4838,"apply.run_wall_time_us":189005,"num_ops":10,"prepare.queue_time_us":310411,"prepare.run_cpu_time_us":24404,"prepare.run_wall_time_us":133855,"raft.queue_time_us":126647,"raft.run_cpu_time_us":9909,"raft.run_wall_time_us":66924,"replication_time_us":298617,"thread_start_us":574867,"threads_started":4,"wal-append.queue_time_us":161097,"wal-append.run_cpu_time_us":45958,"wal-append.run_wall_time_us":1468167}]]}
I20260709 13:09:36.609522  1704 raft_consensus.cc:2804] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:36.652596  1704 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.652962  1704 raft_consensus.cc:3060] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:36.632939  1829 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:36.655237  1829 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:36.614549  1656 consensus_queue.cc:1048] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:09:36.631265 30591 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:36.586987  1846 raft_consensus.cc:2749] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:36.614835  1757 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:36.657397  1757 raft_consensus.cc:3060] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:36.639037  1816 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:36.658411  1816 raft_consensus.cc:3060] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:36.605422  1506 raft_consensus.cc:2749] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:36.620417  1646 consensus_queue.cc:1059] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:09:36.660300  1646 raft_consensus.cc:3055] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:36.660724  1646 raft_consensus.cc:740] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:36.662313  1789 raft_consensus.cc:3055] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:36.616005  1844 raft_consensus.cc:2749] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:36.641726 30623 raft_consensus.cc:2468] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 11.
I20260709 13:09:36.634508  1045 raft_consensus.cc:2749] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:36.665613 30372 catalog_manager.cc:5697] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 2 to 7, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 7 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:09:36.630753  1654 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.667776  1654 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:36.670257  1655 raft_consensus.cc:3055] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:36.647995  1760 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.671061  1760 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:36.672348  1045 raft_consensus.cc:2804] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:36.672732  1045 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:36.673105  1045 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:36.674535 30591 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:36.675305  1844 raft_consensus.cc:2804] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:36.675737  1844 raft_consensus.cc:697] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:36.675947  1764 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:36.676584  1844 consensus_queue.cc:237] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:36.534207  1775 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:36.679263  1764 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:36.679548  1775 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:36.605343  1688 raft_consensus.cc:2749] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:36.661697  1646 consensus_queue.cc:260] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:36.680756  1646 raft_consensus.cc:3060] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:36.680548  1704 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:36.670657  1655 raft_consensus.cc:740] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:36.682539  1704 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:36.682247  1655 consensus_queue.cc:260] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:36.683488  1655 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:36.662724  1789 raft_consensus.cc:740] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:36.685022  1789 consensus_queue.cc:260] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:36.686144  1789 raft_consensus.cc:3060] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:36.686830  1756 raft_consensus.cc:3055] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:36.687223  1756 raft_consensus.cc:740] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:36.688004  1756 consensus_queue.cc:260] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:36.689251  1756 raft_consensus.cc:3060] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:36.690872 30441 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:36.691183  1841 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:36.691672  1841 raft_consensus.cc:3060] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:36.693773 30464 tablet_service.cc:1558] Processing DeleteTablet for tablet 1560cc6404764454b2843cec97934e6b with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 5)) from {username='slave'} at 127.0.0.1:53858
I20260709 13:09:36.667097 30372 catalog_manager.cc:5697] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 5 to 6, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 6 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:36.696103 30372 catalog_manager.cc:5697] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:36.697074  1852 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:36.697597  1852 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:36.697774 30372 catalog_manager.cc:5697] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 5 to 9, leader changed from cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 9 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:36.701869 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:36.702538 30620 raft_consensus.cc:1240] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:09:36.702627 31148 raft_consensus.cc:2468] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 5.
I20260709 13:09:36.703637 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:36.704463 30625 raft_consensus.cc:2410] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:09:36.699486 30372 catalog_manager.cc:5697] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:36.709623 30372 catalog_manager.cc:5697] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 5 to 6, leader changed from cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 6 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:36.710222  1407 leader_election.cc:290] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:36.637486  1240 consensus_queue.cc:237] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:36.635414  1769 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:36.713819 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:36.714509 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:36.718473 30620 raft_consensus.cc:3060] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:36.714789  1862 log.cc:927] Time spent T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:09:36.731828 30620 raft_consensus.cc:2468] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 7.
I20260709 13:09:36.733008 30372 catalog_manager.cc:5697] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 4 to 6, leader changed from cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 6 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:36.720260 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:09:36.743695 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:36.744625 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 239092us
I20260709 13:09:36.758872 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:36.759050 30591 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:36.759773 31148 raft_consensus.cc:2393] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 10: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:36.782243 30619 raft_consensus.cc:2468] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 8.
I20260709 13:09:36.783099 31116 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:36.785302  1785 raft_consensus.cc:2749] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:36.788359 30625 raft_consensus.cc:1275] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:09:36.790774 30591 leader_election.cc:304] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:36.792353 30591 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:36.794248 30591 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:36.694283  1684 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:36.735392 30372 catalog_manager.cc:5697] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 7 to 8, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 8 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:36.699707  1852 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:09:36.796029 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 70894us
I20260709 13:09:36.730690  1834 raft_consensus.cc:2749] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:36.796772 30591 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:36.800664 30372 catalog_manager.cc:5697] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:09:36.593896  1839 raft_consensus.cc:515] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:36.725829  1704 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:36.804101 30372 catalog_manager.cc:5697] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:36.810667 30372 catalog_manager.cc:5697] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 4 to 10. New cstate: current_term: 10 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:36.782001  1761 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:36.795274  1577 raft_consensus.cc:2749] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:36.781708  1770 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:36.805459 30591 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:36.799906  1787 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:36.802439  1846 raft_consensus.cc:2749] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:36.803054 30441 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:36.814381 31143 raft_consensus.cc:1240] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
W20260709 13:09:36.899390 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 93994.6us
W20260709 13:09:36.814751 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 206964us
W20260709 13:09:36.822966 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 468723us
W20260709 13:09:36.902148 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 280492us
W20260709 13:09:36.907749 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 104690us
I20260709 13:09:36.911060 30440 leader_election.cc:304] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:36.908443 30441 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:36.910027 30516 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:36.813130 30372 catalog_manager.cc:5697] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
I20260709 13:09:36.909492 30547 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
mode: GRACEFUL
new_leader_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:45906
I20260709 13:09:36.945670 30547 raft_consensus.cc:606] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Received request to transfer leadership to TS f639301059e24dc5b0d88a46dc683326
I20260709 13:09:36.946331 30372 catalog_manager.cc:5697] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 3 to 7, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 7 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:36.952482 30372 catalog_manager.cc:5697] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 3 to 6, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 6 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:36.946183 30547 raft_consensus.cc:614] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:36.821918  1671 raft_consensus.cc:2749] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:36.954207 30372 catalog_manager.cc:5697] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 6 to 9, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 9 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:09:36.970393 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:36.992962  1855 log.cc:927] Time spent T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
I20260709 13:09:37.006917  1045 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:36.812839  1753 consensus_queue.cc:1048] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:09:36.795152  1779 consensus_queue.cc:1048] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:09:36.876741  1676 raft_consensus.cc:493] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:36.941757  1834 raft_consensus.cc:2804] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:37.009943  1839 leader_election.cc:290] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:36.845753  1721 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:36.942467  1667 consensus_queue.cc:1048] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:09:36.953073  1835 raft_consensus.cc:2804] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:36.952543  1705 raft_consensus.cc:2749] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:37.016819  1870 consensus_queue.cc:1048] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:37.137480  1834 raft_consensus.cc:697] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 7 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:37.138660  1834 consensus_queue.cc:237] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:37.136513  1736 raft_consensus.cc:493] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.141039  1045 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:37.140777  1736 raft_consensus.cc:515] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:37.026614 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:37.142628 30546 raft_consensus.cc:2393] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 7: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:37.143332  1736 leader_election.cc:290] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:37.147140  1757 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:37.161607 31143 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7"
dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
mode: GRACEFUL
new_leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
 from {username='slave'} at 127.0.0.1:42956
W20260709 13:09:37.029767 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 84378.1us
I20260709 13:09:36.818478  1844 raft_consensus.cc:2804] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:36.958432 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:36.826509  1815 raft_consensus.cc:2749] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:36.847364  1829 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.816800  1762 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:36.905081  1640 raft_consensus.cc:2764] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:09:36.821521  1681 raft_consensus.cc:2749] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:37.072772  1874 log.cc:927] Time spent T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:09:37.083585  1837 raft_consensus.cc:2804] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:37.085076 30624 raft_consensus.cc:1240] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:36.814771  1704 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:36.892904  1668 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:37.098187 30439 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.002s	sys 0.005s
W20260709 13:09:37.195580 30439 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.002s	sys 0.005s
I20260709 13:09:36.819296  1761 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:36.893842  1852 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:36.906693  1787 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:37.079712  1773 raft_consensus.cc:493] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:37.147886  1769 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:37.028970 30372 catalog_manager.cc:5697] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 3 to 7, leader changed from cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 7 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:37.097522  1240 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:37.136886  1721 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:37.132437  1869 log.cc:927] Time spent T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:09:37.136976  1882 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.083256  1760 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:37.163713 30516 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
W20260709 13:09:37.237669 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 74013.9us
I20260709 13:09:37.134645  1816 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:37.194705  1878 log.cc:927] Time spent T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.176s	user 0.005s	sys 0.000s
I20260709 13:09:37.137169  1835 raft_consensus.cc:697] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 7 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:37.156035  1841 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:37.184478 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 234575us
I20260709 13:09:37.243042 31114 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:37.167385  1736 consensus_queue.cc:1048] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:09:37.245846 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:37.192898 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:37.165222  1844 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:37.207865 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:37.108448  1676 raft_consensus.cc:515] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:37.171640  1684 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:37.172780 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:37.241154 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:37.241897 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:37.185153  1837 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:37.244812 30619 raft_consensus.cc:1275] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:37.191442 30546 raft_consensus.cc:1240] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:37.224509 30372 catalog_manager.cc:5697] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 4 to 8, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 8 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:37.245867 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 337191us
I20260709 13:09:37.245924 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:37.246434 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:37.278317 30617 raft_consensus.cc:2468] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 11.
I20260709 13:09:37.251528 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
W20260709 13:09:37.254107 30360 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 5610a33c644c4e539ad503631763aa40 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica fe2b7d73f8c743c1ba570cfd981c4e79 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:09:37.256078 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:37.248761  1705 raft_consensus.cc:2804] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:37.258595  1656 raft_consensus.cc:2749] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:09:37.260273  1873 log.cc:927] Time spent T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:09:37.222802  1753 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:37.222301  1240 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:37.304901  1753 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:37.306792  1753 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:37.306829  1240 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:37.223228  1640 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.180884  1829 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:37.309419  1829 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:37.222995  1261 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.310142  1261 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:37.312041  1705 raft_consensus.cc:697] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 10 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:37.312685  1261 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:37.312974  1705 consensus_queue.cc:237] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:37.307487  1640 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:37.314885 30625 raft_consensus.cc:2468] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 8.
I20260709 13:09:37.309430 30372 catalog_manager.cc:5697] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 5 to 9, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 9 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:37.272784 30623 raft_consensus.cc:1240] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:37.281587 30546 raft_consensus.cc:1240] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:37.282195 30624 raft_consensus.cc:1240] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:37.283316 30547 raft_consensus.cc:1275] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:09:37.285167 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:37.300849  1668 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:37.222463  1577 consensus_queue.cc:1059] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:09:37.201169  1788 consensus_queue.cc:1059] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.061s
W20260709 13:09:37.301026 30360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 46979us
I20260709 13:09:37.342430 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:37.343428 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:37.302706  1837 raft_consensus.cc:3060] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:37.304909  1654 consensus_meta.cc:287] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.637s	user 0.006s	sys 0.003s
I20260709 13:09:37.320953 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:37.348206 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:37.348706 30617 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:37.325759  1640 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:37.316020 30549 raft_consensus.cc:1275] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:09:37.326397  1757 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:37.261492 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:37.310676 30619 raft_consensus.cc:2955] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:09:37.327766  1787 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:37.329401  1676 leader_election.cc:290] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:37.330498 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:37.331017  1721 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:37.223773  1786 consensus_queue.cc:1048] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:09:37.333195 30372 catalog_manager.cc:5697] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 3 to 5, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 5 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:37.338738 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:37.481230 30372 catalog_manager.cc:5697] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
I20260709 13:09:37.339022 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:37.340186 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:37.482847 30620 raft_consensus.cc:2393] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 7: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:37.345170 30544 raft_consensus.cc:1275] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:09:37.347121 30546 raft_consensus.cc:1275] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:09:37.222289  1773 raft_consensus.cc:515] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:37.347958  1756 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.350878  1870 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.351763 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
W20260709 13:09:37.352272 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 118276us
I20260709 13:09:37.274392  1844 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:37.358537 30589 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:37.473527  1736 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.354707 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:37.364257 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:37.367802  1760 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:37.241046  1882 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:37.369055  1835 consensus_queue.cc:237] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:37.369843  1886 raft_consensus.cc:3055] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:37.371245  1704 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:37.374221 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:37.375066 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:37.375597  1829 consensus_queue.cc:1048] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:37.506520 30617 raft_consensus.cc:2468] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 9.
I20260709 13:09:37.376695  1761 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:37.376580 30516 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
W20260709 13:09:37.507510 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 131001us
I20260709 13:09:37.508235 30516 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
W20260709 13:09:37.381145 30618 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.010s	sys 0.031s
W20260709 13:09:37.508987 30618 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.011s	sys 0.031s
I20260709 13:09:37.222622  1852 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:37.335587  1671 raft_consensus.cc:493] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.358208  1654 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:37.371704 30361 catalog_manager.cc:5028] TS f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): tablet 1560cc6404764454b2843cec97934e6b (table test-workload [id=887057791fed41a884abbab3e8d4b49f]) successfully deleted
W20260709 13:09:37.515004 30361 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 243647us
I20260709 13:09:37.367070 30623 raft_consensus.cc:1275] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:09:37.490236 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 232010us
W20260709 13:09:37.494380 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 135913us
I20260709 13:09:37.358867 31145 raft_consensus.cc:1275] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:09:37.519194 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:37.502341 31143 raft_consensus.cc:606] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Received request to transfer leadership to TS fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:37.519645 30618 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 11.
I20260709 13:09:37.520043 31143 raft_consensus.cc:614] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:37.412205  1652 consensus_queue.cc:1059] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:09:37.507584 31115 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:37.485589 30372 catalog_manager.cc:5697] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: config changed from index 3 to 2, term changed from 5 to 8, leader changed from <none> to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from VOTER to NON_VOTER, now has a pending config: VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1), VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2), VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3), VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 8 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: NON_VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:09:37.521951 30372 catalog_manager.cc:5697] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 3 to 5, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 5 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:37.522956 30623 raft_consensus.cc:1275] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:09:37.524259 30372 catalog_manager.cc:5697] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:09:37.524775 30589 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:37.526019 30372 catalog_manager.cc:5697] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 4 to 7, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 7 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:37.535197 30372 catalog_manager.cc:5697] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 4 to 8, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 8 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
I20260709 13:09:37.541081 30372 catalog_manager.cc:5697] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
I20260709 13:09:37.366809  1841 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:37.500763  1676 raft_consensus.cc:2749] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:37.365854  1816 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:37.544813 30372 catalog_manager.cc:5697] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 2 to 9, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 9 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:37.546579 30372 catalog_manager.cc:5697] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:09:37.504954  1886 raft_consensus.cc:740] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:37.512501  1667 raft_consensus.cc:2804] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:37.494550  1756 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:37.522256  1704 raft_consensus.cc:2804] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:37.543206  1884 raft_consensus.cc:2749] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:37.496781  1870 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:37.501984  1736 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:37.544708  1757 consensus_queue.cc:1059] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:09:37.576267 30623 raft_consensus.cc:1240] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:37.591833 29364 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:09:37.593532 29364 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:09:37.579365 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 86376.7us
I20260709 13:09:37.580019 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:37.594220 30473 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:37.581779 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:37.582621 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:37.521826  1671 raft_consensus.cc:515] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:37.584491 30474 raft_consensus.cc:1275] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:09:37.584642 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:37.599213 30467 raft_consensus.cc:2468] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 8.
I20260709 13:09:37.599686 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:37.600103 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:37.600674 30467 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 11.
I20260709 13:09:37.549636  1407 raft_consensus.cc:2804] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:37.600777 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:37.585353 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:37.601378 30474 raft_consensus.cc:2468] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 9.
I20260709 13:09:37.601573 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:37.601953 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:37.602942 30467 raft_consensus.cc:1275] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:09:37.586169 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:37.551980  1652 raft_consensus.cc:3055] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:37.603842  1652 raft_consensus.cc:740] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:37.583935 30475 raft_consensus.cc:1275] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:09:37.595387 30469 raft_consensus.cc:2393] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 7: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:37.585289  1570 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:37.587852  1705 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.572000  1667 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:37.544250  1846 consensus_queue.cc:1048] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:09:37.543027  1640 consensus_queue.cc:1048] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:09:37.544473  1880 consensus_queue.cc:1048] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:09:37.603284 30474 raft_consensus.cc:1275] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:09:37.575062  1704 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:37.626211 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:37.628036 30543 raft_consensus.cc:2468] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9.
I20260709 13:09:37.626621 30472 raft_consensus.cc:2393] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 9: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:37.623950 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:37.634160 30441 leader_election.cc:304] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:37.636149 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:37.636940 30543 raft_consensus.cc:2393] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 12: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
W20260709 13:09:37.637283 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 52193.1us
I20260709 13:09:37.641665 30624 raft_consensus.cc:2468] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 7.
I20260709 13:09:37.649847 30441 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:37.650154 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:37.652792 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:37.651221 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:37.654767 30474 raft_consensus.cc:2410] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:09:37.657203 30545 raft_consensus.cc:2468] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
I20260709 13:09:37.658643 30473 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
I20260709 13:09:37.659638 30467 raft_consensus.cc:1240] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:09:37.658628 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:37.621178  1667 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:37.660403 30441 leader_election.cc:304] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:37.669363  1852 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:37.672266  1870 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:37.672636 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:37.673650  1756 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:37.674831  1695 raft_consensus.cc:2804] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:37.675233  1695 raft_consensus.cc:493] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.675595  1695 raft_consensus.cc:3060] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:37.677425  1667 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:37.679560  1667 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:37.605288  1570 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:37.700980  1570 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:37.702510  1773 leader_election.cc:290] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:37.704136 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:37.636420  1704 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:37.740816 30589 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:37.734229 30543 raft_consensus.cc:1240] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 10. Current term is 11. Ops: []
W20260709 13:09:37.736785 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 76438.8us
I20260709 13:09:37.767619 30475 raft_consensus.cc:1240] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:37.769362 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:37.770154 30544 raft_consensus.cc:2468] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
I20260709 13:09:37.781677 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:37.782756 30545 raft_consensus.cc:2410] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:09:37.634869  1886 consensus_queue.cc:260] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:37.790942  1736 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:37.791630  1395 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:37.792264  1395 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:37.660979  1841 consensus_queue.cc:1048] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.132s
I20260709 13:09:37.798365  1668 raft_consensus.cc:3055] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:37.798775  1668 raft_consensus.cc:740] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:37.751230  1852 consensus_queue.cc:1059] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:09:37.799716  1668 consensus_queue.cc:260] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:37.767222  1880 raft_consensus.cc:2804] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:37.801901  1880 raft_consensus.cc:697] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:37.635450  1705 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:37.642938  1261 consensus_queue.cc:1059] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.124s
I20260709 13:09:37.805491  1705 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:37.803002  1880 consensus_queue.cc:237] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:38.139447 30623 raft_consensus.cc:1240] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:37.971640  1841 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.470674  1841 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:38.472806  1841 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:38.473263  1886 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:38.044471  1654 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:37.898694 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:37.890059  1736 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:09:38.475713 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 967440us
I20260709 13:09:37.967109  1499 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:38.476611 30516 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:38.476239  1736 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:38.477022  1499 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:38.477798 30516 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:38.478534  1705 raft_consensus.cc:2749] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:38.478691  1736 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:38.478892 30516 leader_election.cc:304] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:38.479202  1705 raft_consensus.cc:2749] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:38.479961  1667 raft_consensus.cc:2749] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:38.313678 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.480088 30516 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:38.480540  1705 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.900305 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:38.481027  1705 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:38.481384 30516 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:37.966890  1829 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:37.910264  1652 consensus_queue.cc:260] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:38.482117  1829 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:38.482537 30516 leader_election.cc:304] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:38.483074  1652 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:38.483834  1667 raft_consensus.cc:2749] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:37.967505  1816 raft_consensus.cc:493] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:37.765640  1688 raft_consensus.cc:2749] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:38.484711  1667 raft_consensus.cc:2749] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:38.485085 30473 raft_consensus.cc:1240] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:38.469460 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:38.485605  1667 raft_consensus.cc:2749] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:38.486491  1705 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:38.487521 30474 raft_consensus.cc:1275] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:09:37.852169 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:37.916424 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:37.905177 31116 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:38.469107 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:38.475904  1882 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:37.971997 30550 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.008s	sys 0.003s
W20260709 13:09:38.501140 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:38.521745 30550 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.190s	user 0.008s	sys 0.024s
I20260709 13:09:38.522548 30550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 775) took 1224 ms. Trace:
W20260709 13:09:38.501358 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 759602us
W20260709 13:09:38.380692 31113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.484643  1816 raft_consensus.cc:515] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:38.524164 30441 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:38.522933 30550 rpcz_store.cc:276] 0709 13:09:37.298549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.328014 (+ 29465us) service_pool.cc:224] Handling call
0709 13:09:37.330708 (+  2694us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:37.330893 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:37.331368 (+   475us) log.cc:844] Serialized 14 byte log entry
0709 13:09:38.522236 (+1190868us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:38.522287 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:38.522331 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:38.522389 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:38.522498 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":141,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"thread_start_us":1190550,"threads_started":1}
I20260709 13:09:38.483594 30516 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:38.526515 30476 raft_consensus.cc:2468] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 7.
I20260709 13:09:38.527568 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:37.816043  1900 log.cc:927] Time spent T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.137s	user 0.004s	sys 0.000s
I20260709 13:09:38.527494 30589 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:38.528844 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:38.532294 30543 raft_consensus.cc:2468] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 7.
W20260709 13:09:38.532490 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 48984.3us
I20260709 13:09:38.535429 30516 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
W20260709 13:09:38.540747 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 635635us
W20260709 13:09:37.912618  1897 log.cc:927] Time spent T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
W20260709 13:09:38.426568  1695 consensus_meta.cc:287] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.751s	user 0.010s	sys 0.000s
I20260709 13:09:38.014050  1786 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:38.549979 31116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:37.908762  1837 consensus_meta.cc:287] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.537s	user 0.004s	sys 0.004s
I20260709 13:09:38.490916  1668 raft_consensus.cc:3060] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:38.479097  1499 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:38.553056 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:38.121572  1646 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:38.520328  1671 leader_election.cc:290] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:38.251798  1788 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:38.377825  1792 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.983232  1577 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:38.520403  1640 raft_consensus.cc:493] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:09:38.571882 31142 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.004s	sys 0.028s
I20260709 13:09:38.260332  1779 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:38.253216  1407 raft_consensus.cc:697] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 9 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:38.549679  1786 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:38.544006  1761 raft_consensus.cc:2749] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:38.543778  1705 raft_consensus.cc:2749] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:38.543856  1655 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:38.576218  1646 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:38.002532  1884 raft_consensus.cc:493] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:38.549808  1881 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:38.555358  1736 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:38.551923  1684 consensus_queue.cc:1059] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:09:38.577451  1841 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.579291  1829 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:38.583961  1671 raft_consensus.cc:2804] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:38.551510  1890 consensus_queue.cc:1048] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:09:38.555048  1837 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:38.273599  1704 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:38.581779  1788 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:38.584405  1792 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:38.599097  1881 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:38.620457  1881 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:38.615173  1852 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.622978  1852 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:38.624507  1852 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:38.650638 30372 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.862s	user 0.028s	sys 0.023s
W20260709 13:09:38.651661 30372 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.029s	sys 0.023s
I20260709 13:09:38.666431 30440 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:09:38.674299 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 150073us
I20260709 13:09:38.676059 30441 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
W20260709 13:09:38.681551 30471 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.002s	sys 0.002s
W20260709 13:09:38.686430 30549 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.002s	sys 0.018s
W20260709 13:09:38.686988 30549 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.003s	sys 0.018s
I20260709 13:09:38.592123  1655 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:38.687804 30625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47446 (request call id 2391) took 1346 ms. Trace:
I20260709 13:09:38.688422 30625 rpcz_store.cc:276] 0709 13:09:37.340942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.486596 (+145654us) service_pool.cc:224] Handling call
0709 13:09:37.486921 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:37.487258 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:37.487288 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:37.487731 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 13:09:37.774630 (+286899us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:37.774699 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.774788 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:38.687117 (+912329us) raft_consensus.cc:1685] finished
0709 13:09:38.687161 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:38.687448 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4421,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":1757,"thread_start_us":221611,"threads_started":1,"wal-append.queue_time_us":1093592}
I20260709 13:09:38.691193  1655 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:38.692540  1760 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.693730  1760 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:38.695492 31142 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.004s	sys 0.028s
I20260709 13:09:38.697865  1760 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:38.698510  1646 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:38.701305  1837 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:38.702373  1837 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.703040  1704 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:38.703284  1837 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:38.604919  1671 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.599716  1736 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:38.704680  1671 raft_consensus.cc:3060] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:38.704852  1395 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:38.706147  1837 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:38.606019  1757 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:38.708623  1757 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:38.709251  1786 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:38.711035  1816 leader_election.cc:290] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:38.711326  1757 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:38.714660  1788 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:38.590433  1779 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:38.606448  1841 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:38.587437  1640 raft_consensus.cc:515] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:38.718021  1779 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:38.574703  1499 raft_consensus.cc:2804] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:38.718542  1841 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:38.719134  1640 leader_election.cc:290] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:38.719329  1499 raft_consensus.cc:697] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 11 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:38.585122  1577 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:38.720845 31148 raft_consensus.cc:2468] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
I20260709 13:09:38.721019  1499 consensus_queue.cc:237] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:38.706811  1736 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:38.733546  1758 raft_consensus.cc:2804] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:38.737188  1870 raft_consensus.cc:2804] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:38.737200  1764 consensus_queue.cc:1059] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:09:38.734164  1758 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:38.791363  1758 raft_consensus.cc:3060] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:38.778069  1870 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:38.792670 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 113188us
I20260709 13:09:38.551999  1695 raft_consensus.cc:515] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:38.804265  1407 consensus_queue.cc:237] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:38.808094  1577 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:09:38.809036 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 264497us
I20260709 13:09:38.810364  1839 raft_consensus.cc:2749] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:38.814370  1764 raft_consensus.cc:3055] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:38.814918  1764 raft_consensus.cc:740] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:38.816576  1764 consensus_queue.cc:260] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:38.817595  1681 raft_consensus.cc:3055] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:38.818288  1681 raft_consensus.cc:740] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:38.818776  1764 raft_consensus.cc:3060] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:38.809298  1921 log.cc:927] Time spent T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:09:38.823794 30469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 847) took 1174 ms. Trace:
I20260709 13:09:38.823984  1395 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:38.824831  1395 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:38.828578 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:38.829445  1834 raft_consensus.cc:3055] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:38.829741 30623 raft_consensus.cc:2468] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 10.
I20260709 13:09:38.830030  1834 raft_consensus.cc:740] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:38.832312 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:38.833314 30625 raft_consensus.cc:2468] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 11.
I20260709 13:09:38.834242  1839 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.835012  1839 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:38.838497  1839 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:38.838795 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:38.839313 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:38.824296 30469 rpcz_store.cc:276] 0709 13:09:37.649564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.651421 (+  1857us) service_pool.cc:224] Handling call
0709 13:09:37.651753 (+   332us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:37.652096 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:37.652123 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:37.797680 (+145557us) spinlock_profiling.cc:243] Waited 1.69 ms on lock 0x7b2c000014c8. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc782861a11 00007fc782871372 00007fc783fa3a01 00007fc783f6843a 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2
0709 13:09:38.530039 (+732359us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b2c000014c8. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc782861a11 00007fc782871372 00007fc783fa3a01 00007fc783f6843a 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2
0709 13:09:38.545835 (+ 15796us) log.cc:844] Serialized 52 byte log entry
0709 13:09:38.755343 (+209508us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:38.756071 (+   728us) log.cc:844] Serialized 14 byte log entry
0709 13:09:38.809009 (+ 52938us) log.cc:844] Serialized 14 byte log entry
0709 13:09:38.809195 (+   186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:38.809314 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:38.823237 (+ 13923us) raft_consensus.cc:1685] finished
0709 13:09:38.823265 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:38.823498 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":109375,"prepare.queue_time_us":1329,"prepare.run_cpu_time_us":111,"prepare.run_wall_time_us":110,"raft.queue_time_us":54139,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":21705,"spinlock_wait_cycles":46581504,"thread_start_us":73971,"threads_started":1,"wal-append.queue_time_us":74667}
I20260709 13:09:38.852670  1654 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:38.831624  1834 consensus_queue.cc:260] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:38.597612  1884 raft_consensus.cc:515] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:38.798913 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 230502us
I20260709 13:09:38.855195  1667 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:38.856063  1667 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:38.856775  1792 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:38.857160  1884 leader_election.cc:290] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:38.844177  1736 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:38.858361  1736 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:38.859383 30472 raft_consensus.cc:2393] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 6: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:38.859591  1667 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:38.860646 30472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60026 (request call id 845) took 1211 ms. Trace:
I20260709 13:09:38.860955  1736 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:38.861066 30472 rpcz_store.cc:276] 0709 13:09:37.649046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.652557 (+  3511us) service_pool.cc:224] Handling call
0709 13:09:38.860348 (+1207791us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b5400042ed4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:38.860528 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2772535552}
I20260709 13:09:38.855252  1829 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:38.862600  1829 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:38.864205 30619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 799) took 1559 ms. Trace:
I20260709 13:09:38.794114  1870 raft_consensus.cc:3060] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:38.864711 30619 rpcz_store.cc:276] 0709 13:09:37.304341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.309647 (+  5306us) service_pool.cc:224] Handling call
0709 13:09:37.309984 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:37.310450 (+   466us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:37.548366 (+237916us) log.cc:844] Serialized 14 byte log entry
0709 13:09:38.688484 (+1140118us) log.cc:844] Serialized 14 byte log entry
0709 13:09:38.689528 (+  1044us) log.cc:844] Serialized 14 byte log entry
0709 13:09:38.689717 (+   189us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:38.690909 (+  1192us) log.cc:844] Serialized 26 byte log entry
0709 13:09:38.691155 (+   246us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:38.691196 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:38.691355 (+   159us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:38.863715 (+172360us) raft_consensus.cc:1685] finished
0709 13:09:38.863745 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:38.863981 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":637950,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":2909,"raft.queue_time_us":22602,"raft.run_cpu_time_us":581,"raft.run_wall_time_us":27232,"thread_start_us":887275,"threads_started":2,"wal-append.queue_time_us":1042376}
I20260709 13:09:38.868427  1834 raft_consensus.cc:3060] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:38.848690 30471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 1858) took 1269 ms. Trace:
I20260709 13:09:38.869863 30471 rpcz_store.cc:276] 0709 13:09:37.579367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.579485 (+   118us) service_pool.cc:224] Handling call
0709 13:09:37.592883 (+ 13398us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:37.593175 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:37.593210 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:37.599088 (+  5878us) log.cc:844] Serialized 52 byte log entry
0709 13:09:37.989489 (+390401us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:38.682315 (+692826us) log.cc:844] Serialized 14 byte log entry
0709 13:09:38.800458 (+118143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:38.848297 (+ 47839us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:38.848388 (+    91us) raft_consensus.cc:1685] finished
0709 13:09:38.848402 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:38.848618 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36078,"prepare.queue_time_us":625750,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":54,"raft.queue_time_us":97036,"raft.run_cpu_time_us":465,"raft.run_wall_time_us":34768,"thread_start_us":1044369,"threads_started":3,"wal-append.queue_time_us":962010}
I20260709 13:09:38.873270  1930 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:38.873507  1924 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:38.874320  1930 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:38.874498  1924 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:38.851104  1907 raft_consensus.cc:3055] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:38.876088  1907 raft_consensus.cc:740] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:38.853744  1654 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:38.847275 30549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 1969) took 1134 ms. Trace:
I20260709 13:09:38.874933 30623 raft_consensus.cc:2468] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 8.
W20260709 13:09:38.843416  1908 log.cc:927] Time spent T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260709 13:09:38.861619  1736 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:09:38.897539 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 215230us
I20260709 13:09:38.865206  1829 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:38.877830  1921 log.cc:927] Time spent T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.054s	user 0.003s	sys 0.000s
I20260709 13:09:38.843430  1395 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:38.874595  1695 leader_election.cc:290] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:38.878085 30549 rpcz_store.cc:276] 0709 13:09:37.712574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.714705 (+  2131us) service_pool.cc:224] Handling call
0709 13:09:37.715103 (+   398us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:37.715572 (+   469us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:37.776611 (+ 61039us) log.cc:844] Serialized 14 byte log entry
0709 13:09:38.732180 (+955569us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:38.733584 (+  1404us) log.cc:844] Serialized 52 byte log entry
0709 13:09:38.733778 (+   194us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:38.733810 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:38.733914 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:38.846996 (+113082us) raft_consensus.cc:1685] finished
0709 13:09:38.847017 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:38.847183 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":60858,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":42,"raft.queue_time_us":20050,"raft.run_cpu_time_us":428,"raft.run_wall_time_us":10296,"thread_start_us":695001,"threads_started":1,"wal-append.queue_time_us":722382}
I20260709 13:09:38.915793 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:38.917165 30470 raft_consensus.cc:1240] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 7 LEADER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:38.917361  1837 raft_consensus.cc:2804] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:09:38.913339 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.924350  1681 consensus_queue.cc:260] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:38.925138 30619 raft_consensus.cc:2468] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 10.
I20260709 13:09:38.928354  1681 raft_consensus.cc:3060] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:38.908680  1930 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:38.950719 30470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 1861) took 1370 ms. Trace:
I20260709 13:09:38.951206 30470 rpcz_store.cc:276] 0709 13:09:37.580246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.580373 (+   127us) service_pool.cc:224] Handling call
0709 13:09:37.580685 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:38.917722 (+1337037us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:38.950439 (+ 32717us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54001211d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:38.950664 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3064029952}
I20260709 13:09:38.954959  1870 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:38.956180  1907 consensus_queue.cc:260] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:38.956758 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.915036  1736 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:38.961374 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:38.940769  1837 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:38.962568 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:38.996531 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.963845 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:38.965178 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:38.965736  1671 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:38.966540 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:38.966794  1931 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.967530  1695 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.969449  1930 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.970594  1884 raft_consensus.cc:493] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:38.972090  1890 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.973404  1787 consensus_queue.cc:1059] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:38.974395 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:38.974568 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:38.975407 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:38.977077  1924 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:38.983078  1923 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:38.983501 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 44219.5us
I20260709 13:09:38.984877  1926 consensus_queue.cc:1048] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:38.986361 30591 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:38.972136 30440 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:38.989552  1654 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:38.989954 30473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 860) took 1088 ms. Trace:
I20260709 13:09:39.007174 30546 raft_consensus.cc:2393] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 5: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:39.007367  1736 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:39.008190 30549 raft_consensus.cc:2468] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 8.
I20260709 13:09:39.008451 30591 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:39.009384 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:39.010347 30621 raft_consensus.cc:2393] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 10: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:39.010495 30591 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:39.010656  1760 raft_consensus.cc:2804] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:39.011121  1760 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.011528  1740 raft_consensus.cc:2804] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:39.012039  1740 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.012125  1932 raft_consensus.cc:3055] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:39.012449  1740 raft_consensus.cc:3060] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:39.012657  1932 raft_consensus.cc:740] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:39.012809  1929 raft_consensus.cc:2749] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:39.012884 30591 leader_election.cc:304] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:39.013695  1932 consensus_queue.cc:260] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:39.014430  1929 raft_consensus.cc:2749] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:39.014988  1932 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:39.015210  1929 consensus_queue.cc:1048] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:39.022149  1577 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.022401  1886 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.022287  1695 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:38.995728 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:39.022877  1577 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:39.023260  1886 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:38.996677  1907 raft_consensus.cc:3060] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:38.998204  1837 raft_consensus.cc:3060] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:39.024672  1695 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:39.025123  1577 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:39.025302  1930 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:39.016525 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:39.026439 30623 raft_consensus.cc:2468] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 7.
I20260709 13:09:39.017221 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:39.001890  1681 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:38.991746  1844 consensus_meta.cc:287] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 1.489s	user 0.010s	sys 0.012s
I20260709 13:09:39.019425 31115 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:39.001674  1931 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:39.029244  1844 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:39.029728 31115 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:39.031188  1395 raft_consensus.cc:2804] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:39.031493  1844 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:39.032146 31115 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:39.032035  1890 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:39.031555  1395 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.033185  1395 raft_consensus.cc:3060] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:39.027523  1930 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:39.036362  1934 raft_consensus.cc:2804] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:39.036835  1934 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.037184  1934 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:39.005743 30473 rpcz_store.cc:276] 0709 13:09:37.901259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.488018 (+586759us) service_pool.cc:224] Handling call
0709 13:09:38.488364 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:38.794457 (+306093us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:38.796949 (+  2492us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:38.860403 (+ 63454us) log.cc:844] Serialized 26 byte log entry
0709 13:09:38.901976 (+ 41573us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:38.902011 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:38.911791 (+  9780us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:38.989563 (+ 77772us) raft_consensus.cc:1685] finished
0709 13:09:38.989583 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:38.989768 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":219578,"raft.queue_time_us":249184,"raft.run_cpu_time_us":373,"raft.run_wall_time_us":10294,"thread_start_us":93520,"threads_started":2,"wal-append.queue_time_us":53501}
W20260709 13:09:39.020098 31113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.042855 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:39.020311 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:39.021211 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:39.021441  1884 raft_consensus.cc:515] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:39.044710  1652 raft_consensus.cc:2804] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:39.044957  1931 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:39.045116  1652 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:39.045581  1652 raft_consensus.cc:3060] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:39.045626  1923 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:39.025327  1886 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:39.018174  1671 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:39.047596 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:39.047626 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:39.048641 30471 raft_consensus.cc:2393] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 10: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:39.048678  1923 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:39.049471 30590 leader_election.cc:304] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:39.025681  1577 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:39.046001  1884 leader_election.cc:290] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:39.028448  1681 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:39.047861 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:39.042945  1930 raft_consensus.cc:3060] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:39.044068  1890 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:39.020279  1924 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.011514  1760 raft_consensus.cc:3060] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:39.053496 31115 leader_election.cc:304] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:39.056726 30469 raft_consensus.cc:2468] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 10.
I20260709 13:09:39.057698 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
W20260709 13:09:39.046106 31116 leader_election.cc:336] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.509s (SENT)
I20260709 13:09:39.060814 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:39.061728 30543 raft_consensus.cc:2393] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 11: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:39.062242  1577 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:39.062978 31116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.065230  1577 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:39.065469 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:39.065641 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:09:39.066733 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 53951.4us
I20260709 13:09:39.067246 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:39.067922 31142 raft_consensus.cc:2468] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7.
I20260709 13:09:39.069178 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:39.069387 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:39.069958 31146 raft_consensus.cc:2468] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
I20260709 13:09:39.070087 31142 raft_consensus.cc:2468] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 13.
I20260709 13:09:39.071496 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:39.072280 30544 raft_consensus.cc:2393] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 8: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:39.072293 31142 raft_consensus.cc:2393] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 10: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:39.073642 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:39.073431  1924 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:39.075522 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:39.075726  1924 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:09:39.076170 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 540660us
I20260709 13:09:39.076362  1924 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.077040  1924 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:39.077394 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:39.077855 30516 leader_election.cc:304] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:39.079353 30516 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:39.080482  1924 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:39.081993 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:39.083557  1792 raft_consensus.cc:2804] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:09:39.083847 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.084036  1792 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:39.084481  1792 raft_consensus.cc:3060] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:39.085455 30618 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:39.092088  1870 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:38.994961  1758 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:39.056243  1886 raft_consensus.cc:2804] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:39.108804 31115 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:39.109721 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:39.112293 30548 raft_consensus.cc:1240] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 6. Current term is 7. Ops: []
W20260709 13:09:39.114104 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 93724.6us
I20260709 13:09:39.085268  1681 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:09:39.142544 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 67919.8us
I20260709 13:09:39.145323 30544 raft_consensus.cc:1275] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:39.106429  1654 raft_consensus.cc:2749] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:39.135442  1923 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:39.146600 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:39.111579  1837 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:39.158463  1939 log.cc:927] Time spent T 00000000000000000000000000000000 P 045170a35afe4845987482e49e9e1eb9: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:09:39.158545  1837 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:39.165757  1837 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
W20260709 13:09:39.166477 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 57724.9us
I20260709 13:09:39.166368  1837 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:39.167207 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:39.155392  1923 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:39.133536  1736 raft_consensus.cc:2749] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:39.168231 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:39.168505  1837 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:39.170135 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:39.170794  1656 raft_consensus.cc:2804] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:39.155848 30549 raft_consensus.cc:2468] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 8.
I20260709 13:09:39.133471  1886 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:39.184518 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 50345.7us
I20260709 13:09:39.188406 30546 raft_consensus.cc:2468] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 8.
I20260709 13:09:39.174664 30543 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 10.
I20260709 13:09:39.183280 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:39.194983 30551 raft_consensus.cc:3060] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:39.201380  1395 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:39.203954  1395 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:39.193485  1740 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:39.207044  1740 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:39.208000 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
W20260709 13:09:39.208595 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 129371us
I20260709 13:09:39.210464 31145 raft_consensus.cc:1240] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 9 LEADER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 13:09:39.212760 31143 raft_consensus.cc:2393] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 11: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:39.209810 30589 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:39.183143  1656 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.222604  1656 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:39.225520 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:39.226594 30545 raft_consensus.cc:2468] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7.
I20260709 13:09:39.228744 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:39.229619 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:39.230297 31146 raft_consensus.cc:2468] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 6.
I20260709 13:09:39.230465  1760 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:39.232344 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:39.232928 31151 raft_consensus.cc:2468] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 7.
I20260709 13:09:39.233326  1923 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:39.187033  1681 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:39.237668 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:39.237859  1681 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:39.238641 30619 raft_consensus.cc:2393] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 7: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:39.219278  1758 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:39.240218 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:39.241104 30517 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:39.241844 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 47801.5us
I20260709 13:09:39.242022  1841 raft_consensus.cc:2804] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:39.242432  1841 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:39.242780  1841 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:39.241676  1934 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:39.260398  1684 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.260982  1684 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:39.261531  1758 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.262132  1758 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:39.264564  1758 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:39.265026 30547 raft_consensus.cc:3060] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:39.266433 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:39.267030 31151 raft_consensus.cc:3060] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:39.221745 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:39.267648 30549 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
I20260709 13:09:39.269536 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:39.270160 30621 raft_consensus.cc:3060] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:39.272509 30618 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 12.
I20260709 13:09:39.274526  1930 raft_consensus.cc:2749] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:39.276337 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:39.277139 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:39.277446  1681 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:39.276881 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:39.278519 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:39.278235 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:39.278857 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:39.278115 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:39.293104 30469 raft_consensus.cc:2468] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
I20260709 13:09:39.279750 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:39.279929 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:39.280426 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:39.183725  1870 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.227686 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:39.264474 31145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48426 (request call id 779) took 1269 ms. Trace:
W20260709 13:09:39.307703 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 66682.6us
I20260709 13:09:39.287657 30548 raft_consensus.cc:2468] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 8.
I20260709 13:09:39.300289 30551 raft_consensus.cc:2468] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
I20260709 13:09:39.300556 31151 raft_consensus.cc:2468] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 6.
I20260709 13:09:39.294011 30470 raft_consensus.cc:2468] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 5.
I20260709 13:09:39.293133 30472 raft_consensus.cc:2468] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
I20260709 13:09:39.315374 30545 raft_consensus.cc:2410] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:09:39.194784  1886 raft_consensus.cc:3060] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:39.279945  1932 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:39.317951  1932 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:39.318434 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:39.319082 30548 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
I20260709 13:09:39.319267 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:39.320067  1932 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:39.322170 30543 raft_consensus.cc:2393] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 12: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:39.323158 30619 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 9.
W20260709 13:09:39.324141 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 83140.2us
I20260709 13:09:39.324908  1925 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:39.307982 31145 rpcz_store.cc:276] 0709 13:09:37.995288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.003962 (+  8674us) service_pool.cc:224] Handling call
0709 13:09:38.471627 (+467665us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:39.241133 (+769506us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.264171 (+ 23038us) spinlock_profiling.cc:243] Waited 674 ms on lock 0x7b5400602a54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:39.264404 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1550943104}
I20260709 13:09:39.318111  1792 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:39.335436 30546 raft_consensus.cc:2468] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7.
I20260709 13:09:39.340590 30618 raft_consensus.cc:2468] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 8.
I20260709 13:09:39.325296  1829 consensus_queue.cc:1048] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:39.337354 30589 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:39.345008 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:39.345467 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:39.350236 30516 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:39.276834  1758 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.297225  1684 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:39.349946 30589 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:39.335078  1736 raft_consensus.cc:2749] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:39.360147 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:39.360918 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:39.364158 30589 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:39.367426 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:39.368177 30471 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 11.
I20260709 13:09:39.368294 30618 raft_consensus.cc:2468] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 10.
I20260709 13:09:39.368933 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:39.369546 30472 raft_consensus.cc:2368] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 5. Current term is 6.
I20260709 13:09:39.355695  1740 raft_consensus.cc:2804] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:39.325505  1925 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:39.373271 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:39.357631  1760 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:39.376667 30589 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:39.377914 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:39.386078 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:39.386703 30467 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 11.
I20260709 13:09:39.387995  1705 raft_consensus.cc:2804] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:39.388401  1705 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.388761  1705 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:39.349609  1656 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:39.391960  1761 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:39.370510  1740 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.392746  1740 raft_consensus.cc:3060] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:39.392786  1761 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:39.395922 30624 raft_consensus.cc:3060] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:09:39.370319  1924 raft_consensus.cc:2804] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:39.399725  1924 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.400224  1924 raft_consensus.cc:3060] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:39.401243  1792 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:39.401407 30621 raft_consensus.cc:2468] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 11.
I20260709 13:09:39.402009 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:39.402531 30473 raft_consensus.cc:3060] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:39.349359  1870 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:39.379392 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:39.405386 30619 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:39.355967  1654 consensus_queue.cc:1048] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:09:39.399271 30547 raft_consensus.cc:2468] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 10.
I20260709 13:09:39.408802 31115 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:39.373051  1926 raft_consensus.cc:2804] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:39.414345  1684 raft_consensus.cc:2804] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:39.418234 30589 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:39.408128 31116 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:39.403426  1656 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:39.430454  1761 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:39.431845  1652 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:39.417413  1925 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:39.373739  1758 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:39.417791  1926 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:39.439437  1926 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:39.440124  1758 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:39.440959  1870 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:39.444859 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:39.445124 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:39.445596 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:39.445755 30470 raft_consensus.cc:2468] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 12.
I20260709 13:09:39.446478 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:39.448316 30472 raft_consensus.cc:2410] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:09:39.448346  1792 raft_consensus.cc:2749] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:39.449016 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:39.449837 30476 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
W20260709 13:09:39.446614 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 75420.6us
I20260709 13:09:39.379400  1704 consensus_queue.cc:1048] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:09:39.377420  1934 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:39.415014  1684 raft_consensus.cc:697] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 11 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:39.448504 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:39.422200  1930 raft_consensus.cc:2804] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:39.462746 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:39.465346  1684 consensus_queue.cc:237] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:39.429791  1757 raft_consensus.cc:2804] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:39.467998  1757 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.468364  1757 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:39.472258 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 122084us
I20260709 13:09:39.434007  1652 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:39.473443 30470 raft_consensus.cc:2468] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 8.
I20260709 13:09:39.478711 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:39.479082 30549 raft_consensus.cc:1275] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:39.480139 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:39.480654 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:39.480816 30476 raft_consensus.cc:2376] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9. Re-sending same reply.
I20260709 13:09:39.480890 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:39.480224 30467 raft_consensus.cc:1275] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:39.483330 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:39.484109 30470 raft_consensus.cc:2393] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 9: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:39.486213  1792 consensus_queue.cc:1059] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:39.487088 31116 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:39.488819  1948 log.cc:927] Time spent T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.073s	user 0.003s	sys 0.000s
I20260709 13:09:39.503788 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:39.504766 30467 raft_consensus.cc:2468] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 9.
I20260709 13:09:39.505975 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:39.507009 30470 raft_consensus.cc:2393] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 12: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:39.508426  1654 consensus_queue.cc:1048] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:39.512929 30473 raft_consensus.cc:2468] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
I20260709 13:09:39.475140 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:39.515645 30474 raft_consensus.cc:2393] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 12: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:39.513301 30624 raft_consensus.cc:2468] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 6.
I20260709 13:09:39.514029 30619 raft_consensus.cc:2468] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 12.
I20260709 13:09:39.488711 30472 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 11.
I20260709 13:09:39.523582 31115 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:39.524986 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.537328 30475 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
I20260709 13:09:39.542140 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:39.545378 30516 leader_election.cc:304] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:39.547534 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:09:39.544180 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 70884.3us
I20260709 13:09:39.476737  1930 raft_consensus.cc:697] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:39.555250 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:39.543570  1924 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:39.601264  1652 raft_consensus.cc:2749] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:09:39.602188 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 115201us
I20260709 13:09:39.602922 31116 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:39.603181  1924 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:39.604278 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:39.604993 30472 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 10.
I20260709 13:09:39.604301 31116 leader_election.cc:304] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:39.606384 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:39.607180 30619 raft_consensus.cc:1240] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:39.616145 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:39.604548  1577 consensus_queue.cc:1048] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:09:39.617393 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:39.628177 30473 raft_consensus.cc:2393] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 8: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:39.616761  1652 consensus_queue.cc:1048] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:09:39.631799 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:39.633492 30624 raft_consensus.cc:1275] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:09:39.520398  1740 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:39.633563 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:39.639415 30619 raft_consensus.cc:3060] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:39.635196 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:39.640866 30547 raft_consensus.cc:3060] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:39.521944  1841 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:39.638481 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:39.631058 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:39.644047 30470 raft_consensus.cc:2468] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 9.
I20260709 13:09:39.638657 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:39.641656 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:39.650632 30474 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 12.
I20260709 13:09:39.630568  1934 raft_consensus.cc:2804] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:39.604398  1656 raft_consensus.cc:2804] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:09:39.659247 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 333684us
I20260709 13:09:39.644358  1792 raft_consensus.cc:2749] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:39.660558 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 56354.5us
I20260709 13:09:39.658802 30467 raft_consensus.cc:2468] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 11.
I20260709 13:09:39.668550 30616 raft_consensus.cc:1240] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:39.658306  1925 raft_consensus.cc:2804] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:39.674415 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:39.658690  1934 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:39.675295 30551 raft_consensus.cc:2393] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 10: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:39.678539 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:39.680320 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:39.680518 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:39.648844  1757 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:39.672528  1924 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.689155 30547 raft_consensus.cc:2468] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 8.
I20260709 13:09:39.693873 30619 raft_consensus.cc:2468] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 9.
I20260709 13:09:39.675442  1656 raft_consensus.cc:697] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 12 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:39.698104 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:39.688792 30441 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:39.702195 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:39.702741 30589 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:39.686228  1667 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:39.705199  1924 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:39.705406  1667 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:39.708338 30618 raft_consensus.cc:2393] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 8: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:39.679334  1934 raft_consensus.cc:3060] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:39.676357  1652 consensus_queue.cc:1059] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:09:39.715009 30619 raft_consensus.cc:1240] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:39.718137 30551 raft_consensus.cc:3060] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:39.720091 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:39.722908 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:39.676545  1761 consensus_queue.cc:1048] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:09:39.729436 30440 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:39.731761 30551 raft_consensus.cc:2468] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 8.
I20260709 13:09:39.707767  1924 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:39.735617 30619 raft_consensus.cc:1240] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 8. Current term is 9. Ops: [6.9-8.10]
I20260709 13:09:39.713181  1884 raft_consensus.cc:2804] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:39.676764  1930 consensus_queue.cc:237] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:39.745280 31145 raft_consensus.cc:1240] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:39.748555 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:39.749356  1655 consensus_queue.cc:1048] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:39.751317  1667 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:39.756019  1884 raft_consensus.cc:697] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:39.756990  1884 consensus_queue.cc:237] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:39.757773 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:39.764635  1740 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:39.740161  1705 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:39.766443 30544 raft_consensus.cc:2393] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 12: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:39.767361  1705 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:39.768119  1656 consensus_queue.cc:237] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:39.770006 31115 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:39.774252 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 88307.1us
I20260709 13:09:39.722384  1923 raft_consensus.cc:2749] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:39.742769  1870 raft_consensus.cc:2804] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:39.776973  1870 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.778077 31146 raft_consensus.cc:1240] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 11 LEADER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:39.777338  1870 raft_consensus.cc:3060] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:39.779332 30440 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:39.779146 31116 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:39.782337 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:39.785204 30619 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:39.778558 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:39.794147 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:39.796056 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:39.798252 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:39.772347  1757 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:39.811390 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:39.812242 30547 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:39.803948 30616 raft_consensus.cc:1240] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:39.806097 30625 raft_consensus.cc:2393] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 12: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:39.807231 30441 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:39.805377 30590 leader_election.cc:304] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:39.818869 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:39.819507 30476 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 9.
I20260709 13:09:39.782428  1792 raft_consensus.cc:2804] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:39.824388 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:39.827718 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:39.828145 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:39.828550 30474 raft_consensus.cc:2393] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 10: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:39.828881 30542 raft_consensus.cc:3060] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:39.774969  1890 consensus_queue.cc:1048] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:09:39.799440  1758 raft_consensus.cc:2804] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:39.832471 30590 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:39.843212 30590 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:39.831180 30467 raft_consensus.cc:2393] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 6: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:39.806907  1652 raft_consensus.cc:2804] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:39.844966  1932 raft_consensus.cc:2749] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:39.847105 30440 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:39.850579 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:39.854539  1925 raft_consensus.cc:493] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:39.855047  1925 raft_consensus.cc:3060] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:39.836002  1740 raft_consensus.cc:2764] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:09:39.827252  1924 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
W20260709 13:09:39.876459 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 48482.8us
I20260709 13:09:39.845917  1841 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:39.845721  1652 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:39.857770  1792 raft_consensus.cc:697] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 9 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:39.912248 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:39.891144  1934 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:39.866463  1757 raft_consensus.cc:2804] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:39.897429 31116 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:39.869207  1671 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.903342 30542 raft_consensus.cc:2468] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
I20260709 13:09:39.904013  1924 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:39.870219  1577 raft_consensus.cc:2749] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:39.891621  1907 raft_consensus.cc:3055] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:39.909682  1652 raft_consensus.cc:3060] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:39.883327  1834 raft_consensus.cc:2804] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:39.915663 30619 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 11.
I20260709 13:09:39.885365 30441 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:39.935338 30547 raft_consensus.cc:2468] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 8.
I20260709 13:09:39.945976 31151 raft_consensus.cc:2410] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:09:39.923679  1757 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:39.952844 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 71712.6us
I20260709 13:09:39.953819 30441 leader_election.cc:304] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:39.943552  1395 raft_consensus.cc:2804] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:39.942807  1907 raft_consensus.cc:740] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:39.949389  1705 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:39.954084  1757 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:39.988780 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 127756us
I20260709 13:09:39.960040  1395 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.942975  1671 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:39.958164  1890 raft_consensus.cc:2804] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:39.992267 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:39.958014  1704 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:39.959775  1834 raft_consensus.cc:697] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 8 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:39.959828  1758 raft_consensus.cc:697] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 10 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:40.001478 30543 raft_consensus.cc:1275] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:09:40.002627  1655 raft_consensus.cc:493] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:40.002862 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:40.004016  1870 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:39.998445  1926 consensus_meta.cc:287] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.558s	user 0.010s	sys 0.000s
I20260709 13:09:39.998658  1890 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:40.005674 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:40.012144 30548 raft_consensus.cc:2368] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 7. Current term is 8.
I20260709 13:09:40.006282  1704 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:40.011255 30441 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.014683 30517 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:40.015340 31146 raft_consensus.cc:2368] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 7. Current term is 8.
I20260709 13:09:39.997768  1395 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:39.991462  1969 raft_consensus.cc:2804] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:40.007951  1760 raft_consensus.cc:493] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.026068 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:40.015027  1890 raft_consensus.cc:3060] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:40.020231  1829 raft_consensus.cc:2804] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:40.045851 30619 raft_consensus.cc:1240] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:40.036965 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:39.995402  1705 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:40.024549  1655 raft_consensus.cc:515] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:40.039328  1758 consensus_queue.cc:237] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:40.061247  1684 consensus_queue.cc:1059] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:09:40.014927  1926 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:40.063795  1926 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:40.064769 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:40.065352 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:40.067178  1655 leader_election.cc:290] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:40.067340 31142 raft_consensus.cc:1240] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 12 LEADER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:40.068193 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:40.068404 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:40.068708 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:40.069301 31142 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 10.
I20260709 13:09:40.069427 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:40.070086 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:40.070533 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:40.070755  1925 raft_consensus.cc:515] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:40.071051 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:40.007701  1834 consensus_queue.cc:237] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:40.072036 31142 raft_consensus.cc:2393] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 13: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:40.074649  1705 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:40.056443  1829 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:40.074958  1890 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:40.075481  1829 raft_consensus.cc:3060] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:40.069438 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:40.080818 31144 raft_consensus.cc:2410] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:09:40.083070  1890 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:40.084040 30517 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:40.087594 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:40.085696 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:40.071980 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:40.085662  1870 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:40.014264  1792 consensus_queue.cc:237] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:40.084777 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:40.090154 31145 raft_consensus.cc:2468] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 10.
I20260709 13:09:40.094878  1705 raft_consensus.cc:2804] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:40.098137  1705 raft_consensus.cc:697] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 11 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:40.099030  1705 consensus_queue.cc:237] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:40.102560  1925 leader_election.cc:290] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:40.103538  1886 consensus_meta.cc:287] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.752s	user 0.005s	sys 0.002s
W20260709 13:09:40.108403  1971 log.cc:927] Time spent T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:09:40.088033  1671 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:40.119444  1886 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:40.120424  1924 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:40.065546  1760 raft_consensus.cc:515] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:40.121269  1704 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:40.123034  1760 leader_election.cc:290] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:40.125690 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:40.125958 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:40.126315 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:40.126873 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:40.127758 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:40.128190 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:40.128820 30617 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 10.
I20260709 13:09:40.125730 30619 raft_consensus.cc:1240] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:40.130503 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:40.131255 30551 raft_consensus.cc:2393] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 8: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:40.131546 30617 raft_consensus.cc:1275] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:40.132529 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:40.132974 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:40.133656 30548 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 8.
I20260709 13:09:40.134213 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:40.134555 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:40.134908 30617 raft_consensus.cc:2393] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 9: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:40.135648 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:40.135766 30517 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:40.136011 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:40.136112 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:40.136310 30624 raft_consensus.cc:2468] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9.
I20260709 13:09:40.136626 30623 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 11.
I20260709 13:09:40.117444  1934 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:40.137239 30517 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:40.137972 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:40.138492 30623 raft_consensus.cc:3060] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:40.135648 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:40.138387 30517 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:40.146544 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:40.146986 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:40.148586  1704 raft_consensus.cc:2804] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:40.148870  1955 raft_consensus.cc:2804] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:40.149034  1704 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:40.149308  1955 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:40.149469  1704 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:40.149732  1955 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:40.152480 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:40.152771 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:40.153782 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:40.154310  1907 consensus_queue.cc:260] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:40.155516  1907 raft_consensus.cc:3060] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:40.157119 30623 raft_consensus.cc:2468] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 12.
I20260709 13:09:40.157405 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:40.158119  1972 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:40.146517  1925 raft_consensus.cc:2804] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:40.160619 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:09:40.165797 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 171989us
I20260709 13:09:40.166158 31143 raft_consensus.cc:3060] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:40.160851 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:40.161258 30621 raft_consensus.cc:2368] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 10. Current term is 11.
I20260709 13:09:40.162184 30548 raft_consensus.cc:3055] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:40.168332 30551 raft_consensus.cc:2368] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 7. Current term is 8.
I20260709 13:09:40.168391 30548 raft_consensus.cc:740] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:40.176249 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:40.166970 30620 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 11.
I20260709 13:09:40.186280 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:40.139042  1395 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:40.189802 30551 raft_consensus.cc:1240] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:40.220108 30550 raft_consensus.cc:1240] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:40.217159 31143 raft_consensus.cc:2468] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 11.
I20260709 13:09:40.233421 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:40.233681 30545 raft_consensus.cc:1240] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:09:40.234210 30542 raft_consensus.cc:2393] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 8: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:40.212813 31116 leader_election.cc:304] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:40.211092 30476 raft_consensus.cc:1240] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:40.234563 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:40.235363 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:40.170313  1925 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:40.241328  1925 raft_consensus.cc:3060] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:40.204190 30548 consensus_queue.cc:260] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:40.243607 31115 leader_election.cc:400] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 election: Vote denied by peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) with higher term. Message: Invalid argument: T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 10. Current term is 11.
I20260709 13:09:40.244129 31115 leader_election.cc:403] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:09:40.244143 30550 raft_consensus.cc:2368] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 7. Current term is 8.
I20260709 13:09:40.247975 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:40.246735 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:40.169615  1886 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:40.247991 30470 raft_consensus.cc:1240] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 10 LEADER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:40.243830 30546 raft_consensus.cc:3055] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:40.207554 30516 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:40.250294 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:40.252111 30546 raft_consensus.cc:740] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:40.255558  1652 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:40.262372 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 54880.8us
I20260709 13:09:40.267851 30548 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:40.267771 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 178216us
I20260709 13:09:40.269037 30441 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:40.191043  1969 raft_consensus.cc:697] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 6 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
W20260709 13:09:40.276505 30517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.258613  1934 raft_consensus.cc:2749] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) with higher term. Message: Invalid argument: T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 10. Current term is 11.
I20260709 13:09:40.259694  1407 raft_consensus.cc:2749] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:40.268918  1736 raft_consensus.cc:2749] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:40.231094  1972 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:40.274863 30546 consensus_queue.cc:260] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:40.321992 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 58882.8us
I20260709 13:09:40.326143 30516 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:40.275121  1981 consensus_queue.cc:1059] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
W20260709 13:09:40.328578 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 59583.4us
I20260709 13:09:40.272778  1973 consensus_queue.cc:1059] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:09:40.337941 30546 raft_consensus.cc:3060] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:40.339335 30441 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:40.301119  1923 raft_consensus.cc:2749] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:40.343024 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:40.343848 30474 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:40.346931 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 68376.2us
W20260709 13:09:40.356643 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 89707us
I20260709 13:09:40.346727  1736 raft_consensus.cc:2749] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:40.363034 30591 leader_election.cc:304] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:40.364370 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:40.363186 30589 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:40.366355 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:40.372198  1926 raft_consensus.cc:2804] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:40.372810  1926 raft_consensus.cc:493] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:40.373205  1926 raft_consensus.cc:3060] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:40.374027  1577 raft_consensus.cc:2804] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:40.374598  1577 raft_consensus.cc:697] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:40.375463  1577 consensus_queue.cc:237] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:40.364358  1829 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:40.364972  1890 raft_consensus.cc:3055] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:40.380234  1890 raft_consensus.cc:740] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:40.381084  1890 consensus_queue.cc:260] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:40.382234  1890 raft_consensus.cc:3060] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:40.383294 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:40.352615  1969 consensus_queue.cc:237] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:40.384899  1926 raft_consensus.cc:515] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:40.392917 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 53697.5us
I20260709 13:09:40.369946 30589 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:40.425459 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 62487.4us
I20260709 13:09:40.428798 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:40.429363 30548 raft_consensus.cc:1275] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 10. (term mismatch)
I20260709 13:09:40.430653 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:40.431093 30548 pending_rounds.cc:85] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd: Aborting all ops after (but not including) 9
I20260709 13:09:40.432324 30548 pending_rounds.cc:107] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd: Aborting uncommitted NO_OP operation due to leader change: 8.10
I20260709 13:09:40.434058 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:40.428848 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:09:40.443542 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.368772  1982 raft_consensus.cc:2749] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:40.503885 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 177845us
I20260709 13:09:40.504014 30546 raft_consensus.cc:1275] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 13:09:40.509963 30546 pending_rounds.cc:85] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd: Aborting all ops after (but not including) 10
I20260709 13:09:40.510214 30546 pending_rounds.cc:107] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:09:40.510524 30546 raft_consensus.cc:2889] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:40.506816 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 79950us
I20260709 13:09:40.511835 30591 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:40.506683  1955 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:40.527211 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.379715  1704 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:40.530016  1704 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:40.532572  1972 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:40.465459  1886 raft_consensus.cc:2804] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:40.536343  1886 raft_consensus.cc:697] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
W20260709 13:09:40.536643  1984 log.cc:927] Time spent T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
W20260709 13:09:40.537868  1983 log.cc:927] Time spent T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.252s	user 0.000s	sys 0.002s
W20260709 13:09:40.537572  1989 log.cc:927] Time spent T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 13:09:40.537559  1886 consensus_queue.cc:237] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:40.539256  1987 log.cc:927] Time spent T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
W20260709 13:09:40.542537 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 77418.4us
I20260709 13:09:40.543380 30441 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:40.544793 30441 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:40.546346  1982 raft_consensus.cc:2749] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:40.547116  1982 raft_consensus.cc:2804] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:40.547686  1982 raft_consensus.cc:697] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 12 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:40.548732  1982 consensus_queue.cc:237] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:40.515216 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:40.551544 30591 leader_election.cc:400] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 pre-election: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 5. Current term is 6.
I20260709 13:09:40.552762 30591 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:40.554203 30591 leader_election.cc:304] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:40.557582 30616 raft_consensus.cc:2393] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 9: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:40.561754 30516 leader_election.cc:400] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 election: Vote denied by peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453) with higher term. Message: Invalid argument: T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 7. Current term is 8.
I20260709 13:09:40.562054 30516 leader_election.cc:403] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:09:40.434099 30548 raft_consensus.cc:2889] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:40.617383  1704 consensus_queue.cc:1059] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:40.618345 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:09:40.618937 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 98698.4us
I20260709 13:09:40.621109 30547 raft_consensus.cc:1240] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 11. Current term is 12. Ops: []
W20260709 13:09:40.626072 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 75400.3us
I20260709 13:09:40.627753 30516 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:40.392575  1757 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:40.632627 30441 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:40.551968  1671 raft_consensus.cc:2749] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:40.561192  1841 raft_consensus.cc:2764] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:09:40.618104  1926 leader_election.cc:290] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:40.625701  1829 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:40.646778 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:40.632006  1924 raft_consensus.cc:2749] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:40.666923 30617 raft_consensus.cc:2368] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 13. Current term is 14.
I20260709 13:09:40.664444 30516 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:40.677345 30623 raft_consensus.cc:1240] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:09:40.640496  1499 raft_consensus.cc:2749] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453) with higher term. Message: Invalid argument: T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 7. Current term is 8.
I20260709 13:09:40.639449  1758 raft_consensus.cc:2749] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:40.688731 30623 raft_consensus.cc:1275] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:09:40.699553 30616 raft_consensus.cc:1275] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:09:40.717155  1970 consensus_queue.cc:1048] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:40.719074  1395 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:40.722100  1996 log.cc:927] Time spent T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:09:40.723428 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:40.725728 30619 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:40.655885  1705 raft_consensus.cc:2749] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:40.655543  1995 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:40.732789 30474 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 10.
I20260709 13:09:40.741035 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:40.741923 31143 raft_consensus.cc:2468] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 9.
I20260709 13:09:40.745918 30516 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:40.712399  1907 consensus_meta.cc:287] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.541s	user 0.010s	sys 0.000s
I20260709 13:09:40.705835  1829 raft_consensus.cc:2749] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:40.754596 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:40.758769 30625 raft_consensus.cc:1275] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:09:40.758605 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 204474us
I20260709 13:09:40.754969 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:40.760341 30591 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
W20260709 13:09:40.764230 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 131682us
I20260709 13:09:40.766948 30548 raft_consensus.cc:1240] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:40.681156  1957 consensus_queue.cc:1059] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.092s
I20260709 13:09:40.769235 30549 raft_consensus.cc:1275] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:09:40.769258 30441 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:40.778223  1705 consensus_queue.cc:1059] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:40.781723  1957 consensus_queue.cc:1243] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer cd669586cff44d4bbfcc007e213faab6 log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:09:40.784505  1757 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:40.785490  1925 consensus_meta.cc:287] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.543s	user 0.010s	sys 0.001s
I20260709 13:09:40.785949  1925 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:40.786952 30545 raft_consensus.cc:3060] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:40.787950  1704 raft_consensus.cc:3055] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:40.788319  1704 raft_consensus.cc:740] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:40.789093  1704 consensus_queue.cc:260] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:40.790030  1907 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.790248  1704 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:40.790517  1907 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:40.792557  1907 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:40.794111 30545 raft_consensus.cc:2468] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 10.
I20260709 13:09:40.794209  1671 raft_consensus.cc:2804] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:40.794759  1671 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:40.794895 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:40.795167  1671 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:40.795315 30516 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:40.795651 30544 raft_consensus.cc:2393] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 5: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:40.796398  1932 raft_consensus.cc:2804] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:40.796931  1932 raft_consensus.cc:697] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 8 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:40.797582 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:40.797751  1932 consensus_queue.cc:237] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:40.798655 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:40.798471 30591 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:40.800881 30591 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:40.801867 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:40.801998 30441 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:40.802341  1886 raft_consensus.cc:2749] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:40.802706  1870 raft_consensus.cc:2749] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:40.802999 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:40.803023  1886 raft_consensus.cc:2804] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:40.803572  1886 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:40.804085 30441 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:40.803925  1671 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:40.804840  1758 raft_consensus.cc:2804] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:40.805199  1758 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.805549  1758 raft_consensus.cc:3060] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:40.805779  1870 consensus_queue.cc:1059] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:40.806860  1870 raft_consensus.cc:3055] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:40.807185  1870 raft_consensus.cc:740] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:40.807331  1991 consensus_queue.cc:1048] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:40.805580  1886 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:40.810575 30517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.812804 30591 leader_election.cc:304] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:40.813252 30441 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:40.803525 30616 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:40.761988  1499 raft_consensus.cc:2749] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:40.799243 30617 raft_consensus.cc:3060] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:40.765908  1924 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:40.751556  1995 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:40.840878 30619 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 10.
I20260709 13:09:40.842702 31115 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:40.820266  1757 raft_consensus.cc:2749] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:40.843380  1969 raft_consensus.cc:2804] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:40.807967  1407 consensus_queue.cc:1048] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:09:40.821796  1957 raft_consensus.cc:2749] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:40.826716  1991 consensus_queue.cc:1059] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:09:40.846647  1955 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:40.854497 30551 raft_consensus.cc:1275] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:40.855298 30440 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:40.855383 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:40.858464 30441 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:40.855361 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 60120.8us
I20260709 13:09:40.809703  1870 consensus_queue.cc:260] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:40.860643 30619 raft_consensus.cc:2468] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 7.
I20260709 13:09:40.861646 30516 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:40.870115 30441 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:40.830385  1924 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:40.853008  1969 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.871367 30441 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:40.855010  1684 raft_consensus.cc:2804] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:09:40.886236  1997 log.cc:927] Time spent T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:09:40.886624  1671 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:40.887269  1955 raft_consensus.cc:2749] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:40.888036  1932 consensus_queue.cc:1048] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:09:40.888883  1890 consensus_meta.cc:287] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.506s	user 0.010s	sys 0.000s
I20260709 13:09:40.890661  1924 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:40.891428  1870 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:40.872709  1923 raft_consensus.cc:2749] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:40.882445  1841 consensus_queue.cc:1048] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:09:40.888067 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:40.882993  1981 raft_consensus.cc:2804] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:40.894539  1981 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:40.894618 31149 raft_consensus.cc:2393] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 8: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:40.894927  1981 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:40.895292 31149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48414 (request call id 932) took 1013 ms. Trace:
I20260709 13:09:40.895714 31149 rpcz_store.cc:276] 0709 13:09:39.882319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.904344 (+ 22025us) service_pool.cc:224] Handling call
0709 13:09:40.887790 (+983446us) spinlock_profiling.cc:243] Waited 9.49 ms on lock 0x7b5800003998. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780e43b71 00007fc780e43a22 00007fc789d5cc09 00007fc788eb6ee0 00007fc788f800ab 00007fc788f80131 00007fc788f2e0a0 00007fc788f2d984 00007fc7824a86d4 00007fc7824a8662
0709 13:09:40.895224 (+  7434us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21825920}
I20260709 13:09:40.887202 30516 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:40.870967  1991 consensus_queue.cc:1243] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer f639301059e24dc5b0d88a46dc683326 log is divergent from this leader: its last log entry 10.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:09:40.909425 30441 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:40.909328 30617 raft_consensus.cc:2468] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 8.
I20260709 13:09:40.872254  1982 raft_consensus.cc:2804] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:40.882030  1969 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:40.916397  1973 raft_consensus.cc:2749] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:09:40.921554 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 63864.6us
I20260709 13:09:40.921686 30441 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:40.921424  1973 raft_consensus.cc:2749] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:40.922644 30591 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:40.923426  1973 raft_consensus.cc:2804] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:40.923925  1973 raft_consensus.cc:697] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 12 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:40.924002  1577 raft_consensus.cc:2749] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:40.924469 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:40.925339 30467 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 11.
I20260709 13:09:40.925545 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:40.925879 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:40.926378  2011 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:40.927064  2011 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:40.927505 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:40.928143 30469 raft_consensus.cc:3060] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:40.924885  1973 consensus_queue.cc:237] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:40.929854  2011 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:40.927599 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:40.923985  1829 raft_consensus.cc:2749] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:40.931771 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:40.940366 30516 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:40.891738  1995 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:40.946112 30591 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:40.959672 30591 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:40.961192 30591 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:40.961380 30469 raft_consensus.cc:2468] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 11.
W20260709 13:09:40.959685 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 85831.7us
I20260709 13:09:40.964666 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:40.965735 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:40.966642 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:40.967094 30469 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:40.882797  1757 consensus_queue.cc:1059] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:09:40.909726  1684 raft_consensus.cc:697] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 10 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:40.975554 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:40.977985 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:40.978233 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:40.982640 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:40.946839  1982 raft_consensus.cc:697] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 10 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
W20260709 13:09:40.985455 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 104110us
I20260709 13:09:40.985690 30516 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:40.958472  1955 raft_consensus.cc:2749] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:40.969933  1924 raft_consensus.cc:2749] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:40.996265 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:40.991030 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:40.991021 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:40.990377 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:40.994768 30472 raft_consensus.cc:3055] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:40.997597 30472 raft_consensus.cc:740] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:40.998399 30616 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 12.
I20260709 13:09:40.998683 30470 raft_consensus.cc:1240] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:09:41.001046 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:40.987574  1930 raft_consensus.cc:2749] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:41.002609 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:41.003758 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:41.005177 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:40.994050  1671 raft_consensus.cc:2804] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:40.994141  2011 raft_consensus.cc:2749] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:41.010036 30473 raft_consensus.cc:1240] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 12 LEADER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:41.012290  1684 consensus_queue.cc:237] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:41.013497  1982 consensus_queue.cc:237] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:41.001988  2015 consensus_queue.cc:1059] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:09:41.044348  2015 raft_consensus.cc:3055] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:41.044559  1841 raft_consensus.cc:493] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.021696 30472 consensus_queue.cc:260] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:41.003208  2006 consensus_queue.cc:1048] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:09:41.045642 30472 raft_consensus.cc:3060] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:41.024066  1652 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:41.025013 30543 raft_consensus.cc:1275] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:09:41.046276  1924 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:41.046978  1924 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:41.048300  1671 raft_consensus.cc:697] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:41.028093 30469 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 12.
I20260709 13:09:41.029093 30475 raft_consensus.cc:2468] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 8.
I20260709 13:09:41.051666 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:41.036306 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:41.036192 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:41.052765 30467 raft_consensus.cc:3060] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:40.999609  2004 consensus_queue.cc:1048] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:09:41.040514 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:41.058151 30470 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:41.044740  2015 raft_consensus.cc:740] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:41.045343  1841 raft_consensus.cc:515] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:41.064016  1930 consensus_queue.cc:1048] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:41.057703  1758 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:41.066407  1986 log.cc:927] Time spent T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.816s	user 0.007s	sys 0.006s
I20260709 13:09:41.069343 30468 raft_consensus.cc:1240] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:09:41.070884 30618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 835) took 1181 ms. Trace:
I20260709 13:09:41.071843 30471 raft_consensus.cc:2468] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
I20260709 13:09:41.072171 30616 raft_consensus.cc:1275] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:09:41.073431 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:41.074040 30616 raft_consensus.cc:2393] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 9: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:41.008917 30516 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
W20260709 13:09:41.010491  2008 log.cc:927] Time spent T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:09:41.023058  1907 raft_consensus.cc:3055] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:41.059021 30550 raft_consensus.cc:2468] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 9.
I20260709 13:09:41.062990 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:41.075583 30517 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:41.071341 30618 rpcz_store.cc:276] 0709 13:09:39.889660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.890116 (+   456us) service_pool.cc:224] Handling call
0709 13:09:39.890445 (+   329us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:40.018613 (+128168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:40.018655 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:40.025588 (+  6933us) log.cc:844] Serialized 52 byte log entry
0709 13:09:40.171849 (+146261us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:40.250213 (+ 78364us) log.cc:844] Serialized 14 byte log entry
0709 13:09:40.257093 (+  6880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:40.698706 (+441613us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b5400203354. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:40.698750 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:41.024462 (+325712us) spinlock_profiling.cc:243] Waited 6.17 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:09:41.070619 (+ 46157us) raft_consensus.cc:1685] finished
0709 13:09:41.070650 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:41.070816 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1305,"prepare.queue_time_us":156081,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":3973,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":3398,"spinlock_wait_cycles":299354240,"thread_start_us":147757,"threads_started":2,"wal-append.queue_time_us":183032}
I20260709 13:09:41.078050 30472 raft_consensus.cc:1275] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:09:41.081681 30472 pending_rounds.cc:85] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326: Aborting all ops after (but not including) 3
I20260709 13:09:41.081990 30472 pending_rounds.cc:107] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:09:41.082274 30472 raft_consensus.cc:2889] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:41.082983 30517 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
W20260709 13:09:41.085462 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 100534us
I20260709 13:09:41.084221 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:41.086436  1704 raft_consensus.cc:2749] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:41.088418 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:41.090376 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:41.090672 30517 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:41.084015  2011 raft_consensus.cc:2749] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:41.092140  2018 log.cc:927] Time spent T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:09:41.142614 30620 raft_consensus.cc:1240] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:41.092378  1736 raft_consensus.cc:3055] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:41.092794 30591 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:41.099903 30546 raft_consensus.cc:1275] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:09:41.104563 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:41.105038  1924 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:41.080076  1907 raft_consensus.cc:740] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:41.111161 30625 raft_consensus.cc:1240] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:41.112116 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:41.086282  1955 raft_consensus.cc:2749] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:41.113643 30469 raft_consensus.cc:2468] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 10.
I20260709 13:09:41.114504 30475 raft_consensus.cc:2468] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 8.
W20260709 13:09:41.115995  2002 log.cc:927] Time spent T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.348s	user 0.000s	sys 0.001s
I20260709 13:09:41.117319  1886 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:41.124185  2015 consensus_queue.cc:260] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:41.125599 30467 raft_consensus.cc:2468] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 10.
I20260709 13:09:41.126324  1969 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:41.153635 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:41.130709 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:41.135550 31143 raft_consensus.cc:3060] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:41.137741 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 128515us
I20260709 13:09:41.049532  1671 consensus_queue.cc:237] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:41.146015 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 53324.4us
I20260709 13:09:41.145987 31146 raft_consensus.cc:2468] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 7.
I20260709 13:09:41.148242 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:41.155476 30516 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:41.157305 30471 raft_consensus.cc:2468] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 7.
W20260709 13:09:41.150763 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 60170.7us
I20260709 13:09:41.152295 31116 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:41.157670 30591 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:41.159940 30516 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:41.160060 30591 leader_election.cc:304] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:41.160501 31116 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:41.160945  1926 raft_consensus.cc:2749] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:41.161305  1761 raft_consensus.cc:2804] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:41.161232  1907 consensus_queue.cc:260] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:41.161969  1761 raft_consensus.cc:697] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 10 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:41.162567  1907 raft_consensus.cc:3060] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:41.163221  1886 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:41.162902  1761 consensus_queue.cc:237] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:41.163667  1834 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:09:41.164106  1652 raft_consensus.cc:2804] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:41.164508  1652 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:41.164855  1652 raft_consensus.cc:3060] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:41.164944  2015 raft_consensus.cc:3060] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:41.165418  1758 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:41.165814  1969 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:41.149638  1930 raft_consensus.cc:2764] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:09:41.168068  1981 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:41.169358  1757 raft_consensus.cc:3055] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:41.169754 30474 raft_consensus.cc:1240] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:41.170192  1981 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:41.170751  1981 raft_consensus.cc:493] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.171149  1981 raft_consensus.cc:515] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:41.147212  2011 raft_consensus.cc:2749] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:41.169761  1757 raft_consensus.cc:740] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:41.172905  1704 raft_consensus.cc:2804] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:41.173321  1704 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:41.173766  1704 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:41.173372  1757 consensus_queue.cc:260] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:41.145464  1736 raft_consensus.cc:740] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:41.176857 30591 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:41.181643 30517 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:41.186771 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:41.187611 30624 raft_consensus.cc:3060] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:41.189968 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:41.196139 30590 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:41.197252 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:41.214247 30517 leader_election.cc:304] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:41.216104 30623 raft_consensus.cc:2393] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 7: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:41.222572 30625 raft_consensus.cc:1240] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 LEADER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:41.222453 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:41.223364 31151 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:41.223876 31149 raft_consensus.cc:1240] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 9 LEADER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:41.216156 31115 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:41.230533 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:41.236260 31143 raft_consensus.cc:1275] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:41.239717 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:41.240485 30622 raft_consensus.cc:2468] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 7.
I20260709 13:09:41.183306  1930 raft_consensus.cc:2749] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:41.193497  1757 raft_consensus.cc:3060] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:41.244127 30474 raft_consensus.cc:1275] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:09:41.190546  1955 raft_consensus.cc:2749] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:41.192062  2011 raft_consensus.cc:2804] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:41.245078  2016 consensus_queue.cc:1048] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.098s
I20260709 13:09:41.253114 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:41.223080  1957 raft_consensus.cc:2804] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:41.253803 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:41.256381 31150 raft_consensus.cc:2468] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
I20260709 13:09:41.258637  1957 raft_consensus.cc:697] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 8 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:41.259619  1957 consensus_queue.cc:237] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:41.264909  2022 raft_consensus.cc:2804] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:41.265501  2022 raft_consensus.cc:697] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:41.266393  2022 consensus_queue.cc:237] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:41.268110  1925 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:41.269044  1981 leader_election.cc:290] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:41.275939 30624 raft_consensus.cc:2468] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 10.
W20260709 13:09:41.277791 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.282508 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:41.283226 30470 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 13.
I20260709 13:09:41.283160 30546 raft_consensus.cc:2468] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 5.
I20260709 13:09:41.283057 30441 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:41.286361  1758 raft_consensus.cc:2749] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:41.284099 30469 raft_consensus.cc:1240] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:41.289417 30546 raft_consensus.cc:1275] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:09:41.288806 30441 leader_election.cc:304] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:41.175530  1736 consensus_queue.cc:260] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:41.316478 30441 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:41.285096  2011 raft_consensus.cc:697] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 12 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:41.329051 30441 leader_election.cc:304] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:41.317430 30440 leader_election.cc:304] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:09:41.339582 30517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.344488 30517 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:41.348201 30441 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:41.349614 30591 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:41.353960 30517 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:41.355186 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:41.355762 30548 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:41.312106  2023 raft_consensus.cc:2749] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:41.322233  1981 raft_consensus.cc:2749] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:41.359000 30550 raft_consensus.cc:1275] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:09:41.357229 30441 leader_election.cc:400] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Vote denied by peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) with higher term. Message: Invalid argument: T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 13. Current term is 14.
I20260709 13:09:41.360308 30441 leader_election.cc:403] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:41.361320 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:41.373463 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:41.384732 31151 raft_consensus.cc:2468] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 14.
I20260709 13:09:41.392583 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:41.395294 30549 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:09:41.389794 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:41.397179  1969 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:09:41.393784  1995 consensus_queue.cc:1048] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:09:41.359556  1886 consensus_queue.cc:1048] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:09:41.400032 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:41.401525 30469 raft_consensus.cc:1275] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:09:41.391955  1980 raft_consensus.cc:2764] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:09:41.402604 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:41.403167 30470 raft_consensus.cc:2376] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10. Re-sending same reply.
I20260709 13:09:41.404953 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:41.405616 30470 raft_consensus.cc:2393] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 8: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:41.406417 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:41.406044 30370 catalog_manager.cc:5697] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:41.356492  1829 consensus_queue.cc:1059] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:09:41.407245 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:41.408936 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:09:41.409277 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 59783.3us
I20260709 13:09:41.408962 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:41.395382 30544 raft_consensus.cc:2468] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 11.
I20260709 13:09:41.407634 30370 catalog_manager.cc:5697] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:41.328277  1982 raft_consensus.cc:2804] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:41.427616 30476 raft_consensus.cc:2393] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 12: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:41.430688 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:41.431133 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:41.431530 30550 raft_consensus.cc:2410] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:09:41.431931 30618 raft_consensus.cc:2468] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 5.
I20260709 13:09:41.352377  1834 raft_consensus.cc:2804] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:41.432261 30516 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:41.430755 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:41.438776 30474 raft_consensus.cc:1240] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 9. Current term is 10. Ops: [8.5-9.6]
I20260709 13:09:41.446842 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:41.447511 31151 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:41.435153 30590 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:41.465930 30548 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 11.
I20260709 13:09:41.470144 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:41.357278  1841 leader_election.cc:290] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133)
I20260709 13:09:41.357568  1870 raft_consensus.cc:2804] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:41.471823 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:41.472532 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:41.473397 30472 raft_consensus.cc:3055] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:41.357060  1499 raft_consensus.cc:2749] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:41.443955  1834 raft_consensus.cc:493] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.483965  1834 raft_consensus.cc:3060] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:41.484597  1499 consensus_queue.cc:1059] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:41.478534 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:41.485958  2016 raft_consensus.cc:2804] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:41.486370  2016 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:41.486722  2016 raft_consensus.cc:3060] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:41.425203  1982 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.488963  1982 raft_consensus.cc:3060] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:41.491494  2026 log.cc:927] Time spent T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:09:41.480749 30472 raft_consensus.cc:740] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:41.414047  1736 raft_consensus.cc:3060] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:41.492769  2024 log.cc:927] Time spent T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 13:09:41.484342  2011 consensus_queue.cc:237] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:41.358978  2009 consensus_queue.cc:1048] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.117s
I20260709 13:09:41.408264  2013 raft_consensus.cc:2804] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:41.436254 30370 catalog_manager.cc:5697] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 5 to 8, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 8 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:41.357818  1925 consensus_queue.cc:1048] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.119s
I20260709 13:09:41.352205  1760 consensus_queue.cc:1048] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.119s
I20260709 13:09:41.443203  1924 raft_consensus.cc:2804] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:41.479347  1870 raft_consensus.cc:493] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.503153 31147 raft_consensus.cc:2468] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 7.
I20260709 13:09:41.517438  2013 raft_consensus.cc:697] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 10 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:41.533643  1870 raft_consensus.cc:3060] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:41.469100  2023 consensus_queue.cc:1048] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
W20260709 13:09:41.535275 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 185761us
W20260709 13:09:41.540077 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 145299us
I20260709 13:09:41.534694  1924 raft_consensus.cc:697] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
W20260709 13:09:41.534860 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 103160us
I20260709 13:09:41.587387 30591 leader_election.cc:304] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
W20260709 13:09:41.561496 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 232374us
W20260709 13:09:41.561307 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 245253us
I20260709 13:09:41.554598  1834 raft_consensus.cc:515] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:41.554564  1829 raft_consensus.cc:3055] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:41.561051 31151 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 11.
W20260709 13:09:41.581658 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.581534  2016 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:41.582295 30622 raft_consensus.cc:1240] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 8. Current term is 9. Ops: []
W20260709 13:09:41.609184 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 174111us
W20260709 13:09:41.648495 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 61180.7us
I20260709 13:09:41.654382 30472 consensus_queue.cc:260] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:41.655367 30472 raft_consensus.cc:3060] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:41.654650 30591 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
W20260709 13:09:41.654297 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 50165us
I20260709 13:09:41.661242 31148 raft_consensus.cc:1275] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:09:41.569806  1684 raft_consensus.cc:2804] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:41.669149 30441 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:41.671236 30441 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:41.610997  1930 raft_consensus.cc:2749] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:41.611924 30517 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6
W20260709 13:09:41.708942 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 233734us
I20260709 13:09:41.706933 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:41.608520  1925 raft_consensus.cc:3055] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:41.707144 31147 raft_consensus.cc:1275] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:41.706063 30472 raft_consensus.cc:1275] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
W20260709 13:09:41.695319 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 263145us
I20260709 13:09:41.672951  2015 consensus_queue.cc:1048] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:09:41.713423 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:41.719872 30620 raft_consensus.cc:2393] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 10: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:41.714008 30516 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:41.714596 30472 pending_rounds.cc:85] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326: Aborting all ops after (but not including) 4
I20260709 13:09:41.720628 30472 pending_rounds.cc:107] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:09:41.720965 30472 raft_consensus.cc:2889] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:41.721449 31151 raft_consensus.cc:1275] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:41.715214 30441 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:41.658221  1926 raft_consensus.cc:2749] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:41.586454  1924 consensus_queue.cc:237] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:41.587057  2034 raft_consensus.cc:2749] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:09:41.727056 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 115243us
I20260709 13:09:41.730758 30623 raft_consensus.cc:1240] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:41.673074  1980 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.743569  1980 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:41.746093  1980 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:41.706831  2020 raft_consensus.cc:2749] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:41.671777  1829 raft_consensus.cc:740] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:41.717326  1923 raft_consensus.cc:2749] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:41.714814  1925 raft_consensus.cc:740] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:41.616689  1995 consensus_queue.cc:1059] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.115s
I20260709 13:09:41.674085  1499 consensus_queue.cc:1059] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 13:09:41.786490 30619 raft_consensus.cc:1275] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:09:41.785122 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 70359.7us
I20260709 13:09:41.780537  2048 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:41.782411  1757 consensus_meta.cc:287] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.528s	user 0.004s	sys 0.006s
I20260709 13:09:41.762663  2035 consensus_queue.cc:1059] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:09:41.832686 30472 raft_consensus.cc:1275] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:09:41.842749 30549 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 10.
I20260709 13:09:41.854489 30590 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:41.815352  1955 raft_consensus.cc:2749] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:41.807072  2044 raft_consensus.cc:2804] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:41.832850  1499 consensus_queue.cc:1243] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer f639301059e24dc5b0d88a46dc683326 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:09:41.879945 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 117237us
I20260709 13:09:41.889458 30625 raft_consensus.cc:1275] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:09:41.892103 30620 raft_consensus.cc:1275] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:09:41.895597 30517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.756250  2013 consensus_queue.cc:237] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:41.880939  1841 raft_consensus.cc:2804] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:41.882294  1757 raft_consensus.cc:493] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:41.892045  1704 consensus_meta.cc:287] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.718s	user 0.006s	sys 0.008s
I20260709 13:09:41.897488 30549 raft_consensus.cc:1240] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 8. Current term is 9. Ops: []
W20260709 13:09:41.891532  2029 log.cc:927] Time spent T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.274s	user 0.001s	sys 0.001s
W20260709 13:09:41.913208 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 199275us
W20260709 13:09:41.914511 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 186430us
I20260709 13:09:41.891753  2044 raft_consensus.cc:697] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 13 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:41.894378  1834 leader_election.cc:290] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:41.925083 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 108861us
I20260709 13:09:41.933809  1499 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:41.934551  1499 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:41.882370  1671 consensus_queue.cc:1048] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:09:41.833308  2048 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:41.936489 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 102871us
I20260709 13:09:41.909682  2017 raft_consensus.cc:2804] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:41.946165 31151 raft_consensus.cc:1240] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:41.885394  1925 consensus_queue.cc:260] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:41.928174  1841 raft_consensus.cc:697] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:41.916285  1704 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:41.914830  1757 raft_consensus.cc:515] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:41.985687 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:41.945370 31114 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
W20260709 13:09:41.950129  2040 log.cc:927] Time spent T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 13:09:41.948518  2017 raft_consensus.cc:697] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 7 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
W20260709 13:09:42.022917 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:42.053053 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:42.073638 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:42.075506 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.954906  2016 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:42.090135 30544 raft_consensus.cc:1275] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:09:42.090837 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 207716us
I20260709 13:09:42.091102 31151 raft_consensus.cc:2468] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
I20260709 13:09:42.005131  1925 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:42.178068 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 451675us
I20260709 13:09:42.178980 30441 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:42.000326  2039 consensus_queue.cc:1059] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.150s
W20260709 13:09:42.150382  2040 log.cc:927] Time spent T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:09:42.187081  2009 raft_consensus.cc:2804] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:42.190927  1990 consensus_queue.cc:1048] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:09:42.193207 30620 raft_consensus.cc:1240] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 11. Current term is 12. Ops: []
W20260709 13:09:42.194794  2049 log.cc:927] Time spent T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.252s	user 0.000s	sys 0.000s
W20260709 13:09:42.200804  1652 consensus_meta.cc:287] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 1.035s	user 0.010s	sys 0.003s
I20260709 13:09:42.201088 30473 raft_consensus.cc:1240] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:42.201273  1652 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:42.203433  1652 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:42.206558  2052 log.cc:927] Time spent T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.252s	user 0.000s	sys 0.000s
I20260709 13:09:42.207891 31146 raft_consensus.cc:1240] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:42.209255  2033 raft_consensus.cc:2749] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:42.210599 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 55971.7us
I20260709 13:09:42.211478  2048 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:42.214061  2063 consensus_queue.cc:1059] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:09:42.206373  1994 consensus_queue.cc:1048] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:42.150197  2042 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.230434 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:42.231036 31151 raft_consensus.cc:3060] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:42.225953 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 284190us
I20260709 13:09:42.262483 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
W20260709 13:09:42.329905 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 94114.6us
I20260709 13:09:42.108317 30590 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:42.342710 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 107321us
I20260709 13:09:42.225010  2009 raft_consensus.cc:697] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 11 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:42.366137 31151 raft_consensus.cc:2468] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 8.
I20260709 13:09:42.322391  2034 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:09:42.368166 31150 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.026s	sys 0.023s
W20260709 13:09:42.372895 31150 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.027s	sys 0.023s
I20260709 13:09:42.372637 30619 raft_consensus.cc:1240] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 LEADER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:42.236131  1990 consensus_queue.cc:1048] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.125s
I20260709 13:09:42.097469  2044 consensus_queue.cc:237] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:42.387892 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 279657us
I20260709 13:09:42.390488 31114 leader_election.cc:400] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 7. Current term is 8.
I20260709 13:09:42.393622 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:42.329883  2020 consensus_queue.cc:1048] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:09:42.398170 30620 raft_consensus.cc:1240] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:42.402166 30616 raft_consensus.cc:1275] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:42.267453  2042 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:42.233182  1841 consensus_queue.cc:237] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:42.391534 31114 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:42.423026 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:42.405145 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:42.400982  1926 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.433509  1926 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:42.427726 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:42.428272  2068 raft_consensus.cc:493] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.437098 30620 raft_consensus.cc:3060] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:42.437167  2068 raft_consensus.cc:515] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:42.440611 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:42.443394  1926 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:42.449455  1982 consensus_meta.cc:287] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.960s	user 0.006s	sys 0.004s
I20260709 13:09:42.450040  1982 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:42.451550 30468 raft_consensus.cc:2368] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 10. Current term is 11.
I20260709 13:09:42.326730  2017 consensus_queue.cc:237] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:42.388563  2034 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:42.458148  2034 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:42.457970  2009 consensus_queue.cc:237] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:42.459101  2054 raft_consensus.cc:3055] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:42.459589  2054 raft_consensus.cc:740] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:42.460485  2054 consensus_queue.cc:260] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:42.461823  2054 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:42.482851 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.465149 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:42.370235  2039 consensus_queue.cc:1048] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:09:42.395190  1499 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:42.498142 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 55409.8us
I20260709 13:09:42.403383  2072 raft_consensus.cc:2804] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:09:42.510820 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 119344us
I20260709 13:09:42.513121 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:42.513837 31148 raft_consensus.cc:2468] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7.
I20260709 13:09:42.518757  2065 raft_consensus.cc:3055] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:42.519169  2065 raft_consensus.cc:740] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:42.521224 30468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50446 (request call id 1917) took 1110 ms. Trace:
I20260709 13:09:42.521587 30468 rpcz_store.cc:276] 0709 13:09:41.411187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.411307 (+   120us) service_pool.cc:224] Handling call
0709 13:09:42.521050 (+1109743us) spinlock_profiling.cc:243] Waited 972 ms on lock 0x7b54003db3d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:42.521170 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2234524544}
I20260709 13:09:42.537077  1684 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.537762  1684 raft_consensus.cc:3060] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:42.366000 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:42.554450 30590 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:42.486052  1930 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:42.584115 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:42.584856 31148 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:42.590091 30591 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
W20260709 13:09:42.577068  2073 log.cc:927] Time spent T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:09:42.564785  1991 raft_consensus.cc:3055] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:42.629312 30591 leader_election.cc:304] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
W20260709 13:09:42.670591 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 447420us
I20260709 13:09:42.640074  1991 raft_consensus.cc:740] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
W20260709 13:09:42.686358 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 53127.1us
I20260709 13:09:42.687403 30591 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:42.640328  1577 raft_consensus.cc:2749] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:42.692780  2061 raft_consensus.cc:2749] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:42.693778  2041 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:42.694308  2041 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:42.697178  2041 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:42.698096 31148 raft_consensus.cc:2468] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 10.
I20260709 13:09:42.499249  2060 consensus_queue.cc:1059] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.146s
I20260709 13:09:42.583168  1671 raft_consensus.cc:2804] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:09:42.592105  1969 consensus_meta.cc:287] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 1.194s	user 0.012s	sys 0.000s
I20260709 13:09:42.586346  1704 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:42.699749 30516 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
W20260709 13:09:42.701730 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 136825us
I20260709 13:09:42.704684  1991 consensus_queue.cc:260] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:42.630661  2034 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:42.706902  1990 consensus_queue.cc:1059] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:42.707662  2089 consensus_queue.cc:1048] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:42.708207  2080 consensus_queue.cc:1048] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:42.709265 30441 leader_election.cc:304] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:42.631752  1757 leader_election.cc:290] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:42.707055  2042 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:42.712564  2013 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:42.583112  2072 raft_consensus.cc:697] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
W20260709 13:09:42.765501 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 65845.7us
I20260709 13:09:42.763375  2041 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:42.763370  1736 consensus_meta.cc:287] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 1.271s	user 0.009s	sys 0.003s
I20260709 13:09:42.709931  1671 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.790032  2035 raft_consensus.cc:2804] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:09:42.793895 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 84705.4us
I20260709 13:09:42.718596 31114 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:42.796002 30618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 851) took 1140 ms. Trace:
I20260709 13:09:42.790876  2087 raft_consensus.cc:493] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:42.721179  1969 raft_consensus.cc:2749] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) with higher term. Message: Invalid argument: T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 13. Current term is 14.
I20260709 13:09:42.765261  2061 raft_consensus.cc:2749] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:42.798139  2060 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.803365 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:42.779285  1982 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:42.809446 30620 raft_consensus.cc:2468] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 8.
I20260709 13:09:42.873198 30475 raft_consensus.cc:1240] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 11 LEADER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:42.814399 30546 raft_consensus.cc:2468] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 9.
I20260709 13:09:42.709400  1684 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:42.823033 30618 rpcz_store.cc:276] 0709 13:09:41.655591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.656762 (+  1171us) service_pool.cc:224] Handling call
0709 13:09:41.706492 (+ 49730us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:41.805596 (+ 99104us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:41.805658 (+    62us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:41.861242 (+ 55584us) log.cc:844] Serialized 26 byte log entry
0709 13:09:41.952760 (+ 91518us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:41.952839 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:41.952983 (+   144us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:42.795771 (+842788us) raft_consensus.cc:1685] finished
0709 13:09:42.795792 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:42.795941 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8061,"raft.queue_time_us":86289,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":81,"thread_start_us":136523,"threads_started":2,"wal-append.queue_time_us":618698}
I20260709 13:09:42.788529  1886 raft_consensus.cc:493] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
W20260709 13:09:42.820045  2036 log.cc:927] Time spent T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.928s	user 0.005s	sys 0.008s
I20260709 13:09:42.798928  2011 raft_consensus.cc:493] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
W20260709 13:09:42.719025  2022 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.959s	user 0.051s	sys 0.056s
I20260709 13:09:42.595882  1930 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:42.800261  2068 leader_election.cc:290] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:42.869352  1704 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:42.830775 31149 raft_consensus.cc:1240] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:42.785910  2034 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:42.812325  1890 raft_consensus.cc:2804] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:42.829967 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:09:42.878654 30474 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.004s	sys 0.028s
W20260709 13:09:42.934228 30474 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.004s	sys 0.028s
W20260709 13:09:42.882210 30442 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.007s	sys 0.028s
W20260709 13:09:42.934901 30442 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.007s	sys 0.028s
I20260709 13:09:42.797704  2088 raft_consensus.cc:2749] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:42.886818 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 168288us
I20260709 13:09:42.584223  2065 consensus_queue.cc:260] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:42.915899 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:42.922168 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:42.936534 31143 raft_consensus.cc:3060] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:42.874840  1924 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.019s	sys 0.013s
I20260709 13:09:42.924556 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:42.871279 30468 raft_consensus.cc:1240] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:42.820731  1671 raft_consensus.cc:3060] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:42.940155 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:42.804608  2013 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:42.931855 30469 raft_consensus.cc:2468] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 14.
I20260709 13:09:42.874878  1499 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:42.871515 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 184215us
W20260709 13:09:42.957836  2077 log.cc:927] Time spent T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 13:09:42.958557  2063 consensus_queue.cc:1048] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:42.958971 30591 leader_election.cc:400] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 10. Current term is 11.
I20260709 13:09:42.959385 30551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 2033) took 1248 ms. Trace:
I20260709 13:09:42.893970  2044 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.960067  2044 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:42.940644 31114 leader_election.cc:400] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 election: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 7. Current term is 8.
I20260709 13:09:42.961042 31114 leader_election.cc:403] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:09:42.961740  2088 raft_consensus.cc:2749] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 7. Current term is 8.
I20260709 13:09:42.962025 31114 leader_election.cc:304] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:42.962355  2044 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:42.962656  1890 raft_consensus.cc:697] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 8 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:42.963333  1969 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.963269  1499 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:42.963981  1969 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:42.963589  1890 consensus_queue.cc:237] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:42.966156  1969 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:42.966810  2079 log.cc:927] Time spent T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
I20260709 13:09:42.967178  1499 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:42.967654  2088 raft_consensus.cc:2749] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:42.967823  2075 raft_consensus.cc:2749] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:42.968169 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:42.968500 31150 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48412 (request call id 753) took 1298 ms. Trace:
W20260709 13:09:42.969488 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.968954 31150 rpcz_store.cc:276] 0709 13:09:41.670047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.670206 (+   159us) service_pool.cc:224] Handling call
0709 13:09:41.713165 (+ 42959us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:41.865267 (+152102us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:41.865311 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:41.865861 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 13:09:42.373579 (+507718us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:42.373644 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.373767 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:42.968316 (+594549us) raft_consensus.cc:1685] finished
0709 13:09:42.968336 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:42.968450 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":146767,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":16028,"thread_start_us":658883,"threads_started":2,"wal-append.queue_time_us":699912}
I20260709 13:09:42.968958 30468 raft_consensus.cc:2368] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 10. Current term is 11.
I20260709 13:09:42.971346 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:42.972419 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:42.972987 30468 raft_consensus.cc:2468] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
I20260709 13:09:42.971419  1704 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:42.974716 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:09:42.909091  2022 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.152s	user 0.052s	sys 0.061s
I20260709 13:09:42.978966 31143 raft_consensus.cc:2468] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 11.
I20260709 13:09:42.815438  2041 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:42.990082 30621 raft_consensus.cc:1275] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:09:42.940145  1924 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.020s	sys 0.017s
I20260709 13:09:42.960330  2039 consensus_queue.cc:1048] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:43.019389 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:42.939555  1981 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:43.172375  1981 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:42.969357  2070 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.959723 30551 rpcz_store.cc:276] 0709 13:09:41.711429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.711980 (+   551us) service_pool.cc:224] Handling call
0709 13:09:41.712379 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:41.741175 (+ 28796us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:41.900146 (+158971us) log.cc:844] Serialized 14 byte log entry
0709 13:09:42.216368 (+316222us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:42.216913 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 13:09:42.217061 (+   148us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:42.217104 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.217187 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:42.959206 (+742019us) raft_consensus.cc:1685] finished
0709 13:09:42.959225 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:42.959337 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72227,"prepare.queue_time_us":199300,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":136293,"raft.run_cpu_time_us":397,"raft.run_wall_time_us":138522,"thread_start_us":348118,"threads_started":2,"wal-append.queue_time_us":481123}
I20260709 13:09:42.886221  1886 raft_consensus.cc:515] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:42.922683  2011 raft_consensus.cc:515] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:42.876387  2060 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:43.049325 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.037158  2035 raft_consensus.cc:697] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 10 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:42.869191  2087 raft_consensus.cc:515] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:43.021466  2042 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:43.042685  2022 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.995517  1980 consensus_queue.cc:1059] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.104s
I20260709 13:09:43.157935 30624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36130 (request call id 1995) took 1769 ms. Trace:
W20260709 13:09:43.158968 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 115330us
I20260709 13:09:43.198395 31114 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:43.199638 31114 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:43.082953  2063 consensus_queue.cc:1048] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 13:09:43.160048  2044 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:43.019937  1577 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:43.022147  2065 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:43.099773  2091 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:43.168877 30471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 1922) took 1755 ms. Trace:
I20260709 13:09:43.170806 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:43.171039  1684 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:43.171694  1973 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:43.175758 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:09:43.184600 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 98590.7us
I20260709 13:09:42.885499  2072 consensus_queue.cc:237] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:43.192124 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:43.040705  2088 consensus_queue.cc:1048] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.147s
I20260709 13:09:43.201663 30551 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:43.164506  1736 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:09:43.197170 30469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50446 (request call id 1913) took 1792 ms (client timeout 2146 ms). Trace:
W20260709 13:09:43.281456 30469 rpcz_store.cc:269] 0709 13:09:41.404388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.406201 (+  1813us) service_pool.cc:224] Handling call
0709 13:09:43.196967 (+1790766us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b540029b3d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:43.197100 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3385277184}
I20260709 13:09:43.211798 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:43.225858  2075 raft_consensus.cc:2749] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:43.222963 30591 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.070s (SENT) [suppressed 18 similar messages]
W20260709 13:09:43.235845  2085 log.cc:927] Time spent T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.428s	user 0.000s	sys 0.001s
W20260709 13:09:43.251006  2093 log.cc:927] Time spent T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.324s	user 0.000s	sys 0.001s
I20260709 13:09:43.252301  2053 consensus_queue.cc:1059] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.178s
I20260709 13:09:43.195044  2070 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:43.252410  1704 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:43.233713 30471 rpcz_store.cc:276] 0709 13:09:41.413612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.413715 (+   103us) service_pool.cc:224] Handling call
0709 13:09:41.440143 (+ 26428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:41.539449 (+ 99306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:41.539496 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:42.536590 (+997094us) spinlock_profiling.cc:243] Waited 4.09 ms on lock 0x7b2c000014c8. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc782861a11 00007fc782871372 00007fc783fa3a01 00007fc783f6843a 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2
0709 13:09:42.552144 (+ 15554us) log.cc:844] Serialized 26 byte log entry
0709 13:09:42.805553 (+253409us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:42.805590 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.805652 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:43.168612 (+362960us) raft_consensus.cc:1685] finished
0709 13:09:43.168631 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:43.168822 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":48926,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":108,"spinlock_wait_cycles":9405824,"thread_start_us":351899,"threads_started":2,"wal-append.queue_time_us":448295}
I20260709 13:09:43.249689  2098 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:43.187939  1969 consensus_queue.cc:1048] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:09:43.233757  1499 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.256922 30441 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:43.212942  2042 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:43.259081 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 59498.6us
I20260709 13:09:43.312530 31114 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:43.271739 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:43.282516 30548 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
I20260709 13:09:43.198237 30624 rpcz_store.cc:276] 0709 13:09:41.388844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.388961 (+   117us) service_pool.cc:224] Handling call
0709 13:09:41.389293 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:41.400045 (+ 10752us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:41.400078 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:41.400485 (+   407us) log.cc:844] Serialized 26 byte log entry
0709 13:09:41.555406 (+154921us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:41.731753 (+176347us) log.cc:844] Serialized 14 byte log entry
0709 13:09:41.970263 (+238510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:41.970385 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:42.350933 (+380548us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:09:43.026927 (+675994us) raft_consensus.cc:1685] finished
0709 13:09:43.098874 (+ 71947us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:43.157823 (+ 58949us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28522,"prepare.queue_time_us":339121,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":62566,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":155,"spinlock_wait_cycles":48235392,"thread_start_us":463134,"threads_started":3,"wal-append.queue_time_us":260735}
I20260709 13:09:43.313428 31150 raft_consensus.cc:2468] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 9.
I20260709 13:09:43.290603 30370 catalog_manager.cc:5697] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 3 to 5, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 5 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:09:43.232421  2069 raft_consensus.cc:2749] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:43.212783  2022 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:43.300309  1870 consensus_meta.cc:287] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 1.693s	user 0.020s	sys 0.000s
W20260709 13:09:43.316382 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 79315.4us
I20260709 13:09:43.234849  2044 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:43.314833  2013 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:43.327560  2041 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:43.328320  1886 leader_election.cc:290] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:43.235018  1577 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:43.257320  1973 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:43.338231  2031 raft_consensus.cc:2749] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:43.339196  2120 raft_consensus.cc:2804] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:43.308585  1930 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:43.308997  2034 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:43.308357  1704 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:43.345275 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:43.345772 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:43.346321 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:43.346877 30469 raft_consensus.cc:2468] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 9.
I20260709 13:09:43.346953 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:43.348137 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:43.300607  1736 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:43.253618  2091 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:43.354099 31115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:43.397716 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 76574.5us
I20260709 13:09:43.403941 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:43.316493  1499 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:43.402489 30468 raft_consensus.cc:1240] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:09:43.329651  2056 consensus_queue.cc:1059] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.096s
I20260709 13:09:43.385356  2017 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.422979 31146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48414 (request call id 935) took 2229 ms. Trace:
I20260709 13:09:43.348589  2013 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:43.405014 30476 raft_consensus.cc:1217] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 12 LEADER]: Deduplicated request from leader. Original: 9.5->[11.6-11.6]   Dedup: 11.6->[]
I20260709 13:09:43.324743  1870 raft_consensus.cc:515] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:43.441942  2086 log.cc:927] Time spent T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.355s	user 0.001s	sys 0.000s
W20260709 13:09:43.442272  2095 log.cc:927] Time spent T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 13:09:43.442905  2106 raft_consensus.cc:493] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:43.443353  2118 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.389219  2120 raft_consensus.cc:697] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 11 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:43.386835  2034 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:43.385568  1704 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:43.444156 31146 rpcz_store.cc:276] 0709 13:09:41.188178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.188318 (+   140us) service_pool.cc:224] Handling call
0709 13:09:41.188580 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:42.208337 (+1019757us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:43.409126 (+1200789us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54006eee54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:43.409304 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2343629568}
I20260709 13:09:43.736795 30623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47446 (request call id 2420) took 1561 ms. Trace:
I20260709 13:09:43.744910 30623 rpcz_store.cc:276] 0709 13:09:42.175794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.187225 (+ 11431us) service_pool.cc:224] Handling call
0709 13:09:42.204382 (+ 17157us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:42.204775 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:42.204808 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:42.205271 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 13:09:42.381228 (+175957us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:42.381269 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.381332 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:43.736510 (+1355178us) raft_consensus.cc:1685] finished
0709 13:09:43.736535 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:43.736721 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2826,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"thread_start_us":175628,"threads_started":1,"wal-append.queue_time_us":367892}
I20260709 13:09:43.748026 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:43.749408 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:43.324756  2007 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.752453 30476 raft_consensus.cc:1240] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 12 LEADER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 11. Current term is 12. Ops: [11.6-11.6]
W20260709 13:09:43.412747 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 189785us
I20260709 13:09:43.770169 30591 leader_election.cc:400] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 election: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 10. Current term is 11.
I20260709 13:09:43.801375 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:09:43.735739  2102 log.cc:927] Time spent T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.345s	user 0.000s	sys 0.000s
W20260709 13:09:43.679920  2100 log.cc:927] Time spent T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.445s	user 0.000s	sys 0.001s
W20260709 13:09:43.680032  2114 log.cc:927] Time spent T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.387s	user 0.001s	sys 0.000s
W20260709 13:09:43.809330 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 63959.4us
I20260709 13:09:43.846881 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:43.847448 31147 raft_consensus.cc:1275] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:09:43.813195 30467 raft_consensus.cc:2368] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 5. Current term is 6.
I20260709 13:09:43.692209  2130 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.722247  1973 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:43.782899 30591 leader_election.cc:304] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:43.864178 30618 raft_consensus.cc:1275] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:43.572696  2087 leader_election.cc:290] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:43.594154  2011 leader_election.cc:290] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:43.323972  2098 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:43.571864  2060 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:43.782785  2009 raft_consensus.cc:3055] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:43.349166  1981 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:43.631549  2096 log.cc:927] Time spent T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.395s	user 0.001s	sys 0.000s
W20260709 13:09:43.852923  1671 consensus_meta.cc:287] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.858s	user 0.007s	sys 0.003s
I20260709 13:09:43.726148  1577 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:43.904554 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:43.895012  2088 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:43.919008  2134 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:43.852089  2131 log.cc:927] Time spent T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
W20260709 13:09:43.853224  1925 consensus_meta.cc:287] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 1.707s	user 0.006s	sys 0.007s
W20260709 13:09:43.850955  2105 log.cc:927] Time spent T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.262s	user 0.000s	sys 0.000s
I20260709 13:09:43.913103  2009 raft_consensus.cc:740] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
W20260709 13:09:43.852916  2110 log.cc:927] Time spent T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
I20260709 13:09:43.453200  2017 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:43.772758  2091 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:43.852356  1499 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:43.772785  2022 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:43.771281  1975 raft_consensus.cc:493] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.767315  1655 consensus_queue.cc:1048] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.137s
I20260709 13:09:43.989627  1975 raft_consensus.cc:515] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:43.808441  2042 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:43.992192  2080 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.992677  2080 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:43.993889  2099 log.cc:927] Time spent T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.701s	user 0.000s	sys 0.009s
I20260709 13:09:43.811939  2117 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:43.344668  2035 consensus_queue.cc:237] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:43.941294  1980 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.845554  1736 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:43.850795  2125 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:09:43.927186 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 144461us
I20260709 13:09:43.905200  1758 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:43.767603  2054 consensus_meta.cc:287] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 1.265s	user 0.015s	sys 0.000s
I20260709 13:09:43.796146  1991 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:43.812080  2013 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:43.933677 30474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 2353) took 1748 ms. Trace:
I20260709 13:09:43.932178 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:43.945015 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:09:43.851531  2124 log.cc:927] Time spent T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260709 13:09:43.809432  2034 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:43.812700  2118 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:43.929461  2023 raft_consensus.cc:2749] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:43.930140  2135 raft_consensus.cc:493] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:43.938462  2119 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.932456  2060 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:43.932094  2108 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:43.932044  2127 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.995491 30617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36130 (request call id 2010) took 1170 ms. Trace:
I20260709 13:09:43.889243  2015 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:44.040162 30617 rpcz_store.cc:276] 0709 13:09:42.824903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.825036 (+   133us) service_pool.cc:224] Handling call
0709 13:09:42.825346 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:42.825716 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:42.825743 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:42.829251 (+  3508us) log.cc:844] Serialized 26 byte log entry
0709 13:09:43.162621 (+333370us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:43.162705 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:43.162879 (+   174us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:43.995228 (+832349us) raft_consensus.cc:1685] finished
0709 13:09:43.995253 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:43.995417 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":568,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":42660,"thread_start_us":249554,"threads_started":1,"wal-append.queue_time_us":532945}
I20260709 13:09:43.995775 30470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 896) took 1421 ms. Trace:
I20260709 13:09:43.996869 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:43.932216  2070 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:43.937896  2089 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:43.994799  2080 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:43.998086  2140 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:43.997856  2117 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:44.046176 30470 rpcz_store.cc:276] 0709 13:09:42.574250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.574398 (+   148us) service_pool.cc:224] Handling call
0709 13:09:42.574717 (+   319us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:42.586533 (+ 11816us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:42.586561 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:42.627978 (+ 41417us) log.cc:844] Serialized 52 byte log entry
0709 13:09:42.828437 (+200459us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:43.037735 (+209298us) log.cc:844] Serialized 14 byte log entry
0709 13:09:43.212166 (+174431us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:43.212254 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:43.995536 (+783282us) raft_consensus.cc:1685] finished
0709 13:09:43.995555 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:43.995716 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":131851,"prepare.queue_time_us":132011,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":187853,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":51776,"thread_start_us":321431,"threads_started":3,"wal-append.queue_time_us":677735}
I20260709 13:09:43.794224  1829 consensus_queue.cc:260] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:44.048173  1829 raft_consensus.cc:3060] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:43.989636  1655 consensus_queue.cc:1243] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer 092f6eb694fc4bbeab49677cccd880fd log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:09:44.055850  2015 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:43.998803  2129 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:43.999003 31145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48412 (request call id 760) took 1115 ms. Trace:
I20260709 13:09:43.999037  1870 leader_election.cc:290] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:44.002732 30591 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
W20260709 13:09:44.062951 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 60304us
I20260709 13:09:43.967628  2011 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.974251  2044 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:44.004659  1975 leader_election.cc:290] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:44.007459  2136 consensus_queue.cc:1048] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:09:43.768831  2106 raft_consensus.cc:515] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:43.945088  2134 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:44.009514  2017 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:43.988025  2138 log.cc:927] Time spent T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:09:44.039831  2119 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:43.929491  1671 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:43.973501  1925 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.916134  2130 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:44.013229  2098 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:44.023067 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:44.018844 30474 rpcz_store.cc:276] 0709 13:09:42.185519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.185633 (+   114us) service_pool.cc:224] Handling call
0709 13:09:42.205936 (+ 20303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:42.232943 (+ 27007us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:42.232971 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:42.233402 (+   431us) log.cc:844] Serialized 26 byte log entry
0709 13:09:42.934594 (+701192us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:42.934632 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.934700 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:43.933455 (+998755us) raft_consensus.cc:1685] finished
0709 13:09:43.933478 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:43.933614 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26628,"raft.queue_time_us":115613,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":12028,"thread_start_us":596398,"threads_started":1,"wal-append.queue_time_us":764689}
I20260709 13:09:43.949108  2088 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:44.030390  2065 consensus_meta.cc:287] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.794s	user 0.010s	sys 0.000s
I20260709 13:09:43.808663  2007 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:44.030987  2034 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:44.001358  1499 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:44.048689  1957 raft_consensus.cc:3055] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:44.054746  2127 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:44.055524 31114 leader_election.cc:336] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Timed out: RequestConsensusVote RPC to 127.28.173.2:34733 timed out after 1.790s (SENT)
I20260709 13:09:44.015381  1980 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:44.018352  1758 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:44.011897  2042 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:44.047225  2140 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:43.948041  2120 consensus_queue.cc:237] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:44.033419  2125 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:44.045820  2135 raft_consensus.cc:515] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:44.033792  2009 consensus_queue.cc:260] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:44.141580 31144 raft_consensus.cc:1275] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:09:44.819851 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:44.613145 30616 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.008s	sys 0.007s
I20260709 13:09:44.367569 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:44.165755 30547 raft_consensus.cc:1275] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:09:44.166823 30546 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35278 (request call id 813) took 2816 ms (client timeout 1790 ms). Trace:
I20260709 13:09:44.111972 30619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36130 (request call id 2012) took 1134 ms. Trace:
I20260709 13:09:44.060266 31145 rpcz_store.cc:276] 0709 13:09:42.883637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.883769 (+   132us) service_pool.cc:224] Handling call
0709 13:09:42.929902 (+ 46133us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:43.325055 (+395153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:43.325089 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:43.330825 (+  5736us) log.cc:844] Serialized 26 byte log entry
0709 13:09:43.363170 (+ 32345us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:43.363209 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:43.991653 (+628444us) spinlock_profiling.cc:243] Waited 386 ms on lock 0x7b5400694454. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:43.991708 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:43.991752 (+    44us) raft_consensus.cc:1685] finished
0709 13:09:43.991766 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:43.998946 (+  7180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9009,"raft.queue_time_us":9218,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":6434,"spinlock_wait_cycles":887091456,"thread_start_us":27682,"threads_started":1,"wal-append.queue_time_us":429778}
I20260709 13:09:44.176061 31142 raft_consensus.cc:1240] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 7. Current term is 8. Ops: []
W20260709 13:09:44.834012 30622 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.008s	sys 0.008s
W20260709 13:09:44.350098 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:44.832279 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 766947us
W20260709 13:09:44.494901 30517 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.015s	sys 0.013s
W20260709 13:09:44.832330 30616 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.920s	user 0.012s	sys 0.008s
W20260709 13:09:44.838335 30517 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.930s	user 0.016s	sys 0.021s
I20260709 13:09:44.168843 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:09:44.835455 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 779878us
W20260709 13:09:44.837688 30622 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.008s	sys 0.008s
W20260709 13:09:44.143913 30467 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50446 (request call id 1910) took 2744 ms (client timeout 2070 ms). Trace:
W20260709 13:09:44.486088 31115 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.008s	sys 0.020s
I20260709 13:09:44.375870 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:44.125656 30617 raft_consensus.cc:1275] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:09:44.847209 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:44.843003 30620 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.010s	sys 0.009s
I20260709 13:09:44.833603 30618 raft_consensus.cc:2468] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 5.
I20260709 13:09:44.849375 30548 raft_consensus.cc:2468] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 12.
W20260709 13:09:44.849767 31115 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.949s	user 0.013s	sys 0.025s
W20260709 13:09:44.849391 30620 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.010s	sys 0.009s
W20260709 13:09:44.852501 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:44.841651 30517 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:44.507843 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:44.851620 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:44.851974 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:44.853893 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:44.854187 30548 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 12.
I20260709 13:09:44.854642 30624 raft_consensus.cc:2468] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 9.
W20260709 13:09:44.256757 30516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:44.118570  2112 log.cc:927] Time spent T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.693s	user 0.000s	sys 0.009s
W20260709 13:09:44.849695 30467 rpcz_store.cc:269] 0709 13:09:41.399465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.431366 (+ 31901us) service_pool.cc:224] Handling call
0709 13:09:44.143630 (+2712264us) spinlock_profiling.cc:243] Waited 2.33 s on lock 0x7b54003c32d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:44.143787 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5352158976}
W20260709 13:09:44.833945 30546 rpcz_store.cc:269] 0709 13:09:41.350873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.373109 (+ 22236us) service_pool.cc:224] Handling call
0709 13:09:44.165090 (+2791981us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54001450d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:44.166687 (+  1597us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3264407296}
W20260709 13:09:44.829778  1991 consensus_meta.cc:287] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.807s	user 0.007s	sys 0.004s
I20260709 13:09:44.407819 30370 catalog_manager.cc:5697] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
W20260709 13:09:44.763837  2072 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.765s	user 0.011s	sys 0.006s
I20260709 13:09:44.068564  2023 raft_consensus.cc:2804] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:09:44.834233  2035 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.009s	sys 0.009s
I20260709 13:09:44.865226 30621 raft_consensus.cc:1275] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:09:44.865401 30625 raft_consensus.cc:2393] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 8: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:44.138890  2094 raft_consensus.cc:3055] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:44.869444 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:09:44.850283 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 949663us
I20260709 13:09:44.058130  2060 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:44.765647  2057 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.006s	sys 0.019s
W20260709 13:09:44.124692  2064 log.cc:927] Time spent T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 1.744s	user 0.005s	sys 0.008s
I20260709 13:09:44.861614 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:44.863993 30517 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:44.865816 30551 raft_consensus.cc:2468] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 11.
I20260709 13:09:44.861707 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:44.066840  1704 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:44.866441 30621 raft_consensus.cc:1240] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 11. Current term is 12. Ops: []
W20260709 13:09:44.151281  2115 log.cc:927] Time spent T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.475s	user 0.001s	sys 0.001s
I20260709 13:09:44.936784 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:44.851286  2017 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.855504 30619 rpcz_store.cc:276] 0709 13:09:42.977274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.978588 (+  1314us) service_pool.cc:224] Handling call
0709 13:09:43.021549 (+ 42961us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:43.075068 (+ 53519us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:43.075154 (+    86us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:43.099457 (+ 24303us) log.cc:844] Serialized 26 byte log entry
0709 13:09:43.270152 (+170695us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:43.270208 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:43.270286 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:44.111748 (+841462us) raft_consensus.cc:1685] finished
0709 13:09:44.111769 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:44.111911 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52876,"raft.queue_time_us":150819,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":98,"thread_start_us":48209,"threads_started":1,"wal-append.queue_time_us":215935}
I20260709 13:09:44.349840  2107 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.763551  1886 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.430536  2016 raft_consensus.cc:493] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:44.128746  2081 raft_consensus.cc:3055] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:44.143219  1955 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.104930  2106 leader_election.cc:290] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:44.121580  2013 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:44.110307  1870 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:44.113590  2118 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:44.848264  1890 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:44.839284  2022 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:44.859277  1499 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:44.360388  2062 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.846762  2015 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:44.954922  2134 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:44.839404  1990 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:44.066630  2011 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:44.060586  2089 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:44.175169  1926 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.939713 30542 raft_consensus.cc:2410] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:09:44.939968 31147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48412 (request call id 765) took 1047 ms. Trace:
W20260709 13:09:44.863198  2072 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.016s	sys 0.006s
I20260709 13:09:44.832898  1957 raft_consensus.cc:740] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:44.860849  2051 raft_consensus.cc:493] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.861778  2098 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.865226  2023 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.071205  2108 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:44.953733 30547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 816) took 3586 ms. Trace:
I20260709 13:09:44.953883 30625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57140 (request call id 865) took 1097 ms. Trace:
W20260709 13:09:44.868659  2035 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.009s	sys 0.009s
I20260709 13:09:44.941174 30370 catalog_manager.cc:5697] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 7 to 9, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 9 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:44.071905  2129 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:44.937963  2057 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.907s	user 0.010s	sys 0.024s
I20260709 13:09:44.939071  2009 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:44.852075  1925 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:44.848167  2042 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:44.936357  2117 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:44.872228 31146 raft_consensus.cc:1275] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:09:44.943228  1704 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.869398  2094 raft_consensus.cc:740] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:44.986109 31149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48414 (request call id 951) took 2058 ms. Trace:
I20260709 13:09:45.076836  2072 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.929075 30548 raft_consensus.cc:2468] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
I20260709 13:09:44.997793  2144 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:44.998399  2130 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:44.998821  1499 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:44.999289  2062 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:45.000319  1834 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:45.000840  1991 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.000912  2148 raft_consensus.cc:2749] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:44.971158  1955 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:44.960249  2081 raft_consensus.cc:740] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:45.006572 31147 rpcz_store.cc:276] 0709 13:09:43.892277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.892417 (+   140us) service_pool.cc:224] Handling call
0709 13:09:43.895218 (+  2801us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:44.866010 (+970792us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:44.866037 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:44.866073 (+    36us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:44.866099 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:44.939739 (+ 73640us) spinlock_profiling.cc:243] Waited 970 ms on lock 0x7b5400532854. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:44.939784 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:44.939916 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2232143744}
I20260709 13:09:44.977736  2106 raft_consensus.cc:2804] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:44.947239  2017 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:44.985661  1890 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:45.021090  2051 raft_consensus.cc:515] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:45.015790  2033 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.072880 31151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48412 (request call id 756) took 2244 ms. Trace:
I20260709 13:09:44.962992  2016 raft_consensus.cc:515] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:44.985028  2034 raft_consensus.cc:493] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.984771  2118 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:45.012492  2060 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:45.163720 30617 raft_consensus.cc:1240] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:45.097723 30370 catalog_manager.cc:5697] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 3 to 4, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 4 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:45.159550 31151 rpcz_store.cc:276] 0709 13:09:42.827985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.828292 (+   307us) service_pool.cc:224] Handling call
0709 13:09:42.828620 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:42.887652 (+ 59032us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:42.887682 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:42.930136 (+ 42454us) log.cc:844] Serialized 26 byte log entry
0709 13:09:43.233219 (+303083us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:43.233269 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:43.233359 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:44.150571 (+917212us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:09:45.025015 (+874444us) raft_consensus.cc:1685] finished
0709 13:09:45.025036 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:45.072810 (+ 47774us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58659,"raft.queue_time_us":85427,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":8087,"spinlock_wait_cycles":4206848,"thread_start_us":256516,"threads_started":1,"wal-append.queue_time_us":673131}
I20260709 13:09:44.977291  1870 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:45.100044 30547 rpcz_store.cc:276] 0709 13:09:41.356096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.356779 (+   683us) service_pool.cc:224] Handling call
0709 13:09:44.165414 (+2808635us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:44.833358 (+667944us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:44.942109 (+108751us) spinlock_profiling.cc:243] Waited 2.77 s on lock 0x7b54001450d0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f678ad 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:44.942276 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6366102656}
I20260709 13:09:45.099504 30625 rpcz_store.cc:276] 0709 13:09:43.846144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.846624 (+   480us) service_pool.cc:224] Handling call
0709 13:09:44.942845 (+1096221us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54002debd4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:44.942980 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2307193216}
I20260709 13:09:45.080361  1655 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.103432  2007 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:45.015951  1926 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:45.105010  2088 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:45.105926  2119 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:44.963598  2107 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:45.149662  1834 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:45.066555  2023 raft_consensus.cc:3060] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:45.073944  2065 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.990336  2022 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:45.136921 31149 rpcz_store.cc:276] 0709 13:09:42.928036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.928169 (+   133us) service_pool.cc:224] Handling call
0709 13:09:42.930119 (+  1950us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:42.930322 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:42.930346 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:42.957523 (+ 27177us) log.cc:844] Serialized 26 byte log entry
0709 13:09:43.163174 (+205651us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:43.163206 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:43.163263 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:44.117921 (+954658us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:09:44.972044 (+854123us) raft_consensus.cc:1685] finished
0709 13:09:44.972064 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:44.986031 (+ 13967us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43145088,"thread_start_us":201666,"threads_started":1,"wal-append.queue_time_us":340991}
I20260709 13:09:45.013327  1990 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:45.136508  2087 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.099187  2098 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:45.145361  1957 consensus_queue.cc:260] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:45.154932 31146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48426 (request call id 808) took 1354 ms. Trace:
I20260709 13:09:45.141880  1704 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:45.138809  2144 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:45.150833  1760 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:45.144889  2072 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:45.150228  1671 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:45.154655  2106 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:45.155722  2140 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:45.171399 30619 raft_consensus.cc:1275] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:09:45.198863 30619 pending_rounds.cc:85] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79: Aborting all ops after (but not including) 8
I20260709 13:09:45.199100 30619 pending_rounds.cc:107] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:09:45.172829 30623 raft_consensus.cc:2468] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 8.
I20260709 13:09:45.199326 30619 raft_consensus.cc:2889] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:45.170691 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:45.200762 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:45.167403  2034 raft_consensus.cc:515] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:44.970481  1886 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:45.149333  1991 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:45.168165  1980 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:45.168663  1925 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:45.195035  2145 log.cc:927] Time spent T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 13:09:45.188740 30624 raft_consensus.cc:1240] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:45.174140  2007 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.175678  2135 leader_election.cc:290] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:45.180866  2125 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:45.167488  2118 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:45.210590 30618 raft_consensus.cc:1275] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:09:45.187299 31146 rpcz_store.cc:276] 0709 13:09:43.800894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.803047 (+  2153us) service_pool.cc:224] Handling call
0709 13:09:43.803366 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:45.135092 (+1331726us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.154719 (+ 19627us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54005749d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:45.154875 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2445780864}
I20260709 13:09:45.172070  1655 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:45.216805 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:45.222692 30624 raft_consensus.cc:3060] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:45.217252 30370 catalog_manager.cc:5697] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 3 to 4, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 4 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:45.209725  2153 log.cc:927] Time spent T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:09:45.168022  2033 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:45.224699 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:45.233217 30625 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 12.
I20260709 13:09:45.203080  1957 raft_consensus.cc:3060] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:45.200802  2106 raft_consensus.cc:3060] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:45.229429 30370 catalog_manager.cc:5697] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:45.191919  2087 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:45.233577 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:09:45.236984 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 398339us
I20260709 13:09:45.237221 30619 raft_consensus.cc:2468] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 8.
W20260709 13:09:45.234848  2155 log.cc:927] Time spent T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:09:45.235507  2118 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:45.237691 30591 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:45.188020  2065 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:45.271176  2163 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.169402  2094 consensus_queue.cc:260] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:45.196202  1760 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:45.279768 30372 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57546 (request call id 306) took 16271 ms (client timeout 15000 ms). Trace:
I20260709 13:09:45.223568  2119 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:45.235858  1870 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:45.283159 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.285045  2164 raft_consensus.cc:2749] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:45.296118 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:45.298629 31143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48412 (request call id 768) took 1194 ms. Trace:
I20260709 13:09:45.304442  1760 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:45.305392  2129 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:45.297989 30623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47446 (request call id 2432) took 1175 ms. Trace:
I20260709 13:09:45.271859 30370 catalog_manager.cc:5697] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 4 to 6, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 6 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:45.306751 31143 rpcz_store.cc:276] 0709 13:09:44.104486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.104660 (+   174us) service_pool.cc:224] Handling call
0709 13:09:44.104981 (+   321us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:44.105444 (+   463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:44.105486 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:44.106226 (+   740us) log.cc:844] Serialized 52 byte log entry
0709 13:09:45.148454 (+1042228us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:45.148491 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.148567 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:45.298431 (+149864us) raft_consensus.cc:1685] finished
0709 13:09:45.298450 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:45.298577 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3991,"raft.queue_time_us":1250,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":9078,"thread_start_us":318175,"threads_started":1,"wal-append.queue_time_us":1093905}
I20260709 13:09:45.321259 30623 rpcz_store.cc:276] 0709 13:09:44.122589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.375537 (+252948us) service_pool.cc:224] Handling call
0709 13:09:45.297814 (+922277us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b540027f454. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:45.297934 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":726669696}
I20260709 13:09:45.322528 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:45.273355  2160 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:45.228025  2007 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:45.376935  2072 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:45.186841  2081 consensus_queue.cc:260] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:45.314507 30622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 864) took 1507 ms. Trace:
I20260709 13:09:45.324880 30624 raft_consensus.cc:2468] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 6.
W20260709 13:09:45.337666 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.280941  1671 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:45.360107  2062 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:45.291860  1834 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:45.299428  2022 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:45.361392  2154 log.cc:927] Time spent T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.206s	user 0.000s	sys 0.002s
I20260709 13:09:45.362607  2108 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:45.363286  2011 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:45.295506  2033 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:45.364773 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:45.366096  2106 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:45.284448  2163 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:45.293866  1926 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:45.293289  1655 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:45.369722  2107 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:45.375617  2016 leader_election.cc:290] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:45.375998  2160 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:45.419266 31116 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.870s	user 0.008s	sys 0.011s
W20260709 13:09:45.379801 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 515840us
W20260709 13:09:45.419986 31116 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.008s	sys 0.011s
W20260709 13:09:45.420255 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 871323us
I20260709 13:09:45.420590 30517 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:45.358952  2164 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.297258  1886 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:45.320617  2156 log.cc:927] Time spent T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.174s	user 0.003s	sys 0.000s
I20260709 13:09:45.377799  2072 raft_consensus.cc:493] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.292219  1890 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:45.280335  2118 consensus_queue.cc:1059] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.104s
W20260709 13:09:45.387153 31115 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.004s	sys 0.013s
W20260709 13:09:45.433383 31115 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.004s	sys 0.013s
W20260709 13:09:45.433763 31115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.434381 31115 leader_election.cc:304] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:45.321185  2042 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:45.388451 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:45.383206 30622 rpcz_store.cc:276] 0709 13:09:43.807042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.807165 (+   123us) service_pool.cc:224] Handling call
0709 13:09:43.858388 (+ 51223us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:43.895410 (+ 37022us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:44.146465 (+251055us) spinlock_profiling.cc:243] Waited 4.49 ms on lock 0x7b1800400f00. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780df5c0a 00007fc78a535219 00007fc780e7da40 00007fc780e784e4 00007fc780e78455 00007fc7879603c7 00007fc783f729a7 00007fc783f820bf 00007fc783f82038
0709 13:09:44.146751 (+   286us) log.cc:844] Serialized 14 byte log entry
0709 13:09:45.266016 (+1119265us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:45.274376 (+  8360us) log.cc:844] Serialized 26 byte log entry
0709 13:09:45.274537 (+   161us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:45.274584 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.274797 (+   213us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:45.302815 (+ 28018us) raft_consensus.cc:1685] finished
0709 13:09:45.314314 (+ 11499us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:45.314450 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39963,"prepare.queue_time_us":252013,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":4511,"raft.queue_time_us":422276,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":29306,"spinlock_wait_cycles":10322304,"thread_start_us":1113796,"threads_started":2,"wal-append.queue_time_us":996643}
I20260709 13:09:45.394613 30616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 866) took 1503 ms. Trace:
I20260709 13:09:45.364148  1955 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:45.378582  2007 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:45.402544 30516 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.017s	sys 0.006s
W20260709 13:09:45.445451 30516 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.017s	sys 0.006s
I20260709 13:09:45.306074  2119 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:45.388450  2089 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:45.407164 31148 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.006s	sys 0.006s
I20260709 13:09:45.378103 30618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454"
dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
mode: GRACEFUL
new_leader_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:49382
W20260709 13:09:45.448894 31148 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.006s	sys 0.006s
I20260709 13:09:45.392477  2017 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:45.389601  1671 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:45.405361  2070 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.846s	user 0.000s	sys 0.013s
I20260709 13:09:45.321353  2094 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:45.408259  2033 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:45.451231  1655 raft_consensus.cc:2749] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:45.455551 30551 raft_consensus.cc:1275] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:09:45.455302  2033 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:45.407258  2088 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:09:45.428228 31113 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.903s	user 0.018s	sys 0.022s
W20260709 13:09:45.461535 31113 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.936s	user 0.018s	sys 0.023s
I20260709 13:09:45.430436 30470 raft_consensus.cc:1275] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:09:45.280709 30372 rpcz_store.cc:269] 0709 13:09:29.001972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.008047 (+  6075us) service_pool.cc:224] Handling call
0709 13:09:45.240070 (+16232023us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:38.617105 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:38.625461 (+  8356us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:38.625498 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:09:38.625518 (+    20us) tablet.cc:662] Decoding operations
0709 13:09:38.824651 (+199133us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:38.824772 (+   121us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:38.824822 (+    50us) tablet.cc:685] Acquiring locks for 28 operations
0709 13:09:38.924037 (+ 99215us) tablet.cc:701] Row locks acquired
0709 13:09:38.924093 (+    56us) write_op.cc:260] PREPARE: finished
0709 13:09:38.924355 (+   262us) write_op.cc:270] Start()
0709 13:09:38.924508 (+   153us) write_op.cc:276] Timestamp: P: 1783602578924276 usec, L: 0
0709 13:09:38.924550 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 13:09:38.928630 (+  4080us) log.cc:844] Serialized 11231 byte log entry
0709 13:09:39.477763 (+549133us) op_driver.cc:464] REPLICATION: finished
0709 13:09:39.749170 (+271407us) write_op.cc:301] APPLY: starting
0709 13:09:39.749286 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:39.749852 (+   566us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:39.749999 (+   147us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:39.753341 (+  3342us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:39.753901 (+   560us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=28
0709 13:09:39.753947 (+    46us) write_op.cc:312] APPLY: finished
0709 13:09:39.754445 (+   498us) log.cc:844] Serialized 188 byte log entry
0709 13:09:39.755281 (+   836us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:39.755521 (+   240us) write_op.cc:454] Released schema lock
0709 13:09:39.755604 (+    83us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:39.756105 (+   501us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:39.756133 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":734299,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":271057,"apply.run_cpu_time_us":5930,"apply.run_wall_time_us":6929,"num_ops":28,"prepare.queue_time_us":823522,"prepare.run_cpu_time_us":42232,"prepare.run_wall_time_us":478157,"raft.queue_time_us":317621,"raft.run_cpu_time_us":51941,"raft.run_wall_time_us":171771,"replication_time_us":553067,"spinlock_wait_cycles":1792,"thread_start_us":1329960,"threads_started":4,"wal-append.queue_time_us":163161,"wal-append.run_cpu_time_us":24662,"wal-append.run_wall_time_us":1667294}]]}
I20260709 13:09:45.441787 30616 rpcz_store.cc:276] 0709 13:09:43.890911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.891051 (+   140us) service_pool.cc:224] Handling call
0709 13:09:43.891428 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:43.891681 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:43.912505 (+ 20824us) log.cc:844] Serialized 14 byte log entry
0709 13:09:45.394095 (+1481590us) spinlock_profiling.cc:243] Waited 2.94 ms on lock 0x7b18003bc6e0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc783b104bc 00007fc780e5e48b 00007fc789cb8ab9 00007fc780e7a69b 00007fc780e7893f 00007fc780e78455 00007fc783f60060 00007fc783f72716 00007fc783f83287
0709 13:09:45.394214 (+   119us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:45.394275 (+    61us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:45.394329 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.394411 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:45.394548 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16667,"prepare.queue_time_us":255475,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":370404,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":9354,"spinlock_wait_cycles":6763264,"thread_start_us":1294495,"threads_started":2,"wal-append.queue_time_us":1089820}
I20260709 13:09:45.435070 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:45.436537 30548 raft_consensus.cc:1275] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:09:45.437011 31116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.441831 30619 raft_consensus.cc:2468] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9.
I20260709 13:09:45.442319 30546 raft_consensus.cc:1240] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 10 LEADER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:45.430848  2098 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:45.417039 30360 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 2b207fb799ce4340b29ae053898e0e6c with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica fe2b7d73f8c743c1ba570cfd981c4e79 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
W20260709 13:09:45.473212 30360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 84985.5us
I20260709 13:09:45.446431 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:09:45.451149  2070 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.903s	user 0.000s	sys 0.014s
I20260709 13:09:45.448081 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:45.449153 30618 raft_consensus.cc:606] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Received request to transfer leadership to TS 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:45.481293 30618 raft_consensus.cc:614] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:45.449091 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:45.424026  2107 raft_consensus.cc:2749] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:45.424399  2034 leader_election.cc:290] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:45.423031  1990 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:45.451928 30544 raft_consensus.cc:1240] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:09:45.457857 30550 raft_consensus.cc:1240] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 13 LEADER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:45.460445 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:45.460566 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:45.431620  2144 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:45.432994  1758 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:45.469895 30547 raft_consensus.cc:1240] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:45.470845  2106 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:45.472555 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.472460  2160 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:45.475210 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:45.447376  2163 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:45.436929  1991 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:45.607486 30516 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:09:45.623363 30516 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:45.628405 30618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3"
dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
mode: GRACEFUL
new_leader_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:49382
I20260709 13:09:45.630610 30618 raft_consensus.cc:606] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 LEADER]: Received request to transfer leadership to TS 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:45.530388 30549 pending_rounds.cc:85] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd: Aborting all ops after (but not including) 8
I20260709 13:09:45.530685 30471 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 10.
I20260709 13:09:45.642835 30549 pending_rounds.cc:107] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:09:45.530637 30545 raft_consensus.cc:2468] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 10.
I20260709 13:09:45.537361  1671 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:45.436569  2072 raft_consensus.cc:515] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:45.429381  2164 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:45.485462  2065 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:45.544934  2033 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:45.480083  2171 consensus_queue.cc:1048] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:09:45.552318  2087 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:45.475769  2088 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:45.685618 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 54034.7us
I20260709 13:09:45.647223  2163 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:45.691486 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:45.693053 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:45.645974 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:45.626765  2144 raft_consensus.cc:2749] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:45.631002  2106 raft_consensus.cc:2804] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:45.725764  2163 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:45.726347  2106 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:45.726917  2106 raft_consensus.cc:3060] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:45.728678  2163 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:45.645545 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:45.729434 30620 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.874s	user 0.002s	sys 0.009s
I20260709 13:09:45.628240  2107 consensus_queue.cc:1048] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:09:45.729782 30548 raft_consensus.cc:2393] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 10: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
W20260709 13:09:45.729769 30620 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.874s	user 0.002s	sys 0.009s
I20260709 13:09:45.693461  2022 raft_consensus.cc:3055] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:09:45.695107  2173 log.cc:927] Time spent T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.151s	user 0.004s	sys 0.001s
I20260709 13:09:45.643168 30549 raft_consensus.cc:2889] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:45.701515  2164 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:45.705416  2127 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:45.645485 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:45.746785 30544 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 11.
I20260709 13:09:45.747721 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:45.713529  2081 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:45.715598 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 265801us
I20260709 13:09:45.764572 31115 leader_election.cc:304] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:09:45.765892 31115 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:45.716303  2168 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:45.717852  2072 leader_election.cc:290] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:45.718134 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:45.718456 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:45.718817 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:45.719452 31151 raft_consensus.cc:1275] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:09:45.794780 30544 raft_consensus.cc:2393] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 12: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:45.719715  2172 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:45.720012  1704 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:45.720273  2119 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:45.720172 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:45.720860  2051 leader_election.cc:290] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:45.721877 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:45.849406 30551 raft_consensus.cc:1275] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:09:45.722455  2088 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:45.722564 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:45.723258 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:45.849409 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:45.838912 30550 raft_consensus.cc:1275] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:09:45.840794 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 73058.9us
I20260709 13:09:45.844666 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:45.855288 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:09:45.732924  2009 consensus_meta.cc:287] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.595s	user 0.009s	sys 0.002s
I20260709 13:09:45.856812  2070 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:45.857605 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:45.859242  2070 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:45.862032  2070 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:45.858178 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:45.857748 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:45.864749 30623 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 11.
I20260709 13:09:45.857352 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:45.870643 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:45.872367 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:45.873806 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:45.874536 30618 raft_consensus.cc:2468] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 8.
I20260709 13:09:45.876228 31115 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:45.877081 30475 raft_consensus.cc:2468] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 10.
I20260709 13:09:45.877351  1991 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:45.877837  1991 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:45.881853  1991 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:45.882504  2170 raft_consensus.cc:2749] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:45.885996 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:45.886812 30618 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 11.
I20260709 13:09:45.888686 31115 leader_election.cc:304] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:45.889652  2070 raft_consensus.cc:2804] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:45.890169  2070 raft_consensus.cc:493] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.890621  2070 raft_consensus.cc:3060] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:45.764146  2087 consensus_queue.cc:1048] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.132s
I20260709 13:09:45.896113 30620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 862) took 2098 ms. Trace:
I20260709 13:09:45.896293 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:45.896952 31144 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 11.
I20260709 13:09:45.897866 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:45.734866  2022 raft_consensus.cc:740] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:45.899447 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:45.896512 30620 rpcz_store.cc:276] 0709 13:09:43.748773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.749452 (+   679us) service_pool.cc:224] Handling call
0709 13:09:43.811656 (+ 62204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:44.049269 (+237613us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:09:44.147954 (+ 98685us) log.cc:844] Serialized 14 byte log entry
0709 13:09:45.299483 (+1151529us) spinlock_profiling.cc:243] Waited 25.9 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:09:45.730753 (+431270us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:45.730805 (+    52us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:45.730862 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.847042 (+116180us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b5400203354. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:45.847110 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:45.847261 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":100688,"prepare.queue_time_us":99120,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":379038,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":32078,"spinlock_wait_cycles":605594880,"thread_start_us":1580058,"threads_started":2,"wal-append.queue_time_us":959087}
I20260709 13:09:45.909785 31143 raft_consensus.cc:2410] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:09:45.909595 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:45.910422 30619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5"
dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
mode: GRACEFUL
new_leader_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:49382
I20260709 13:09:45.911103 30619 raft_consensus.cc:606] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Received request to transfer leadership to TS 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:45.911520 30619 raft_consensus.cc:614] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:09:45.913141 30440 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.054s	user 0.005s	sys 0.018s
W20260709 13:09:45.913817 30440 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.055s	user 0.005s	sys 0.018s
I20260709 13:09:45.915236 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:45.915868 31151 raft_consensus.cc:2468] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 7.
I20260709 13:09:45.916046 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:45.916800 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:45.917798 31151 raft_consensus.cc:2410] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:09:45.839952  1655 raft_consensus.cc:2804] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:09:45.920132 30441 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.000s	sys 0.022s
W20260709 13:09:45.920714 30441 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.000s	sys 0.022s
I20260709 13:09:45.920591 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:09:45.921002 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 704953us
I20260709 13:09:45.922412 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:45.840111  2165 raft_consensus.cc:2749] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:45.924496 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:45.928819 30618 raft_consensus.cc:2410] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:09:45.929716 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:09:45.929951 30589 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.000s	sys 0.023s
W20260709 13:09:45.930509 30589 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.000s	sys 0.024s
W20260709 13:09:45.930879 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 648204us
I20260709 13:09:45.938597 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:45.939545 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:45.941864 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:45.924811 31115 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:45.928167 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:45.948040 31145 raft_consensus.cc:2410] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
W20260709 13:09:45.973711 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.981336 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:45.982903 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:45.982203 31150 raft_consensus.cc:2468] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
I20260709 13:09:46.005364 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:46.009771 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:46.016414 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:46.017329 30621 raft_consensus.cc:2410] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 13:09:46.018851 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 66623.8us
I20260709 13:09:46.019073 31142 raft_consensus.cc:2393] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 8: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:46.020128 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:46.024560 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:46.025017 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:46.025445 30620 raft_consensus.cc:2393] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 11: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:46.026018 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:46.026863 30475 raft_consensus.cc:2410] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 15 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 13:09:45.923334  2120 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.007s	sys 0.015s
W20260709 13:09:46.032487 30441 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:46.034039 30625 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.011s	sys 0.018s
W20260709 13:09:46.034456 30625 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.012s	sys 0.018s
W20260709 13:09:45.923197  2158 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.003s	sys 0.020s
I20260709 13:09:46.064148 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:46.064953 30621 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 10.
I20260709 13:09:46.038439 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:09:46.072607 30617 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.014s	sys 0.037s
I20260709 13:09:45.928498  1655 raft_consensus.cc:493] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
W20260709 13:09:46.073163 30617 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.014s	sys 0.037s
I20260709 13:09:46.074805 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:09:46.034898 30591 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.765s	user 0.012s	sys 0.017s
I20260709 13:09:46.077487 30471 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 13.
W20260709 13:09:46.077565 30591 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.013s	sys 0.018s
W20260709 13:09:46.078241 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 808169us
I20260709 13:09:46.074180 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:09:46.038584 30542 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.031s	sys 0.016s
W20260709 13:09:46.080941 30542 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.031s	sys 0.019s
I20260709 13:09:46.005409  2065 raft_consensus.cc:2804] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:09:45.917799 30440 connection.cc:256] RPC call timeout handler was delayed by -1.041135426999972s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1587s for a response
I20260709 13:09:46.083709 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:09:46.084970 30440 connection.cc:256] RPC call timeout handler was delayed by -1.0357354269999632s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1593s for a response
I20260709 13:09:46.083798 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:46.088131 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:09:46.090555 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 157609us
W20260709 13:09:46.035135  2120 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.007s	sys 0.016s
W20260709 13:09:46.037670  2117 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.023s	sys 0.025s
W20260709 13:09:46.032091  1957 consensus_meta.cc:287] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.783s	user 0.005s	sys 0.008s
I20260709 13:09:46.024474  1926 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:09:46.071457  2158 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.003s	sys 0.022s
I20260709 13:09:46.096877 31116 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:46.106338 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:46.115451 30620 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 12.
I20260709 13:09:46.031944  2098 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.038401  2163 raft_consensus.cc:493] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:46.119028 31116 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:46.117496 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:46.120422 30544 raft_consensus.cc:3060] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:46.096487  1655 raft_consensus.cc:3060] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:46.107565  2117 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.023s	sys 0.025s
I20260709 13:09:46.145793 31116 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:46.147353  2170 raft_consensus.cc:2749] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:46.149358  2170 raft_consensus.cc:2804] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:46.149824  2170 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.083298  2065 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:46.088620  1758 consensus_queue.cc:1059] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:09:46.156659 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:46.088881  2094 consensus_queue.cc:1048] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
W20260709 13:09:46.158812 30370 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.021s	sys 0.023s
W20260709 13:09:46.162518 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 410453us
W20260709 13:09:46.210201 30370 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.848s	user 0.024s	sys 0.024s
I20260709 13:09:46.159153 30550 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 12.
I20260709 13:09:46.106417  2087 consensus_queue.cc:1048] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:09:46.150238  2170 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:46.121836  1926 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:46.127466  2163 raft_consensus.cc:515] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:46.201604 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:46.224431 31145 raft_consensus.cc:2393] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 9: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:46.199970 31116 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:46.225484 31116 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:46.157735  2065 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:46.127777  1991 raft_consensus.cc:2749] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:09:46.211135 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.212437 31148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48412 (request call id 761) took 2405 ms. Trace:
I20260709 13:09:46.235743 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:46.105957  2176 consensus_queue.cc:1048] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.075s
W20260709 13:09:46.237346 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 446870us
I20260709 13:09:46.236121 31148 rpcz_store.cc:276] 0709 13:09:43.807243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.807692 (+   449us) service_pool.cc:224] Handling call
0709 13:09:43.808169 (+   477us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:43.808418 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:44.070532 (+262114us) log.cc:844] Serialized 14 byte log entry
0709 13:09:45.694605 (+1624073us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:09:45.715320 (+ 20715us) spinlock_profiling.cc:243] Waited 1.79 ms on lock 0x7b1800466120. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780df5c0a 00007fc78a535219 00007fc780e7da40 00007fc780e784e4 00007fc780e78455 00007fc783f60060 00007fc783f72716 00007fc783f83287 00007fc783f83208
0709 13:09:46.211959 (+496639us) log.cc:844] Serialized 14 byte log entry
0709 13:09:46.212139 (+   180us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:46.212179 (+    40us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:46.212227 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.212287 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:46.212388 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23759,"prepare.queue_time_us":1057006,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":8403,"raft.queue_time_us":266885,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":6907,"spinlock_wait_cycles":34103552,"thread_start_us":1324098,"threads_started":3,"wal-append.queue_time_us":1396787}
W20260709 13:09:46.242309 30516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.845310  2172 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:46.255327 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:45.839700  2168 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:46.216652  2057 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:46.260895 30550 raft_consensus.cc:2410] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:09:46.124917  2098 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:46.243325  2171 raft_consensus.cc:2749] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:46.243803  2165 raft_consensus.cc:2804] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:46.269908 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:46.286330 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:46.307252 30551 raft_consensus.cc:2468] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 8.
I20260709 13:09:46.306890 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:46.251050  2177 raft_consensus.cc:3055] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:46.311236 31151 raft_consensus.cc:2468] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 6.
I20260709 13:09:46.310258 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:09:46.269096  2188 log.cc:927] Time spent T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.261s	user 0.000s	sys 0.001s
I20260709 13:09:46.323295 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:46.323968 30545 raft_consensus.cc:2468] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 8.
I20260709 13:09:46.322314 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:46.326525 30550 raft_consensus.cc:2468] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9.
I20260709 13:09:46.269249  2057 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:46.339649  2189 log.cc:927] Time spent T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 13:09:46.341826  2022 consensus_queue.cc:260] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:46.344790 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:46.346071 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:09:46.362193 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.306969  2165 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.343593  2022 raft_consensus.cc:3060] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:46.258697  1991 consensus_queue.cc:1048] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:09:46.319864  2177 raft_consensus.cc:740] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:46.393311 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:46.398599 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:09:46.404131  2190 log.cc:927] Time spent T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.194s	user 0.002s	sys 0.000s
I20260709 13:09:46.405251  2172 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:46.407292  2070 consensus_meta.cc:287] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.516s	user 0.010s	sys 0.000s
I20260709 13:09:46.420320 30544 raft_consensus.cc:2468] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 6.
I20260709 13:09:46.453935  2177 consensus_queue.cc:260] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:46.456611  2177 raft_consensus.cc:3060] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:46.290596 30516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.410238  2065 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:46.466626  2065 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:46.469086  2168 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:46.473047 30516 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:46.473376  2098 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:46.474535 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:46.474819 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:46.475555 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:46.475608 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:46.503342 30544 raft_consensus.cc:2393] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 11: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:46.476419 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:46.504489 30551 raft_consensus.cc:2468] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 8.
I20260709 13:09:46.394212  2165 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:46.503779 30545 raft_consensus.cc:2468] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 10.
W20260709 13:09:46.523097 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 50145us
I20260709 13:09:46.524471 30546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 827) took 1065 ms. Trace:
I20260709 13:09:46.524966 30546 rpcz_store.cc:276] 0709 13:09:45.459148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.468013 (+  8865us) service_pool.cc:224] Handling call
0709 13:09:45.468262 (+   249us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:45.548631 (+ 80369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:45.548678 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:45.600068 (+ 51390us) log.cc:844] Serialized 26 byte log entry
0709 13:09:45.920339 (+320271us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:46.276697 (+356358us) log.cc:844] Serialized 14 byte log entry
0709 13:09:46.284279 (+  7582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.284384 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:46.403555 (+119171us) spinlock_profiling.cc:243] Waited 2.89 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:09:46.494231 (+ 90676us) raft_consensus.cc:1685] finished
0709 13:09:46.524232 (+ 30001us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:46.524408 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67549,"prepare.queue_time_us":426807,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":74221,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":26266,"spinlock_wait_cycles":6656384,"thread_start_us":543065,"threads_started":2,"wal-append.queue_time_us":503180}
W20260709 13:09:46.479476  2106 consensus_meta.cc:287] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.752s	user 0.008s	sys 0.003s
I20260709 13:09:46.537709 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:46.538666 30544 raft_consensus.cc:2468] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 13.
I20260709 13:09:46.534197 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:46.540202 30546 raft_consensus.cc:2410] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 13:09:46.544849 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 457433us
I20260709 13:09:46.548375 30516 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:46.566087 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:46.566927 30551 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 10.
I20260709 13:09:46.531973  2107 raft_consensus.cc:2804] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:46.572392 30617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36130 (request call id 2019) took 1396 ms. Trace:
I20260709 13:09:46.454691  2070 raft_consensus.cc:515] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:46.572938 30617 rpcz_store.cc:276] 0709 13:09:45.175522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.175666 (+   144us) service_pool.cc:224] Handling call
0709 13:09:45.176014 (+   348us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:45.219063 (+ 43049us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:45.219092 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:45.225909 (+  6817us) log.cc:844] Serialized 52 byte log entry
0709 13:09:45.391413 (+165504us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:46.094518 (+703105us) log.cc:844] Serialized 14 byte log entry
0709 13:09:46.122501 (+ 27983us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.555375 (+432874us) spinlock_profiling.cc:243] Waited 35 ms on lock 0x7b54002de6d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:46.555442 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:46.555506 (+    64us) raft_consensus.cc:1685] finished
0709 13:09:46.572125 (+ 16619us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:46.572324 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33643,"prepare.queue_time_us":308474,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":131093,"raft.run_cpu_time_us":4404,"raft.run_wall_time_us":41830,"spinlock_wait_cycles":80578816,"thread_start_us":740517,"threads_started":2,"wal-append.queue_time_us":167205}
I20260709 13:09:46.551026 30441 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:46.612092 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 522993us
I20260709 13:09:46.571673  1957 raft_consensus.cc:2804] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:46.621304 31143 raft_consensus.cc:2393] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 9: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
W20260709 13:09:46.621884 31115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.572299  2107 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
W20260709 13:09:46.620074 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 503009us
I20260709 13:09:46.545497  2106 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:46.622395 31115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:46.608131  2190 log.cc:927] Time spent T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:09:46.624291 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 388525us
I20260709 13:09:46.666558 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:09:46.662796 30516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.631708 30589 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
W20260709 13:09:46.676894 30590 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.016s	sys 0.016s
W20260709 13:09:46.677505 30590 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.016s	sys 0.016s
I20260709 13:09:46.678594 30617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42"
dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
mode: GRACEFUL
new_leader_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:49382
W20260709 13:09:46.679241 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 49091.5us
I20260709 13:09:46.679401 30617 raft_consensus.cc:606] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 LEADER]: Received request to transfer leadership to TS 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:46.627859  2107 raft_consensus.cc:3060] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:46.680814 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:46.622466  1926 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:46.620134  1957 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
W20260709 13:09:46.685678 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 54053.4us
I20260709 13:09:46.670732 30516 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
W20260709 13:09:46.694170 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.696853 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:46.707418 30620 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:46.697829 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:46.708918 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:46.709762 31151 raft_consensus.cc:2410] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:09:46.663641  2163 leader_election.cc:290] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:46.709733 31150 raft_consensus.cc:2468] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:09:46.706025 30589 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:46.670313  2176 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
W20260709 13:09:46.711956 30625 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.014s	sys 0.022s
W20260709 13:09:46.712886 30625 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.014s	sys 0.022s
I20260709 13:09:46.713189 30589 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:46.715134 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:46.664414  2094 consensus_queue.cc:1048] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:09:46.717346 30589 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:46.684330  2182 raft_consensus.cc:2804] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:09:46.716230  2117 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.083s	sys 0.121s
I20260709 13:09:46.747560 30620 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 12.
I20260709 13:09:46.710479  1957 raft_consensus.cc:3060] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:46.747694 31150 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48412 (request call id 773) took 1028 ms. Trace:
I20260709 13:09:46.754184 31150 rpcz_store.cc:276] 0709 13:09:45.719082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.741371 (+1022289us) service_pool.cc:224] Handling call
0709 13:09:46.746919 (+  5548us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.747160 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:46.747206 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:46.747378 (+   172us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:46.747423 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.747497 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:46.747627 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:46.714663  2023 consensus_meta.cc:287] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 1.523s	user 0.011s	sys 0.005s
I20260709 13:09:46.749439 31115 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:46.745079  2117 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.083s	sys 0.121s
I20260709 13:09:46.756088  2201 raft_consensus.cc:2804] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:46.716203 30590 leader_election.cc:304] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:46.757607  2170 consensus_meta.cc:287] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.517s	user 0.009s	sys 0.000s
I20260709 13:09:46.757673  2209 raft_consensus.cc:993] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79: : Instructing follower 092f6eb694fc4bbeab49677cccd880fd to start an election
I20260709 13:09:46.716574  2176 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:46.763954  1671 raft_consensus.cc:2804] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:46.777964 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:46.805512 30550 raft_consensus.cc:2468] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 11.
W20260709 13:09:46.737030  2081 consensus_meta.cc:287] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.923s	user 0.007s	sys 0.004s
I20260709 13:09:46.742571  2182 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:46.793649 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
W20260709 13:09:46.794450 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 78348.3us
I20260709 13:09:46.737566  2162 raft_consensus.cc:2804] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:46.822278 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:46.822876 30550 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 11.
W20260709 13:09:46.740918 31149 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.018s	sys 0.027s
W20260709 13:09:46.823997 31149 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.018s	sys 0.027s
I20260709 13:09:46.793778  2201 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.863634 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:46.803495  2088 raft_consensus.cc:2804] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:09:46.796834  1980 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.002s	sys 0.030s
I20260709 13:09:46.716779  1926 raft_consensus.cc:2804] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:46.787909 31116 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:46.807559 31150 raft_consensus.cc:1240] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:46.818286 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:46.826133 31147 raft_consensus.cc:2468] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 12.
I20260709 13:09:46.828353 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:46.830551 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:46.832748 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:46.833083  2034 raft_consensus.cc:2804] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:09:46.852020 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.804180  2072 raft_consensus.cc:2804] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:46.803409 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:46.866236 31149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48414 (request call id 954) took 1149 ms. Trace:
I20260709 13:09:46.869916 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:46.755141  2098 consensus_queue.cc:1048] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:09:46.813772  1671 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:46.878255 30545 raft_consensus.cc:2410] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:09:46.883852 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:46.884538 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:46.886638 31150 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48414 (request call id 964) took 1162 ms. Trace:
I20260709 13:09:46.887569 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:46.889955 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:46.948789 31150 rpcz_store.cc:276] 0709 13:09:45.723782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.755365 (+1031583us) service_pool.cc:224] Handling call
0709 13:09:46.794323 (+ 38958us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.886315 (+ 91992us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.886571 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:46.949656 30551 raft_consensus.cc:2468] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 12.
I20260709 13:09:46.950560 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:46.803233 30549 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.017s	sys 0.017s
I20260709 13:09:46.820283  2182 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:46.825572  2162 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:09:46.925271 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 57478.9us
I20260709 13:09:46.885939  2034 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:46.806411  2170 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:46.888590  2072 raft_consensus.cc:493] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
W20260709 13:09:46.925946 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 138153us
W20260709 13:09:46.878707  1980 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.002s	sys 0.031s
I20260709 13:09:46.891888 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:46.945021 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:47.020852 30620 raft_consensus.cc:2393] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 9: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:46.872599  2201 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:46.960134  2070 leader_election.cc:290] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:46.797288  2023 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:46.957381 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:47.038758 30618 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 13.
I20260709 13:09:46.879845  2168 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.888902 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:46.965742 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:47.040374 30621 raft_consensus.cc:3060] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:46.889145 31149 rpcz_store.cc:276] 0709 13:09:45.716916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.717028 (+   112us) service_pool.cc:224] Handling call
0709 13:09:45.717294 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:45.717475 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:46.209764 (+492289us) log.cc:844] Serialized 14 byte log entry
0709 13:09:46.865801 (+656037us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:46.865875 (+    74us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:46.865936 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.866023 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:46.866168 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":610625,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":42864,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":7814,"thread_start_us":1098779,"threads_started":2}
I20260709 13:09:47.021185  2072 raft_consensus.cc:3060] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:46.983299 31144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48414 (request call id 959) took 1264 ms. Trace:
W20260709 13:09:46.880920 30360 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 2b207fb799ce4340b29ae053898e0e6c with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica fe2b7d73f8c743c1ba570cfd981c4e79 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:09:47.007086 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:47.144013 30360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 268946us
I20260709 13:09:47.144155 30545 raft_consensus.cc:2468] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
I20260709 13:09:47.137629 31144 rpcz_store.cc:276] 0709 13:09:45.718460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.019597 (+301137us) service_pool.cc:224] Handling call
0709 13:09:46.625278 (+605681us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.625493 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:46.625528 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:46.625584 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:46.625627 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.625715 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:46.983122 (+357407us) spinlock_profiling.cc:243] Waited 605 ms on lock 0x7b5400500350. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f678ad 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:46.983245 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1392016256}
I20260709 13:09:46.968829 30623 raft_consensus.cc:1275] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:09:46.948949  2088 raft_consensus.cc:697] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 12 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
W20260709 13:09:46.997519 30548 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.009s	sys 0.033s
W20260709 13:09:47.155699 30548 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.010s	sys 0.034s
I20260709 13:09:46.951543  2163 raft_consensus.cc:1081] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 LEADER]: Signalling peer 092f6eb694fc4bbeab49677cccd880fd to start an election
W20260709 13:09:47.014822 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 52485.1us
W20260709 13:09:47.157222 31115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.961665  2065 raft_consensus.cc:2804] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:09:46.951838 30549 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.018s	sys 0.017s
I20260709 13:09:47.027938 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:47.028527 30543 raft_consensus.cc:1240] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:46.982966  2034 raft_consensus.cc:3060] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:47.030519 31142 raft_consensus.cc:2368] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 11. Current term is 12.
I20260709 13:09:46.966730  2202 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:46.925361  1671 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:47.044112 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:47.007931  2162 raft_consensus.cc:3060] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:47.045820 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 494827us
I20260709 13:09:47.231529 30441 leader_election.cc:304] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:47.046531 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 352940us
W20260709 13:09:47.024431  2204 log.cc:927] Time spent T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
W20260709 13:09:47.054679 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 384021us
I20260709 13:09:47.133533 31145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48414 (request call id 966) took 1235 ms. Trace:
I20260709 13:09:47.239262 31145 rpcz_store.cc:276] 0709 13:09:45.898316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.834623 (+936307us) service_pool.cc:224] Handling call
0709 13:09:46.834932 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.835129 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:09:46.835413 (+   284us) log.cc:844] Serialized 14 byte log entry
0709 13:09:47.132300 (+296887us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:47.132499 (+   199us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:47.132644 (+   145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.132875 (+   231us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:47.133457 (+   582us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85329,"prepare.queue_time_us":1196,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":112186,"thread_start_us":210655,"threads_started":1}
I20260709 13:09:47.012112  2177 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.023008  2165 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:47.135637 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:09:47.242077 31115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.148084 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:47.246037 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:47.247251 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:47.164764 30622 raft_consensus.cc:2393] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 11: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:47.252025 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:47.165283  2065 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.067867  2106 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:47.158233  1655 consensus_meta.cc:287] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 1.007s	user 0.011s	sys 0.000s
I20260709 13:09:47.147148 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:47.044046  2209 consensus_queue.cc:1059] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.187s
I20260709 13:09:47.131932  2168 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:47.266077 31147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 823) took 1281 ms. Trace:
I20260709 13:09:47.267194 30363 maintenance_manager.cc:419] P 045170a35afe4845987482e49e9e1eb9: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033377
W20260709 13:09:47.268759  2205 log.cc:927] Time spent T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.253s	user 0.000s	sys 0.000s
W20260709 13:09:47.269538  2207 log.cc:927] Time spent T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.221s	user 0.000s	sys 0.000s
W20260709 13:09:47.269691  2022 consensus_meta.cc:287] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.849s	user 0.010s	sys 0.000s
W20260709 13:09:47.271585  2211 log.cc:927] Time spent T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.256s	user 0.000s	sys 0.000s
I20260709 13:09:47.273594  2224 consensus_queue.cc:1048] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:47.251442  2177 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:47.280995  2106 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:47.285609  2165 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:47.286556 31148 raft_consensus.cc:1240] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:47.292909  2072 raft_consensus.cc:515] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:47.294509  2176 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:47.254676 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:47.301774 31147 rpcz_store.cc:276] 0709 13:09:45.984756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.009442 (+ 24686us) service_pool.cc:224] Handling call
0709 13:09:47.265891 (+1256449us) spinlock_profiling.cc:243] Waited 815 ms on lock 0x7b54005a14d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:47.266000 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1875406080}
I20260709 13:09:47.260490 30623 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 12.
I20260709 13:09:47.299314  2065 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:47.240811  2202 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:47.308725  2196 log.cc:927] Time spent T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 13:09:47.351611 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.233508 30620 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 9.
I20260709 13:09:47.235383 30621 raft_consensus.cc:2468] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 9.
I20260709 13:09:47.309316  2120 raft_consensus.cc:2804] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:09:47.317471 30467 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.016s	sys 0.024s
W20260709 13:09:47.361601  1758 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.033s	sys 0.043s
I20260709 13:09:47.301084  1655 raft_consensus.cc:515] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:47.549953 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:47.369385  2170 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:47.572431 30550 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 13.
I20260709 13:09:47.402557 30543 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:39952
I20260709 13:09:47.573459 30543 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:47.573913 30543 raft_consensus.cc:3060] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:47.536502  2211 log.cc:927] Time spent T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 13:09:47.504264  2120 raft_consensus.cc:493] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.405915  2057 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:47.587667 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
W20260709 13:09:47.502547 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 86444.7us
W20260709 13:09:47.504382 30467 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.017s	sys 0.024s
I20260709 13:09:47.529654 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:47.590003 30621 raft_consensus.cc:2410] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:09:47.531345 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:47.532272 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:47.591095 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:47.591089 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:47.591864 30620 raft_consensus.cc:2468] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 8.
W20260709 13:09:47.538594  2205 log.cc:927] Time spent T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:09:47.469758  2225 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:09:47.578184  1957 consensus_meta.cc:287] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.819s	user 0.011s	sys 0.000s
I20260709 13:09:47.412139 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:47.414033 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:47.585165 31146 raft_consensus.cc:2393] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 6: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:47.502873  2179 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:47.592764 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:47.588781 30589 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:47.593959 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:47.597865 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:47.371119  2106 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:47.602164 30589 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:47.599151 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:47.599426 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:47.603075 30621 raft_consensus.cc:2468] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 9.
I20260709 13:09:47.603325 30618 raft_consensus.cc:2410] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:09:47.576416  1655 leader_election.cc:290] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:47.600181 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:47.603869 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:47.604888 30621 raft_consensus.cc:2393] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 6: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:47.605994 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:47.400758  2088 consensus_queue.cc:237] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:47.609567 30620 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a"
dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
mode: GRACEFUL
new_leader_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:49382
I20260709 13:09:47.610296 30620 raft_consensus.cc:606] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 LEADER]: Received request to transfer leadership to TS 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:47.589339  2120 raft_consensus.cc:3060] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:47.608139 30589 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:47.614589 30548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 840) took 1326 ms. Trace:
I20260709 13:09:47.614579 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:47.644769 30619 raft_consensus.cc:2410] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:09:47.643283 30548 rpcz_store.cc:276] 0709 13:09:46.287204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.307636 (+ 20432us) service_pool.cc:224] Handling call
0709 13:09:46.307990 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:46.308332 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:46.308357 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:46.318590 (+ 10233us) log.cc:844] Serialized 26 byte log entry
0709 13:09:47.156188 (+837598us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:47.166629 (+ 10441us) log.cc:844] Serialized 14 byte log entry
0709 13:09:47.612879 (+446250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.612959 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:47.613001 (+    42us) raft_consensus.cc:1685] finished
0709 13:09:47.613017 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:47.613151 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24124,"prepare.queue_time_us":93108,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":361361,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":20984,"thread_start_us":1109932,"threads_started":2,"wal-append.queue_time_us":915088}
I20260709 13:09:47.612910  2164 raft_consensus.cc:2804] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:09:47.711495 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 448944us
I20260709 13:09:47.711735 30549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 830) took 2251 ms. Trace:
I20260709 13:09:47.643079  2176 raft_consensus.cc:2804] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:09:47.649158  2215 log.cc:927] Time spent T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.406s	user 0.000s	sys 0.001s
W20260709 13:09:47.720465 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 480653us
W20260709 13:09:47.720855 30517 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.003s	sys 0.028s
W20260709 13:09:47.723632 30517 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.003s	sys 0.028s
W20260709 13:09:47.715618 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 459933us
I20260709 13:09:47.718149 30549 rpcz_store.cc:276] 0709 13:09:45.459850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.480751 (+ 20901us) service_pool.cc:224] Handling call
0709 13:09:45.530193 (+ 49442us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:45.746656 (+216463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:45.746684 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:45.747208 (+   524us) log.cc:844] Serialized 52 byte log entry
0709 13:09:46.228258 (+481050us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:47.158607 (+930349us) log.cc:844] Serialized 14 byte log entry
0709 13:09:47.236944 (+ 78337us) log.cc:844] Serialized 14 byte log entry
0709 13:09:47.711314 (+474370us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.711417 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:47.711478 (+    61us) raft_consensus.cc:1685] finished
0709 13:09:47.711496 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:47.711667 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15015,"prepare.queue_time_us":226294,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":10964,"raft.queue_time_us":759276,"raft.run_cpu_time_us":385,"raft.run_wall_time_us":103810,"thread_start_us":1858089,"threads_started":3,"wal-append.queue_time_us":593219}
I20260709 13:09:47.725605 30441 leader_election.cc:304] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:47.603379  2179 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:47.607458  2225 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:47.604142  1957 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:47.734421 31115 leader_election.cc:304] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:09:47.717239  2164 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
W20260709 13:09:47.723271  2205 log.cc:927] Time spent T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:09:47.722391  2218 log.cc:927] Time spent T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.479s	user 0.001s	sys 0.000s
I20260709 13:09:47.715306  2161 raft_consensus.cc:2749] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:47.721860  2176 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:47.741060 30514 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.024s	sys 0.034s
W20260709 13:09:47.744172 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 499947us
I20260709 13:09:47.746913 30547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43088 (request call id 2155) took 2193 ms. Trace:
W20260709 13:09:47.728477 30516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:47.761600 30516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:47.760522 30514 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.024s	sys 0.034s
I20260709 13:09:47.760866 30547 rpcz_store.cc:276] 0709 13:09:45.553319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.793048 (+239729us) service_pool.cc:224] Handling call
0709 13:09:45.793311 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:45.793494 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:46.316931 (+523437us) log.cc:844] Serialized 14 byte log entry
0709 13:09:47.269458 (+952527us) log.cc:844] Serialized 14 byte log entry
0709 13:09:47.746533 (+477075us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:47.746584 (+    51us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:47.746632 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.746738 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:47.746858 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44805,"prepare.queue_time_us":555640,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":69,"raft.queue_time_us":610987,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":107991,"thread_start_us":1813525,"threads_started":4,"wal-append.queue_time_us":959690}
I20260709 13:09:47.767684 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:47.743836  2164 raft_consensus.cc:3060] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:47.781136 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:47.746731  2171 raft_consensus.cc:2804] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:47.777652 31114 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
W20260709 13:09:47.840590 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 63016.8us
I20260709 13:09:47.791241 30516 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:47.765604  2176 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:47.796100 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 75154.4us
I20260709 13:09:47.771160  2072 leader_election.cc:290] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:47.789130  2237 log.cc:927] Time spent T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
W20260709 13:09:47.785324  2208 log.cc:927] Time spent T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.318s	user 0.001s	sys 0.000s
W20260709 13:09:47.795388  2235 log.cc:927] Time spent T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
I20260709 13:09:47.835368 30618 raft_consensus.cc:3060] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:47.747071  2233 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:47.867105 30542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43088 (request call id 2148) took 2429 ms. Trace:
I20260709 13:09:47.868638 31114 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:47.867636 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 76496us
I20260709 13:09:47.839085  2177 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:47.892777 31114 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:47.894131 30516 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:47.873101 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 261024us
I20260709 13:09:47.882350 30625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36130 (request call id 2028) took 2600 ms. Trace:
W20260709 13:09:47.872562 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 264475us
I20260709 13:09:47.896085 30516 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:47.888712 30440 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:47.901329 30516 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:47.896946 30543 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:47.816224  2227 consensus_queue.cc:1048] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:09:47.866387  2247 raft_consensus.cc:2749] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:47.875701  2171 raft_consensus.cc:697] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 9 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:47.906432  1957 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:47.888927  2119 consensus_queue.cc:1048] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:09:47.802415  2257 consensus_queue.cc:1048] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.091s
I20260709 13:09:47.900367  2165 raft_consensus.cc:2804] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:47.968501  2165 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:47.968894  2165 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:47.900529  2234 log.cc:927] Time spent T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
W20260709 13:09:47.908471  2182 consensus_meta.cc:287] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.911s	user 0.011s	sys 0.000s
W20260709 13:09:47.910503  2107 consensus_meta.cc:287] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 1.210s	user 0.012s	sys 0.000s
I20260709 13:09:47.912135  2251 raft_consensus.cc:2749] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:47.912459  2258 raft_consensus.cc:2804] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:09:47.878495  2232 log.cc:927] Time spent T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.271s	user 0.001s	sys 0.001s
W20260709 13:09:47.945080 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 52381.3us
I20260709 13:09:47.873769  2240 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:47.945685 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:47.897046 30625 rpcz_store.cc:276] 0709 13:09:45.282958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.283072 (+   114us) service_pool.cc:224] Handling call
0709 13:09:45.283359 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:46.063406 (+780047us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:46.063462 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:46.105599 (+ 42137us) log.cc:844] Serialized 26 byte log entry
0709 13:09:46.713237 (+607638us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:46.713276 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.713339 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:47.882101 (+1168762us) raft_consensus.cc:1685] finished
0709 13:09:47.882123 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:47.882274 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":86425,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"thread_start_us":1309903,"threads_started":2,"wal-append.queue_time_us":900554}
W20260709 13:09:47.993682 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 268131us
I20260709 13:09:47.879622 30542 rpcz_store.cc:276] 0709 13:09:45.437315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.437435 (+   120us) service_pool.cc:224] Handling call
0709 13:09:45.448287 (+ 10852us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:45.459700 (+ 11413us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:46.082359 (+622659us) log.cc:844] Serialized 14 byte log entry
0709 13:09:47.072987 (+990628us) log.cc:844] Serialized 14 byte log entry
0709 13:09:47.586699 (+513712us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:47.591156 (+  4457us) log.cc:844] Serialized 26 byte log entry
0709 13:09:47.591300 (+   144us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:47.591334 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.591413 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:47.866882 (+275469us) raft_consensus.cc:1685] finished
0709 13:09:47.866901 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:47.867044 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71161,"prepare.queue_time_us":851834,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":75,"raft.queue_time_us":493898,"raft.run_cpu_time_us":414,"raft.run_wall_time_us":134135,"thread_start_us":1911897,"threads_started":4,"wal-append.queue_time_us":745313}
I20260709 13:09:47.951591 30440 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:47.954579  2244 consensus_queue.cc:1048] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:09:47.955673  2241 log.cc:927] Time spent T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 13:09:47.946341  2238 log.cc:927] Time spent T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
I20260709 13:09:47.955792 30543 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:47.957329 31149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48414 (request call id 970) took 1270 ms. Trace:
I20260709 13:09:47.953961 30516 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:47.959872  1655 raft_consensus.cc:2804] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:47.960731  2171 consensus_queue.cc:237] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:47.965950 30618 raft_consensus.cc:2468] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 6.
I20260709 13:09:47.878237  2224 raft_consensus.cc:2804] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:47.897949  2248 raft_consensus.cc:2749] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:47.972404 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:47.974367  2206 raft_consensus.cc:993] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79: : Instructing follower 092f6eb694fc4bbeab49677cccd880fd to start an election
I20260709 13:09:47.974658 29364 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:47.953598  2262 raft_consensus.cc:2804] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:09:47.976467 31146 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48414 (request call id 953) took 2259 ms (client timeout 2104 ms). Trace:
W20260709 13:09:47.978623  2162 consensus_meta.cc:287] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.729s	user 0.008s	sys 0.002s
I20260709 13:09:47.982023  2164 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:47.983130  2225 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:47.983765 31151 raft_consensus.cc:1240] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 5. Current term is 6. Ops: []
W20260709 13:09:47.984094 30360 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 2b207fb799ce4340b29ae053898e0e6c with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica fe2b7d73f8c743c1ba570cfd981c4e79 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:09:47.943800  2106 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:47.874222  2249 consensus_queue.cc:1048] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.101s
W20260709 13:09:47.972862  2239 log.cc:927] Time spent T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.257s	user 0.000s	sys 0.001s
I20260709 13:09:47.903646 30589 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:47.995467 30441 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:47.972025  1957 raft_consensus.cc:2749] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:48.000125 30440 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:09:48.003089 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 49236.6us
I20260709 13:09:47.987248  2022 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.890873  2233 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:48.023845 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 120237us
I20260709 13:09:48.006080  2251 raft_consensus.cc:2804] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:48.025326 30589 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:48.026219 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:48.026948 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:48.027140 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:48.027343 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:48.027763 30544 raft_consensus.cc:2393] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 10: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:48.002785 31149 rpcz_store.cc:276] 0709 13:09:46.687384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.041993 (+354609us) service_pool.cc:224] Handling call
0709 13:09:47.042425 (+   432us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:47.042850 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:47.042889 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:47.043544 (+   655us) log.cc:844] Serialized 52 byte log entry
0709 13:09:47.684537 (+640993us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:47.684595 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.684677 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:47.957084 (+272407us) raft_consensus.cc:1685] finished
0709 13:09:47.957112 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:47.957269 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7971,"raft.queue_time_us":8951,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":15744,"thread_start_us":447939,"threads_started":1,"wal-append.queue_time_us":765922}
I20260709 13:09:47.989882  2258 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:48.006573  2242 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.008005 31144 raft_consensus.cc:3060] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:48.006920 31115 leader_election.cc:304] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:48.014499 31146 rpcz_store.cc:269] 0709 13:09:45.716640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.718233 (+  1593us) service_pool.cc:224] Handling call
0709 13:09:47.976244 (+2258011us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b54004cc054. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:47.976381 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4005907840}
W20260709 13:09:48.016521 30591 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.783s	user 0.007s	sys 0.016s
I20260709 13:09:48.000941  2231 raft_consensus.cc:2804] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:48.009696 29364 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:47.986922  2182 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:47.988443  2107 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:48.027984 30547 raft_consensus.cc:2468] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 10.
I20260709 13:09:48.028673 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:48.029544 30440 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:48.030216 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:48.030478 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:48.016077  2262 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:48.033468 30591 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.008s	sys 0.016s
I20260709 13:09:48.034018 31114 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:47.995154  2202 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:48.004859  1655 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:48.019495  2224 raft_consensus.cc:697] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 6 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:48.019387  2259 raft_consensus.cc:1081] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 LEADER]: Signalling peer 092f6eb694fc4bbeab49677cccd880fd to start an election
I20260709 13:09:48.021929  2162 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:48.000833  2240 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:48.069506  2162 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:48.035404  2177 raft_consensus.cc:2804] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:48.070142 30623 raft_consensus.cc:1240] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:48.070325  2240 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:48.070453  2177 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:48.070995  2177 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:48.031306 30360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 47266.8us
I20260709 13:09:48.072772  2233 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:48.072904 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:48.072324  1926 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:48.073702  1926 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:48.034785  2022 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:48.074088 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:48.075130 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:48.075637  2022 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:48.072139 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:48.078410 30544 raft_consensus.cc:2376] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 6. Re-sending same reply.
I20260709 13:09:48.079247 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:48.081499  2228 log.cc:927] Time spent T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.777s	user 0.002s	sys 0.000s
I20260709 13:09:48.033048 30441 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:48.042177 30622 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36130 (request call id 2040) took 2096 ms (client timeout 1704 ms). Trace:
W20260709 13:09:48.082319 30622 rpcz_store.cc:269] 0709 13:09:45.945583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.945804 (+   221us) service_pool.cc:224] Handling call
0709 13:09:48.041992 (+2096188us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54001d8b54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:48.042113 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2597795072}
I20260709 13:09:48.042629 30616 raft_consensus.cc:1240] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:09:48.084899 30616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 880) took 2134 ms. Trace:
I20260709 13:09:48.085232 30616 rpcz_store.cc:276] 0709 13:09:45.950399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.083931 (+133532us) service_pool.cc:224] Handling call
0709 13:09:48.042429 (+1958498us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:48.083522 (+ 41093us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.084671 (+  1149us) spinlock_profiling.cc:243] Waited 1.96 s on lock 0x7b54001d8b50. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f678ad 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:48.084840 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4503207808}
I20260709 13:09:48.087049  2168 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:09:48.088016 31142 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48412 (request call id 780) took 2057 ms (client timeout 2140 ms). Trace:
W20260709 13:09:48.088413 31142 rpcz_store.cc:269] 0709 13:09:46.030470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.347047 (+316577us) service_pool.cc:224] Handling call
0709 13:09:48.087797 (+1740750us) spinlock_profiling.cc:243] Waited 606 ms on lock 0x7b5400482bd4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:48.087957 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1392903936}
I20260709 13:09:48.089329 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:48.089932 31149 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 9.
I20260709 13:09:48.090667 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:48.091161 31149 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
I20260709 13:09:48.065199 31151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48412 (request call id 774) took 2345 ms. Trace:
I20260709 13:09:48.092372 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:48.092471 31151 rpcz_store.cc:276] 0709 13:09:45.719384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.741558 (+1022174us) service_pool.cc:224] Handling call
0709 13:09:47.983635 (+1242077us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:48.022008 (+ 38373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.065015 (+ 43007us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54004cc050. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f678ad 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:48.065143 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2724119296}
I20260709 13:09:48.093559 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:48.093657 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:48.094280 31151 raft_consensus.cc:2468] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
I20260709 13:09:48.094655 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:48.095345 31151 raft_consensus.cc:1240] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:09:48.096204  2163 raft_consensus.cc:3055] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:48.096349 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:48.096608  2163 raft_consensus.cc:740] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:48.096946 31142 raft_consensus.cc:2468] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 8.
I20260709 13:09:48.097414  2163 consensus_queue.cc:260] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:48.098425  2163 raft_consensus.cc:3060] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:48.098500  1991 consensus_queue.cc:1059] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:48.099350  1991 raft_consensus.cc:3055] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:48.099686  1991 raft_consensus.cc:740] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:48.100215 30474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 921) took 1313 ms. Trace:
I20260709 13:09:48.100289  2224 consensus_queue.cc:237] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:48.100591  1991 consensus_queue.cc:260] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:48.101810  1991 raft_consensus.cc:3060] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:48.104959 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:48.100625 30474 rpcz_store.cc:276] 0709 13:09:46.786520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.788472 (+  1952us) service_pool.cc:224] Handling call
0709 13:09:46.808296 (+ 19824us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:46.808592 (+   296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:46.808617 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:46.816757 (+  8140us) log.cc:844] Serialized 26 byte log entry
0709 13:09:48.099674 (+1282917us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b180040ca80. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc783b104bc 00007fc780e5e48b 00007fc789cb8ab9 00007fc780e7a69b 00007fc780e7893f 00007fc780e7ac02 00007fc783b0220b 00007fc783b07d23 00007fc783b080d1
0709 13:09:48.099836 (+   162us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:48.099879 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.099941 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:48.099982 (+    41us) raft_consensus.cc:1685] finished
0709 13:09:48.099992 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.100167 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15519,"raft.queue_time_us":323189,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":29293,"spinlock_wait_cycles":6130048,"thread_start_us":307670,"threads_started":1,"wal-append.queue_time_us":677240}
I20260709 13:09:48.075596 30550 raft_consensus.cc:2468] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 8.
I20260709 13:09:48.110690 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:48.114391 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:48.116616 31148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48426 (request call id 816) took 2269 ms. Trace:
I20260709 13:09:48.037817 30589 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
W20260709 13:09:48.039314 31143 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48414 (request call id 967) took 2111 ms (client timeout 2418 ms). Trace:
W20260709 13:09:48.117512 31143 rpcz_store.cc:269] 0709 13:09:45.928286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.929487 (+  1201us) service_pool.cc:224] Handling call
0709 13:09:48.039155 (+2109668us) spinlock_profiling.cc:243] Waited 690 ms on lock 0x7b5400564ad4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:48.039263 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1587063680}
I20260709 13:09:48.046284 30542 raft_consensus.cc:2468] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 8.
W20260709 13:09:48.118239 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 85248.1us
I20260709 13:09:48.119270 31144 raft_consensus.cc:2468] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7.
I20260709 13:09:48.040674 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:48.120042 30549 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:48.047520 30545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 2074) took 1174 ms. Trace:
I20260709 13:09:48.051882 31114 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:48.031466  2206 raft_consensus.cc:2804] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:48.055233  2107 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:48.040201  2174 raft_consensus.cc:2749] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:48.039659  2201 consensus_meta.cc:287] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.996s	user 0.006s	sys 0.006s
I20260709 13:09:48.037168  2253 raft_consensus.cc:2804] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:48.034893  2258 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:48.035429  2263 raft_consensus.cc:2804] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:48.037653  2231 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:48.037998  2242 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:48.033061  2251 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:48.057516 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.057722  2164 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:48.059497  2023 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:48.061434  1671 consensus_meta.cc:287] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.818s	user 0.009s	sys 0.000s
I20260709 13:09:48.061779  2179 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:48.062641 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:48.064360 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:48.065011 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:48.132855  2247 raft_consensus.cc:3060] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:48.149103 30546 raft_consensus.cc:2393] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 9: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:48.065130  2182 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:48.065794 30624 raft_consensus.cc:1240] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:48.066218  2246 raft_consensus.cc:2749] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:48.046979  2262 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:48.051565  2260 raft_consensus.cc:493] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:48.152649  2260 raft_consensus.cc:515] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:48.154914  2260 leader_election.cc:290] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133)
I20260709 13:09:48.046312  2119 raft_consensus.cc:2804] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:48.117097 31148 rpcz_store.cc:276] 0709 13:09:45.846774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.832343 (+985569us) service_pool.cc:224] Handling call
0709 13:09:46.832660 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:47.361021 (+528361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.116360 (+755339us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b540045f454. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:48.116542 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1043315584}
I20260709 13:09:48.052664 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:48.155572  2119 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:48.156077  2119 raft_consensus.cc:3060] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:48.148983  1671 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:48.156872 30620 raft_consensus.cc:1240] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:48.157596 30551 raft_consensus.cc:2393] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 10: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:48.159788  2242 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:48.137277  2231 raft_consensus.cc:3060] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:48.121191 30545 rpcz_store.cc:276] 0709 13:09:46.954899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.144974 (+190075us) service_pool.cc:224] Handling call
0709 13:09:47.145328 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:47.145540 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:47.145569 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:47.146017 (+   448us) log.cc:844] Serialized 26 byte log entry
0709 13:09:47.548948 (+402931us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:47.548999 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.549090 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:48.047252 (+498162us) raft_consensus.cc:1685] finished
0709 13:09:48.047282 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.047446 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":401072,"threads_started":1,"wal-append.queue_time_us":619207}
W20260709 13:09:48.126021 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 74229.1us
I20260709 13:09:48.052974  1655 raft_consensus.cc:3060] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:48.130403  2176 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:48.133148  2201 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:48.131310 30440 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:48.164062 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:09:48.186524 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 55281.7us
I20260709 13:09:48.187595 30440 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:48.135793 30590 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:48.189038 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 53317.3us
I20260709 13:09:48.141474 30549 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 12.
W20260709 13:09:48.143517 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 105749us
I20260709 13:09:48.125201  2206 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:48.128741  2009 raft_consensus.cc:2749] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:48.148224 30543 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 12.
I20260709 13:09:48.186551 30616 raft_consensus.cc:2468] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 8.
W20260709 13:09:48.065260  2034 consensus_meta.cc:287] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.831s	user 0.009s	sys 0.001s
I20260709 13:09:48.150683 30547 raft_consensus.cc:1240] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:48.136876  2168 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.123659 30441 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:48.134761  2263 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.192093 30440 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:48.144764  2251 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:48.195048 31115 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:48.197793 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 74214.6us
I20260709 13:09:48.199120 30440 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:48.205183 30441 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:48.200634 31114 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326
W20260709 13:09:48.149968  2065 consensus_meta.cc:287] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.615s	user 0.010s	sys 0.000s
I20260709 13:09:48.146111  2253 raft_consensus.cc:697] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 6 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:48.148742  2022 raft_consensus.cc:2804] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:09:48.183648  2120 consensus_meta.cc:287] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.537s	user 0.005s	sys 0.004s
I20260709 13:09:48.207028 30589 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:48.202185  2262 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:48.209579 30619 raft_consensus.cc:2393] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 12: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:48.214624 30441 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:48.224026 30590 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.173.4:34453 timed out after 2.418s (SENT) [suppressed 31 similar messages]
I20260709 13:09:48.196161  2206 raft_consensus.cc:3060] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:48.195529  2158 raft_consensus.cc:2749] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:48.194454  1980 raft_consensus.cc:2749] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:48.226012 30440 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:48.206195  2260 raft_consensus.cc:2804] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:48.204156  2257 raft_consensus.cc:2749] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:48.208369  1758 raft_consensus.cc:2749] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:48.203892  2263 raft_consensus.cc:3060] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:48.207978  2022 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:09:48.261320 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 50161.5us
I20260709 13:09:48.236488  2254 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:48.236421  2009 raft_consensus.cc:2804] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:48.235936  2259 raft_consensus.cc:2804] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:48.264370 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:48.240444  2088 raft_consensus.cc:2804] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:48.236838  2242 raft_consensus.cc:2804] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:48.203461  2023 consensus_queue.cc:1059] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:09:48.241587  2236 raft_consensus.cc:2804] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:48.317734 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:48.318210  2236 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:48.318482 30551 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
I20260709 13:09:48.318728  2236 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:48.319635 30551 raft_consensus.cc:1240] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:48.324376 30551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:39952
I20260709 13:09:48.324894 30551 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:48.325210 30551 raft_consensus.cc:3060] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:48.207763  2034 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:48.213810  2120 raft_consensus.cc:515] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:48.207717  2168 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:48.286372 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:48.354024 30545 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
I20260709 13:09:48.358392 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:48.359131 30549 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:48.276612  1758 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.284066  2224 raft_consensus.cc:2749] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:48.327915  2242 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:48.329588 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:48.252693  2260 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.213999  2065 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:48.332765 30542 raft_consensus.cc:2468] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 11.
I20260709 13:09:48.264514  2022 raft_consensus.cc:3060] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:48.334522 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:48.332464 30551 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:48.278947  2009 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:48.311604 30591 leader_election.cc:336] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.070s (SENT)
I20260709 13:09:48.460961 30591 leader_election.cc:304] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
W20260709 13:09:48.462034 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 150456us
W20260709 13:09:48.423786 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:48.432368 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.285624  2088 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.433054 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:48.276935  2259 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:48.323444  2176 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:48.470824  2088 raft_consensus.cc:3060] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:48.470991  2023 raft_consensus.cc:2749] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:48.437453  1758 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:48.466578 31147 raft_consensus.cc:2393] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 12: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:48.468331 31149 raft_consensus.cc:2410] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:09:48.467800 30545 raft_consensus.cc:3060] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:48.350919  2057 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:48.500061 31150 raft_consensus.cc:1240] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:09:48.465934 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:48.507629 30542 raft_consensus.cc:1240] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:48.476433 30551 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:48.496480  2271 log.cc:927] Time spent T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
W20260709 13:09:48.462926  2269 log.cc:927] Time spent T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
I20260709 13:09:48.516919 30549 raft_consensus.cc:2468] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 13.
I20260709 13:09:48.437143  2242 raft_consensus.cc:3060] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:48.468286  2170 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:48.522475  2170 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:48.521893  1758 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:48.453297  2260 raft_consensus.cc:3060] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:48.528271  2170 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:48.528769  2251 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:48.538698 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:48.541289 30471 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:48.498059  2259 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:48.541955 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 325628us
I20260709 13:09:48.545400 30441 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:48.467767  2009 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:48.552127 30545 raft_consensus.cc:2468] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 12.
I20260709 13:09:48.553797 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:48.554143 30471 raft_consensus.cc:2468] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 11.
W20260709 13:09:48.539675  2165 consensus_meta.cc:287] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.570s	user 0.010s	sys 0.000s
I20260709 13:09:48.557396 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:48.559326 30544 raft_consensus.cc:2368] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 12. Current term is 13.
I20260709 13:09:48.557040  2280 raft_consensus.cc:2804] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:48.560621  2280 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.561066  2280 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:48.534345  1926 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:48.520208  2177 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:48.567921  2165 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:48.569626  2177 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:48.570070  2165 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:48.571050 31145 raft_consensus.cc:1240] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 8. Current term is 9. Ops: []
W20260709 13:09:48.572871 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 466466us
W20260709 13:09:48.573990  2272 log.cc:927] Time spent T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:09:48.574368 30516 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:48.576190 31144 raft_consensus.cc:1240] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 9 LEADER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:09:48.577558 31144 raft_consensus.cc:1240] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:48.578379  2233 raft_consensus.cc:2804] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:48.578812  2233 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:48.537917  2180 raft_consensus.cc:3055] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:48.517519  2057 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:48.576121 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:09:48.581549 30441 connection.cc:256] RPC call timeout handler was delayed by -1.1102660059999607s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1704s for a response
W20260709 13:09:48.589079 30441 connection.cc:256] RPC call timeout handler was delayed by -1.0940660059999345s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17220000000000002s for a response
I20260709 13:09:48.589133 30473 raft_consensus.cc:2468] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 11.
I20260709 13:09:48.590515 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:48.590970 30621 raft_consensus.cc:1240] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:09:48.542158  1758 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:48.586412 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:48.587707 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:48.588202 30618 raft_consensus.cc:1240] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:48.590992 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:09:48.585928 30516 leader_election.cc:336] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Timed out: RequestConsensusVote RPC to 127.28.173.3:32851 timed out after 1.589s (SENT)
I20260709 13:09:48.597162 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:48.597384 30618 raft_consensus.cc:1275] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:09:48.597760 30618 pending_rounds.cc:85] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79: Aborting all ops after (but not including) 7
I20260709 13:09:48.597960 30618 pending_rounds.cc:107] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:09:48.596669 30516 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:48.598244 30618 raft_consensus.cc:2889] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:48.598654 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 366891us
I20260709 13:09:48.593411 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:48.598930 30621 raft_consensus.cc:1240] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:09:48.599891 31144 raft_consensus.cc:1240] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 12 LEADER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:48.595052 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:48.601903 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:48.602603 30469 raft_consensus.cc:2468] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 12.
I20260709 13:09:48.593675 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:48.604344 30472 raft_consensus.cc:2393] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 14: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:48.605715 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:48.556226  2201 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:48.606979 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:48.607578 30440 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:48.607851 30472 raft_consensus.cc:2468] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 7.
I20260709 13:09:48.608913 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:48.609614 30472 raft_consensus.cc:2468] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 8.
I20260709 13:09:48.610612 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:48.584657  2233 raft_consensus.cc:3060] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:48.611260 30621 raft_consensus.cc:2468] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9.
I20260709 13:09:48.432235  2253 consensus_queue.cc:237] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:48.611490 30440 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:48.616374 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:48.603678 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:48.612113 30476 raft_consensus.cc:1240] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:48.584940  2180 raft_consensus.cc:740] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:48.619283 30469 raft_consensus.cc:2393] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 13: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:48.619742 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:48.620769 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:48.625736 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:48.627991 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:48.630960 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:48.632844  2057 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:48.615409  2094 raft_consensus.cc:3060] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:48.634853  2119 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:48.638659  2231 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:48.588524  2244 consensus_queue.cc:1059] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:09:48.639335  2168 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:48.640089 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:48.641590 31144 raft_consensus.cc:1275] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:09:48.615479  2034 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:48.644806  2034 raft_consensus.cc:2749] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:48.631567 30621 raft_consensus.cc:2468] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 8.
I20260709 13:09:48.650156 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:48.650981 30621 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:48.606402  1758 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:48.598024  2206 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:48.654846 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:48.674952 31150 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48426 (request call id 824) took 2385 ms. Trace:
I20260709 13:09:48.873824 31150 rpcz_store.cc:276] 0709 13:09:46.289502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.008187 (+718685us) service_pool.cc:224] Handling call
0709 13:09:47.014093 (+  5906us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:48.506470 (+1492377us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.674718 (+168248us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54005749d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:48.674897 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3415447296}
I20260709 13:09:48.663631 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:09:48.851152 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 233797us
I20260709 13:09:48.676928 30624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 888) took 1885 ms. Trace:
W20260709 13:09:48.859963 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.879324 30624 rpcz_store.cc:276] 0709 13:09:46.791411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.791556 (+   145us) service_pool.cc:224] Handling call
0709 13:09:46.791899 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:48.151806 (+1359907us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.676643 (+524837us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54002c9a54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:48.676855 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2929095552}
I20260709 13:09:48.697909 31114 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:48.660290 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:09:48.880935 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 183096us
I20260709 13:09:48.881165 30476 raft_consensus.cc:2468] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 11.
W20260709 13:09:48.817693 31148 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.005s	sys 0.024s
W20260709 13:09:48.881879 31148 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.008s	sys 0.024s
I20260709 13:09:48.884609 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:48.885277 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:48.686636 30621 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 13.
I20260709 13:09:48.885217 30622 raft_consensus.cc:2468] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 11.
I20260709 13:09:48.889671 30470 raft_consensus.cc:2393] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 11: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
W20260709 13:09:48.895403 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 364396us
I20260709 13:09:48.920704 31116 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd
W20260709 13:09:48.850200  1655 consensus_meta.cc:287] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.643s	user 0.008s	sys 0.000s
I20260709 13:09:48.897620 30547 raft_consensus.cc:1240] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:48.900628 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:48.900668 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:48.648342  2201 raft_consensus.cc:3060] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:48.943318  2253 raft_consensus.cc:2804] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:48.943884  2253 raft_consensus.cc:697] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 11 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:48.944720  2253 consensus_queue.cc:237] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:48.948705  1671 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:48.901981 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:48.902822 30616 raft_consensus.cc:1240] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:48.903319 30550 raft_consensus.cc:1240] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:48.852552  2120 leader_election.cc:290] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:48.680701  2231 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:48.905700 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:48.899534  2177 consensus_queue.cc:1059] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:09:48.676204  2065 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:48.682016  2119 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:48.848850  2251 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:48.908574 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:48.983408 30545 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:48.909844 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:48.892774  2168 raft_consensus.cc:2804] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:48.891834 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:48.682276  2242 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:48.942301  2278 log.cc:927] Time spent T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:09:48.990351  2290 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:48.990890  2290 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:48.845281  2022 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:48.992650 30545 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 13.
W20260709 13:09:48.997115  2258 consensus_meta.cc:287] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.853s	user 0.006s	sys 0.005s
I20260709 13:09:48.680866  2254 raft_consensus.cc:2749] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:48.978713 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:48.987737  2168 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:48.878409  2260 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:48.975713  2244 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:48.953909  2057 consensus_queue.cc:1059] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.074s
I20260709 13:09:49.025075  2168 raft_consensus.cc:3060] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:49.042388  2284 raft_consensus.cc:3055] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:49.042788  2284 raft_consensus.cc:740] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:49.043561  2284 consensus_queue.cc:260] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:48.839919  2180 consensus_queue.cc:260] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:49.035282  1758 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:49.037002  2094 raft_consensus.cc:2749] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:48.976116  1655 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:48.922603  2233 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:49.040516  2290 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:49.050098 31147 raft_consensus.cc:1240] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 10. Current term is 11. Ops: []
W20260709 13:09:49.048365  2245 log.cc:927] Time spent T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
W20260709 13:09:49.051074  2247 consensus_meta.cc:287] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.869s	user 0.011s	sys 0.000s
I20260709 13:09:49.038275  2206 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:49.041260  2244 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:49.054592  2180 raft_consensus.cc:3060] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:49.022414  2258 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:49.063551  2263 consensus_meta.cc:287] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.789s	user 0.007s	sys 0.002s
I20260709 13:09:49.063946  2263 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:49.065114  2244 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:49.065922  2263 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:49.065627  2280 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:49.061208  2247 raft_consensus.cc:2749] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:48.915740 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:48.919559 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:49.098397 30468 raft_consensus.cc:1240] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 12. Current term is 13. Ops: []
W20260709 13:09:48.978709 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 392757us
I20260709 13:09:49.154011 30620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 898) took 1401 ms. Trace:
I20260709 13:09:49.099355 30473 raft_consensus.cc:2393] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 10: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:49.154469 30620 rpcz_store.cc:276] 0709 13:09:47.752215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.752476 (+   261us) service_pool.cc:224] Handling call
0709 13:09:47.752853 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:48.157216 (+404363us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:49.153340 (+996124us) spinlock_profiling.cc:243] Waited 404 ms on lock 0x7b5400203354. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:49.153778 (+   438us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":928734592}
W20260709 13:09:49.099833 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 181897us
I20260709 13:09:49.101269 30542 raft_consensus.cc:3060] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:48.982112 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:49.101457 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:49.110144 30467 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:49.110343 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:49.115125  1655 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:49.116320 31146 raft_consensus.cc:1240] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 8. Current term is 9. Ops: []
W20260709 13:09:49.046787 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 137933us
I20260709 13:09:49.066900  2259 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:49.068657  2280 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:49.181306  2259 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:09:49.139302 30360 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 2b207fb799ce4340b29ae053898e0e6c with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica fe2b7d73f8c743c1ba570cfd981c4e79 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:09:49.147059  2022 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:49.148414  2258 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:49.149570 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:49.068863  2260 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:49.143926 30544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43088 (request call id 2188) took 1081 ms. Trace:
I20260709 13:09:49.159765 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: true dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:49.162917 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:49.185524 30360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 47859.1us
I20260709 13:09:49.164615 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:49.165655 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:09:49.169129 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.173508 30550 raft_consensus.cc:1240] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:49.175127 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:49.177217 30549 raft_consensus.cc:3060] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:49.177444 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:49.184916 30617 raft_consensus.cc:1240] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:49.163985 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:49.189054 30548 raft_consensus.cc:3060] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:49.188026 30551 raft_consensus.cc:2468] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9.
I20260709 13:09:49.192911 30473 raft_consensus.cc:2410] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:09:49.192844 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:49.196161  2182 raft_consensus.cc:993] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79: : Instructing follower 092f6eb694fc4bbeab49677cccd880fd to start an election
I20260709 13:09:49.196923  2182 raft_consensus.cc:1081] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 LEADER]: Signalling peer 092f6eb694fc4bbeab49677cccd880fd to start an election
I20260709 13:09:49.199751 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:49.201300 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:49.175868 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:49.202824  2231 raft_consensus.cc:3055] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:49.208212  2231 raft_consensus.cc:740] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:49.209666  2231 consensus_queue.cc:260] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:49.214953 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:49.221921 30469 raft_consensus.cc:2468] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
I20260709 13:09:49.225061 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:49.225483 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:49.225991 30473 raft_consensus.cc:2393] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 11: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:49.227324 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:49.228641 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:49.232149 31150 raft_consensus.cc:3060] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:49.232314 30473 raft_consensus.cc:2393] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 11: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:49.233268 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:49.233908 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:49.235255 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:49.236289 30475 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 11.
I20260709 13:09:49.227324 30545 raft_consensus.cc:2393] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 13: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:49.239152 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:49.184661 30544 rpcz_store.cc:276] 0709 13:09:48.062040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.104724 (+ 42684us) service_pool.cc:224] Handling call
0709 13:09:49.136469 (+1031745us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b54002571d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:49.143187 (+  6718us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1042898304}
I20260709 13:09:49.240715 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:49.242017 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:49.242703 30475 raft_consensus.cc:2468] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
I20260709 13:09:49.243749  2242 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:49.248459  2231 raft_consensus.cc:3060] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:49.251073  2233 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:49.243678 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:49.252290 30470 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 11.
I20260709 13:09:49.258433 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:49.263940 30544 raft_consensus.cc:1240] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:49.265350 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:49.266688 31146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48414 (request call id 977) took 1177 ms. Trace:
I20260709 13:09:49.266872 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:49.280921 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:49.267134 31146 rpcz_store.cc:276] 0709 13:09:48.089536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.091883 (+  2347us) service_pool.cc:224] Handling call
0709 13:09:48.092169 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:49.173367 (+1081198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:49.266367 (+ 93000us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540045e7d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:49.266569 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2353719168}
I20260709 13:09:49.273622  2034 raft_consensus.cc:3055] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:49.294752 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:49.294829  2034 raft_consensus.cc:740] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
W20260709 13:09:49.295594 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.295866  2284 raft_consensus.cc:3060] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:49.296633  2034 consensus_queue.cc:260] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:49.298297  2034 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:49.304235 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:49.304334 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:49.305581 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:49.305680 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:49.306754 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:49.307080  2262 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:49.270488  1926 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:49.268406 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
W20260709 13:09:49.281543 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 91989.8us
I20260709 13:09:49.279904 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:49.306948 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:49.314281 30475 raft_consensus.cc:2410] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:09:49.273723 31115 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:49.315145 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:49.316884 30546 raft_consensus.cc:2393] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 8: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:49.267700 30516 leader_election.cc:304] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:49.321283 30550 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:49.323364 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:49.324740 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.328428 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:49.328787 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:49.329367 30620 raft_consensus.cc:2393] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 9: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:49.330127 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:49.321307 30551 raft_consensus.cc:3060] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:49.277382  2009 consensus_meta.cc:287] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.719s	user 0.005s	sys 0.006s
I20260709 13:09:49.334201 30548 raft_consensus.cc:2410] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:09:49.336059 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:49.338253 30467 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 12.
I20260709 13:09:49.338682 31150 raft_consensus.cc:2468] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
W20260709 13:09:49.341756 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 74245.7us
I20260709 13:09:49.343346 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:09:49.346083 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 72635.7us
I20260709 13:09:49.346902 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:49.348814 30470 raft_consensus.cc:2468] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 7.
I20260709 13:09:49.349781 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:49.350704 30620 raft_consensus.cc:2393] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 13: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:49.352252  2057 raft_consensus.cc:2804] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:49.352679  2057 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.353004  2057 raft_consensus.cc:3060] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:49.354543  2233 raft_consensus.cc:2804] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:49.357946 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:49.359331 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:49.360636 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:49.361428 30475 raft_consensus.cc:3060] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:09:49.361918  2233 raft_consensus.cc:493] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:49.362309  2233 raft_consensus.cc:3060] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:49.363461 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: true dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:49.364286 30620 raft_consensus.cc:3055] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:49.364548 30620 raft_consensus.cc:740] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:49.365653 30620 consensus_queue.cc:260] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:49.274991  1655 consensus_queue.cc:1059] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 13:09:49.376179 30550 raft_consensus.cc:2468] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 9.
I20260709 13:09:49.348973 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:49.380995 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:49.381703 30616 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 9.
I20260709 13:09:49.381175 30546 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:49.392913 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:49.394311 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:49.395623 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:49.396235 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:49.397119 30623 raft_consensus.cc:2393] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 13: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:49.397177 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:49.396365 30622 raft_consensus.cc:3055] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:49.397890 30622 raft_consensus.cc:740] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:49.398741 30622 consensus_queue.cc:260] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:49.399780 30622 raft_consensus.cc:3060] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:49.383396 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:49.408123 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:49.409286 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:09:49.410233 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.411100 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:49.093547 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:49.419893 30620 raft_consensus.cc:3060] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:49.403553 30542 raft_consensus.cc:2468] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9.
I20260709 13:09:49.445063 30468 raft_consensus.cc:2393] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 11: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:49.447350 30469 raft_consensus.cc:3060] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:49.340631  2009 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:49.443691 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:49.448654 30622 raft_consensus.cc:2468] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 8.
I20260709 13:09:49.449378 30549 raft_consensus.cc:2468] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 11.
I20260709 13:09:49.462543 30620 raft_consensus.cc:2468] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 9.
I20260709 13:09:49.466553 30546 raft_consensus.cc:2410] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:09:49.468578 30516 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:49.469995 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:49.472615 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:49.468241 30543 raft_consensus.cc:1240] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:49.476936 30516 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:49.478196 30516 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:49.480283 30472 raft_consensus.cc:2368] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 9. Current term is 10.
I20260709 13:09:49.481199  2057 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:49.465051 30441 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:49.398947  2233 raft_consensus.cc:515] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:49.484338 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:49.485176  2233 leader_election.cc:290] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:49.485750 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:49.487027 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:09:49.487501 30589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:49.483355 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 179714us
I20260709 13:09:49.483515 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:49.488956 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:49.493743  2258 raft_consensus.cc:2764] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:09:49.494244 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:49.483419  2057 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:49.498301 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:49.498924 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:49.499485 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:49.500212 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:49.500600 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:49.501017 30547 raft_consensus.cc:2393] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 14: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:49.504421 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:49.504679 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:49.505731 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:49.506943 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
W20260709 13:09:49.509994 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 141393us
I20260709 13:09:49.521956 30548 raft_consensus.cc:2393] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 12: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:49.515982  1926 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:49.518386  2244 raft_consensus.cc:2749] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:49.515292  2165 consensus_queue.cc:1059] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:09:49.494550  2258 raft_consensus.cc:2749] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:49.577771 30551 raft_consensus.cc:2468] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 9.
I20260709 13:09:49.578292 30475 raft_consensus.cc:2468] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
I20260709 13:09:49.576287 30473 raft_consensus.cc:2468] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 10.
I20260709 13:09:49.504418 30472 raft_consensus.cc:1240] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:49.595996 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:49.596971 30469 raft_consensus.cc:2410] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:09:49.598734 30545 raft_consensus.cc:1240] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:49.600822 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:49.600065 30543 raft_consensus.cc:1240] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:49.601822  2230 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:49.605453  2065 raft_consensus.cc:3055] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:49.605810 30472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 2373) took 1006 ms. Trace:
I20260709 13:09:49.606599 30622 raft_consensus.cc:1275] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:09:49.603569  2201 consensus_meta.cc:287] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.661s	user 0.009s	sys 0.006s
I20260709 13:09:49.608572 30547 raft_consensus.cc:1240] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:49.623220  2165 raft_consensus.cc:3055] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:09:49.608839  2236 consensus_meta.cc:287] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 1.189s	user 0.015s	sys 0.013s
I20260709 13:09:49.623714  2165 raft_consensus.cc:740] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:49.624148  2236 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:49.625041  2165 consensus_queue.cc:260] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:49.625949 30474 raft_consensus.cc:2393] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 11: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:49.623246  2065 raft_consensus.cc:740] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:49.626782  2009 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:49.627242  2065 consensus_queue.cc:260] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:49.623464  2201 raft_consensus.cc:2749] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:49.627885  2236 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:49.628662  2065 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:49.613965 30542 raft_consensus.cc:1240] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 10. Current term is 11. Ops: []
W20260709 13:09:49.636085  2168 consensus_meta.cc:287] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.593s	user 0.000s	sys 0.015s
W20260709 13:09:49.636385  2088 consensus_meta.cc:287] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 1.114s	user 0.007s	sys 0.014s
I20260709 13:09:49.636735  2168 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:49.598757 30548 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:39952
I20260709 13:09:49.637874 30548 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:49.638284 30548 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:49.643260 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:49.615433 30549 raft_consensus.cc:1240] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:49.621212  2262 raft_consensus.cc:2749] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:49.643916 30621 raft_consensus.cc:3060] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:49.621703  2230 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:49.620620 30471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 932) took 1025 ms. Trace:
I20260709 13:09:49.645953  2230 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:49.618990 30472 rpcz_store.cc:276] 0709 13:09:48.594683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.501403 (+906720us) service_pool.cc:224] Handling call
0709 13:09:49.504044 (+  2641us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:49.600715 (+ 96671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:49.600892 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:49.646162 30471 rpcz_store.cc:276] 0709 13:09:48.572556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.584877 (+ 12321us) service_pool.cc:224] Handling call
0709 13:09:48.585127 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:48.903847 (+318720us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:48.903876 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:48.903916 (+    40us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:48.903951 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:49.523392 (+619441us) spinlock_profiling.cc:243] Waited 318 ms on lock 0x7b54001e1ed4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:49.576410 (+ 53018us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:49.597863 (+ 21453us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":732490496}
I20260709 13:09:49.647598 30472 raft_consensus.cc:1240] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:09:49.649355 30471 raft_consensus.cc:1240] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 9. Current term is 10. Ops: []
W20260709 13:09:49.649678 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:49.650120 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.650311  2242 consensus_queue.cc:1048] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:49.650759 30471 raft_consensus.cc:1275] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:49.651605 30622 raft_consensus.cc:1240] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:49.651911  1926 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:49.652873 30473 raft_consensus.cc:1275] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:09:49.655241 30468 raft_consensus.cc:2393] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 13: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
W20260709 13:09:49.656788 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 178792us
I20260709 13:09:49.636833  2088 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:49.656121 30548 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:49.659834 30476 raft_consensus.cc:2468] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 9.
I20260709 13:09:49.660588 30546 raft_consensus.cc:1240] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:49.661862  2165 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:49.662343  1926 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:49.663107  2284 consensus_queue.cc:1059] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:49.663913 30470 raft_consensus.cc:2393] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 10: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:49.664394  2284 raft_consensus.cc:3055] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:49.664778  2284 raft_consensus.cc:740] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:49.665161 30470 raft_consensus.cc:1240] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 8. Current term is 9. Ops: []
W20260709 13:09:49.678440 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.665711  2284 consensus_queue.cc:260] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:49.681725 30441 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:49.790601 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:49.863227 31115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:49.871335 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.688184 30551 raft_consensus.cc:1275] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:09:49.722901 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:49.824937 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 58865.2us
I20260709 13:09:49.693517 30621 raft_consensus.cc:2468] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 12.
I20260709 13:09:49.816250 31151 raft_consensus.cc:1240] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 7. Current term is 9. Ops: [7.9-7.9]
I20260709 13:09:49.680447 30471 raft_consensus.cc:1275] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:09:49.756844 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.702028 30469 raft_consensus.cc:1275] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:09:49.766752 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:49.799760 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 68134.9us
I20260709 13:09:49.873170 30548 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:49.659435  2168 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:49.878789 30469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 2400) took 1030 ms. Trace:
W20260709 13:09:49.883615 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.883044 30469 rpcz_store.cc:276] 0709 13:09:48.844835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.619720 (+774885us) service_pool.cc:224] Handling call
0709 13:09:49.692468 (+ 72748us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:49.874942 (+182474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:49.875127 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:49.889299 30473 raft_consensus.cc:1240] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 11 LEADER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:49.745213  2246 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:49.895985 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 55529.7us
I20260709 13:09:49.898936 30470 raft_consensus.cc:1240] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 13. Current term is 14. Ops: []
W20260709 13:09:49.900493 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.886696  2236 raft_consensus.cc:2749] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:49.902489 30624 raft_consensus.cc:1275] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:09:49.904441 31115 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:49.915342 30468 raft_consensus.cc:1240] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:49.916030 30476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2395) took 1072 ms. Trace:
I20260709 13:09:49.917403 30472 raft_consensus.cc:1240] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:49.916435 30476 rpcz_store.cc:276] 0709 13:09:48.843537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.159279 (+315742us) service_pool.cc:224] Handling call
0709 13:09:49.915875 (+756596us) spinlock_profiling.cc:243] Waited 443 ms on lock 0x7b54002189d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:49.915980 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1019129728}
I20260709 13:09:49.922716 30516 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:49.912914 30589 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:49.923460 30467 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60026 (request call id 929) took 1378 ms (client timeout 1598 ms). Trace:
W20260709 13:09:49.927515 30467 rpcz_store.cc:269] 0709 13:09:48.537832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.538397 (+   565us) service_pool.cc:224] Handling call
0709 13:09:49.908115 (+1369718us) spinlock_profiling.cc:243] Waited 543 ms on lock 0x7b54000438d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:49.916534 (+  8419us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1248279936}
W20260709 13:09:49.981036 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 93359.4us
I20260709 13:09:49.982374  2057 consensus_queue.cc:1048] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
W20260709 13:09:49.985023  2300 log.cc:927] Time spent T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 13:09:49.924688  2168 raft_consensus.cc:2804] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:09:49.989305 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 96178.2us
I20260709 13:09:49.988641 30474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2378) took 1389 ms. Trace:
W20260709 13:09:49.994062 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 402330us
I20260709 13:09:49.993405 30474 rpcz_store.cc:276] 0709 13:09:48.598956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.617257 (+ 18301us) service_pool.cc:224] Handling call
0709 13:09:49.927210 (+1309953us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b5400028fd4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:49.988579 (+ 61369us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2303424768}
I20260709 13:09:49.914251  2246 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:49.991938  2072 raft_consensus.cc:2804] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:50.002383 30590 leader_election.cc:304] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:50.008483 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:49.997988  2034 raft_consensus.cc:2749] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:49.996574  2088 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:50.013043 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:50.013927 30476 raft_consensus.cc:2410] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:09:49.998718  2168 raft_consensus.cc:697] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 12 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:50.002564  2072 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:50.016381  2072 raft_consensus.cc:3060] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:50.016805 30467 raft_consensus.cc:3055] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:50.017194 30467 raft_consensus.cc:740] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:50.017314 30617 raft_consensus.cc:3060] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:50.020848 30589 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:50.021937  2284 raft_consensus.cc:3060] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:50.027743  1926 raft_consensus.cc:2804] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:50.033776  1926 raft_consensus.cc:697] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:50.035233  1926 consensus_queue.cc:237] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:50.038228  2180 raft_consensus.cc:2804] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:50.038692  2180 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:50.039057  2180 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:50.047801 30516 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:50.043030 30467 consensus_queue.cc:260] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:50.050773 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:50.053234 30472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 1949) took 1153 ms. Trace:
I20260709 13:09:50.053719 30472 rpcz_store.cc:276] 0709 13:09:48.900253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.650620 (+750367us) service_pool.cc:224] Handling call
0709 13:09:49.916007 (+265387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:49.918575 (+  2568us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.052977 (+134402us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b54002189d0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f678ad 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:50.053151 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":609595776}
I20260709 13:09:50.077124 30467 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:50.077611 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:50.055622  2165 raft_consensus.cc:493] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.079923  2165 raft_consensus.cc:515] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:50.056135  2088 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:50.082015 30617 raft_consensus.cc:2468] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 9.
I20260709 13:09:50.082430 30475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 2390) took 1397 ms. Trace:
I20260709 13:09:50.085309 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:50.071501  2230 raft_consensus.cc:2749] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:50.083379 31115 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:50.089394 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:50.089812 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:50.090301 30472 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:50.095916 31151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48412 (request call id 784) took 1522 ms. Trace:
W20260709 13:09:50.092664 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 58744.3us
I20260709 13:09:50.096029 30476 raft_consensus.cc:2468] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 11.
I20260709 13:09:50.097932 31151 rpcz_store.cc:276] 0709 13:09:48.573545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.588432 (+ 14887us) service_pool.cc:224] Handling call
0709 13:09:48.610978 (+ 22546us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:49.892600 (+1281622us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.092154 (+199554us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54005c3d54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:50.095851 (+  3697us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2558454144}
I20260709 13:09:50.082904 30475 rpcz_store.cc:276] 0709 13:09:48.684674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.600411 (+915737us) service_pool.cc:224] Handling call
0709 13:09:49.666126 (+ 65715us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:49.680823 (+ 14697us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:49.911789 (+230966us) log.cc:844] Serialized 14 byte log entry
0709 13:09:50.082023 (+170234us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:50.082092 (+    69us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:50.082159 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.082249 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:50.082363 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":326460,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"thread_start_us":190868,"threads_started":2}
W20260709 13:09:50.091118 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 75056.5us
I20260709 13:09:50.105558  2246 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:50.106027  2304 log.cc:927] Time spent T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:09:50.106397 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 80833.4us
W20260709 13:09:50.093350  2301 log.cc:927] Time spent T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:09:50.107285 30441 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:50.097564  2057 raft_consensus.cc:2804] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:50.110054 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:50.110105 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:50.111936 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:50.074100  2168 consensus_queue.cc:237] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:50.114866 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:50.113293 30516 leader_election.cc:304] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:50.118136 30476 raft_consensus.cc:3055] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:50.087699  2201 consensus_queue.cc:1059] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:09:50.118544 30476 raft_consensus.cc:740] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:50.119591 30470 raft_consensus.cc:3055] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:50.093176  2088 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:50.124377 30470 raft_consensus.cc:740] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:50.120447 31116 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:50.124297 30476 consensus_queue.cc:260] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:50.129849 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.132244 30476 raft_consensus.cc:3060] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:50.134099 30472 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 14.
I20260709 13:09:50.132961  2309 consensus_queue.cc:1059] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:09:50.136053  2230 raft_consensus.cc:2749] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:50.133723 30589 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:50.125594  2098 raft_consensus.cc:2749] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:50.124341  2057 raft_consensus.cc:697] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 9 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:50.140116 30476 raft_consensus.cc:1275] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:09:50.140595 30476 pending_rounds.cc:85] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326: Aborting all ops after (but not including) 6
I20260709 13:09:50.140847 30476 pending_rounds.cc:107] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:09:50.143781 30476 raft_consensus.cc:2889] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:50.146116 30622 raft_consensus.cc:2468] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 11.
I20260709 13:09:50.147720 30441 leader_election.cc:304] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:50.148466 30591 leader_election.cc:336] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.684s (SENT)
W20260709 13:09:50.148912 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.151165  2088 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:50.144292 30467 raft_consensus.cc:1275] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:09:50.156868 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 46134.3us
W20260709 13:09:50.155273 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 106282us
I20260709 13:09:50.158464 31115 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:50.164656 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:50.163100  2242 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:50.156811  2165 leader_election.cc:290] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:50.169901 30591 leader_election.cc:336] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.694s (SENT)
W20260709 13:09:50.169919 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 51740.7us
I20260709 13:09:50.170332 30591 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:50.166116  2201 raft_consensus.cc:2749] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:50.181483 30470 consensus_queue.cc:260] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:50.182500 30470 raft_consensus.cc:3060] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:50.183135  2051 raft_consensus.cc:2804] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:50.183555  2051 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.184007  2051 raft_consensus.cc:3060] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:50.179317  2242 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:50.189618  2009 raft_consensus.cc:3055] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:50.190042  2009 raft_consensus.cc:740] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:50.190997  2009 consensus_queue.cc:260] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:50.196918  1926 raft_consensus.cc:2749] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:50.197757  2009 raft_consensus.cc:3060] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:50.171489  2057 consensus_queue.cc:237] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:50.200431 30440 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:50.164939  2098 consensus_queue.cc:1059] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
W20260709 13:09:50.201893 30440 leader_election.cc:336] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Timed out: RequestConsensusVote RPC to 127.28.173.2:34733 timed out after 2.092s (SENT)
I20260709 13:09:50.202080  2236 raft_consensus.cc:3055] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:50.202373 30440 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:50.202685  2236 raft_consensus.cc:740] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:50.204083  2201 raft_consensus.cc:2749] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:50.203919  2236 consensus_queue.cc:260] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:50.206341  2236 raft_consensus.cc:3060] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:50.203938  2262 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:09:50.206740 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 59145us
I20260709 13:09:50.201915  2098 raft_consensus.cc:2804] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:09:50.212188 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.166069  2072 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:50.176025  2088 raft_consensus.cc:2804] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:09:50.224328 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 111144us
W20260709 13:09:50.221786 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:50.232424 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 52801.5us
I20260709 13:09:50.231197  2310 raft_consensus.cc:2804] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:50.239497  2206 raft_consensus.cc:3055] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:50.240042  2206 raft_consensus.cc:740] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:50.241042  2206 consensus_queue.cc:260] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:50.242142  2206 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:50.244434  2180 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:50.250882  2310 raft_consensus.cc:697] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:50.252192  2310 consensus_queue.cc:237] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:50.256734 30589 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:50.262741  2072 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:50.264221  2309 raft_consensus.cc:2804] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:50.264999  2309 raft_consensus.cc:697] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:50.266453  2309 consensus_queue.cc:237] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:50.268752 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 107347us
I20260709 13:09:50.231907  2088 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.271637 30589 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:50.250569  2051 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:50.263558  2072 consensus_queue.cc:1059] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:09:50.258810  2180 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:50.276503  2088 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:50.229592  2262 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:50.300858  2262 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:50.301380  2313 raft_consensus.cc:2804] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:50.301973  2313 raft_consensus.cc:697] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:50.302939  2313 consensus_queue.cc:237] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:50.308704  2242 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:50.308089 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 140900us
I20260709 13:09:50.286623  2072 raft_consensus.cc:3055] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:50.315476  2072 raft_consensus.cc:740] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:50.316068 31116 leader_election.cc:304] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:50.316489  2072 consensus_queue.cc:260] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:50.294893 30440 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:50.318113  2072 raft_consensus.cc:3060] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:50.318960 31116 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:50.317028  2242 raft_consensus.cc:2804] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:09:50.286849  2305 log.cc:927] Time spent T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
W20260709 13:09:50.321012 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 60041.6us
W20260709 13:09:50.322012 30591 leader_election.cc:336] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.703s (SENT)
I20260709 13:09:50.322680 30591 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:50.323318  2206 consensus_queue.cc:1059] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:50.323837  2316 raft_consensus.cc:2749] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:50.324862  2316 raft_consensus.cc:3055] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:50.325297  2316 raft_consensus.cc:740] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:50.325500 30590 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:50.326702  2206 raft_consensus.cc:2804] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:50.326397  2316 consensus_queue.cc:260] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:50.327374  2206 raft_consensus.cc:697] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:50.328285  2316 raft_consensus.cc:3060] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:50.328775  2206 consensus_queue.cc:237] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:50.338369 30591 leader_election.cc:336] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.801s (SENT)
W20260709 13:09:50.339082 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.340090 30591 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:50.320958  2098 raft_consensus.cc:697] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 13 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:50.320863  2242 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:09:50.372331 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.364686  2180 raft_consensus.cc:2749] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:09:50.375460 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 104052us
I20260709 13:09:50.380216  2051 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:50.375250  2284 raft_consensus.cc:2804] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:50.383375  2284 raft_consensus.cc:697] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 14 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:50.371942  2242 raft_consensus.cc:3060] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:50.384389  2284 consensus_queue.cc:237] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:50.363277  2246 consensus_queue.cc:1048] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:09:50.390329  2098 consensus_queue.cc:237] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:50.390991 30589 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
W20260709 13:09:50.393213 30591 leader_election.cc:336] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.814s (SENT)
I20260709 13:09:50.408634 30591 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:50.410579  2319 raft_consensus.cc:2749] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:50.392555  2065 consensus_queue.cc:1048] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
W20260709 13:09:50.411480 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.414661  1926 raft_consensus.cc:2749] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:09:50.414832 30591 leader_election.cc:336] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.861s (SENT)
I20260709 13:09:50.425925 30591 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:50.416886 30589 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:50.420826  2088 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:50.430991  2088 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:50.431881 30470 raft_consensus.cc:1275] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:09:50.438588 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.448129  2314 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:50.448849  2314 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:50.451220  2314 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:50.461387 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.461258  1926 raft_consensus.cc:2749] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:50.465085 30441 leader_election.cc:400] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Vote denied by peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453) with higher term. Message: Invalid argument: T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 11. Current term is 12.
I20260709 13:09:50.462518  2242 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:50.470685 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:50.470566 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 55816.4us
W20260709 13:09:50.471455 30591 leader_election.cc:336] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.871s (SENT)
I20260709 13:09:50.471853 30591 leader_election.cc:304] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:50.470598  2309 raft_consensus.cc:2749] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:50.486738  2242 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:50.491268 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:50.511226  2321 log.cc:927] Time spent T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.172s	user 0.000s	sys 0.008s
I20260709 13:09:50.517568 30516 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:50.518491  2230 raft_consensus.cc:2804] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:50.518893  2230 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:50.519240  2230 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:50.529410 30516 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:50.532881 30516 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:50.556849 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 85424.9us
W20260709 13:09:50.560366 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 92653.5us
W20260709 13:09:50.574476 30591 leader_election.cc:336] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.040s (SENT)
W20260709 13:09:50.575773 30591 leader_election.cc:336] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.052s (SENT)
W20260709 13:09:50.563800 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 268995us
I20260709 13:09:50.564101  2328 raft_consensus.cc:2749] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:50.578380  2328 raft_consensus.cc:2804] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:50.578869  2328 raft_consensus.cc:697] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 8 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:50.579845  2328 consensus_queue.cc:237] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:50.568929 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:50.461448 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 44652.1us
W20260709 13:09:50.588621 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 331459us
W20260709 13:09:50.590129 30589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:50.591179 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 58376.5us
I20260709 13:09:50.592031  2316 raft_consensus.cc:2749] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:50.592792  2316 consensus_queue.cc:1059] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:50.594416  2316 consensus_queue.cc:1059] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:50.595485  2316 raft_consensus.cc:493] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.595947  2319 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.596405  2319 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:50.599270  2319 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:50.599838  2319 raft_consensus.cc:3055] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:50.600195  2319 raft_consensus.cc:740] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:50.601248  2319 consensus_queue.cc:260] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:50.602698  2319 raft_consensus.cc:3060] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:50.612293  1926 raft_consensus.cc:3055] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:50.612739  1926 raft_consensus.cc:740] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:50.611303  2316 raft_consensus.cc:515] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:50.613701  1926 consensus_queue.cc:260] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:50.614893  1926 raft_consensus.cc:3060] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:50.614974  2316 leader_election.cc:290] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:50.624491 30543 raft_consensus.cc:1240] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:50.629909 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:50.630496 30543 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:09:50.634130 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:50.634863 30547 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:50.647794 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:50.648643 30545 raft_consensus.cc:2368] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 9. Current term is 10.
I20260709 13:09:50.649497 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:50.650398 30545 raft_consensus.cc:2393] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 7: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:50.651369 30547 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 11.
I20260709 13:09:50.657840 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:50.658821 30549 raft_consensus.cc:2393] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 9: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:50.659741 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:50.660583 30549 raft_consensus.cc:2393] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 13: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:50.662046 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:50.656647 30516 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:50.666754 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:50.667483 30618 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:50.668723 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:50.669322 30617 raft_consensus.cc:2468] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 7.
I20260709 13:09:50.670820 30546 raft_consensus.cc:1275] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 13:09:50.671195 30546 pending_rounds.cc:85] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd: Aborting all ops after (but not including) 10
I20260709 13:09:50.671429 30546 pending_rounds.cc:107] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:09:50.671643 30546 raft_consensus.cc:2889] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:50.675295 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.676151 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:50.676719 30547 raft_consensus.cc:2393] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 13: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:50.677508  2328 raft_consensus.cc:2804] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:50.689623 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:50.690688 30544 raft_consensus.cc:2393] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 6: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:50.688170  2335 consensus_queue.cc:1059] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:09:50.692929 30543 raft_consensus.cc:2468] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 10.
I20260709 13:09:50.695334 30618 raft_consensus.cc:2468] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 10.
I20260709 13:09:50.718291  2335 raft_consensus.cc:3055] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:50.720398  2335 raft_consensus.cc:740] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:50.720547  2340 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.724099  2328 raft_consensus.cc:697] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 9 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:50.724350  2335 consensus_queue.cc:260] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:50.725576  2328 consensus_queue.cc:237] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:50.725957  2335 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:50.741074  1926 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:50.741923  1926 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:50.723408  2340 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:50.744869  1926 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:50.746007  2340 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:50.753896 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:09:50.755618 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 44830.6us
I20260709 13:09:50.761021 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:50.761795 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:50.760362 30625 raft_consensus.cc:2468] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 10.
I20260709 13:09:50.762573 31150 raft_consensus.cc:2393] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 13: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:50.764523 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:50.766000 31143 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:50.772325 30516 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:50.774789 31143 raft_consensus.cc:2468] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 10.
I20260709 13:09:50.777439 30516 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:50.778339  2341 raft_consensus.cc:2804] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:50.779093  2341 raft_consensus.cc:697] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 10 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:50.780490  2340 raft_consensus.cc:2804] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:50.780079  2341 consensus_queue.cc:237] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:50.781072  2340 raft_consensus.cc:697] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 10 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:50.783232  2340 consensus_queue.cc:237] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:50.813036 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:50.813128 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:50.813753 30624 raft_consensus.cc:2468] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 7.
I20260709 13:09:50.814381 30621 raft_consensus.cc:2393] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 14: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
W20260709 13:09:50.821642  2324 log.cc:927] Time spent T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.311s	user 0.000s	sys 0.006s
I20260709 13:09:50.824517 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:50.826941 30516 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:50.827654  2328 raft_consensus.cc:2804] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:50.828085  2328 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:50.828454  2328 raft_consensus.cc:3060] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:50.831614  2230 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:50.834160  2230 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:50.837285  2328 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:50.839664 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.841355  2328 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:50.841449 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:50.842567 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:50.843290 30550 raft_consensus.cc:1240] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:50.844233 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:50.844913 30547 raft_consensus.cc:2393] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 10: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:50.845023 30549 raft_consensus.cc:1275] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:09:50.845661 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:50.846215 30546 raft_consensus.cc:3060] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:50.846805 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:50.847460 30549 raft_consensus.cc:2393] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 8: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:50.848742 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:50.849040 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:50.849346 31143 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:50.850325 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:50.850898 30543 raft_consensus.cc:2468] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:09:50.856199 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:50.856617 31143 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 10.
I20260709 13:09:50.856717 30625 raft_consensus.cc:3060] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:50.858110 30549 raft_consensus.cc:1275] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:50.859455 30543 raft_consensus.cc:1275] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:09:50.864832  1926 consensus_queue.cc:1059] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:50.865813  1926 raft_consensus.cc:3055] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:50.866228  1926 raft_consensus.cc:740] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:50.862458 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:50.868049 30621 raft_consensus.cc:2393] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 10: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:50.869418 30546 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
I20260709 13:09:50.873093 30625 raft_consensus.cc:2468] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 8.
I20260709 13:09:50.875892 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:50.876286 30516 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:50.876627 31146 raft_consensus.cc:2393] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 9: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:50.877058  2328 raft_consensus.cc:2804] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:50.877537  2328 raft_consensus.cc:697] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 8 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:50.878229  1926 consensus_queue.cc:260] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:50.878435  2328 consensus_queue.cc:237] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:50.883877 30370 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47208 (request call id 187) took 30699 ms (client timeout 15000 ms). Trace:
I20260709 13:09:50.887672  2310 consensus_queue.cc:1048] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:50.882143  1926 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:50.889726 30589 leader_election.cc:304] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:50.890479  2310 raft_consensus.cc:2804] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:50.890856  2310 raft_consensus.cc:493] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.891185  2310 raft_consensus.cc:3060] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:50.885807 30370 rpcz_store.cc:269] 0709 13:09:20.184748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.185051 (+   303us) service_pool.cc:224] Handling call
0709 13:09:50.883655 (+30698604us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:46.405801 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:46.406457 (+   656us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:46.406509 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:09:46.406527 (+    18us) tablet.cc:662] Decoding operations
0709 13:09:46.407603 (+  1076us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:46.407656 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:46.407682 (+    26us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:09:46.408421 (+   739us) tablet.cc:701] Row locks acquired
0709 13:09:46.408437 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:09:46.408566 (+   129us) write_op.cc:270] Start()
0709 13:09:46.408676 (+   110us) write_op.cc:276] Timestamp: P: 1783602586408521 usec, L: 0
0709 13:09:46.408697 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:09:46.409312 (+   615us) log.cc:844] Serialized 4012 byte log entry
0709 13:09:47.984833 (+1575521us) op_driver.cc:464] REPLICATION: finished
0709 13:09:48.077929 (+ 93096us) spinlock_profiling.cc:243] Waited 2.88 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc780e5e0ac 00007fc789cb8ab9 00007fc780e7a69b 00007fc780e7893f 00007fc780e7ac02 00007fc78799eef0
0709 13:09:48.255493 (+177564us) write_op.cc:301] APPLY: starting
0709 13:09:48.264423 (+  8930us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:48.349166 (+ 84743us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:48.349194 (+    28us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:48.534186 (+184992us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:48.594808 (+ 60622us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=20
0709 13:09:48.606921 (+ 12113us) write_op.cc:312] APPLY: finished
0709 13:09:48.641337 (+ 34416us) log.cc:844] Serialized 77 byte log entry
0709 13:09:48.641511 (+   174us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:48.641633 (+   122us) write_op.cc:454] Released schema lock
0709 13:09:48.641682 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:48.642075 (+   393us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:48.642106 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3216537,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":232264,"apply.run_cpu_time_us":5244,"apply.run_wall_time_us":401687,"num_ops":10,"prepare.queue_time_us":960817,"prepare.run_cpu_time_us":24973,"prepare.run_wall_time_us":587709,"raft.queue_time_us":704381,"raft.run_cpu_time_us":12525,"raft.run_wall_time_us":151006,"replication_time_us":1576013,"spinlock_wait_cycles":6615296,"thread_start_us":1829161,"threads_started":4,"wal-append.queue_time_us":868806,"wal-append.run_cpu_time_us":21197,"wal-append.run_wall_time_us":2369786}]]}
I20260709 13:09:50.897522  2319 consensus_queue.cc:1048] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:50.911702 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:50.912614 30542 raft_consensus.cc:2393] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 10: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
W20260709 13:09:50.914371 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.899160  1926 consensus_queue.cc:1048] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:50.898731 30589 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:51.060678 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 161979us
I20260709 13:09:51.061487 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:51.062146 30623 raft_consensus.cc:2468] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 9.
W20260709 13:09:51.062423 30589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.901698  2310 raft_consensus.cc:515] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:51.162668  2310 leader_election.cc:290] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:50.931253 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:09:50.940514 31116 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.021s	sys 0.013s
I20260709 13:09:50.984229 30362 maintenance_manager.cc:643] P 045170a35afe4845987482e49e9e1eb9: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 3.371s	user 0.165s	sys 0.062s Metrics: {"bytes_written":30236,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":44401,"dirs.run_cpu_time_us":383,"dirs.run_wall_time_us":1490,"drs_written":1,"lbm_read_time_us":564,"lbm_reads_lt_1ms":4,"lbm_write_time_us":7946,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":33,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":57984,"threads_started":2,"update_count":10,"wal-append.queue_time_us":12424}
W20260709 13:09:51.164029 31116 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.021s	sys 0.014s
W20260709 13:09:51.050773 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:51.164377 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 801591us
W20260709 13:09:51.059301 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.166666 30363 maintenance_manager.cc:419] P 045170a35afe4845987482e49e9e1eb9: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9969 bytes on disk
I20260709 13:09:51.074046 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:51.168776 30590 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:51.168912 30362 maintenance_manager.cc:643] P 045170a35afe4845987482e49e9e1eb9: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":318,"lbm_reads_lt_1ms":4}
I20260709 13:09:51.084393  2034 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.086190 31147 raft_consensus.cc:1240] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 11 LEADER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:09:51.170122  2340 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:51.110226 31114 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:51.170691  2340 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:51.170154  2034 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:51.171473 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 61325.6us
I20260709 13:09:51.172809  2340 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:51.173359 31114 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:51.173480  2034 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:51.174507 31114 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:51.175361 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:51.175976 30543 raft_consensus.cc:3060] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:51.127622  2088 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.176625  2088 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:51.178656  2088 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:51.134222 30516 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:51.140067 30625 raft_consensus.cc:1275] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:09:51.159693 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:51.205047 30591 leader_election.cc:336] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.833s (SENT)
W20260709 13:09:51.205926 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.163578 30622 raft_consensus.cc:2468] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 11.
I20260709 13:09:51.114761  1926 raft_consensus.cc:2804] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:51.213862  1926 raft_consensus.cc:697] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
W20260709 13:09:51.214466 30360 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 2b207fb799ce4340b29ae053898e0e6c with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica fe2b7d73f8c743c1ba570cfd981c4e79 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
W20260709 13:09:51.215211 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.175906  2165 raft_consensus.cc:2749] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:51.216152  2165 raft_consensus.cc:2804] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:51.216614  2165 raft_consensus.cc:697] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 9 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:51.217458  2165 consensus_queue.cc:237] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:51.134567  2335 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:51.223436  2335 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:51.225605  2335 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:51.196255  2088 raft_consensus.cc:3060] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:51.200742 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:51.229396 30616 raft_consensus.cc:3060] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:51.201855 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:51.187825 30517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:51.234331 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:51.234724 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:51.234998 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:51.235114 30517 leader_election.cc:336] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.624s (SENT)
I20260709 13:09:51.235566 30517 leader_election.cc:304] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:51.237032  2341 raft_consensus.cc:2749] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:51.237190  2262 raft_consensus.cc:2804] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:09:51.233716 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 648859us
I20260709 13:09:51.237691  2262 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:51.238112  2262 raft_consensus.cc:3060] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:51.238214 30440 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:51.238487 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:51.239279 30622 raft_consensus.cc:2393] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 10: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:51.240440 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:51.240563  2318 consensus_queue.cc:1059] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:51.241984 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:51.242648 30619 raft_consensus.cc:2468] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 7.
I20260709 13:09:51.241923  2318 consensus_queue.cc:1048] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:51.243119  2098 raft_consensus.cc:2804] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:51.247388 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:51.248015 30625 raft_consensus.cc:3060] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:51.249280 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:51.214905  1926 consensus_queue.cc:237] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:51.251452 31115 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:51.253726  2325 raft_consensus.cc:2804] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:51.259119 30625 raft_consensus.cc:2468] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 12.
W20260709 13:09:51.260442 30517 leader_election.cc:336] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.678s (SENT)
W20260709 13:09:51.260668 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 126563us
I20260709 13:09:51.260875 30517 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:51.260396  2325 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:51.265693 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:51.269207 31143 raft_consensus.cc:1275] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:51.269035 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:51.270172 30618 raft_consensus.cc:2393] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 10: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:51.270475 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:51.273725 30543 raft_consensus.cc:2468] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7.
I20260709 13:09:51.272635 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:51.278466 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:51.266635  2325 raft_consensus.cc:3060] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:51.280061  2072 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.260754  2319 raft_consensus.cc:2749] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:51.301023 30516 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:51.282402 30622 raft_consensus.cc:1275] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:09:51.268016 31115 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:51.285321 31150 raft_consensus.cc:2468] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 10.
I20260709 13:09:51.272336  2341 raft_consensus.cc:2764] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:09:51.310621 30616 raft_consensus.cc:2468] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 9.
I20260709 13:09:51.282804  2335 raft_consensus.cc:2749] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:51.321624 30621 raft_consensus.cc:2468] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 9.
W20260709 13:09:51.322831 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 63619.2us
W20260709 13:09:51.323833 30517 leader_election.cc:336] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.683s (SENT)
I20260709 13:09:51.324194 30517 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:51.324971  2230 raft_consensus.cc:2749] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:51.304600  2180 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.328948  2180 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:51.330950  2180 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:51.332747  2262 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:51.334955  2262 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:51.336695 30589 leader_election.cc:304] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:51.347261 30517 leader_election.cc:336] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.749s (SENT)
I20260709 13:09:51.347754 30517 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:51.311436  2034 raft_consensus.cc:2749] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:51.347155 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
W20260709 13:09:51.356339 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 782463us
W20260709 13:09:51.359045 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 91112.5us
I20260709 13:09:51.351944 30516 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:51.396924 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:51.305330  2072 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:51.398432 30591 leader_election.cc:336] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.104s (SENT)
I20260709 13:09:51.399678 30591 leader_election.cc:304] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
W20260709 13:09:51.399922 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 86494.2us
I20260709 13:09:51.321240  2340 consensus_queue.cc:1048] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:09:51.362010  2335 raft_consensus.cc:2749] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 8 LEADER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:51.394100  2316 raft_consensus.cc:2804] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:51.405200 30516 leader_election.cc:304] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:51.400738  2328 raft_consensus.cc:2764] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:09:51.411523 30516 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:51.409967 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 234449us
W20260709 13:09:51.412799 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 65596us
I20260709 13:09:51.419334  2366 raft_consensus.cc:2804] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:51.419896  2366 raft_consensus.cc:697] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 12 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
W20260709 13:09:51.421913 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 182410us
I20260709 13:09:51.409474  2341 raft_consensus.cc:2804] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:51.425088 31114 leader_election.cc:400] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 election: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 9. Current term is 10.
I20260709 13:09:51.425732 31114 leader_election.cc:403] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 13:09:51.426658 30517 leader_election.cc:336] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.771s (SENT)
I20260709 13:09:51.408249  2034 consensus_queue.cc:1048] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:09:51.440871 30517 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
W20260709 13:09:51.445257 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 70832.6us
I20260709 13:09:51.446767 30616 raft_consensus.cc:1275] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:09:51.447280  2358 log.cc:927] Time spent T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:09:51.447569  2072 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:51.450011 30517 leader_election.cc:336] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.773s (SENT)
I20260709 13:09:51.450457 30517 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:51.420855  2366 consensus_queue.cc:237] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:51.451646 30624 raft_consensus.cc:1275] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:09:51.453418  2328 raft_consensus.cc:2749] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:51.454252  2328 raft_consensus.cc:2749] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:51.422219  2339 raft_consensus.cc:2804] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:51.466820 30440 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:09:51.474858 30591 leader_election.cc:336] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.550s (SENT)
I20260709 13:09:51.413054  2230 consensus_queue.cc:1048] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:09:51.425832  2201 consensus_queue.cc:1059] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
W20260709 13:09:51.481966 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 57990.4us
I20260709 13:09:51.440598  2341 raft_consensus.cc:697] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 9 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
W20260709 13:09:51.489990 30517 leader_election.cc:336] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.833s (SENT)
I20260709 13:09:51.466116  2339 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:51.490460 30517 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:51.480633  2057 raft_consensus.cc:2749] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 9. Current term is 10.
I20260709 13:09:51.508260  2341 consensus_queue.cc:237] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:51.508249 30517 leader_election.cc:336] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.862s (SENT)
I20260709 13:09:51.512189 30517 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:51.514894  2034 raft_consensus.cc:2749] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:51.516146 30517 leader_election.cc:336] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.902s (SENT)
I20260709 13:09:51.487901  2316 raft_consensus.cc:697] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
W20260709 13:09:51.529531 30589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.493732  2339 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:51.545531 31142 raft_consensus.cc:1240] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 11. Current term is 12. Ops: []
W20260709 13:09:51.546823 30572 debug-util.cc:398] Leaking SignalData structure 0x7b08002fea20 after lost signal to thread 29367
I20260709 13:09:51.547096 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:51.548063 31150 raft_consensus.cc:2393] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 12: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
W20260709 13:09:51.548195 30572 debug-util.cc:398] Leaking SignalData structure 0x7b0800273a20 after lost signal to thread 30408
I20260709 13:09:51.548962 31146 raft_consensus.cc:1240] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 8. Current term is 10. Ops: []
W20260709 13:09:51.549383 30572 debug-util.cc:398] Leaking SignalData structure 0x7b0800244320 after lost signal to thread 30500
I20260709 13:09:51.506217  2165 consensus_queue.cc:1048] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
W20260709 13:09:51.550673 30572 debug-util.cc:398] Leaking SignalData structure 0x7b08002ec360 after lost signal to thread 30575
W20260709 13:09:51.551019 30572 debug-util.cc:398] Leaking SignalData structure 0x7b08002ec3c0 after lost signal to thread 30576
W20260709 13:09:51.553047 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 78205.3us
I20260709 13:09:51.506330  2359 consensus_queue.cc:1048] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:09:51.538715  2309 raft_consensus.cc:2749] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:51.556636 30572 debug-util.cc:398] Leaking SignalData structure 0x7b0800369b40 after lost signal to thread 30649
I20260709 13:09:51.540493  2088 raft_consensus.cc:2749] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:51.560102 30572 debug-util.cc:398] Leaking SignalData structure 0x7b08003a12a0 after lost signal to thread 31175
I20260709 13:09:51.559427  2325 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:51.560431  2284 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.561522  2284 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:51.562172 31148 raft_consensus.cc:1275] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:51.562800 31151 raft_consensus.cc:2393] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 7: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:51.563402  2284 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:51.560811 31146 raft_consensus.cc:1275] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 13:09:51.560411 30572 debug-util.cc:398] Leaking SignalData structure 0x7b0800243d60 after lost signal to thread 31176
I20260709 13:09:51.565390 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:51.566793  2236 raft_consensus.cc:3055] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:51.566910 31150 raft_consensus.cc:1275] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:09:51.567204  2236 raft_consensus.cc:740] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:51.568544 31148 raft_consensus.cc:1275] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:51.568077  2236 consensus_queue.cc:260] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:51.571916 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:51.572403  2236 raft_consensus.cc:3060] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:51.557024  2072 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.573710  2072 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:51.576153  2316 consensus_queue.cc:237] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:51.570627  2310 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.578405  2310 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:51.496037  2369 raft_consensus.cc:2749] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 9 LEADER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:51.587801  2072 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:51.596740  2373 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.597270  2373 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:51.597873  2329 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:09:51.598040 30591 leader_election.cc:336] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.513s (SENT)
W20260709 13:09:51.595191 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.598003  2360 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:51.588272  2057 consensus_queue.cc:1048] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:09:51.600052 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:51.601097 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:51.588403  2366 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:51.603296 31143 raft_consensus.cc:2393] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 10: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
W20260709 13:09:51.603521 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 158576us
I20260709 13:09:51.604290 30590 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
W20260709 13:09:51.607662 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 168884us
W20260709 13:09:51.611658 30517 leader_election.cc:336] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.977s (SENT)
I20260709 13:09:51.617280 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:51.617435 30517 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:51.618718 30517 leader_election.cc:336] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.987s (SENT)
W20260709 13:09:51.619638 30517 leader_election.cc:336] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.994s (SENT)
I20260709 13:09:51.619915  2318 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.612716 31146 raft_consensus.cc:3055] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:51.620565  2318 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:51.621152 31146 raft_consensus.cc:740] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:51.621940 31146 consensus_queue.cc:260] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:51.622848 31146 raft_consensus.cc:3060] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:51.623024  2318 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:51.622750  2366 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:51.614081 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.624073  2034 raft_consensus.cc:3060] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:51.623922  2098 raft_consensus.cc:697] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 11 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
W20260709 13:09:51.624462 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 228017us
I20260709 13:09:51.625180  2098 consensus_queue.cc:237] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:51.623644  2318 raft_consensus.cc:2804] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:51.601220  2329 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:51.630326  2329 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:51.631363  2329 raft_consensus.cc:493] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.599351  2373 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:51.610157  2360 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:51.632280 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:51.634034  2360 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:51.610005  2361 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.634781 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:51.635217  2361 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:51.636245 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:51.636940 30475 raft_consensus.cc:2376] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 12. Re-sending same reply.
I20260709 13:09:51.637320  2361 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:51.608510  2309 consensus_queue.cc:1059] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:09:51.638046 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:09:51.638767 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.639063 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:51.631234  2009 consensus_queue.cc:1059] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:51.633893 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:51.651054 30472 raft_consensus.cc:3060] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:51.639605 30476 raft_consensus.cc:2468] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 6.
W20260709 13:09:51.649477 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 45305.5us
W20260709 13:09:51.650014 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:51.649215 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 179185us
I20260709 13:09:51.635567 30474 raft_consensus.cc:2468] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 11.
I20260709 13:09:51.611379 30516 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:51.674305 31146 raft_consensus.cc:1275] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:09:51.674156 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 62882.9us
W20260709 13:09:51.676985 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:51.678859 30517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.679682 30516 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:51.680102 30471 raft_consensus.cc:1240] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:51.680943 30467 raft_consensus.cc:2468] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 7.
I20260709 13:09:51.682546 30621 raft_consensus.cc:1240] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:51.684762 30624 raft_consensus.cc:1275] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:09:51.686568 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:51.687146 30473 raft_consensus.cc:3060] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:51.688290 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:09:51.695515 30591 leader_election.cc:336] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.418s (SENT)
I20260709 13:09:51.696225 30591 leader_election.cc:304] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
W20260709 13:09:51.697652 30517 leader_election.cc:336] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.077s (SENT)
I20260709 13:09:51.698071 30517 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:51.689527 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:51.702037 30472 raft_consensus.cc:2410] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
W20260709 13:09:51.702868 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 218514us
I20260709 13:09:51.683418  2230 raft_consensus.cc:2804] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:51.705191 31114 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:51.678684  2318 raft_consensus.cc:697] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 9 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
W20260709 13:09:51.714731 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.647855  2369 consensus_queue.cc:1048] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:09:51.699481  2371 raft_consensus.cc:2749] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:51.711530 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:51.719455 30471 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:09:51.655706  2329 raft_consensus.cc:515] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:51.716547 30440 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:51.704116  2325 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:51.716773 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:51.721807 30472 raft_consensus.cc:3060] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:51.717650  2009 consensus_queue.cc:1059] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:09:51.723281  2379 consensus_queue.cc:1048] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:09:51.724054  2318 consensus_queue.cc:237] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:51.724643  2379 consensus_queue.cc:1048] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:51.719552  2236 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.727356  2236 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:51.728490 30517 leader_election.cc:336] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.081s (SENT)
I20260709 13:09:51.729678  2236 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:51.730973 31116 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:51.732156 31116 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:51.733407 31116 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd
W20260709 13:09:51.729709 30517 leader_election.cc:336] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.120s (SENT)
I20260709 13:09:51.711311  2034 raft_consensus.cc:2749] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:51.734721  2336 raft_consensus.cc:2749] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:51.735234  2380 raft_consensus.cc:2749] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:51.686702  2335 consensus_queue.cc:1048] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:09:51.736349  2330 raft_consensus.cc:3055] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:51.737112  2262 raft_consensus.cc:3055] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:51.710238  2057 consensus_queue.cc:1048] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:09:51.737221  2366 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:51.737800 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:51.738219  2331 consensus_queue.cc:1048] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:09:51.738602 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:51.734169  2368 raft_consensus.cc:2749] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:51.730448 30470 raft_consensus.cc:1240] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:51.727675 30468 raft_consensus.cc:3055] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:51.713472  2230 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:51.753656 30473 raft_consensus.cc:2468] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 12.
W20260709 13:09:51.753933 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 74323us
I20260709 13:09:51.789325 30468 raft_consensus.cc:740] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:51.754209 30476 raft_consensus.cc:1275] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:09:51.720320  2374 raft_consensus.cc:2749] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:09:51.798564 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 111709us
W20260709 13:09:51.814678 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.815227 30590 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
W20260709 13:09:51.767732 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 50414.6us
W20260709 13:09:51.776623 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 46926.7us
W20260709 13:09:51.820533 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.823732 30542 raft_consensus.cc:1240] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 8 LEADER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:51.824153 30543 raft_consensus.cc:1240] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:51.818717 30474 raft_consensus.cc:2468] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 10.
I20260709 13:09:51.766626  2262 raft_consensus.cc:740] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:51.757691  2330 raft_consensus.cc:740] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:51.758111  2072 raft_consensus.cc:2749] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:51.845957  2372 raft_consensus.cc:2749] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:51.782547  2329 leader_election.cc:290] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:51.784415  2361 raft_consensus.cc:3055] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:51.849155  2361 raft_consensus.cc:740] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:51.854857  2361 consensus_queue.cc:260] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:51.856251  2361 raft_consensus.cc:3060] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:51.857954  2392 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.858625  2392 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:51.860924  2392 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:51.836486 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:51.862169 30542 raft_consensus.cc:2468] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 10.
I20260709 13:09:51.756335  2314 consensus_queue.cc:1059] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:09:51.864655  2314 raft_consensus.cc:3055] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:51.865157  2314 raft_consensus.cc:740] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:51.865701 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:51.866216  2314 consensus_queue.cc:260] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:51.866336 30547 raft_consensus.cc:2468] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
I20260709 13:09:51.815250  2230 raft_consensus.cc:3060] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:51.780095  2381 raft_consensus.cc:2804] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:51.873811 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:51.756570  2284 raft_consensus.cc:2804] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:51.839076 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:51.876938 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:51.836539  2236 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.840888  2359 consensus_queue.cc:1059] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:51.828266  2009 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.840720  2330 consensus_queue.cc:260] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:51.841701  2367 consensus_queue.cc:1048] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:51.844344  2387 raft_consensus.cc:2804] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:51.892355 30547 raft_consensus.cc:1275] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:09:51.892413  2387 raft_consensus.cc:697] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 10 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:51.893684  2310 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:51.893843  2387 consensus_queue.cc:237] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:51.822266  2380 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.877588 30616 raft_consensus.cc:2468] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 9.
I20260709 13:09:51.897991  2380 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:51.878475 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 182988us
W20260709 13:09:51.899793 30591 leader_election.cc:336] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.522s (SENT)
I20260709 13:09:51.900306 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:51.900967 30548 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 13.
W20260709 13:09:51.901206 30591 leader_election.cc:336] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.439s (SENT)
I20260709 13:09:51.877004 30543 raft_consensus.cc:2393] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 7: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:51.883272 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:51.903407 30470 raft_consensus.cc:2468] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 14.
I20260709 13:09:51.828625  2201 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.885607 30625 raft_consensus.cc:1275] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:09:51.885771 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 51463.5us
I20260709 13:09:51.913704 30467 raft_consensus.cc:1275] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:09:51.888701  2381 raft_consensus.cc:697] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 12 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:51.891240  2376 consensus_queue.cc:1048] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:09:51.892815 30547 pending_rounds.cc:85] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd: Aborting all ops after (but not including) 9
I20260709 13:09:51.836429 30468 consensus_queue.cc:260] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:51.871125  2339 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:51.925345  2339 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:51.926549  2339 consensus_queue.cc:1059] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:51.926896 30590 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:51.927314  2339 raft_consensus.cc:3055] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:51.927690  2339 raft_consensus.cc:740] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
W20260709 13:09:51.928821 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.928499  2339 consensus_queue.cc:260] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:51.929768  2339 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:51.912498 30621 raft_consensus.cc:1275] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:51.930727  2341 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:51.931246  2341 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:51.931732 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:51.933364  2341 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:51.920593 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:51.933707 30617 raft_consensus.cc:1240] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:51.934211  2392 consensus_queue.cc:1048] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:51.934676 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:51.935509 30617 raft_consensus.cc:2410] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:09:51.935572  2392 raft_consensus.cc:2749] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:51.936120 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:51.937630 30589 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:51.938542 30589 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:51.937243 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:51.922127 30547 pending_rounds.cc:107] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:09:51.939850 30547 raft_consensus.cc:2889] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:51.923374 30468 raft_consensus.cc:3060] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:51.929852 30497 debug-util.cc:398] Leaking SignalData structure 0x7b08001225e0 after lost signal to thread 29367
W20260709 13:09:51.941067 30517 leader_election.cc:336] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.195s (SENT)
W20260709 13:09:51.941469 30497 debug-util.cc:398] Leaking SignalData structure 0x7b080011ff60 after lost signal to thread 30408
I20260709 13:09:51.941452 30623 raft_consensus.cc:2468] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 7.
I20260709 13:09:51.941787 30517 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:51.942898 30497 debug-util.cc:398] Leaking SignalData structure 0x7b08002f7b40 after lost signal to thread 30500
W20260709 13:09:51.943171 30497 debug-util.cc:398] Leaking SignalData structure 0x7b08003a3520 after lost signal to thread 30501
W20260709 13:09:51.944355 30497 debug-util.cc:398] Leaking SignalData structure 0x7b08003c0e20 after lost signal to thread 30575
W20260709 13:09:51.944612 30497 debug-util.cc:398] Leaking SignalData structure 0x7b0800391c20 after lost signal to thread 30576
W20260709 13:09:51.945577 30497 debug-util.cc:398] Leaking SignalData structure 0x7b0800344ca0 after lost signal to thread 30649
I20260709 13:09:51.947082 30620 raft_consensus.cc:2468] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9.
I20260709 13:09:51.879932  2284 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:51.910354 30472 raft_consensus.cc:2468] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 12.
I20260709 13:09:51.954371 30467 raft_consensus.cc:1275] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:09:51.954834 30467 pending_rounds.cc:85] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326: Aborting all ops after (but not including) 8
W20260709 13:09:51.954910 30589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.955197 30467 pending_rounds.cc:107] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:09:51.955545 30467 raft_consensus.cc:2889] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:51.957839 30497 debug-util.cc:398] Leaking SignalData structure 0x7b0800396da0 after lost signal to thread 31175
W20260709 13:09:51.958225 30497 debug-util.cc:398] Leaking SignalData structure 0x7b08002692a0 after lost signal to thread 31176
W20260709 13:09:51.958644 30497 debug-util.cc:398] Leaking SignalData structure 0x7b0800276a80 after lost signal to thread 2098
W20260709 13:09:51.958953 30497 debug-util.cc:398] Leaking SignalData structure 0x7b0800359740 after lost signal to thread 2201
W20260709 13:09:51.959229 30497 debug-util.cc:398] Leaking SignalData structure 0x7b0800374440 after lost signal to thread 2236
W20260709 13:09:51.959498 30497 debug-util.cc:398] Leaking SignalData structure 0x7b0800037ae0 after lost signal to thread 2262
I20260709 13:09:51.969129 30625 raft_consensus.cc:3060] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:51.943111 31115 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:51.988483 30471 raft_consensus.cc:2468] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 13.
I20260709 13:09:51.993234 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:09:52.016544 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.016916 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:52.017019 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:09:52.018097 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 77070.9us
I20260709 13:09:51.886540  2236 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:51.962193  2284 raft_consensus.cc:3060] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:52.021158 30517 leader_election.cc:336] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.204s (SENT)
I20260709 13:09:52.021389 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:51.904984  2336 consensus_queue.cc:1059] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.107s
I20260709 13:09:52.024396 30617 raft_consensus.cc:1240] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:51.989524  2072 raft_consensus.cc:2804] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:52.026197 30625 raft_consensus.cc:2468] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 10.
I20260709 13:09:51.903560  2009 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:51.983318  2379 raft_consensus.cc:2804] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:52.028931 30617 raft_consensus.cc:1240] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:51.989917  2034 raft_consensus.cc:2749] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:51.988387  2057 raft_consensus.cc:2804] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:52.036520 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:52.037201 30548 raft_consensus.cc:1240] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:52.012224  2330 raft_consensus.cc:3060] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:52.044278 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:51.921417  2201 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:52.050670  2365 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.051718 30547 raft_consensus.cc:1275] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:09:52.051332  2365 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:52.053916  2365 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:52.054512  2371 raft_consensus.cc:3055] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:52.054891  2371 raft_consensus.cc:740] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:52.054966 30546 raft_consensus.cc:1240] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:52.056579 30545 raft_consensus.cc:1275] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:09:52.059871 30617 raft_consensus.cc:1275] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:52.061916  1926 consensus_queue.cc:1048] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:52.073284  2314 raft_consensus.cc:3060] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:52.073463 31116 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:09:52.050866  2383 log.cc:927] Time spent T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:09:52.078783  2373 raft_consensus.cc:3055] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:52.079236  2373 raft_consensus.cc:740] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:52.080271  2367 raft_consensus.cc:2804] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:52.080804  2367 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.081197  2367 raft_consensus.cc:3060] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:52.082011  2009 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:52.082762  2378 consensus_queue.cc:1048] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:52.015581  2374 consensus_queue.cc:1059] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:09:52.034469  2072 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.075176 31116 leader_election.cc:304] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:52.084904  2072 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:52.023694  2381 consensus_queue.cc:237] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:52.089380  2065 raft_consensus.cc:3055] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:52.089800  2065 raft_consensus.cc:740] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:52.090701  2065 consensus_queue.cc:260] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:51.968992  2262 consensus_queue.cc:260] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:52.098594 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:52.099234 30473 raft_consensus.cc:2468] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 10.
I20260709 13:09:52.100404 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:52.100986 30617 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:52.102926 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:52.103890 31116 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:52.108595 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:52.055694  2371 consensus_queue.cc:260] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:52.115118 30625 raft_consensus.cc:1275] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:09:52.120052 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:52.120420 30547 raft_consensus.cc:1240] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:09:52.122382 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:52.045578  2379 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:52.128181 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.130494 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:52.132866 30623 raft_consensus.cc:2468] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 11.
I20260709 13:09:52.134936 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:52.157992 30550 raft_consensus.cc:2468] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 10.
I20260709 13:09:52.159067 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:52.162595  2366 consensus_queue.cc:1048] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:09:52.164243 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.164677  2366 consensus_queue.cc:1048] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:52.125990  2009 consensus_queue.cc:1059] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:09:52.135991  2329 consensus_queue.cc:1048] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:52.166404  2009 raft_consensus.cc:3055] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:52.166802  2009 raft_consensus.cc:740] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:52.073305 30369 catalog_manager.cc:5697] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 4 to 7, leader changed from cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 7 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:52.170271 31147 raft_consensus.cc:2468] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 10.
I20260709 13:09:52.139292  2331 consensus_queue.cc:1059] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
W20260709 13:09:52.171376 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.171705  2331 raft_consensus.cc:3055] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:52.172168  2331 raft_consensus.cc:740] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:52.140875 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:52.173838 30546 raft_consensus.cc:2468] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 8.
I20260709 13:09:52.155758  2165 raft_consensus.cc:2804] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:52.175315 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:52.175397  2165 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:52.175971 31149 raft_consensus.cc:2468] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 10.
I20260709 13:09:52.139532  2379 raft_consensus.cc:3060] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:52.179009  2371 raft_consensus.cc:3060] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:52.184278  2380 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:52.185945 30441 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:52.192162 30441 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.147068 30468 raft_consensus.cc:1275] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:09:52.198175 30468 pending_rounds.cc:85] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326: Aborting all ops after (but not including) 7
I20260709 13:09:52.172914  2331 consensus_queue.cc:260] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:52.144204 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:52.210686 30625 raft_consensus.cc:2468] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 10.
I20260709 13:09:52.176010  2165 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:52.193454  2236 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:52.123625  2057 raft_consensus.cc:697] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 7 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:52.169808 30369 catalog_manager.cc:5697] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 8 to 12, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 12 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
I20260709 13:09:52.155332 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:52.198598 30468 pending_rounds.cc:107] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:09:52.227237 30468 raft_consensus.cc:2889] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:52.198697 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:52.198282 30441 connection.cc:256] RPC call timeout handler was delayed by -1.5278493730000946s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1703s for a response
W20260709 13:09:52.228176 30441 connection.cc:256] RPC call timeout handler was delayed by -1.2686493730000166s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19910000000000003s for a response
W20260709 13:09:52.228305 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:52.228523 30441 connection.cc:256] RPC call timeout handler was delayed by -1.0940493730000753s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21850000000000003s for a response
W20260709 13:09:52.202680 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 50068.7us
I20260709 13:09:52.224473 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:52.225940 31150 raft_consensus.cc:2468] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 10.
I20260709 13:09:52.146767 30617 raft_consensus.cc:2468] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 10.
W20260709 13:09:52.229382 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.231369 30516 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:52.155129 31116 leader_election.cc:304] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:52.233433 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 78424.8us
I20260709 13:09:52.234692 31116 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:52.236236 31116 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:52.245694 31149 raft_consensus.cc:1240] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:52.247653 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:52.248534 30617 raft_consensus.cc:2393] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 10: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
W20260709 13:09:52.250051 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.263949 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:52.259608 30516 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:52.261186 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:52.265672 30623 raft_consensus.cc:2393] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 10: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:52.210480  2329 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:52.283985 30468 raft_consensus.cc:1275] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:09:52.297359 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:52.249185  2365 raft_consensus.cc:2804] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:52.250644  2359 raft_consensus.cc:2804] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:52.257212  2335 raft_consensus.cc:2804] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:52.303315 31147 raft_consensus.cc:1240] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 12 LEADER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:09:52.306140 30474 raft_consensus.cc:1240] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 10. Current term is 11. Ops: []
W20260709 13:09:52.317342 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 57112.5us
I20260709 13:09:52.167622  2009 consensus_queue.cc:260] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:52.280989  2201 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:52.280896  1926 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.298076  2331 raft_consensus.cc:3060] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:52.306802  2335 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:52.338567 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 243406us
W20260709 13:09:52.365332 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:52.380906 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:52.409873 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:52.410568 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 458484us
W20260709 13:09:52.394951 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 135450us
W20260709 13:09:52.397500 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 87964us
I20260709 13:09:52.268244  2336 consensus_queue.cc:1048] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:09:52.262324  2328 consensus_queue.cc:1048] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:09:52.402331 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:52.247778  2314 consensus_queue.cc:1048] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
W20260709 13:09:52.440258 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.297909  2329 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:52.421917 30516 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:52.306548  2034 consensus_queue.cc:1048] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.104s
I20260709 13:09:52.444810 31114 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:52.451435 30591 leader_election.cc:336] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.885s (SENT)
W20260709 13:09:52.452174 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.452047 30591 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:52.415717  2335 raft_consensus.cc:3060] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:52.412842  2325 raft_consensus.cc:2804] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:09:52.468575 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 162955us
W20260709 13:09:52.489945 30591 leader_election.cc:336] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.912s (SENT)
I20260709 13:09:52.448621  2330 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:52.505900 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.411320  1926 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:52.514770 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:52.515759 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.490492  2316 raft_consensus.cc:2749] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:09:52.501389  2230 consensus_meta.cc:287] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.625s	user 0.007s	sys 0.004s
I20260709 13:09:52.493412  2319 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:52.544800 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 89934.8us
I20260709 13:09:52.452481  2366 consensus_queue.cc:1048] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:09:52.544536 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:52.501219  2412 raft_consensus.cc:2804] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:52.492060  2381 consensus_queue.cc:1048] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:09:52.560959 30441 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:52.561362 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 113088us
I20260709 13:09:52.568598  2376 consensus_queue.cc:1048] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:52.443336  2057 consensus_queue.cc:237] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:52.528859  2365 raft_consensus.cc:697] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 12 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:52.512254  2330 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:52.552066  2377 raft_consensus.cc:2804] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:09:52.586763 30517 leader_election.cc:336] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.478s (SENT)
W20260709 13:09:52.574810 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 54336.2us
I20260709 13:09:52.592921  2325 raft_consensus.cc:493] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:09:52.597620 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.607055  2318 raft_consensus.cc:2749] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:52.607575 30440 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:52.608065  2318 consensus_queue.cc:1059] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:52.608489 30440 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:52.609476  2318 raft_consensus.cc:2804] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:52.609730  2360 raft_consensus.cc:3055] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:52.610033  2318 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.610263  2360 raft_consensus.cc:740] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:52.610610  2318 raft_consensus.cc:3060] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:52.573498  2372 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.555332  2412 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:52.562778  2328 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.549190  2230 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:52.634188  2329 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:52.551483  2319 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:52.604378  2377 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.612836  2325 raft_consensus.cc:3060] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:52.599912  2416 raft_consensus.cc:2804] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:52.611248  2360 consensus_queue.cc:260] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:52.621294  2415 raft_consensus.cc:2749] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:52.660732  1926 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:52.665148 30549 raft_consensus.cc:1240] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:52.659222  2418 raft_consensus.cc:2804] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:52.624804  2412 raft_consensus.cc:3060] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:52.647871  2377 raft_consensus.cc:3060] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:52.621518  2088 consensus_queue.cc:1048] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:09:52.674655  2314 consensus_queue.cc:1059] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:52.675856  2416 raft_consensus.cc:697] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 10 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:52.677021 30441 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
W20260709 13:09:52.679600 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:52.675906  2401 log.cc:927] Time spent T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
I20260709 13:09:52.631567  2372 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:52.652446  2367 consensus_meta.cc:287] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.571s	user 0.009s	sys 0.002s
W20260709 13:09:52.682703 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 115423us
W20260709 13:09:52.656867 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 70133.3us
W20260709 13:09:52.759164 30517 leader_election.cc:336] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.538s (SENT)
I20260709 13:09:52.680096 30617 raft_consensus.cc:1275] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:09:52.636202  2328 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:52.684209  2418 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:52.769487 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.636782  2359 raft_consensus.cc:697] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 13 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
W20260709 13:09:52.688623  2395 log.cc:927] Time spent T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
I20260709 13:09:52.768009  2380 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:52.780891 30517 leader_election.cc:336] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.573s (SENT)
I20260709 13:09:52.783432 30441 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:52.787874 30625 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.005s	sys 0.008s
W20260709 13:09:52.789659 30625 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.006s	sys 0.008s
I20260709 13:09:52.776753  2418 raft_consensus.cc:3060] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:52.800782 30616 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.002s	sys 0.013s
I20260709 13:09:52.801494 30470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 967) took 1075 ms. Trace:
I20260709 13:09:52.772980  2360 raft_consensus.cc:3060] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:52.781023  2072 consensus_meta.cc:287] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.695s	user 0.010s	sys 0.000s
I20260709 13:09:52.814520 30470 rpcz_store.cc:276] 0709 13:09:51.725809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.904206 (+178397us) service_pool.cc:224] Handling call
0709 13:09:51.928782 (+ 24576us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:51.929096 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:51.929121 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:51.929529 (+   408us) log.cc:844] Serialized 26 byte log entry
0709 13:09:52.210221 (+280692us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:52.512652 (+302431us) log.cc:844] Serialized 14 byte log entry
0709 13:09:52.512860 (+   208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:52.512945 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:52.801286 (+288341us) raft_consensus.cc:1685] finished
0709 13:09:52.801305 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:52.801438 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10513,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":41457,"thread_start_us":554728,"threads_started":2,"wal-append.queue_time_us":484581}
W20260709 13:09:52.791783 31148 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.000s	sys 0.012s
W20260709 13:09:52.817641 31149 consensus_meta.cc:287] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.518s	user 0.010s	sys 0.000s
I20260709 13:09:52.767558  2367 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:52.823275 31149 raft_consensus.cc:2468] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 10.
W20260709 13:09:52.821213 31148 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.000s	sys 0.013s
W20260709 13:09:52.824312 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 402479us
W20260709 13:09:52.817240 30616 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.002s	sys 0.014s
W20260709 13:09:52.825430 30517 leader_election.cc:336] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.660s (SENT)
I20260709 13:09:52.825865 30517 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
W20260709 13:09:52.830742 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 47374.7us
I20260709 13:09:52.831903 30441 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:52.784812  2387 consensus_queue.cc:1059] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:09:52.788559  2331 consensus_queue.cc:1059] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:09:52.787513  2329 consensus_queue.cc:1059] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:09:52.670908 30369 catalog_manager.cc:5697] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 7 to 11, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 11 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:09:52.813421  1926 consensus_queue.cc:1059] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:09:52.773044  2365 consensus_queue.cc:237] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:52.872084 30619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 939) took 1052 ms. Trace:
I20260709 13:09:52.787180  2380 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:52.872493 30619 rpcz_store.cc:276] 0709 13:09:51.819773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.822295 (+  2522us) service_pool.cc:224] Handling call
0709 13:09:51.826297 (+  4002us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:51.830627 (+  4330us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:51.830668 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:51.845175 (+ 14507us) log.cc:844] Serialized 52 byte log entry
0709 13:09:51.989722 (+144547us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:51.989761 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:51.989825 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:52.871876 (+882051us) raft_consensus.cc:1685] finished
0709 13:09:52.871897 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:52.872028 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":517,"raft.queue_time_us":4380,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":18160,"thread_start_us":144160,"threads_started":1,"wal-append.queue_time_us":451386}
W20260709 13:09:52.886608 30591 leader_election.cc:336] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.111s (SENT)
I20260709 13:09:52.897218 30476 raft_consensus.cc:1275] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:09:52.905079 30544 raft_consensus.cc:1275] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:09:52.829300  2072 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:52.908993 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 45901us
I20260709 13:09:52.909453 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:09:52.912674 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 80848.7us
W20260709 13:09:52.914475 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 89071.2us
W20260709 13:09:52.915649 30517 leader_election.cc:336] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.630s (SENT)
I20260709 13:09:52.885288  2373 consensus_queue.cc:260] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:52.919203  2373 raft_consensus.cc:3060] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:52.876107  2330 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:52.885303  2390 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.928974 30441 leader_election.cc:304] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:52.940486 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:52.943692 30542 raft_consensus.cc:1240] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:52.956097 30619 raft_consensus.cc:1275] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:09:52.924722  2230 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:52.961248 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 74661.8us
W20260709 13:09:52.964856 30591 leader_election.cc:336] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.114s (SENT)
W20260709 13:09:52.932034  2400 log.cc:927] Time spent T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.361s	user 0.000s	sys 0.001s
I20260709 13:09:52.964136 30547 raft_consensus.cc:1240] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:52.977080 30516 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:52.979678 30547 raft_consensus.cc:1275] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:52.941566  2319 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:52.986284 30548 raft_consensus.cc:1275] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:09:52.952807  2330 raft_consensus.cc:2749] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:09:52.969693  2371 consensus_meta.cc:287] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.790s	user 0.013s	sys 0.000s
I20260709 13:09:52.960570  2201 raft_consensus.cc:2764] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:09:52.993733 30591 leader_election.cc:336] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.979s (SENT)
I20260709 13:09:52.996294 30591 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:52.834550  2416 consensus_queue.cc:237] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:52.864799  2359 consensus_queue.cc:237] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:53.009500  2165 consensus_meta.cc:287] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.760s	user 0.007s	sys 0.002s
W20260709 13:09:53.009714  2409 log.cc:927] Time spent T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.410s	user 0.000s	sys 0.000s
W20260709 13:09:53.011246  2379 consensus_meta.cc:287] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.834s	user 0.009s	sys 0.000s
W20260709 13:09:53.012724  2404 log.cc:927] Time spent T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:09:52.944362  2390 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:52.993001  2328 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:53.004709 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:53.005333 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:52.997843  2230 raft_consensus.cc:2804] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:52.969919  2335 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:53.096475  2406 log.cc:927] Time spent T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
I20260709 13:09:53.000464  2372 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:53.001572  2319 raft_consensus.cc:2749] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:53.011266  2262 raft_consensus.cc:3060] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:53.124629 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 92611.7us
W20260709 13:09:53.128055 30591 leader_election.cc:336] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.598s (SENT)
I20260709 13:09:53.134480 30591 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
W20260709 13:09:53.135587 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 131616us
W20260709 13:09:53.128885 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 94745.4us
W20260709 13:09:53.131121 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.969614 30369 catalog_manager.cc:5697] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:09:53.144053 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:53.145963 30543 raft_consensus.cc:1240] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 9. Current term is 10. Ops: []
W20260709 13:09:53.152093 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.094303  2230 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.148766 30547 raft_consensus.cc:2468] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
I20260709 13:09:53.093463  2329 raft_consensus.cc:3055] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:53.095147  2367 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:53.031658  2419 raft_consensus.cc:2749] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:09:53.184438 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 56419.1us
W20260709 13:09:53.192164 30591 leader_election.cc:336] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.649s (SENT)
I20260709 13:09:53.192623 30591 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:53.032178  2339 consensus_queue.cc:1048] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.145s
I20260709 13:09:53.201261 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:53.029580  2165 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:53.202479 31113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:53.202811  2421 log.cc:927] Time spent T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.215s	user 0.000s	sys 0.004s
W20260709 13:09:53.206609  2428 log.cc:927] Time spent T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.319s	user 0.000s	sys 0.001s
I20260709 13:09:53.223377 30622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47446 (request call id 2509) took 1350 ms. Trace:
W20260709 13:09:53.204429 30591 leader_election.cc:336] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.783s (SENT)
I20260709 13:09:53.204933  2319 raft_consensus.cc:2749] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:53.204864  2385 raft_consensus.cc:2749] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:53.190950  2329 raft_consensus.cc:740] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:53.206251 31151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48414 (request call id 1007) took 1269 ms. Trace:
I20260709 13:09:53.191664  2230 raft_consensus.cc:3060] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:53.206738  2180 raft_consensus.cc:493] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.206935 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:53.138540  2374 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.203248 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:53.287490 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:53.229854 30591 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:53.229714 30622 rpcz_store.cc:276] 0709 13:09:51.873344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.873448 (+   104us) service_pool.cc:224] Handling call
0709 13:09:51.885477 (+ 12029us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:51.913266 (+ 27789us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:51.913292 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:51.920735 (+  7443us) log.cc:844] Serialized 26 byte log entry
0709 13:09:52.140074 (+219339us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b1800370c60. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e5de07 00007fc789cb8ab9 00007fc780e7a69b 00007fc780e7893f 00007fc780e7ac02 00007fc783b0220b 00007fc783b07d23 00007fc783b080d1 00007fc783f23a0f
0709 13:09:52.400423 (+260349us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:52.400479 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:52.400569 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:53.009066 (+608497us) spinlock_profiling.cc:243] Waited 71.9 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:09:53.223142 (+214076us) raft_consensus.cc:1685] finished
0709 13:09:53.223166 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:53.223320 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59064,"raft.queue_time_us":36412,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":29470,"spinlock_wait_cycles":203214464,"thread_start_us":260114,"threads_started":1,"wal-append.queue_time_us":577143}
I20260709 13:09:53.206311  2426 raft_consensus.cc:2749] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:09:53.302680 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 347132us
I20260709 13:09:53.229997  2380 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:53.240259 31151 rpcz_store.cc:276] 0709 13:09:51.936964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.938402 (+  1438us) service_pool.cc:224] Handling call
0709 13:09:51.938709 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:51.939028 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:51.939055 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:51.985083 (+ 46028us) log.cc:844] Serialized 26 byte log entry
0709 13:09:52.404785 (+419702us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:52.404824 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:52.404889 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:53.206011 (+801122us) raft_consensus.cc:1685] finished
0709 13:09:53.206032 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:53.206176 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17130,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":15788,"thread_start_us":355956,"threads_started":1,"wal-append.queue_time_us":641300}
W20260709 13:09:53.245554 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 316710us
I20260709 13:09:53.304298 30441 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:53.246538  2329 consensus_queue.cc:260] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:53.093967  2379 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:53.264856 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.223868  2065 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:53.296113 31147 raft_consensus.cc:2468] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
W20260709 13:09:53.251798  2438 log.cc:927] Time spent T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.153s	user 0.004s	sys 0.000s
I20260709 13:09:53.133697  2368 consensus_queue.cc:1048] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.094s
W20260709 13:09:53.261441  2436 log.cc:927] Time spent T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 13:09:53.300299 30547 raft_consensus.cc:3060] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:53.247720  2331 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:53.316676 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 112263us
I20260709 13:09:53.292814 31145 raft_consensus.cc:1240] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:53.264014  2372 consensus_queue.cc:1048] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.073s
W20260709 13:09:53.303546 30517 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.700s (SENT) [suppressed 80 similar messages]
I20260709 13:09:53.318467  2413 raft_consensus.cc:476] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 9 LEADER]: Not starting pre-election -- already a leader
I20260709 13:09:53.336794  2376 raft_consensus.cc:2749] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:09:53.336858 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:53.296103  2404 log.cc:927] Time spent T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
W20260709 13:09:53.341578  2394 log.cc:927] Time spent T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 1.303s	user 0.001s	sys 0.004s
I20260709 13:09:53.249363  2330 raft_consensus.cc:3055] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:53.350804 30620 raft_consensus.cc:1240] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:53.250015  2098 raft_consensus.cc:3055] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:09:53.339644  2428 log.cc:927] Time spent T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:09:53.417306 30549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 881) took 1571 ms. Trace:
W20260709 13:09:53.351598 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 48083.9us
W20260709 13:09:53.419945 30517 leader_election.cc:336] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.789s (SENT)
I20260709 13:09:53.420531 30517 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
W20260709 13:09:53.349442 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 45229.9us
I20260709 13:09:53.353595 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:53.417754 30549 rpcz_store.cc:276] 0709 13:09:51.837402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.837871 (+   469us) service_pool.cc:224] Handling call
0709 13:09:51.875537 (+ 37666us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:52.681815 (+806278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:53.408985 (+727170us) spinlock_profiling.cc:243] Waited 789 ms on lock 0x7b54001450d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:53.409233 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1815323904}
I20260709 13:09:53.350145  2449 raft_consensus.cc:2749] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:09:53.357383  2410 log.cc:927] Time spent T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
I20260709 13:09:53.357805  2461 raft_consensus.cc:2749] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:53.254405 30369 catalog_manager.cc:5697] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 3 to 9, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 9 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:53.359485  2447 log.cc:927] Time spent T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.327s	user 0.000s	sys 0.001s
W20260709 13:09:53.360955  2403 log.cc:927] Time spent T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.816s	user 0.003s	sys 0.000s
I20260709 13:09:53.361088  2379 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:53.361734 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:53.293280  2180 raft_consensus.cc:515] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:53.436385 31142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48414 (request call id 1010) took 1446 ms. Trace:
I20260709 13:09:53.441887 30547 raft_consensus.cc:2468] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 11.
I20260709 13:09:53.443048 30441 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:53.337653 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:09:53.357118  2418 consensus_meta.cc:287] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.535s	user 0.009s	sys 0.000s
I20260709 13:09:53.413523 30468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 973) took 1108 ms. Trace:
W20260709 13:09:53.348958 30591 leader_election.cc:336] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.907s (SENT)
I20260709 13:09:53.442512 31148 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48426 (request call id 847) took 1288 ms. Trace:
I20260709 13:09:53.317433  2374 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:53.357395  2398 log.cc:927] Time spent T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.946s	user 0.013s	sys 0.012s
I20260709 13:09:53.348332  2430 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.347749  2314 consensus_queue.cc:1048] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 13:09:53.415531  2448 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:53.449012 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 100081us
W20260709 13:09:53.456434 30591 leader_election.cc:336] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 3.294s (SENT)
I20260709 13:09:53.353479  2331 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:53.456905 30591 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:53.414402  2330 raft_consensus.cc:740] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:53.444778 30468 rpcz_store.cc:276] 0709 13:09:52.286322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.286491 (+   169us) service_pool.cc:224] Handling call
0709 13:09:52.286862 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:52.303364 (+ 16502us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:52.303407 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:52.308992 (+  5585us) log.cc:844] Serialized 26 byte log entry
0709 13:09:52.562696 (+253704us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:52.562740 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:52.562806 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:53.394765 (+831959us) raft_consensus.cc:1685] finished
0709 13:09:53.394805 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:53.394956 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8286,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":49026,"thread_start_us":148589,"threads_started":1,"wal-append.queue_time_us":468568}
I20260709 13:09:53.417466  2098 raft_consensus.cc:740] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
W20260709 13:09:53.432696  2284 consensus_meta.cc:287] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 1.393s	user 0.006s	sys 0.007s
I20260709 13:09:53.446457 31148 rpcz_store.cc:276] 0709 13:09:52.153688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.153885 (+   197us) service_pool.cc:224] Handling call
0709 13:09:52.196741 (+ 42856us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:52.197069 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:52.197099 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:52.197559 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 13:09:52.824941 (+627382us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:52.824980 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:52.825059 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:53.442319 (+617260us) raft_consensus.cc:1685] finished
0709 13:09:53.442339 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:53.442457 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14771,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":12951,"thread_start_us":626888,"threads_started":1,"wal-append.queue_time_us":703536}
W20260709 13:09:53.487788  2396 log.cc:927] Time spent T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 1.450s	user 0.004s	sys 0.024s
I20260709 13:09:53.501948 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:53.502612 30475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 974) took 1215 ms. Trace:
I20260709 13:09:53.503140 30475 rpcz_store.cc:276] 0709 13:09:52.287709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.287897 (+   188us) service_pool.cc:224] Handling call
0709 13:09:52.302546 (+ 14649us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:52.500371 (+197825us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:52.500401 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:52.513168 (+ 12767us) log.cc:844] Serialized 26 byte log entry
0709 13:09:52.819872 (+306704us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:52.819921 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:52.820008 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:53.463796 (+643788us) raft_consensus.cc:1685] finished
0709 13:09:53.463844 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:53.502549 (+ 38705us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7024,"raft.queue_time_us":33539,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":62387,"thread_start_us":415445,"threads_started":2,"wal-append.queue_time_us":446457}
W20260709 13:09:53.507283 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 87384.5us
W20260709 13:09:53.507998 30517 leader_election.cc:336] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.840s (SENT)
I20260709 13:09:53.442130 31142 rpcz_store.cc:276] 0709 13:09:51.990516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.990637 (+   121us) service_pool.cc:224] Handling call
0709 13:09:52.020532 (+ 29895us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:52.020863 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:52.020893 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:52.027607 (+  6714us) log.cc:844] Serialized 26 byte log entry
0709 13:09:52.440475 (+412868us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:52.809570 (+369095us) log.cc:844] Serialized 14 byte log entry
0709 13:09:52.836979 (+ 27409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:52.837104 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:53.436178 (+599074us) raft_consensus.cc:1685] finished
0709 13:09:53.436198 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:53.436329 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":108900,"prepare.queue_time_us":171589,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":4329,"raft.queue_time_us":57237,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":27953,"thread_start_us":742770,"threads_started":2,"wal-append.queue_time_us":786635}
I20260709 13:09:53.449975  2413 raft_consensus.cc:2749] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:53.519963  2180 leader_election.cc:290] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:53.519488 30369 catalog_manager.cc:5697] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 8 to 10, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 10 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
W20260709 13:09:53.522619  2318 consensus_meta.cc:287] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.911s	user 0.007s	sys 0.006s
W20260709 13:09:53.523450  2450 log.cc:927] Time spent T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.224s	user 0.000s	sys 0.000s
I20260709 13:09:53.524645 30624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47446 (request call id 2506) took 1654 ms. Trace:
I20260709 13:09:53.536830 30618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 949) took 1020 ms. Trace:
W20260709 13:09:53.527212 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 84237.4us
W20260709 13:09:53.527218 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 70801.9us
I20260709 13:09:53.505381  2379 raft_consensus.cc:2749] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:53.537920 31146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48414 (request call id 1008) took 1600 ms. Trace:
I20260709 13:09:53.543206 31146 rpcz_store.cc:276] 0709 13:09:51.937260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.937371 (+   111us) service_pool.cc:224] Handling call
0709 13:09:51.937630 (+   259us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:51.937971 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:51.938001 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:51.938485 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 13:09:52.057903 (+119418us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b48002613d8. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc788e91aa1 00007fc788e88b37 00007fc788e889ca 00007fc788f8026f 00007fc788f7ff37 00007fc788f9455c 00007fc788f94508 00007fc788f94488 00007fc788f94443 00007fc788f936ec 00007fc787ebda96
0709 13:09:52.299668 (+241765us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:09:52.488244 (+188576us) log.cc:844] Serialized 14 byte log entry
0709 13:09:52.488441 (+   197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:52.488519 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:53.360253 (+871734us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:09:53.537718 (+177465us) raft_consensus.cc:1685] finished
0709 13:09:53.537740 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:53.537865 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":312195,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":150364,"raft.run_cpu_time_us":2129,"raft.run_wall_time_us":123264,"spinlock_wait_cycles":303175296,"thread_start_us":509901,"threads_started":2,"wal-append.queue_time_us":507557}
W20260709 13:09:53.530440 30517 leader_election.cc:336] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.510s (SENT)
I20260709 13:09:53.546844 30517 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:53.537364 30618 rpcz_store.cc:276] 0709 13:09:52.516547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.518020 (+  1473us) service_pool.cc:224] Handling call
0709 13:09:52.518465 (+   445us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:52.569918 (+ 51453us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:52.570264 (+   346us) log.cc:844] Serialized 14 byte log entry
0709 13:09:52.590636 (+ 20372us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:52.591200 (+   564us) log.cc:844] Serialized 52 byte log entry
0709 13:09:52.591322 (+   122us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:52.591359 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:53.107346 (+515987us) spinlock_profiling.cc:243] Waited 36.5 ms on lock 0x7b54001d8b54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:53.124590 (+ 17244us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:53.528785 (+404195us) raft_consensus.cc:1685] finished
0709 13:09:53.536620 (+  7835us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:53.536772 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14395,"prepare.queue_time_us":971,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":16082,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":175,"spinlock_wait_cycles":83940224,"thread_start_us":19757,"threads_started":1,"wal-append.queue_time_us":202625}
I20260709 13:09:53.536701 30624 rpcz_store.cc:276] 0709 13:09:51.870361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.870514 (+   153us) service_pool.cc:224] Handling call
0709 13:09:51.870806 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:51.871125 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:51.871151 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:51.871626 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 13:09:51.990013 (+118387us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:51.990050 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:51.990112 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:53.356642 (+1366530us) spinlock_profiling.cc:243] Waited 4.5 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:09:53.524342 (+167700us) raft_consensus.cc:1685] finished
0709 13:09:53.524372 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:53.524589 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":300,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"spinlock_wait_cycles":10355968,"thread_start_us":117937,"threads_started":1,"wal-append.queue_time_us":375907}
I20260709 13:09:53.516783  2461 raft_consensus.cc:2804] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:09:53.537392  2373 consensus_meta.cc:287] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.618s	user 0.010s	sys 0.003s
W20260709 13:09:53.582044  2441 log.cc:927] Time spent T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 13:09:53.504756  2284 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:53.598380 30625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 948) took 1450 ms. Trace:
I20260709 13:09:53.599601  2284 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:53.581924  2098 consensus_queue.cc:260] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:53.598757 30625 rpcz_store.cc:276] 0709 13:09:52.148412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.246165 (+ 97753us) service_pool.cc:224] Handling call
0709 13:09:52.246484 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:52.246833 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:52.247092 (+   259us) log.cc:844] Serialized 14 byte log entry
0709 13:09:52.809916 (+562824us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:52.823752 (+ 13836us) log.cc:844] Serialized 26 byte log entry
0709 13:09:52.824114 (+   362us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:52.824147 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:52.824215 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:53.598181 (+773966us) raft_consensus.cc:1685] finished
0709 13:09:53.598200 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:53.598326 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":224,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":14214,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":30812,"thread_start_us":554699,"threads_started":1,"wal-append.queue_time_us":785031}
I20260709 13:09:53.600684  2098 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:53.450363  2418 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:53.602981  2418 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:53.594064  2165 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:53.582494  2458 consensus_queue.cc:1059] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
W20260709 13:09:53.609112  2377 consensus_meta.cc:287] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.920s	user 0.010s	sys 0.002s
I20260709 13:09:53.609838  2165 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.609633  2377 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:53.610208  2450 log.cc:927] Time spent T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:09:53.610340  2165 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:53.612867  2230 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:53.614200 31144 raft_consensus.cc:1240] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:09:53.550791  2330 consensus_queue.cc:260] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:53.618322 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 87877.7us
W20260709 13:09:53.619068 30517 leader_election.cc:336] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.695s (SENT)
I20260709 13:09:53.584184  2201 raft_consensus.cc:493] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.584764  2423 raft_consensus.cc:2749] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:53.510697  2430 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:53.611699  2377 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:53.625424  2430 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:09:53.626677  2402 log.cc:927] Time spent T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 1.049s	user 0.004s	sys 0.000s
I20260709 13:09:53.627698  2009 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:53.628153  2455 consensus_queue.cc:1059] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:53.593420  2374 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:53.633548  2330 raft_consensus.cc:3060] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:53.587790  2461 raft_consensus.cc:697] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 10 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:53.543551  2318 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:53.588593 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 47483.8us
I20260709 13:09:53.637454 31143 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 11.
I20260709 13:09:53.588716 30551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 880) took 1751 ms. Trace:
I20260709 13:09:53.581455  2444 consensus_queue.cc:1048] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
W20260709 13:09:53.589824  2459 log.cc:927] Time spent T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
W20260709 13:09:53.590464  2437 log.cc:927] Time spent T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:09:53.591890  2331 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:53.594774 30591 leader_election.cc:336] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.223s (SENT)
I20260709 13:09:53.592381 30369 catalog_manager.cc:5697] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 8 to 9, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 9 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:53.623103  2201 raft_consensus.cc:515] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:53.638057 30551 rpcz_store.cc:276] 0709 13:09:51.836997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.837112 (+   115us) service_pool.cc:224] Handling call
0709 13:09:51.846435 (+  9323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:51.846852 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:51.846878 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:51.847273 (+   395us) log.cc:844] Serialized 26 byte log entry
0709 13:09:52.033701 (+186428us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:52.033727 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:52.033773 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:53.297606 (+1263833us) spinlock_profiling.cc:243] Waited 2.6 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:09:53.588415 (+290809us) raft_consensus.cc:1685] finished
0709 13:09:53.588441 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:53.588657 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1623,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"spinlock_wait_cycles":5977856,"thread_start_us":186093,"threads_started":1,"wal-append.queue_time_us":189629}
W20260709 13:09:53.603001  2325 consensus_meta.cc:287] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.932s	user 0.010s	sys 0.000s
I20260709 13:09:53.645529 30591 leader_election.cc:304] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
W20260709 13:09:53.623093  2412 consensus_meta.cc:287] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.930s	user 0.010s	sys 0.000s
I20260709 13:09:53.653373 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:53.649792 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:53.654357 30468 raft_consensus.cc:3060] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:53.652251 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:53.657095 30475 raft_consensus.cc:2468] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 12.
W20260709 13:09:53.646008  2360 consensus_meta.cc:287] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.823s	user 0.007s	sys 0.004s
I20260709 13:09:53.658833 30467 raft_consensus.cc:2393] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 11: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:53.613080  2165 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:53.661566 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 66865.2us
I20260709 13:09:53.667166  2390 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:53.668164 30616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 941) took 1763 ms. Trace:
I20260709 13:09:53.658252  2325 raft_consensus.cc:515] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:53.668705 30620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 945) took 1572 ms. Trace:
I20260709 13:09:53.669241 30620 rpcz_store.cc:276] 0709 13:09:52.096371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.097091 (+   720us) service_pool.cc:224] Handling call
0709 13:09:52.124327 (+ 27236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:53.414743 (+1290416us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:53.668502 (+253759us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b5400195854. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:53.668654 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2820067584}
I20260709 13:09:53.668515 30616 rpcz_store.cc:276] 0709 13:09:51.904332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.904467 (+   135us) service_pool.cc:224] Handling call
0709 13:09:51.904752 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:51.923203 (+ 18451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:51.923237 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:52.138289 (+215052us) spinlock_profiling.cc:243] Waited 32.9 ms on lock 0x7b2c000ecfb8. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc782861a11 00007fc782871372 00007fc783fa3a01 00007fc783f6843a 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2
0709 13:09:52.138777 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 13:09:52.825357 (+686580us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:52.825394 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:52.825454 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:53.667902 (+842448us) raft_consensus.cc:1685] finished
0709 13:09:53.667921 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:53.668109 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17177,"raft.queue_time_us":21001,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":68,"spinlock_wait_cycles":75749760,"thread_start_us":686211,"threads_started":1,"wal-append.queue_time_us":1206902}
I20260709 13:09:53.670776  2325 leader_election.cc:290] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:53.661888  2412 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:53.672710  2318 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:53.623155  2310 raft_consensus.cc:3055] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:53.676247  2310 raft_consensus.cc:740] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:53.676076 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:53.677129  2310 consensus_queue.cc:260] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:53.678193  2310 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:53.648218  2262 consensus_meta.cc:287] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.510s	user 0.009s	sys 0.001s
I20260709 13:09:53.681107 30369 catalog_manager.cc:5697] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 5 to 9, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 9 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:53.683231 31146 raft_consensus.cc:2468] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 10.
I20260709 13:09:53.663883  2379 raft_consensus.cc:2749] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:53.683450 30369 catalog_manager.cc:5697] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 4 to 5, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 5 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:53.694139 30369 catalog_manager.cc:5697] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 8 to 9, leader changed from cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 9 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:53.664124  2461 consensus_queue.cc:237] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:53.699051 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:53.699776 30476 raft_consensus.cc:3060] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:53.672896  2412 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:53.661891 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:53.673869  2201 leader_election.cc:290] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:53.674081  2423 raft_consensus.cc:493] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.704162  2423 raft_consensus.cc:515] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:53.704980  2201 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.705441  2201 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:53.706283  2423 leader_election.cc:290] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:53.674865 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:53.707012 30625 raft_consensus.cc:3060] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:53.707326  2201 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:53.675838  2335 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:53.677569  2329 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:53.708244 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:53.688489 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:53.689028  2435 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.690259 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:53.691536  2072 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:53.683938 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:53.761762 30620 raft_consensus.cc:2393] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 10: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:53.761934 30616 raft_consensus.cc:2393] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 10: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:53.647462  2448 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:53.662302 30517 leader_election.cc:336] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.979s (SENT)
I20260709 13:09:53.764791 30517 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:53.765007 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:53.617417  2230 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:53.752115 30625 raft_consensus.cc:2468] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 11.
W20260709 13:09:53.752367 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 43991.1us
I20260709 13:09:53.753230 30469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 955) took 2122 ms. Trace:
W20260709 13:09:53.755137 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.768929 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:53.760272 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
W20260709 13:09:53.704183 30591 leader_election.cc:336] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 3.559s (SENT)
I20260709 13:09:53.770033 30591 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:53.771291 30475 raft_consensus.cc:2393] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 13: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:53.769042 30468 raft_consensus.cc:2468] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 8.
I20260709 13:09:53.781570 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:53.776305 30590 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:53.796844 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:09:53.798729 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 142229us
W20260709 13:09:53.799466 30517 leader_election.cc:336] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.187s (SENT)
I20260709 13:09:53.799870 30517 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
W20260709 13:09:53.801033 30517 leader_election.cc:336] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.208s (SENT)
I20260709 13:09:53.801425 30517 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:53.802049  2230 raft_consensus.cc:2749] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:53.802814  2230 raft_consensus.cc:2749] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:53.781745  2201 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.798738 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:53.796962 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:53.781865  2360 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.796887 30516 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:53.797668 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:53.805192 30622 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 10.
I20260709 13:09:53.805085  2360 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:53.808079 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:53.808326  2376 raft_consensus.cc:493] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
W20260709 13:09:53.808604  2465 log.cc:927] Time spent T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.141s	user 0.006s	sys 0.000s
I20260709 13:09:53.808869  2376 raft_consensus.cc:515] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:53.736848 30369 catalog_manager.cc:5697] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 reported cstate change: config changed from index 2 to 3, term changed from 8 to 7, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1), VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2), VOTER fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3), VOTER cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 7 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:09:53.811110  2376 leader_election.cc:290] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:53.753777  2449 raft_consensus.cc:493] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:53.812453  2449 raft_consensus.cc:515] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:53.813227  2419 raft_consensus.cc:2749] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:09:53.815572 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.818313 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:09:53.819177 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 115027us
I20260709 13:09:53.819641 30468 raft_consensus.cc:2468] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 9.
W20260709 13:09:53.820818 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 44592us
I20260709 13:09:53.769066 30469 rpcz_store.cc:276] 0709 13:09:51.630638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.654184 (+ 23546us) service_pool.cc:224] Handling call
0709 13:09:51.684718 (+ 30534us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:51.709843 (+ 25125us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:51.709874 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:51.710315 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 13:09:51.913977 (+203662us) spinlock_profiling.cc:243] Waited 1.35 ms on lock 0x7b180026db20. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e5de07 00007fc789cb8ab9 00007fc780e7a69b 00007fc780e7893f 00007fc780e7ac02 00007fc783b0220b 00007fc783b07d23 00007fc783b080d1 00007fc783f23a0f
0709 13:09:52.263267 (+349290us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:52.785973 (+522706us) log.cc:844] Serialized 14 byte log entry
0709 13:09:53.581258 (+795285us) spinlock_profiling.cc:243] Waited 98 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:09:53.716973 (+135715us) spinlock_profiling.cc:243] Waited 3.7 ms on lock 0x7b180026db20. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc783b104bc 00007fc780e5e48b 00007fc789cb8ab9 00007fc780e7a69b 00007fc780e7893f 00007fc780e78455 00007fc783f60060 00007fc783f72716 00007fc783f83287
0709 13:09:53.717121 (+   148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:53.717243 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:53.717296 (+    53us) raft_consensus.cc:1685] finished
0709 13:09:53.717313 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:53.753144 (+ 35831us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68371,"prepare.queue_time_us":973355,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":54,"raft.queue_time_us":224646,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":14214,"spinlock_wait_cycles":237111680,"thread_start_us":1017078,"threads_started":3,"wal-append.queue_time_us":766281}
I20260709 13:09:53.823448 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:53.771001  2316 raft_consensus.cc:2749] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:53.825227 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:53.830437 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:53.823626  2230 raft_consensus.cc:476] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 8 LEADER]: Not starting pre-election -- already a leader
I20260709 13:09:53.829457  2419 raft_consensus.cc:2804] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:53.803718  2201 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:53.830641 30547 raft_consensus.cc:2468] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9.
I20260709 13:09:53.763410 30476 raft_consensus.cc:2468] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 11.
I20260709 13:09:53.828717 30471 raft_consensus.cc:2468] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 6.
I20260709 13:09:53.831858 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:53.831215 31148 raft_consensus.cc:2468] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
I20260709 13:09:53.838280 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:09:53.867585 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.818568  2072 raft_consensus.cc:2804] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:53.842523 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:53.807883  2360 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:53.842752 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:53.921710 30549 raft_consensus.cc:2393] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 11: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:53.921872 30548 raft_consensus.cc:3060] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:53.842094 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:53.911350 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:53.822991  2423 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:53.912499 30360 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 2b207fb799ce4340b29ae053898e0e6c with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica fe2b7d73f8c743c1ba570cfd981c4e79 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:09:53.837596  2412 raft_consensus.cc:493] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:53.914656  2201 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:53.837205  2380 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.915311 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:53.915930 30475 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 10.
I20260709 13:09:53.774181  2435 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:53.946332 30544 raft_consensus.cc:2468] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 13.
W20260709 13:09:53.916638 30517 leader_election.cc:336] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.734s (SENT)
I20260709 13:09:53.917126  2372 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.965577 30440 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:09:53.940331 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.924257 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:53.941978 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:53.921319  2072 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:53.947291 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 106490us
I20260709 13:09:53.961853 30517 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:53.935071 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:53.811405 30369 catalog_manager.cc:5697] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 6 to 7, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 7 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:09:53.936131  1926 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.920833  2098 raft_consensus.cc:493] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.012256  2098 raft_consensus.cc:515] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:54.014597  2098 leader_election.cc:290] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:53.974596  2380 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:54.016533 30550 raft_consensus.cc:1275] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:53.974576 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:09:53.982372 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 65762.6us
I20260709 13:09:54.019021 30589 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:53.994149  2360 raft_consensus.cc:2804] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:09:54.019356 30517 leader_election.cc:336] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.019s (SENT)
I20260709 13:09:53.996542  2359 consensus_queue.cc:1059] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:09:54.002388 31143 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48412 (request call id 792) took 1901 ms (client timeout 1706 ms). Trace:
I20260709 13:09:54.004917  2413 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.918586  2180 consensus_queue.cc:1059] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:09:54.019145 30468 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 10.
I20260709 13:09:54.027715 30589 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:53.978912  2072 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:54.021525 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:09:54.029093 30517 leader_election.cc:336] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.771s (SENT)
W20260709 13:09:54.027042 31143 rpcz_store.cc:269] 0709 13:09:52.100798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.101978 (+  1180us) service_pool.cc:224] Handling call
0709 13:09:54.002145 (+1900167us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b5400727254. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:54.002277 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3474584960}
I20260709 13:09:54.040535 30469 raft_consensus.cc:2410] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:09:53.974188  2201 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.973045  2416 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.923362  2165 consensus_queue.cc:1048] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:09:54.026753  2360 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.032390  2376 raft_consensus.cc:2749] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:54.038444  2310 raft_consensus.cc:2804] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:54.040421 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:53.947996  2412 raft_consensus.cc:515] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:53.941295  2423 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:54.038028 30548 raft_consensus.cc:2468] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9.
I20260709 13:09:54.054086 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:54.056152 30468 raft_consensus.cc:2468] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 11.
I20260709 13:09:54.059237 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:54.027144  1926 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:53.979358  2372 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:54.048449  2360 raft_consensus.cc:3060] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:54.081845 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 52807.4us
I20260709 13:09:54.050618  2379 raft_consensus.cc:3055] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:54.088603 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:54.057431  2310 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.089591 30469 raft_consensus.cc:2376] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 9. Re-sending same reply.
I20260709 13:09:54.089910 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:54.090831 30623 raft_consensus.cc:2468] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 9.
I20260709 13:09:54.095639 30468 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 14.
I20260709 13:09:54.097020 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:54.103543 31150 raft_consensus.cc:1240] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 12 LEADER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:54.045388  2416 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:54.038832  2413 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:54.045522  2201 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:54.095721 30590 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:54.117798 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:54.118551 30469 raft_consensus.cc:2376] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 14. Re-sending same reply.
I20260709 13:09:54.129854 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:54.085049  2379 raft_consensus.cc:740] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:54.091758  2310 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:54.165855 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:54.166611 30469 raft_consensus.cc:3060] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:54.151015 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:54.168316 30468 raft_consensus.cc:2393] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 11: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:54.172188 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: true dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:54.148411  2390 raft_consensus.cc:2804] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:09:54.200218 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.149063  2448 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:54.228286 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:54.229447 30472 raft_consensus.cc:2410] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
W20260709 13:09:54.173000  2470 log.cc:927] Time spent T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:09:54.249936  2474 raft_consensus.cc:2749] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:09:54.251001  2468 log.cc:927] Time spent T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:09:54.251042  2339 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:54.251367  2474 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.251775  2339 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:54.252914  2473 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:54.253433  2473 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:54.254051  2339 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:54.257357  2474 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:54.259622  2474 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:54.255501  2473 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:54.261746 31150 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48414 (request call id 1013) took 1959 ms. Trace:
I20260709 13:09:54.262246 31150 rpcz_store.cc:276] 0709 13:09:52.302595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.336702 (+ 34107us) service_pool.cc:224] Handling call
0709 13:09:52.403428 (+ 66726us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:54.104077 (+1700649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:54.261414 (+157337us) spinlock_profiling.cc:243] Waited 1.7 s on lock 0x7b5400586e54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:54.261671 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3909267328}
I20260709 13:09:54.210196 30468 raft_consensus.cc:2376] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 9. Re-sending same reply.
I20260709 13:09:54.268781 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:54.213972  2390 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:54.272583 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:54.217975  2180 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:54.273444 31114 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:54.639694 30468 raft_consensus.cc:2393] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 6: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
W20260709 13:09:54.645226 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 371844us
I20260709 13:09:54.233114  2316 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:09:54.312493  2461 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.012s	sys 0.019s
I20260709 13:09:54.282557  2065 consensus_queue.cc:1059] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
W20260709 13:09:54.341454 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:54.358188 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.360538 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:54.361325 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:54.264351  2379 consensus_queue.cc:260] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:54.365258 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:54.680392 30550 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:54.373059 30619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47446 (request call id 2527) took 1023 ms. Trace:
I20260709 13:09:54.681259 30619 rpcz_store.cc:276] 0709 13:09:53.349480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.349672 (+   192us) service_pool.cc:224] Handling call
0709 13:09:53.350638 (+   966us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:53.503580 (+152942us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:53.503620 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:53.525247 (+ 21627us) log.cc:844] Serialized 26 byte log entry
0709 13:09:53.746265 (+221018us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:53.746306 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:53.809584 (+ 63278us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b540027f454. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:53.809636 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:54.368506 (+558870us) raft_consensus.cc:1685] finished
0709 13:09:54.368533 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:54.372979 (+  4446us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":523,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":7577,"spinlock_wait_cycles":350829824,"thread_start_us":160231,"threads_started":1,"wal-append.queue_time_us":493591}
I20260709 13:09:54.382282  2412 leader_election.cc:290] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:54.384764  2469 log.cc:927] Time spent T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.306s	user 0.000s	sys 0.002s
I20260709 13:09:54.385401  2423 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:54.397413  2475 log.cc:927] Time spent T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:09:54.391656  1926 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:54.400359 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:54.425127 31144 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48414 (request call id 1012) took 2135 ms. Trace:
I20260709 13:09:54.429865 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:09:54.434430 30441 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:60026 dropped due to backpressure: service queue is full with 50 items [suppressed 2 similar messages]
W20260709 13:09:54.435946 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:54.451043  2451 log.cc:927] Time spent T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.753s	user 0.000s	sys 0.006s
I20260709 13:09:54.491288 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:54.714704 30476 raft_consensus.cc:2393] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 14: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:54.660336  2367 raft_consensus.cc:2804] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:54.541213 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:54.717267 30475 raft_consensus.cc:2368] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 8. Current term is 9.
I20260709 13:09:54.543279 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:54.563136  2380 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:54.567144 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 64657.7us
W20260709 13:09:54.627261 30516 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.001s	sys 0.009s
W20260709 13:09:54.728438 30516 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.002s	sys 0.009s
W20260709 13:09:54.729338 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 642544us
W20260709 13:09:54.627600 30517 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.003s	sys 0.007s
I20260709 13:09:54.583271  2492 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:54.594914  2330 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:54.714112  2098 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:09:54.627002  2230 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.000s	sys 0.010s
I20260709 13:09:54.660713 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:54.662494 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:54.752627 30546 raft_consensus.cc:2468] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
I20260709 13:09:54.664559 30548 raft_consensus.cc:2468] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
I20260709 13:09:54.664867 30544 raft_consensus.cc:2393] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 10: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
W20260709 13:09:54.665817 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.731392  2367 raft_consensus.cc:697] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 11 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
W20260709 13:09:54.617874  2419 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.000s	sys 0.010s
I20260709 13:09:54.683990 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:54.761957 30472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2416) took 1054 ms. Trace:
W20260709 13:09:54.744920  2374 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.006s	sys 0.010s
I20260709 13:09:54.648378  2390 raft_consensus.cc:3060] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:54.711766 30471 raft_consensus.cc:2468] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 9.
I20260709 13:09:54.779744 30471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2414) took 1073 ms. Trace:
I20260709 13:09:54.780283 30471 rpcz_store.cc:276] 0709 13:09:53.706352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.429588 (+723236us) service_pool.cc:224] Handling call
0709 13:09:54.779658 (+350070us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:54.711529 31144 rpcz_store.cc:276] 0709 13:09:52.289648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.308606 (+ 18958us) service_pool.cc:224] Handling call
0709 13:09:52.401738 (+ 93132us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:53.614675 (+1212937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:54.424761 (+810086us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54006eee54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:54.425028 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2787345664}
I20260709 13:09:54.715132 30476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2415) took 1008 ms. Trace:
I20260709 13:09:54.781884 30476 rpcz_store.cc:276] 0709 13:09:53.706778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.490950 (+784172us) service_pool.cc:224] Handling call
0709 13:09:54.715063 (+224113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:54.495697 30467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60026 (request call id 983) took 1342 ms. Trace:
W20260709 13:09:54.734472 30517 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.003s	sys 0.008s
I20260709 13:09:54.730674 30516 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:54.735246 31113 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.018s	sys 0.024s
I20260709 13:09:54.738811 30550 raft_consensus.cc:2410] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:09:54.740334  2426 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:54.665114  2180 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:54.664172  2316 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:54.747785 30591 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.015s	sys 0.021s
W20260709 13:09:54.804502 30591 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.015s	sys 0.021s
W20260709 13:09:54.804780 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 608396us
I20260709 13:09:54.654573 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:54.806039  2316 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:54.806332 30468 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:54.806528  2316 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.806960  2316 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:54.800035  2314 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.808357  2314 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:54.808911  2316 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:54.679111 30469 consensus_meta.cc:287] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.512s	user 0.007s	sys 0.000s
I20260709 13:09:54.810580 30469 raft_consensus.cc:2468] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 8.
I20260709 13:09:54.811048 30469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60026 (request call id 993) took 1105 ms. Trace:
I20260709 13:09:54.811342 30469 rpcz_store.cc:276] 0709 13:09:53.705182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.119316 (+414134us) service_pool.cc:224] Handling call
0709 13:09:54.810990 (+691674us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:54.812352 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:54.812868 30469 raft_consensus.cc:2376] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 8. Re-sending same reply.
I20260709 13:09:54.813725 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:54.814389 30469 raft_consensus.cc:2393] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 13: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:54.711721 30441 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:60026 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2426)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2417)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2449)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2418)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2450)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2451)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2420)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2442)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2438)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2423)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2439)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2453)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60026 (request call id 988)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2424)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2425)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2427)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2432)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60026 (request call id 992)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2433)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60026 (request call id 999)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2434)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2443)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 986)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 994)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 995)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 996)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 2441)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 2445)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 2446)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 998)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 1000)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 1001)
I20260709 13:09:54.762327 30472 rpcz_store.cc:276] 0709 13:09:53.707049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.659101 (+952052us) service_pool.cc:224] Handling call
0709 13:09:54.761901 (+102800us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:54.820353 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:54.821156 30472 raft_consensus.cc:2410] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:09:54.821537 30472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2442) took 1014 ms. Trace:
I20260709 13:09:54.821822 30472 rpcz_store.cc:276] 0709 13:09:53.807303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.820093 (+1012790us) service_pool.cc:224] Handling call
0709 13:09:54.821486 (+  1393us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:54.822642 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:09:54.658682  2461 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.957s	user 0.012s	sys 0.019s
I20260709 13:09:54.733239  2449 leader_election.cc:290] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:54.755841  2359 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.015s	sys 0.031s
I20260709 13:09:54.797832 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
W20260709 13:09:54.757527  2230 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.001s	sys 0.010s
W20260709 13:09:54.798148 30517 leader_election.cc:336] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 3.095s (SENT)
W20260709 13:09:54.783128  2374 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.006s	sys 0.010s
I20260709 13:09:54.782930 30467 rpcz_store.cc:276] 0709 13:09:53.152962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.196178 (+ 43216us) service_pool.cc:224] Handling call
0709 13:09:54.495440 (+1299262us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b54000285d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:54.495622 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1033748224}
I20260709 13:09:54.837719 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:54.838269 30467 raft_consensus.cc:2376] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 10. Re-sending same reply.
I20260709 13:09:54.838896 30467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2423) took 1036 ms. Trace:
W20260709 13:09:54.838832 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 108255us
W20260709 13:09:54.760057  2430 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.062s	user 0.013s	sys 0.007s
I20260709 13:09:54.755452  2376 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:54.865195  2376 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:54.865577 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 67464.9us
W20260709 13:09:54.866202 30517 leader_election.cc:336] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 3.166s (SENT)
I20260709 13:09:54.866561 30517 leader_election.cc:304] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:54.867304  2376 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:54.742568  2065 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:54.868062  2065 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:54.868618 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:54.869557 30471 raft_consensus.cc:2393] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 10: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
W20260709 13:09:54.869818  2488 log.cc:927] Time spent T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:09:54.870040 30471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2418) took 1162 ms. Trace:
I20260709 13:09:54.870275  2065 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:54.801065 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:54.823606  2359 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.016s	sys 0.031s
I20260709 13:09:54.831369 30473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 977) took 2240 ms. Trace:
W20260709 13:09:54.782920  2419 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.000s	sys 0.012s
I20260709 13:09:54.881161  2419 raft_consensus.cc:697] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 11 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:54.882164  2419 consensus_queue.cc:237] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:54.840161  2314 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:54.838205 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:54.839433 30467 rpcz_store.cc:276] 0709 13:09:53.802585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.837459 (+1034874us) service_pool.cc:224] Handling call
0709 13:09:54.838844 (+  1385us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:54.884274 30469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2420) took 1113 ms. Trace:
I20260709 13:09:54.884438 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:54.884624 30469 rpcz_store.cc:276] 0709 13:09:53.770397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.824517 (+1054120us) service_pool.cc:224] Handling call
0709 13:09:54.884219 (+ 59702us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:54.798453  2328 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.026s	sys 0.033s
I20260709 13:09:54.759127  2098 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:54.863003 30516 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:54.749133  2330 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:54.758622  2372 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:54.870572 30471 rpcz_store.cc:276] 0709 13:09:53.707580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.801955 (+1094375us) service_pool.cc:224] Handling call
0709 13:09:54.869969 (+ 68014us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:54.762995  2201 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:54.827826 30468 raft_consensus.cc:2468] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 15.
I20260709 13:09:54.746426  2492 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:54.762336  2416 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:54.842577  2430 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.145s	user 0.013s	sys 0.008s
I20260709 13:09:54.885175 30467 raft_consensus.cc:2393] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 6: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:54.895519 30468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60026 (request call id 987) took 1200 ms. Trace:
I20260709 13:09:54.877287 30473 rpcz_store.cc:276] 0709 13:09:52.591184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.594687 (+  3503us) service_pool.cc:224] Handling call
0709 13:09:52.632612 (+ 37925us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:52.815443 (+182831us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:52.815473 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:52.816321 (+   848us) log.cc:844] Serialized 26 byte log entry
0709 13:09:52.957527 (+141206us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:52.957558 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:52.957653 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:54.450373 (+1492720us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:09:54.797724 (+347351us) raft_consensus.cc:1685] finished
0709 13:09:54.797744 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:54.831305 (+ 33561us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13409,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":13266,"spinlock_wait_cycles":35365120,"thread_start_us":262055,"threads_started":2,"wal-append.queue_time_us":820968}
I20260709 13:09:54.896881 30441 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 2445) took 1081 ms. Trace:
I20260709 13:09:54.862445 30476 raft_consensus.cc:2468] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 9.
I20260709 13:09:54.891040 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:54.899492 30468 rpcz_store.cc:276] 0709 13:09:53.694732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.653993 (+959261us) service_pool.cc:224] Handling call
0709 13:09:54.895458 (+241465us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:54.836701  2461 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:54.900384 30469 raft_consensus.cc:2393] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 10: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
W20260709 13:09:54.798605 31113 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.018s	sys 0.024s
I20260709 13:09:54.900749 30476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2449) took 1084 ms. Trace:
I20260709 13:09:54.903977 30476 rpcz_store.cc:276] 0709 13:09:53.816746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.782736 (+965990us) service_pool.cc:224] Handling call
0709 13:09:54.900683 (+117947us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:54.899657 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:54.903012 30467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2439) took 1096 ms. Trace:
I20260709 13:09:54.905318 30467 rpcz_store.cc:276] 0709 13:09:53.806505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.884185 (+1077680us) service_pool.cc:224] Handling call
0709 13:09:54.902929 (+ 18744us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:54.905851 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:54.906656 30476 raft_consensus.cc:2368] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 8. Current term is 9.
I20260709 13:09:54.907059 30476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2424) took 1104 ms. Trace:
W20260709 13:09:54.888237  2328 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.026s	sys 0.033s
I20260709 13:09:54.907426 30476 rpcz_store.cc:276] 0709 13:09:53.802906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.904667 (+1101761us) service_pool.cc:224] Handling call
0709 13:09:54.907003 (+  2336us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:54.911448 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:54.908455 30469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2453) took 1074 ms. Trace:
I20260709 13:09:54.905575 30475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2417) took 1198 ms. Trace:
I20260709 13:09:54.912380 30476 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
I20260709 13:09:54.912530 30475 rpcz_store.cc:276] 0709 13:09:53.707322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.878242 (+1170920us) service_pool.cc:224] Handling call
0709 13:09:54.905512 (+ 27270us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:54.912236 30469 rpcz_store.cc:276] 0709 13:09:53.834431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.885295 (+1050864us) service_pool.cc:224] Handling call
0709 13:09:54.908395 (+ 23100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:54.899685 30441 rpcz_store.cc:276] 0709 13:09:53.815482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.896813 (+1081331us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:09:54.914016 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:54.906317 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:54.914989 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:54.926894 30467 raft_consensus.cc:2393] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 11: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:54.915562 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:54.927580 30475 raft_consensus.cc:2468] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 9.
W20260709 13:09:54.917068  2072 consensus_meta.cc:287] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.871s	user 0.012s	sys 0.006s
I20260709 13:09:54.860986  2479 raft_consensus.cc:2749] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:54.919760 30472 raft_consensus.cc:2468] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 7.
I20260709 13:09:54.877560  2435 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:54.894441  2373 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:54.931401  2098 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:54.931828  2180 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:54.932075  2330 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:54.931699  2373 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:54.934527  2373 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:54.843510  2426 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:54.936713 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:54.937285 30470 raft_consensus.cc:2376] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 9. Re-sending same reply.
I20260709 13:09:54.937714 30470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2426) took 1134 ms. Trace:
I20260709 13:09:54.937817  2492 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:54.938030 30470 rpcz_store.cc:276] 0709 13:09:53.803432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.936447 (+1133015us) service_pool.cc:224] Handling call
0709 13:09:54.937661 (+  1214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:54.938470  2426 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:54.921640 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:54.939320 30471 raft_consensus.cc:2393] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 9: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:54.941962  2413 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:54.942561 30472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2438) took 1136 ms. Trace:
I20260709 13:09:54.942967 30472 rpcz_store.cc:276] 0709 13:09:53.806289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.822410 (+1016121us) service_pool.cc:224] Handling call
0709 13:09:54.942412 (+120002us) spinlock_profiling.cc:243] Waited 96.5 ms on lock 0x7b5400217fd4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:54.942505 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":222035328}
I20260709 13:09:54.944679  2379 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:54.924690 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 61834.1us
I20260709 13:09:54.946935 30516 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:54.900266  2491 consensus_queue.cc:1059] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:09:54.947312  2448 raft_consensus.cc:3055] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:54.924211  2367 consensus_queue.cc:237] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:54.947753  2448 raft_consensus.cc:740] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:54.948112 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:54.948823 30473 raft_consensus.cc:2393] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 12: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:54.948608  2448 consensus_queue.cc:260] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:54.949649  2448 raft_consensus.cc:3060] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:54.909948  2461 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:54.929906  2496 raft_consensus.cc:2749] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:54.939714 30471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60026 (request call id 988) took 1244 ms. Trace:
I20260709 13:09:54.952162 30471 rpcz_store.cc:276] 0709 13:09:53.695003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.902591 (+1207588us) service_pool.cc:224] Handling call
0709 13:09:54.939652 (+ 37061us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:54.914048 30441 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:50430 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2425)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50446 (request call id 2001)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50446 (request call id 2009)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2460)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50446 (request call id 1998)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2459)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50446 (request call id 2008)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2427)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50446 (request call id 2002)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2456)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50446 (request call id 1995)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50446 (request call id 1996)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2432)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60026 (request call id 992)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50446 (request call id 1999)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50446 (request call id 2000)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2433)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50446 (request call id 2005)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60026 (request call id 999)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50446 (request call id 2007)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2434)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2457)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50446 (request call id 1987)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50446 (request call id 1988)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50446 (request call id 1989)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2443)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50446 (request call id 1990)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50446 (request call id 1993)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 986)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 994)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 995)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 996)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 2441)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 2446)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 998)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 1000)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 1001)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 2454)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 2455)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 2462)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 2003)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 2004)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 2006)
I20260709 13:09:54.967523 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:54.968313 30468 raft_consensus.cc:2393] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 14: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:54.968541 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:54.969460 30476 raft_consensus.cc:2393] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 13: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:54.969950 30476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2425) took 1166 ms. Trace:
I20260709 13:09:54.970316 30476 rpcz_store.cc:276] 0709 13:09:53.803180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.968262 (+1165082us) service_pool.cc:224] Handling call
0709 13:09:54.969888 (+  1626us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:54.969002 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:54.971490 30468 raft_consensus.cc:2410] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:09:54.971472 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:54.972718 30476 raft_consensus.cc:2410] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:09:54.965126 31144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48914655f9d44751a883e36b566dcefd"
dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
mode: GRACEFUL
new_leader_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:42956
I20260709 13:09:54.973587 31144 raft_consensus.cc:606] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Received request to transfer leadership to TS f639301059e24dc5b0d88a46dc683326
I20260709 13:09:54.973701 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:54.974036 31144 raft_consensus.cc:614] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:54.975077 30543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43088 (request call id 2247) took 1139 ms. Trace:
I20260709 13:09:54.976346 30516 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:54.968713 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:54.977680 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:54.977742 30469 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
I20260709 13:09:54.978389 30467 raft_consensus.cc:2368] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 11. Current term is 12.
I20260709 13:09:54.978787 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:54.979595 30469 raft_consensus.cc:2393] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 14: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:54.973521 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:55.006603 30471 raft_consensus.cc:2393] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 12: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:55.006986 30471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2427) took 1203 ms. Trace:
I20260709 13:09:55.007359 30471 rpcz_store.cc:276] 0709 13:09:53.803690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.967787 (+1164097us) service_pool.cc:224] Handling call
0709 13:09:55.006932 (+ 39145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:55.008278 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:55.008785 30471 raft_consensus.cc:2376] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 14. Re-sending same reply.
I20260709 13:09:55.009224 30471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2432) took 1204 ms. Trace:
I20260709 13:09:55.009505 30471 rpcz_store.cc:276] 0709 13:09:53.804908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.008005 (+1203097us) service_pool.cc:224] Handling call
0709 13:09:55.009176 (+  1171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:55.010335 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:55.010885 30471 raft_consensus.cc:2468] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 11.
I20260709 13:09:55.011314 30471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60026 (request call id 992) took 1306 ms. Trace:
I20260709 13:09:54.975436 30543 rpcz_store.cc:276] 0709 13:09:53.835524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.836227 (+   703us) service_pool.cc:224] Handling call
0709 13:09:53.836502 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:54.240757 (+404255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:54.240798 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:54.241328 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 13:09:54.735716 (+494388us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:54.735755 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:54.736955 (+  1200us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:54.974876 (+237921us) raft_consensus.cc:1685] finished
0709 13:09:54.974895 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:54.975016 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81401,"raft.queue_time_us":263199,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"thread_start_us":774096,"threads_started":2,"wal-append.queue_time_us":651586}
I20260709 13:09:54.980787 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:55.012696 30468 raft_consensus.cc:2368] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 10. Current term is 11.
I20260709 13:09:54.988883  2496 raft_consensus.cc:2804] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:55.013418 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:55.013653  2496 raft_consensus.cc:697] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 10 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:55.014027 30468 raft_consensus.cc:2368] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 10. Current term is 11.
I20260709 13:09:55.006888 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:55.014725 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:55.014796 30469 raft_consensus.cc:2468] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 8.
I20260709 13:09:54.963456  2330 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.951776  2461 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:55.015532  2415 raft_consensus.cc:3055] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:55.015748 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:55.015491  2330 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:55.016781  2415 raft_consensus.cc:740] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:55.017138 30468 raft_consensus.cc:2368] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 6. Current term is 7.
I20260709 13:09:55.017504 30468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2433) took 1212 ms. Trace:
I20260709 13:09:55.017783 30468 rpcz_store.cc:276] 0709 13:09:53.805125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.015554 (+1210429us) service_pool.cc:224] Handling call
0709 13:09:55.017455 (+  1901us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:55.017738  2415 consensus_queue.cc:260] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:55.018589  2330 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:55.018728 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:55.019166  2415 raft_consensus.cc:3060] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:55.019526 30468 raft_consensus.cc:2410] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:09:54.984973  2479 raft_consensus.cc:2749] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:55.028577 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:55.029477 31143 raft_consensus.cc:2393] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 11: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
W20260709 13:09:54.980975 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 165723us
I20260709 13:09:54.983798 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:54.984329 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:54.987910 31144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130"
dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
mode: GRACEFUL
new_leader_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:42956
I20260709 13:09:54.988787 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:55.031068 31144 raft_consensus.cc:606] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 9 LEADER]: Received request to transfer leadership to TS f639301059e24dc5b0d88a46dc683326
I20260709 13:09:54.990142 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:55.011590 30471 rpcz_store.cc:276] 0709 13:09:53.704882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.010101 (+1305219us) service_pool.cc:224] Handling call
0709 13:09:55.011266 (+  1165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:55.031786 30473 raft_consensus.cc:2468] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 11.
I20260709 13:09:55.014513  2496 consensus_queue.cc:237] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:54.962852  2072 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:55.031034 30472 raft_consensus.cc:2468] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
I20260709 13:09:55.044749 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:55.045099 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:55.045428 30472 raft_consensus.cc:2393] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 10: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:55.045583  2072 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:55.045692 30549 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 10.
I20260709 13:09:55.002243 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:55.046482 31150 raft_consensus.cc:2468] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 12.
I20260709 13:09:55.046905 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:55.047715 30468 raft_consensus.cc:2376] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10. Re-sending same reply.
I20260709 13:09:55.048151 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:55.048825 30550 raft_consensus.cc:2393] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 6: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:55.049305 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:55.049588 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:55.049911 31145 raft_consensus.cc:2468] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 13.
I20260709 13:09:55.032388 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:55.050657 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:55.051203 30550 raft_consensus.cc:2468] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 9.
I20260709 13:09:55.051493 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:55.043512 30440 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:55.043669 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:55.052299 30547 raft_consensus.cc:2393] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 9: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:55.053288 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:55.053529 30547 raft_consensus.cc:1240] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:55.053845 30546 raft_consensus.cc:2468] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 9.
I20260709 13:09:55.032785 30476 raft_consensus.cc:2468] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
I20260709 13:09:55.045898 30472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2434) took 1240 ms. Trace:
I20260709 13:09:55.055785 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:55.056118 30472 rpcz_store.cc:276] 0709 13:09:53.805367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.044507 (+1239140us) service_pool.cc:224] Handling call
0709 13:09:55.045837 (+  1330us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:55.056581 30476 raft_consensus.cc:2410] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:09:55.056977 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:55.057288 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:55.058017 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:54.981746 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:55.058861 31148 raft_consensus.cc:1275] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:09:55.059634 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:55.059947 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:55.060310 30467 raft_consensus.cc:2368] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 7. Current term is 8.
I20260709 13:09:55.043174 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:55.060943 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:55.055600  2461 raft_consensus.cc:2804] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:55.043051 30543 raft_consensus.cc:1275] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:55.058779 30472 raft_consensus.cc:2410] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:09:55.048662 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:09:55.063017 30591 leader_election.cc:336] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 3.067s (SENT)
I20260709 13:09:55.064375 30471 raft_consensus.cc:2410] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 9 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:09:55.057935 30476 raft_consensus.cc:2393] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 13: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:55.050681 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:55.052332 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:55.063203 30440 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:55.129040 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:55.134177 30468 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 11.
W20260709 13:09:55.134944 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 71829.6us
I20260709 13:09:55.135171 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:09:55.135843 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.129628 30470 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
I20260709 13:09:55.135914 30468 raft_consensus.cc:2468] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
I20260709 13:09:55.140486 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:55.149591 30476 raft_consensus.cc:2410] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:09:55.134262 30544 raft_consensus.cc:2468] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 10.
W20260709 13:09:55.151273 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 88290.7us
W20260709 13:09:55.151793 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.154076 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:55.154908 30468 raft_consensus.cc:2468] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
I20260709 13:09:55.027632 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:55.155987 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:55.156522 30469 raft_consensus.cc:2410] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:09:55.156895 30468 raft_consensus.cc:2468] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
I20260709 13:09:55.159409 30475 raft_consensus.cc:2468] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 13.
I20260709 13:09:55.161895 30547 raft_consensus.cc:1275] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:55.163767 30476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 986) took 1469 ms. Trace:
W20260709 13:09:55.164597 30591 leader_election.cc:336] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.521s (SENT)
I20260709 13:09:55.164880 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:55.165030 30591 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:55.164155 30476 rpcz_store.cc:276] 0709 13:09:53.694441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.163088 (+1468647us) service_pool.cc:224] Handling call
0709 13:09:55.163329 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:55.163480 (+   151us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:55.163504 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:55.163541 (+    37us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:55.163569 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:55.163622 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:55.163708 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:55.166216 30472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2443) took 1358 ms. Trace:
I20260709 13:09:55.166576 30472 rpcz_store.cc:276] 0709 13:09:53.807538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.057798 (+1250260us) service_pool.cc:224] Handling call
0709 13:09:55.166161 (+108363us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:55.166953 30591 leader_election.cc:336] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.583s (SENT)
W20260709 13:09:55.167862 30591 leader_election.cc:336] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.614s (SENT)
I20260709 13:09:55.168292 30591 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:55.157333 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:55.169770 30469 raft_consensus.cc:2410] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:09:55.173493 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:55.173930 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:55.174059 30473 raft_consensus.cc:2468] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
I20260709 13:09:55.174489 30549 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 11.
I20260709 13:09:55.167667 30516 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:55.176322 30591 leader_election.cc:336] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.669s (SENT)
W20260709 13:09:55.177098 30591 leader_election.cc:336] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.723s (SENT)
I20260709 13:09:55.177619 31114 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:55.179318 31114 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:55.180686 30516 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:55.147234  2461 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.150933  2098 raft_consensus.cc:2804] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:55.133498  2339 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.201715 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:55.202064 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:55.227105 30467 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 12.
I20260709 13:09:55.228102 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:55.195585 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:55.196115 31114 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:55.228847 30471 raft_consensus.cc:2376] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10. Re-sending same reply.
W20260709 13:09:55.228858 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.230291 31114 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:55.230926 30469 raft_consensus.cc:2393] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 9: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:55.196929 30472 raft_consensus.cc:1275] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:09:55.195490 30476 raft_consensus.cc:1275] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:09:55.232198 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:55.232860 30473 raft_consensus.cc:2468] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 12.
I20260709 13:09:55.233307 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:55.234001 30467 raft_consensus.cc:2393] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 11: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:55.120882  2330 consensus_queue.cc:1048] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
W20260709 13:09:55.225018 30590 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.006s	sys 0.024s
I20260709 13:09:55.232314 30476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 2446) took 1416 ms. Trace:
W20260709 13:09:55.234472 30590 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.006s	sys 0.024s
I20260709 13:09:55.162983  2072 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:55.234534 30476 rpcz_store.cc:276] 0709 13:09:53.815854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.194871 (+1379017us) service_pool.cc:224] Handling call
0709 13:09:55.195184 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:55.232078 (+ 36894us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:55.232264 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:55.166353  2376 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:55.232210 30472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 2441) took 1425 ms. Trace:
I20260709 13:09:55.237105 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:55.223402 30516 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:55.221897  2413 raft_consensus.cc:2804] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:55.237623 30472 rpcz_store.cc:276] 0709 13:09:53.807056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.196404 (+1389348us) service_pool.cc:224] Handling call
0709 13:09:55.196648 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:55.231965 (+ 35317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:55.232158 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:55.195024  2502 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:09:55.235874 31116 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.004s	sys 0.009s
I20260709 13:09:55.240568  2507 raft_consensus.cc:493] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:55.219326  2487 raft_consensus.cc:2804] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:55.197101  2426 raft_consensus.cc:2749] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:55.195677  1926 raft_consensus.cc:2749] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:55.219074  2165 raft_consensus.cc:2804] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:55.322247 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:55.273404 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:55.325922 31147 raft_consensus.cc:2468] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 8.
I20260709 13:09:55.276643 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:55.273252 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:55.219483  2373 raft_consensus.cc:2804] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:55.225502  2461 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:55.336529  2360 consensus_meta.cc:287] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 1.251s	user 0.018s	sys 0.039s
I20260709 13:09:55.337098  2360 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:55.236845  2374 consensus_queue.cc:1048] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.104s
I20260709 13:09:55.342252  2373 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:55.342814  2373 raft_consensus.cc:3060] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:55.348064 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 470241us
I20260709 13:09:55.248180 30476 raft_consensus.cc:1275] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:55.239727 30467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 998) took 1204 ms. Trace:
I20260709 13:09:55.236120  2098 raft_consensus.cc:697] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 9 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
W20260709 13:09:55.267387 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 465708us
I20260709 13:09:55.274030 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:55.326115 30617 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 11.
I20260709 13:09:55.250016 30472 raft_consensus.cc:1275] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:09:55.226894  2492 consensus_queue.cc:1048] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:09:55.331054  2371 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:55.274768  2487 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:55.348711 30517 leader_election.cc:336] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.113s (SENT)
I20260709 13:09:55.348871 30467 rpcz_store.cc:276] 0709 13:09:54.035405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.238664 (+1203259us) service_pool.cc:224] Handling call
0709 13:09:55.238974 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:55.239360 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:55.239396 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:55.239451 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:55.239492 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:55.239556 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:55.239667 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:55.411176 30467 raft_consensus.cc:1240] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:55.250613 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:55.249642  2376 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:55.328794 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 61267.1us
I20260709 13:09:55.237138  2494 raft_consensus.cc:2804] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:09:55.250137 31116 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.005s	sys 0.009s
I20260709 13:09:55.348419  2165 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.354797 30589 leader_election.cc:304] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:55.357663  2314 raft_consensus.cc:493] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:55.238591  2339 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:55.276081  2180 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.272078  2477 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.279372 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:55.353107 30476 raft_consensus.cc:1275] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:09:55.414031 31147 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67"
dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
mode: GRACEFUL
new_leader_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:42956
I20260709 13:09:55.414228 30467 raft_consensus.cc:1275] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:09:55.355724 30474 raft_consensus.cc:2368] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 9. Current term is 10.
W20260709 13:09:55.417227 30591 leader_election.cc:336] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.750s (SENT)
I20260709 13:09:55.352849  2360 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:55.248865  2486 consensus_queue.cc:1048] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.162s
I20260709 13:09:55.419824 30471 raft_consensus.cc:1275] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:09:55.465338 30471 pending_rounds.cc:85] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326: Aborting all ops after (but not including) 3
I20260709 13:09:55.465474 30467 raft_consensus.cc:1240] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
W20260709 13:09:55.425623 30588 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.020s	sys 0.062s
W20260709 13:09:55.466135 30588 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.020s	sys 0.062s
W20260709 13:09:55.426477 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 71747.8us
I20260709 13:09:55.359915 30472 raft_consensus.cc:1240] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:55.467662 30589 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
W20260709 13:09:55.429242  2390 consensus_meta.cc:287] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.630s	user 0.009s	sys 0.000s
I20260709 13:09:55.469437 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:55.470386 31148 raft_consensus.cc:2393] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 11: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
W20260709 13:09:55.428575 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 79889.4us
W20260709 13:09:55.471165 30517 leader_election.cc:336] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.122s (SENT)
I20260709 13:09:55.471642 30517 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:55.473538 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:55.475193 30589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.250315  2419 raft_consensus.cc:2804] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:55.249317  2413 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:55.414778  2310 consensus_meta.cc:287] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 1.245s	user 0.005s	sys 0.015s
I20260709 13:09:55.432476 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:55.432904 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:55.277947  2507 raft_consensus.cc:515] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:55.431090  2494 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.497066 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:55.504504 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:55.505076 31148 raft_consensus.cc:3060] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:55.408221  2371 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:55.436015 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:55.461802 30591 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:55.461213 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:09:55.507725 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 90542.3us
I20260709 13:09:55.462560 30473 raft_consensus.cc:2410] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
W20260709 13:09:55.437389 31115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.461817 31147 raft_consensus.cc:606] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Received request to transfer leadership to TS 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:55.512768 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:55.463683 30625 raft_consensus.cc:1275] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:55.465605 30471 pending_rounds.cc:107] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326: Aborting uncommitted NO_OP operation due to leader change: 6.4
W20260709 13:09:55.514403 30474 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2429) took 1710 ms (client timeout 1538 ms). Trace:
I20260709 13:09:55.424095  2230 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.511674 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:09:55.425176 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 700526us
I20260709 13:09:55.537065 31116 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:55.538164 31116 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:55.539129 30591 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:55.476617 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:55.245869  2284 raft_consensus.cc:2804] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:55.546250 30621 raft_consensus.cc:1275] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:09:55.546588 30623 raft_consensus.cc:2393] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 8: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:55.546475 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:55.467666 30476 raft_consensus.cc:1240] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 13. Current term is 14. Ops: []
W20260709 13:09:55.484299 30545 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.004s	sys 0.062s
W20260709 13:09:55.491468  2367 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.005s	sys 0.014s
I20260709 13:09:55.277654  2502 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:55.488184 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:55.490636 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:55.567149 30549 raft_consensus.cc:2468] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7.
I20260709 13:09:55.490885 30618 raft_consensus.cc:1275] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:55.568352  2502 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:55.435137 30617 raft_consensus.cc:1240] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:55.246058  2072 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:55.570631  2072 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:55.412951  2487 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:55.428318  2165 raft_consensus.cc:3060] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:55.501087  2477 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:55.575043  2477 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:55.437693  2426 raft_consensus.cc:2804] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:55.575613  2426 raft_consensus.cc:493] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:55.576043  2426 raft_consensus.cc:3060] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:55.503428  2360 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.577490  2360 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:55.512794 31147 raft_consensus.cc:614] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:55.514786 30471 raft_consensus.cc:2889] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:55.514899 30474 rpcz_store.cc:269] 0709 13:09:53.804210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.400029 (+595819us) service_pool.cc:224] Handling call
0709 13:09:55.505396 (+1105367us) spinlock_profiling.cc:243] Waited 636 ms on lock 0x7b54001216d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:55.514318 (+  8922us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1461846400}
I20260709 13:09:55.459743  1926 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.581976  1926 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:55.539621 31116 leader_election.cc:304] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:55.547825 30547 raft_consensus.cc:2393] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 11: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:55.485025 30624 raft_consensus.cc:1240] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 LEADER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 6. Current term is 7. Ops: []
W20260709 13:09:55.547854 30545 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.004s	sys 0.062s
I20260709 13:09:55.583662  2325 raft_consensus.cc:2804] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:55.585166  2325 raft_consensus.cc:697] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 8 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:55.585314  2380 raft_consensus.cc:2749] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:55.586570  2360 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:55.553508 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:55.554332 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:55.551365 30591 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:55.504524  2310 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:55.587692 30621 raft_consensus.cc:2410] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:09:55.589133  2310 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:55.558488  2507 leader_election.cc:290] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:55.490633  2379 raft_consensus.cc:2749] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:55.485857  2419 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:55.590351  2419 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:55.490743  2413 raft_consensus.cc:3060] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:55.514107  2494 raft_consensus.cc:3060] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:55.559656 30622 raft_consensus.cc:2410] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:09:55.503917 30441 connection.cc:256] RPC call timeout handler was delayed by -2.2466568879999613s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15100000000000002s for a response
W20260709 13:09:55.649632 30441 connection.cc:256] RPC call timeout handler was delayed by -2.0810568880000346s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1694s for a response
W20260709 13:09:55.650094 30441 connection.cc:256] RPC call timeout handler was delayed by -2.0702568880000172s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1706s for a response
I20260709 13:09:55.564673  2479 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:55.485651  2098 consensus_queue.cc:237] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:55.586165  2325 consensus_queue.cc:237] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:55.436919  2314 raft_consensus.cc:515] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:55.596258 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 56692.8us
I20260709 13:09:55.617944 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:55.618422 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:09:55.650449 30441 connection.cc:256] RPC call timeout handler was delayed by -1.9352568880000263s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18560000000000001s for a response
I20260709 13:09:55.464254  2180 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:55.554916  2367 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.006s	sys 0.014s
I20260709 13:09:55.661578 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:09:55.694324 30441 connection.cc:256] RPC call timeout handler was delayed by -1.6850568879999628s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2134s for a response
I20260709 13:09:55.591838  2430 raft_consensus.cc:2804] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:55.546486  2284 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.553606  2492 raft_consensus.cc:2749] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:09:55.700235 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 148940us
I20260709 13:09:55.712831 30441 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:55.714048 30441 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
W20260709 13:09:55.714604 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.701948 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:55.696230 31116 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:55.593147  2372 raft_consensus.cc:2749] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:55.492988  2390 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:55.707885 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:55.615828  2491 raft_consensus.cc:2804] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:55.715368 30617 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 10.
I20260709 13:09:55.657809  2505 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.717121 30441 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:55.717844 31116 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:55.720034  2430 raft_consensus.cc:697] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 11 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:55.728087  2512 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.734449  2339 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:55.734889  2512 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:55.734930  2430 consensus_queue.cc:237] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:55.737038  2512 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:55.737558  2512 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.719960  2201 raft_consensus.cc:2804] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:55.719533  2448 raft_consensus.cc:2804] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:09:55.732102 30591 leader_election.cc:336] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.028s (SENT)
I20260709 13:09:55.722229 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:55.739365 30591 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:55.719285 30441 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:55.721804 30545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 2149) took 1369 ms. Trace:
I20260709 13:09:55.741096 30619 raft_consensus.cc:1275] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:09:55.723623 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:55.728246 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:55.723220 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:55.736030 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:55.743229 30622 raft_consensus.cc:2468] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 10.
I20260709 13:09:55.744377 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:55.726140 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:55.737978  2512 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:55.746826 31148 raft_consensus.cc:2468] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9.
I20260709 13:09:55.719605 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:55.744705 31115 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:55.555065  2230 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:55.690238  2072 raft_consensus.cc:2749] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:55.756927 30624 raft_consensus.cc:1240] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:55.716220  2284 raft_consensus.cc:3060] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:55.661490  2502 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.690871  2516 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:55.740368 30545 rpcz_store.cc:276] 0709 13:09:54.628279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.628448 (+   169us) service_pool.cc:224] Handling call
0709 13:09:54.656923 (+ 28475us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:54.686948 (+ 30025us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:54.686995 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:54.687569 (+   574us) log.cc:844] Serialized 26 byte log entry
0709 13:09:55.585008 (+897439us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:55.585052 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:55.585143 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:55.721621 (+136478us) raft_consensus.cc:1685] finished
0709 13:09:55.721639 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:55.721751 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":27559,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":2875,"thread_start_us":834425,"threads_started":1,"wal-append.queue_time_us":1001285}
I20260709 13:09:55.791407 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:55.812155 31147 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483"
dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
mode: GRACEFUL
new_leader_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:42956
I20260709 13:09:55.738737  2477 raft_consensus.cc:493] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:55.739745  2360 raft_consensus.cc:2749] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:55.716763  2449 raft_consensus.cc:2749] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:55.820361 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:55.821578 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:55.827113 30621 raft_consensus.cc:2410] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:09:55.826325 30617 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 10.
I20260709 13:09:55.785467  2310 raft_consensus.cc:2749] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:55.774348  2359 raft_consensus.cc:2749] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:55.723265  2373 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:55.691160  2479 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:55.831923 31115 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:55.790872  2367 consensus_queue.cc:1048] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:09:55.848630 30621 raft_consensus.cc:1275] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:09:55.832792 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 361635us
I20260709 13:09:55.816229  2088 raft_consensus.cc:2804] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:55.773660  2505 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:55.870087 30517 leader_election.cc:336] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 3.363s (SENT)
I20260709 13:09:55.870596 30517 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:55.871276  2515 raft_consensus.cc:2804] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:55.871500  2416 raft_consensus.cc:2749] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:55.871848  2515 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:55.872308  2515 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:55.872485 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:55.873111 30545 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 10.
I20260709 13:09:55.873736 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:55.874123 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:55.874840 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:55.875238 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:55.875933 30545 raft_consensus.cc:3060] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:55.876185 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:55.876538 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:55.876427  2057 consensus_queue.cc:1048] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:55.877112 30551 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 10.
I20260709 13:09:55.877296 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:55.876118 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:55.879383 30544 raft_consensus.cc:1240] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:55.880537 30542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 2157) took 1117 ms. Trace:
I20260709 13:09:55.882934 30545 raft_consensus.cc:2468] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 10.
W20260709 13:09:55.883648 30517 leader_election.cc:336] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.194s (SENT)
I20260709 13:09:55.884498 30517 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:55.887360  2416 raft_consensus.cc:2749] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:55.845276  2330 raft_consensus.cc:2804] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:55.843369  2376 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:55.882644 30542 rpcz_store.cc:276] 0709 13:09:54.762880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.768006 (+  5126us) service_pool.cc:224] Handling call
0709 13:09:54.797726 (+ 29720us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:54.797918 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:55.140734 (+342816us) log.cc:844] Serialized 14 byte log entry
0709 13:09:55.872368 (+731634us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:55.872677 (+   309us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:55.878873 (+  6196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:55.879529 (+   656us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:55.880325 (+   796us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":444036,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":18629,"raft.queue_time_us":75056,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":35055,"thread_start_us":1033666,"threads_started":3,"wal-append.queue_time_us":572110}
I20260709 13:09:55.893487 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:55.896930  2373 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:55.897408  2415 consensus_meta.cc:287] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.878s	user 0.005s	sys 0.006s
I20260709 13:09:55.898630  2180 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:55.889570  2088 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:55.830049  2477 raft_consensus.cc:515] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:55.819558  2502 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:55.910517 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:55.869956  2072 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.914039 30622 raft_consensus.cc:2468] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 14.
W20260709 13:09:55.939502 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 220270us
I20260709 13:09:55.824190  2516 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:55.951412 30441 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:55.951930 30621 raft_consensus.cc:2468] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 10.
I20260709 13:09:55.957016 30517 leader_election.cc:304] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:55.947425  2461 consensus_meta.cc:287] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.584s	user 0.008s	sys 0.009s
I20260709 13:09:55.981158 30618 raft_consensus.cc:2468] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9.
I20260709 13:09:55.947978  2088 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:55.975076  2339 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.989749  2371 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:55.954308  2165 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:55.954643  2072 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:55.993775  2448 raft_consensus.cc:697] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 15 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:55.946947  2515 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:55.992300  2461 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:56.018606  2479 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:56.053694 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 335878us
I20260709 13:09:56.053699 30589 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:56.055297 30516 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:56.011849  2339 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:56.046794  2314 leader_election.cc:290] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:56.110941 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:56.051117  2390 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:56.063271  2525 log.cc:927] Time spent T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
I20260709 13:09:56.121567 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:56.121158 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:56.120806 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:09:56.108157  2520 log.cc:927] Time spent T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.255s	user 0.000s	sys 0.001s
I20260709 13:09:56.061864  2230 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:56.062516  2371 raft_consensus.cc:2804] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:56.126899 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:56.062865  2201 raft_consensus.cc:697] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 10 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:56.061331  2491 raft_consensus.cc:697] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 6 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:56.132428  2491 consensus_queue.cc:237] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:56.133800  2516 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:56.135255  2379 raft_consensus.cc:2804] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:56.135954  2165 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:56.135852 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:56.139145 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:09:56.148331  2523 log.cc:927] Time spent T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
W20260709 13:09:56.149526  2539 log.cc:927] Time spent T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:09:56.148506  2201 consensus_queue.cc:237] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:56.152940 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:09:56.130648  2521 log.cc:927] Time spent T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 13:09:56.130280  2371 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.065147  2365 consensus_queue.cc:1048] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 13:09:56.128871  2512 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:09:56.148341  2531 log.cc:927] Time spent T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:09:56.166002 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:56.168257 31143 raft_consensus.cc:2368] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 11. Current term is 12.
I20260709 13:09:56.165169  2371 raft_consensus.cc:3060] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:56.170140  2461 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:56.125917  2448 consensus_queue.cc:237] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:56.167157  2505 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:56.162016  2413 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:56.190055  2551 log.cc:927] Time spent T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:09:56.208308 30551 raft_consensus.cc:1240] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:09:56.210492 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:56.211205 31142 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:56.211565  2339 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:56.212139 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:56.212838 30622 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 12.
I20260709 13:09:56.213735 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:56.214671 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:56.216820 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:56.217901 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:56.217698  2284 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:56.218458 30621 raft_consensus.cc:2468] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 13.
I20260709 13:09:56.218740 31142 raft_consensus.cc:2468] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 11.
I20260709 13:09:56.219230 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:09:56.223260  2426 consensus_meta.cc:287] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.647s	user 0.022s	sys 0.013s
W20260709 13:09:56.227360  2419 consensus_meta.cc:287] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.636s	user 0.006s	sys 0.002s
I20260709 13:09:56.118980  2487 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:56.227955 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 352199us
I20260709 13:09:56.170207  2072 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:56.215582 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:56.240655 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:56.254345 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:56.256956 31151 raft_consensus.cc:2393] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 11: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:56.257228 31144 raft_consensus.cc:1240] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 8 LEADER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:56.227880  2477 leader_election.cc:290] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:56.223675  2426 raft_consensus.cc:515] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:56.252476  2540 log.cc:927] Time spent T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:09:56.262526 30468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 994) took 2557 ms. Trace:
I20260709 13:09:56.265105 30468 rpcz_store.cc:276] 0709 13:09:53.705487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.159250 (+1453763us) service_pool.cc:224] Handling call
0709 13:09:55.159566 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:55.159777 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:09:55.555752 (+395975us) log.cc:844] Serialized 14 byte log entry
0709 13:09:56.262188 (+706436us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:56.262241 (+    53us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:56.262288 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.262350 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.262473 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":381635,"prepare.queue_time_us":500116,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"thread_start_us":672388,"threads_started":2,"wal-append.queue_time_us":448869}
I20260709 13:09:56.272792 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:56.273639 31148 raft_consensus.cc:2468] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
I20260709 13:09:56.282594 31148 raft_consensus.cc:1240] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:09:56.241370  2419 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:56.272694  2546 log.cc:927] Time spent T 00000000000000000000000000000000 P 045170a35afe4845987482e49e9e1eb9: Append to log took a long time: real 0.148s	user 0.001s	sys 0.001s
I20260709 13:09:56.289531 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:56.289748 31145 raft_consensus.cc:1275] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:56.287295 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:56.271915  2461 raft_consensus.cc:2749] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:09:56.283154  2548 log.cc:927] Time spent T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:09:56.294510 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:56.295833  2487 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:56.307514 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:56.307919 31149 raft_consensus.cc:3060] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:56.296330  2088 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:56.297719  2515 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:56.298163  2426 leader_election.cc:290] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:56.306856 30590 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:56.319348 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:56.320273 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:56.327775 30590 leader_election.cc:400] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Vote denied by peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453) with higher term. Message: Invalid argument: T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 11. Current term is 12.
I20260709 13:09:56.328326 30590 leader_election.cc:403] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:56.344481 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:56.345387 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:56.350507  1926 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:56.355077 30473 raft_consensus.cc:1240] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:56.411144 31142 raft_consensus.cc:1240] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:56.410282 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:56.403126 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
W20260709 13:09:56.406607 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 75479.1us
I20260709 13:09:56.404309 30475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 995) took 2698 ms. Trace:
I20260709 13:09:56.425109 30475 rpcz_store.cc:276] 0709 13:09:53.705753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.160245 (+1454492us) service_pool.cc:224] Handling call
0709 13:09:55.160989 (+   744us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:55.161158 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:09:55.506915 (+345757us) log.cc:844] Serialized 14 byte log entry
0709 13:09:56.351906 (+844991us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:56.403866 (+ 51960us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:56.403965 (+    99us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.404065 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.404237 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":297531,"prepare.queue_time_us":501891,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":41,"raft.queue_time_us":315329,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":4286,"spinlock_wait_cycles":3513600,"thread_start_us":854631,"threads_started":3,"wal-append.queue_time_us":619193}
W20260709 13:09:56.429329 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 76804.1us
I20260709 13:09:56.430210 30590 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
W20260709 13:09:56.436822 30589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.335451  2330 raft_consensus.cc:697] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 11 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:56.355796  2316 raft_consensus.cc:2749] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:56.440418  2540 log.cc:927] Time spent T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:09:56.437628  2510 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:09:56.447638 30590 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:56.491128 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 43563us
I20260709 13:09:56.336061  2413 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:56.460690 31149 raft_consensus.cc:2468] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 11.
I20260709 13:09:56.463728 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:56.324393  2461 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:09:56.466547  2558 log.cc:927] Time spent T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 13:09:56.467132 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:56.470824 30469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 2455) took 1655 ms. Trace:
W20260709 13:09:56.473181  2559 log.cc:927] Time spent T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:09:56.473524  2512 raft_consensus.cc:2804] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:56.480482  2371 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:56.485045  2419 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:56.486881  2088 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:56.492571 30474 raft_consensus.cc:3060] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:56.409116 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 457721us
I20260709 13:09:56.436655  2554 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.500056 30469 rpcz_store.cc:276] 0709 13:09:54.815884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.331663 (+515779us) service_pool.cc:224] Handling call
0709 13:09:55.332029 (+   366us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:09:55.332450 (+   421us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:55.332481 (+    31us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:09:55.333082 (+   601us) log.cc:844] Serialized 78 byte log entry
0709 13:09:55.786795 (+453713us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:55.827526 (+ 40731us) log.cc:844] Serialized 14 byte log entry
0709 13:09:55.844490 (+ 16964us) log.cc:844] Serialized 14 byte log entry
0709 13:09:55.851833 (+  7343us) log.cc:844] Serialized 14 byte log entry
0709 13:09:56.224883 (+373050us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b180033e560. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780df5c0a 00007fc78a535219 00007fc780e7da40 00007fc780e784e4 00007fc780e78455 00007fc783f60060 00007fc783f72716 00007fc783f83287 00007fc783f83208
0709 13:09:56.225043 (+   160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.225193 (+   150us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:56.346697 (+121504us) spinlock_profiling.cc:243] Waited 20.3 ms on lock 0x7b180033e560. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e7b522 00007fc780e7d7c1 00007fc780e7d779 00007fc780e7d709 00007fc780e7d6d1 00007fc780e7c9cd 000000000038f354 000000000038f199 00007fc780e5e83a
0709 13:09:56.467926 (+121229us) spinlock_profiling.cc:243] Waited 22.4 ms on lock 0x7b180033e560. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e7b3f3 00007fc780e7d7c1 00007fc780e7d779 00007fc780e7d709 00007fc780e7d6d1 00007fc780e7c9cd 000000000038f354 000000000038f199 00007fc780e5e83a
0709 13:09:56.470594 (+  2668us) raft_consensus.cc:1685] finished
0709 13:09:56.470620 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.470765 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37624,"prepare.queue_time_us":161696,"prepare.run_cpu_time_us":154,"prepare.run_wall_time_us":3435,"raft.queue_time_us":446530,"raft.run_cpu_time_us":465,"raft.run_wall_time_us":85883,"spinlock_wait_cycles":206047744,"thread_start_us":453335,"threads_started":1,"wal-append.queue_time_us":619825}
I20260709 13:09:56.502352 30624 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:56.317066  2072 consensus_queue.cc:1059] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.126s
I20260709 13:09:56.500857  2477 raft_consensus.cc:2804] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:56.550933 30620 raft_consensus.cc:2393] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 8: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
W20260709 13:09:56.565310 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 172519us
I20260709 13:09:56.581336  2371 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:56.553998  2560 log.cc:927] Time spent T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:09:56.546315  2512 raft_consensus.cc:697] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:56.549489  2477 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:09:56.587908  2494 consensus_meta.cc:287] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.889s	user 0.005s	sys 0.009s
I20260709 13:09:56.533370  2461 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:56.597460 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:56.602021 30475 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:56.548621  2554 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:56.599648 30616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 964) took 1131 ms. Trace:
I20260709 13:09:56.595975  2487 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
W20260709 13:09:56.600394 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 56085.6us
I20260709 13:09:56.603120  2515 consensus_queue.cc:1059] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:56.609902 30470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 996) took 2903 ms. Trace:
I20260709 13:09:56.610960 30474 raft_consensus.cc:2468] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 12.
I20260709 13:09:56.590147  2477 raft_consensus.cc:3060] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:56.589885  2330 consensus_queue.cc:237] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:56.620635 30624 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 11.
I20260709 13:09:56.613763 30616 rpcz_store.cc:276] 0709 13:09:55.468269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.468443 (+   174us) service_pool.cc:224] Handling call
0709 13:09:55.468697 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:55.468874 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:09:55.852031 (+383157us) log.cc:844] Serialized 14 byte log entry
0709 13:09:56.598541 (+746510us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b18003631c0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc783b104bc 00007fc780e5e48b 00007fc789cb8ab9 00007fc780e7a69b 00007fc780e7893f 00007fc780e7ac02 00007fc783b0220b 00007fc783b07d23 00007fc783b0823a
0709 13:09:56.599048 (+   507us) log.cc:844] Serialized 14 byte log entry
0709 13:09:56.599256 (+   208us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:56.599309 (+    53us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:56.599366 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.599448 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.599586 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":513306,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":56,"raft.queue_time_us":178,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":11160,"spinlock_wait_cycles":80258304,"thread_start_us":516822,"threads_started":2,"wal-append.queue_time_us":269723}
I20260709 13:09:56.618075 30441 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:56.670465 30475 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 11.
W20260709 13:09:56.734285 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 116322us
I20260709 13:09:56.739126 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:56.739993 30476 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 13.
I20260709 13:09:56.740954 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:56.742338 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:56.742389 30591 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:56.742969 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:56.614259 30470 rpcz_store.cc:276] 0709 13:09:53.706027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.165668 (+1459641us) service_pool.cc:224] Handling call
0709 13:09:55.224087 (+ 58419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:55.224265 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:09:55.542648 (+318383us) log.cc:844] Serialized 14 byte log entry
0709 13:09:56.315029 (+772381us) log.cc:844] Serialized 14 byte log entry
0709 13:09:56.609642 (+294613us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:56.609696 (+    54us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:56.609740 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.609784 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.609857 (+    73us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":638257,"prepare.queue_time_us":511582,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":11655,"raft.queue_time_us":644613,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":931,"spinlock_wait_cycles":3555584,"thread_start_us":681455,"threads_started":3,"wal-append.queue_time_us":517342}
I20260709 13:09:56.744551 30591 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:56.745182 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:56.745548 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:56.745827 30624 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:56.747391 30474 raft_consensus.cc:2410] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:09:56.749220 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:56.750026 30476 raft_consensus.cc:2468] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 13.
I20260709 13:09:56.751451 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:56.648314  2554 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:56.755287 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:56.758263 30468 raft_consensus.cc:2368] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 11. Current term is 12.
I20260709 13:09:56.760426 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:56.601413  2494 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:56.756757  2426 consensus_queue.cc:1048] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:09:56.747431  2371 consensus_queue.cc:1059] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:09:56.759804  2491 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.614527  2487 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:56.772495  2491 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:56.774698  2487 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:56.775094  2491 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:56.753285  1926 raft_consensus.cc:2749] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:56.648593  2512 consensus_queue.cc:237] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:56.781040  2461 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:56.748718  2201 raft_consensus.cc:2749] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:56.744999  2310 raft_consensus.cc:2749] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:56.786746 30470 raft_consensus.cc:3055] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:56.787215 30470 raft_consensus.cc:740] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:56.790122 31147 raft_consensus.cc:606] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Received request to transfer leadership to TS 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:56.762091  2379 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:56.824955 30624 raft_consensus.cc:2468] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 11.
I20260709 13:09:56.830912 30470 consensus_queue.cc:260] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:56.825958 31147 raft_consensus.cc:614] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:56.832140 30470 raft_consensus.cc:3060] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:56.832422 31150 raft_consensus.cc:2393] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 10: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:56.832782 31115 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:56.835140  2568 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:56.836838  2568 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:56.838610 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:56.839200 30624 raft_consensus.cc:2468] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 10.
I20260709 13:09:56.842581 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:56.831331  2379 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:56.842105 30440 leader_election.cc:336] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Timed out: RequestConsensusVote RPC to 127.28.173.2:34733 timed out after 1.507s (SENT)
I20260709 13:09:56.853385 31115 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:56.849886 30441 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.850203 30470 raft_consensus.cc:1275] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:09:56.855836 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:56.856086 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:56.856541 30470 raft_consensus.cc:2468] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
I20260709 13:09:56.856673 30475 raft_consensus.cc:2468] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
I20260709 13:09:56.857851 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:56.859473 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:56.860248 30476 raft_consensus.cc:2393] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 9: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:56.858932 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:56.860611 30441 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:56.861934 30441 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:56.872212 30475 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:56.835937  2491 raft_consensus.cc:2804] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:56.874486  2547 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.876111 30441 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:56.876492  2547 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:56.877400 30441 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:56.878475  2569 raft_consensus.cc:2804] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:56.878793  2547 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:56.879091  2569 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:56.876873 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:56.879456  2547 raft_consensus.cc:2749] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:56.880302  2563 raft_consensus.cc:2749] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:56.891785 30468 raft_consensus.cc:2468] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
I20260709 13:09:56.893149  2568 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:56.893666 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:56.894344 30468 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 14.
I20260709 13:09:56.894733  2502 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:56.896132 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:56.896497  2374 raft_consensus.cc:2804] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:56.896948  2374 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.897038 30473 raft_consensus.cc:2410] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:09:56.897388  2374 raft_consensus.cc:3060] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:56.874619  2310 consensus_queue.cc:1048] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.024s
W20260709 13:09:56.899747 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 45497us
I20260709 13:09:56.900257 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:56.900420  2491 raft_consensus.cc:697] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 11 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:56.901743  2491 consensus_queue.cc:237] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:56.902582  2372 consensus_queue.cc:1048] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:56.879604  2569 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:56.905028 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:56.907205 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:56.907449 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:56.908121 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:56.908610 30476 raft_consensus.cc:2468] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 14.
I20260709 13:09:56.906822 30590 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:56.888317  2566 log.cc:927] Time spent T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 13:09:56.911913  2510 raft_consensus.cc:2749] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453) with higher term. Message: Invalid argument: T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 11. Current term is 12.
I20260709 13:09:56.913690 30622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 976) took 1035 ms. Trace:
I20260709 13:09:56.913810  2310 raft_consensus.cc:2804] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:56.880081 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:56.914060 30622 rpcz_store.cc:276] 0709 13:09:55.878641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.243756 (+365115us) service_pool.cc:224] Handling call
0709 13:09:56.244133 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:56.245697 (+  1564us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:56.245726 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:56.258386 (+ 12660us) log.cc:844] Serialized 26 byte log entry
0709 13:09:56.409668 (+151282us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:56.409712 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.409786 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:56.913479 (+503693us) raft_consensus.cc:1685] finished
0709 13:09:56.913499 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.913636 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1105,"raft.queue_time_us":1196,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":4882,"thread_start_us":127354,"threads_started":1,"wal-append.queue_time_us":332416}
I20260709 13:09:56.915686 30474 raft_consensus.cc:2393] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 13: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:56.876428 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:56.874737  2564 raft_consensus.cc:2749] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:56.916769 30469 raft_consensus.cc:2468] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 13.
I20260709 13:09:56.895251 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:56.877449 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:56.918124 31147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:42956 (request call id 13) took 1174 ms. Trace:
I20260709 13:09:56.918483 31147 rpcz_store.cc:276] 0709 13:09:55.743693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.743931 (+   238us) service_pool.cc:224] Handling call
0709 13:09:56.917939 (+1174008us) spinlock_profiling.cc:243] Waited 973 ms on lock 0x7b5400050354. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f62853 00007fc788f3060a 00007fc7824b67d4 00007fc7824b6762 00007fc7824b6691 00007fc7824b660c 00007fc7824b58c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:56.918043 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2238701440}
I20260709 13:09:56.884616  1926 consensus_queue.cc:1059] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:09:56.923010 30621 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 12.
I20260709 13:09:56.924645 31150 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48412 (request call id 802) took 1437 ms. Trace:
I20260709 13:09:56.915994 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:56.926733 31150 rpcz_store.cc:276] 0709 13:09:55.487647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.487881 (+   234us) service_pool.cc:224] Handling call
0709 13:09:56.924464 (+1436583us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b5400050354. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:56.924584 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2909525376}
I20260709 13:09:56.927033 30622 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 14.
I20260709 13:09:56.930269 30475 raft_consensus.cc:2468] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 11.
I20260709 13:09:56.931259 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:56.918525 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:56.933954 30622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47446 (request call id 2540) took 1023 ms. Trace:
I20260709 13:09:56.934705 31146 raft_consensus.cc:1240] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 11 LEADER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:09:56.934322 30622 rpcz_store.cc:276] 0709 13:09:55.910749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.933124 (+1022375us) service_pool.cc:224] Handling call
0709 13:09:56.933443 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:56.933647 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:56.933671 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:56.933714 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:56.933750 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.933809 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.933905 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:56.935607 30616 raft_consensus.cc:1240] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 LEADER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:56.935994 31149 raft_consensus.cc:1275] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:56.937335 30624 raft_consensus.cc:1240] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:09:56.943488  2569 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:56.946295  2569 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:56.969925 30624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42"
dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
mode: GRACEFUL
new_leader_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:49382
I20260709 13:09:56.933280  2372 consensus_queue.cc:1059] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:09:56.973870  2372 consensus_queue.cc:1243] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer cd669586cff44d4bbfcc007e213faab6 log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:09:56.971488 30624 raft_consensus.cc:606] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Received request to transfer leadership to TS 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:56.975646 30624 raft_consensus.cc:614] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:56.984222 30625 raft_consensus.cc:1240] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:09:56.985807 30551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43088 (request call id 2259) took 1111 ms. Trace:
I20260709 13:09:56.986258 30551 rpcz_store.cc:276] 0709 13:09:55.874506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.877691 (+  3185us) service_pool.cc:224] Handling call
0709 13:09:55.877963 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:56.208982 (+331019us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.985470 (+776488us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b54002585d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:56.985727 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":706678016}
I20260709 13:09:56.992651  2580 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:56.993253  2580 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:56.993623 29364 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:56.994527  2284 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:56.995426 29364 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:56.995800  2580 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:56.997182  2426 raft_consensus.cc:3055] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:56.997682  2426 raft_consensus.cc:740] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:56.998780  2426 consensus_queue.cc:260] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:57.034106  2426 raft_consensus.cc:3060] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:57.036412  2544 raft_consensus.cc:993] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6: : Instructing follower f639301059e24dc5b0d88a46dc683326 to start an election
I20260709 13:09:57.039062  2284 raft_consensus.cc:1081] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 9 LEADER]: Signalling peer f639301059e24dc5b0d88a46dc683326 to start an election
W20260709 13:09:57.003577  2545 log.cc:927] Time spent T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.830s	user 0.001s	sys 0.011s
I20260709 13:09:57.024881  2477 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:57.057996 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 180657us
I20260709 13:09:56.992285  2374 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:57.060374  2310 raft_consensus.cc:697] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:57.072664  2310 consensus_queue.cc:237] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:57.073587  2374 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:57.075120  2494 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:57.060853  2330 consensus_queue.cc:1048] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:57.061599 30441 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:57.078579 30441 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:57.079927  2461 raft_consensus.cc:2749] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:57.080592  2461 consensus_queue.cc:1048] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:57.080709  2512 consensus_queue.cc:1059] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:57.081355  2512 consensus_queue.cc:1243] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer cd669586cff44d4bbfcc007e213faab6 log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:09:57.081923  2098 raft_consensus.cc:2749] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:57.082049  2583 consensus_queue.cc:1059] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:57.082926  2461 raft_consensus.cc:3055] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:57.083271  2461 raft_consensus.cc:740] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:57.083582 30441 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:57.084056  2461 consensus_queue.cc:260] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:57.030534  2379 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:57.070241 30618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36130 (request call id 2092) took 1344 ms. Trace:
I20260709 13:09:57.085456  2461 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:57.085740 30618 rpcz_store.cc:276] 0709 13:09:55.725798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.725901 (+   103us) service_pool.cc:224] Handling call
0709 13:09:57.070031 (+1344130us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b5400163ad4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:57.070148 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":541867264}
I20260709 13:09:57.086899  2330 raft_consensus.cc:2749] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:57.088275 30618 raft_consensus.cc:1240] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:57.076958  2505 raft_consensus.cc:3055] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:57.088780  2505 raft_consensus.cc:740] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:57.089570  2505 consensus_queue.cc:260] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:57.090835  2505 raft_consensus.cc:3060] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:57.092247 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:57.088218 30441 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:57.108937 30441 leader_election.cc:304] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:57.089500  2379 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:57.110296 30621 raft_consensus.cc:1275] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:57.110596 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:57.111204 30548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 898) took 2065 ms. Trace:
I20260709 13:09:57.111470 30467 raft_consensus.cc:1275] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:57.089612  2477 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:57.095889 30625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 977) took 1194 ms. Trace:
I20260709 13:09:57.115073 30625 rpcz_store.cc:276] 0709 13:09:55.901805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.474173 (+572368us) service_pool.cc:224] Handling call
0709 13:09:56.983898 (+509725us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:56.984820 (+   922us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:57.095684 (+110864us) spinlock_profiling.cc:243] Waited 509 ms on lock 0x7b54001e3050. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f678ad 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:57.095830 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1171203840}
I20260709 13:09:57.100450 30623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 967) took 1553 ms. Trace:
W20260709 13:09:57.103685 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 1.14666e+06us
I20260709 13:09:57.104867  2534 raft_consensus.cc:2804] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:57.073202 30619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 969) took 1341 ms. Trace:
I20260709 13:09:57.069442 30616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47446 (request call id 2539) took 1161 ms. Trace:
I20260709 13:09:57.118227 30517 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:57.118484 30616 rpcz_store.cc:276] 0709 13:09:55.907734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.658784 (+751050us) service_pool.cc:224] Handling call
0709 13:09:56.659142 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:56.937032 (+277890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:57.069183 (+132151us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b5400203354. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:57.069380 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":635356032}
I20260709 13:09:57.118018 30619 rpcz_store.cc:276] 0709 13:09:55.732164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.824160 (+ 91996us) service_pool.cc:224] Handling call
0709 13:09:57.072220 (+1248060us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:57.072390 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:57.072418 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:57.072460 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:57.072489 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:57.072543 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:57.073041 (+   498us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b5400163ad0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f678ad 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:57.073137 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2866641664}
I20260709 13:09:57.120244 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:57.122888 30618 raft_consensus.cc:3060] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:57.123790 31149 raft_consensus.cc:2468] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
I20260709 13:09:57.111559 30548 rpcz_store.cc:276] 0709 13:09:55.045343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.051880 (+  6537us) service_pool.cc:224] Handling call
0709 13:09:55.052184 (+   304us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:55.052570 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:55.428715 (+376145us) log.cc:844] Serialized 14 byte log entry
0709 13:09:55.890128 (+461413us) log.cc:844] Serialized 14 byte log entry
0709 13:09:55.890277 (+   149us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:55.906845 (+ 16568us) log.cc:844] Serialized 52 byte log entry
0709 13:09:55.906985 (+   140us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:55.907209 (+   224us) log.cc:844] Serialized 14 byte log entry
0709 13:09:56.349324 (+442115us) spinlock_profiling.cc:243] Waited 3.52 ms on lock 0x7b18003be7e0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780df5c0a 00007fc78a535219 00007fc787e3c58f 00007fc780e7b571 00007fc780e7d7c1 00007fc780e7d779 00007fc780e7d709 00007fc780e7d6d1 00007fc780e7c9cd
0709 13:09:56.936691 (+587367us) spinlock_profiling.cc:243] Waited 34 ms on lock 0x7b18003be7e0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e7b557 00007fc780e7d7c1 00007fc780e7d779 00007fc780e7d709 00007fc780e7d6d1 00007fc780e7c9cd 000000000038f354 000000000038f199 00007fc780e5e83a
0709 13:09:57.110928 (+174237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:57.110995 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:57.111035 (+    40us) raft_consensus.cc:1685] finished
0709 13:09:57.111048 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:57.111155 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1294239,"prepare.queue_time_us":1368222,"prepare.run_cpu_time_us":124,"prepare.run_wall_time_us":128,"raft.queue_time_us":13301,"raft.run_cpu_time_us":396,"raft.run_wall_time_us":55514,"spinlock_wait_cycles":86215936,"thread_start_us":734050,"threads_started":2,"wal-append.queue_time_us":662593}
I20260709 13:09:57.127162 30441 leader_election.cc:304] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:57.107744  2573 log.cc:927] Time spent T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.669s	user 0.010s	sys 0.006s
I20260709 13:09:57.132730 31116 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:09:57.116206 30623 rpcz_store.cc:276] 0709 13:09:55.546761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.555739 (+  8978us) service_pool.cc:224] Handling call
0709 13:09:55.556006 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:55.567160 (+ 11154us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:55.907375 (+340215us) log.cc:844] Serialized 14 byte log entry
0709 13:09:56.050755 (+143380us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:56.050818 (+    63us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:56.050872 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.223118 (+172246us) spinlock_profiling.cc:243] Waited 5.77 ms on lock 0x7b18003630a0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e7b3f3 00007fc780e7d7c1 00007fc780e7d779 00007fc780e7d709 00007fc780e7d6d1 00007fc780e7c9cd 000000000038f354 000000000038f199 00007fc780e5e83a
0709 13:09:57.100203 (+877085us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b54002debd4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:57.100259 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:57.100391 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52736,"prepare.queue_time_us":456536,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":302,"raft.queue_time_us":5573,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"spinlock_wait_cycles":38438656,"thread_start_us":429656,"threads_started":2,"wal-append.queue_time_us":371616}
I20260709 13:09:57.137125 31116 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:57.132484 30550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 909) took 1328 ms. Trace:
I20260709 13:09:57.137924 30550 rpcz_store.cc:276] 0709 13:09:55.803755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.804025 (+   270us) service_pool.cc:224] Handling call
0709 13:09:55.827325 (+ 23300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:55.827511 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:09:55.849427 (+ 21916us) log.cc:844] Serialized 14 byte log entry
0709 13:09:57.132191 (+1282764us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:57.132241 (+    50us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:57.132281 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:57.132341 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:57.132434 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1122346,"prepare.queue_time_us":61545,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":57,"thread_start_us":160064,"threads_started":1,"wal-append.queue_time_us":196216}
I20260709 13:09:57.132668 30441 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:57.133220 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 130608us
I20260709 13:09:57.134016 30622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47446 (request call id 2541) took 1210 ms. Trace:
I20260709 13:09:57.141352 30441 leader_election.cc:304] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:57.124954  2534 raft_consensus.cc:493] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.142628 30441 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:57.142992  2534 raft_consensus.cc:3060] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:57.145233 30470 raft_consensus.cc:1275] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:57.131896  2515 consensus_queue.cc:1048] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
W20260709 13:09:57.148234 31151 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48412 (request call id 806) took 1530 ms (client timeout 1762 ms). Trace:
W20260709 13:09:57.148666 31151 rpcz_store.cc:269] 0709 13:09:55.617980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.618145 (+   165us) service_pool.cc:224] Handling call
0709 13:09:57.148028 (+1529883us) spinlock_profiling.cc:243] Waited 562 ms on lock 0x7b5400532854. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:09:57.148175 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1292428032}
I20260709 13:09:57.149946  2479 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.150460  2479 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:57.114702  2330 raft_consensus.cc:2749] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:57.125180  2579 consensus_queue.cc:1059] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:09:57.152495 30617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 970) took 1420 ms. Trace:
I20260709 13:09:57.152649  2579 raft_consensus.cc:3055] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:57.153036  2479 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:57.153115  2579 raft_consensus.cc:740] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:57.131883  2569 raft_consensus.cc:2749] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:57.153666  2479 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.154107  2479 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:57.154886  2430 raft_consensus.cc:3055] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:57.155275  2430 raft_consensus.cc:740] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:57.156059  2430 consensus_queue.cc:260] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:57.156843  2339 raft_consensus.cc:2804] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:57.156970  2328 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.157305  2339 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.157706  2339 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:57.157498  2328 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:57.155953 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 1.10061e+06us
I20260709 13:09:57.159499  2328 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:57.176477 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:57.176843 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:57.177191  2430 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:57.178366 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:57.159879 30616 raft_consensus.cc:1275] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:09:57.155927  2359 raft_consensus.cc:2804] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:57.180328 30549 raft_consensus.cc:1240] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:57.180473  2359 raft_consensus.cc:697] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 12 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:57.180670 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:57.181844 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:57.169668 30468 raft_consensus.cc:1275] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:09:57.136297  2567 log.cc:927] Time spent T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:09:57.162456 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:57.163374  2535 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:57.164002 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:57.210738 30548 raft_consensus.cc:2468] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 13.
I20260709 13:09:57.164116 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:57.164709  2547 raft_consensus.cc:2749] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:57.165146  2568 consensus_queue.cc:1048] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:57.209821  2328 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:57.165514  2496 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:57.165752  2554 raft_consensus.cc:2749] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:57.165943  2416 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.224082  2328 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:57.224226  2496 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:57.224610  2416 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:57.226317  2496 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:57.226392  2328 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:57.226675  2416 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:57.166188  2563 raft_consensus.cc:2804] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:57.227275  2563 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.167192 30475 raft_consensus.cc:1275] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:09:57.167255 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 49134.9us
I20260709 13:09:57.166345  2413 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:57.228533 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 45951.7us
I20260709 13:09:57.228694  2413 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:57.229635 30517 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:57.167860  2373 raft_consensus.cc:2749] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:57.168653 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:57.230765  2486 consensus_queue.cc:1059] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:57.231395 30549 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 14.
I20260709 13:09:57.169121 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:57.136722  2564 raft_consensus.cc:2749] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:57.163636 30547 raft_consensus.cc:1240] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:57.171224 30472 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130"
dest_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:60026
I20260709 13:09:57.168476 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:57.172037 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:57.172140 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:57.234700 30470 raft_consensus.cc:2393] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 10: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:57.156131  2230 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:57.172688 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:57.240715 30625 raft_consensus.cc:3060] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:57.175108 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:57.175737 30591 leader_election.cc:336] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.834s (SENT)
W20260709 13:09:57.242187 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 66485us
I20260709 13:09:57.152890 30617 rpcz_store.cc:276] 0709 13:09:55.732571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.830338 (+ 97767us) service_pool.cc:224] Handling call
0709 13:09:55.830695 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:55.867867 (+ 37172us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:56.287226 (+419359us) log.cc:844] Serialized 14 byte log entry
0709 13:09:56.352775 (+ 65549us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:56.353114 (+   339us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:56.353442 (+   328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:57.062127 (+708685us) spinlock_profiling.cc:243] Waited 3.05 ms on lock 0x7b1800363220. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e492a6 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e7b3f3 00007fc780e7d7c1
0709 13:09:57.063385 (+  1258us) spinlock_profiling.cc:243] Waited 2.24 ms on lock 0x7b1800363220. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e7b3f3 00007fc780e7d7c1 00007fc780e7d779 00007fc780e7d709 00007fc780e7d6d1 00007fc780e7c9cd 000000000038f354 000000000038f199 00007fc780e5e83a
0709 13:09:57.152296 (+ 88911us) spinlock_profiling.cc:243] Waited 36.9 ms on lock 0x7b540027f954. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:57.152344 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:57.152442 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20532,"prepare.queue_time_us":175368,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":1704,"raft.queue_time_us":62523,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":10132,"spinlock_wait_cycles":96987008,"thread_start_us":446142,"threads_started":2,"wal-append.queue_time_us":153521}
I20260709 13:09:57.184324 30441 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:57.243752 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 59537.8us
I20260709 13:09:57.244588 30441 leader_election.cc:304] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:57.185145 30551 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:57.134128 30624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47446 (request call id 2551) took 1108 ms. Trace:
I20260709 13:09:57.186153 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:57.245674 30618 raft_consensus.cc:2468] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 11.
I20260709 13:09:57.181500  2359 consensus_queue.cc:237] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:57.215907 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:57.257495 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:57.257792 30546 raft_consensus.cc:2468] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 5.
I20260709 13:09:57.243110 30516 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:57.216320 30621 raft_consensus.cc:1275] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:09:57.220177 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:57.258903 30621 pending_rounds.cc:85] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79: Aborting all ops after (but not including) 8
I20260709 13:09:57.259169 30621 pending_rounds.cc:107] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79: Aborting uncommitted NO_OP operation due to leader change: 10.9
W20260709 13:09:57.227221 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 90193.2us
I20260709 13:09:57.259418 30621 raft_consensus.cc:2889] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:57.227905  2563 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:57.227952  2494 raft_consensus.cc:2804] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:57.230927  2413 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:57.168450 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:57.233215 30472 raft_consensus.cc:493] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:57.277138 30472 raft_consensus.cc:3060] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:57.171909 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:57.234556 30550 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 13.
I20260709 13:09:57.233461 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:57.278649 30547 raft_consensus.cc:3060] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:57.245704 30624 rpcz_store.cc:276] 0709 13:09:56.025449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.997536 (+972087us) service_pool.cc:224] Handling call
0709 13:09:56.997832 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:56.998054 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:57.115126 (+117072us) log.cc:844] Serialized 14 byte log entry
0709 13:09:57.133848 (+ 18722us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:57.133888 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:57.133923 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:57.133976 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:57.134081 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":106,"prepare.queue_time_us":70098,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":3586,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"thread_start_us":134960,"threads_started":2,"wal-append.queue_time_us":14791}
I20260709 13:09:57.280299 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:57.250378 30543 raft_consensus.cc:2393] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 10: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:57.281447 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:57.281905 30620 raft_consensus.cc:1240] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 LEADER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:57.282405 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:57.219215  2534 raft_consensus.cc:515] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:57.251310 31115 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:57.254066 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:57.255722 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:57.209913  2477 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:57.259312 30616 raft_consensus.cc:2393] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 12: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:57.256567 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:57.262166 31150 raft_consensus.cc:1240] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 10. Current term is 11. Ops: []
W20260709 13:09:57.262869 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.258112  2230 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:57.265751 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:57.265751 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:57.270861 30441 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:57.248148  2496 consensus_queue.cc:1048] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:09:57.279322 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:57.283526 30617 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 13.
I20260709 13:09:57.278666 30517 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:57.277918 30619 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 14.
I20260709 13:09:57.284765 31146 raft_consensus.cc:2393] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 12: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:09:57.259792  2547 raft_consensus.cc:2804] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:57.287873 30618 raft_consensus.cc:2468] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9.
I20260709 13:09:57.290181 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:57.288225 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:57.262948 30516 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:57.276582  2583 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.247972  2380 consensus_queue.cc:1059] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:09:57.291791 30551 raft_consensus.cc:2468] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 11.
W20260709 13:09:57.322926 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 60077.4us
I20260709 13:09:57.233834  2535 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:57.339778 30543 raft_consensus.cc:2368] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 9. Current term is 10.
I20260709 13:09:57.301496 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:57.332967 30516 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:57.140667 30622 rpcz_store.cc:276] 0709 13:09:55.923494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.936545 (+1013051us) service_pool.cc:224] Handling call
0709 13:09:56.936808 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:56.936988 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:57.051576 (+114588us) log.cc:844] Serialized 14 byte log entry
0709 13:09:57.133721 (+ 82145us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:57.133772 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:57.133813 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:57.133870 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:57.133967 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":130553,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":691,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":70,"thread_start_us":194489,"threads_started":2}
I20260709 13:09:57.249995  2379 raft_consensus.cc:493] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:57.285490 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:57.308890 30548 raft_consensus.cc:3060] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:09:57.312165 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:57.313874 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:57.312314 30542 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
I20260709 13:09:57.312255 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:57.318849 30620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47446 (request call id 2553) took 1277 ms. Trace:
I20260709 13:09:57.323494 30550 raft_consensus.cc:2393] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 10: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:57.307331  2537 raft_consensus.cc:2804] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:57.332669 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:57.323948 30441 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:57.249325  2544 consensus_queue.cc:1048] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 13:09:57.277870  2479 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:57.400511 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:57.316068  2461 raft_consensus.cc:2749] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:57.402223 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:57.431382 30549 raft_consensus.cc:2393] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 10: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:57.402540 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:57.402828 30546 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:57.359386 30472 raft_consensus.cc:515] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:57.340591 30545 raft_consensus.cc:2468] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 13.
I20260709 13:09:57.340176  2413 raft_consensus.cc:2749] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:57.406075 30620 rpcz_store.cc:276] 0709 13:09:56.041170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.001635 (+960465us) service_pool.cc:224] Handling call
0709 13:09:57.001982 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:57.282396 (+280414us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:57.318575 (+ 36179us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b540021cfd4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:57.318781 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":643193088}
I20260709 13:09:57.407305 30471 raft_consensus.cc:2468] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 15.
I20260709 13:09:57.259579  2419 consensus_queue.cc:1059] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:09:57.343567 30589 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:57.412992 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 150963us
W20260709 13:09:57.414400 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 81487.7us
W20260709 13:09:57.452164 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 108682us
I20260709 13:09:57.154126  2579 consensus_queue.cc:260] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:57.331238 30625 raft_consensus.cc:2468] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 10.
I20260709 13:09:57.401958 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:57.427524 30469 raft_consensus.cc:2393] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 9: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
W20260709 13:09:57.428256 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 104378us
I20260709 13:09:57.458963 30616 raft_consensus.cc:1240] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:09:57.430486 30548 raft_consensus.cc:2468] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 11.
I20260709 13:09:57.333324  2328 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:57.285778  2416 raft_consensus.cc:2804] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:57.437463 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:57.460654 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:57.461380 30548 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:57.317283  2547 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.452358 30472 leader_election.cc:290] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:57.453274 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:57.411991 30547 raft_consensus.cc:2468] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 11.
I20260709 13:09:57.453980 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:57.465171 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:57.465701 30547 raft_consensus.cc:3060] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:09:57.454314 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:57.458062 30441 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:57.467521 30475 raft_consensus.cc:2468] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
I20260709 13:09:57.468020 30546 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 12.
I20260709 13:09:57.452304 30516 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:57.411412  2537 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:09:57.455353 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 189181us
I20260709 13:09:57.455648 30589 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:57.440217  2487 raft_consensus.cc:2804] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:57.287801  2515 consensus_queue.cc:1048] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.136s
I20260709 13:09:57.313174  2477 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:57.470142 30545 raft_consensus.cc:2393] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 10: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:57.430670  2373 raft_consensus.cc:2804] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:57.464006  2547 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:57.474499 30589 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:57.475306 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:57.475826 30547 raft_consensus.cc:2468] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 12.
I20260709 13:09:57.433981  2554 raft_consensus.cc:2764] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:09:57.488862 30589 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:57.439419  2569 raft_consensus.cc:2804] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:57.413345  2505 consensus_queue.cc:1059] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:09:57.438827  2533 raft_consensus.cc:3055] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:57.480665 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:57.414646  2379 raft_consensus.cc:515] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:57.465590  2072 raft_consensus.cc:2804] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:57.489867 30589 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:57.339768  2583 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:57.490283 30547 raft_consensus.cc:1275] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:09:57.492168 30545 raft_consensus.cc:1275] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:57.470780  2380 consensus_queue.cc:1048] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:09:57.495970  2426 raft_consensus.cc:2804] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:57.495522  2316 raft_consensus.cc:2749] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:57.496486  2230 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:57.469911  2310 consensus_queue.cc:1059] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:09:57.478103  2537 raft_consensus.cc:3060] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:57.484436  2373 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.507320  2328 raft_consensus.cc:2749] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:57.483484  2088 consensus_queue.cc:1048] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:09:57.508615  2534 leader_election.cc:290] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:57.509001  2569 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.509424  2413 consensus_queue.cc:1048] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:57.473321  2496 consensus_queue.cc:1048] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:09:57.511314  2487 raft_consensus.cc:697] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 11 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:57.480154  2419 raft_consensus.cc:2749] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:57.332396  2564 consensus_queue.cc:1048] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.160s
W20260709 13:09:57.601032  2595 log.cc:927] Time spent T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:09:57.473140  2461 raft_consensus.cc:2804] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:57.601627  2461 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:57.602079  2461 raft_consensus.cc:3060] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:57.602484  2592 log.cc:927] Time spent T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:09:57.602955 30471 raft_consensus.cc:1240] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:09:57.512732 30625 raft_consensus.cc:3060] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:57.517691  2479 raft_consensus.cc:3055] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:57.530721 30548 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 11.
I20260709 13:09:57.607995  2479 raft_consensus.cc:740] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:57.609061  2479 consensus_queue.cc:260] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:57.610376  2479 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:57.540763 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 297947us
W20260709 13:09:57.543694 31113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.482327  2516 raft_consensus.cc:2804] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:57.614526  2516 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:57.615046  2516 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:57.620163 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:57.573712  2373 raft_consensus.cc:3060] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:57.621483 31150 raft_consensus.cc:1240] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 11. Current term is 12. Ops: []
W20260709 13:09:57.547489 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 57690.8us
I20260709 13:09:57.622869 30589 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:57.549423 30620 raft_consensus.cc:1240] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:57.573819  2374 consensus_queue.cc:1048] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:09:57.512591  2579 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:57.625103  2568 consensus_queue.cc:1059] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:57.626000  2568 raft_consensus.cc:3055] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:57.626320  2568 raft_consensus.cc:740] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:57.543323  2533 raft_consensus.cc:740] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:57.627192  2568 consensus_queue.cc:260] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:57.628675  2568 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:57.628450  2533 consensus_queue.cc:260] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:57.628887  2372 raft_consensus.cc:3055] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:57.629333  2372 raft_consensus.cc:740] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:57.629652  2533 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:57.630290  2372 consensus_queue.cc:260] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:57.631435  2372 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:57.560038  2426 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.691730  2426 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:57.599575  2416 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.696148  2416 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:57.600286  2590 log.cc:927] Time spent T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:09:57.625324  2379 leader_election.cc:290] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133)
I20260709 13:09:57.547269  2072 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.704308  2072 raft_consensus.cc:3060] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:57.559314  2494 raft_consensus.cc:697] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 11 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:57.633220  2583 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:57.634198  2535 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:57.553062  2180 raft_consensus.cc:2804] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:09:57.635679 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.710561  2180 raft_consensus.cc:697] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:57.712039  2585 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:57.708768  2494 consensus_queue.cc:237] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:57.712781  2585 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:57.711575  2180 consensus_queue.cc:237] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:57.718835  2585 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:57.637931 31146 raft_consensus.cc:3055] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:57.719357 31146 raft_consensus.cc:740] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:57.720228 31146 consensus_queue.cc:260] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:57.721328 31146 raft_consensus.cc:3060] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:57.638374 30589 leader_election.cc:400] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 election: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 9. Current term is 10.
I20260709 13:09:57.723985 30589 leader_election.cc:403] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 13:09:57.724609 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 86361.4us
I20260709 13:09:57.725639 30589 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:57.638772  2310 raft_consensus.cc:2804] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:57.727272  2310 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:57.727775  2310 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:57.640895 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:57.642848  2373 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:57.730599  2416 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:57.645010  2487 consensus_queue.cc:237] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:57.553392  2448 consensus_queue.cc:1048] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:09:57.588339  2569 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:57.584429  2098 consensus_queue.cc:1059] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:09:57.552385  2330 consensus_queue.cc:1059] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.103s
I20260709 13:09:57.615648  2580 raft_consensus.cc:3055] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:57.619340  2339 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:57.654172 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.651768  2461 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:57.656997 30440 leader_election.cc:336] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Timed out: RequestConsensusVote RPC to 127.28.173.2:34733 timed out after 1.762s (SENT)
I20260709 13:09:57.639717  2563 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:57.636441  2477 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:57.741892  2505 raft_consensus.cc:2804] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:57.659691 30625 raft_consensus.cc:2468] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 10.
I20260709 13:09:57.736826 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:57.768790 30551 raft_consensus.cc:2468] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 7.
I20260709 13:09:57.769616 30441 leader_election.cc:304] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:57.771232  2564 raft_consensus.cc:2804] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:57.771703  2564 raft_consensus.cc:697] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 10 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:57.771984 30589 leader_election.cc:304] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:57.772548  2564 consensus_queue.cc:237] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:57.666136  2516 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:57.751993 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:57.667403 30549 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 13.
I20260709 13:09:57.775271  2516 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:57.735576  2373 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:57.741598  2316 raft_consensus.cc:3060] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:57.777220 30549 raft_consensus.cc:1240] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:57.777542  2505 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.777961  2505 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:57.778784  2339 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:57.780400 30589 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:57.780596  2563 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:57.742148 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 289905us
I20260709 13:09:57.750401  2585 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:57.759193  2098 raft_consensus.cc:3055] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:57.750524  2580 raft_consensus.cc:740] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:57.759795 30544 raft_consensus.cc:2393] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 11: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:57.760324  2330 raft_consensus.cc:3055] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:57.761379  2461 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:57.763057 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:57.763057 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:57.830101 30623 raft_consensus.cc:3060] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:57.770366 30551 raft_consensus.cc:1275] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 13:09:57.831370 30551 pending_rounds.cc:85] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd: Aborting all ops after (but not including) 10
I20260709 13:09:57.831634 30551 pending_rounds.cc:107] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:09:57.832056 30551 raft_consensus.cc:2889] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:57.741854 30545 raft_consensus.cc:3055] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:57.833030 30545 raft_consensus.cc:740] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:57.772954  2477 raft_consensus.cc:2804] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:57.754556 30440 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:57.775707 30542 raft_consensus.cc:2468] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
I20260709 13:09:57.781805 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:57.757474 31146 raft_consensus.cc:2468] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 10.
W20260709 13:09:57.782312 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 270803us
I20260709 13:09:57.791712 30516 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:57.789012 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:57.833752 30545 consensus_queue.cc:260] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:57.837495 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 180508us
I20260709 13:09:57.838043 30549 raft_consensus.cc:2368] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 13. Current term is 14.
I20260709 13:09:57.839844 30545 raft_consensus.cc:3060] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:57.826808  2516 raft_consensus.cc:2804] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:57.751299  2547 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:57.829308  2330 raft_consensus.cc:740] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:09:57.825209  2098 raft_consensus.cc:740] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
W20260709 13:09:57.868161 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:57.849013 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 67376.7us
I20260709 13:09:57.876032 30623 raft_consensus.cc:2468] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 10.
I20260709 13:09:57.836771  2477 raft_consensus.cc:493] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:57.829730  2379 consensus_queue.cc:1059] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:09:57.893184 31150 raft_consensus.cc:1275] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:09:57.827284  2585 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:57.825335  2537 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:57.859125  2339 raft_consensus.cc:2749] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:57.848372  2563 raft_consensus.cc:2749] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:57.860464  2516 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.896592 30516 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:57.913015 30545 raft_consensus.cc:1275] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:09:57.919221 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:57.922413 30545 pending_rounds.cc:85] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd: Aborting all ops after (but not including) 9
I20260709 13:09:57.922699 30545 pending_rounds.cc:107] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:09:57.922902 31151 raft_consensus.cc:1275] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:57.922946 30545 raft_consensus.cc:2889] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:57.894896  2477 raft_consensus.cc:3060] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:57.931433  2585 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:57.933411  2547 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:57.936457  2098 consensus_queue.cc:260] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:57.937753  2098 raft_consensus.cc:3060] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:57.941547  2537 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:57.942273 30548 raft_consensus.cc:1240] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:57.943251  2416 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:57.946537  2569 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:57.924775  2516 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:57.951918  2330 consensus_queue.cc:260] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:57.953507  2330 raft_consensus.cc:3060] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:57.954943  2316 raft_consensus.cc:2749] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 9. Current term is 10.
I20260709 13:09:57.956488 30470 raft_consensus.cc:2393] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 14: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
W20260709 13:09:57.948599 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 52110us
I20260709 13:09:57.959043 30516 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:57.958758  2072 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:57.960701 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:57.964627 30473 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.003s	sys 0.007s
I20260709 13:09:57.964486 30516 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:57.967684 31115 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.005s	sys 0.005s
W20260709 13:09:57.968132 31115 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.005s	sys 0.005s
W20260709 13:09:57.968477 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 717179us
W20260709 13:09:57.969492 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 502000us
W20260709 13:09:57.965011 30473 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.003s	sys 0.007s
I20260709 13:09:57.976711 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:57.978442 31142 raft_consensus.cc:1240] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:09:57.980155 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:57.980991 31150 raft_consensus.cc:2468] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 10.
I20260709 13:09:57.978345 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:57.990483 30516 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:57.990949 30551 raft_consensus.cc:1275] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:09:57.992964 30619 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.006s	sys 0.005s
W20260709 13:09:57.993346 30619 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.006s	sys 0.005s
I20260709 13:09:57.998803 30624 raft_consensus.cc:1240] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:57.939044  2310 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:58.007498 30616 raft_consensus.cc:1240] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:58.012097 30617 raft_consensus.cc:1275] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:09:57.947489  2426 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:57.966013  2339 raft_consensus.cc:2804] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:09:58.013115 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.999679 30516 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:57.998535  2535 raft_consensus.cc:2804] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:58.028153 30618 raft_consensus.cc:1240] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:58.036099 30516 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
W20260709 13:09:58.037199 31113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.037166 30516 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:58.003790  2553 raft_consensus.cc:3055] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:58.041175  2380 raft_consensus.cc:2749] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:58.041755  2553 raft_consensus.cc:740] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:58.042760  2553 consensus_queue.cc:260] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:58.044104  2553 raft_consensus.cc:3060] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:58.056196 30517 leader_election.cc:304] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:58.057312  2380 raft_consensus.cc:2749] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:58.057379  2426 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:58.058727  2569 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:58.059535  2479 raft_consensus.cc:2804] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:58.060082  2479 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.060523  2479 raft_consensus.cc:3060] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:58.067947  2602 consensus_queue.cc:1048] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:58.005064  2533 raft_consensus.cc:2749] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:09:58.087945 30550 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.003s	sys 0.027s
W20260709 13:09:58.088372 30550 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.003s	sys 0.027s
I20260709 13:09:58.093745 30517 leader_election.cc:400] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 11. Current term is 12.
I20260709 13:09:58.094201 30517 leader_election.cc:403] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:58.018114  2339 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.035533  2563 raft_consensus.cc:493] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.038713  2416 raft_consensus.cc:2749] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:58.116346 30517 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:58.134809 30591 leader_election.cc:304] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:09:58.136751 30591 leader_election.cc:304] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:58.083680  2535 raft_consensus.cc:697] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 10 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:09:58.106607  2373 raft_consensus.cc:2749] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 11. Current term is 12.
I20260709 13:09:58.109062  2339 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:58.184037 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 47390.8us
I20260709 13:09:58.185673 30591 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
W20260709 13:09:58.229156 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 43571.5us
I20260709 13:09:58.230806 30591 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:58.148681  2430 consensus_queue.cc:1048] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.090s
I20260709 13:09:58.153505  2537 consensus_queue.cc:1048] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 13:09:58.238355  2316 raft_consensus.cc:2749] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:58.238689  2537 consensus_queue.cc:1243] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer f639301059e24dc5b0d88a46dc683326 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:09:58.239132  2316 raft_consensus.cc:2804] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:09:58.239459 31149 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.009s	sys 0.029s
W20260709 13:09:58.239786 31149 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.009s	sys 0.029s
I20260709 13:09:58.240594 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:09:58.275167 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 44443.7us
I20260709 13:09:58.277568 30591 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
W20260709 13:09:58.247490 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 432679us
I20260709 13:09:58.144598  2426 raft_consensus.cc:2804] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:58.148248  2604 raft_consensus.cc:2749] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:09:58.319875 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.133633  2563 raft_consensus.cc:515] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:58.239490  2316 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:58.214156  2416 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:58.285625  2359 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.019s	sys 0.022s
I20260709 13:09:58.283113  2430 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:58.285372  2180 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.012s	sys 0.030s
W20260709 13:09:58.388610 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.413558 30616 raft_consensus.cc:1240] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 13:09:58.413919 30467 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.009s	sys 0.018s
W20260709 13:09:58.417285 30621 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.110s	user 0.025s	sys 0.030s
W20260709 13:09:58.426203 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:58.460740 30467 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.010s	sys 0.018s
W20260709 13:09:58.460909 30621 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.154s	user 0.026s	sys 0.030s
W20260709 13:09:58.325963 30543 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.024s	sys 0.035s
I20260709 13:09:58.318360  2426 raft_consensus.cc:493] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:58.246198  2505 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:58.457379 30590 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.029s	sys 0.026s
W20260709 13:09:58.469022 30590 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.030s	sys 0.026s
W20260709 13:09:58.461807 30543 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.837s	user 0.024s	sys 0.040s
W20260709 13:09:58.427033  2359 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.020s	sys 0.022s
W20260709 13:09:58.470259 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 618304us
I20260709 13:09:58.415987  2316 raft_consensus.cc:3060] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:58.475405 30590 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
W20260709 13:09:58.450985  2180 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.012s	sys 0.030s
W20260709 13:09:58.471262  2582 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.018s	sys 0.018s
I20260709 13:09:58.331728  2599 consensus_queue.cc:1059] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.149s
I20260709 13:09:58.472275  2426 raft_consensus.cc:3060] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:58.482816 30619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36130 (request call id 2105) took 1212 ms. Trace:
I20260709 13:09:58.517828 30619 rpcz_store.cc:276] 0709 13:09:57.269908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.316879 (+ 46971us) service_pool.cc:224] Handling call
0709 13:09:57.322103 (+  5224us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:57.322505 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:57.322546 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:57.409749 (+ 87203us) log.cc:844] Serialized 26 byte log entry
0709 13:09:57.993874 (+584125us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:57.993915 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:57.993982 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:58.482594 (+488612us) raft_consensus.cc:1685] finished
0709 13:09:58.482617 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:58.482758 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10549,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":68213,"thread_start_us":538241,"threads_started":1,"wal-append.queue_time_us":1046626}
I20260709 13:09:58.319298  2615 consensus_queue.cc:1059] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.194s
I20260709 13:09:58.476861  2072 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:58.448120  2605 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.535617  2072 raft_consensus.cc:2749] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:58.536655  2072 raft_consensus.cc:2804] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:58.537258  2072 raft_consensus.cc:697] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:58.538394  2072 consensus_queue.cc:237] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:58.502862 30620 raft_consensus.cc:2393] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 15: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
W20260709 13:09:58.505718 31115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.431915  2416 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:58.481050  2620 raft_consensus.cc:2749] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:09:58.478992  2516 consensus_meta.cc:287] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.527s	user 0.010s	sys 0.000s
I20260709 13:09:58.501292  2505 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:58.475310  2535 consensus_queue.cc:237] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:58.569427 30474 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.009s	sys 0.025s
W20260709 13:09:58.569934 30474 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.009s	sys 0.025s
W20260709 13:09:58.552090 30589 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.770s	user 0.011s	sys 0.021s
I20260709 13:09:58.459353  2430 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:58.499768  2477 consensus_meta.cc:287] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.552s	user 0.004s	sys 0.005s
W20260709 13:09:58.559135 30475 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.017s	sys 0.016s
W20260709 13:09:58.578279 30475 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.017s	sys 0.016s
W20260709 13:09:58.550135 30546 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.010s	sys 0.026s
W20260709 13:09:58.578980 30546 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.010s	sys 0.026s
W20260709 13:09:58.570634 30589 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.011s	sys 0.021s
I20260709 13:09:58.515609  2310 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:58.507104  2582 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.019s	sys 0.018s
W20260709 13:09:58.549649  2494 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.019s	sys 0.012s
W20260709 13:09:58.579934 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 798161us
I20260709 13:09:58.587265 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:58.587900 30549 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:58.588567 30623 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.021s	sys 0.011s
I20260709 13:09:58.588748 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
W20260709 13:09:58.589376 30468 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.015s	sys 0.043s
I20260709 13:09:58.589612 30551 raft_consensus.cc:2393] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 14: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
W20260709 13:09:58.589797 30468 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.015s	sys 0.043s
W20260709 13:09:58.588933 30623 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.021s	sys 0.011s
I20260709 13:09:58.592365 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:58.583611  2494 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.019s	sys 0.012s
I20260709 13:09:58.608856 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:58.609957 30616 raft_consensus.cc:2393] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 15: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:58.596925 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:58.610100 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:58.610419 30551 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:09:58.615696 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:58.615844 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:58.614770 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:09:58.615804 30550 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.000s	sys 0.018s
W20260709 13:09:58.617023 30550 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.001s	sys 0.019s
W20260709 13:09:58.617308 30471 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.006s	sys 0.034s
I20260709 13:09:58.617810 30550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 927) took 1395 ms. Trace:
W20260709 13:09:58.620314 30470 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.005s	sys 0.013s
I20260709 13:09:58.584874  2568 raft_consensus.cc:493] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:09:58.620909 30470 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.006s	sys 0.013s
I20260709 13:09:58.527001  2605 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:58.570235  2516 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:58.626762 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:58.627214 30549 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 15.
W20260709 13:09:58.618016 30471 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.006s	sys 0.035s
I20260709 13:09:58.647383 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:58.652904 30551 raft_consensus.cc:2468] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 15.
W20260709 13:09:58.654086 30476 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.018s	sys 0.008s
W20260709 13:09:58.654497 30476 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.018s	sys 0.008s
I20260709 13:09:58.582554  2477 raft_consensus.cc:515] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:58.655436 30547 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.003s	sys 0.023s
W20260709 13:09:58.663757 30547 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.004s	sys 0.023s
I20260709 13:09:58.664526 30547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 2178) took 1415 ms. Trace:
I20260709 13:09:58.664877 30547 rpcz_store.cc:276] 0709 13:09:57.248879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.550658 (+301779us) service_pool.cc:224] Handling call
0709 13:09:57.550924 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:57.551115 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:57.972149 (+421034us) log.cc:844] Serialized 14 byte log entry
0709 13:09:58.664230 (+692081us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:58.664277 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:58.664321 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.664379 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:58.664478 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":925390,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"thread_start_us":1092875,"threads_started":2}
I20260709 13:09:58.618287 30550 rpcz_store.cc:276] 0709 13:09:57.222186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.514759 (+292573us) service_pool.cc:224] Handling call
0709 13:09:57.515040 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:57.515245 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:58.088821 (+573576us) log.cc:844] Serialized 14 byte log entry
0709 13:09:58.617504 (+528683us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:58.617558 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:58.617599 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.617666 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:58.617766 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":804425,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":70,"thread_start_us":1101502,"threads_started":2}
I20260709 13:09:58.609766  2505 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:58.647583  2461 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:58.648099  2449 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:09:58.703052  2621 log.cc:927] Time spent T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:09:58.721184 30625 raft_consensus.cc:1240] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:58.649930  2607 raft_consensus.cc:3060] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:58.722828 30624 raft_consensus.cc:2468] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 10.
W20260709 13:09:58.723688 30622 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.009s	sys 0.018s
W20260709 13:09:58.782794 30622 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.009s	sys 0.018s
I20260709 13:09:58.778843 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:58.782615 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:09:58.780674 30473 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.012s	sys 0.036s
W20260709 13:09:58.784322 30473 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.013s	sys 0.036s
W20260709 13:09:58.786707 30469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.827s	user 0.011s	sys 0.021s
W20260709 13:09:58.787149 30469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.858s	user 0.012s	sys 0.021s
I20260709 13:09:58.788204 30619 raft_consensus.cc:2393] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 14: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:58.778184  2461 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:58.792270  2461 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:58.794070 30440 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.016s	sys 0.017s
W20260709 13:09:58.794492 30440 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.755s	user 0.016s	sys 0.017s
W20260709 13:09:58.794826 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 771018us
I20260709 13:09:58.656486  2568 raft_consensus.cc:515] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:58.799418 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:58.818706 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:58.819430 30620 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:58.679354  2505 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:58.793262  2461 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:09:58.824278 30440 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.173.2:34733 timed out after 2.460s (SENT) [suppressed 24 similar messages]
W20260709 13:09:58.796607  2613 log.cc:927] Time spent T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.368s	user 0.001s	sys 0.001s
W20260709 13:09:58.848522 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.865505  2416 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:58.866261  2603 log.cc:927] Time spent T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.450s	user 0.004s	sys 0.000s
I20260709 13:09:58.840288  2230 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.871228  2426 raft_consensus.cc:515] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:58.874507  2618 log.cc:927] Time spent T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
W20260709 13:09:58.905478 30472 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.016s	sys 0.025s
W20260709 13:09:58.906014 30472 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.016s	sys 0.025s
I20260709 13:09:58.874181 30589 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:58.876097  2505 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:09:58.876982  2617 log.cc:927] Time spent T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 13:09:58.877647  2619 log.cc:927] Time spent T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.209s	user 0.000s	sys 0.000s
I20260709 13:09:58.878691  2430 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:58.782136  2449 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:58.912977 30589 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:58.650753  2580 consensus_queue.cc:260] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:58.887916 30517 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.021s	sys 0.064s
W20260709 13:09:58.894168 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.885886  2284 raft_consensus.cc:3055] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:58.846906  2563 leader_election.cc:290] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:58.885645 30620 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 14.
W20260709 13:09:58.914654 30517 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.021s	sys 0.065s
I20260709 13:09:58.927095 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:58.928526 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:58.913416  2505 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:58.940376 30544 raft_consensus.cc:1240] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:58.940425 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
W20260709 13:09:58.915937 31113 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.016s	sys 0.024s
I20260709 13:09:58.902823  2230 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:58.930768 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:58.957180 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:58.929198 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:58.957811 30545 raft_consensus.cc:2376] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 10. Re-sending same reply.
I20260709 13:09:58.958488 30550 raft_consensus.cc:2393] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 15: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
W20260709 13:09:58.915232 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.934738 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:58.943703 31113 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.016s	sys 0.024s
W20260709 13:09:58.960352 31113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.918900  2284 raft_consensus.cc:740] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:58.969121 30548 raft_consensus.cc:1240] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:58.897691  2461 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:58.945253 31114 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.007s	sys 0.019s
W20260709 13:09:58.973563 31114 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.007s	sys 0.019s
W20260709 13:09:58.974102 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 544514us
I20260709 13:09:59.027339 30624 raft_consensus.cc:1240] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:59.029109 31149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48412 (request call id 821) took 1371 ms. Trace:
I20260709 13:09:59.030139 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:59.029546 31149 rpcz_store.cc:276] 0709 13:09:57.657505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.657663 (+   158us) service_pool.cc:224] Handling call
0709 13:09:57.658035 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:57.658417 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:57.658455 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:57.659059 (+   604us) log.cc:844] Serialized 26 byte log entry
0709 13:09:58.240175 (+581116us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:58.240213 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.240278 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:59.028909 (+788631us) raft_consensus.cc:1685] finished
0709 13:09:59.028931 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.029051 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3893,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"thread_start_us":580678,"threads_started":1,"wal-append.queue_time_us":927457}
I20260709 13:09:59.030794 30550 raft_consensus.cc:2468] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 6.
I20260709 13:09:58.928506 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:58.956113 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:09:58.919147 31116 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.014s	sys 0.026s
W20260709 13:09:59.052220 31116 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.014s	sys 0.026s
I20260709 13:09:58.963281 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:58.957399 30547 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 13.
I20260709 13:09:58.964610 31142 raft_consensus.cc:1275] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:09:58.970745 30617 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.011s	sys 0.007s
W20260709 13:09:59.054244 30617 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.011s	sys 0.008s
I20260709 13:09:59.055037 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
W20260709 13:09:58.971292 30591 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.007s	sys 0.012s
W20260709 13:09:59.055634 30591 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.007s	sys 0.012s
W20260709 13:09:59.056185 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 778637us
I20260709 13:09:58.947499 30589 leader_election.cc:400] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 election: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 13. Current term is 14.
I20260709 13:09:58.940968  2580 raft_consensus.cc:3060] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:58.973873 30545 raft_consensus.cc:1275] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:59.010607  2477 leader_election.cc:290] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133)
I20260709 13:09:59.012228 30621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36130 (request call id 2103) took 1743 ms. Trace:
I20260709 13:09:59.032610  2626 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.073339 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:59.074337 30545 raft_consensus.cc:2393] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 15: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:59.033694 30548 raft_consensus.cc:1240] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:58.968619  2310 raft_consensus.cc:2804] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:59.041149 31114 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:09:59.077903 31114 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:58.929867  2624 consensus_queue.cc:1048] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.102s
I20260709 13:09:59.080534 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:09:58.974798  2516 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:59.056825 30591 leader_election.cc:304] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:59.081458  2448 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.082142 30591 leader_election.cc:304] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:59.082106  2448 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:59.083195 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:59.083415 30591 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:09:59.084519  2374 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.085453 30591 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:09:59.085198  2374 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:59.011461 30467 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.008s	sys 0.053s
W20260709 13:09:59.086203 30467 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.008s	sys 0.054s
I20260709 13:09:59.086370 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:09:59.086928  2585 raft_consensus.cc:2749] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:59.087059 30545 raft_consensus.cc:2393] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 10: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:59.087612  2585 raft_consensus.cc:2804] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:59.088181  2585 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:59.088214 30591 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
W20260709 13:09:59.041501  2491 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.016s	sys 0.018s
I20260709 13:09:59.090031 30591 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
W20260709 13:09:59.027865  2515 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.956s	user 0.012s	sys 0.011s
I20260709 13:09:59.067956 30547 raft_consensus.cc:2393] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 15: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:58.929109  2563 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:59.070250 30621 rpcz_store.cc:276] 0709 13:09:57.268807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.305158 (+ 36351us) service_pool.cc:224] Handling call
0709 13:09:57.305507 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:57.305908 (+   401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:57.305940 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:57.306463 (+   523us) log.cc:844] Serialized 26 byte log entry
0709 13:09:58.461617 (+1155154us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:58.974636 (+513019us) log.cc:844] Serialized 14 byte log entry
0709 13:09:58.974940 (+   304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.975027 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:58.975077 (+    50us) raft_consensus.cc:1685] finished
0709 13:09:58.975094 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.012148 (+ 37054us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1222,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":17077,"thread_start_us":1652490,"threads_started":2,"wal-append.queue_time_us":1342288}
I20260709 13:09:59.027670  2605 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:59.032498  2537 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.110337  2537 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:59.112818  2537 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:59.044926  2603 log.cc:927] Time spent T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:09:59.035063 30618 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.001s	sys 0.022s
W20260709 13:09:59.044875 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 66807us
W20260709 13:09:59.113888 30618 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.001s	sys 0.022s
I20260709 13:09:59.116298 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:59.081120 30548 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:59.060321 30589 leader_election.cc:403] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:09:59.083775 30544 raft_consensus.cc:2468] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 7.
I20260709 13:09:59.084024  2516 raft_consensus.cc:2749] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:59.084444  2624 raft_consensus.cc:2749] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:09:59.074404  2316 consensus_meta.cc:287] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.600s	user 0.007s	sys 0.003s
I20260709 13:09:59.088812  2585 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:59.118112 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 170794us
I20260709 13:09:59.078233  2494 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:59.121937 30590 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.000s	sys 0.013s
W20260709 13:09:59.103921  2491 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.016s	sys 0.019s
I20260709 13:09:59.087608  2374 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:59.076886  2310 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:59.188632 30548 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 14.
I20260709 13:09:59.126505 30471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 1031) took 1272 ms. Trace:
I20260709 13:09:59.098438  2477 raft_consensus.cc:2749] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:09:59.104445  2515 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.033s	user 0.013s	sys 0.011s
W20260709 13:09:59.160372 30590 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.000s	sys 0.014s
W20260709 13:09:59.195842 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 720525us
I20260709 13:09:59.121466  2537 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:59.196666 30476 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.021s	sys 0.019s
W20260709 13:09:59.197302 30476 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.021s	sys 0.019s
I20260709 13:09:59.199218 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
W20260709 13:09:59.148010 30543 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.016s	sys 0.015s
I20260709 13:09:59.164216 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:09:59.165428 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 50000us
W20260709 13:09:59.206845 30543 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.017s	sys 0.015s
W20260709 13:09:59.166164 30474 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.013s	sys 0.017s
I20260709 13:09:59.099978  2416 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:59.174752 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:59.189965 30471 rpcz_store.cc:276] 0709 13:09:57.854294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.854427 (+   133us) service_pool.cc:224] Handling call
0709 13:09:57.854720 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:57.854907 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:58.654309 (+799402us) log.cc:844] Serialized 14 byte log entry
0709 13:09:59.126176 (+471867us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:59.126231 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:59.126282 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.126351 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.126455 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":756714,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":154,"thread_start_us":1234621,"threads_started":2}
I20260709 13:09:59.127478  2325 raft_consensus.cc:2749] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:59.214970 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:59.193392  2426 leader_election.cc:290] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:09:59.208005 30474 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.014s	sys 0.017s
I20260709 13:09:59.208760 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:59.216774 30621 raft_consensus.cc:2393] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 15: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:59.166684  2284 consensus_queue.cc:260] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:59.224852 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:09:59.246349 30621 raft_consensus.cc:2393] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 14: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:09:59.231940 30624 raft_consensus.cc:1275] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:59.224615 30471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2477) took 1071 ms. Trace:
I20260709 13:09:59.127321  2646 raft_consensus.cc:2804] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:59.247316 30471 rpcz_store.cc:276] 0709 13:09:58.153213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.214681 (+1061468us) service_pool.cc:224] Handling call
0709 13:09:59.224560 (+  9879us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:59.247664  2646 raft_consensus.cc:697] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 12 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:59.091260  2626 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:59.195550  2310 raft_consensus.cc:3060] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:59.249097 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:59.197108  2624 raft_consensus.cc:2804] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:59.265488 30471 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 14.
I20260709 13:09:59.265995 30471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2475) took 1114 ms. Trace:
I20260709 13:09:59.266300 30471 rpcz_store.cc:276] 0709 13:09:58.151338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.248675 (+1097337us) service_pool.cc:224] Handling call
0709 13:09:59.265938 (+ 17263us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:59.256114 30476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 2059) took 1941 ms. Trace:
I20260709 13:09:59.267313 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:59.257234 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:59.269012 30621 raft_consensus.cc:2393] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 10: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:09:59.274885 30471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2492) took 1061 ms. Trace:
W20260709 13:09:59.278342 30470 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.012s	sys 0.038s
W20260709 13:09:59.278867 30470 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.012s	sys 0.038s
I20260709 13:09:59.263224 30622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 998) took 1267 ms. Trace:
I20260709 13:09:59.293835 30622 rpcz_store.cc:276] 0709 13:09:57.995360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.000856 (+  5496us) service_pool.cc:224] Handling call
0709 13:09:58.001144 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:58.001363 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:58.783342 (+781979us) log.cc:844] Serialized 14 byte log entry
0709 13:09:59.262335 (+478993us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:59.262541 (+   206us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:59.262754 (+   213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.262945 (+   191us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.263152 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7032,"prepare.queue_time_us":1247572,"thread_start_us":1242329,"threads_started":2}
I20260709 13:09:59.157284  2316 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:59.267580 30476 rpcz_store.cc:276] 0709 13:09:57.314979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.315092 (+   113us) service_pool.cc:224] Handling call
0709 13:09:57.315372 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:57.317313 (+  1941us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:57.317341 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:57.317729 (+   388us) log.cc:844] Serialized 26 byte log entry
0709 13:09:57.899557 (+581828us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:58.654795 (+755238us) log.cc:844] Serialized 14 byte log entry
0709 13:09:58.865690 (+210895us) spinlock_profiling.cc:243] Waited 31.6 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:09:59.197987 (+332297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.198122 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:59.198184 (+    62us) raft_consensus.cc:1685] finished
0709 13:09:59.255848 (+ 57664us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.256042 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2260,"prepare.queue_time_us":897645,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":39,"raft.queue_time_us":140633,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":17736,"spinlock_wait_cycles":72574720,"thread_start_us":1739657,"threads_started":3,"wal-append.queue_time_us":749603}
I20260709 13:09:59.311170 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:59.311774 30476 raft_consensus.cc:3060] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:59.276207 30471 rpcz_store.cc:276] 0709 13:09:58.213279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.267031 (+1053752us) service_pool.cc:224] Handling call
0709 13:09:59.274445 (+  7414us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:59.320515 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:59.321192 30471 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:59.310333 30622 raft_consensus.cc:1275] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:09:59.122679  2563 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:59.309597 30621 raft_consensus.cc:1240] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:09:59.322898 30476 raft_consensus.cc:2468] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 10.
I20260709 13:09:59.323508 30476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2485) took 1143 ms. Trace:
I20260709 13:09:59.323937 30476 rpcz_store.cc:276] 0709 13:09:58.180045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.310897 (+1130852us) service_pool.cc:224] Handling call
0709 13:09:59.323459 (+ 12562us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:59.327943 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:59.250353  2477 raft_consensus.cc:2749] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 13. Current term is 14.
I20260709 13:09:59.330611 30476 raft_consensus.cc:2410] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
W20260709 13:09:59.253895  2615 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.010s	sys 0.023s
I20260709 13:09:59.171965  2494 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:59.335143 30476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2473) took 1185 ms. Trace:
I20260709 13:09:59.271912  2624 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:09:59.341264 30619 raft_consensus.cc:1240] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:59.244089  2416 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:59.341838 30476 rpcz_store.cc:276] 0709 13:09:58.149476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.326963 (+1177487us) service_pool.cc:224] Handling call
0709 13:09:59.335079 (+  8116us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:59.340955  2615 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.011s	sys 0.024s
I20260709 13:09:59.258458  2426 consensus_queue.cc:1048] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 13:09:59.227188  2537 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:59.332866  2632 log.cc:927] Time spent T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.390s	user 0.001s	sys 0.001s
I20260709 13:09:59.351119 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:59.357192 31149 raft_consensus.cc:2468] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 11.
I20260709 13:09:59.266462  2072 consensus_queue.cc:1048] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.076s
W20260709 13:09:59.349331  2330 consensus_meta.cc:287] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 1.395s	user 0.009s	sys 0.005s
I20260709 13:09:59.344122  2624 raft_consensus.cc:3060] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:59.346619  2449 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:59.337424  2604 raft_consensus.cc:493] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:09:59.339946  2553 consensus_meta.cc:287] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 1.295s	user 0.014s	sys 0.012s
I20260709 13:09:59.346371  2448 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:59.351743  2230 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:59.363710  2634 log.cc:927] Time spent T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.337s	user 0.000s	sys 0.001s
I20260709 13:09:59.353473  2284 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:59.367690  2642 log.cc:927] Time spent T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.298s	user 0.000s	sys 0.001s
W20260709 13:09:59.374161  2637 log.cc:927] Time spent T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.334s	user 0.000s	sys 0.001s
W20260709 13:09:59.373644  2607 consensus_meta.cc:287] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.576s	user 0.007s	sys 0.002s
W20260709 13:09:59.379066  2098 consensus_meta.cc:287] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 1.441s	user 0.005s	sys 0.010s
W20260709 13:09:59.381562  2479 consensus_meta.cc:287] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 1.321s	user 0.010s	sys 0.003s
I20260709 13:09:59.366640  2461 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:59.364672  2654 consensus_queue.cc:1048] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:09:59.400956  2607 raft_consensus.cc:2749] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:59.414284  2655 log.cc:927] Time spent T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:09:59.425145  2494 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:59.406953  2479 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:59.427558  2339 consensus_meta.cc:287] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 1.177s	user 0.012s	sys 0.000s
I20260709 13:09:59.382478  2604 raft_consensus.cc:515] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:59.432307  2653 log.cc:927] Time spent T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:09:59.446009  2479 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:59.448464  2604 leader_election.cc:290] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:59.450299  2647 log.cc:927] Time spent T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:09:59.458527  2416 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:59.369473  2646 consensus_queue.cc:237] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:59.464131  2537 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:59.472393  2563 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:59.473524  2650 log.cc:927] Time spent T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:09:59.470494  2626 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:59.481035  2505 consensus_meta.cc:287] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.524s	user 0.005s	sys 0.005s
I20260709 13:09:59.678025  2505 raft_consensus.cc:2749] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:09:59.517127 30360 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 2b207fb799ce4340b29ae053898e0e6c with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica fe2b7d73f8c743c1ba570cfd981c4e79 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
W20260709 13:09:59.518828 30440 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.003s	sys 0.009s
W20260709 13:09:59.524173 30468 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.006s	sys 0.024s
W20260709 13:09:59.519115 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.530259 30469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 1033) took 1675 ms. Trace:
I20260709 13:09:59.528981 30467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 1032) took 1674 ms. Trace:
I20260709 13:09:59.538141 30472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 1037) took 1575 ms. Trace:
I20260709 13:09:59.348228 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:59.568665 30475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 1035) took 1713 ms. Trace:
I20260709 13:09:59.587412 30516 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:09:59.597714 30618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 1004) took 1319 ms. Trace:
I20260709 13:09:59.598081 30617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 1006) took 1315 ms. Trace:
I20260709 13:09:59.598845 30623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 994) took 1604 ms. Trace:
I20260709 13:09:59.712915  2604 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.602701 30625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36130 (request call id 2111) took 1814 ms. Trace:
I20260709 13:09:59.713972  2604 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:59.714357 30625 rpcz_store.cc:276] 0709 13:09:57.787934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.788073 (+   139us) service_pool.cc:224] Handling call
0709 13:09:57.835437 (+ 47364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:58.777659 (+942222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.602190 (+824531us) spinlock_profiling.cc:243] Waited 885 ms on lock 0x7b5400202e54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:59.602523 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2036497664}
W20260709 13:09:59.610188 31113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:59.610949 31114 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.000s	sys 0.022s
W20260709 13:09:59.716172 31114 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.000s	sys 0.023s
I20260709 13:09:59.624910  2072 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.626065  2098 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.626425  2088 raft_consensus.cc:3055] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:59.627051  2180 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:59.632375  2330 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:59.640596  2316 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:59.737653  2373 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:59.641538  2339 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:59.739212  2683 raft_consensus.cc:2804] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:59.739785  2683 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.740304  2683 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:59.741079  2339 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:59.647053  2359 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:09:59.743139  2580 consensus_meta.cc:287] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.674s	user 0.008s	sys 0.004s
I20260709 13:09:59.742754  2359 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:59.711082 30360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 194363us
I20260709 13:09:59.686712 30472 rpcz_store.cc:276] 0709 13:09:57.962837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.963030 (+   193us) service_pool.cc:224] Handling call
0709 13:09:57.963470 (+   440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:57.963908 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:57.963947 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:57.966063 (+  2116us) log.cc:844] Serialized 26 byte log entry
0709 13:09:58.284697 (+318634us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b1800373840. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e5de07 00007fc789cb8ab9 00007fc780e7a69b 00007fc780e7893f 00007fc780e7ac02 00007fc783b0220b 00007fc783b07d23 00007fc783b080d1 00007fc783f23a0f
0709 13:09:58.906525 (+621828us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:58.906576 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.906647 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:59.537399 (+630752us) raft_consensus.cc:1685] finished
0709 13:09:59.537439 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.537924 (+   485us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1575,"raft.queue_time_us":2386,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":20769,"spinlock_wait_cycles":2430208,"thread_start_us":621576,"threads_started":1,"wal-append.queue_time_us":1169749}
I20260709 13:09:59.745584  2359 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:59.662886 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:59.746764 30624 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 13.
I20260709 13:09:59.639281 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:59.669126  2374 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:59.662952 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:09:59.748554  2374 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:59.670383  2379 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:59.750397  2379 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:59.750931  2682 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.751194  2374 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:59.671325  2416 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:59.673540  2461 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.674116  2487 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.674240  2479 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.674870  2477 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:59.486287  2585 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:59.487775  2624 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:09:59.694936 30589 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.000s	sys 0.012s
W20260709 13:09:59.679242  2535 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.003s	sys 0.006s
W20260709 13:09:59.703249 30440 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.003s	sys 0.009s
W20260709 13:09:59.702630 30468 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.006s	sys 0.024s
I20260709 13:09:59.711512 30475 rpcz_store.cc:276] 0709 13:09:57.855421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.855528 (+   107us) service_pool.cc:224] Handling call
0709 13:09:57.855910 (+   382us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:57.867412 (+ 11502us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:57.867442 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:57.867988 (+   546us) log.cc:844] Serialized 52 byte log entry
0709 13:09:58.583939 (+715951us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:58.583977 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.584042 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:59.568084 (+984042us) raft_consensus.cc:1685] finished
0709 13:09:59.568124 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.568492 (+   368us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12309,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":15476,"thread_start_us":652754,"threads_started":1,"wal-append.queue_time_us":1011441}
I20260709 13:09:59.751767  2682 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:59.757773 31150 raft_consensus.cc:1275] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:59.757606  2416 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:59.759938  2535 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.003s	sys 0.006s
I20260709 13:09:59.760205  2682 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:59.752548  2672 raft_consensus.cc:493] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:59.760587  2180 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:59.761210  2461 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:59.761555  2672 raft_consensus.cc:515] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:59.761957  2072 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:59.763306 30621 raft_consensus.cc:1275] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:09:59.763958 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 797955us
I20260709 13:09:59.732538  2088 raft_consensus.cc:740] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:09:59.765852 30440 leader_election.cc:304] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:59.767975 30589 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.001s	sys 0.012s
I20260709 13:09:59.768447 31142 raft_consensus.cc:2468] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 13.
W20260709 13:09:59.769673 31113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.770890  2672 leader_election.cc:290] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:59.752164  2673 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.772477 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:59.760110  2330 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:59.774768  2624 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:59.723269  2604 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:59.776543 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:59.776621  2330 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:59.777340 30475 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2474) took 1626 ms (client timeout 1937 ms). Trace:
W20260709 13:09:59.777756 30475 rpcz_store.cc:269] 0709 13:09:58.150556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.776220 (+1625664us) service_pool.cc:224] Handling call
0709 13:09:59.777256 (+  1036us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:59.778904 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:59.778725  2310 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:59.780694 30468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 2061) took 2460 ms. Trace:
I20260709 13:09:59.781491  2374 raft_consensus.cc:493] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.781569  2663 raft_consensus.cc:2749] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:59.781771  2479 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:59.782459  2374 raft_consensus.cc:515] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:59.712060 30618 rpcz_store.cc:276] 0709 13:09:58.278419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.278628 (+   209us) service_pool.cc:224] Handling call
0709 13:09:58.279028 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:58.279414 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:58.279451 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:58.280010 (+   559us) log.cc:844] Serialized 26 byte log entry
0709 13:09:59.114275 (+834265us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:59.596413 (+482138us) log.cc:844] Serialized 14 byte log entry
0709 13:09:59.596967 (+   554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.597142 (+   175us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:59.597197 (+    55us) raft_consensus.cc:1685] finished
0709 13:09:59.597213 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.597448 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":221742,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":328561,"raft.run_cpu_time_us":370,"raft.run_wall_time_us":377,"thread_start_us":1315402,"threads_started":2,"wal-append.queue_time_us":946289}
I20260709 13:09:59.721976  2563 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.784073  2563 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:59.785007  2374 leader_election.cc:290] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:59.785096  2487 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:59.786375  2679 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.786558  2563 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:59.724278 30441 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.000s	sys 0.017s
W20260709 13:09:59.787302 30441 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.001s	sys 0.017s
I20260709 13:09:59.787199  2679 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:09:59.768478 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 606356us
I20260709 13:09:59.791188 30589 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:59.722998  2662 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:59.791539  2693 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.792477  2682 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:59.792325  2662 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:59.793285  2682 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:59.792372  2316 consensus_queue.cc:1059] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:09:59.794386  2664 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.794752  2316 raft_consensus.cc:3055] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:59.725656 30476 raft_consensus.cc:2468] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 7.
I20260709 13:09:59.795220  2316 raft_consensus.cc:740] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
W20260709 13:09:59.737430 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 150509us
I20260709 13:09:59.795115  2664 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:59.796674  2316 consensus_queue.cc:260] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:59.798107  2316 raft_consensus.cc:3060] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:59.713146 30623 rpcz_store.cc:276] 0709 13:09:57.994132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.994245 (+   113us) service_pool.cc:224] Handling call
0709 13:09:57.994524 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:57.994832 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:57.994861 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:57.995309 (+   448us) log.cc:844] Serialized 26 byte log entry
0709 13:09:58.592051 (+596742us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:58.592110 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.592199 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:59.598254 (+1006055us) raft_consensus.cc:1685] finished
0709 13:09:59.598298 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.598635 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":659,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":5868,"thread_start_us":574862,"threads_started":1,"wal-append.queue_time_us":930464}
W20260709 13:09:59.716903 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 637362us
I20260709 13:09:59.725059  2665 raft_consensus.cc:493] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.738718  2373 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:59.772186  2673 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:59.784145  2477 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:59.737227  2098 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:59.685940 30469 rpcz_store.cc:276] 0709 13:09:57.854838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.854971 (+   133us) service_pool.cc:224] Handling call
0709 13:09:57.891657 (+ 36686us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:57.892037 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:57.892062 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:57.892540 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 13:09:58.787581 (+895041us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:58.787625 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.787710 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:59.529603 (+741893us) raft_consensus.cc:1685] finished
0709 13:09:59.529653 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.529988 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2350,"raft.queue_time_us":91,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":1105,"thread_start_us":858546,"threads_started":1,"wal-append.queue_time_us":1572880}
I20260709 13:09:59.686373 30467 rpcz_store.cc:276] 0709 13:09:57.854586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.855965 (+  1379us) service_pool.cc:224] Handling call
0709 13:09:57.856219 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:57.856393 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:09:58.461576 (+605183us) log.cc:844] Serialized 14 byte log entry
0709 13:09:59.519996 (+1058420us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:59.520167 (+   171us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:59.520519 (+   352us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.520683 (+   164us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.528535 (+  7852us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30238,"prepare.queue_time_us":794073,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":586367,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":144,"thread_start_us":1632181,"threads_started":3,"wal-append.queue_time_us":900056}
I20260709 13:09:59.766888  2088 consensus_queue.cc:260] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:59.787474  2487 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:59.779517 30475 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 10.
W20260709 13:09:59.795568 30476 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2482) took 1617 ms (client timeout 1859 ms). Trace:
I20260709 13:09:59.746788 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:09:59.809046 30475 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2481) took 1627 ms (client timeout 2049 ms). Trace:
W20260709 13:09:59.809381 30475 rpcz_store.cc:269] 0709 13:09:58.177365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.778563 (+1601198us) service_pool.cc:224] Handling call
0709 13:09:59.804752 (+ 26189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:59.811411 30472 raft_consensus.cc:2368] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 14. Current term is 15.
W20260709 13:09:59.811934 30472 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2484) took 1632 ms (client timeout 1899 ms). Trace:
W20260709 13:09:59.812299 30472 rpcz_store.cc:269] 0709 13:09:58.179362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.746154 (+1566792us) service_pool.cc:224] Handling call
0709 13:09:59.811856 (+ 65702us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:59.812953  2673 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:59.813469 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:59.814570 30475 raft_consensus.cc:2410] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:09:59.814314 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:59.815012 30475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2478) took 1640 ms. Trace:
W20260709 13:09:59.815420 30469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2487) took 1633 ms (client timeout 2078 ms). Trace:
I20260709 13:09:59.816371 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:09:59.817097 31147 raft_consensus.cc:2468] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 10.
I20260709 13:09:59.815344 30475 rpcz_store.cc:276] 0709 13:09:58.174645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.813111 (+1638466us) service_pool.cc:224] Handling call
0709 13:09:59.814949 (+  1838us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:59.816179 30469 rpcz_store.cc:269] 0709 13:09:58.182270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.813838 (+1631568us) service_pool.cc:224] Handling call
0709 13:09:59.815328 (+  1490us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:59.807194 30440 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:09:59.805030 30476 rpcz_store.cc:269] 0709 13:09:58.178046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.347941 (+1169895us) service_pool.cc:224] Handling call
0709 13:09:59.795473 (+447532us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:59.818629 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:09:59.825306 31150 raft_consensus.cc:3060] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:59.794932  2662 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:59.775599  2624 consensus_queue.cc:1048] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:09:59.781054 30468 rpcz_store.cc:276] 0709 13:09:57.319972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.454361 (+134389us) service_pool.cc:224] Handling call
0709 13:09:57.478523 (+ 24162us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:57.898758 (+420235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:57.898803 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:57.899361 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 13:09:58.590459 (+691098us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:58.968878 (+378419us) log.cc:844] Serialized 14 byte log entry
0709 13:09:59.780169 (+811291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.780312 (+   143us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:59.780373 (+    61us) raft_consensus.cc:1685] finished
0709 13:09:59.780384 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.780601 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76894,"prepare.queue_time_us":326405,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":2182,"raft.queue_time_us":721227,"raft.run_cpu_time_us":418,"raft.run_wall_time_us":416,"thread_start_us":2211000,"threads_started":4,"wal-append.queue_time_us":1007849}
I20260709 13:09:59.831099 30589 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:09:59.831247  2652 raft_consensus.cc:2804] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:59.832914  2098 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:59.792335  2693 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:59.712357 30617 rpcz_store.cc:276] 0709 13:09:58.282122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.282245 (+   123us) service_pool.cc:224] Handling call
0709 13:09:58.282557 (+   312us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:59.054763 (+772206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:59.054791 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:59.055364 (+   573us) log.cc:844] Serialized 52 byte log entry
0709 13:09:59.596527 (+541163us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:59.597187 (+   660us) log.cc:844] Serialized 14 byte log entry
0709 13:09:59.597523 (+   336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.597653 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:59.597698 (+    45us) raft_consensus.cc:1685] finished
0709 13:09:59.597712 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.597914 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":99362,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":12802,"raft.queue_time_us":325036,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":211,"thread_start_us":1263403,"threads_started":2,"wal-append.queue_time_us":349617}
I20260709 13:09:59.818846  2477 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:59.842147  2690 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:09:59.846810  2690 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:59.850535  2098 raft_consensus.cc:2749] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:59.848670  2088 raft_consensus.cc:3060] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:59.853369  2693 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:59.840158  2652 raft_consensus.cc:697] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:59.855319  2652 consensus_queue.cc:237] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:59.858814  2505 raft_consensus.cc:2804] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:59.859386  2505 raft_consensus.cc:697] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:09:59.860109 30543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 928) took 2637 ms. Trace:
I20260709 13:09:59.860378  2505 consensus_queue.cc:237] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:59.860499 30543 rpcz_store.cc:276] 0709 13:09:57.222449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.518768 (+296319us) service_pool.cc:224] Handling call
0709 13:09:57.519046 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:57.624078 (+105032us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:58.469733 (+845655us) log.cc:844] Serialized 14 byte log entry
0709 13:09:59.724008 (+1254275us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:59.724117 (+   109us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:59.724266 (+   149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.859642 (+135376us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b5400358c54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:09:59.859684 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.859859 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9718,"prepare.queue_time_us":871801,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":89411,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":16459,"spinlock_wait_cycles":241018752,"thread_start_us":2076548,"threads_started":3,"wal-append.queue_time_us":885367}
I20260709 13:09:59.865087  2568 leader_election.cc:290] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:59.849457 30616 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.003s	sys 0.011s
W20260709 13:09:59.867874 30517 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.012s	sys 0.003s
W20260709 13:09:59.868153 30616 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.003s	sys 0.011s
W20260709 13:09:59.869174 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 71326.3us
I20260709 13:09:59.874490 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:59.847856 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:59.876744 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:09:59.875177 30517 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.013s	sys 0.003s
I20260709 13:09:59.821486  2563 consensus_queue.cc:1048] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:09:59.879868 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:59.881328 30468 raft_consensus.cc:2410] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:09:59.885449 31146 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 11.
I20260709 13:09:59.887454 30475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2480) took 1706 ms. Trace:
I20260709 13:09:59.887872 30475 rpcz_store.cc:276] 0709 13:09:58.176681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.829664 (+1652983us) service_pool.cc:224] Handling call
0709 13:09:59.883124 (+ 53460us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:59.889753 30468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2479) took 1710 ms. Trace:
I20260709 13:09:59.890178 30468 rpcz_store.cc:276] 0709 13:09:58.175982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.844112 (+1668130us) service_pool.cc:224] Handling call
0709 13:09:59.886531 (+ 42419us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:59.900341 30473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 2060) took 2523 ms. Trace:
I20260709 13:09:59.900836 30473 rpcz_store.cc:276] 0709 13:09:57.315899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.316008 (+   109us) service_pool.cc:224] Handling call
0709 13:09:57.316283 (+   275us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:57.316598 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:57.316625 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:57.333489 (+ 16864us) log.cc:844] Serialized 52 byte log entry
0709 13:09:57.501403 (+167914us) spinlock_profiling.cc:243] Waited 7.58 ms on lock 0x7b4800240258. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc788e91aa1 00007fc788e88b37 00007fc788e889ca 00007fc788f8026f 00007fc788f7ff37 00007fc788f9455c 00007fc788f94508 00007fc788f94488 00007fc788f94443 00007fc788f936ec 00007fc787ebda96
0709 13:09:57.976057 (+474654us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:58.784875 (+808818us) log.cc:844] Serialized 14 byte log entry
0709 13:09:59.310241 (+525366us) log.cc:844] Serialized 14 byte log entry
0709 13:09:59.543164 (+232923us) spinlock_profiling.cc:243] Waited 6.41 ms on lock 0x7b18003a01e0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780df5c0a 00007fc78a535219 00007fc780e7da40 00007fc780e784e4 00007fc780e78455 00007fc783f60060 00007fc783f72716 00007fc783f83287 00007fc783f83208
0709 13:09:59.806024 (+262860us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.823236 (+ 17212us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:59.828561 (+  5325us) raft_consensus.cc:1685] finished
0709 13:09:59.828571 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.839453 (+ 10882us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":390769,"prepare.queue_time_us":933139,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":948925,"raft.run_cpu_time_us":3395,"raft.run_wall_time_us":192831,"spinlock_wait_cycles":55410048,"thread_start_us":1950211,"threads_started":4,"wal-append.queue_time_us":798675}
I20260709 13:09:59.902971  2535 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.903643  2535 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:59.905516 30469 raft_consensus.cc:2393] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 15: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:09:59.905953 30469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2483) took 1727 ms. Trace:
I20260709 13:09:59.906412 30469 rpcz_store.cc:276] 0709 13:09:58.178700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.824210 (+1645510us) service_pool.cc:224] Handling call
0709 13:09:59.905898 (+ 81688us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:59.907619 30473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 1040) took 1942 ms. Trace:
W20260709 13:09:59.908579 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.908802 30469 raft_consensus.cc:1275] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:09:59.905982  2535 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:59.880285  2479 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:59.880545  2461 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:09:59.894553 30542 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.008s	sys 0.012s
I20260709 13:09:59.908048 30473 rpcz_store.cc:276] 0709 13:09:57.965275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.906618 (+1941343us) service_pool.cc:224] Handling call
0709 13:09:59.907043 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:59.907268 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:59.907291 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:59.907338 (+    47us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:59.907371 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.907424 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.907533 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:59.914134 30469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 2476) took 1759 ms. Trace:
I20260709 13:09:59.916718 30469 rpcz_store.cc:276] 0709 13:09:58.152069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.907059 (+1754990us) service_pool.cc:224] Handling call
0709 13:09:59.907425 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:59.909189 (+  1764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.911069 (+  1880us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:59.919709 30542 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.008s	sys 0.012s
I20260709 13:09:59.923903  2686 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:09:59.924806  2686 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:59.925715 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:59.926518 30472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2490) took 1713 ms. Trace:
I20260709 13:09:59.926824 30472 rpcz_store.cc:276] 0709 13:09:58.212663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.925387 (+1712724us) service_pool.cc:224] Handling call
0709 13:09:59.926463 (+  1076us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:59.928073  2691 raft_consensus.cc:493] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:09:59.928996  2691 raft_consensus.cc:515] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:59.932405  2416 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:59.915706  2684 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.933624  2684 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:09:59.895599 31114 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:09:59.936664  2487 raft_consensus.cc:2749] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:59.937019 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 62234.4us
I20260709 13:09:59.939127  2487 consensus_queue.cc:1048] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:59.893107  2284 consensus_queue.cc:1048] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:09:59.943157  2359 consensus_queue.cc:1048] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:59.931540  2585 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:59.942488 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:59.913836  2310 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:09:59.952591 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:09:59.940666  2691 leader_election.cc:290] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:09:59.887234  2665 raft_consensus.cc:515] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:09:59.970585 31150 raft_consensus.cc:2468] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 11.
I20260709 13:09:59.971804  2664 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:59.972012 31115 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:09:59.972892 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 94514.4us
I20260709 13:09:59.973075 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:09:59.973755 30467 raft_consensus.cc:3060] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:59.975780  2486 raft_consensus.cc:2804] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:59.976293  2486 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.976655  2486 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:59.973253  2690 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:09:59.982564  2627 log.cc:927] Time spent T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 1.022s	user 0.005s	sys 0.000s
I20260709 13:09:59.984125  2072 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:09:59.989269 30616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 1007) took 1330 ms. Trace:
W20260709 13:09:59.981895 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 66574.3us
W20260709 13:09:59.993276 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 225480us
I20260709 13:09:59.996879  2180 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:00.007196 30546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 912) took 2823 ms. Trace:
I20260709 13:10:00.008085  2373 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:00.007604 30546 rpcz_store.cc:276] 0709 13:09:57.183774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.470631 (+286857us) service_pool.cc:224] Handling call
0709 13:09:57.470918 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:57.755134 (+284216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:57.755164 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:57.791076 (+ 35912us) log.cc:844] Serialized 26 byte log entry
0709 13:09:58.579454 (+788378us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:58.579509 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.579602 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:59.923048 (+1343446us) spinlock_profiling.cc:243] Waited 6.02 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:10:00.006734 (+ 83686us) raft_consensus.cc:1685] finished
0709 13:10:00.006754 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:00.007037 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":38024,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":73,"spinlock_wait_cycles":13835648,"thread_start_us":1002157,"threads_started":2,"wal-append.queue_time_us":1067009}
I20260709 13:10:00.011899 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:00.012571 31151 raft_consensus.cc:2468] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 12.
I20260709 13:10:00.013979  2679 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:00.015992 30470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 1038) took 1915 ms. Trace:
W20260709 13:10:00.029342 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 62172.9us
I20260709 13:10:00.030097 30476 pending_rounds.cc:85] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326: Aborting all ops after (but not including) 5
I20260709 13:10:00.035574 30469 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 12.
I20260709 13:10:00.030405 30476 pending_rounds.cc:107] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:10:00.039878 30590 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:00.038959 30468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 1039) took 2069 ms. Trace:
I20260709 13:09:59.999006 30616 rpcz_store.cc:276] 0709 13:09:58.658961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.722296 (+ 63335us) service_pool.cc:224] Handling call
0709 13:09:58.722598 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:58.722799 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:59.126858 (+404059us) log.cc:844] Serialized 14 byte log entry
0709 13:09:59.892223 (+765365us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:59.913701 (+ 21478us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:59.942049 (+ 28348us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.951649 (+  9600us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.989208 (+ 37559us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2962,"prepare.queue_time_us":609711,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":37,"raft.queue_time_us":4400,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":23198,"thread_start_us":1145351,"threads_started":2,"wal-append.queue_time_us":570636}
I20260709 13:10:00.041976 30468 rpcz_store.cc:276] 0709 13:09:57.964991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.893563 (+1928572us) service_pool.cc:224] Handling call
0709 13:09:59.955292 (+ 61729us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:00.031158 (+ 75866us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:00.031184 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:00.031228 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:00.034464 (+  3236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.034559 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:00.034709 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:00.038630 30476 raft_consensus.cc:2889] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:00.004262  2691 raft_consensus.cc:493] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:00.033927  2684 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:10:00.044365 30471 consensus_meta.cc:287] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.588s	user 0.008s	sys 0.016s
I20260709 13:10:00.065456  2663 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.066347  2663 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:00.067986  2461 consensus_queue.cc:1059] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:00.069928  2682 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:00.078276 30467 raft_consensus.cc:2468] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 14.
I20260709 13:10:00.078781 30467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2489) took 1866 ms. Trace:
I20260709 13:10:00.079028 30467 rpcz_store.cc:276] 0709 13:09:58.212390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.972738 (+1760348us) service_pool.cc:224] Handling call
0709 13:10:00.078706 (+105968us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:00.080698  2379 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:00.081629  2690 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:00.082374  2461 raft_consensus.cc:3055] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:00.082931  2461 raft_consensus.cc:740] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:00.082463  2690 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:00.083894  2461 consensus_queue.cc:260] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:00.087607 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:00.088006 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:00.088698 30543 raft_consensus.cc:3060] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:00.088577 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:00.089543 30548 raft_consensus.cc:2393] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 14: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:00.058588 30475 raft_consensus.cc:2468] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 14.
I20260709 13:10:00.090492 30471 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 14.
I20260709 13:10:00.081041 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:00.022791 30470 rpcz_store.cc:276] 0709 13:09:57.964669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.078669 (+114000us) service_pool.cc:224] Handling call
0709 13:09:58.079046 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:58.079440 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:58.621441 (+542001us) log.cc:844] Serialized 14 byte log entry
0709 13:09:59.824389 (+1202948us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:59.836578 (+ 12189us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:59.847959 (+ 11381us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.873434 (+ 25475us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.879650 (+  6216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81743,"prepare.queue_time_us":834216,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":3270,"raft.queue_time_us":444709,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":181,"thread_start_us":1554281,"threads_started":3,"wal-append.queue_time_us":787990}
I20260709 13:09:59.699349 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:00.098366 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:00.099980 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:00.100731 30617 raft_consensus.cc:2468] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 10.
I20260709 13:10:00.101822 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:00.102612 31151 raft_consensus.cc:2393] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 11: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:10:00.105337 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:00.107852 30543 raft_consensus.cc:2468] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 8.
I20260709 13:10:00.105098 30542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43088 (request call id 2265) took 1161 ms. Trace:
I20260709 13:10:00.092329  2461 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:00.118690 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:00.119284 30440 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6
W20260709 13:10:00.117360 30471 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2491) took 1900 ms (client timeout 1769 ms). Trace:
W20260709 13:10:00.121454 30471 rpcz_store.cc:269] 0709 13:09:58.212942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.320277 (+1107335us) service_pool.cc:224] Handling call
0709 13:10:00.110151 (+789874us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:00.122602 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:00.119757 30517 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:00.124056 30625 raft_consensus.cc:1240] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:00.113144  2652 raft_consensus.cc:2804] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:00.125874 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:00.127519 30617 raft_consensus.cc:2468] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 8.
I20260709 13:10:00.130033 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:00.130051 30616 raft_consensus.cc:2468] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 13.
I20260709 13:10:00.131567 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:00.114636 30542 rpcz_store.cc:276] 0709 13:09:58.928545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.928662 (+   117us) service_pool.cc:224] Handling call
0709 13:09:58.929636 (+   974us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:58.929842 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:58.962576 (+ 32734us) log.cc:844] Serialized 14 byte log entry
0709 13:09:59.968479 (+1005903us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:00.005016 (+ 36537us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:00.032879 (+ 27863us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.041779 (+  8900us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:00.090401 (+ 48622us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":33095,"prepare.run_cpu_time_us":8199,"prepare.run_wall_time_us":51834,"raft.queue_time_us":83206,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":5547,"thread_start_us":957188,"threads_started":2,"wal-append.queue_time_us":469316}
I20260709 13:10:00.134054 30474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 1036) took 2169 ms. Trace:
I20260709 13:10:00.112901  2691 raft_consensus.cc:515] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:00.135419 30590 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:00.127255  2652 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.144348  2665 leader_election.cc:290] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:00.148835 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:00.149430  2691 leader_election.cc:290] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:00.150496  2690 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:10:00.151274 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 92836.7us
I20260709 13:10:00.152066  2652 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:00.152324 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:00.153100 31146 raft_consensus.cc:2468] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 11.
I20260709 13:10:00.156771  2663 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:10:00.158099 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 113373us
I20260709 13:10:00.160029  2684 raft_consensus.cc:2749] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:00.141289  2448 consensus_queue.cc:1048] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:10:00.162678  2683 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:00.135972 30474 rpcz_store.cc:276] 0709 13:09:57.855688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.855780 (+    92us) service_pool.cc:224] Handling call
0709 13:09:57.867542 (+ 11762us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:57.867988 (+   446us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:09:58.240250 (+372262us) spinlock_profiling.cc:243] Waited 4 ms on lock 0x7b4800240258. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc788e91aa1 00007fc788e88b37 00007fc788e889ca 00007fc788f8026f 00007fc788f7ff37 00007fc788f9455c 00007fc788f94508 00007fc788f94488 00007fc788f94443 00007fc788f936ec 00007fc787ebda96
0709 13:09:58.574994 (+334744us) log.cc:844] Serialized 14 byte log entry
0709 13:09:59.734953 (+1159959us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:59.915071 (+180118us) log.cc:844] Serialized 52 byte log entry
0709 13:09:59.942244 (+ 27173us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:59.951718 (+  9474us) log.cc:844] Serialized 14 byte log entry
0709 13:09:59.951999 (+   281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.964210 (+ 12211us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:00.005190 (+ 40980us) raft_consensus.cc:1685] finished
0709 13:10:00.005203 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:00.024885 (+ 19682us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27087,"prepare.queue_time_us":834119,"prepare.run_cpu_time_us":113,"prepare.run_wall_time_us":4443,"raft.queue_time_us":507457,"raft.run_cpu_time_us":3165,"raft.run_wall_time_us":423416,"spinlock_wait_cycles":9210624,"thread_start_us":1799109,"threads_started":3,"wal-append.queue_time_us":821435}
I20260709 13:10:00.166644  2684 consensus_queue.cc:1059] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:10:00.167114  2695 log.cc:927] Time spent T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:10:00.142457  2563 raft_consensus.cc:2804] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:10:00.168522  2697 log.cc:927] Time spent T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:10:00.170436 30470 raft_consensus.cc:1275] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:00.171232 30517 leader_election.cc:304] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:00.173448 30469 raft_consensus.cc:1275] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:10:00.182173 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:00.183106 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:00.183853 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:00.183688 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:00.181788 30467 raft_consensus.cc:1240] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 9. Current term is 10. Ops: []
W20260709 13:10:00.185319 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 46692.5us
W20260709 13:10:00.210083 31113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.211122  2373 raft_consensus.cc:3055] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:00.211545  2373 raft_consensus.cc:740] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:00.213377 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:10:00.214735 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 43599.6us
I20260709 13:10:00.215538 30517 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:00.216503  2607 raft_consensus.cc:2804] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:00.190227  2686 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:00.216109 30370 catalog_manager.cc:5697] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 7 to 8, leader changed from cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 8 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:00.217065 30517 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:00.203979 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:00.219527 31150 raft_consensus.cc:2468] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 11.
I20260709 13:10:00.209100 31149 raft_consensus.cc:2468] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 13.
I20260709 13:10:00.221311 30473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 2486) took 2027 ms. Trace:
W20260709 13:10:00.223104 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 71114.1us
I20260709 13:10:00.219997 30516 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
W20260709 13:10:00.226889 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 93992us
I20260709 13:10:00.217263  2416 raft_consensus.cc:2749] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:00.221618 30473 rpcz_store.cc:276] 0709 13:09:58.180699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.920145 (+1739446us) service_pool.cc:224] Handling call
0709 13:09:59.969532 (+ 49387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:00.038703 (+ 69171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:00.038746 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:00.111185 (+ 72439us) log.cc:844] Serialized 26 byte log entry
0709 13:10:00.164950 (+ 53765us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:00.207801 (+ 42851us) log.cc:844] Serialized 14 byte log entry
0709 13:10:00.208084 (+   283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.208193 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:00.208247 (+    54us) raft_consensus.cc:1685] finished
0709 13:10:00.208264 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:00.208410 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50077,"prepare.queue_time_us":52944,"raft.queue_time_us":31970,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":6065,"thread_start_us":30497,"threads_started":1,"wal-append.queue_time_us":73987}
I20260709 13:10:00.232446 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:00.233067 30543 raft_consensus.cc:2468] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 14.
I20260709 13:10:00.235134 30542 raft_consensus.cc:1240] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:10:00.237902 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
W20260709 13:10:00.238245 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 127150us
W20260709 13:10:00.235898 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 71137.5us
I20260709 13:10:00.217094  2607 raft_consensus.cc:697] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 10 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:00.235476 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:00.238358 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:00.244720 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:00.219300  2563 raft_consensus.cc:697] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 10 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:00.244103 30516 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
W20260709 13:10:00.252705 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.252995 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:00.229331  2316 raft_consensus.cc:493] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:00.247618 31115 leader_election.cc:304] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:00.253754 30624 raft_consensus.cc:2468] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 13.
I20260709 13:10:00.252655 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:00.260589 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:00.212566  2373 consensus_queue.cc:260] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:00.247296  2477 raft_consensus.cc:2804] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:00.247172  2604 raft_consensus.cc:2749] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:00.261193 30546 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 12.
I20260709 13:10:00.264209 31115 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:00.265869 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:00.262290 30516 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
W20260709 13:10:00.267328 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 59198.3us
I20260709 13:10:00.262837 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:00.257584 30370 catalog_manager.cc:5697] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 6 to 7, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 7 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
I20260709 13:10:00.269807 30616 raft_consensus.cc:1275] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:00.268682 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:00.264822 30440 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:00.250156  2686 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:00.272223 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:00.272562 30543 raft_consensus.cc:1240] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:00.276988  2690 raft_consensus.cc:2749] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:00.272778 30620 raft_consensus.cc:2393] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 13: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:10:00.270493 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:00.271391 30516 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:10:00.276875 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:00.275453 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:00.277499  2088 raft_consensus.cc:2804] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:00.275749 31115 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:00.281078 30544 raft_consensus.cc:2468] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 11.
I20260709 13:10:00.267378  2535 raft_consensus.cc:2804] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:00.267540  2684 raft_consensus.cc:2804] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:00.317914 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:00.318197 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:10:00.318334 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 49020.9us
I20260709 13:10:00.318822 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:00.319164 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:00.257241  2284 consensus_queue.cc:1048] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:10:00.262918  2316 raft_consensus.cc:515] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:00.319413 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 45734.1us
W20260709 13:10:00.396206 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 148190us
I20260709 13:10:00.283208 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:00.320403 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:00.382092 30625 raft_consensus.cc:1275] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:00.340086 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:00.321007 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:00.280973  2088 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:00.321362 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 104432us
I20260709 13:10:00.400259 30474 raft_consensus.cc:2393] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 14: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:00.329164 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:00.322502 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:00.348484 30617 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:00.389827 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:00.399675 30544 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 11.
I20260709 13:10:00.320616 31116 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:00.281898 30516 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:10:00.415527 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:00.344223 30370 catalog_manager.cc:5697] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 7 to 8, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 8 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
I20260709 13:10:00.416841 30543 raft_consensus.cc:2410] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:10:00.274969  2477 raft_consensus.cc:697] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:00.320129  2448 raft_consensus.cc:2804] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:00.420795 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:10:00.416903 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 136115us
I20260709 13:10:00.246199  2652 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:00.317581  2691 raft_consensus.cc:2804] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:00.340294  2373 raft_consensus.cc:3060] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:00.427655 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 145863us
I20260709 13:10:00.423941 30623 raft_consensus.cc:2393] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 8: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:10:00.424963 30517 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:00.320040  2515 raft_consensus.cc:2804] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:00.318071  2535 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.402724  2684 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.442456 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:00.422030  2479 raft_consensus.cc:2804] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:00.409065  2088 raft_consensus.cc:3060] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:00.279549  2416 raft_consensus.cc:2804] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:00.431548 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:00.429203 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:00.412523  2683 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:00.441429 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:10:00.320518  2699 log.cc:927] Time spent T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:10:00.335260  2486 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:00.446633 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:00.450268  2652 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:10:00.451895 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.339972  2686 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:00.443212 30370 catalog_manager.cc:5697] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:00.459247 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:00.425266  2448 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:00.459597 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:00.429514  2691 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.463526 30621 raft_consensus.cc:2368] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 14. Current term is 15.
I20260709 13:10:00.439944  2487 raft_consensus.cc:2804] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:00.462458 30616 raft_consensus.cc:2468] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 11.
I20260709 13:10:00.279738  2607 consensus_queue.cc:237] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:00.441321  2535 raft_consensus.cc:3060] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:00.445942  2684 raft_consensus.cc:3060] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:00.441133  2515 raft_consensus.cc:493] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.467263  2448 raft_consensus.cc:3060] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:00.467724  2602 consensus_queue.cc:1059] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.032s
W20260709 13:10:00.468775  2647 log.cc:927] Time spent T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:10:00.469544  2686 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:10:00.469692 30369 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57538 (request call id 303) took 29830 ms (client timeout 15000 ms). Trace:
I20260709 13:10:00.470494 30370 catalog_manager.cc:5697] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:00.472817 31150 raft_consensus.cc:2468] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 5.
I20260709 13:10:00.473126 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:00.475477  2604 raft_consensus.cc:2804] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:00.476013 30624 raft_consensus.cc:2376] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 14. Re-sending same reply.
I20260709 13:10:00.456954  2479 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.461007 30620 raft_consensus.cc:2376] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 10. Re-sending same reply.
I20260709 13:10:00.465986 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
W20260709 13:10:00.479758 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 61284.3us
I20260709 13:10:00.478962 30472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 2488) took 2264 ms. Trace:
I20260709 13:10:00.482556 31151 raft_consensus.cc:2368] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 13. Current term is 14.
I20260709 13:10:00.478186  2691 raft_consensus.cc:3060] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:00.478053  2487 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.429541  2563 consensus_queue.cc:237] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:00.492614 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:00.501785 30616 raft_consensus.cc:2468] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 8.
I20260709 13:10:00.483217  2515 raft_consensus.cc:3060] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:00.498929 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 77026.9us
I20260709 13:10:00.494865 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:00.502373 30544 raft_consensus.cc:3060] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:00.504027 30517 leader_election.cc:400] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 14. Current term is 15.
I20260709 13:10:00.504168  2316 leader_election.cc:290] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:00.505264  2486 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:00.507143 30624 raft_consensus.cc:1240] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:00.508194 30517 leader_election.cc:403] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:00.494655 30472 rpcz_store.cc:276] 0709 13:09:58.212051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.927442 (+1715391us) service_pool.cc:224] Handling call
0709 13:09:59.940223 (+ 12781us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:00.034037 (+ 93814us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:00.034070 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:00.115372 (+ 81302us) log.cc:844] Serialized 52 byte log entry
0709 13:10:00.219619 (+104247us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:00.399345 (+179726us) log.cc:844] Serialized 14 byte log entry
0709 13:10:00.410181 (+ 10836us) log.cc:844] Serialized 14 byte log entry
0709 13:10:00.410461 (+   280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.410564 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:00.476430 (+ 65866us) raft_consensus.cc:1685] finished
0709 13:10:00.476448 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:00.476584 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":112919,"prepare.queue_time_us":72271,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":56,"raft.queue_time_us":42985,"raft.run_cpu_time_us":444,"raft.run_wall_time_us":31215,"spinlock_wait_cycles":5812096,"thread_start_us":214214,"threads_started":2,"wal-append.queue_time_us":320473}
I20260709 13:10:00.511586  2683 consensus_queue.cc:1059] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:00.478139  2477 consensus_queue.cc:237] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:00.510412 30370 catalog_manager.cc:5697] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 6 to 8, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 8 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
I20260709 13:10:00.516806 30622 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 12.
I20260709 13:10:00.496110  2479 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:00.501329  2487 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:00.492362  2604 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:00.520843 30625 raft_consensus.cc:2393] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 14: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:10:00.522990  2072 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.517315 30589 leader_election.cc:304] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:00.525506 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:00.528440 30543 raft_consensus.cc:1275] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:00.526674  2604 raft_consensus.cc:3060] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:00.535964  2072 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:00.538268  2072 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:00.546238 30617 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 15.
I20260709 13:10:00.548637 30619 raft_consensus.cc:2468] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 12.
W20260709 13:10:00.549530 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 46903.4us
I20260709 13:10:00.553560  2088 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:00.554190  2652 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:00.559125  2652 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:00.560396 30543 raft_consensus.cc:1275] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:10:00.561249  2180 raft_consensus.cc:2804] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:00.562806 30370 catalog_manager.cc:5697] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 4 to 7, leader changed from cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 7 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:00.568231 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:10:00.564029 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 57389.3us
I20260709 13:10:00.567932  2692 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.570436 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:00.549718  2683 raft_consensus.cc:3055] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:00.575788 30370 catalog_manager.cc:5697] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 7 to 10, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 10 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
I20260709 13:10:00.572795 30440 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:00.588093 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:00.593679 30370 catalog_manager.cc:5697] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 10 to 13, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 13 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:00.575901  2683 raft_consensus.cc:740] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:00.600401 30370 catalog_manager.cc:5697] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:00.580651  2180 raft_consensus.cc:697] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:00.586776  2686 raft_consensus.cc:2804] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:00.601771 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:00.607674 30624 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:00.610095 30543 raft_consensus.cc:1275] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:10:00.577387  2692 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:00.617520  2448 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:00.614048 30516 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:00.602234  2072 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:00.630177 30370 catalog_manager.cc:5697] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
W20260709 13:10:00.631089 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 87271.6us
W20260709 13:10:00.634545 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 81253us
I20260709 13:10:00.607352  2686 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:00.647305  2088 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:00.647512 30440 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:00.652769  2684 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:00.654920  2684 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:00.655495 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:00.656564  2609 consensus_queue.cc:1048] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:00.658815 30440 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:00.633491  2602 consensus_queue.cc:1048] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:10:00.660470 30517 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:00.617523  2652 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:00.662698 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:00.663098  2678 raft_consensus.cc:2804] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:00.663570  2678 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:10:00.632725  2461 consensus_meta.cc:287] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.511s	user 0.007s	sys 0.003s
I20260709 13:10:00.660303 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:00.666970 30472 raft_consensus.cc:2368] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 13. Current term is 14.
I20260709 13:10:00.654920  2692 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:00.661851  2663 consensus_queue.cc:1048] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:00.662003 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:00.660179 30370 catalog_manager.cc:5697] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:00.662362  2690 raft_consensus.cc:2749] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:00.644619 30591 leader_election.cc:336] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.515s (SENT)
I20260709 13:10:00.660269 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:00.667197 30589 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:00.669814 30476 raft_consensus.cc:2368] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 13. Current term is 14.
I20260709 13:10:00.661132  2686 raft_consensus.cc:3060] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:00.665930  2678 raft_consensus.cc:3060] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:00.679250 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:00.680941 30473 raft_consensus.cc:2393] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 15: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:00.682376 30517 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:00.684789 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:00.688597 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:00.688628 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:00.690395 30474 raft_consensus.cc:2393] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 15: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:00.705880 30472 raft_consensus.cc:2393] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 14: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:00.669752  2316 consensus_queue.cc:1059] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:10:00.710381 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:00.710193 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:00.710685 30370 catalog_manager.cc:5697] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 9 to 14, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 14 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:00.711483 30619 raft_consensus.cc:3060] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:00.711572 30476 raft_consensus.cc:2393] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 12: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:00.674464  2607 raft_consensus.cc:2749] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 14. Current term is 15.
I20260709 13:10:00.641304  2072 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:00.670300  2652 consensus_queue.cc:1059] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:10:00.666705  2416 raft_consensus.cc:697] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 11 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:00.718477 30471 raft_consensus.cc:1275] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:00.720250 31115 leader_election.cc:400] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Vote denied by peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) with higher term. Message: Invalid argument: T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 14. Current term is 15.
I20260709 13:10:00.722887 31115 leader_election.cc:403] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:00.722954 30470 raft_consensus.cc:2393] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 14: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:00.724145 30370 catalog_manager.cc:5697] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:00.732270 30440 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:10:00.733327 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 128939us
I20260709 13:10:00.727087 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
W20260709 13:10:00.738751 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.738744 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:00.718027  2692 raft_consensus.cc:2804] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:00.748538 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:00.748704 30370 catalog_manager.cc:5697] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 9 to 10, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 10 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:00.720149  2373 raft_consensus.cc:2749] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:00.754963 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:00.757323  2714 raft_consensus.cc:2749] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:00.760798  2714 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.761358  2714 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:00.761656 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:00.762387 31147 raft_consensus.cc:2393] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 9: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:10:00.763338 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:00.764003 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:00.764227 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:00.764521 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:00.764632 30471 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 12.
I20260709 13:10:00.765326 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:00.765604 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:00.766381 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:00.766597 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:00.767140 31142 raft_consensus.cc:2468] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
I20260709 13:10:00.766404  2579 raft_consensus.cc:3055] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:00.768411  2579 raft_consensus.cc:740] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:00.769512  2579 consensus_queue.cc:260] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:00.770462 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:00.770819  2579 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:00.771936  2607 raft_consensus.cc:2804] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:00.772090 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:00.762339 31144 raft_consensus.cc:1240] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:10:00.772416  2607 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:00.772718 30471 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:10:00.772857  2607 raft_consensus.cc:3060] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:00.773873  2692 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:00.774088 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:00.774336  2692 raft_consensus.cc:3060] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:00.774649 30467 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:00.774691 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:00.775307 30476 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 11.
I20260709 13:10:00.763391  2714 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:00.776904 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:00.778321 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:00.778833 30473 raft_consensus.cc:2468] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 11.
I20260709 13:10:00.780015 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:00.780354 30517 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
W20260709 13:10:00.782052 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 145818us
I20260709 13:10:00.710212  2379 consensus_queue.cc:1048] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:10:00.785149 30590 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:00.781211 30370 catalog_manager.cc:5697] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:00.713076  2535 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:00.752868  2602 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:10:00.789609 30370 catalog_manager.cc:5697] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 8 to 11, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 11 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
I20260709 13:10:00.790534 30476 raft_consensus.cc:1275] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:10:00.794204 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:00.711941  2683 consensus_queue.cc:260] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:00.796962 30467 raft_consensus.cc:2468] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 16.
I20260709 13:10:00.797797 30475 raft_consensus.cc:1240] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:00.799991 30544 raft_consensus.cc:2468] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 11.
I20260709 13:10:00.801576 30370 catalog_manager.cc:5697] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 9 to 12, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 12 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
W20260709 13:10:00.491189 30369 rpcz_store.cc:269] 0709 13:09:30.639467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.639899 (+   432us) service_pool.cc:224] Handling call
0709 13:10:00.469453 (+29829554us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:55.240877 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:55.589156 (+348279us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:55.589212 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:09:55.589233 (+    21us) tablet.cc:662] Decoding operations
0709 13:09:55.590456 (+  1223us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:55.590615 (+   159us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:55.590652 (+    37us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:09:55.722878 (+132226us) tablet.cc:701] Row locks acquired
0709 13:09:55.722927 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:09:55.723092 (+   165us) write_op.cc:270] Start()
0709 13:09:55.723214 (+   122us) write_op.cc:276] Timestamp: P: 1783602595723025 usec, L: 0
0709 13:09:55.723248 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:09:55.724034 (+   786us) log.cc:844] Serialized 4863 byte log entry
0709 13:09:56.782079 (+1058045us) op_driver.cc:464] REPLICATION: finished
0709 13:09:56.940427 (+158348us) write_op.cc:301] APPLY: starting
0709 13:09:56.940578 (+   151us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:57.177770 (+237192us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:57.178023 (+   253us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:57.942351 (+764328us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:57.942718 (+   367us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 13:09:57.942765 (+    47us) write_op.cc:312] APPLY: finished
0709 13:09:57.943172 (+   407us) log.cc:844] Serialized 113 byte log entry
0709 13:09:58.587987 (+644815us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:58.613421 (+ 25434us) write_op.cc:454] Released schema lock
0709 13:09:58.649847 (+ 36426us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:58.699698 (+ 49851us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:58.699745 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":148370,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":155811,"apply.run_cpu_time_us":67634,"apply.run_wall_time_us":1761384,"cfile_cache_hit":46,"cfile_cache_hit_bytes":48093,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6218,"cfile_init":2,"lbm_read_time_us":78999,"lbm_reads_1-10_ms":2,"lbm_reads_10-100_ms":2,"lbm_reads_lt_1ms":8,"num_ops":12,"prepare.queue_time_us":478971,"prepare.run_cpu_time_us":25014,"prepare.run_wall_time_us":733335,"raft.queue_time_us":457082,"raft.run_cpu_time_us":12998,"raft.run_wall_time_us":80553,"replication_time_us":1058622,"thread_start_us":1688309,"threads_started":5,"wal-append.queue_time_us":1092133,"wal-append.run_cpu_time_us":32063,"wal-append.run_wall_time_us":2713024}]]}
I20260709 13:10:00.747515  2316 consensus_queue.cc:1048] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:10:00.803892 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:00.806016 30473 raft_consensus.cc:1275] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:10:00.807097 30470 raft_consensus.cc:3060] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:00.808971 30474 raft_consensus.cc:1275] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:10:00.809438 30474 pending_rounds.cc:85] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326: Aborting all ops after (but not including) 7
I20260709 13:10:00.809721 30474 pending_rounds.cc:107] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:10:00.810010 30474 raft_consensus.cc:2889] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:00.818091 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:10:00.825382 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 220801us
I20260709 13:10:00.825049 30370 catalog_manager.cc:5697] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 9 to 12, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 12 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:00.827343 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 147858us
I20260709 13:10:00.784875  2477 consensus_queue.cc:1048] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:10:00.787621  2691 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:00.812393  2663 raft_consensus.cc:2804] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:00.836001 30589 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:00.736824  2180 consensus_queue.cc:237] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:00.838191  2416 consensus_queue.cc:237] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:00.839145  2720 raft_consensus.cc:3055] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:00.845223 30441 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:00.811681  2714 raft_consensus.cc:2749] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:00.848167 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 107337us
I20260709 13:10:00.834774 30476 raft_consensus.cc:2468] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
I20260709 13:10:00.852955 30370 catalog_manager.cc:5697] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 5 to 9, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 9 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:00.855222 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:00.873023 30471 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 14.
W20260709 13:10:00.857151 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 145846us
I20260709 13:10:00.878594 30546 raft_consensus.cc:1240] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:10:00.879448 30619 raft_consensus.cc:2468] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 9.
W20260709 13:10:00.890467 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 106994us
I20260709 13:10:00.898856 30472 raft_consensus.cc:2410] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 16 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:10:00.899487 30370 catalog_manager.cc:5697] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:00.870779  2720 raft_consensus.cc:740] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
W20260709 13:10:00.903954 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 68048.2us
I20260709 13:10:00.889046  2563 raft_consensus.cc:2804] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:00.887440  2316 raft_consensus.cc:2749] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:00.886650  2663 raft_consensus.cc:697] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 14 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
W20260709 13:10:00.906047 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 60892.5us
I20260709 13:10:00.910929 30516 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:00.913434 30370 catalog_manager.cc:5697] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 7 to 10, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 10 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
I20260709 13:10:00.922214 30370 catalog_manager.cc:5697] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:00.924139 30370 catalog_manager.cc:5697] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 5 to 11. New cstate: current_term: 11 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:00.919256  2714 consensus_queue.cc:1048] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:10:00.929051 30441 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:00.910200  2652 raft_consensus.cc:2804] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:00.930406 30624 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 14.
I20260709 13:10:00.921849 30516 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:00.938215  2678 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:00.940425  2723 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.956142 30370 catalog_manager.cc:5697] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 7 to 10, leader changed from cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 10 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:00.951887 30590 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:00.906168  2604 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:00.931458  2487 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:00.944337  2379 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.922102  2563 raft_consensus.cc:697] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 10 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
W20260709 13:10:00.967828 30591 leader_election.cc:336] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.672s (SENT)
I20260709 13:10:00.971889 30542 raft_consensus.cc:1240] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:00.971689 30469 raft_consensus.cc:1240] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 7. Current term is 8. Ops: []
W20260709 13:10:00.978724 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 76975.1us
I20260709 13:10:00.964902  2728 raft_consensus.cc:2749] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:10:00.981196 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 52252.9us
I20260709 13:10:00.976938 30516 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:00.987578  2715 raft_consensus.cc:2749] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:00.974387 31146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7"
dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
mode: GRACEFUL
new_leader_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:42956
I20260709 13:10:00.990691 31146 raft_consensus.cc:606] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 9 LEADER]: Received request to transfer leadership to TS 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:00.970772  2379 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:00.992027  2726 consensus_queue.cc:1048] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 13:10:00.993482  2727 raft_consensus.cc:493] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.993983  2727 raft_consensus.cc:515] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:00.996462  2720 consensus_queue.cc:260] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:00.994218  2379 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:00.971689  2373 raft_consensus.cc:2804] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:00.970983  2535 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:01.019318 30517 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:01.023160 30517 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:01.027884  2715 raft_consensus.cc:2804] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:01.029343 31116 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:10:01.031615 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 54786.1us
I20260709 13:10:01.032295 30516 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:10:00.986692  2477 raft_consensus.cc:2804] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:01.035012 31115 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:10:01.042268 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 90451.3us
I20260709 13:10:01.042704 30441 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:01.021718  2720 raft_consensus.cc:3060] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:01.051203 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 90704us
W20260709 13:10:01.037972  2515 consensus_meta.cc:287] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.514s	user 0.010s	sys 0.000s
I20260709 13:10:01.020934  2727 leader_election.cc:290] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:00.987022  2692 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:00.971534  2723 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:01.038410  2477 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.035075  2691 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:01.040961  2714 raft_consensus.cc:2749] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:01.078697 30548 raft_consensus.cc:2468] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
W20260709 13:10:01.083829 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 48894.3us
W20260709 13:10:01.066188  2716 log.cc:927] Time spent T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 13:10:01.053287  2732 raft_consensus.cc:2804] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:00.985910  2663 consensus_queue.cc:237] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:01.101899  2678 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:01.104027 31151 raft_consensus.cc:1275] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:10:01.055845  2535 consensus_queue.cc:1048] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:10:01.110144 30624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c"
dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
mode: GRACEFUL
new_leader_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:49382
I20260709 13:10:01.088933  2477 raft_consensus.cc:3060] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:01.095389  2717 log.cc:927] Time spent T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 13:10:01.099743  2563 consensus_queue.cc:237] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:01.106504  2732 raft_consensus.cc:697] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 14 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:01.114538  2714 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:01.114825  2461 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.120260 30624 raft_consensus.cc:606] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Received request to transfer leadership to TS 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:01.139557 30624 raft_consensus.cc:614] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:01.069329  2515 raft_consensus.cc:515] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:01.118386  2373 raft_consensus.cc:697] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 14 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:01.092422  2744 raft_consensus.cc:2749] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:01.076438  2722 consensus_queue.cc:1048] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:10:01.120822 30470 raft_consensus.cc:2468] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
W20260709 13:10:01.145443 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 110873us
I20260709 13:10:01.153339  2732 consensus_queue.cc:237] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:01.155920 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 123685us
I20260709 13:10:01.156760 30516 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:01.157366  2733 raft_consensus.cc:2804] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:01.157981  2733 raft_consensus.cc:697] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 9 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:01.158177  2487 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:01.158877  2733 consensus_queue.cc:237] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:01.136780  2726 raft_consensus.cc:2804] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:01.141449  2728 raft_consensus.cc:2749] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:10:01.160254  2739 log.cc:927] Time spent T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:10:01.160619 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:01.161201 30472 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:01.162853  2607 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:01.144845  2714 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:01.166046  2714 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:10:01.167109  2737 log.cc:927] Time spent T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:10:01.179901 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 67747us
I20260709 13:10:01.170320  2715 raft_consensus.cc:697] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 15 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:01.172855  2652 raft_consensus.cc:697] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:01.173849  2604 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:01.207770 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:01.211016 30441 leader_election.cc:304] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:01.155962  2461 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:01.214550 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:01.219051 31146 raft_consensus.cc:3060] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:01.215329 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:01.216518 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:01.220362 31144 raft_consensus.cc:3060] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:01.220703 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:01.221055 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:01.221300 30617 raft_consensus.cc:1275] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:01.221598 30624 raft_consensus.cc:3060] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:01.145550  2729 consensus_queue.cc:1048] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:10:01.192188  2726 raft_consensus.cc:697] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 12 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:01.227861 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:01.213495  2750 raft_consensus.cc:2749] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:01.231369 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:01.231659 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:01.179409  2373 consensus_queue.cc:237] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:01.235311 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 98153us
I20260709 13:10:01.236807 31149 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130"
dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
mode: GRACEFUL
new_leader_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:42956
I20260709 13:10:01.237399 31149 raft_consensus.cc:606] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Received request to transfer leadership to TS f639301059e24dc5b0d88a46dc683326
I20260709 13:10:01.237829 31149 raft_consensus.cc:614] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:01.238169 31142 raft_consensus.cc:2368] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 14. Current term is 15.
I20260709 13:10:01.241212 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:01.242455  2746 raft_consensus.cc:2749] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:01.243960  2448 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:01.246037 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:01.247242 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:10:01.248901  2479 consensus_meta.cc:287] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.701s	user 0.010s	sys 0.000s
I20260709 13:10:01.249320  2479 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:01.250056  2683 raft_consensus.cc:3060] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:01.251500  2479 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:01.252157 30547 raft_consensus.cc:2393] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 15: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:01.268190 30589 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:01.273404 31144 raft_consensus.cc:2468] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 14.
W20260709 13:10:01.253815  2743 log.cc:927] Time spent T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 13:10:01.254859  2710 log.cc:927] Time spent T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.761s	user 0.004s	sys 0.000s
I20260709 13:10:01.254782  2607 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:10:01.258100 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:01.261482 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.261817  2750 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:10:01.262128 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 56250.1us
I20260709 13:10:01.252465  2723 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:01.350194  2747 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.350821  2747 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:01.252799  2738 log.cc:927] Time spent T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:10:01.353531  2747 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:01.338392  2753 raft_consensus.cc:2749] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:01.354982  2690 consensus_queue.cc:1048] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:01.355293 31146 raft_consensus.cc:2468] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 11.
I20260709 13:10:01.345870 30624 raft_consensus.cc:2468] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 14.
I20260709 13:10:01.354728  2604 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.356087  2754 consensus_queue.cc:1059] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:01.356331  2604 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:01.357301  2754 raft_consensus.cc:3055] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:01.357481 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:01.357650  2754 raft_consensus.cc:740] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:01.358415  2604 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:01.358569  2754 consensus_queue.cc:260] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:01.284091 30472 raft_consensus.cc:2468] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 15.
I20260709 13:10:01.361424 30618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47446 (request call id 2585) took 1105 ms. Trace:
I20260709 13:10:01.361773 30618 rpcz_store.cc:276] 0709 13:10:00.255679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.257721 (+  2042us) service_pool.cc:224] Handling call
0709 13:10:01.361236 (+1103515us) spinlock_profiling.cc:243] Waited 404 ms on lock 0x7b5400222254. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:10:01.361347 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":928120704}
I20260709 13:10:01.366602 30546 raft_consensus.cc:1240] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:10:01.369102  2426 raft_consensus.cc:3055] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:01.369474  2426 raft_consensus.cc:740] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:01.370398  2426 consensus_queue.cc:260] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:01.371529  2426 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:01.372543 30548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39952 (request call id 2205) took 1179 ms. Trace:
I20260709 13:10:01.378031 30548 rpcz_store.cc:276] 0709 13:10:00.192747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.192867 (+   120us) service_pool.cc:224] Handling call
0709 13:10:01.372377 (+1179510us) spinlock_profiling.cc:243] Waited 466 ms on lock 0x7b540020add4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:10:01.372468 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1072510336}
I20260709 13:10:01.375710 30542 raft_consensus.cc:1275] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:10:01.367642 30546 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:01.376925 30441 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:01.384500 30441 leader_election.cc:304] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:01.386582  2072 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:01.377622  2754 raft_consensus.cc:3060] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:01.354722 30517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.385046  2749 raft_consensus.cc:2804] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:01.395992  2749 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:01.396435  2749 raft_consensus.cc:3060] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:01.401016 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:01.402308 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:01.402899 30542 raft_consensus.cc:2468] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9.
I20260709 13:10:01.404208 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:01.404901 30548 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:01.403645 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:01.419587 30548 raft_consensus.cc:2410] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:10:01.425004 30546 raft_consensus.cc:1275] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:10:01.427325 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:01.462159 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:01.462996 30546 raft_consensus.cc:2376] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 11. Re-sending same reply.
W20260709 13:10:01.421720 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 78628.6us
I20260709 13:10:01.471496 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:01.472285 30548 raft_consensus.cc:2393] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 11: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:01.472862 31146 raft_consensus.cc:1240] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
W20260709 13:10:01.473227 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.481142 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:01.481357 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:01.482923 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:01.483799 30617 raft_consensus.cc:2393] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 12: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:01.422251  2690 raft_consensus.cc:2804] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:01.485270 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:01.492576 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:01.492784 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:01.494310 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:01.485908 30625 raft_consensus.cc:2368] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 13. Current term is 14.
I20260709 13:10:01.496552 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:01.497357 30624 raft_consensus.cc:2393] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 16: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:10:01.500257 30542 raft_consensus.cc:2393] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 12: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
W20260709 13:10:01.503675 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 293458us
I20260709 13:10:01.511956 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:01.513547 30589 leader_election.cc:304] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:01.512723 30543 raft_consensus.cc:2468] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 11.
I20260709 13:10:01.518958 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:01.520716 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:01.520467 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:01.521425 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:01.522069 30542 raft_consensus.cc:2468] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 14.
I20260709 13:10:01.521433 30544 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 12.
I20260709 13:10:01.520467 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:01.461619  2563 consensus_queue.cc:1059] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:10:01.527618 30619 raft_consensus.cc:2393] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 10: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:10:01.530658  2563 raft_consensus.cc:3055] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:01.531046  2563 raft_consensus.cc:740] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:01.531513  2729 raft_consensus.cc:2804] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:01.527453 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:01.532415 31146 raft_consensus.cc:2468] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 16.
I20260709 13:10:01.528708 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:01.533254 30620 raft_consensus.cc:3060] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:01.533491  2602 consensus_meta.cc:287] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.729s	user 0.007s	sys 0.002s
I20260709 13:10:01.533895  2602 raft_consensus.cc:2749] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) with higher term. Message: Invalid argument: T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 14. Current term is 15.
I20260709 13:10:01.533941  2477 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:01.347061  2715 consensus_queue.cc:237] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:01.465310  2180 consensus_queue.cc:1059] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:10:01.541599 30548 raft_consensus.cc:2393] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 14: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:01.541819 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:01.498508  2690 raft_consensus.cc:493] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:01.542268 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:01.548785 30591 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:01.539302 30516 leader_election.cc:304] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:01.563717  2663 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.564422  2663 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:01.566238 30441 leader_election.cc:304] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:01.529423 31116 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:10:01.511233  2686 consensus_meta.cc:287] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.822s	user 0.011s	sys 0.000s
I20260709 13:10:01.544871 31147 raft_consensus.cc:2468] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 15.
I20260709 13:10:01.545636 30620 raft_consensus.cc:2468] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 11.
I20260709 13:10:01.516276  2515 leader_election.cc:290] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:01.571045 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:01.576436 30548 raft_consensus.cc:2468] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 8.
I20260709 13:10:01.571637 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:01.577059 30441 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:01.572814 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:01.574380 30619 raft_consensus.cc:1240] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:01.572243 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:01.579773 30544 raft_consensus.cc:2410] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:10:01.579952 30542 raft_consensus.cc:2393] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 12: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:01.581192 30468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 2494) took 1791 ms. Trace:
I20260709 13:10:01.581282 30516 leader_election.cc:400] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Vote denied by peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453) with higher term. Message: Invalid argument: T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 14. Current term is 15.
I20260709 13:10:01.582434 30516 leader_election.cc:403] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:01.462859  2652 consensus_queue.cc:237] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:01.511466  2316 consensus_queue.cc:1059] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:10:01.568827  2686 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:01.587939 30516 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:10:01.554533  2426 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.556293  2729 raft_consensus.cc:697] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:01.581714 30468 rpcz_store.cc:276] 0709 13:09:59.789733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.077038 (+287305us) service_pool.cc:224] Handling call
0709 13:10:00.116756 (+ 39718us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:00.132357 (+ 15601us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:00.132386 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:00.184873 (+ 52487us) log.cc:844] Serialized 26 byte log entry
0709 13:10:00.256016 (+ 71143us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:00.315725 (+ 59709us) log.cc:844] Serialized 14 byte log entry
0709 13:10:00.317160 (+  1435us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.317233 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:01.254352 (+937119us) spinlock_profiling.cc:243] Waited 5.68 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:10:01.573799 (+319447us) raft_consensus.cc:1685] finished
0709 13:10:01.580952 (+  7153us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:01.581126 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19301,"prepare.queue_time_us":78851,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":9268,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":21590,"spinlock_wait_cycles":13064064,"thread_start_us":38603,"threads_started":1,"wal-append.queue_time_us":246829}
I20260709 13:10:01.597573 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:01.569428  2690 raft_consensus.cc:3060] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:01.485052  2750 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:01.598663 30516 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:10:01.600687 30441 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:01.602927 30591 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:01.642967 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:01.583623  2461 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:01.579874  2746 raft_consensus.cc:2749] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:01.579612  2691 raft_consensus.cc:2804] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:01.664120 30546 raft_consensus.cc:2468] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 11.
I20260709 13:10:01.592904  2373 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:01.666347 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 63633.5us
I20260709 13:10:01.668040 30591 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:01.644451 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:10:01.599630 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 93940.3us
I20260709 13:10:01.656700 30549 raft_consensus.cc:2368] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 14. Current term is 15.
I20260709 13:10:01.655510 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:10:01.657121 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 58535.7us
I20260709 13:10:01.655942 30617 raft_consensus.cc:1240] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:10:01.659198 30476 raft_consensus.cc:1240] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:01.668810  2316 raft_consensus.cc:2804] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:01.674189  2316 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:01.674608  2316 raft_consensus.cc:3060] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:01.675141  2486 consensus_queue.cc:1059] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:01.676210  2515 raft_consensus.cc:3055] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:01.676621  2515 raft_consensus.cc:740] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:01.677292 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:01.677762  2515 consensus_queue.cc:260] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:01.679162  2515 raft_consensus.cc:3060] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:01.675213 30516 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:01.528178  2726 consensus_queue.cc:237] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:01.655387  2755 log.cc:927] Time spent T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 13:10:01.643136  2535 raft_consensus.cc:2804] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:01.592710  2748 raft_consensus.cc:2749] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:01.690155 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:01.705150 30617 raft_consensus.cc:2393] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 15: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:10:01.543716  2753 consensus_queue.cc:1048] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.136s
I20260709 13:10:01.656725  2720 raft_consensus.cc:2749] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:01.695062 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:01.708467 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:01.707937 30622 raft_consensus.cc:1240] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:01.698606  2715 consensus_queue.cc:1048] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:10:01.710119  2733 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.720469  2733 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:01.710316  2760 consensus_queue.cc:1048] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:01.710566  2766 raft_consensus.cc:2804] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:01.710497 31114 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:10:01.687636  2072 raft_consensus.cc:2804] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:01.714672 30591 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:01.715329 30620 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 12.
I20260709 13:10:01.652266  2725 raft_consensus.cc:3055] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:01.718302 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:01.732786 30619 raft_consensus.cc:2393] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 9: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:10:01.663755  2416 raft_consensus.cc:2804] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:01.711169  2742 raft_consensus.cc:3055] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:01.644649  2426 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:01.728075  2750 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:01.715754  2461 raft_consensus.cc:2804] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:01.728533  2729 consensus_queue.cc:237] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:01.664047  2691 raft_consensus.cc:493] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:01.652237  2727 consensus_queue.cc:1048] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:10:01.584213  2563 consensus_queue.cc:260] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:01.714828 30549 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 11.
I20260709 13:10:01.741528 30591 leader_election.cc:304] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:01.738817 31114 leader_election.cc:304] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:01.703183  2607 raft_consensus.cc:2749] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:01.698786  2284 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:01.793200 30617 raft_consensus.cc:1275] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:01.734436  2766 raft_consensus.cc:697] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 15 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:01.846616 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:01.739223  2776 raft_consensus.cc:2749] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:01.731731  2535 raft_consensus.cc:697] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 14 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:01.739499  2760 raft_consensus.cc:2804] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:10:01.808316 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 207672us
I20260709 13:10:01.744767  2180 consensus_queue.cc:1048] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.096s
I20260709 13:10:01.853621  2284 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:01.855829 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 117110us
W20260709 13:10:01.860059  2768 log.cc:927] Time spent T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:10:01.740469  2742 raft_consensus.cc:740] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:01.735255  2725 raft_consensus.cc:740] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:01.735049  2072 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:10:01.864646 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 123185us
I20260709 13:10:01.869011 30622 raft_consensus.cc:2410] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:10:01.783609  2691 raft_consensus.cc:3060] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:01.749307  2461 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.874413 30441 leader_election.cc:400] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Vote denied by peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453) with higher term. Message: Invalid argument: T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 13. Current term is 14.
I20260709 13:10:01.874801 30621 raft_consensus.cc:1275] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:01.910373 30441 leader_election.cc:403] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:01.744927  2416 raft_consensus.cc:697] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 11 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:01.875312 30617 raft_consensus.cc:1275] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:01.856525  2602 raft_consensus.cc:2749] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:01.872179  2777 raft_consensus.cc:2749] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:01.888289 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
W20260709 13:10:01.889780 30547 consensus_meta.cc:287] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.531s	user 0.008s	sys 0.007s
I20260709 13:10:01.909648 30591 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
W20260709 13:10:01.910969 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.916620 30547 raft_consensus.cc:2468] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 11.
I20260709 13:10:01.922829 30440 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:01.909188  2072 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:01.936213  2535 consensus_queue.cc:237] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:01.937712  2776 raft_consensus.cc:2749] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:10:01.937990  2767 log.cc:927] Time spent T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
I20260709 13:10:01.938566  2563 raft_consensus.cc:3060] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:01.944092  2686 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:01.936331  2416 consensus_queue.cc:237] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:01.936973  2771 log.cc:927] Time spent T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:10:01.950534 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:01.950562 31115 leader_election.cc:400] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 election: Vote denied by peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) with higher term. Message: Invalid argument: T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 13. Current term is 14.
I20260709 13:10:01.951339 31115 leader_election.cc:403] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:10:01.913856  2461 raft_consensus.cc:3060] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:01.954030 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 68700.4us
I20260709 13:10:01.958644 31114 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:01.963909 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:01.963495 31115 leader_election.cc:304] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:10:01.912932  2720 consensus_queue.cc:1048] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:10:01.987311 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:01.988469 30547 raft_consensus.cc:2393] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 8: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
W20260709 13:10:01.994065 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 119786us
W20260709 13:10:01.994021 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 84471us
I20260709 13:10:01.995177 30591 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:01.996510  2753 raft_consensus.cc:2804] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:01.963052  2686 raft_consensus.cc:2749] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:01.995784 30441 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:01.960187  2728 raft_consensus.cc:2749] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453) with higher term. Message: Invalid argument: T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 13. Current term is 14.
I20260709 13:10:01.993705 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:02.001811 30551 raft_consensus.cc:3060] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:01.999029 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:02.002488 30549 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 12.
I20260709 13:10:02.004482 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:02.005056  2759 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:02.007141 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 52396.4us
I20260709 13:10:02.004647 30473 raft_consensus.cc:1240] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:02.009238 31114 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:01.990141  2760 raft_consensus.cc:697] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 11 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:02.013602 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:10:02.015720 31147 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48414 (request call id 1064) took 1247 ms (client timeout 1617 ms). Trace:
I20260709 13:10:02.016326 30547 raft_consensus.cc:2393] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 10: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:10:02.014489 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:01.971083  2783 raft_consensus.cc:2749] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) with higher term. Message: Invalid argument: T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 13. Current term is 14.
W20260709 13:10:02.016163 31147 rpcz_store.cc:269] 0709 13:10:00.762304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.763103 (+   799us) service_pool.cc:224] Handling call
0709 13:10:02.009980 (+1246877us) spinlock_profiling.cc:243] Waited 764 ms on lock 0x7b54005c2454. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:10:02.010061 (+    81us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1758007168}
I20260709 13:10:02.020105  2775 raft_consensus.cc:2764] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:10:02.034898 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:02.020524  2430 consensus_queue.cc:1059] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.020s
W20260709 13:10:02.021759  2763 log.cc:927] Time spent T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:10:02.024128 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:02.036724  2284 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:02.036952 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:02.038106 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:02.039191 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:02.040694 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:02.041224 30474 raft_consensus.cc:2468] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 11.
I20260709 13:10:02.041530 30547 raft_consensus.cc:1275] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:02.042004 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:02.043371 30474 raft_consensus.cc:1275] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:02.024372  2780 consensus_queue.cc:1059] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:10:02.025556 30545 raft_consensus.cc:1240] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:02.016044  2690 raft_consensus.cc:515] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:02.030632  2683 consensus_meta.cc:287] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.780s	user 0.011s	sys 0.000s
I20260709 13:10:01.997174  2753 raft_consensus.cc:697] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:02.019268 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:01.997464  2515 raft_consensus.cc:2804] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:10:02.056411 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.035741 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:02.054591 30471 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:02.055588 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 46418.5us
I20260709 13:10:02.059334 31114 leader_election.cc:400] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 14. Current term is 15.
I20260709 13:10:02.063207 30470 raft_consensus.cc:1240] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 8. Current term is 9. Ops: []
W20260709 13:10:02.053699 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 130949us
I20260709 13:10:02.068252 30474 raft_consensus.cc:1240] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:10:02.072202 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:02.074012 30473 raft_consensus.cc:2368] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 14. Current term is 15.
W20260709 13:10:02.060807  2754 consensus_meta.cc:287] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.640s	user 0.007s	sys 0.003s
I20260709 13:10:02.053638  2426 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:02.076951 30440 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:01.993320  2766 consensus_queue.cc:237] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:02.083458 30467 raft_consensus.cc:2468] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 8.
I20260709 13:10:02.086342 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:01.992471  2725 consensus_queue.cc:260] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:02.093736 30548 raft_consensus.cc:1240] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:02.094463 30471 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 15.
I20260709 13:10:02.077116  2479 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.074457  2604 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.998955  2742 consensus_queue.cc:260] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:02.075721  2515 raft_consensus.cc:697] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 11 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:02.104470 30440 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:02.094647 30473 raft_consensus.cc:2393] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 8: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:02.110383 30548 raft_consensus.cc:1275] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:02.111855 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:02.112260 30548 raft_consensus.cc:1240] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 10. Current term is 11. Ops: []
W20260709 13:10:02.121932 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.122116  2786 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.122619  2786 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:02.068915  2783 consensus_queue.cc:1048] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:10:02.128074  2072 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:02.130829  2072 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:02.132290 30619 raft_consensus.cc:1240] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 11. Current term is 12. Ops: []
W20260709 13:10:02.132416 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 68596.2us
I20260709 13:10:02.109813 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:02.126807  2782 raft_consensus.cc:3060] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:02.095263  2754 raft_consensus.cc:2804] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:02.126930 30440 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:02.127353  2751 consensus_queue.cc:1048] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 13:10:02.143527 30440 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:02.139029 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:02.142906  2725 raft_consensus.cc:3060] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:02.148756  2753 consensus_queue.cc:237] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:02.110994  2479 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:02.152985  2373 raft_consensus.cc:2749] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453) with higher term. Message: Invalid argument: T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 14. Current term is 15.
I20260709 13:10:02.155521  2775 raft_consensus.cc:2749] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:02.157892 30440 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:02.174410 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:10:02.175992 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.175758 30440 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:02.141245  2754 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:02.167104 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
W20260709 13:10:02.168330  2789 log.cc:927] Time spent T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:10:02.169582 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:02.162484  2780 raft_consensus.cc:3060] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:02.170212 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:02.178085 30440 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:02.165002 30473 raft_consensus.cc:2376] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 14. Re-sending same reply.
I20260709 13:10:02.180210 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:02.187507 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:02.188930 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:02.110208  2604 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:02.191088 31144 raft_consensus.cc:2393] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 15: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:10:02.131709  2316 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:02.217005 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:02.227087 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:02.228263 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:02.226511 30473 raft_consensus.cc:2468] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
I20260709 13:10:02.229346 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:02.186010  2754 raft_consensus.cc:3060] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:02.190609  2746 raft_consensus.cc:2749] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:02.190575  2678 raft_consensus.cc:2749] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:02.230314 31147 raft_consensus.cc:2468] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 8.
I20260709 13:10:02.234115 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:02.237884 31150 raft_consensus.cc:2393] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 8: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:02.234820 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:02.235352 31142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea"
dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
mode: GRACEFUL
new_leader_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:42956
I20260709 13:10:02.235463 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:02.109966  2760 consensus_queue.cc:237] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:02.238806 30473 raft_consensus.cc:2368] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 13. Current term is 14.
W20260709 13:10:02.229576  2749 consensus_meta.cc:287] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.833s	user 0.007s	sys 0.004s
I20260709 13:10:02.242023 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:02.244972 30516 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:10:02.248812 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:02.227715  2775 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:02.272316 31144 raft_consensus.cc:1240] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:02.269097 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:02.273468 30474 raft_consensus.cc:2393] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 15: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:02.275204 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:02.281968 30543 raft_consensus.cc:2468] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 15.
I20260709 13:10:02.283670 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:02.224756  2515 consensus_queue.cc:237] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:02.284529 30474 raft_consensus.cc:2393] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 15: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:02.285403 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:02.285928 30474 raft_consensus.cc:2376] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 16. Re-sending same reply.
W20260709 13:10:02.289918 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 103178us
I20260709 13:10:02.290020 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:02.291059 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:02.292335  2691 raft_consensus.cc:515] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:02.293020  2604 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:02.294447  2691 leader_election.cc:290] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:02.295077 30473 raft_consensus.cc:2468] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
I20260709 13:10:02.295929 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:02.297354  2779 raft_consensus.cc:2804] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:02.297788  2779 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:02.298171  2779 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:02.298992 30516 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:02.299863  2791 raft_consensus.cc:2749] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:02.300174 30516 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:10:02.300591  2795 log.cc:927] Time spent T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:10:02.301518  2373 raft_consensus.cc:2749] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:02.302125 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:02.302345  2373 raft_consensus.cc:2749] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:10:02.302635  2792 log.cc:927] Time spent T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:10:02.303077  2373 consensus_queue.cc:1059] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:02.303337 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:02.303951  2723 raft_consensus.cc:3055] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:02.304013 30542 raft_consensus.cc:2468] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 9.
I20260709 13:10:02.304425  2723 raft_consensus.cc:740] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:02.305405  2723 consensus_queue.cc:260] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:02.280958  2775 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:02.309923  2775 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:02.248777  2690 leader_election.cc:290] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:02.314926  2316 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:02.316726  2759 raft_consensus.cc:2749] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:02.318603  2786 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:02.292752  2692 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:02.330262 30473 raft_consensus.cc:3060] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:02.241317  2745 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:02.329164 30516 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:02.337045 30551 raft_consensus.cc:2468] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 9.
I20260709 13:10:02.330842 30474 raft_consensus.cc:2468] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 11.
I20260709 13:10:02.340662 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:02.341240 30551 raft_consensus.cc:3060] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:02.274462  2726 raft_consensus.cc:2804] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:02.355577  2604 raft_consensus.cc:2749] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:02.359491  2745 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:02.367030 30551 raft_consensus.cc:2468] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 12.
I20260709 13:10:02.368072 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:02.368597 30551 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:02.368414 30589 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:02.336755  2479 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:02.268695  2461 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:02.405416 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.265944  2749 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:02.496690 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 128346us
I20260709 13:10:02.508502 30471 raft_consensus.cc:2393] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 12: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:02.353307  2691 consensus_queue.cc:1048] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.147s
I20260709 13:10:02.511024  2788 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.511601  2788 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:02.512822  2802 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:02.513428  2802 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:02.516029  2461 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:02.518826  2745 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:02.501561  2692 raft_consensus.cc:2804] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:02.528964  2782 raft_consensus.cc:2749] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:02.530165 31142 raft_consensus.cc:606] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Received request to transfer leadership to TS 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:02.530548 31142 raft_consensus.cc:614] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:02.530642 30551 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 12.
I20260709 13:10:02.534137 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:02.524063  2725 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.522938  2726 raft_consensus.cc:697] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 8 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:02.529968  2749 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:02.545212 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:02.533237  2692 raft_consensus.cc:697] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:02.555927 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:02.557349 30475 raft_consensus.cc:2393] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 12: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:02.557533 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:02.555577  2754 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:02.561038  2754 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:02.564522  2802 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:02.570261  2692 consensus_queue.cc:237] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:02.564441 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:02.572543 30475 raft_consensus.cc:2393] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 14: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:02.541054  2725 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:02.576270 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:02.546356  2779 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:02.578773 30551 raft_consensus.cc:2468] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 11.
I20260709 13:10:02.585692 30473 raft_consensus.cc:2468] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 11.
I20260709 13:10:02.589771  2780 raft_consensus.cc:2749] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:02.591373 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
W20260709 13:10:02.593132 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.594379 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:02.595731 30589 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:02.597090 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:02.601269 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:02.602854 31150 raft_consensus.cc:1275] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:10:02.604180  2726 consensus_queue.cc:237] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:02.600075  2477 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:02.608935 30591 leader_election.cc:304] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:02.611147  2788 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:02.612325 30591 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:02.607273  2779 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:10:02.613039 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.618177 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:02.623052 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:02.593839  2725 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:02.624863 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:02.625917 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:02.639441 30472 raft_consensus.cc:2376] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 14. Re-sending same reply.
I20260709 13:10:02.639542 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:02.626190 31144 raft_consensus.cc:1240] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 11 LEADER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:10:02.625705  2753 raft_consensus.cc:2749] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:02.641214 30544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35278 (request call id 942) took 1104 ms. Trace:
I20260709 13:10:02.619896  2720 raft_consensus.cc:2804] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:02.635999  2663 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:02.636335 30550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 2228) took 1422 ms. Trace:
I20260709 13:10:02.641578 30544 rpcz_store.cc:276] 0709 13:10:01.536369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.593947 (+ 57578us) service_pool.cc:224] Handling call
0709 13:10:02.641042 (+1047095us) spinlock_profiling.cc:243] Waited 324 ms on lock 0x7b5400357854. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:10:02.641158 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":745666816}
I20260709 13:10:02.628026  2477 raft_consensus.cc:2804] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:02.648106 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:02.653151 30472 raft_consensus.cc:3060] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:02.653805  2779 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.654245  2779 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:02.656272  2779 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:02.657791 30441 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:02.657473 30591 leader_election.cc:400] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 election: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 13. Current term is 14.
I20260709 13:10:02.645423  2720 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.660811 30441 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:02.647202 30550 rpcz_store.cc:276] 0709 13:10:01.213622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.258297 (+ 44675us) service_pool.cc:224] Handling call
0709 13:10:01.264767 (+  6470us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:01.265104 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:01.265132 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:01.265603 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 13:10:02.542785 (+1277182us) spinlock_profiling.cc:243] Waited 51.2 ms on lock 0x7b180046dc20. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e5de07 00007fc789cb8ab9 00007fc780e7a69b 00007fc780e7893f 00007fc780e7ac02 00007fc783b0220b 00007fc783b07d23 00007fc783b080d1 00007fc783f23a0f
0709 13:10:02.558632 (+ 15847us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:02.558660 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:02.558705 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:02.635886 (+ 77181us) raft_consensus.cc:1685] finished
0709 13:10:02.635912 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:02.636157 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16601,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":61769,"spinlock_wait_cycles":117786496,"thread_start_us":15313,"threads_started":1,"wal-append.queue_time_us":1216075}
I20260709 13:10:02.652825  2477 raft_consensus.cc:493] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:02.652480  2725 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:02.677313 30544 raft_consensus.cc:1240] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 11. Current term is 12. Ops: [9.8-11.9]
I20260709 13:10:02.679035 30472 raft_consensus.cc:2468] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 12.
I20260709 13:10:02.680142 30551 raft_consensus.cc:1275] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:02.663471  2720 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:02.687175  2742 raft_consensus.cc:3060] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:02.680205  2748 raft_consensus.cc:2749] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:02.664023  2779 raft_consensus.cc:3060] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:02.694039 30545 raft_consensus.cc:1240] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
W20260709 13:10:02.682806  2812 log.cc:927] Time spent T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:10:02.682175  2725 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:02.700790 30476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 1065) took 1571 ms. Trace:
I20260709 13:10:02.701175 30476 rpcz_store.cc:276] 0709 13:10:01.128968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.129091 (+   123us) service_pool.cc:224] Handling call
0709 13:10:01.129354 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:01.673865 (+544511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:02.700564 (+1026699us) spinlock_profiling.cc:243] Waited 530 ms on lock 0x7b54003db8d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:10:02.700736 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1218104704}
I20260709 13:10:02.701725  2725 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:02.678182  2477 raft_consensus.cc:3060] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:02.684722  2797 log.cc:927] Time spent T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.404s	user 0.003s	sys 0.000s
I20260709 13:10:02.702472 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:02.702755 30550 raft_consensus.cc:1275] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:02.703099 30476 raft_consensus.cc:2468] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 11.
I20260709 13:10:02.703780 30547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 945) took 1166 ms. Trace:
I20260709 13:10:02.685206 30591 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:02.696965 30546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43088 (request call id 2284) took 1303 ms. Trace:
I20260709 13:10:02.705065 30441 leader_election.cc:304] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:02.705602 30546 rpcz_store.cc:276] 0709 13:10:01.393388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.470934 (+ 77546us) service_pool.cc:224] Handling call
0709 13:10:02.696787 (+1225853us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b5400397bd4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:10:02.696898 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":392270208}
I20260709 13:10:02.704177 30547 rpcz_store.cc:276] 0709 13:10:01.537212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.042279 (+505067us) service_pool.cc:224] Handling call
0709 13:10:02.042597 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:02.051285 (+  8688us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:02.051314 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:02.060102 (+  8788us) log.cc:844] Serialized 26 byte log entry
0709 13:10:02.164989 (+104887us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:02.165033 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:02.165103 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:02.684142 (+519039us) spinlock_profiling.cc:243] Waited 50.3 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:10:02.703470 (+ 19328us) raft_consensus.cc:1685] finished
0709 13:10:02.703493 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:02.703721 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18846,"raft.queue_time_us":8832,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":7237,"spinlock_wait_cycles":115774848,"thread_start_us":67894,"threads_started":1,"wal-append.queue_time_us":158539}
I20260709 13:10:02.709021  2722 raft_consensus.cc:3055] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:02.709425  2722 raft_consensus.cc:740] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:02.710234  2722 consensus_queue.cc:260] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:02.715843 30550 raft_consensus.cc:1275] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:10:02.717902 30591 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:02.720104 30441 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:02.720839 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:02.720806 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:10:02.722230 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.722286 30476 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 14.
I20260709 13:10:02.722738 30551 raft_consensus.cc:1240] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:02.725301 30544 raft_consensus.cc:1275] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:02.727408 30441 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:02.729010  2663 raft_consensus.cc:3060] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:02.711184  2722 raft_consensus.cc:3060] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:02.733095 30441 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:02.737859 31142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e"
dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
mode: GRACEFUL
new_leader_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:42956
I20260709 13:10:02.738513 31142 raft_consensus.cc:606] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 14 LEADER]: Received request to transfer leadership to TS f639301059e24dc5b0d88a46dc683326
I20260709 13:10:02.741983 30591 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:02.743391 30591 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:02.731052  2780 raft_consensus.cc:2749] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:02.736044  2749 raft_consensus.cc:2749] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:02.739822  2742 raft_consensus.cc:2804] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:02.736217  2754 consensus_queue.cc:1059] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:10:02.745297  2746 consensus_queue.cc:1059] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:10:02.752416  2746 raft_consensus.cc:3055] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:02.752811  2746 raft_consensus.cc:740] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:02.751499  2742 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:02.753417  2742 raft_consensus.cc:3060] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:02.751504  2808 consensus_queue.cc:1048] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:10:02.753677  2746 consensus_queue.cc:260] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:02.754873  2746 raft_consensus.cc:3060] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:02.739791  2461 raft_consensus.cc:2749] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:02.756146 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:02.752259  2563 consensus_queue.cc:1059] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:02.757593  2563 consensus_queue.cc:1243] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer cd669586cff44d4bbfcc007e213faab6 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:10:02.757632  2723 raft_consensus.cc:3060] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:02.738061  2692 raft_consensus.cc:2804] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:02.764284 30591 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:02.748215  2725 raft_consensus.cc:2749] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:02.762970  2753 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:02.777357 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 56201us
I20260709 13:10:02.762801  2727 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:02.778399 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:02.781258 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:02.782083 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.767545  2563 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:02.785622 30591 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:02.786715 30591 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:02.789261 30548 raft_consensus.cc:1240] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 11 LEADER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:02.776441  2692 raft_consensus.cc:697] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:02.784698  2072 raft_consensus.cc:2749] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:02.796696 31142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3"
dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
mode: GRACEFUL
new_leader_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:42956
I20260709 13:10:02.797616 31142 raft_consensus.cc:606] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 12 LEADER]: Received request to transfer leadership to TS 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:02.789970  2725 raft_consensus.cc:2804] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:02.799392  2663 raft_consensus.cc:2749] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:02.803556 29364 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:10:02.805361 29364 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:02.806456  2720 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:02.807891  2779 raft_consensus.cc:2749] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:02.808367  2754 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:02.808909  2754 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:02.811409  2754 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:02.813822 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:02.815299  2742 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:02.817698  2753 raft_consensus.cc:2749] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:02.799826  2785 raft_consensus.cc:2804] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:02.784294  2727 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:02.826653  2725 raft_consensus.cc:697] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:02.832167 30591 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:02.833437 30591 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:02.831153  2742 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:02.793507  2563 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:02.845882 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.847157 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:02.837248  2663 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:02.843786  2072 raft_consensus.cc:2749] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:02.850349 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:02.853462 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:02.857266 30474 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:02.845013  2753 raft_consensus.cc:2804] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:02.843233  2785 raft_consensus.cc:697] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:02.835402  2477 raft_consensus.cc:515] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:02.871945 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.845624  2742 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:02.857178 30545 raft_consensus.cc:2376] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 9. Re-sending same reply.
I20260709 13:10:02.861276 30549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 948) took 1323 ms. Trace:
I20260709 13:10:02.869522  2785 consensus_queue.cc:237] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:02.880754  2764 log.cc:927] Time spent T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 1.030s	user 0.000s	sys 0.002s
I20260709 13:10:02.856778  2692 consensus_queue.cc:237] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:02.875156 30549 rpcz_store.cc:276] 0709 13:10:01.537994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.057379 (+519385us) service_pool.cc:224] Handling call
0709 13:10:02.696891 (+639512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:02.697081 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:02.697106 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:02.697146 (+    40us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:02.697175 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:02.697224 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:02.861081 (+163857us) spinlock_profiling.cc:243] Waited 623 ms on lock 0x7b5400397bd0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f678ad 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:10:02.861212 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1433918336}
I20260709 13:10:02.864552  2753 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.886431 31144 raft_consensus.cc:1240] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 11 LEADER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:10:02.872054  2477 leader_election.cc:290] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:02.846091  2725 consensus_queue.cc:237] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:02.860319  2663 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:02.889463  2753 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:02.883030  2742 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:02.890847  2733 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:02.896075  2754 consensus_queue.cc:1059] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:10:02.901938  2754 consensus_queue.cc:1243] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer cd669586cff44d4bbfcc007e213faab6 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:10:02.904314  2727 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:02.909227  2742 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:02.909833  2663 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:02.912130 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:02.919346 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:02.920907 30476 raft_consensus.cc:2468] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 12.
I20260709 13:10:02.923043 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:02.925056 30476 raft_consensus.cc:3060] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:02.927721 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:02.929234 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:02.929790 30467 raft_consensus.cc:2468] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 12.
I20260709 13:10:02.930176 30591 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:02.930783 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:02.931175 30591 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:02.931504 30467 raft_consensus.cc:2393] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 12: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:02.929728 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:02.932353 30471 raft_consensus.cc:3060] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:02.933452  2727 raft_consensus.cc:2804] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:02.933719 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:02.933851  2727 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:02.934237  2727 raft_consensus.cc:3060] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:02.934267 30545 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:02.936017  2072 raft_consensus.cc:2804] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:02.936560  2072 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.936972  2072 raft_consensus.cc:3060] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:02.938510  2793 log.cc:927] Time spent T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.706s	user 0.019s	sys 0.022s
I20260709 13:10:02.940306 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:02.944206 30468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 1073) took 1268 ms. Trace:
I20260709 13:10:02.944553 30468 rpcz_store.cc:276] 0709 13:10:01.675626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.682312 (+  6686us) service_pool.cc:224] Handling call
0709 13:10:01.684737 (+  2425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:02.592898 (+908161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:02.592945 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:02.592998 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:02.593042 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:02.943969 (+350927us) spinlock_profiling.cc:243] Waited 908 ms on lock 0x7b54003db3d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:10:02.944027 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:02.944157 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2087962496}
I20260709 13:10:02.946816 30472 raft_consensus.cc:1275] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:02.954445  2316 consensus_queue.cc:1048] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:02.957600 30625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47446 (request call id 2613) took 1040 ms. Trace:
I20260709 13:10:02.959039 30471 raft_consensus.cc:2468] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 11.
I20260709 13:10:02.957618 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:02.960716 30591 leader_election.cc:304] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:10:02.968016 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 102276us
I20260709 13:10:02.970724 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:02.958070 30625 rpcz_store.cc:276] 0709 13:10:01.917449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.918967 (+  1518us) service_pool.cc:224] Handling call
0709 13:10:01.948842 (+ 29875us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:01.959521 (+ 10679us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:01.959571 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:01.969374 (+  9803us) log.cc:844] Serialized 26 byte log entry
0709 13:10:02.087969 (+118595us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:02.088012 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:02.088085 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:02.937941 (+849856us) spinlock_profiling.cc:243] Waited 3.3 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:10:02.945629 (+  7688us) raft_consensus.cc:1685] finished
0709 13:10:02.945646 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:02.957519 (+ 11873us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":608,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":9575,"spinlock_wait_cycles":7600896,"thread_start_us":83805,"threads_started":1,"wal-append.queue_time_us":170894}
I20260709 13:10:02.972369 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:02.983250 30471 raft_consensus.cc:1275] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:02.984620 30623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47446 (request call id 2603) took 1782 ms. Trace:
W20260709 13:10:02.972043  2800 log.cc:927] Time spent T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.661s	user 0.001s	sys 0.003s
I20260709 13:10:02.985131 30623 rpcz_store.cc:276] 0709 13:10:01.202562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.202690 (+   128us) service_pool.cc:224] Handling call
0709 13:10:01.216247 (+ 13557us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:01.266841 (+ 50594us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:01.266884 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:01.281575 (+ 14691us) log.cc:844] Serialized 26 byte log entry
0709 13:10:01.395156 (+113581us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b480024c258. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc788e91aa1 00007fc788e88b37 00007fc788e889ca 00007fc788f8026f 00007fc788f7ff37 00007fc788f9455c 00007fc788f94508 00007fc788f94488 00007fc788f94443 00007fc788f936ec 00007fc787ebda96
0709 13:10:01.558783 (+163627us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:01.558878 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:01.558973 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:02.880219 (+1321246us) spinlock_profiling.cc:243] Waited 5.72 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:10:02.984412 (+104193us) raft_consensus.cc:1685] finished
0709 13:10:02.984433 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:02.984547 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35803,"raft.queue_time_us":50807,"raft.run_cpu_time_us":2173,"raft.run_wall_time_us":110317,"spinlock_wait_cycles":36853888,"thread_start_us":202280,"threads_started":1,"wal-append.queue_time_us":348660}
I20260709 13:10:02.964210  2790 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
W20260709 13:10:02.992889 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.010021 30622 raft_consensus.cc:1240] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 LEADER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:03.010327 30545 raft_consensus.cc:2468] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 12.
I20260709 13:10:02.997304  2787 consensus_queue.cc:1059] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:03.014110 30474 raft_consensus.cc:2468] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 12.
I20260709 13:10:03.016551  2729 consensus_queue.cc:1048] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
W20260709 13:10:02.989413  2766 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.002s	sys 0.015s
I20260709 13:10:03.037405 30625 raft_consensus.cc:1275] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:10:03.034410 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 80712.2us
I20260709 13:10:03.039149 30471 raft_consensus.cc:1240] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:03.042511 30440 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:10:03.024962  2766 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.002s	sys 0.016s
I20260709 13:10:03.046255 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:03.009152  2832 raft_consensus.cc:2804] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:03.054196 30618 raft_consensus.cc:2393] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 11: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:10:03.057461 30476 raft_consensus.cc:2468] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 11.
W20260709 13:10:03.061100  2828 log.cc:927] Time spent T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:10:03.063145  2727 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:03.012444  2790 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:03.065855  2727 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:03.066115  2790 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:03.066469 30617 raft_consensus.cc:1240] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:03.066857 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:03.069479 30476 raft_consensus.cc:1240] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:03.057955  2754 consensus_queue.cc:1048] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:10:03.073556  2686 raft_consensus.cc:3055] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:03.074072  2686 raft_consensus.cc:740] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:03.078850  2753 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:03.080856 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:03.082355 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:03.082899 30476 raft_consensus.cc:3060] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:03.083943  2725 consensus_queue.cc:1059] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:10:03.084751 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.045177  2746 raft_consensus.cc:2749] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:03.098308 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:03.098846 30474 raft_consensus.cc:2468] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 11.
W20260709 13:10:03.099366 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 47529.4us
I20260709 13:10:03.103456 30618 raft_consensus.cc:1240] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 LEADER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:03.104161 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:03.104745 30621 raft_consensus.cc:2468] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 8.
I20260709 13:10:03.100865  2787 consensus_queue.cc:1048] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:10:03.092799  2750 raft_consensus.cc:493] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.109772  2839 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:03.116339  2839 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:03.118498  2753 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:03.118608 30476 raft_consensus.cc:2468] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 13.
I20260709 13:10:03.119545 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:03.122475 30474 raft_consensus.cc:1275] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:03.095717  2832 raft_consensus.cc:697] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:03.128041  2832 consensus_queue.cc:237] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:03.129509 30517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:03.067327 30360 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 5610a33c644c4e539ad503631763aa40 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:10:03.132112 30360 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 77379.7us
I20260709 13:10:03.071715  2729 consensus_queue.cc:1048] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:10:03.141757  2747 consensus_queue.cc:1059] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:03.143137  2747 raft_consensus.cc:3055] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:03.143527  2747 raft_consensus.cc:740] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:03.144661  2747 consensus_queue.cc:260] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:03.145768  2747 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:03.150285 30470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 1076) took 1473 ms. Trace:
I20260709 13:10:03.150701 30470 rpcz_store.cc:276] 0709 13:10:01.677318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.678944 (+  1626us) service_pool.cc:224] Handling call
0709 13:10:01.679231 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:02.063604 (+384373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.150047 (+1086443us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b5400042ed4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:10:03.150225 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":882602240}
I20260709 13:10:03.152621 30475 raft_consensus.cc:2468] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 8.
I20260709 13:10:03.075161  2686 consensus_queue.cc:260] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:03.112391  2750 raft_consensus.cc:515] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:03.157655 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:03.153873 30470 raft_consensus.cc:1240] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:03.154366 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:03.110824 31115 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:03.119725 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
W20260709 13:10:03.159791 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 49049.8us
I20260709 13:10:03.160162 30476 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:03.156131 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
W20260709 13:10:03.157630 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 89423.8us
I20260709 13:10:03.162074 31147 raft_consensus.cc:1275] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:03.118440  2839 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:03.162868 31114 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:03.162290 30589 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:03.164539 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:03.166419 30470 raft_consensus.cc:1240] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:03.165374 31114 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:10:03.172138 31147 raft_consensus.cc:1275] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:10:03.172637 30517 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:03.173197 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:03.173851  2686 raft_consensus.cc:3060] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:03.164659  2766 consensus_queue.cc:1048] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:10:03.175585  2599 raft_consensus.cc:2749] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:03.176105  2733 raft_consensus.cc:2804] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:03.173218  2072 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:03.176517  2733 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:03.176919  2733 raft_consensus.cc:3060] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:03.177122 30468 raft_consensus.cc:1240] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 11. Current term is 12. Ops: []
W20260709 13:10:03.178406  2801 log.cc:927] Time spent T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.866s	user 0.002s	sys 0.000s
I20260709 13:10:03.179157  2072 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:03.163589  2787 consensus_queue.cc:1059] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:10:03.180059 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:03.180585  2787 consensus_queue.cc:1243] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer fe2b7d73f8c743c1ba570cfd981c4e79 log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:10:03.181172  2787 raft_consensus.cc:3055] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:03.181516  2787 raft_consensus.cc:740] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:03.157440  2732 consensus_queue.cc:1048] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:10:03.162357  2790 raft_consensus.cc:2804] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:03.184265  2790 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:03.184671  2790 raft_consensus.cc:3060] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:03.187285 30619 raft_consensus.cc:1275] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:10:03.187829 30619 pending_rounds.cc:85] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79: Aborting all ops after (but not including) 9
I20260709 13:10:03.188107 30619 pending_rounds.cc:107] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:10:03.188400 30619 raft_consensus.cc:2889] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:03.173609  2684 consensus_queue.cc:1048] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:03.192379 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:03.192759 30517 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:03.194960 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:03.195585 30622 raft_consensus.cc:2468] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 11.
I20260709 13:10:03.198662 30622 raft_consensus.cc:1240] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:10:03.201295 30625 raft_consensus.cc:1275] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:10:03.189739  2839 raft_consensus.cc:3060] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:03.205220 30476 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 15.
I20260709 13:10:03.203147 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:03.204203 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:03.206343 30620 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 14.
I20260709 13:10:03.195282  2088 raft_consensus.cc:3055] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:03.194591  2715 raft_consensus.cc:2749] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:03.211133 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:03.210642  2088 raft_consensus.cc:740] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:03.207967 30476 raft_consensus.cc:1275] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:10:03.206669  2416 raft_consensus.cc:2804] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:10:03.222575 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.211256  2832 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.229346 30623 raft_consensus.cc:1240] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:03.230576 30471 raft_consensus.cc:1240] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:03.233119 30476 raft_consensus.cc:1240] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:03.243350 30625 raft_consensus.cc:1275] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:10:03.214128  2732 consensus_queue.cc:1048] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:10:03.220037  2416 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:03.250039 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:03.215667  2726 consensus_queue.cc:1048] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:10:03.255708 30625 raft_consensus.cc:1240] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 LEADER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 10. Current term is 11. Ops: []
W20260709 13:10:03.256475 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 56340.3us
I20260709 13:10:03.258792 30545 raft_consensus.cc:1275] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:03.258908 30550 raft_consensus.cc:1240] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:03.241011  2832 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:03.260687 30516 leader_election.cc:304] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:03.247212  2416 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:03.257050  2750 leader_election.cc:290] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:03.268760 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:03.269048 30516 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:10:03.272846 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 80119.3us
I20260709 13:10:03.265764  2715 raft_consensus.cc:2749] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:10:03.275534  2840 log.cc:927] Time spent T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:10:03.275568  2726 raft_consensus.cc:2804] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:03.278040  2726 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:03.278415  2726 raft_consensus.cc:3060] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:03.264811  2088 consensus_queue.cc:260] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:03.280857  2832 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:03.281121  2088 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:03.284703  2720 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:10:03.286608 30543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35278 (request call id 950) took 1748 ms (client timeout 1816 ms). Trace:
W20260709 13:10:03.287029 30543 rpcz_store.cc:269] 0709 13:10:01.538509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.584062 (+ 45553us) service_pool.cc:224] Handling call
0709 13:10:03.286420 (+1702358us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b54002571d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:10:03.286550 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1263286656}
I20260709 13:10:03.288170 30469 raft_consensus.cc:1275] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:03.290793 30469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 1082) took 1341 ms. Trace:
I20260709 13:10:03.291114 30469 rpcz_store.cc:276] 0709 13:10:01.949647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.949775 (+   128us) service_pool.cc:224] Handling call
0709 13:10:01.960567 (+ 10792us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:03.288552 (+1327985us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.290566 (+  2014us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b540029aed4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:10:03.290736 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3052338432}
I20260709 13:10:03.292762 30475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50446 (request call id 2110) took 1110 ms. Trace:
I20260709 13:10:03.293116 30475 rpcz_store.cc:276] 0709 13:10:02.182636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.581557 (+398921us) service_pool.cc:224] Handling call
0709 13:10:03.292598 (+711041us) spinlock_profiling.cc:243] Waited 558 ms on lock 0x7b540011e754. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:10:03.292709 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1282418048}
I20260709 13:10:03.295502  2715 consensus_queue.cc:1059] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:03.296526  2750 raft_consensus.cc:3055] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:03.296855  2750 raft_consensus.cc:740] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:03.297612  2750 consensus_queue.cc:260] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:03.298388  2839 raft_consensus.cc:2749] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:03.298743  2750 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:03.299638 30619 raft_consensus.cc:1240] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:03.300756 31116 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:03.304476 30517 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
W20260709 13:10:03.306639 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.313470 30516 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:03.326154 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:03.326792 30547 raft_consensus.cc:2468] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 12.
I20260709 13:10:03.319973  2766 raft_consensus.cc:3060] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:03.310037  2736 consensus_queue.cc:1059] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:10:03.311352  2747 consensus_queue.cc:1048] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:10:03.338867 30517 leader_election.cc:400] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 14. Current term is 15.
I20260709 13:10:03.345090 30517 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:03.323055  2284 consensus_queue.cc:1059] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:10:03.348990  2599 consensus_queue.cc:1059] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:10:03.350533  2741 consensus_queue.cc:1059] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:03.351954  2648 consensus_queue.cc:1059] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
W20260709 13:10:03.365917 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:03.367782 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.324667  2850 consensus_queue.cc:1048] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:10:03.337618  2849 raft_consensus.cc:2749] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:03.342649  2684 raft_consensus.cc:2804] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:03.334331  2602 consensus_queue.cc:1059] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:10:03.377293  2726 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:03.339663  2732 consensus_queue.cc:1048] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:10:03.369638 30591 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:03.378450 30590 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:03.367332  2742 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.400233 30475 raft_consensus.cc:1275] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:10:03.401814 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:03.410077 30473 raft_consensus.cc:1240] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:03.410808 30473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 2517) took 1262 ms. Trace:
I20260709 13:10:03.412864  2850 raft_consensus.cc:2749] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:03.413355  2726 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:03.413560  2850 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.403863  2692 raft_consensus.cc:2804] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:03.383297  2684 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.408823  2728 raft_consensus.cc:493] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:03.342840  2683 consensus_queue.cc:1048] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:10:03.432351  2416 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:03.399176  2486 raft_consensus.cc:3055] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:03.411202 30473 rpcz_store.cc:276] 0709 13:10:02.148485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.705067 (+556582us) service_pool.cc:224] Handling call
0709 13:10:03.409645 (+704578us) spinlock_profiling.cc:243] Waited 8.48 ms on lock 0x7b5800002d98. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780e43b71 00007fc780e43a22 00007fc789d5cc09 00007fc788eb6ee0 00007fc788f800ab 00007fc788f80131 00007fc788f41fc0 00007fc788f2c929 00007fc788f2c3d2 00007fc7824a3bd4
0709 13:10:03.409849 (+   204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:03.410565 (+   716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.410758 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19498240}
W20260709 13:10:03.389741 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 44746.6us
W20260709 13:10:03.441437 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 63068.6us
W20260709 13:10:03.442066 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 102433us
I20260709 13:10:03.443213 30517 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:03.445245 30618 raft_consensus.cc:1275] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:03.444115 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:03.448086 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:03.414029  2850 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:03.452627 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:03.404227  2849 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.449134 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:03.456575 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:10:03.440459 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 102736us
I20260709 13:10:03.457651 30620 raft_consensus.cc:2393] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 15: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:03.422286  2684 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:03.459111 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:03.426343  2284 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:03.461464 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:03.466236  2850 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:10:03.472913  2852 log.cc:927] Time spent T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:10:03.474570 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.482163 30474 raft_consensus.cc:1275] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:10:03.482712 30474 pending_rounds.cc:85] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326: Aborting all ops after (but not including) 7
I20260709 13:10:03.482980 30474 pending_rounds.cc:107] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:10:03.483251 30474 raft_consensus.cc:2889] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:03.446539  2728 raft_consensus.cc:515] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:03.484759 30543 raft_consensus.cc:1275] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:10:03.484728  2790 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:03.485911  2728 leader_election.cc:290] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:03.487054  2790 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:03.414458  2742 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:03.489264  2742 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:03.440347  2486 raft_consensus.cc:740] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:03.455600  2844 raft_consensus.cc:2749] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:03.499193 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:03.492347  2284 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:03.512001 30543 raft_consensus.cc:2468] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 12.
I20260709 13:10:03.458451  2646 raft_consensus.cc:3055] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:03.513134  2646 raft_consensus.cc:740] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:03.513876  2284 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:03.514199  2646 consensus_queue.cc:260] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:03.514993 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:03.515789  2646 raft_consensus.cc:3060] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:03.458117  2849 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:03.517015 30547 raft_consensus.cc:1275] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:03.517971  2849 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:03.500593  2486 consensus_queue.cc:260] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:03.501521  2416 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:03.509123  2733 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:03.519569 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 76462.8us
W20260709 13:10:03.518901 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 121390us
I20260709 13:10:03.521148 30517 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:03.521148 30622 raft_consensus.cc:1240] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:03.521430 30591 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
W20260709 13:10:03.519742 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 60294.7us
I20260709 13:10:03.524088 30591 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:03.525622 30622 raft_consensus.cc:1240] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:10:03.527269  2486 raft_consensus.cc:3060] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:03.528406  2416 raft_consensus.cc:2749] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:03.520685  2747 raft_consensus.cc:2749] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:03.530704  2816 log.cc:927] Time spent T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.855s	user 0.002s	sys 0.002s
I20260709 13:10:03.530668 30517 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:03.531360  2683 consensus_queue.cc:1048] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:03.529096 30472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 2114) took 1172 ms. Trace:
I20260709 13:10:03.532049 30472 rpcz_store.cc:276] 0709 13:10:02.357091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.731212 (+374121us) service_pool.cc:224] Handling call
0709 13:10:02.946518 (+215306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:02.947253 (+   735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.528906 (+581653us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b54001211d0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f678ad 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:10:03.529029 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":477909760}
I20260709 13:10:03.531637  2747 raft_consensus.cc:2804] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:03.532811  2844 raft_consensus.cc:2804] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:03.533150  2747 raft_consensus.cc:697] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 14 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:03.534051  2747 consensus_queue.cc:237] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:03.534734  2733 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:03.535400 31150 raft_consensus.cc:1240] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:03.536545  2683 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.523192  2602 consensus_queue.cc:1059] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:10:03.537335  2602 consensus_queue.cc:1243] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer f639301059e24dc5b0d88a46dc683326 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:10:03.537068  2683 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:03.537736  2785 raft_consensus.cc:3055] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:03.537822  2602 raft_consensus.cc:3055] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:03.538195  2785 raft_consensus.cc:740] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:03.538352  2602 raft_consensus.cc:740] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:03.539119  2683 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:03.539220  2602 consensus_queue.cc:260] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:03.540050  2844 raft_consensus.cc:697] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:03.540843  2602 raft_consensus.cc:3060] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:03.541550  2722 raft_consensus.cc:3055] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:03.541918  2722 raft_consensus.cc:740] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:03.542742  2722 consensus_queue.cc:260] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:03.529076 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 77694us
I20260709 13:10:03.546563 30543 raft_consensus.cc:1240] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:10:03.546351  2683 consensus_queue.cc:1059] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:03.540998  2844 consensus_queue.cc:237] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:03.548413  2683 consensus_queue.cc:1243] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer fe2b7d73f8c743c1ba570cfd981c4e79 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:10:03.548480  2722 raft_consensus.cc:3060] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:03.548996  2691 raft_consensus.cc:3055] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:03.549373  2691 raft_consensus.cc:740] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:03.551630 30517 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:03.552980 30591 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:03.556020 30517 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:03.539060  2785 consensus_queue.cc:260] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:03.559353 30517 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:03.561774 30591 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:03.555804 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:10:03.571009 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 47928.5us
I20260709 13:10:03.571878 30550 raft_consensus.cc:1275] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:03.573522 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:03.573828 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:03.573904 31147 raft_consensus.cc:1275] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:03.581270 30589 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:03.581854 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:03.583278 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:03.583310 31147 raft_consensus.cc:2410] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:10:03.584599  2871 consensus_queue.cc:1048] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:10:03.586277 31115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.588750 30589 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:03.594509 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:03.580005  2850 raft_consensus.cc:2804] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:03.598207  2850 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.598661  2850 raft_consensus.cc:3060] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:03.529270  2870 raft_consensus.cc:2804] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:03.588874  2871 raft_consensus.cc:2749] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:03.604395 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:03.556660  2692 raft_consensus.cc:697] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:03.625252 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:03.637694 30551 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 12.
I20260709 13:10:03.560802  2849 raft_consensus.cc:2749] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:03.627715 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:03.601881  2729 raft_consensus.cc:2804] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:03.605108 30473 raft_consensus.cc:1240] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:03.631457 30472 raft_consensus.cc:1240] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:03.554840  2691 consensus_queue.cc:260] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:03.639083 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:03.639276 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:03.572395  2683 raft_consensus.cc:3060] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:03.602278  2316 raft_consensus.cc:2804] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:03.592012  2607 consensus_queue.cc:1059] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:10:03.652077 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:03.654664 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:03.605558  2373 consensus_queue.cc:1059] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:10:03.653882  2691 raft_consensus.cc:3060] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:03.626372  2865 consensus_queue.cc:1048] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:10:03.653128  2316 raft_consensus.cc:697] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:03.640743  2785 raft_consensus.cc:3060] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:03.640868  2284 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.601941  2861 consensus_queue.cc:1048] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:10:03.626645  2733 consensus_queue.cc:1048] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:10:03.646515  2729 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.629716  2646 consensus_queue.cc:1048] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
W20260709 13:10:03.649924  2826 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.013s	sys 0.062s
W20260709 13:10:03.706840  2826 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.013s	sys 0.063s
I20260709 13:10:03.707563  2563 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:03.708289 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:03.709407 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:03.683441 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
W20260709 13:10:03.689000 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 127312us
I20260709 13:10:03.696485 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:03.711118 30550 raft_consensus.cc:2393] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 12: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:10:03.688154  2284 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:03.713514 30591 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:03.715260 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:03.697746  2692 consensus_queue.cc:237] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:03.698891  2876 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.699782 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:03.700275  2316 consensus_queue.cc:237] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:03.697095  2729 raft_consensus.cc:3060] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:03.704222 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:03.705248 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:03.705945 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:03.663165  2870 raft_consensus.cc:697] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:03.648218  2871 raft_consensus.cc:2804] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:03.757586 30550 raft_consensus.cc:1240] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 11. Current term is 12. Ops: []
W20260709 13:10:03.719442 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 123482us
W20260709 13:10:03.701486  2855 log.cc:927] Time spent T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:10:03.730490 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:10:03.731156 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.658628  2684 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:03.736606 31151 raft_consensus.cc:2393] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 9: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:10:03.737375 31147 raft_consensus.cc:2376] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 15. Re-sending same reply.
I20260709 13:10:03.768086 30551 raft_consensus.cc:1240] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:10:03.768414  2870 consensus_queue.cc:237] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:03.759155 30589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.716560  2646 consensus_queue.cc:1059] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.055s
W20260709 13:10:03.605090  2832 consensus_queue.cc:1175] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "092f6eb694fc4bbeab49677cccd880fd" responder_term: 6 status { last_received { term: 5 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:03.772038 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:03.773962 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:03.775648 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:03.760496 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:03.777122 31144 raft_consensus.cc:2468] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 12.
I20260709 13:10:03.765394  2284 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:03.777592 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:03.762626 31148 raft_consensus.cc:2468] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 12.
I20260709 13:10:03.781039 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:03.727000  2844 raft_consensus.cc:2804] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:03.783181  2609 raft_consensus.cc:993] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6: : Instructing follower 092f6eb694fc4bbeab49677cccd880fd to start an election
W20260709 13:10:03.849433 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.852320 30548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43088 (request call id 2303) took 2102 ms. Trace:
I20260709 13:10:03.852908 30548 rpcz_store.cc:276] 0709 13:10:01.750282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.570317 (+820035us) service_pool.cc:224] Handling call
0709 13:10:02.570618 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:02.789689 (+219071us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.851979 (+1062290us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b54003381d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:10:03.852241 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":498796800}
I20260709 13:10:03.854676  2609 raft_consensus.cc:1081] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 12 LEADER]: Signalling peer 092f6eb694fc4bbeab49677cccd880fd to start an election
I20260709 13:10:03.856426  2373 raft_consensus.cc:3055] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:03.856835  2373 raft_consensus.cc:740] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:03.857632  2373 consensus_queue.cc:260] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:03.858788  2373 raft_consensus.cc:3060] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:03.757941  2871 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.860843  2871 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:03.869706  2873 log.cc:927] Time spent T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:10:03.736990  2876 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:03.872757  2876 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:03.756594  2864 raft_consensus.cc:493] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:03.879021  2683 raft_consensus.cc:2749] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:03.879344  2864 raft_consensus.cc:515] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:03.881579  2864 leader_election.cc:290] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:03.885221 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:03.885438 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:03.885957 30550 raft_consensus.cc:3060] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:03.886073  2284 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.886458 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:03.886636  2284 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:03.887084 30545 raft_consensus.cc:2468] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 15.
I20260709 13:10:03.719267  2486 consensus_queue.cc:1059] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 13:10:03.888947 30545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:35278
I20260709 13:10:03.889588 30545 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:03.889957 30545 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:03.890496 30543 raft_consensus.cc:2468] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 12.
I20260709 13:10:03.892167 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:03.736660  2072 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.895584 30550 raft_consensus.cc:2468] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 10.
I20260709 13:10:03.903292 31145 raft_consensus.cc:2468] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 12.
I20260709 13:10:03.920392 31149 raft_consensus.cc:1275] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:03.927960 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:03.900667 30545 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:03.928458 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:03.934746 30542 raft_consensus.cc:2393] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 6: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:03.848992  2844 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:03.957789 30545 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:03.951532  2088 raft_consensus.cc:3055] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:03.953439  2599 raft_consensus.cc:3055] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:03.954833  2486 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.971302 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:10:03.971364  2766 consensus_meta.cc:287] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.621s	user 0.009s	sys 0.001s
I20260709 13:10:03.936678  2563 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.971298  2844 raft_consensus.cc:3060] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:03.995342 30590 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:03.925036  2072 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:03.977123  2088 raft_consensus.cc:740] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:03.976778  2599 raft_consensus.cc:740] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:04.007584 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:03.941461  2871 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:03.993418  2766 raft_consensus.cc:2749] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:04.014278 31142 raft_consensus.cc:1240] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:04.014345  2599 consensus_queue.cc:260] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:04.015853  2599 raft_consensus.cc:3060] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:04.011794 30624 raft_consensus.cc:1240] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 LEADER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:03.993687  2728 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.017021  2728 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:04.019181  2728 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:10:04.024377 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.019904 30472 raft_consensus.cc:2468] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 16.
I20260709 13:10:04.034009 30440 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:03.991402  2486 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:03.994750  2563 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:04.048063 30620 raft_consensus.cc:2393] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 13: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:10:04.052343 30617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 1053) took 1045 ms. Trace:
I20260709 13:10:04.055652 30617 rpcz_store.cc:276] 0709 13:10:03.007326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.008639 (+  1313us) service_pool.cc:224] Handling call
0709 13:10:03.008998 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:03.066879 (+ 57881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.052097 (+985218us) spinlock_profiling.cc:243] Waited 57.3 ms on lock 0x7b54001d8b54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:10:04.052285 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":131740416}
I20260709 13:10:04.056862 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:04.060986 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:04.061739 30617 raft_consensus.cc:2468] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 15.
I20260709 13:10:04.013494  2850 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:04.063534 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:04.068396 30440 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:04.069623 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:04.071734 30617 raft_consensus.cc:2468] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 6.
I20260709 13:10:04.075881 30467 raft_consensus.cc:1275] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:04.076323 30474 raft_consensus.cc:1275] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:10:04.077338 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:04.078078 30474 raft_consensus.cc:2468] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 7.
I20260709 13:10:04.072386 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:04.079615 30474 raft_consensus.cc:1275] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:10:04.088388 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:04.089164 30467 raft_consensus.cc:2393] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 10: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:04.090794 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:04.093055 30544 raft_consensus.cc:2368] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 11. Current term is 12.
I20260709 13:10:04.091306 30467 raft_consensus.cc:2376] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 15. Re-sending same reply.
I20260709 13:10:04.094426 30474 raft_consensus.cc:1275] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:10:04.094455 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:10:04.097040 30517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.092882 31115 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:04.100538 30476 raft_consensus.cc:1275] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:04.070266  2839 raft_consensus.cc:2749] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:04.067742  2284 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:04.105528 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:04.064785  2870 consensus_queue.cc:1048] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:10:04.113400 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:04.095510 30467 raft_consensus.cc:2468] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 8.
I20260709 13:10:04.105031 31115 leader_election.cc:304] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:04.052300  2879 consensus_queue.cc:1048] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:10:04.119148 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:04.138866 30467 raft_consensus.cc:2468] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 10.
I20260709 13:10:04.094385  2877 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.144599  2072 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:04.186501 30467 pending_rounds.cc:85] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326: Aborting all ops after (but not including) 5
I20260709 13:10:04.186932 30467 pending_rounds.cc:107] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:10:04.187209 30467 raft_consensus.cc:2889] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:04.117268  2609 raft_consensus.cc:2804] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:10:04.143352  2886 log.cc:927] Time spent T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
W20260709 13:10:04.276422 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 160515us
I20260709 13:10:04.142565  2868 raft_consensus.cc:2804] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:10:04.318665 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 250300us
I20260709 13:10:04.321301 30545 raft_consensus.cc:1240] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 9. Current term is 10. Ops: []
W20260709 13:10:04.276360  2846 log.cc:927] Time spent T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:10:04.320535 30440 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:04.091414  2088 consensus_queue.cc:260] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:04.198873  2609 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.348474 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:04.290928  2686 raft_consensus.cc:2749] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:10:04.335068 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 216584us
I20260709 13:10:04.346840 30440 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:04.347663 30546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 961) took 1657 ms. Trace:
I20260709 13:10:04.353408 30546 rpcz_store.cc:276] 0709 13:10:02.690221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.709240 (+ 19019us) service_pool.cc:224] Handling call
0709 13:10:03.293749 (+584509us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:03.316430 (+ 22681us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:03.316478 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:03.316527 (+    49us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:03.316557 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.316646 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.347473 (+1030827us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b54002571d0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f678ad 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:10:04.347606 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31106,"raft.queue_time_us":22853,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":3759,"spinlock_wait_cycles":1343612160}
I20260709 13:10:04.294610  2868 raft_consensus.cc:493] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:04.185539  2877 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:04.364032  2072 consensus_queue.cc:1048] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:10:04.362063 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.362730 30475 raft_consensus.cc:1240] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 10. Current term is 11. Ops: [8.6-10.7]
I20260709 13:10:04.370877 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:04.297389  2691 consensus_queue.cc:1048] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:10:04.351787  2609 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:04.344862  2535 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:04.355466  2747 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.361683  2868 raft_consensus.cc:3060] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:04.373731 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:04.379181 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
W20260709 13:10:04.373706  2888 log.cc:927] Time spent T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.327s	user 0.000s	sys 0.001s
I20260709 13:10:04.381644  2486 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:10:04.374123  2898 log.cc:927] Time spent T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:10:04.374737 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:04.367381  2686 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.390013 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:04.421763 30476 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:04.277482  2787 consensus_queue.cc:260] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:04.370261  2839 consensus_queue.cc:1048] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:10:04.379401  2871 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:04.381824  2901 raft_consensus.cc:2749] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:10:04.390887  2885 log.cc:927] Time spent T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.344s	user 0.001s	sys 0.000s
I20260709 13:10:04.388433  2563 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:10:04.393937  2887 log.cc:927] Time spent T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.341s	user 0.001s	sys 0.000s
W20260709 13:10:04.443004 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.382007  2535 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:04.450644 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 93073.9us
I20260709 13:10:04.422003  2479 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:04.434830 30471 raft_consensus.cc:1275] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:10:04.455412 30471 pending_rounds.cc:85] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326: Aborting all ops after (but not including) 9
I20260709 13:10:04.455727 30471 pending_rounds.cc:107] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:10:04.456055 30471 raft_consensus.cc:2889] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:04.456671 31115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.466866 30550 raft_consensus.cc:1240] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:04.467895  2901 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.468350  2901 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:04.466795 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:04.470355 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:04.470958 30548 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:04.386710  2747 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:04.435740  2850 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:04.463402 30476 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 13.
I20260709 13:10:04.432463  2686 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:04.449391  2905 raft_consensus.cc:2804] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:04.490231 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:04.492868 30471 raft_consensus.cc:1275] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:04.470475  2901 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:04.475833  2563 raft_consensus.cc:2749] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:04.499439 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 152657us
I20260709 13:10:04.505313 30440 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
W20260709 13:10:04.496160  2890 log.cc:927] Time spent T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.302s	user 0.000s	sys 0.001s
I20260709 13:10:04.508690 30475 raft_consensus.cc:2468] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 10.
I20260709 13:10:04.497314  2905 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.513789  2905 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:04.514606  2912 raft_consensus.cc:2749] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:10:04.515141  2904 log.cc:927] Time spent T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:10:04.510812  2910 consensus_queue.cc:1048] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.013s
W20260709 13:10:04.518498  2844 consensus_meta.cc:287] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.507s	user 0.010s	sys 0.000s
W20260709 13:10:04.527061  2900 log.cc:927] Time spent T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 13:10:04.519306  2877 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:04.524557  2747 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:04.526501  2686 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:04.527972  2844 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:04.530252 30622 raft_consensus.cc:1240] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:04.507268  2901 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:04.531147  2901 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:04.474594  2479 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:04.534809 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 165164us
I20260709 13:10:04.532807 30440 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:04.547533 30548 raft_consensus.cc:2468] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 13.
I20260709 13:10:04.547154 30441 leader_election.cc:304] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:10:04.512293  2729 consensus_meta.cc:287] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.752s	user 0.010s	sys 0.000s
I20260709 13:10:04.549512 30441 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:10:04.549872 30590 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.001s	sys 0.018s
W20260709 13:10:04.561836 30590 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.001s	sys 0.018s
W20260709 13:10:04.562400 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 567106us
I20260709 13:10:04.563066 30590 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:04.571177 30441 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:04.576642 30441 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:04.569267  2912 raft_consensus.cc:2804] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:10:04.586930  2897 log.cc:927] Time spent T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
W20260709 13:10:04.587400  2895 log.cc:927] Time spent T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 13:10:04.572346  2902 consensus_queue.cc:1059] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:10:04.581929 30616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 1055) took 1574 ms. Trace:
I20260709 13:10:04.548141  2692 raft_consensus.cc:493] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:04.590135 30616 rpcz_store.cc:276] 0709 13:10:03.007982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.009283 (+  1301us) service_pool.cc:224] Handling call
0709 13:10:03.024355 (+ 15072us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:03.044592 (+ 20237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:03.044620 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:03.052365 (+  7745us) log.cc:844] Serialized 26 byte log entry
0709 13:10:03.145985 (+ 93620us) spinlock_profiling.cc:243] Waited 1.86 ms on lock 0x7b480024c258. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc788e91aa1 00007fc788e88b37 00007fc788e889ca 00007fc788f8026f 00007fc788f7ff37 00007fc788f9455c 00007fc788f94508 00007fc788f94488 00007fc788f94443 00007fc788f936ec 00007fc787ebda96
0709 13:10:03.944503 (+798518us) spinlock_profiling.cc:243] Waited 8.06 ms on lock 0x7b1800492dc0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e5de07 00007fc789cb8ab9 00007fc780e7a69b 00007fc780e7893f 00007fc780e7ac02 00007fc783b0220b 00007fc783b07d23 00007fc783b080d1 00007fc783f23a0f
0709 13:10:04.070225 (+125722us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:04.070265 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.070326 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:04.581658 (+511332us) raft_consensus.cc:1685] finished
0709 13:10:04.581687 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.581853 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":550,"raft.queue_time_us":12776,"raft.run_cpu_time_us":1391,"raft.run_wall_time_us":93741,"spinlock_wait_cycles":22815872,"thread_start_us":125522,"threads_started":1,"wal-append.queue_time_us":1305700}
I20260709 13:10:04.574399  2877 raft_consensus.cc:3060] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:04.560695  2563 raft_consensus.cc:2749] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:04.546357  2686 consensus_queue.cc:1059] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
W20260709 13:10:04.598840  2899 log.cc:927] Time spent T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 13:10:04.573356  2729 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:04.605305  2373 consensus_meta.cc:287] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.746s	user 0.013s	sys 0.000s
I20260709 13:10:04.601246  2692 raft_consensus.cc:515] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:04.605563  2917 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:04.625371 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 48814.7us
I20260709 13:10:04.624639  2913 raft_consensus.cc:2749] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:04.627133  2892 log.cc:927] Time spent T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
I20260709 13:10:04.627202  2479 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:04.645147 30441 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:04.633051  2535 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:04.637424  2692 leader_election.cc:290] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:04.619539  2563 raft_consensus.cc:2749] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:04.648133 30441 leader_election.cc:304] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:04.652194 30441 leader_election.cc:304] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:04.642360  2905 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:04.662089  2729 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:04.663986 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:04.664122 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:04.665823 31150 raft_consensus.cc:2468] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 16.
I20260709 13:10:04.654109  2563 consensus_queue.cc:1059] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:10:04.669714  2477 consensus_queue.cc:1048] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:04.670177  2563 raft_consensus.cc:2749] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:04.670827  2563 raft_consensus.cc:2749] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:04.670645  2609 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:04.672375  2535 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:04.672593 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:04.672931 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:04.673237 30616 raft_consensus.cc:2468] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 14.
I20260709 13:10:04.673030  2535 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:04.675457 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:04.675772 30441 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:04.676076 31150 raft_consensus.cc:2468] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 8.
I20260709 13:10:04.648777  2912 raft_consensus.cc:697] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 12 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:04.643618  2917 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:04.681047  2609 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 16 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:04.682164  2720 consensus_queue.cc:1048] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:04.671468  2563 raft_consensus.cc:3055] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:04.687515  2477 consensus_queue.cc:1048] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:10:04.692196  2928 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:04.693097  2912 consensus_queue.cc:237] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:04.667166  2913 raft_consensus.cc:2749] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:04.698887  2715 raft_consensus.cc:3055] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:04.684124  2902 raft_consensus.cc:2749] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:04.699992 30623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36130 (request call id 2146) took 1237 ms. Trace:
I20260709 13:10:04.701998  2917 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:04.697504  2563 raft_consensus.cc:740] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:04.711306 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:04.664116  2905 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:04.733522 30623 rpcz_store.cc:276] 0709 13:10:03.462819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.462934 (+   115us) service_pool.cc:224] Handling call
0709 13:10:04.699735 (+1236801us) spinlock_profiling.cc:243] Waited 980 ms on lock 0x7b54001d7754. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:10:04.699929 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2253387520}
I20260709 13:10:04.737381 30548 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 11.
I20260709 13:10:04.732219  2715 raft_consensus.cc:740] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:04.677312  2729 consensus_queue.cc:1048] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:10:04.717746  2901 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:04.732237  2692 raft_consensus.cc:493] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:10:04.753536  2884 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.970s	user 0.004s	sys 0.049s
I20260709 13:10:04.735039  2928 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:04.753504 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 67400.4us
I20260709 13:10:04.759063 30441 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:04.759975  2686 raft_consensus.cc:2804] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:04.760080 30441 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:04.745007  2609 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.757722 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:04.760747  2686 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.761118  2901 raft_consensus.cc:2804] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:04.761272 30548 raft_consensus.cc:3060] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:04.761888  2901 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.762312  2901 raft_consensus.cc:3060] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:04.762130  2609 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:04.764276  2609 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:10:04.756632  2884 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.983s	user 0.004s	sys 0.050s
I20260709 13:10:04.753228  2913 consensus_queue.cc:1059] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:10:04.768685  2715 consensus_queue.cc:260] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:04.745759  2905 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:04.769858  2715 raft_consensus.cc:3060] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:04.769815  2905 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:04.771930  2905 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:04.772742  2535 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:04.769204  2930 raft_consensus.cc:2749] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:04.779163 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:04.782761 30624 raft_consensus.cc:1240] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:10:04.784703 30476 raft_consensus.cc:2393] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 9: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:04.782927 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:04.783994 30441 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:04.790318 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:04.790699 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:04.791249 30623 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:04.792484 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:04.790149 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:04.794153 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:04.794154 30468 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 11.
I20260709 13:10:04.795218 30469 raft_consensus.cc:1275] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:04.796759 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:04.797346 30545 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 12.
I20260709 13:10:04.797896 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:04.798447 30476 raft_consensus.cc:3060] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:04.798522 30545 raft_consensus.cc:1275] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:10:04.798947 30545 pending_rounds.cc:85] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd: Aborting all ops after (but not including) 8
I20260709 13:10:04.799165 30545 pending_rounds.cc:107] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:10:04.799391 30545 raft_consensus.cc:2889] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:04.783115  2686 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:04.805265 30548 raft_consensus.cc:2468] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 13.
I20260709 13:10:04.786712  2913 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.812062 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:04.796630  2563 consensus_queue.cc:260] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:04.824689 30468 raft_consensus.cc:2393] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 13: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:04.758340  2692 raft_consensus.cc:515] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:04.837780  2932 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:04.852792  2932 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:04.831063 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 47107.5us
I20260709 13:10:04.855748 30441 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:04.842871 30476 raft_consensus.cc:2468] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 12.
I20260709 13:10:04.862630 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:04.838439 30625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47446 (request call id 2637) took 1059 ms. Trace:
I20260709 13:10:04.876149 30469 raft_consensus.cc:1240] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:10:04.787055  2868 raft_consensus.cc:515] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:04.881793 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:04.882457 30618 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:04.875427 30625 rpcz_store.cc:276] 0709 13:10:03.779022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.899322 (+120300us) service_pool.cc:224] Handling call
0709 13:10:03.899631 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:04.052804 (+153173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:04.052848 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:04.053378 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 13:10:04.595454 (+542076us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b18003da620. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e5de07 00007fc789cb8ab9 00007fc780e7a69b 00007fc780e7893f 00007fc780e7ac02 00007fc783b0220b 00007fc783b07d23 00007fc783b080d1 00007fc783f23a0f
0709 13:10:04.646216 (+ 50762us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:04.646267 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.701564 (+ 55297us) spinlock_profiling.cc:243] Waited 4.47 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:10:04.838117 (+136553us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b540027e554. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:10:04.838176 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:04.838222 (+    46us) raft_consensus.cc:1685] finished
0709 13:10:04.838235 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.838381 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12172,"raft.queue_time_us":24937,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":5817,"spinlock_wait_cycles":317686912,"thread_start_us":45430,"threads_started":1,"wal-append.queue_time_us":611595}
W20260709 13:10:04.888168 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.842370  2930 raft_consensus.cc:2804] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:04.855108  2932 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:10:04.893859 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 150410us
I20260709 13:10:04.875866  2926 raft_consensus.cc:2749] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:04.876976  2917 raft_consensus.cc:493] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:04.902802 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.885382  2563 raft_consensus.cc:3060] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:04.943632  2917 raft_consensus.cc:515] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:04.945945  2917 leader_election.cc:290] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:04.908196  2918 raft_consensus.cc:3055] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:04.892788  2930 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.947089  2918 raft_consensus.cc:740] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:04.912395  2932 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:04.910669  2928 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:10:04.962853  2891 log.cc:927] Time spent T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.673s	user 0.001s	sys 0.001s
I20260709 13:10:04.948495  2918 consensus_queue.cc:260] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:04.971143 30517 leader_election.cc:304] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:04.922714 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:04.933859  2728 raft_consensus.cc:3055] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:04.921586  2868 leader_election.cc:290] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:04.936474 30551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43088 (request call id 2317) took 1359 ms. Trace:
I20260709 13:10:04.937031  2692 leader_election.cc:290] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:04.824270  2913 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:04.938733 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.977113 30551 rpcz_store.cc:276] 0709 13:10:03.577431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.710146 (+132715us) service_pool.cc:224] Handling call
0709 13:10:03.710422 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:03.768492 (+ 58070us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.936227 (+1167735us) spinlock_profiling.cc:243] Waited 57.4 ms on lock 0x7b540002f3d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:10:04.936414 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":132027136}
I20260709 13:10:04.942442 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:04.987413 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:04.988372 30548 raft_consensus.cc:2393] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 6: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
W20260709 13:10:04.949702 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 54783.5us
I20260709 13:10:04.952379 30549 raft_consensus.cc:1275] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:04.947570  2930 raft_consensus.cc:3060] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:04.959322  2932 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:04.971627 30590 leader_election.cc:336] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453): Timed out: RequestConsensusVote RPC to 127.28.173.4:34453 timed out after 1.617s (SENT)
I20260709 13:10:04.978775 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:04.992652 30590 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:04.992714 30548 raft_consensus.cc:1240] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 12. Current term is 13. Ops: []
W20260709 13:10:04.936273 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.979592 30623 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 13.
W20260709 13:10:04.989586 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.992827 30545 raft_consensus.cc:3060] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:04.999249 31115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.989295 30589 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
W20260709 13:10:04.994252 30440 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.173.2:34733 timed out after 2.386s (SENT) [suppressed 31 similar messages]
W20260709 13:10:05.031690 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 60663.3us
W20260709 13:10:05.032037 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.032526 30517 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:05.035256 30473 raft_consensus.cc:1275] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:05.031113 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:04.996327  2726 raft_consensus.cc:2804] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:04.985073  2728 raft_consensus.cc:740] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:05.045866 30517 leader_election.cc:304] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:05.046965 30517 leader_election.cc:304] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:05.048352 31142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48412 (request call id 855) took 1633 ms. Trace:
I20260709 13:10:05.047869 30618 raft_consensus.cc:2468] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 16.
I20260709 13:10:05.048748 31142 rpcz_store.cc:276] 0709 13:10:03.415440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.415824 (+   384us) service_pool.cc:224] Handling call
0709 13:10:03.416190 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:04.014706 (+598516us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.048077 (+1033371us) spinlock_profiling.cc:243] Waited 598 ms on lock 0x7b54005c3d54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:10:05.048244 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1375028480}
W20260709 13:10:05.050439 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 61235.1us
I20260709 13:10:05.052775 30589 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:05.053864 30517 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:05.054147  2878 consensus_queue.cc:1059] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.102s
I20260709 13:10:05.055006  2909 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.055529 30517 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:05.055505  2909 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:05.056322  2877 raft_consensus.cc:2749] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:05.031251  2868 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.057104 30517 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:05.058502  2479 raft_consensus.cc:2749] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:05.058641  2909 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:05.058969  2750 raft_consensus.cc:2749] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:05.059185  2479 consensus_queue.cc:1048] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:05.061299  2479 consensus_queue.cc:1048] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:05.053086 31115 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:05.067378 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:05.069355 30623 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 12.
I20260709 13:10:05.074532 30545 raft_consensus.cc:2468] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 16.
I20260709 13:10:05.084167 31142 raft_consensus.cc:1240] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:05.050336  2747 raft_consensus.cc:3060] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:05.045323  2726 raft_consensus.cc:493] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:05.048768  2722 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:05.086629 30589 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:05.052004  2373 raft_consensus.cc:2764] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:10:05.058702  2896 raft_consensus.cc:2749] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:05.051725  2917 raft_consensus.cc:2749] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:05.077701  2715 raft_consensus.cc:2804] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:05.063653  2889 raft_consensus.cc:2749] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:05.063328  2745 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:05.079653  2733 raft_consensus.cc:2804] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:10:05.108238 31147 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48414 (request call id 1073) took 1469 ms (client timeout 1617 ms). Trace:
W20260709 13:10:05.108758 31147 rpcz_store.cc:269] 0709 13:10:03.638622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.638786 (+   164us) service_pool.cc:224] Handling call
0709 13:10:05.108069 (+1469283us) spinlock_profiling.cc:243] Waited 91.1 ms on lock 0x7b54005c2454. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:10:05.108179 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":209569664}
I20260709 13:10:05.090070  2726 raft_consensus.cc:3060] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:05.081595  2684 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:05.118050 31149 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48414 (request call id 1082) took 1418 ms. Trace:
I20260709 13:10:05.118502 31149 rpcz_store.cc:276] 0709 13:10:03.705642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.764137 (+ 58495us) service_pool.cc:224] Handling call
0709 13:10:03.919958 (+155821us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:03.920846 (+   888us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.117843 (+1196997us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b540045e7d0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f678ad 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:10:05.117989 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":357510528}
I20260709 13:10:05.087248  2866 raft_consensus.cc:2804] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:05.085189  2753 raft_consensus.cc:3055] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:05.121121  2753 raft_consensus.cc:740] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:05.122044  2753 consensus_queue.cc:260] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:05.123327  2753 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:05.094748  2722 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:05.127223  2932 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:05.057128  2868 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:05.128620  2722 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:05.129769  2868 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:05.129470  2728 consensus_queue.cc:260] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:05.131100  2728 raft_consensus.cc:3060] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:05.131392  2733 raft_consensus.cc:697] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 16 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:05.048928  2901 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:05.132440  2733 consensus_queue.cc:237] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:05.133831  2901 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:10:05.108357  2935 log.cc:927] Time spent T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 13:10:05.136762 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:05.140769 30589 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:05.135195  2686 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:05.149024 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:05.152872 31142 raft_consensus.cc:3055] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:05.154296  2866 raft_consensus.cc:697] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:05.155644 31148 raft_consensus.cc:1275] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:05.156483  2913 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:10:05.157407 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 273127us
I20260709 13:10:05.153228 31142 raft_consensus.cc:740] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:05.158385 30441 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:05.161252 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:05.161770 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:05.162112 31150 raft_consensus.cc:2410] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:10:05.162339 31146 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 11.
I20260709 13:10:05.159426 30517 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:05.164388 30546 raft_consensus.cc:1240] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:10:05.165256 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:05.166145 30544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43088 (request call id 2309) took 1592 ms. Trace:
I20260709 13:10:05.166782 30470 raft_consensus.cc:1240] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 17 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:10:05.167135 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:05.097671  2715 raft_consensus.cc:493] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:05.166515 30544 rpcz_store.cc:276] 0709 13:10:03.573482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.573611 (+   129us) service_pool.cc:224] Handling call
0709 13:10:05.164017 (+1590406us) spinlock_profiling.cc:243] Waited 517 ms on lock 0x7b540002eed4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:10:05.166078 (+  2061us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1189758848}
I20260709 13:10:05.171486 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:05.171857 30516 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:10:05.172075 30589 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:05.172595 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:05.172917 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:05.173952 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:05.167865 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:05.169721 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:05.164582 31142 consensus_queue.cc:260] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:05.169976 31148 raft_consensus.cc:1240] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:05.176244 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:05.176436 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:05.150724  2868 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.177533  2868 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:05.178517 31114 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:05.179435  2722 raft_consensus.cc:2749] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:05.174808 30544 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 12.
I20260709 13:10:05.155218  2866 consensus_queue.cc:237] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:05.180650 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:05.172991 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:05.148155  2936 raft_consensus.cc:2804] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:05.184791 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:05.170858  2535 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:05.185361 31148 raft_consensus.cc:3060] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:05.185441  2535 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:05.185808 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:05.186599 30545 raft_consensus.cc:2393] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 12: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:05.187397 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:05.187498  2535 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:05.183514 30617 raft_consensus.cc:2393] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 12: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:10:05.196480  2726 raft_consensus.cc:515] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:05.188401 30476 raft_consensus.cc:1240] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:10:05.188903 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:05.189589 30545 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:05.198873  2726 leader_election.cc:290] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:05.179481  2868 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:05.171274  2750 raft_consensus.cc:2804] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:05.200330  2750 raft_consensus.cc:697] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 12 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:05.200613 30618 raft_consensus.cc:2468] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 12.
I20260709 13:10:05.200789  2878 raft_consensus.cc:2804] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:05.201258  2878 raft_consensus.cc:697] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:05.201144  2750 consensus_queue.cc:237] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:05.201882 31148 raft_consensus.cc:2468] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9.
I20260709 13:10:05.202138  2878 consensus_queue.cc:237] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:05.170369  2861 consensus_queue.cc:1048] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:10:05.180791  2913 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.204480  2913 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:05.206501  2913 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:05.167595  2901 raft_consensus.cc:2804] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:05.162935  2684 consensus_queue.cc:1048] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:10:05.159086  2896 consensus_queue.cc:1059] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:10:05.192579 30469 raft_consensus.cc:1240] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:05.208778  2896 raft_consensus.cc:3055] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:05.209327  2896 raft_consensus.cc:740] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:05.209514 30545 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 13.
I20260709 13:10:05.209602  2877 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:05.173849  2876 consensus_queue.cc:1048] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:10:05.166538  2871 raft_consensus.cc:2764] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:10:05.210196  2877 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:05.176378  2715 raft_consensus.cc:3060] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:05.184041 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:05.208727  2910 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:05.211452 31146 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 12.
I20260709 13:10:05.207777 30547 raft_consensus.cc:1275] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:10:05.170121 30625 raft_consensus.cc:2468] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 6.
I20260709 13:10:05.213120 30617 raft_consensus.cc:1240] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:05.207898  2901 raft_consensus.cc:697] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 13 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:05.222949 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:05.217120 31115 leader_election.cc:304] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:05.210104  2686 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 17 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:05.223412  2901 consensus_queue.cc:237] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:05.224102  2910 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:05.222873 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:05.226644 30616 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:05.215590 30544 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 15.
I20260709 13:10:05.221378 31114 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:05.231998 31114 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:10:05.150257  2745 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:05.226181  2910 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:05.236778 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:05.244674 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:05.211297  2936 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:05.251374 30617 raft_consensus.cc:1275] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:05.252363 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:05.205236  2747 raft_consensus.cc:2749] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:05.264016 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:10:05.264827 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 47554.4us
W20260709 13:10:05.269824 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 275573us
I20260709 13:10:05.230669  2722 raft_consensus.cc:2804] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:05.301017 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:05.250372  2860 raft_consensus.cc:2749] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:05.266547 30441 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:05.266052  2535 raft_consensus.cc:2804] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:05.314635 30617 raft_consensus.cc:1240] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:05.276917 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:05.276917 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:05.307713  2876 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.266453  2909 raft_consensus.cc:493] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.316952 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:05.265228  2479 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.322395 30547 raft_consensus.cc:2393] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 12: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:10:05.323438 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:05.324337 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:05.266390  2936 raft_consensus.cc:3060] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:05.210148  2896 consensus_queue.cc:260] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:05.309711  2861 raft_consensus.cc:493] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:05.334252 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 67776.1us
I20260709 13:10:05.335161 30440 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:05.343456 30440 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:05.344460 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:05.344709 30440 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:10:05.342200 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.345449 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:05.345587 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:05.346071 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:05.346225 31148 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:05.345690  2910 raft_consensus.cc:2804] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:05.350800  2941 consensus_queue.cc:1059] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:10:05.354847 31148 raft_consensus.cc:2468] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 17.
W20260709 13:10:05.355904 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.358258  2535 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:05.358902  2535 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:05.364847 30440 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:05.317265  2722 raft_consensus.cc:697] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 6 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:05.330060  2733 raft_consensus.cc:2804] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:10:05.370065 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 198277us
I20260709 13:10:05.375545 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:05.375753 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:05.376299 31148 raft_consensus.cc:2468] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 7.
I20260709 13:10:05.380805 31148 raft_consensus.cc:1240] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:10:05.380151  2912 raft_consensus.cc:2749] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:05.388622  2910 raft_consensus.cc:697] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 9 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:05.389182  2941 raft_consensus.cc:3055] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:05.389570  2941 raft_consensus.cc:740] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:05.389612  2910 consensus_queue.cc:237] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:05.390281  2563 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.390417  2941 consensus_queue.cc:260] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:05.390834  2563 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:05.391764  2941 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:05.391994 30617 raft_consensus.cc:1275] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:10:05.392964  2563 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:05.393033  2877 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:05.397794 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:05.370316  2913 raft_consensus.cc:2749] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:05.400099 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:05.400966 30441 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:05.372087  2686 raft_consensus.cc:2749] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:05.373544  2932 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.323506  2876 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:05.330236  2909 raft_consensus.cc:515] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:05.407126 30441 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:05.408138 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:05.408332 30516 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:10:05.408970 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 177048us
I20260709 13:10:05.408746 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:05.395854  2896 raft_consensus.cc:3060] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:05.420519 30469 raft_consensus.cc:2393] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 7: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
W20260709 13:10:05.420888 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 81923.2us
I20260709 13:10:05.421826 30440 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:05.341709  2479 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:05.423678 30440 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:05.426026 30517 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:05.408993  2912 raft_consensus.cc:2804] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:05.434167 30440 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:05.361223  2861 raft_consensus.cc:515] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:05.404387  2732 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.411341  2928 raft_consensus.cc:2804] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:05.452133 30551 raft_consensus.cc:2410] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 16 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:10:05.452539 30516 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:05.429771  2913 raft_consensus.cc:2749] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:05.432742  2563 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:05.438403  2912 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:05.462440 30542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 2272) took 1005 ms. Trace:
I20260709 13:10:05.441226  2931 raft_consensus.cc:2749] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:05.412495  2932 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:05.441020  2926 raft_consensus.cc:2749] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:05.420265  2750 consensus_queue.cc:1059] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:10:05.477038 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:05.471252 30542 rpcz_store.cc:276] 0709 13:10:04.457507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.457633 (+   126us) service_pool.cc:224] Handling call
0709 13:10:04.457903 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:04.481057 (+ 23154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:04.481116 (+    59us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:04.481173 (+    57us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:04.481222 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.462209 (+980987us) spinlock_profiling.cc:243] Waited 22.9 ms on lock 0x7b5400359154. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:10:05.462257 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:05.462377 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52710656}
I20260709 13:10:05.480402 30516 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:05.457371  2373 raft_consensus.cc:2749] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:05.499464  2750 raft_consensus.cc:2749] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:05.500293  2750 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:05.500862  2750 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:05.502422  2930 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:05.503353 30616 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 13.
I20260709 13:10:05.503516 30468 raft_consensus.cc:1240] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 14. Current term is 15. Ops: []
W20260709 13:10:05.505155  2945 log.cc:927] Time spent T 00000000000000000000000000000000 P 045170a35afe4845987482e49e9e1eb9: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:10:05.506634  2930 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:05.508914  2931 raft_consensus.cc:493] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:05.509274  2479 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:05.510021  2479 raft_consensus.cc:2749] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:05.509680  2931 raft_consensus.cc:515] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:05.451393  2732 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:05.453447  2722 consensus_queue.cc:237] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:05.519222  2909 leader_election.cc:290] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:05.521472  2932 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:05.528975  2726 raft_consensus.cc:3055] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:10:05.529927 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 49630.1us
I20260709 13:10:05.533264 30516 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
W20260709 13:10:05.535478  2952 log.cc:927] Time spent T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:10:05.535990 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:05.531076  2747 raft_consensus.cc:2749] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:05.538359  2747 raft_consensus.cc:2804] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:05.538784  2747 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:05.539227  2747 raft_consensus.cc:3060] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:05.542574  2940 log.cc:927] Time spent T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 13:10:05.474284  2912 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:05.546308 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:05.531733  2726 raft_consensus.cc:740] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:05.478086  2733 raft_consensus.cc:697] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 10 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:05.460956  2684 consensus_queue.cc:1048] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 13:10:05.550848 30516 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:10:05.552618 30620 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47446 (request call id 2633) took 1781 ms (client timeout 2368 ms). Trace:
I20260709 13:10:05.532373  2745 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:05.572625 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:10:05.569193 30620 rpcz_store.cc:269] 0709 13:10:03.771613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.771745 (+   132us) service_pool.cc:224] Handling call
0709 13:10:05.552405 (+1780660us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x7b5400203354. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:10:05.552549 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":632770816}
I20260709 13:10:05.555635  2479 consensus_queue.cc:1059] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
W20260709 13:10:05.576531 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:05.588474 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 162530us
I20260709 13:10:05.567739  2732 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:05.548751  2962 consensus_queue.cc:1048] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:10:05.615468 30516 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:05.616822 30517 leader_election.cc:304] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:10:05.653641 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 235219us
I20260709 13:10:05.588881  2750 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:05.582703  2753 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:05.584551  2684 raft_consensus.cc:2804] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:05.573410  2861 leader_election.cc:290] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:05.624310  2941 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:10:05.677743 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 61027.1us
W20260709 13:10:05.677369 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 61974.2us
I20260709 13:10:05.659582  2745 raft_consensus.cc:3055] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:05.664649  2896 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:05.660205  2932 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:10:05.674750  2929 log.cc:927] Time spent T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:10:05.689808 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:05.686530  2373 raft_consensus.cc:2749] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:05.686726  2861 raft_consensus.cc:2749] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:05.659917  2479 consensus_queue.cc:1059] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:10:05.692701 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:05.677349  2876 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:05.716492 30474 raft_consensus.cc:2393] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 13: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:05.686966  2931 leader_election.cc:290] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:05.702421  2715 raft_consensus.cc:515] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:05.685822  2753 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:05.688948  2930 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:05.705714  2967 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:10:05.706529  2728 consensus_meta.cc:287] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.575s	user 0.011s	sys 0.000s
I20260709 13:10:05.687052  2684 raft_consensus.cc:697] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 13 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:05.752784 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:05.706831  2954 consensus_queue.cc:1059] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:05.708256  2950 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:05.708630  2563 raft_consensus.cc:2749] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:05.692236  2896 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:05.709532  2932 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:05.686985  2745 raft_consensus.cc:740] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:05.683353  2941 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:05.641211  2726 consensus_queue.cc:260] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:05.747524 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:05.678113  2733 consensus_queue.cc:237] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:05.790709 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:05.791447 30474 raft_consensus.cc:2468] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 11.
I20260709 13:10:05.753507  2930 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:05.755185  2967 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:05.741346  2928 raft_consensus.cc:697] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 17 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
W20260709 13:10:05.822485 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.835234  2910 raft_consensus.cc:493] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:05.838986  2910 raft_consensus.cc:515] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:05.841907  2910 leader_election.cc:290] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:05.847554 30440 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:05.853713  2910 raft_consensus.cc:2749] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:05.856379  2928 consensus_queue.cc:237] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:05.858166  2918 raft_consensus.cc:3060] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:05.797909  2969 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:05.860330  2969 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:05.862444  2969 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:05.786072  2950 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:05.865458  2953 log.cc:927] Time spent T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.310s	user 0.002s	sys 0.000s
I20260709 13:10:05.825469  2728 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:05.872655 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:05.876056 30622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47446 (request call id 2639) took 2092 ms. Trace:
I20260709 13:10:05.876657 30622 rpcz_store.cc:276] 0709 13:10:03.783309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.902239 (+118930us) service_pool.cc:224] Handling call
0709 13:10:03.902494 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:04.530638 (+628144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.875826 (+1345188us) spinlock_profiling.cc:243] Waited 627 ms on lock 0x7b5400304654. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:10:05.875998 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1443161984}
W20260709 13:10:05.887888  2535 consensus_meta.cc:287] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.528s	user 0.013s	sys 0.000s
I20260709 13:10:05.888522  2535 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:05.889549  2971 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.890133  2971 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:05.891227  2535 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:05.876114 30474 raft_consensus.cc:2468] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 11.
W20260709 13:10:05.894583 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:05.896071 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 228011us
I20260709 13:10:05.898557 31114 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:05.901650 31114 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:05.877619  2728 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:05.903517 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:05.905056 30474 raft_consensus.cc:3060] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:05.837687  2745 consensus_queue.cc:260] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:05.903294  2722 raft_consensus.cc:2749] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:05.920800 31142 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:05.921154  2959 log.cc:927] Time spent T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
W20260709 13:10:05.922648  2973 log.cc:927] Time spent T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:10:05.925252 31113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.927438 30549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 2278) took 1217 ms. Trace:
I20260709 13:10:05.938951 30549 rpcz_store.cc:276] 0709 13:10:04.710264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.712554 (+  2290us) service_pool.cc:224] Handling call
0709 13:10:04.712970 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:04.989076 (+276106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.927148 (+938072us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b54000dcad4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:10:05.927367 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":545558784}
I20260709 13:10:05.911494  2971 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:05.880805  2684 consensus_queue.cc:237] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:05.950357  2753 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:05.953613  2930 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:05.938953 31116 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:05.955734 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:05.956180  2722 raft_consensus.cc:2764] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:10:05.956580 30467 raft_consensus.cc:2410] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:10:05.957460 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:05.958806 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:05.959421 30467 raft_consensus.cc:2468] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 12.
I20260709 13:10:05.965534  2787 raft_consensus.cc:3060] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:05.973049 30475 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50430 (request call id 2540) took 1614 ms (client timeout 1717 ms). Trace:
I20260709 13:10:05.977221 30619 raft_consensus.cc:1240] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 LEADER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:05.978596 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:05.980701 30470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 2146) took 1203 ms. Trace:
I20260709 13:10:05.981158 30470 rpcz_store.cc:276] 0709 13:10:04.777363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.777741 (+   378us) service_pool.cc:224] Handling call
0709 13:10:04.778003 (+   262us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:05.171148 (+393145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.980459 (+809311us) spinlock_profiling.cc:243] Waited 389 ms on lock 0x7b540029b3d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:10:05.980647 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":893600512}
I20260709 13:10:05.910990  2864 raft_consensus.cc:2804] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:05.984114  2981 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:05.985476  2979 log.cc:927] Time spent T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:10:05.988646  2961 log.cc:927] Time spent T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.230s	user 0.002s	sys 0.000s
W20260709 13:10:05.992633  2972 log.cc:927] Time spent T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:10:05.996256  2971 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:05.997720  2896 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:05.912914  2950 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:10:06.004698 31115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:05.973559 30475 rpcz_store.cc:269] 0709 13:10:04.358696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.370853 (+ 12157us) service_pool.cc:224] Handling call
0709 13:10:05.972792 (+1601939us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54002189d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:10:05.972919 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":266169728}
I20260709 13:10:06.012892  2747 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:06.013396 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:06.014593 30517 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:06.014868 30620 raft_consensus.cc:1240] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:06.016425 31149 raft_consensus.cc:1275] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:10:06.017364  2936 consensus_meta.cc:287] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.665s	user 0.017s	sys 0.001s
I20260709 13:10:06.018092  2535 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:06.018254 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:06.018692  2949 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.019240  2479 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:06.019584 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:06.024108  2745 raft_consensus.cc:3060] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:06.025360 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 86477.3us
W20260709 13:10:06.026598 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.026473 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:10:06.059131 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.059257 30622 raft_consensus.cc:2468] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 8.
I20260709 13:10:06.035337 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:06.038187 30474 raft_consensus.cc:2468] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 11.
I20260709 13:10:06.000927  2864 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.047212 30441 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:06.048696 30517 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:06.054548 30544 raft_consensus.cc:1275] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:06.065958 30476 raft_consensus.cc:1240] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:06.066264 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:06.070762 30467 raft_consensus.cc:2468] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 10.
I20260709 13:10:06.071717 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:06.065991 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:06.067251 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:06.027033  2941 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:06.067890 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:06.070127 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:06.041492  2869 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.053108  2950 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:06.075919 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:06.082463 30517 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:06.085089 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:06.089541 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:06.089596 30517 leader_election.cc:304] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:06.089843 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:06.090448 30476 raft_consensus.cc:2468] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 12.
I20260709 13:10:06.090181 30474 raft_consensus.cc:2468] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 9.
I20260709 13:10:06.082332  2563 raft_consensus.cc:2804] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:06.072549 30467 raft_consensus.cc:2410] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:10:06.084240 30472 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 12.
I20260709 13:10:06.086449 30547 raft_consensus.cc:2468] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 12.
I20260709 13:10:06.086424 31115 leader_election.cc:304] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:06.093170 30474 raft_consensus.cc:1240] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:10:06.094615 30476 raft_consensus.cc:1275] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:10:06.027275  2981 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:06.099877 30517 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:06.097564 30476 raft_consensus.cc:1275] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:06.030498  2971 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:06.101285 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:06.107872 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:06.089715  2896 raft_consensus.cc:2749] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:06.073498  2864 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:06.110492 30469 raft_consensus.cc:2468] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 6.
I20260709 13:10:06.111370 30517 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:06.114199 31151 raft_consensus.cc:1240] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:06.054976  2936 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:06.135105  2936 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:06.097631  2966 raft_consensus.cc:2804] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:06.137353  2966 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:06.137764  2966 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:06.084218 30475 raft_consensus.cc:2468] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 7.
W20260709 13:10:06.120705  2978 log.cc:927] Time spent T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 13:10:06.124755 30543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 2270) took 1669 ms. Trace:
I20260709 13:10:06.106293  2863 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.140599 30543 rpcz_store.cc:276] 0709 13:10:04.455663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.455780 (+   117us) service_pool.cc:224] Handling call
0709 13:10:04.456129 (+   349us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:10:04.498662 (+ 42533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:04.498705 (+    43us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:10:04.503478 (+  4773us) log.cc:844] Serialized 78 byte log entry
0709 13:10:04.606636 (+103158us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:04.606697 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.124311 (+1517614us) spinlock_profiling.cc:243] Waited 42.1 ms on lock 0x7b5400358254. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:10:06.124368 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:06.124409 (+    41us) raft_consensus.cc:1685] finished
0709 13:10:06.124421 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:06.124679 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2056,"raft.queue_time_us":77,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":7511,"spinlock_wait_cycles":96934144,"thread_start_us":91559,"threads_started":1,"wal-append.queue_time_us":120474,"wal-append.run_cpu_time_us":6773,"wal-append.run_wall_time_us":1029332}
I20260709 13:10:06.126423  2747 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:06.128005  2981 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:10:06.129534  2912 consensus_meta.cc:287] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.571s	user 0.013s	sys 0.003s
I20260709 13:10:06.131101  2971 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:10:06.131711  2977 log.cc:927] Time spent T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 13:10:06.126453 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:06.158519 31151 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:06.159215 31116 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:06.113127  2732 raft_consensus.cc:2804] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:06.066840  2479 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:06.112936  2867 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.107368  2967 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:06.096453  2563 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:06.057514  2535 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:06.091074  2869 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:06.156175  2747 raft_consensus.cc:2804] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:06.106735  2750 raft_consensus.cc:2804] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:06.164742  2732 raft_consensus.cc:493] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.162597 31142 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 13.
I20260709 13:10:06.166921 31116 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:06.138706  2733 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.140563  2848 raft_consensus.cc:2749] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:06.145638  2918 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.059926  2949 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:06.170982  2860 raft_consensus.cc:2804] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:06.195173 31142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 916) took 1100 ms. Trace:
I20260709 13:10:06.199182 31142 rpcz_store.cc:276] 0709 13:10:05.094974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.148797 (+ 53823us) service_pool.cc:224] Handling call
0709 13:10:05.920522 (+771725us) spinlock_profiling.cc:243] Waited 743 ms on lock 0x7b58006e8dd0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783ec40aa 00007fc783f46447 00007fc783f5efe7 00007fc783f607de 00007fc783f6c27c 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c
0709 13:10:06.195111 (+274589us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1708629248}
I20260709 13:10:06.200574 31116 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:06.200654 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:06.175580  2563 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:06.175760  2728 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:06.203861 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:06.257272  2949 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:06.165153  2912 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:06.256013 31147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48426 (request call id 918) took 1107 ms. Trace:
I20260709 13:10:06.292256  2720 consensus_queue.cc:1048] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:06.293617 31147 rpcz_store.cc:276] 0709 13:10:05.148601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.148801 (+   200us) service_pool.cc:224] Handling call
0709 13:10:05.149111 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:05.154046 (+  4935us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:05.154085 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:05.154553 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 13:10:05.999108 (+844555us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b18003138a0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e5de07 00007fc789cb8ab9 00007fc780e7a69b 00007fc780e7893f 00007fc780e7ac02 00007fc783b0220b 00007fc783b07d23 00007fc783b080d1 00007fc783f23a0f
0709 13:10:06.143980 (+144872us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:06.144018 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.144081 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:06.255705 (+111624us) raft_consensus.cc:1685] finished
0709 13:10:06.255724 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:06.255949 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2697,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"spinlock_wait_cycles":4510208,"thread_start_us":144701,"threads_started":1,"wal-append.queue_time_us":1087670}
I20260709 13:10:06.302327  2869 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:06.302410 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:06.302716 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:06.304018 30623 raft_consensus.cc:1275] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:10:06.305394  2912 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:06.292773  2969 raft_consensus.cc:493] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:06.303659 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:06.306973  2969 raft_consensus.cc:515] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:06.308610  2944 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.217204  2909 raft_consensus.cc:2749] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:06.202498  2918 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:06.192971  2750 raft_consensus.cc:493] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.197703  2732 raft_consensus.cc:3060] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:06.250339  2984 log.cc:927] Time spent T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:10:06.262755  2725 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:06.263515 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 334030us
I20260709 13:10:06.259159  2864 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:06.266418  2917 consensus_queue.cc:1048] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:06.267462  2866 consensus_queue.cc:1048] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:06.260319 30469 raft_consensus.cc:1240] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:06.269068 30468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 2547) took 1093 ms. Trace:
I20260709 13:10:06.334872 30468 rpcz_store.cc:276] 0709 13:10:05.175177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.175290 (+   113us) service_pool.cc:224] Handling call
0709 13:10:05.175548 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:05.504403 (+328855us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.268841 (+764438us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b54003d2f54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:10:06.269002 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":753740160}
I20260709 13:10:06.202919  2733 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:06.190413  2747 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:06.198834  2860 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.346545  2860 raft_consensus.cc:3060] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:06.316673  2750 raft_consensus.cc:3060] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:06.159739  2863 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:06.274633  2479 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:06.276139  2844 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:06.279400  2950 raft_consensus.cc:2749] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:06.282208  2088 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:06.282915 30624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 1076) took 1408 ms. Trace:
I20260709 13:10:06.283011  2966 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:06.287321 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:06.287897 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:06.363097 30624 rpcz_store.cc:276] 0709 13:10:04.874275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.875033 (+   758us) service_pool.cc:224] Handling call
0709 13:10:04.875349 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:04.884817 (+  9468us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:04.884857 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:04.884909 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:04.884953 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.282702 (+1397749us) spinlock_profiling.cc:243] Waited 9.26 ms on lock 0x7b54001644d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:10:06.282747 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:06.282861 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21307648}
I20260709 13:10:06.368745 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:06.288214 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:06.369675 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:06.289417 30617 raft_consensus.cc:1275] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:10:06.290113 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:06.290901 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:06.290514  2373 raft_consensus.cc:493] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.291483 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:06.291563  2871 consensus_queue.cc:1059] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:06.384145 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:06.385828 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:06.385962 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:06.204605  2962 raft_consensus.cc:2749] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:06.207765 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 68517.1us
I20260709 13:10:06.175093  2867 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:06.296216 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:06.312971 31151 raft_consensus.cc:2468] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 13.
I20260709 13:10:06.390522 31142 raft_consensus.cc:3060] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:06.312990 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:06.391554 30623 raft_consensus.cc:2468] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 11.
I20260709 13:10:06.309240  2911 consensus_queue.cc:1048] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:06.309104  2944 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:06.321919 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:06.399801 30543 raft_consensus.cc:2468] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 11.
I20260709 13:10:06.338886  2725 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:06.400858 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:06.401508 30543 raft_consensus.cc:2468] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 12.
I20260709 13:10:06.265858 30591 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:06.325537 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:06.403748 30548 raft_consensus.cc:2468] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 7.
I20260709 13:10:06.405732 30548 raft_consensus.cc:1240] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:06.407054 31114 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:10:06.408242  2869 raft_consensus.cc:2804] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:06.408587  2869 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.408937  2869 raft_consensus.cc:3060] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:06.326646 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:06.309670  2969 leader_election.cc:290] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:06.339334 30549 raft_consensus.cc:1275] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:06.341009  2072 consensus_queue.cc:1048] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:06.414160 31148 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 13.
I20260709 13:10:06.341281 30589 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:06.345542  2733 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:06.345989  2747 raft_consensus.cc:3060] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:06.349574 30547 raft_consensus.cc:1240] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:06.219341 31116 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:06.352353 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:06.423753 30545 raft_consensus.cc:3060] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:06.359303  2896 consensus_queue.cc:1059] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:10:06.339944  2745 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:10:06.362437  2723 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.904s	user 0.002s	sys 0.009s
I20260709 13:10:06.366303  2863 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:10:06.376044 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.379932  2912 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.398295 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:06.398655 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:06.342990  2753 consensus_queue.cc:1048] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:10:06.393405 30517 leader_election.cc:304] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:06.417160 31145 raft_consensus.cc:1275] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:06.422477 30551 raft_consensus.cc:2393] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 13: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
W20260709 13:10:06.424665 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 205441us
I20260709 13:10:06.436556 30590 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:06.437263  2072 raft_consensus.cc:2749] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:06.438874 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:06.439430 30467 raft_consensus.cc:2468] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 13.
I20260709 13:10:06.439430 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:06.439673 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:06.440107 30475 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:06.430311 31115 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:10:06.428864 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 87641.6us
I20260709 13:10:06.414172 30549 raft_consensus.cc:1275] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:10:06.433595 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 167803us
I20260709 13:10:06.419449  2720 raft_consensus.cc:3055] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:06.423604  2905 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.418568  2722 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.438652 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:10:06.444622 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 51328.1us
W20260709 13:10:06.429860  2723 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.974s	user 0.002s	sys 0.010s
I20260709 13:10:06.459125  2088 raft_consensus.cc:2804] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:06.459554  2088 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.459885  2088 raft_consensus.cc:3060] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:06.397054  2686 consensus_queue.cc:1048] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:10:06.448211 30467 raft_consensus.cc:1275] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:10:06.462044 30545 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 12.
I20260709 13:10:06.463786  2725 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:06.433568  2733 raft_consensus.cc:2804] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:06.453127 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:06.397317  2373 raft_consensus.cc:515] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:06.470257 30474 raft_consensus.cc:2468] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 11.
I20260709 13:10:06.472041  2373 leader_election.cc:290] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:06.472769 30474 raft_consensus.cc:1275] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:06.434754  2866 raft_consensus.cc:2804] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:06.435050  2871 raft_consensus.cc:2749] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:06.475189 30543 raft_consensus.cc:1275] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:10:06.444444 30589 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:06.450619 30468 raft_consensus.cc:2468] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 11.
I20260709 13:10:06.449679 31114 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:06.454396 31142 raft_consensus.cc:2468] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 13.
I20260709 13:10:06.483580 31142 raft_consensus.cc:1275] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:06.454770 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:06.484616 30470 raft_consensus.cc:2393] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 7: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:06.457408 30591 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:06.449534  2909 consensus_queue.cc:1059] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:10:06.459959  2949 raft_consensus.cc:2804] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:06.448014  2720 raft_consensus.cc:740] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:06.468320  2727 consensus_queue.cc:1059] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:10:06.489403 31116 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:10:06.491330 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 46950.6us
W20260709 13:10:06.510443 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 53141.8us
W20260709 13:10:06.498944 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 49343.3us
W20260709 13:10:06.500327 31115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.434949  2563 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:06.475607  2733 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.487278  2860 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:06.479427  2866 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.444136  2912 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:06.517711 30472 raft_consensus.cc:1240] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:06.516631 31151 raft_consensus.cc:1275] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:10:06.540123  3004 log.cc:927] Time spent T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
W20260709 13:10:06.541484  3006 log.cc:927] Time spent T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:10:06.507793  2966 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:10:06.512116 30517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:06.534626  2927 log.cc:927] Time spent T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 1.856s	user 0.003s	sys 0.003s
I20260709 13:10:06.467015  2479 consensus_queue.cc:1059] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:10:06.514882  2865 raft_consensus.cc:2749] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:06.468878  2905 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:06.510118  2725 raft_consensus.cc:2804] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:06.474381  2316 consensus_queue.cc:1059] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:10:06.449693  2745 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:06.551064 30589 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:06.532358  2088 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:06.469099  2722 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:06.535702  2733 raft_consensus.cc:3060] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:06.517539  2918 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:06.557830 30551 raft_consensus.cc:1275] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:06.543737  2766 raft_consensus.cc:2749] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:06.558719 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:06.469316  2970 consensus_queue.cc:1048] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.075s
I20260709 13:10:06.553524  2088 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:06.542804  2949 raft_consensus.cc:697] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 11 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:06.548192  2727 raft_consensus.cc:3055] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:06.573444 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:06.574169 30551 raft_consensus.cc:2468] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 15.
W20260709 13:10:06.564532 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 75206.1us
I20260709 13:10:06.537899  2866 raft_consensus.cc:3060] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:06.570487 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 132914us
W20260709 13:10:06.572083 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 58367.8us
I20260709 13:10:06.575759 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:06.550415  2725 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:06.587834  2088 consensus_queue.cc:1048] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:06.587379 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:06.560606  2864 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:06.590796 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:06.591948 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:06.582195 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:06.582281 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:06.593538 30547 raft_consensus.cc:2468] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 11.
I20260709 13:10:06.596148 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:06.598362  2918 consensus_queue.cc:1048] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:06.600448 30440 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:06.603200  2918 raft_consensus.cc:2804] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:06.603569  2918 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:06.603960  2918 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:06.608363 30517 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:06.609789 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:06.568885  2965 raft_consensus.cc:2804] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:06.612265 30470 raft_consensus.cc:3060] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:06.614967 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:06.564661  2785 consensus_queue.cc:1059] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:10:06.620399 30440 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:06.586558  2753 raft_consensus.cc:2804] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:06.627439 30440 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:06.622068 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:06.622511 30549 raft_consensus.cc:1275] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:10:06.630908 30549 pending_rounds.cc:85] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd: Aborting all ops after (but not including) 7
I20260709 13:10:06.631194 30549 pending_rounds.cc:107] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:10:06.631464 30549 raft_consensus.cc:2889] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:06.581926  2727 raft_consensus.cc:740] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:06.591877  2725 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:06.588383  2865 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:06.635672 30545 raft_consensus.cc:1275] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:10:06.630419 30547 raft_consensus.cc:2468] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 7.
I20260709 13:10:06.629330 30440 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:06.547801  2884 consensus_queue.cc:1048] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:10:06.640138  2884 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:06.640756  2884 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:06.644498  2971 raft_consensus.cc:2804] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:06.644897  2971 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.645246  2971 raft_consensus.cc:3060] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:06.645083 30440 leader_election.cc:304] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:06.648169  2728 raft_consensus.cc:2749] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:06.650075 30440 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:06.646701  2884 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:06.652793  2728 raft_consensus.cc:2749] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:06.653752  2971 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:06.656484  2971 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:06.619041  2479 raft_consensus.cc:2804] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:10:06.663551 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 78660.1us
I20260709 13:10:06.615391  2965 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.665643 30591 leader_election.cc:304] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:06.621587  2870 consensus_queue.cc:1048] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:10:06.638090  2969 raft_consensus.cc:2749] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:06.638281  2686 raft_consensus.cc:2749] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:06.666182  2479 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.681988 30470 raft_consensus.cc:2468] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 12.
I20260709 13:10:06.662899  2867 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:06.663558  2753 raft_consensus.cc:697] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:06.670374  2965 raft_consensus.cc:3060] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:06.626293  2844 consensus_queue.cc:1048] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:10:06.637712  2878 consensus_queue.cc:1059] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:10:06.662205  2785 consensus_queue.cc:1048] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:10:06.702641  2905 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:06.680385  2316 raft_consensus.cc:2749] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:06.685566 30591 leader_election.cc:304] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:06.693624 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:06.718106 30474 raft_consensus.cc:3060] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:06.694717  3009 consensus_queue.cc:1048] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:10:06.695560  2753 consensus_queue.cc:237] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:06.689425  2884 consensus_queue.cc:1048] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:10:06.698734 30475 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 13.
I20260709 13:10:06.699965  2563 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:06.682986  2727 consensus_queue.cc:260] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:06.687299  2479 raft_consensus.cc:3060] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:06.708237  2745 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:06.708827  2912 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:06.681774  2732 raft_consensus.cc:515] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:06.660113  2865 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:06.711380  3003 log.cc:927] Time spent T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:10:06.664601  2971 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.712469  2750 raft_consensus.cc:515] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:06.739636 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 54130.6us
I20260709 13:10:06.749116  2844 raft_consensus.cc:2804] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:10:06.748668  3007 log.cc:927] Time spent T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.233s	user 0.001s	sys 0.001s
W20260709 13:10:06.755070 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 164699us
I20260709 13:10:06.757460 30474 raft_consensus.cc:2468] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 11.
W20260709 13:10:06.758119 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 244156us
I20260709 13:10:06.670537  2949 consensus_queue.cc:237] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:06.692929 31116 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:06.767951  2727 raft_consensus.cc:3060] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:06.768723  2725 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:06.769847  2750 leader_election.cc:290] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:06.770362 30545 raft_consensus.cc:1240] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:10:06.784775 31147 raft_consensus.cc:2368] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 9. Current term is 10.
W20260709 13:10:06.786798 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 93929.3us
I20260709 13:10:06.790385 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:10:06.792964 31115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.808184 31116 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:06.809180 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:06.809864 30619 raft_consensus.cc:2468] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 11.
I20260709 13:10:06.810187 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:06.810803 30616 raft_consensus.cc:3060] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:06.810112 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:06.813859  2088 raft_consensus.cc:2804] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:06.814538  2088 raft_consensus.cc:697] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 11 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:06.815532  2088 consensus_queue.cc:237] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:06.819443  3016 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.820217  3016 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:06.782788  2844 raft_consensus.cc:493] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:06.828388  2982 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:06.828697  2844 raft_consensus.cc:3060] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:06.830106 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:06.832242 30622 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:06.833630 30623 raft_consensus.cc:1240] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:06.797993  2745 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.846781  2733 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:06.851130 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:06.782187  2971 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:06.874821 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:06.798765  3021 raft_consensus.cc:2804] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:06.901193 30622 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 13.
I20260709 13:10:06.829018  2982 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:06.909309  2870 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:06.875408  2563 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.853982  2745 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:06.920789  2732 leader_election.cc:290] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:06.921370 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:06.947960 30474 raft_consensus.cc:3060] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:06.916602  2747 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:06.863365 30616 raft_consensus.cc:2468] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 12.
I20260709 13:10:06.938309 31151 raft_consensus.cc:2376] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 13. Re-sending same reply.
I20260709 13:10:06.907153  2725 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:06.937116 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:06.964355 30623 raft_consensus.cc:3060] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:10:06.834860  2869 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:06.943404 30473 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 2148) took 2165 ms. Trace:
I20260709 13:10:06.966703 30473 rpcz_store.cc:276] 0709 13:10:04.777915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.778020 (+   105us) service_pool.cc:224] Handling call
0709 13:10:04.794628 (+ 16608us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:05.035746 (+241118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.943186 (+1907440us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b5400299ad4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:10:06.943343 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":552422272}
I20260709 13:10:06.944972  3021 raft_consensus.cc:697] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 12 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:06.980320 30474 raft_consensus.cc:2468] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 10.
I20260709 13:10:06.981521 30548 raft_consensus.cc:1240] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:06.984942 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:06.946826  2563 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:06.945739  2870 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:07.010267 31115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.013020  2982 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:07.013999  2869 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:07.017010 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:07.018786 31116 leader_election.cc:304] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:07.019549  2732 raft_consensus.cc:2804] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:07.020087  2971 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:07.020300 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:06.975761  3016 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:07.025313 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:07.025899 31151 raft_consensus.cc:2393] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 13: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:10:07.028381  2865 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:07.021927  3027 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.036718 30623 raft_consensus.cc:2468] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 10.
I20260709 13:10:06.985036  2479 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:07.042850  3024 log.cc:927] Time spent T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:10:07.045818  2479 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:07.048009  2563 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:07.049685 31149 raft_consensus.cc:1240] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:10:07.020100  2732 raft_consensus.cc:697] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 10 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:07.032285  3027 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:07.066229 31145 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48414 (request call id 1085) took 3102 ms. Trace:
I20260709 13:10:07.066632 31145 rpcz_store.cc:276] 0709 13:10:03.964157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.964277 (+   120us) service_pool.cc:224] Handling call
0709 13:10:03.964625 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:06.434989 (+2470364us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:07.065976 (+630987us) spinlock_profiling.cc:243] Waited 2.44 s on lock 0x7b54006eee54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:10:07.066146 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5623470464}
I20260709 13:10:07.068862 30547 raft_consensus.cc:1240] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:10:07.077544 30440 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:10:07.082734 30517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.990986  2844 raft_consensus.cc:515] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:07.055482  2733 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:07.047305  2722 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:07.055889  2932 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:07.041975  2745 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:07.092871  2860 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:07.093321  2949 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.094403  2949 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:07.095443  2747 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:07.085047  2971 consensus_queue.cc:1048] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:10:07.096558  2949 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:07.096989 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:07.102492 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:07.080930  2877 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.084810  2950 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.087405  3009 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.081988  2965 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:07.087118  2563 raft_consensus.cc:2804] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:07.105033 30547 raft_consensus.cc:2393] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 12: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:07.053923 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:07.085381  2918 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:07.089326  2912 consensus_queue.cc:1048] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:10:07.142444 30623 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 12.
I20260709 13:10:07.148170  2918 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:07.105860  2877 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:07.153362 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:07.154481 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:10:07.154588  2989 log.cc:927] Time spent T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.959s	user 0.000s	sys 0.002s
I20260709 13:10:07.155527 30544 raft_consensus.cc:2468] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 12.
I20260709 13:10:07.139477  2563 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.157511 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:07.158151 30544 raft_consensus.cc:2393] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 12: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:07.158977 30440 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:07.160559 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:07.161164 30544 raft_consensus.cc:2468] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 12.
I20260709 13:10:07.161958 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:07.162426 30544 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:07.058357  3021 consensus_queue.cc:237] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:07.145246  2971 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.164304 30440 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:07.163632  2918 raft_consensus.cc:2804] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:07.166164 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:07.176910 30547 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 13.
I20260709 13:10:07.170691  3027 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:07.178081 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:07.182126 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:07.178340 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:07.178916 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:07.179368 30441 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:07.179713 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:07.182934 30474 raft_consensus.cc:3060] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:07.180401 30467 raft_consensus.cc:1240] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:10:07.184697 30441 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:07.108884  3009 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:07.160710  2563 raft_consensus.cc:3060] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:07.188117 30468 raft_consensus.cc:2393] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 12: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:07.108906  2950 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:07.197667 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:07.199208 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:07.187937  2889 consensus_queue.cc:1048] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:10:07.188108  2727 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:07.202513  2727 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:07.204712 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:07.205847 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:07.206894 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:07.207163 31149 raft_consensus.cc:1275] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:10:07.207670  2844 leader_election.cc:290] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:07.208339 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:07.209327 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:10:07.209530 31113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.209885 31145 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 13.
I20260709 13:10:07.210445 30623 raft_consensus.cc:1240] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:07.210970 31145 raft_consensus.cc:1275] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:10:07.212154 31146 raft_consensus.cc:2393] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 8: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:10:07.213045 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:07.176721  2918 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.190778 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:07.215248 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:07.218747 30468 raft_consensus.cc:3060] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:07.218007 30544 raft_consensus.cc:2468] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 16.
W20260709 13:10:07.197017  2866 consensus_meta.cc:287] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.603s	user 0.009s	sys 0.002s
I20260709 13:10:07.229169 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:07.193034 30474 raft_consensus.cc:2468] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 12.
I20260709 13:10:07.171752  2932 raft_consensus.cc:2804] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:07.195107  2686 raft_consensus.cc:2764] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:10:07.194911  2905 raft_consensus.cc:2749] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:07.297794 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:07.298663 30474 raft_consensus.cc:2393] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 13: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:07.321714 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:07.322712 31145 raft_consensus.cc:2368] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 7. Current term is 8.
I20260709 13:10:07.324072 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:07.120221  2732 consensus_queue.cc:237] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:07.176504  2971 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:07.328493 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:07.329593 30591 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:07.330018 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:07.331038 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:07.221081  2918 raft_consensus.cc:3060] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:07.332413 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:07.333600 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:07.340072 31146 raft_consensus.cc:2393] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 13: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:10:07.340242 30474 raft_consensus.cc:2410] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:10:07.341401 30517 leader_election.cc:304] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:07.342370 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:07.270641  2932 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.347354 30474 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 15.
I20260709 13:10:07.351925  2747 consensus_queue.cc:1059] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:10:07.352716  2949 raft_consensus.cc:2804] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:07.353259  2949 raft_consensus.cc:697] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 12 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:07.353834  2994 raft_consensus.cc:3055] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:07.354387  2994 raft_consensus.cc:740] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:07.354087  2949 consensus_queue.cc:237] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:07.361876 30546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 2267) took 2909 ms. Trace:
I20260709 13:10:07.362267 30546 rpcz_store.cc:276] 0709 13:10:04.452919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.453039 (+   120us) service_pool.cc:224] Handling call
0709 13:10:05.164163 (+711124us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:05.164826 (+   663us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:07.361693 (+2196867us) spinlock_profiling.cc:243] Waited 698 ms on lock 0x7b540002eed0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f678ad 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:10:07.361821 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1604364032}
I20260709 13:10:07.359654 30476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 1128) took 1267 ms. Trace:
I20260709 13:10:07.363231 30476 rpcz_store.cc:276] 0709 13:10:06.092045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.108224 (+ 16179us) service_pool.cc:224] Handling call
0709 13:10:06.108552 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:06.130098 (+ 21546us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:10:06.352947 (+222849us) log.cc:844] Serialized 14 byte log entry
0709 13:10:06.390993 (+ 38046us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:06.391041 (+    48us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:06.391221 (+   180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:07.359341 (+968120us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b540029aed4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:10:07.359404 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:07.359582 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36538,"prepare.queue_time_us":135809,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":4306,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":12734,"spinlock_wait_cycles":49067776,"thread_start_us":215520,"threads_started":2,"wal-append.queue_time_us":74695}
I20260709 13:10:07.366314 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:07.328320  2870 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:07.332075  2865 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:07.332279  2373 raft_consensus.cc:493] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.382618  2373 raft_consensus.cc:515] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:07.385138  2373 leader_election.cc:290] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:07.369150  2950 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:07.271569  2866 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:07.386656 30542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 993) took 1058 ms. Trace:
I20260709 13:10:07.387240  2866 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:07.371246  2944 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:07.372224  2965 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:07.389832 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:07.372778  2912 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:07.372726 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:07.390759  2535 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:07.381199  2971 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:10:07.381783 31148 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48426 (request call id 925) took 1716 ms (client timeout 1581 ms). Trace:
W20260709 13:10:07.391623 31148 rpcz_store.cc:269] 0709 13:10:05.664947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.666070 (+  1123us) service_pool.cc:224] Handling call
0709 13:10:07.381562 (+1715492us) spinlock_profiling.cc:243] Waited 721 ms on lock 0x7b5400727254. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:10:07.381699 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1658244480}
I20260709 13:10:07.390568  2912 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:07.378836  2896 raft_consensus.cc:3055] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:07.392897  2896 raft_consensus.cc:740] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:07.393705  2896 consensus_queue.cc:260] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:07.394233  2912 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:07.394383 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:07.394734  2912 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:07.394841  2896 raft_consensus.cc:3060] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:07.401818 30548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 998) took 1070 ms. Trace:
I20260709 13:10:07.402179 30548 rpcz_store.cc:276] 0709 13:10:06.330939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.406393 (+ 75454us) service_pool.cc:224] Handling call
0709 13:10:06.406647 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:06.981978 (+575331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:07.401593 (+419615us) spinlock_profiling.cc:243] Waited 575 ms on lock 0x7b5400358754. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:10:07.401761 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1321669888}
I20260709 13:10:07.403228 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:07.405058  2912 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:07.405929  2877 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:07.407114  2727 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:10:07.407927  3033 log.cc:927] Time spent T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.265s	user 0.000s	sys 0.001s
I20260709 13:10:07.409267  2918 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:07.412094  2918 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:07.346931  2932 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:07.403774 30548 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 15.
I20260709 13:10:07.413686 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:07.412168 30475 raft_consensus.cc:2393] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 13: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:07.414746 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:07.415589 30548 raft_consensus.cc:3060] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:07.407821  2715 leader_election.cc:290] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:07.418957 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:07.420810 30623 raft_consensus.cc:1275] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:10:07.422542  2720 consensus_queue.cc:260] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:07.423512  2720 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:07.424098  2912 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:07.430359 30548 raft_consensus.cc:2468] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 13.
I20260709 13:10:07.431224 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:07.424719  2865 raft_consensus.cc:2749] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:07.432166 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:07.431241 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:07.438030 30468 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 12.
I20260709 13:10:07.439040 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:07.439744 30476 raft_consensus.cc:2393] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 13: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:10:07.447170  2563 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:07.450843 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:07.451321 31147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48414 (request call id 1089) took 1349 ms. Trace:
I20260709 13:10:07.451752 31147 rpcz_store.cc:276] 0709 13:10:06.102058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.303451 (+201393us) service_pool.cc:224] Handling call
0709 13:10:07.451133 (+1147682us) spinlock_profiling.cc:243] Waited 477 ms on lock 0x7b54004c6154. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:10:07.451270 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1097967872}
I20260709 13:10:07.451372 30549 raft_consensus.cc:3060] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:07.461261 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:07.462546 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:07.463454 30476 raft_consensus.cc:2393] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 8: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:07.464282 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:07.470316  2912 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:07.470850  2912 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:07.472007 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:07.467060 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:07.387112 30542 rpcz_store.cc:276] 0709 13:10:06.328538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.328662 (+   124us) service_pool.cc:224] Handling call
0709 13:10:06.328975 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:06.329201 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:06.353236 (+ 24035us) log.cc:844] Serialized 14 byte log entry
0709 13:10:07.386022 (+1032786us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b18003d1a40. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc783b104bc 00007fc780e5e48b 00007fc789cb8ab9 00007fc780e7a69b 00007fc780e7893f 00007fc780e7ac02 00007fc783b0220b 00007fc783b07d23 00007fc783b0823a
0709 13:10:07.386249 (+   227us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:07.386311 (+    62us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:07.386369 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:07.386453 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:07.386592 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":24713,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":3464,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":72,"spinlock_wait_cycles":24605440,"thread_start_us":45992,"threads_started":1,"wal-append.queue_time_us":110795}
I20260709 13:10:07.477237 30468 raft_consensus.cc:3060] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:07.477698 30476 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 13.
I20260709 13:10:07.490631 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:07.497044  2912 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:07.497944  2881 raft_consensus.cc:3055] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:07.499387 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:07.501293 31150 raft_consensus.cc:2410] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for term 14 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:10:07.493105  2996 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.471892  2869 consensus_queue.cc:1059] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:10:07.502487 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:07.472146  2994 consensus_queue.cc:260] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:07.507537 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:07.507244 30591 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:07.499903  2881 raft_consensus.cc:740] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:07.512017 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:07.512702 30542 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:07.511117  2865 raft_consensus.cc:2804] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:07.513550 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:07.514019  2865 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:07.514395 30544 raft_consensus.cc:2410] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:10:07.514595 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:07.514935 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:07.515287 31148 raft_consensus.cc:2393] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 8: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:10:07.503273 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
W20260709 13:10:07.520156 31115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.509377  2563 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:07.514452  2865 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:07.529637 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:10:07.531499 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.532399 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:07.536087 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:07.536725 30545 raft_consensus.cc:3060] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:07.533874 30548 raft_consensus.cc:1240] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:07.506785  2996 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:07.544641 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:07.545943 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:07.549158 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:07.549899 30548 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 13.
I20260709 13:10:07.554837 30476 raft_consensus.cc:2410] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:10:07.562745 31114 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:07.565327 30476 raft_consensus.cc:1240] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 11. Current term is 12. Ops: [8.6-11.8]
I20260709 13:10:07.567785 30545 raft_consensus.cc:2468] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 11.
I20260709 13:10:07.569315 30545 raft_consensus.cc:1275] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:10:07.571831 30468 raft_consensus.cc:2468] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 13.
I20260709 13:10:07.575461 30476 raft_consensus.cc:1240] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:10:07.579352 31114 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:07.580153 30476 raft_consensus.cc:1240] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 17 LEADER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:10:07.580464 31114 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:07.554380  2563 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:07.587200 30549 raft_consensus.cc:2468] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 8.
W20260709 13:10:07.594162 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.563704  2912 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:07.589003  2733 raft_consensus.cc:2749] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:07.573109  2479 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:07.574819  2981 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.574584  2535 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:07.607671  2918 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:07.608052  2535 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:07.608244  2918 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:07.610411  2535 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:07.610725  2918 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:07.581326  2944 raft_consensus.cc:2749] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:07.575014  2878 consensus_queue.cc:1059] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:10:07.595332  2965 raft_consensus.cc:2804] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:07.579875  2896 raft_consensus.cc:493] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:07.594720  2563 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:07.645073  2726 raft_consensus.cc:3060] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:07.647662 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:07.556820  2881 consensus_queue.cc:260] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:07.590677  2867 consensus_queue.cc:1059] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 13:10:07.605683  2646 consensus_queue.cc:1048] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:10:07.641623  2965 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.660102  2944 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.658613  2965 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:07.660669  2944 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:07.664280  2944 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:07.664494 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:07.611577  2912 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:07.630671  2981 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:07.628322  2479 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:07.651000  2896 raft_consensus.cc:515] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:07.684063 30624 raft_consensus.cc:1275] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 13:10:07.667706 30542 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 13.
I20260709 13:10:07.697588 30624 pending_rounds.cc:85] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79: Aborting all ops after (but not including) 12
I20260709 13:10:07.698086 30624 pending_rounds.cc:107] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:10:07.698408 30624 raft_consensus.cc:2889] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:07.704450  3040 log.cc:927] Time spent T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:10:07.699746  2996 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:07.740912  2563 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:07.744333 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:07.745154 30542 raft_consensus.cc:2468] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 10.
W20260709 13:10:07.747306 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 158244us
W20260709 13:10:07.746727 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 175234us
I20260709 13:10:07.749769 30591 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:07.758013 31114 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:07.760944 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:07.763357 31144 raft_consensus.cc:1275] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:10:07.771921  2284 raft_consensus.cc:2804] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:07.760957  2870 raft_consensus.cc:2804] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:07.769171  2720 consensus_queue.cc:1059] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:10:07.806428 30441 leader_election.cc:304] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:07.797251  2479 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:07.873036 30622 raft_consensus.cc:1275] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:10:07.871625 30551 raft_consensus.cc:2410] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:10:07.860136 30440 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:05.409765 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:07.821578 30516 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:10:07.881762 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 60730.4us
I20260709 13:10:07.882477 30516 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
W20260709 13:10:07.852788 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 46423.1us
I20260709 13:10:07.884174 30440 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:07.839017 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:07.806308  2918 raft_consensus.cc:493] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:07.805912  2732 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:07.822084  3015 log.cc:927] Time spent T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 1.119s	user 0.000s	sys 0.003s
I20260709 13:10:07.894340 30620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 1100) took 1413 ms. Trace:
I20260709 13:10:07.894704 30620 rpcz_store.cc:276] 0709 13:10:06.480532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.480693 (+   161us) service_pool.cc:224] Handling call
0709 13:10:06.506711 (+ 26018us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:06.510319 (+  3608us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:06.510346 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:06.514273 (+  3927us) log.cc:844] Serialized 26 byte log entry
0709 13:10:06.660949 (+146676us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:06.660985 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.661048 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:07.821523 (+1160475us) spinlock_profiling.cc:243] Waited 36.7 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:10:07.894050 (+ 72527us) raft_consensus.cc:1685] finished
0709 13:10:07.894071 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:07.894282 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26239,"raft.queue_time_us":6610,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":19761,"spinlock_wait_cycles":84478848,"thread_start_us":111177,"threads_started":1,"wal-append.queue_time_us":160820}
I20260709 13:10:07.896327 30473 raft_consensus.cc:1275] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:07.888527 30516 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:07.836463  2720 raft_consensus.cc:3055] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:07.897890  2720 raft_consensus.cc:740] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:07.898562 30473 raft_consensus.cc:1240] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 11. Current term is 12. Ops: [8.6-11.8]
I20260709 13:10:07.898795  2720 consensus_queue.cc:260] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:07.900060  2720 raft_consensus.cc:3060] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:07.901309  2911 raft_consensus.cc:3055] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:07.901728  2911 raft_consensus.cc:740] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:07.902503  2911 consensus_queue.cc:260] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:07.905790  2911 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:07.887014  2905 raft_consensus.cc:2804] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:07.807804  2284 raft_consensus.cc:697] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 13 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:07.840301  2965 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:07.908912  2284 consensus_queue.cc:237] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:07.909822  2910 raft_consensus.cc:2804] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:07.910238  2910 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.910589  2965 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:07.807283  2870 raft_consensus.cc:697] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:07.871122  3009 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:07.835489  2896 leader_election.cc:290] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:07.885335  2884 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:07.918790  2884 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:07.828437  3045 log.cc:927] Time spent T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:10:07.830456  2932 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:07.835129  2981 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:07.878062  2750 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.886005  2726 raft_consensus.cc:2749] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:07.907349  2865 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:07.814306  3038 raft_consensus.cc:2749] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:07.915478 30516 leader_election.cc:400] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 election: Vote denied by peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453) with higher term. Message: Invalid argument: T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 7. Current term is 8.
I20260709 13:10:07.928857 30516 leader_election.cc:403] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:10:07.916483  2996 raft_consensus.cc:2749] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:07.902155  2732 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:07.916743  2870 consensus_queue.cc:237] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:07.937446  2732 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:07.892068  2479 raft_consensus.cc:2749] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:07.938344  2969 consensus_queue.cc:1048] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:07.939210  2969 consensus_queue.cc:1243] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer cd669586cff44d4bbfcc007e213faab6 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:10:07.941604 30471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 2153) took 3162 ms. Trace:
I20260709 13:10:07.944554 30550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 994) took 1615 ms. Trace:
I20260709 13:10:07.945026 30550 rpcz_store.cc:276] 0709 13:10:06.329624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.329751 (+   127us) service_pool.cc:224] Handling call
0709 13:10:06.349116 (+ 19365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:06.575864 (+226748us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:06.575896 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:06.575936 (+    40us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:06.575966 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:07.944281 (+1368315us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b54000c5154. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:10:07.944342 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:07.944488 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":521024896}
W20260709 13:10:07.947933 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.956122 30467 raft_consensus.cc:1240] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:07.957329  2932 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:07.958189  2750 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:07.930478 30516 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:07.919970  2944 consensus_queue.cc:1048] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:10:07.933288 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:07.965834 30473 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:07.933920 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:07.934131  2877 raft_consensus.cc:3055] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:07.934942  2954 raft_consensus.cc:3055] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:07.910591  2910 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:07.963110 30516 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:07.962530 31115 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:07.964745 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:07.975710 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:07.966713 30620 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:07.942076 30471 rpcz_store.cc:276] 0709 13:10:04.779241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.804668 (+ 25427us) service_pool.cc:224] Handling call
0709 13:10:05.974198 (+1169530us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:06.030061 (+ 55863us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:10:06.055512 (+ 25451us) log.cc:844] Serialized 14 byte log entry
0709 13:10:06.165527 (+110015us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:06.167071 (+  1544us) log.cc:844] Serialized 52 byte log entry
0709 13:10:06.167191 (+   120us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:06.263743 (+ 96552us) spinlock_profiling.cc:243] Waited 1.15 ms on lock 0x7b180041cf20. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780df5c0a 00007fc78a535219 00007fc780e7da40 00007fc780e784e4 00007fc780e78455 00007fc7879603c7 00007fc783f729a7 00007fc783f820bf 00007fc783f82038
0709 13:10:06.361441 (+ 97698us) log.cc:844] Serialized 14 byte log entry
0709 13:10:06.361670 (+   229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.361739 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:06.361860 (+   121us) raft_consensus.cc:1685] finished
0709 13:10:06.361875 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:07.379520 (+1017645us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b180041cf20. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e7b522 00007fc780e7d7c1 00007fc780e7d779 00007fc780e7d709 00007fc780e7d6d1 00007fc780e7c9cd 000000000038f354 000000000038f199 00007fc780e5e83a
0709 13:10:07.941400 (+561880us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54002189d0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f678ad 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:10:07.941534 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24403,"prepare.queue_time_us":124614,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":11187,"raft.queue_time_us":27657,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":9283,"spinlock_wait_cycles":2653031808,"thread_start_us":178014,"threads_started":2,"wal-append.queue_time_us":141180,"wal-append.run_cpu_time_us":2753,"wal-append.run_wall_time_us":1165003}
I20260709 13:10:07.904904  2918 raft_consensus.cc:515] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:07.966380 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 82284.4us
I20260709 13:10:07.977458 30516 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
W20260709 13:10:07.977298 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 93672.4us
I20260709 13:10:07.978744 31143 raft_consensus.cc:1275] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:07.986501 30440 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:07.983291 30473 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 14.
I20260709 13:10:07.976512 31148 raft_consensus.cc:2468] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
I20260709 13:10:07.960758  2981 raft_consensus.cc:2749] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453) with higher term. Message: Invalid argument: T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 7. Current term is 8.
I20260709 13:10:07.987953  2905 raft_consensus.cc:697] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 16 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:07.991256 31115 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:07.993053  2790 consensus_queue.cc:1059] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:08.011690  2905 consensus_queue.cc:237] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:08.013304  2867 raft_consensus.cc:2749] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:08.013653  2790 raft_consensus.cc:3055] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:08.014025  2790 raft_consensus.cc:740] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:08.014829  2790 consensus_queue.cc:260] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:08.016258  2790 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:07.994071  2865 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:07.994392  2918 leader_election.cc:290] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:07.997083 30440 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:07.997577  2932 raft_consensus.cc:2804] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:08.017853  2932 raft_consensus.cc:697] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 13 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:08.018527 30440 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:08.018726  3055 raft_consensus.cc:2804] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:07.988794  2732 raft_consensus.cc:2749] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:07.968225  2479 raft_consensus.cc:3060] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:07.999553 30441 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:08.000131  2971 consensus_queue.cc:1048] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:08.004753  3009 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:10:08.005064  3010 log.cc:927] Time spent T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 1.391s	user 0.001s	sys 0.004s
I20260709 13:10:08.006265  2896 raft_consensus.cc:2749] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:08.006600 30516 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:07.971899  2877 raft_consensus.cc:740] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:07.973644  3014 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.986505  2996 raft_consensus.cc:2749] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:10:08.010002  3013 log.cc:927] Time spent T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 1.310s	user 0.003s	sys 0.000s
W20260709 13:10:08.021085 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.022181 31115 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:08.028033  2646 consensus_queue.cc:1059] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:08.028841 30620 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 14.
I20260709 13:10:07.973738  2954 raft_consensus.cc:740] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:08.039022 30547 raft_consensus.cc:1240] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:08.059484 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:08.039662 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:08.060833 30544 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:08.060501 31143 raft_consensus.cc:2376] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 13. Re-sending same reply.
I20260709 13:10:08.032243  2918 raft_consensus.cc:2804] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:08.046528 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:08.031563  2884 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:08.075784 31150 raft_consensus.cc:2468] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 9.
I20260709 13:10:08.056653 31115 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:08.067631 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:08.076795 31148 raft_consensus.cc:2368] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 13. Current term is 14.
I20260709 13:10:08.042544 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:08.077629 30542 raft_consensus.cc:2468] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 9.
I20260709 13:10:08.091060  2954 consensus_queue.cc:260] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:08.092670  2954 raft_consensus.cc:3060] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:08.063337  2965 raft_consensus.cc:2749] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:08.094198  2877 consensus_queue.cc:260] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:08.095234  2726 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:08.066455  2981 raft_consensus.cc:2749] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:08.078593  2732 raft_consensus.cc:3055] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:08.096167  2732 raft_consensus.cc:740] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:08.095922  2726 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:08.049270  3009 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:08.097064  2732 consensus_queue.cc:260] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:08.098120  2726 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:08.066823  2870 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:08.098869  3009 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:08.098949  2870 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:08.083864  2932 consensus_queue.cc:237] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:08.075469  2918 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:08.099828 31115 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:08.055753  3014 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:08.105784  3014 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:08.105919 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:08.106907 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:08.107326 31142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48414 (request call id 1097) took 1641 ms. Trace:
I20260709 13:10:08.107509 30620 raft_consensus.cc:2468] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 9.
I20260709 13:10:08.107692 31142 rpcz_store.cc:276] 0709 13:10:06.466376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.488858 (+ 22482us) service_pool.cc:224] Handling call
0709 13:10:06.489122 (+   264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:06.489490 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:06.489519 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:06.536814 (+ 47295us) log.cc:844] Serialized 26 byte log entry
0709 13:10:06.613548 (+ 76734us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:06.613586 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.613661 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:08.009419 (+1395758us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:10:08.107037 (+ 97618us) raft_consensus.cc:1685] finished
0709 13:10:08.107068 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.107262 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13120,"raft.queue_time_us":2642,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":6381,"spinlock_wait_cycles":37312256,"thread_start_us":76464,"threads_started":1,"wal-append.queue_time_us":135040}
W20260709 13:10:08.112532 31115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.100004  2860 consensus_queue.cc:1048] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
W20260709 13:10:08.115849 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.095300  2877 raft_consensus.cc:3060] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:08.118513 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.121023 30544 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 14.
I20260709 13:10:08.098482  2732 raft_consensus.cc:3060] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:08.123891 30590 leader_election.cc:304] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:08.108973  2284 raft_consensus.cc:2749] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:08.103657  2918 raft_consensus.cc:3060] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:08.113232 31115 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:08.101097  2870 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:10:08.141709 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 122381us
I20260709 13:10:08.130285  2722 raft_consensus.cc:2749] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:08.169523 30472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 2158) took 2099 ms. Trace:
I20260709 13:10:08.170120 30543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 1000) took 1838 ms. Trace:
I20260709 13:10:08.169900 30472 rpcz_store.cc:276] 0709 13:10:06.069963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.092603 (+ 22640us) service_pool.cc:224] Handling call
0709 13:10:06.092908 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:06.538373 (+445465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.169213 (+1630840us) spinlock_profiling.cc:243] Waited 425 ms on lock 0x7b5400041fd4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:10:08.169442 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":976479104}
I20260709 13:10:08.170533 30543 rpcz_store.cc:276] 0709 13:10:06.331478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.416171 (+ 84693us) service_pool.cc:224] Handling call
0709 13:10:06.416523 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:06.481749 (+ 65226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.169920 (+1688171us) spinlock_profiling.cc:243] Waited 58.4 ms on lock 0x7b5400258ad4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:10:08.170066 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":134234880}
I20260709 13:10:08.140318 30590 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:08.153676  2971 raft_consensus.cc:2749] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:08.137588  2917 raft_consensus.cc:2749] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:08.159963  2863 raft_consensus.cc:2804] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:08.131609  2982 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:08.103181  2910 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:08.163226 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 131489us
I20260709 13:10:08.132032  3014 consensus_queue.cc:1048] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:10:08.138254  3055 raft_consensus.cc:697] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 8 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:08.173658 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:08.207782 30544 raft_consensus.cc:2393] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 8: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:08.176496 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:08.210263 30543 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:08.165954  2479 raft_consensus.cc:2749] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:08.196837 30441 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:08.179579  2863 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.228132  2863 raft_consensus.cc:3060] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:08.228020  3055 consensus_queue.cc:237] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:08.183226  2982 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:08.233865  2982 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:08.189889  2971 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:08.234694  2971 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:08.236779  2971 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:08.237422  2971 raft_consensus.cc:2749] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:08.183159  2905 consensus_queue.cc:1048] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 13:10:08.237383  2863 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:08.241149  2863 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:08.241374 30469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 1130) took 2126 ms. Trace:
I20260709 13:10:08.241801 30469 rpcz_store.cc:276] 0709 13:10:06.114823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.117885 (+  3062us) service_pool.cc:224] Handling call
0709 13:10:06.260077 (+142192us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:06.338437 (+ 78360us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.241193 (+1902756us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b5400175cd0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f678ad 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:10:08.241320 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":252765056}
W20260709 13:10:08.244329 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:08.248031 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 107823us
I20260709 13:10:08.249573  2936 raft_consensus.cc:2749] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:08.249763 30590 leader_election.cc:304] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:08.250211  2936 consensus_queue.cc:1048] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:08.251439  2720 raft_consensus.cc:2749] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:08.254107 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:08.256217 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:08.257033 30616 raft_consensus.cc:2393] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 12: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:10:08.257429  2912 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:08.257728 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:08.258944 30621 raft_consensus.cc:1275] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:10:08.259311 30621 pending_rounds.cc:85] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79: Aborting all ops after (but not including) 7
I20260709 13:10:08.259511 30621 pending_rounds.cc:107] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:10:08.259732 30621 raft_consensus.cc:2889] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:08.260617 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:08.261063  2884 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:08.261301 30546 raft_consensus.cc:2393] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 12: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:08.261685 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:08.261606  2884 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:08.264554 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:08.264858 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:08.265098 30549 raft_consensus.cc:3060] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:08.265539 31116 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:08.266750 30550 raft_consensus.cc:1275] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:08.272156  2863 consensus_queue.cc:1048] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:08.272586  2966 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.273074  2966 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:08.275424  2966 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:08.277181  2944 raft_consensus.cc:2804] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:08.277724  2944 raft_consensus.cc:697] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 14 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:08.278570  2944 consensus_queue.cc:237] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:08.281205 30472 raft_consensus.cc:1275] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:08.282591 30473 raft_consensus.cc:1275] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:10:08.283624 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:08.285168  2884 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:10:08.206713 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.292064 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:08.292761 30623 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 13.
I20260709 13:10:08.294821 30542 raft_consensus.cc:1240] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:08.300185 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:08.302047 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:08.302676 30625 raft_consensus.cc:3060] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:08.306272 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:08.307627 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:08.308456 30623 raft_consensus.cc:2468] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 11.
I20260709 13:10:08.224459 30441 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:08.318046 30549 raft_consensus.cc:2468] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 10.
I20260709 13:10:08.226649 30543 raft_consensus.cc:2468] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 13.
I20260709 13:10:08.320065 30440 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:08.323460 30551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39952 (request call id 2303) took 1739 ms. Trace:
I20260709 13:10:08.323957 30551 rpcz_store.cc:276] 0709 13:10:06.584483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.591724 (+  7241us) service_pool.cc:224] Handling call
0709 13:10:08.286469 (+1694745us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54000dd254. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:10:08.323400 (+ 36931us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2941094784}
I20260709 13:10:08.325630 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:08.321079  2884 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:08.330030 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:08.326355 30617 raft_consensus.cc:2468] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 11.
I20260709 13:10:08.334159 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:08.330389 31116 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:08.339643 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:08.373435 30623 raft_consensus.cc:2393] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 14: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:10:08.330205  2884 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:08.376869 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 86440.7us
I20260709 13:10:08.378237 31115 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:10:08.379304 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 59354.8us
I20260709 13:10:08.383183 30622 raft_consensus.cc:2468] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 12.
I20260709 13:10:08.376271  2373 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:08.385360  2373 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:08.385913  2884 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:10:08.331274  3015 log.cc:927] Time spent T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
W20260709 13:10:08.397723 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 67412.9us
I20260709 13:10:08.414222 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:08.402557  2790 raft_consensus.cc:2749] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:08.422979  3068 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.444474 30625 raft_consensus.cc:2468] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 10.
I20260709 13:10:08.444772  3068 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:08.445645 31115 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:08.446410  2790 raft_consensus.cc:2804] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:08.446727 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:08.446915  3068 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:08.376276  2982 consensus_queue.cc:1048] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 13:10:08.448019 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:08.449044 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:08.390977  3021 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:08.450011 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:08.450994 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:08.391769  3071 raft_consensus.cc:2804] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:08.453037 30470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 2170) took 1260 ms. Trace:
I20260709 13:10:08.453488 30470 rpcz_store.cc:276] 0709 13:10:07.192120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.192238 (+   118us) service_pool.cc:224] Handling call
0709 13:10:07.192503 (+   265us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:07.954756 (+762253us) spinlock_profiling.cc:243] Waited 7.91 ms on lock 0x7b180039e260. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc783b104bc 00007fc780e5e48b 00007fc789cb8ab9 00007fc780e7a69b 00007fc780e7893f 00007fc780e78455 00007fc783f60060 00007fc783f60bfb 00007fc783f6b64b
0709 13:10:07.954917 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:07.954955 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:07.955540 (+   585us) log.cc:844] Serialized 26 byte log entry
0709 13:10:08.111422 (+155882us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:08.111472 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.111568 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:08.452695 (+341127us) raft_consensus.cc:1685] finished
0709 13:10:08.452724 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.452969 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":27168,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":76346,"spinlock_wait_cycles":18195200,"thread_start_us":267448,"threads_started":2,"wal-append.queue_time_us":367035}
I20260709 13:10:08.432510 30617 raft_consensus.cc:2410] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 13:10:08.461485 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 80281.5us
W20260709 13:10:08.462932 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 238520us
I20260709 13:10:08.465150 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:08.465297 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:08.466799 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:10:08.467788  3041 log.cc:927] Time spent T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:10:08.472713  3071 raft_consensus.cc:697] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 13 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:08.390833  2868 consensus_queue.cc:1048] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:10:08.474520  3071 consensus_queue.cc:237] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:08.472398  2870 consensus_queue.cc:1059] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:10:08.475461 31148 raft_consensus.cc:1240] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 12. Current term is 13. Ops: [10.10-12.11]
I20260709 13:10:08.487649 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:08.488341 31143 raft_consensus.cc:2468] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 12.
I20260709 13:10:08.501926 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:08.340559  2863 consensus_queue.cc:1048] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.123s
I20260709 13:10:08.446940  2790 raft_consensus.cc:697] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 10 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:08.473026  2969 raft_consensus.cc:2749] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:08.509300 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:08.519724 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:08.520083 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:08.520884 30474 raft_consensus.cc:2468] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 7.
I20260709 13:10:08.518428 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:08.521452 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:08.525482 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:08.490980  2750 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:08.530977 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:08.539336 30473 raft_consensus.cc:2468] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 12.
I20260709 13:10:08.534557 30467 raft_consensus.cc:1275] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:10:08.540859 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:08.539740 30617 raft_consensus.cc:2393] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 10: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:10:08.541632 30467 raft_consensus.cc:2368] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 15. Current term is 16.
I20260709 13:10:08.510524 30543 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 15.
I20260709 13:10:08.491582  2912 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:08.538498 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:08.545849 30471 raft_consensus.cc:2468] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 12.
I20260709 13:10:08.546975 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:08.548036 30471 raft_consensus.cc:2393] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 13: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:10:08.549039 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:08.549329 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:08.511277  2884 raft_consensus.cc:3055] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:08.549587 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:08.551260 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:08.556919 30475 raft_consensus.cc:2393] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 16: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:08.552873 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:08.554332 30467 raft_consensus.cc:1275] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:08.558838 30471 raft_consensus.cc:2468] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 12.
I20260709 13:10:08.522466  3065 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
W20260709 13:10:08.562842 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.562098 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:08.564366 30617 raft_consensus.cc:2410] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:10:08.565060 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:08.565567 30617 raft_consensus.cc:2468] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 12.
I20260709 13:10:08.565863 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:08.555579  2715 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:08.577235 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:08.578624 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:08.584584 30549 raft_consensus.cc:1240] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 12. Current term is 13. Ops: [10.6-12.7]
I20260709 13:10:08.586825 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:08.587468 30549 raft_consensus.cc:2368] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 13. Current term is 14.
I20260709 13:10:08.588867 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:08.589515 30549 raft_consensus.cc:2393] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 13: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:10:08.589589 30551 raft_consensus.cc:1240] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:08.590050 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:08.590682 30550 raft_consensus.cc:1240] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:08.593806 30546 raft_consensus.cc:1240] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:08.556044  2884 raft_consensus.cc:740] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:08.605362 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:08.606094 30549 raft_consensus.cc:2393] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 10: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:10:08.596966 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:08.609838 30549 raft_consensus.cc:1275] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:08.612175 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:08.613040 30549 raft_consensus.cc:2368] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 12. Current term is 13.
I20260709 13:10:08.615386 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:08.617120 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:08.617694 30550 raft_consensus.cc:2468] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 12.
I20260709 13:10:08.619381 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:08.615589 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:08.620206 30550 raft_consensus.cc:2393] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 15: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:08.615543 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:08.620814 30546 raft_consensus.cc:3060] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:08.556671  2912 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:08.622246 30474 raft_consensus.cc:2393] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 15: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:08.606534  2910 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:08.628120 30517 leader_election.cc:304] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:08.634003 30517 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:08.638536 30475 raft_consensus.cc:1275] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:08.640467 30517 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:08.593129  2715 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:08.643359 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:08.582937  3065 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:08.652565 30546 raft_consensus.cc:2468] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 13.
I20260709 13:10:08.608991  2918 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:08.668309 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:08.669341 30546 raft_consensus.cc:2393] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 15: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
W20260709 13:10:08.674744 30589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.653623  2848 raft_consensus.cc:2804] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:08.642133  2479 raft_consensus.cc:2749] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:08.641835  2911 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:10:08.848692 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.614266  2790 consensus_queue.cc:237] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:08.834266 30470 raft_consensus.cc:1240] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:08.661996  3073 raft_consensus.cc:493] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.672663  2967 raft_consensus.cc:2804] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:08.917454 30624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36130 (request call id 2179) took 2094 ms. Trace:
I20260709 13:10:08.657835  2723 consensus_queue.cc:1048] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.181s
I20260709 13:10:08.937254 30624 rpcz_store.cc:276] 0709 13:10:06.823356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.823486 (+   130us) service_pool.cc:224] Handling call
0709 13:10:06.823801 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:07.698860 (+875059us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.911002 (+1212142us) spinlock_profiling.cc:243] Waited 860 ms on lock 0x7b54002df0d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:10:08.917389 (+  6387us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1977514368}
I20260709 13:10:08.683990  2848 raft_consensus.cc:493] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:08.975906 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 334988us
I20260709 13:10:08.976666 30517 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:08.963310 30624 raft_consensus.cc:1240] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:08.951947 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:08.936185  2967 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.936430  2910 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:08.654072  2884 consensus_queue.cc:260] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:08.950212  3070 log.cc:927] Time spent T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.433s	user 0.001s	sys 0.001s
I20260709 13:10:08.975708  2848 raft_consensus.cc:3060] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:09.008021 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:09.013607 30546 raft_consensus.cc:2468] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 15.
I20260709 13:10:09.009660 30549 raft_consensus.cc:1240] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 11 LEADER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:09.016670 30550 raft_consensus.cc:1275] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:08.991832  2967 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:09.030615 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 243925us
I20260709 13:10:08.945202  3073 raft_consensus.cc:515] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:08.932859  2911 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:09.045080 30441 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
W20260709 13:10:09.058465 30361 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 2b207fb799ce4340b29ae053898e0e6c with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica f639301059e24dc5b0d88a46dc683326 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
W20260709 13:10:09.066565 30361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 429655us
W20260709 13:10:09.035946  3079 log.cc:927] Time spent T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.428s	user 0.001s	sys 0.000s
I20260709 13:10:09.005754  2910 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:09.077296 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:09.076272  3076 log.cc:927] Time spent T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.451s	user 0.000s	sys 0.001s
I20260709 13:10:09.087010 30589 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
W20260709 13:10:09.083742  2732 consensus_meta.cc:287] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.947s	user 0.011s	sys 0.000s
I20260709 13:10:09.078611  3055 raft_consensus.cc:2749] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:09.093683 30589 leader_election.cc:400] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 13. Current term is 14.
I20260709 13:10:09.094801  2910 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:09.096808  3099 raft_consensus.cc:2749] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:09.097577  3080 log.cc:927] Time spent T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
W20260709 13:10:09.103037  3021 consensus_meta.cc:287] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.653s	user 0.006s	sys 0.003s
I20260709 13:10:09.107864  3073 leader_election.cc:290] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:09.111064 31151 raft_consensus.cc:2468] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 7.
I20260709 13:10:09.113603  2966 raft_consensus.cc:2804] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:09.085240  3065 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:09.089655  2715 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:09.138777  2966 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.139246  2966 raft_consensus.cc:3060] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:09.111552  2727 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.140211  2727 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:09.140621 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:09.141173 30623 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 15.
I20260709 13:10:09.142189  2727 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:09.142689  2727 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.143131  2727 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:09.096835 30650 heartbeater.cc:646] Failed to heartbeat to 127.28.173.62:33437 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.28.173.62:33437 timed out after 15.000s (SENT)
I20260709 13:10:09.109225  2912 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:09.147224 30440 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:09.123008  2866 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:09.153036 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.124675  2905 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:09.136317  3021 raft_consensus.cc:2749] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:09.148859  3038 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.152652  2969 raft_consensus.cc:2804] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:10:09.151472  2870 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.000s	sys 0.012s
I20260709 13:10:09.130268  2732 consensus_queue.cc:1048] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:10:09.148362  3099 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.151322  2918 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:10:09.163255  2870 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.000s	sys 0.013s
W20260709 13:10:09.174710 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 129737us
I20260709 13:10:09.216163 30441 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:09.162037  2969 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:09.222407 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 211347us
I20260709 13:10:09.155558  2866 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:09.221616 30441 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:09.229264 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:09.159965  2905 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:09.220234  2918 raft_consensus.cc:2749] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:09.220512  2969 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:09.164037  3038 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:09.229784  3088 log.cc:927] Time spent T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:10:09.242630 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 168737us
W20260709 13:10:09.251602  3086 log.cc:927] Time spent T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.319s	user 0.001s	sys 0.001s
I20260709 13:10:09.230261  2911 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:09.171777  3099 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:09.357923  3099 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:09.233444  3065 raft_consensus.cc:2804] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:09.358522  3065 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:09.358934  3065 raft_consensus.cc:3060] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:09.362471  2884 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:09.284224  2877 consensus_meta.cc:287] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 1.150s	user 0.015s	sys 0.003s
I20260709 13:10:09.287890  2905 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:09.371377 30616 raft_consensus.cc:2410] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:10:09.373742 30616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47446 (request call id 2670) took 1118 ms. Trace:
I20260709 13:10:09.374115 30618 raft_consensus.cc:1275] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:10:09.374624 30618 pending_rounds.cc:85] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79: Aborting all ops after (but not including) 7
I20260709 13:10:09.374851 30618 pending_rounds.cc:107] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:10:09.375087 30618 raft_consensus.cc:2889] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:09.375941 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 91649.8us
I20260709 13:10:09.376384  2373 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:09.229553  2912 consensus_queue.cc:1059] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 13:10:09.380081  2912 consensus_queue.cc:1243] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer cd669586cff44d4bbfcc007e213faab6 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:10:09.381350  2912 raft_consensus.cc:3055] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:09.381677  2912 raft_consensus.cc:740] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:09.382226 30623 raft_consensus.cc:1275] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:09.382385  2912 consensus_queue.cc:260] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:09.291889  2727 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:09.300459  2866 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:09.306082  3038 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:09.307499 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:09.314497  2848 raft_consensus.cc:515] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:09.384785  2944 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.385345  2944 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:09.385885  2848 leader_election.cc:290] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:09.316919  2967 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:09.387943  2967 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:09.324153 30591 leader_election.cc:400] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 election: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 15. Current term is 16.
I20260709 13:10:09.388067  2944 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:09.344580  2969 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:09.347111 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 228612us
I20260709 13:10:09.388577 30591 leader_election.cc:403] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
W20260709 13:10:09.389106 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 65141.1us
I20260709 13:10:09.389380 30589 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
W20260709 13:10:09.351037 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 118891us
W20260709 13:10:09.384124 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.390111  2969 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 17 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:09.390717  2866 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:09.392159 30589 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:09.392278  2727 consensus_queue.cc:1059] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:09.393849  2727 raft_consensus.cc:2749] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:09.394179  3098 consensus_queue.cc:1059] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:09.394642  3112 raft_consensus.cc:2749] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:09.394909  3096 raft_consensus.cc:3055] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:09.395352  3096 raft_consensus.cc:740] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:09.338735  2966 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:09.396252  3112 consensus_queue.cc:1048] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:09.396142  3096 consensus_queue.cc:260] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:09.396610  3098 raft_consensus.cc:3055] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:09.397063  3098 raft_consensus.cc:740] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:09.397305 30589 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:10:09.397508  3096 raft_consensus.cc:3060] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:09.397543  2966 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:09.397843  3098 consensus_queue.cc:260] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:09.398360  3062 raft_consensus.cc:2804] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:09.398849  3062 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.398922 30589 leader_election.cc:400] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 12. Current term is 13.
I20260709 13:10:09.399272 30589 leader_election.cc:403] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:09.399245  3062 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:09.399533  3098 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:09.400285  2905 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:09.400755  2905 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:09.401746  3099 raft_consensus.cc:3060] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:10:09.402734  2905 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:09.403584 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:09.404184 30475 raft_consensus.cc:2468] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 11.
I20260709 13:10:09.356230 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:09.408587  3099 raft_consensus.cc:2749] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 12. Current term is 13.
I20260709 13:10:09.409219  3113 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.411473  2905 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.415148  3113 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:09.415227  2905 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:09.407995  2866 raft_consensus.cc:2749] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 15. Current term is 16.
I20260709 13:10:09.410848 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:10:09.419396  3075 log.cc:927] Time spent T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.738s	user 0.000s	sys 0.001s
I20260709 13:10:09.422740 31142 raft_consensus.cc:2468] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 12.
I20260709 13:10:09.413743  3062 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:09.423842 30620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 1120) took 1263 ms. Trace:
I20260709 13:10:09.424886 30441 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:09.424240 30620 rpcz_store.cc:276] 0709 13:10:08.160176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.160328 (+   152us) service_pool.cc:224] Handling call
0709 13:10:08.160644 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:08.160958 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:08.160986 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:08.161417 (+   431us) log.cc:844] Serialized 26 byte log entry
0709 13:10:08.567591 (+406174us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:08.567646 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.567731 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:09.418726 (+850995us) spinlock_profiling.cc:243] Waited 3.62 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:10:09.423564 (+  4838us) raft_consensus.cc:1685] finished
0709 13:10:09.423589 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:09.423775 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1640,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":1944,"spinlock_wait_cycles":8327040,"thread_start_us":405737,"threads_started":1,"wal-append.queue_time_us":462064}
W20260709 13:10:09.421288 30516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.426028  3055 raft_consensus.cc:2804] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:09.426466  3055 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:09.426842  3055 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:09.427415  2905 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:09.408953 30589 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:09.429571 30589 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:10:09.431066  3106 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.431473 30622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 1126) took 1044 ms. Trace:
I20260709 13:10:09.431975  3104 raft_consensus.cc:2804] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:09.432498  3104 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:09.432627 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:09.432886  3104 raft_consensus.cc:3060] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:09.433218 31150 raft_consensus.cc:2468] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 13.
I20260709 13:10:09.433370  2732 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.431937 30622 rpcz_store.cc:276] 0709 13:10:08.387565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.430716 (+1043151us) service_pool.cc:224] Handling call
0709 13:10:09.431016 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.431187 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.431211 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:09.431249 (+    38us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:09.431278 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.431330 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:09.431422 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:09.430119  3099 raft_consensus.cc:2749] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:09.432281  2720 consensus_queue.cc:1048] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:09.435398 30472 raft_consensus.cc:1240] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 16 LEADER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:09.436553 30472 raft_consensus.cc:1240] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 17 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 15. Current term is 17. Ops: []
I20260709 13:10:09.438658  3101 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.439227 30468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 2177) took 2145 ms. Trace:
I20260709 13:10:09.439129  3101 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:09.439582 30468 rpcz_store.cc:276] 0709 13:10:07.293729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.572451 (+278722us) service_pool.cc:224] Handling call
0709 13:10:07.590856 (+ 18405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:07.718714 (+127858us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:07.744203 (+ 25489us) log.cc:844] Serialized 14 byte log entry
0709 13:10:07.912388 (+168185us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b180032cbc0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e5de07 00007fc789cb8ab9 00007fc780e7a69b 00007fc780e7893f 00007fc780e7ac02 00007fc783b0220b 00007fc783b07d23 00007fc783b0823a 00007fc783f72a2a
0709 13:10:08.524212 (+611824us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:08.524271 (+    59us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:08.524309 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.439032 (+914723us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b5400175cd4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:10:09.439074 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:09.439178 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":24693,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":41,"raft.queue_time_us":151712,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":22722,"spinlock_wait_cycles":295800576,"thread_start_us":611586,"threads_started":2,"wal-append.queue_time_us":348406,"wal-append.run_cpu_time_us":985,"wal-append.run_wall_time_us":1001696}
I20260709 13:10:09.441157  3101 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:09.441699 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:09.442287 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:09.442548 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:09.442885 30546 raft_consensus.cc:2468] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 12.
I20260709 13:10:09.443162 30622 raft_consensus.cc:2468] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 13.
I20260709 13:10:09.440848 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:09.445463 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:09.446147 30620 raft_consensus.cc:2393] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 12: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:10:09.447515 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:09.431560  3106 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:09.449138 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:10:09.449702  3090 log.cc:927] Time spent T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.360s	user 0.000s	sys 0.001s
I20260709 13:10:09.450026  3106 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:10:09.453094 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 476475us
I20260709 13:10:09.456184 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:09.457803 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:09.459358 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:09.461613 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:09.462152 30619 raft_consensus.cc:3060] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:09.462318 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:09.433856  2732 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:09.452561  3055 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:09.374096 30616 rpcz_store.cc:276] 0709 13:10:08.255641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.257507 (+  1866us) service_pool.cc:224] Handling call
0709 13:10:09.373524 (+1116017us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54002c8654. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:10:09.373681 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2558961024}
I20260709 13:10:09.468636 30619 raft_consensus.cc:2468] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 14.
I20260709 13:10:09.472575 30546 raft_consensus.cc:1275] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:10:09.596163 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.417518  3113 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:10:09.592460 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:09.593335 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 119240us
I20260709 13:10:09.598006 30589 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:09.383570  2912 raft_consensus.cc:3060] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:09.600966 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 129215us
W20260709 13:10:09.602921 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 148654us
I20260709 13:10:09.604202 30517 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:09.611402 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:09.612659 30546 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:09.607461 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 139038us
I20260709 13:10:09.601954 31116 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:09.623617 30550 raft_consensus.cc:1275] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:10:09.625938 30549 raft_consensus.cc:1275] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:10:09.626619 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:09.628890 30622 raft_consensus.cc:2393] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 13: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:10:09.634475 30546 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 16.
W20260709 13:10:09.635715 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 137750us
I20260709 13:10:09.617787 30516 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:10:09.619426  2918 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:09.637698  3038 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.654659  3038 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:09.638446  3101 consensus_queue.cc:1048] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:09.639091  2866 raft_consensus.cc:2804] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:09.596271  2996 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:09.608076  2969 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:09.649821 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:09.647007  2646 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:09.651872  3071 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.627772  3111 consensus_queue.cc:1048] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:10:09.680974 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:09.653731  2918 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:09.507639  2373 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.661124 30549 raft_consensus.cc:1275] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:09.686241 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:09.686910 30468 raft_consensus.cc:2468] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 12.
I20260709 13:10:09.592774  2905 raft_consensus.cc:493] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:09.394568  2727 consensus_queue.cc:1059] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.249s
I20260709 13:10:09.647714 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:09.669020 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:09.628949  3113 raft_consensus.cc:2804] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:09.629197  2848 raft_consensus.cc:2804] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:09.674562 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:09.648458  2715 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:09.623306  2966 consensus_queue.cc:1048] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:10:09.660061  2866 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.697636 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:09.702617 30550 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 15.
I20260709 13:10:09.709131 30470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 2195) took 1084 ms. Trace:
I20260709 13:10:09.709564 30470 rpcz_store.cc:276] 0709 13:10:08.625093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.625349 (+   256us) service_pool.cc:224] Handling call
0709 13:10:08.625636 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:08.926876 (+301240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.708896 (+782020us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b54002189d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:10:09.709068 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":479213952}
I20260709 13:10:09.711603 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:09.711365 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:09.715598 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:09.716727 30468 raft_consensus.cc:2410] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:10:09.717121 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:09.692569  2479 raft_consensus.cc:2764] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:10:09.718029 30470 raft_consensus.cc:3060] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Advancing to term 14
W20260709 13:10:09.719934 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 109714us
I20260709 13:10:09.695649  3113 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.728869 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:10:09.732770 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.735369 30550 raft_consensus.cc:2393] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 12: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:09.694885  2848 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:09.672247  2996 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:09.678467  2969 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:09.705186  2866 raft_consensus.cc:3060] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:09.742600 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:09.748153 30550 raft_consensus.cc:2468] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 12.
I20260709 13:10:09.692966  2917 consensus_queue.cc:1048] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:10:09.681605  2646 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:09.700408  2884 consensus_queue.cc:1059] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:10:09.705068  2715 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:09.695375  2373 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:09.735522  3113 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:09.756023 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:09.692066  3071 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:09.700543  2905 raft_consensus.cc:515] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:09.763001 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 144993us
I20260709 13:10:09.739286  3021 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:09.743903  2848 raft_consensus.cc:3060] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:09.760722 30468 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 15.
I20260709 13:10:09.761981 30472 raft_consensus.cc:2468] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 12.
I20260709 13:10:09.735597  2870 consensus_queue.cc:1059] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:10:09.779016 30470 raft_consensus.cc:2468] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 14.
I20260709 13:10:09.781308 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:09.783169 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:09.787191 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:09.791469 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:09.794864 30517 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:09.795579 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:09.805161 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:09.825703 30475 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:09.785969  2870 consensus_queue.cc:1243] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer f639301059e24dc5b0d88a46dc683326 log is divergent from this leader: its last log entry 16.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:10:09.786502  3038 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:10:09.828635 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 218794us
I20260709 13:10:09.845355  3038 consensus_queue.cc:1048] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:09.829936 30517 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:09.772835  3021 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:09.823171 30516 leader_election.cc:400] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Vote denied by peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453) with higher term. Message: Invalid argument: T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 13. Current term is 14.
I20260709 13:10:09.797832 30619 raft_consensus.cc:2468] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 12.
I20260709 13:10:09.788981  2720 raft_consensus.cc:493] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.836280 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:09.782665  3104 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:09.858518 30468 raft_consensus.cc:2468] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 8.
I20260709 13:10:09.788537  2966 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.791800  3062 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:09.797739  3123 raft_consensus.cc:3055] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:09.878544  2785 consensus_queue.cc:1059] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:09.851032  3126 raft_consensus.cc:2804] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:09.879384  2966 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:09.869841 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:09.880204  3126 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:09.880606  3126 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:09.880843 30546 raft_consensus.cc:2393] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 13: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:09.869174 30591 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:09.874197 30475 raft_consensus.cc:2468] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 13.
I20260709 13:10:09.857170  3083 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.876935 30468 raft_consensus.cc:1275] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:09.875399  2720 raft_consensus.cc:515] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:09.878635  3123 raft_consensus.cc:740] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
W20260709 13:10:09.867178 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 103510us
I20260709 13:10:09.826654  3111 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:09.858769  2479 raft_consensus.cc:2804] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:09.879570  2785 raft_consensus.cc:3055] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:09.909112 30516 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:10:09.875116  2866 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:09.874261  2848 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:09.883226  2732 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:09.892108  3129 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.908646  2918 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:09.922042  3128 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.939921  2969 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:09.975267  3128 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:09.976950 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:09.978042  3128 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:09.978197 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:09.923789  2785 raft_consensus.cc:740] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:09.979416 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:09.941752  3104 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:09.909657  3132 consensus_queue.cc:1048] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 13:10:09.928556  3110 raft_consensus.cc:2804] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:09.923704  3111 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:09.944542  3098 consensus_meta.cc:287] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.541s	user 0.005s	sys 0.013s
I20260709 13:10:09.944696  2646 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:09.936151  3129 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:09.946035  2720 leader_election.cc:290] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:09.946326  2905 leader_election.cc:290] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:10:09.947016  3096 consensus_meta.cc:287] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.549s	user 0.010s	sys 0.000s
I20260709 13:10:09.948005  3126 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:09.951891  3124 log.cc:927] Time spent T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
W20260709 13:10:09.952630  3120 log.cc:927] Time spent T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:10:09.907655  3083 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:09.954753  3121 log.cc:927] Time spent T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 13:10:09.955235  3055 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:09.956552  3021 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:09.966173  3139 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.973079  3071 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:09.973927  3123 consensus_queue.cc:260] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:09.923593  3133 raft_consensus.cc:2749] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:09.999059  3111 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:10:09.999668  3089 log.cc:927] Time spent T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.941s	user 0.000s	sys 0.004s
I20260709 13:10:09.991714  3110 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:10.010301  3110 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:10.009752  3139 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:10.013604  3126 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:10.014420  3139 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:10.015419  3083 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:09.985224  3113 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:10.017751  3074 log.cc:927] Time spent T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 1.358s	user 0.000s	sys 0.002s
I20260709 13:10:10.018584  3113 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:10.022198  3129 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:10:10.061056 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 276300us
I20260709 13:10:10.062134 30550 raft_consensus.cc:1240] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 12. Current term is 13. Ops: []
W20260709 13:10:10.065825 30589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:10.065990 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.063308 30440 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:10.076965 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:10.077311 30591 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:09.972744 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:09.986810 30618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47446 (request call id 2687) took 1420 ms. Trace:
I20260709 13:10:10.080601 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:10.081247 30619 raft_consensus.cc:2368] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 13. Current term is 14.
I20260709 13:10:10.080819 30618 rpcz_store.cc:276] 0709 13:10:08.566324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.985958 (+419634us) service_pool.cc:224] Handling call
0709 13:10:09.373672 (+387714us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.375510 (+  1838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.986668 (+611158us) spinlock_profiling.cc:243] Waited 387 ms on lock 0x7b54002c8650. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f678ad 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:10:09.986765 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":890321152}
I20260709 13:10:10.083272 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:10.083389 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:10.084617 30619 raft_consensus.cc:2393] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 9: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:10:10.085170 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:10.085808 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:10.086128 30546 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 14.
I20260709 13:10:10.087035 30619 raft_consensus.cc:2410] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:10:10.088373 30440 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:09.982088 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:10.089841 30620 raft_consensus.cc:3060] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:10.090834 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:10.091763 30623 raft_consensus.cc:1275] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:10.092913 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:10.081719 30551 raft_consensus.cc:3060] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:10.093691 30623 raft_consensus.cc:2468] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 12.
I20260709 13:10:10.094727 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:10.096102 30623 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 15.
I20260709 13:10:10.097162 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:09.973631 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:09.972920 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:10.099095 30624 raft_consensus.cc:2468] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 10.
I20260709 13:10:10.105743 30545 raft_consensus.cc:1240] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:10.106479 30620 raft_consensus.cc:2468] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 9.
I20260709 13:10:10.145574 30543 raft_consensus.cc:2468] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 15.
I20260709 13:10:10.112402 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:10.113579 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:10:10.116307 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 44677.8us
I20260709 13:10:09.952044 31115 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:10:09.950279 31151 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48412 (request call id 882) took 1483 ms (client timeout 1688 ms). Trace:
I20260709 13:10:10.119091 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:10.119757 30625 raft_consensus.cc:2468] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 13.
I20260709 13:10:09.953503  2715 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:10.120329 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:10.120755  2723 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.254276  2715 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.254396  2723 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:10.255122  2715 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:09.979934  2785 consensus_queue.cc:260] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:09.968204  2866 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:09.963478  2373 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:10.121521 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:10.123158  2910 raft_consensus.cc:2804] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:10.123406 31147 raft_consensus.cc:1275] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:10:09.966226  2884 raft_consensus.cc:493] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.281919  2884 raft_consensus.cc:515] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:09.940402  2996 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:10.121686  2479 raft_consensus.cc:697] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 14 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:10.125867 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:10.286309  2479 consensus_queue.cc:237] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:10.287508 31150 raft_consensus.cc:2468] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 13.
I20260709 13:10:10.125982  3108 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.290539  3108 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:10.293475  3108 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:10.126247  3127 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:10.294514  2966 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:10.119140 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:10.294611  3127 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:10.000598  3065 consensus_meta.cc:287] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.641s	user 0.012s	sys 0.008s
I20260709 13:10:10.299499  3065 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:10.301812 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:10.302187  2994 raft_consensus.cc:3060] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:10.302605  3065 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:10.302614 30475 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:10.130419 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.177763  3111 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.305342 30591 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:10.305157  3111 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:10.306608  2866 raft_consensus.cc:2804] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:10.307245  2866 raft_consensus.cc:697] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:10.307894  3111 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:10.180238  3149 raft_consensus.cc:2804] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:10.308669  3149 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.308553  2866 consensus_queue.cc:237] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:10.184289  3151 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:10.309942  3151 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:10.310276  3127 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:10.185277  3152 consensus_queue.cc:1059] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:10.312328  2884 leader_election.cc:290] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:10.313150 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:10.189558  3123 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:10:10.314038 30616 raft_consensus.cc:2393] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 14: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:10:10.314858 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:10.315357 30616 raft_consensus.cc:2376] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 13. Re-sending same reply.
I20260709 13:10:10.191067 30621 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 16.
I20260709 13:10:10.193663  3126 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.194695  3071 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.321349  3071 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:10.196082  3129 consensus_queue.cc:1048] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:10.198491  2848 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:10.327941 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:10.328289  2881 raft_consensus.cc:3060] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:10.328922 30474 raft_consensus.cc:2393] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 15: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:10.329803 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:10.200536  3130 raft_consensus.cc:493] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:10.331782 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:10.332715 30474 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:10.228432  3142 raft_consensus.cc:2749] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:10.229519  3148 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:10.231395 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:10.334239 30473 raft_consensus.cc:2468] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 15.
I20260709 13:10:10.333992  3148 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:10.335237 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:10.336501  3148 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:10.248313  3147 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.336556 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:10:10.232275 31151 rpcz_store.cc:269] 0709 13:10:08.466459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.466586 (+   127us) service_pool.cc:224] Handling call
0709 13:10:09.950121 (+1483535us) spinlock_profiling.cc:243] Waited 644 ms on lock 0x7b54004cc054. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:10:09.950222 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1480242560}
I20260709 13:10:10.257359  2723 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:09.965468  2727 raft_consensus.cc:3055] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:10.254417 31143 raft_consensus.cc:2368] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 12. Current term is 13.
W20260709 13:10:10.258404 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 306291us
I20260709 13:10:10.258921  3150 raft_consensus.cc:2804] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:10.261415 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:10.262243 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:10.264599 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:10.270707 30542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43088 (request call id 2368) took 2095 ms. Trace:
W20260709 13:10:10.271250 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.271292 30589 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:10.275671 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:10.305598  2785 raft_consensus.cc:3060] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:10.309046  2910 raft_consensus.cc:697] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 16 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:10.309175  3149 raft_consensus.cc:3060] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:10.362248 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:10.180960  3096 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:10.363257  3096 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:10.364521 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:10.365062 30623 raft_consensus.cc:2376] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 13. Re-sending same reply.
I20260709 13:10:10.365648  3096 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:10.365906 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:10.183562 30551 raft_consensus.cc:2468] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 13.
I20260709 13:10:10.366586 30623 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 13.
I20260709 13:10:10.320214 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:10.357329 30542 rpcz_store.cc:276] 0709 13:10:08.172932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.174256 (+  1324us) service_pool.cc:224] Handling call
0709 13:10:08.174625 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:08.295302 (+120677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.239575 (+1944273us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54003386d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:10:10.268107 (+ 28532us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":275833216}
I20260709 13:10:10.363464 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:10.332229  3130 raft_consensus.cc:515] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:10.216089 30440 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:10.336257  3126 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:10.250092 30441 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.173.3:32851 timed out after 1.619s (SENT) [suppressed 23 similar messages]
I20260709 13:10:10.337994 30473 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 12.
I20260709 13:10:10.339730 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:10:10.339536 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 346325us
I20260709 13:10:10.355804 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:10.357815 30472 raft_consensus.cc:2468] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 11.
I20260709 13:10:10.311573 30471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 1177) took 1313 ms. Trace:
I20260709 13:10:10.371987 30471 rpcz_store.cc:276] 0709 13:10:08.997798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.004006 (+  6208us) service_pool.cc:224] Handling call
0709 13:10:09.004390 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.146704 (+142314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.146731 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:09.146768 (+    37us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:09.146795 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.311012 (+1164217us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b540011e254. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:10:10.311108 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.311375 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":326867712}
I20260709 13:10:10.367506 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:10:10.374217 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 124298us
I20260709 13:10:10.377380 30516 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:10:10.377440  3160 consensus_queue.cc:1048] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:10:10.379624 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 109652us
I20260709 13:10:10.380081  2917 raft_consensus.cc:2804] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:10.401327  2917 raft_consensus.cc:697] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:10.402401  2917 consensus_queue.cc:237] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:10.403981 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 295357us
I20260709 13:10:10.404683  2870 consensus_queue.cc:1059] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:10.405977  2870 raft_consensus.cc:3055] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:10.406009 30440 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:10.406256 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:10.406494  2870 raft_consensus.cc:740] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:10.371629  2727 raft_consensus.cc:740] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:10.407954  3126 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:10.408385  2727 consensus_queue.cc:260] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:10.409675 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:10.410315  2727 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:10.383445 30616 raft_consensus.cc:2368] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 13. Current term is 14.
I20260709 13:10:10.412828  3146 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:10.413394 30616 raft_consensus.cc:1275] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:10.413560  3146 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:10.416551  2863 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.417079  2863 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:10.419234  2863 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:10.385006 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:10.337385  3147 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:10.420323  3146 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:10.396399  2910 consensus_queue.cc:237] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:10.397095  3110 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:10.397881 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:10.398214 30617 raft_consensus.cc:1275] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:10:10.371672 30468 raft_consensus.cc:3060] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:10.408705 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:10.408778  3151 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:10:10.360265 30469 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.009s	sys 0.014s
I20260709 13:10:10.419736 31116 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:10.356858  3150 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.421693 30625 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 13.
I20260709 13:10:10.369385 30624 raft_consensus.cc:2410] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:10:10.444083  3126 raft_consensus.cc:2764] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:10:10.444451 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:10.445822 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:10.444255  3062 raft_consensus.cc:493] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.448207  3062 raft_consensus.cc:515] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:10.449126  3147 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:10.449198 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:10:10.450273 30441 leader_election.cc:336] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453): Timed out: RequestConsensusVote RPC to 127.28.173.4:34453 timed out after 1.688s (SENT)
I20260709 13:10:10.450811 30441 leader_election.cc:304] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:10.452857 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:10.453945  3132 raft_consensus.cc:2749] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:10.454231 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:10.447793 30371 catalog_manager.cc:5697] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:10.458741 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:10.458160 30371 catalog_manager.cc:5697] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 9 to 12, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 12 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
I20260709 13:10:10.460142 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:10.461217 30472 raft_consensus.cc:2410] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
W20260709 13:10:10.461817 30370 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57546 (request call id 307) took 16631 ms (client timeout 15000 ms). Trace:
I20260709 13:10:10.462204 30473 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 14.
I20260709 13:10:10.462538  2715 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:10.411665 30516 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:10:10.464934 30469 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.010s	sys 0.015s
I20260709 13:10:10.461036 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:10.465693 30616 raft_consensus.cc:2468] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 10.
I20260709 13:10:10.446916 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:10.467525 30621 raft_consensus.cc:2376] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 16. Re-sending same reply.
I20260709 13:10:10.453958 30441 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:10.464640  3150 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:10.481485 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:10.479260 30589 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:10.483106 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:10.483106 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:10.462177 30371 catalog_manager.cc:5697] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 7 to 13, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 13 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:10.489048 30623 raft_consensus.cc:2393] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 13: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:10:10.489110 30620 raft_consensus.cc:1275] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:10:10.489611 30620 pending_rounds.cc:85] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79: Aborting all ops after (but not including) 6
I20260709 13:10:10.407696  2870 consensus_queue.cc:260] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:10.536387  2870 raft_consensus.cc:3060] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:10.538175  2863 consensus_queue.cc:1048] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:10.541189  3110 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:10.543035  3149 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:10.545491  3149 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:10.482596  3142 consensus_queue.cc:1048] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:10:10.502501  2877 consensus_queue.cc:1048] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.122s
I20260709 13:10:10.560513 30623 raft_consensus.cc:1275] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:10.561592 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:10.562237 31143 raft_consensus.cc:3060] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:10.564015 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 219032us
I20260709 13:10:10.565694 31116 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:10.566747  3140 raft_consensus.cc:2804] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:10.567323  3140 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.508114 30547 raft_consensus.cc:2468] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9.
I20260709 13:10:10.509999  3071 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:10.512277 30616 raft_consensus.cc:1275] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:10:10.513389 30473 raft_consensus.cc:1275] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:10.520437 30469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 1178) took 1119 ms. Trace:
W20260709 13:10:10.521445 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 109924us
I20260709 13:10:10.523175 30617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47446 (request call id 2675) took 2134 ms. Trace:
I20260709 13:10:10.556170  3129 raft_consensus.cc:2804] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:10.556627 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:10.556977  3104 raft_consensus.cc:2804] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:10.549078 30620 pending_rounds.cc:107] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:10:10.577045 30617 rpcz_store.cc:276] 0709 13:10:08.389161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.584143 (+194982us) service_pool.cc:224] Handling call
0709 13:10:08.584460 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:10.421574 (+1837114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.522724 (+101150us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b540027f454. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:10:10.523071 (+   347us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4169880832}
I20260709 13:10:10.489688  3147 raft_consensus.cc:2749] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:10.507113  3130 leader_election.cc:290] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:10.580260 30620 raft_consensus.cc:2889] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:10.581756 30475 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 16.
I20260709 13:10:10.573115  3140 raft_consensus.cc:3060] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:10.594376 30474 raft_consensus.cc:2468] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 13.
I20260709 13:10:10.603736 30472 raft_consensus.cc:1240] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:10.580410  3129 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:10.606896 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:10.616214 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:10.617604 30517 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:10.618541  3147 raft_consensus.cc:2804] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:10.618984  3147 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:10.618978 30517 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:10.619575  3147 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:10.620033  2479 raft_consensus.cc:2804] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:10.620460  2479 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:10.620831  2479 raft_consensus.cc:3060] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:10.622604 30622 raft_consensus.cc:2468] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 11.
I20260709 13:10:10.622974 30591 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:10.623600  2944 raft_consensus.cc:2804] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:10.576524 30469 rpcz_store.cc:276] 0709 13:10:09.400682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.401471 (+   789us) service_pool.cc:224] Handling call
0709 13:10:09.401767 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.401943 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:09.671883 (+269940us) log.cc:844] Serialized 14 byte log entry
0709 13:10:10.489464 (+817581us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:10.519962 (+ 30498us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:10.520056 (+    94us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.520179 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.520368 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":237443,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":124290,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102,"thread_start_us":1049960,"threads_started":2}
I20260709 13:10:10.624060  2944 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:10.624444  2944 raft_consensus.cc:3060] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:10.624768 30516 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:10.624913 30371 catalog_manager.cc:5697] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 10 to 12, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 12 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
I20260709 13:10:10.613741  3129 raft_consensus.cc:3060] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:10.628986  3161 raft_consensus.cc:2749] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:10.632848 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.624804  3073 raft_consensus.cc:2764] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:10:10.640548  2981 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.640962  3147 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:10.641535 30514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.641402 30516 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:10.641149  2981 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:10.642885 30516 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:10.643942  3147 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:10.644193  2994 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:10.649056  2785 raft_consensus.cc:2804] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:10.649520  2785 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.649848  2785 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:10.651139  3130 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:10.651796  3130 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:10.462287 30370 rpcz_store.cc:269] 0709 13:09:53.829839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.829967 (+   128us) service_pool.cc:224] Handling call
0709 13:10:10.461576 (+16631609us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:01.723723 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:01.724432 (+   709us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:01.724483 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:10:01.724500 (+    17us) tablet.cc:662] Decoding operations
0709 13:10:01.992551 (+268051us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:02.007979 (+ 15428us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:02.008017 (+    38us) tablet.cc:685] Acquiring locks for 25 operations
0709 13:10:02.170016 (+161999us) tablet.cc:701] Row locks acquired
0709 13:10:02.170087 (+    71us) write_op.cc:260] PREPARE: finished
0709 13:10:02.170287 (+   200us) write_op.cc:270] Start()
0709 13:10:02.170440 (+   153us) write_op.cc:276] Timestamp: P: 1783602602170218 usec, L: 0
0709 13:10:02.170479 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 13:10:02.283366 (+112887us) log.cc:844] Serialized 9763 byte log entry
0709 13:10:02.608736 (+325370us) spinlock_profiling.cc:243] Waited 4.07 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc780e5e0ac 00007fc789cb8ab9 00007fc780e7a69b 00007fc780e7893f 00007fc780e7ac02 00007fc783b0220b
0709 13:10:02.890406 (+281670us) op_driver.cc:464] REPLICATION: finished
0709 13:10:03.282914 (+392508us) spinlock_profiling.cc:243] Waited 40.7 ms on lock 0x7b540008b954. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f63e28 00007fc78799e581 00007fc78799dd58 00007fc7879a29f1 00007fc7879a29a9 00007fc7879a2939 00007fc7879a2901 00007fc7879a1b2d 000000000038f354 000000000038f199
0709 13:10:03.547882 (+264968us) spinlock_profiling.cc:243] Waited 5.59 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc780e5e0ac 00007fc789cb8ab9 00007fc780e7a69b 00007fc780e7893f 00007fc780e7ac02 00007fc78799eef0
0709 13:10:03.764674 (+216792us) write_op.cc:301] APPLY: starting
0709 13:10:03.764794 (+   120us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:04.569414 (+804620us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:04.580824 (+ 11410us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:04.942998 (+362174us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:04.969141 (+ 26143us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=50,key_file_lookups=50,delta_file_lookups=50,mrs_lookups=0
0709 13:10:04.969218 (+    77us) write_op.cc:312] APPLY: finished
0709 13:10:05.059944 (+ 90726us) log.cc:844] Serialized 220 byte log entry
0709 13:10:05.333979 (+274035us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:05.360151 (+ 26172us) write_op.cc:454] Released schema lock
0709 13:10:05.360269 (+   118us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:05.374865 (+ 14596us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:05.379904 (+  5039us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":109833,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":822209,"apply.run_cpu_time_us":62313,"apply.run_wall_time_us":1596071,"cfile_cache_hit":102,"cfile_cache_hit_bytes":108677,"num_ops":25,"prepare.queue_time_us":275637,"prepare.run_cpu_time_us":31739,"prepare.run_wall_time_us":1579442,"raft.queue_time_us":126738,"raft.run_cpu_time_us":77448,"raft.run_wall_time_us":847883,"replication_time_us":711827,"spinlock_wait_cycles":117866368,"thread_start_us":1525265,"threads_started":5,"wal-append.queue_time_us":708257,"wal-append.run_cpu_time_us":20052,"wal-append.run_wall_time_us":2240052}]]}
I20260709 13:10:10.653995  3130 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:10.592160  3104 raft_consensus.cc:697] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
W20260709 13:10:10.654757 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 54485.7us
I20260709 13:10:10.644055  3110 raft_consensus.cc:2749] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:10.666841 30468 raft_consensus.cc:2468] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 13.
I20260709 13:10:10.675673 31143 raft_consensus.cc:2468] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 13.
I20260709 13:10:10.670578 30371 catalog_manager.cc:5697] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:10.700562  3140 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:10.703549  3140 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:10.703945  3153 raft_consensus.cc:493] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:10.704720  3153 raft_consensus.cc:515] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:10.678295  2863 consensus_queue.cc:1048] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:10:10.711002 30618 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 17.
I20260709 13:10:10.703946  3038 raft_consensus.cc:2764] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:10:10.733294  2479 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:10.731588 30441 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:10.736358 30467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 1174) took 2101 ms. Trace:
I20260709 13:10:10.733476  3130 consensus_queue.cc:1048] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:10:10.758127  2479 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:10.752961 30371 catalog_manager.cc:5697] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 5 to 9, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 9 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:10.740844 30467 rpcz_store.cc:276] 0709 13:10:08.635303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.635546 (+   243us) service_pool.cc:224] Handling call
0709 13:10:08.635868 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:08.661874 (+ 26006us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:08.661917 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:08.662581 (+   664us) log.cc:844] Serialized 26 byte log entry
0709 13:10:10.362699 (+1700118us) spinlock_profiling.cc:243] Waited 4 ms on lock 0x7b180046ed00. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e5de07 00007fc789cb8ab9 00007fc780e7a69b 00007fc780e7893f 00007fc780e7ac02 00007fc783b0220b 00007fc783b07d23 00007fc783b080d1 00007fc783f23a0f
0709 13:10:10.651994 (+289295us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:10.652034 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.652107 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:10.735899 (+ 83792us) raft_consensus.cc:1685] finished
0709 13:10:10.735921 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.736153 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25515,"raft.queue_time_us":25645,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":4479,"spinlock_wait_cycles":9200384,"thread_start_us":224061,"threads_started":1,"wal-append.queue_time_us":2071586}
I20260709 13:10:10.784418  3130 raft_consensus.cc:2749] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:10.804065 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:10.805119 30551 raft_consensus.cc:2393] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 12: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:10.792892 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:10.806339 30550 raft_consensus.cc:2410] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:10:10.810909 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:10.796857 30371 catalog_manager.cc:5697] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 7 to 8, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 8 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
I20260709 13:10:10.774699  3150 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:10.815251 30547 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43088 (request call id 2369) took 2516 ms (client timeout 2047 ms). Trace:
I20260709 13:10:10.816203 31116 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:10.816960  3150 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:10:10.815922 30547 rpcz_store.cc:269] 0709 13:10:08.298453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.306062 (+  7609us) service_pool.cc:224] Handling call
0709 13:10:10.814983 (+2508921us) spinlock_profiling.cc:243] Waited 2.18 s on lock 0x7b54002f12d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:10:10.815150 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5012952832}
I20260709 13:10:10.818140 30549 raft_consensus.cc:2468] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 10.
W20260709 13:10:10.828078 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 96609.9us
W20260709 13:10:10.831489 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 102970us
I20260709 13:10:10.844447  3021 consensus_queue.cc:1048] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.092s
I20260709 13:10:10.844937  2965 consensus_queue.cc:1048] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:10:10.847877  3106 raft_consensus.cc:493] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.848767  3106 raft_consensus.cc:515] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:10.851260 30441 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
W20260709 13:10:10.842888 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 109726us
I20260709 13:10:10.857699 30619 raft_consensus.cc:1275] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:10:10.842900 30371 catalog_manager.cc:5697] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 7 to 10, leader changed from cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 10 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:10.796099  3104 consensus_queue.cc:237] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:10.864940  3150 raft_consensus.cc:2804] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:10.873872 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:10.843767  3142 consensus_queue.cc:1048] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:10:10.850736  2917 consensus_queue.cc:1048] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:10:10.877869 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:10.879164 30547 raft_consensus.cc:2393] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 13: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:10.886868 30516 leader_election.cc:304] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:10:10.888000 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 45932us
I20260709 13:10:10.893635 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:10:10.878609 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 62616.4us
I20260709 13:10:10.877539  2750 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:10.879448  3132 raft_consensus.cc:2804] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:10:10.901968 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 48060.2us
I20260709 13:10:10.902005  2479 raft_consensus.cc:2749] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:10.923064 30549 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 13.
W20260709 13:10:10.929788  3171 log.cc:927] Time spent T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
W20260709 13:10:10.930395 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 60634.7us
I20260709 13:10:10.931313 30516 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:10.931998  2910 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:10.932840 30516 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:10.932932  2910 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:10.934366  2479 raft_consensus.cc:2749] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:10.935163  2479 raft_consensus.cc:2749] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:10.937059 30516 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:10.900044  3150 raft_consensus.cc:697] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 13 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:10.940616 30441 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:10.941510 30623 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:10.949714 30590 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:10.939430  3071 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:10:10.955214  3172 log.cc:927] Time spent T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:10:10.915887  3132 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:10.962772 30547 raft_consensus.cc:1275] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:10:10.963732 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:10.943656  3147 raft_consensus.cc:2749] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:10.927735  2750 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:10.969844  3168 log.cc:927] Time spent T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 13:10:10.944945  3129 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:10.962987  3096 raft_consensus.cc:2764] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:10:10.964757  3132 raft_consensus.cc:3060] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:10.979995 30589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:10.983623 30589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.968417  2910 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:10.986452  3129 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:10.969962  3106 leader_election.cc:290] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:10.978147 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:10.995110  3179 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:10.998210 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:10.999392 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:10.999987 30544 raft_consensus.cc:2468] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9.
I20260709 13:10:11.000291 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:11.000854 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:11.001462 30545 raft_consensus.cc:2468] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 11.
I20260709 13:10:11.000890 30543 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 14.
I20260709 13:10:10.995275  2912 raft_consensus.cc:2804] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:10:11.010406 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 85998.8us
I20260709 13:10:11.010584  2912 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:11.014592  2912 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:11.016361 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 87371.1us
I20260709 13:10:10.981274  3146 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:10.993381  2994 raft_consensus.cc:2749] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:11.069676 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:10.977774  3071 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:11.075685 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:11.076326 30474 raft_consensus.cc:3060] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:11.070647 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:11.077437 30548 raft_consensus.cc:2393] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 13: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
W20260709 13:10:11.080793 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 71114.5us
I20260709 13:10:11.094738 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:11.090562 30624 raft_consensus.cc:2468] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 7.
I20260709 13:10:11.099345 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:11.100227 30468 raft_consensus.cc:2468] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 6.
I20260709 13:10:11.102856 30441 leader_election.cc:304] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:10.992059  2785 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:11.111271 30467 raft_consensus.cc:2410] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:10:11.081972  3096 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.108887 30618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36130 (request call id 2199) took 1134 ms. Trace:
I20260709 13:10:11.119112 30618 rpcz_store.cc:276] 0709 13:10:09.974788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.083039 (+108251us) service_pool.cc:224] Handling call
0709 13:10:11.108729 (+1025690us) spinlock_profiling.cc:243] Waited 627 ms on lock 0x7b54002c9054. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:10:11.108831 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1441094912}
I20260709 13:10:11.008574  3179 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:11.123437 30440 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:11.140355 30625 raft_consensus.cc:1240] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
W20260709 13:10:11.142969 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 47017.6us
I20260709 13:10:11.110674  3129 raft_consensus.cc:2749] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:11.085472  3146 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:11.070345  3150 consensus_queue.cc:237] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:11.162838 30441 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:11.158037  2910 raft_consensus.cc:2804] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:11.189057  3071 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:11.140969  3096 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:11.195156 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 95203.2us
I20260709 13:10:11.179522 30474 raft_consensus.cc:2468] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 14.
I20260709 13:10:11.223078 30516 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:11.229482  2479 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:11.229934 30516 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:11.230904  3147 raft_consensus.cc:2749] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:11.232213 30516 leader_election.cc:304] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:11.233111  2785 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:11.233748  3147 raft_consensus.cc:2749] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:10:11.235219  2944 consensus_meta.cc:287] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.610s	user 0.008s	sys 0.004s
I20260709 13:10:11.235716  2944 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:11.238075  2944 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:10:11.240613  3182 log.cc:927] Time spent T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:10:11.244743 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:11.245348 30547 raft_consensus.cc:3060] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:11.252897  3146 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:11.252768 30516 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:10:11.253827  3173 log.cc:927] Time spent T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.246s	user 0.000s	sys 0.001s
I20260709 13:10:11.254261  3147 raft_consensus.cc:2749] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:11.255918  3147 consensus_queue.cc:1048] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:11.258433  2479 raft_consensus.cc:2749] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:11.258087 30547 raft_consensus.cc:2468] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
I20260709 13:10:11.260038 30589 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:11.261159  3019 raft_consensus.cc:2804] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:11.261785  3019 raft_consensus.cc:697] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:11.262864  3019 consensus_queue.cc:237] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:11.256074 30516 leader_election.cc:304] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:10:11.268590  2750 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:11.270195  2750 raft_consensus.cc:2804] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:11.270529  3179 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:11.270826  2750 raft_consensus.cc:697] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 9 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:11.272217  2750 consensus_queue.cc:237] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:11.299862 30623 raft_consensus.cc:2468] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 13.
I20260709 13:10:11.209609  3096 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:10:11.324580 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 68643us
W20260709 13:10:11.333238 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 217382us
I20260709 13:10:11.334808 30551 raft_consensus.cc:1240] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:11.336272 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:11.325249  3062 leader_election.cc:290] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:11.337966 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:11.338646 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:11.365551 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:11.366552 30617 raft_consensus.cc:2368] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 8. Current term is 9.
I20260709 13:10:11.367729 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:11.339264 30548 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 12.
I20260709 13:10:11.379498 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:11.380123 30545 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:11.376024 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:10:11.381201 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 116040us
I20260709 13:10:11.383216 31151 raft_consensus.cc:1240] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:10:11.384083 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:11.384763 31143 raft_consensus.cc:2468] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 11.
I20260709 13:10:11.391280 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:11.391870 31146 raft_consensus.cc:2468] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 14.
I20260709 13:10:11.392225 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:11.392395 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:11.392992 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:11.393576 30624 raft_consensus.cc:2468] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 14.
I20260709 13:10:11.372846 31115 leader_election.cc:304] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:11.396236 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:11.391469 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:11.393589 31150 raft_consensus.cc:1240] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:11.393913 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:11.392365 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:11.400611 30543 raft_consensus.cc:1275] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:11.400687 31147 raft_consensus.cc:2410] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
W20260709 13:10:11.400669 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 66512.8us
I20260709 13:10:11.405714 30547 raft_consensus.cc:1240] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:11.406379 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:11.405053 31149 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 13.
I20260709 13:10:11.409619 31143 raft_consensus.cc:1240] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:10:11.409435 30590 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:11.410056 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:11.405074  2785 consensus_queue.cc:1059] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:10:11.410938  2912 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:11.411705  2785 raft_consensus.cc:3055] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:11.412142  2785 raft_consensus.cc:740] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:11.413179  2785 consensus_queue.cc:260] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:11.416321 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:11.420634  2981 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:11.421025  3192 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.421671 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:11.422313 30618 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 12.
I20260709 13:10:11.423184 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:10:11.424638  3176 log.cc:927] Time spent T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.494s	user 0.003s	sys 0.000s
I20260709 13:10:11.421527  3198 consensus_queue.cc:1059] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:11.425462 30589 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:11.438302 30621 raft_consensus.cc:2468] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 13.
I20260709 13:10:11.413221  2912 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:11.426074 31115 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:11.374588  3110 consensus_queue.cc:1048] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:10:11.404161  2479 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.445183 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:11.446756 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:11.408027  3196 raft_consensus.cc:2804] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:11.454350 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:11.456980 31115 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:11.453819  3146 raft_consensus.cc:2804] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:11.458137  3196 raft_consensus.cc:493] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.466750  3196 raft_consensus.cc:3060] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:11.467259 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:10:11.471072  3184 log.cc:927] Time spent T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:10:11.473326 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:11.474313 31146 raft_consensus.cc:2393] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 14: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:10:11.478771 30622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36130 (request call id 2194) took 1505 ms. Trace:
I20260709 13:10:11.479233 30622 rpcz_store.cc:276] 0709 13:10:09.973418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.979199 (+  5781us) service_pool.cc:224] Handling call
0709 13:10:11.478547 (+1499348us) spinlock_profiling.cc:243] Waited 634 ms on lock 0x7b54001e3a54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:10:11.478685 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1458624896}
I20260709 13:10:11.480260 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:11.481017  2785 raft_consensus.cc:3060] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:11.482750 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:11.461407 30619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36130 (request call id 2200) took 1486 ms. Trace:
I20260709 13:10:11.484288 30619 rpcz_store.cc:276] 0709 13:10:09.975045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.088000 (+112955us) service_pool.cc:224] Handling call
0709 13:10:10.088731 (+   731us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:10.858057 (+769326us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.461132 (+603075us) spinlock_profiling.cc:243] Waited 762 ms on lock 0x7b54001e2b54. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:10:11.461338 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1751695104}
I20260709 13:10:11.489259 30625 raft_consensus.cc:2468] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 17.
I20260709 13:10:11.491662 30620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36130 (request call id 2209) took 1380 ms. Trace:
I20260709 13:10:11.494845 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:11.456008  3104 raft_consensus.cc:3055] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:11.493588 30620 rpcz_store.cc:276] 0709 13:10:10.110968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.410772 (+299804us) service_pool.cc:224] Handling call
0709 13:10:10.467283 (+ 56511us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:10.610791 (+143508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.491402 (+880611us) spinlock_profiling.cc:243] Waited 56.1 ms on lock 0x7b54001d7750. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f678ad 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:10:11.491593 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129041152}
I20260709 13:10:11.462831  3062 raft_consensus.cc:2804] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:11.498961 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:11.499127  3062 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.499850  3062 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:11.440542  3179 consensus_queue.cc:1059] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:10:11.502184 31115 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:11.504142 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:11.490551  3019 raft_consensus.cc:2804] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:11.421515  3192 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:11.450510  2479 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:11.506696 31146 raft_consensus.cc:2468] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 8.
I20260709 13:10:11.514231 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:11.498387  3104 raft_consensus.cc:740] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:11.502350  3146 raft_consensus.cc:697] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 13 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
W20260709 13:10:11.558112 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 155867us
I20260709 13:10:11.507519  3129 raft_consensus.cc:2749] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:11.558873 30590 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:11.508279  3019 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:11.577783 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:11.558396 31142 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 12.
I20260709 13:10:11.574235  3186 raft_consensus.cc:2804] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:10:11.574766  3201 log.cc:927] Time spent T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:10:11.575551  3104 consensus_queue.cc:260] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:11.544831  2965 raft_consensus.cc:2804] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:11.546908  3150 raft_consensus.cc:3055] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:11.584410 30590 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:11.483593 31143 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695"
dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
mode: GRACEFUL
new_leader_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:42956
I20260709 13:10:11.586030 31143 raft_consensus.cc:606] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Received request to transfer leadership to TS 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:11.586375 31143 raft_consensus.cc:614] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:11.586807 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:11.587291 30590 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
W20260709 13:10:11.587674  3202 log.cc:927] Time spent T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:10:11.588596 30590 leader_election.cc:304] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:11.588798  3123 raft_consensus.cc:2749] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:11.589571  3123 raft_consensus.cc:2749] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:11.590161  3123 raft_consensus.cc:2749] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:11.590355 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:11.590725  3123 consensus_queue.cc:1059] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:11.585135  2866 raft_consensus.cc:2804] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:11.592252  2866 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:11.592630  2866 raft_consensus.cc:3060] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:11.592531  3146 consensus_queue.cc:237] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:11.597612  3174 log.cc:927] Time spent T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.640s	user 0.002s	sys 0.000s
I20260709 13:10:11.599980  2727 raft_consensus.cc:3055] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:11.588611 30548 raft_consensus.cc:1275] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:11.592473 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:11.600389 30472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 2211) took 1379 ms. Trace:
I20260709 13:10:11.600378  2727 raft_consensus.cc:740] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:11.603730 30542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 2353) took 1153 ms. Trace:
I20260709 13:10:11.604210  2479 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:11.604602 31148 raft_consensus.cc:1240] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 11. Current term is 12. Ops: []
W20260709 13:10:11.604967 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 442199us
I20260709 13:10:11.604125 30542 rpcz_store.cc:276] 0709 13:10:10.450557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.468648 (+ 18091us) service_pool.cc:224] Handling call
0709 13:10:10.484547 (+ 15899us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:10.619780 (+135233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:10.619833 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:10.619875 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:10.619905 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.603525 (+983620us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b54003d9fd4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:10:11.603574 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.603674 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":270997760}
I20260709 13:10:11.609102 30545 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 15.
I20260709 13:10:11.602917 30472 rpcz_store.cc:276] 0709 13:10:10.220920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.517794 (+296874us) service_pool.cc:224] Handling call
0709 13:10:10.588055 (+ 70261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:10.609136 (+ 21081us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.599477 (+990341us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b5400299ad4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:10:11.600210 (+   733us) spinlock_profiling.cc:243] Waited 70 ms on lock 0x7b5400299ad0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f678ad 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:10:11.600332 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":188639744}
I20260709 13:10:11.580199  3019 raft_consensus.cc:3060] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:11.611420 30441 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:10:11.614164 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 211692us
I20260709 13:10:11.615187 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:11.580895  3186 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:11.550083  3130 consensus_queue.cc:1048] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.056s
W20260709 13:10:11.609637  3132 consensus_meta.cc:287] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.592s	user 0.006s	sys 0.004s
I20260709 13:10:11.619206 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:11.620532  3123 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.621155 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:11.618973 31147 raft_consensus.cc:2468] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 13.
I20260709 13:10:11.624699 30624 raft_consensus.cc:2468] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 11.
I20260709 13:10:11.584838  3150 raft_consensus.cc:740] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:11.584674  2965 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:11.645929  3129 raft_consensus.cc:2749] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:11.619513  3186 raft_consensus.cc:3060] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:11.654775 30625 raft_consensus.cc:1275] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:10:11.621716  3104 raft_consensus.cc:3060] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:11.652000 30440 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:11.660697 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:11.661453 30545 raft_consensus.cc:2393] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 14: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:11.664341 30441 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:11.633807  2965 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:11.667466  2727 consensus_queue.cc:260] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:11.668884  2727 raft_consensus.cc:3060] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:11.653596  2917 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.651363  3199 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:11.626178  3132 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:11.652788  3123 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:11.686307 30440 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:10:11.689805 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 81847.5us
I20260709 13:10:11.691012 30440 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:11.702600 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
W20260709 13:10:11.730665 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 109859us
I20260709 13:10:11.709918  3073 raft_consensus.cc:2804] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:11.729849 30476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50430 (request call id 2606) took 1807 ms. Trace:
I20260709 13:10:11.702379  3038 raft_consensus.cc:2804] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:11.703596  3153 leader_election.cc:290] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:11.684095  2870 consensus_queue.cc:1048] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:10:11.679952  3196 raft_consensus.cc:515] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:11.679627  2917 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:11.705084  2910 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:11.744891 30548 raft_consensus.cc:1240] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:11.731015  3129 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.744036  3195 raft_consensus.cc:2749] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:11.706138  3216 raft_consensus.cc:2804] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:11.736194  3073 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:11.734441  3071 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:11.757840  3073 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:11.758136  3071 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:11.731241  3211 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.759681 30625 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42"
dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
mode: GRACEFUL
new_leader_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:49382
I20260709 13:10:11.759905  3211 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:11.738788  3198 consensus_queue.cc:1059] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 13:10:11.683714  3199 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:11.745944 30476 rpcz_store.cc:276] 0709 13:10:09.794100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.484719 (+690619us) service_pool.cc:224] Handling call
0709 13:10:10.520240 (+ 35521us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:10:10.587247 (+ 67007us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:10.587293 (+    46us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:10:10.641050 (+ 53757us) log.cc:844] Serialized 78 byte log entry
0709 13:10:10.811929 (+170879us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:10.840698 (+ 28769us) log.cc:844] Serialized 14 byte log entry
0709 13:10:10.841012 (+   314us) log.cc:844] Serialized 14 byte log entry
0709 13:10:10.841169 (+   157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.841233 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:11.420470 (+579237us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b18004c7ce0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e7b3f3 00007fc780e7d7c1 00007fc780e7d779 00007fc780e7d709 00007fc780e7d6d1 00007fc780e7c9cd 000000000038f354 000000000038f199 00007fc780e5e83a
0709 13:10:11.596897 (+176427us) spinlock_profiling.cc:243] Waited 4.61 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:10:11.601244 (+  4347us) raft_consensus.cc:1685] finished
0709 13:10:11.601273 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.601437 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":141456,"prepare.queue_time_us":62889,"prepare.run_cpu_time_us":124,"prepare.run_wall_time_us":7765,"raft.queue_time_us":63777,"raft.run_cpu_time_us":392,"raft.run_wall_time_us":13729,"spinlock_wait_cycles":15424896,"thread_start_us":169227,"threads_started":1,"wal-append.queue_time_us":256864}
I20260709 13:10:11.747419  3038 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:11.760291 30625 raft_consensus.cc:606] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Received request to transfer leadership to TS 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:11.766844 30625 raft_consensus.cc:614] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:11.754928 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:11.767755 30545 raft_consensus.cc:2468] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 12.
I20260709 13:10:11.754163  2910 raft_consensus.cc:3060] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:11.774905 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:11.781068 30548 raft_consensus.cc:2468] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 13.
I20260709 13:10:11.756734  3216 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:10:11.785616 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 126849us
I20260709 13:10:11.785986 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:11.786512 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:11.789011 30543 raft_consensus.cc:2468] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 12.
I20260709 13:10:11.768857  3038 raft_consensus.cc:3060] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:11.771601  3199 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:10:11.784288  3207 log.cc:927] Time spent T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
W20260709 13:10:11.779269  3214 log.cc:927] Time spent T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 13:10:11.771605  3132 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:10:11.797885  3222 log.cc:927] Time spent T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:10:11.801472 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:11.802757 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:11.803501 30544 raft_consensus.cc:2410] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:10:11.804236 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:11.804545  3123 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:11.757517  3129 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:11.805094 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:11.805219 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:11.805668 30551 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:11.806331 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:11.806877 30546 raft_consensus.cc:3060] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:11.790360  3216 raft_consensus.cc:3060] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:11.804714 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.808188 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:10:11.808391  3218 log.cc:927] Time spent T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:10:11.809334 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:11.810575 30544 raft_consensus.cc:1240] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:11.806887  3129 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:11.738446  3150 consensus_queue.cc:260] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:11.814472  3150 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:11.817767  3019 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:11.820436 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:11.821743 30544 raft_consensus.cc:2468] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 13.
I20260709 13:10:11.822496  3073 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:11.824759  3071 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:11.826059 30546 raft_consensus.cc:2468] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 14.
I20260709 13:10:11.826131  3196 leader_election.cc:290] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:11.826664 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
W20260709 13:10:11.828297 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 150193us
I20260709 13:10:11.762580  2866 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:11.831872 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:11.838789 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:11.839556 30544 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:11.843060 30545 raft_consensus.cc:1275] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:11.833211  2917 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:11.845676 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:11.848798 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:11.855890 30441 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:11.857724 30441 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:11.864048  3129 raft_consensus.cc:2749] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:11.864864  3129 raft_consensus.cc:2804] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:11.865255  3129 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:11.865657  3129 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:11.868942 30441 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:11.839217  3062 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:11.853312  2866 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:11.854704 30544 raft_consensus.cc:2468] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 13.
I20260709 13:10:11.870287 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:11.870627 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:11.871786 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:11.873067 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:11.873379 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:11.874759 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:11.886811 30543 raft_consensus.cc:2393] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 14: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:11.876765 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:10:11.885480 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 130364us
I20260709 13:10:11.877969  3186 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:11.849279 30551 raft_consensus.cc:2468] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 13.
I20260709 13:10:11.886075 30545 raft_consensus.cc:2376] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 14. Re-sending same reply.
I20260709 13:10:11.886137 30549 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 12.
I20260709 13:10:11.888266 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:10:11.888475 30589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.889433 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:11.885953 30542 raft_consensus.cc:2376] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 13. Re-sending same reply.
I20260709 13:10:11.891517  3062 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:10:11.889899 30589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.895588 30516 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:11.846657  3073 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:11.898075  3196 consensus_queue.cc:1048] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:10:11.912436 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 43566us
I20260709 13:10:11.915186  3132 raft_consensus.cc:2749] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:11.919008 30472 raft_consensus.cc:1240] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:11.919440 31114 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:11.920745 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:11.919601 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:11.922307 31144 raft_consensus.cc:1240] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:11.922482 30546 raft_consensus.cc:1275] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:10:11.919601  3183 consensus_queue.cc:1059] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:10:11.924207  3186 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:11.938148  3019 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:11.915598  2910 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:11.948920  3177 log.cc:927] Time spent T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 1.018s	user 0.003s	sys 0.000s
I20260709 13:10:11.952922 31146 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721"
dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
mode: GRACEFUL
new_leader_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:42956
W20260709 13:10:11.954615  3206 log.cc:927] Time spent T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.343s	user 0.000s	sys 0.000s
I20260709 13:10:11.969913 30469 raft_consensus.cc:3060] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:11.975425 30620 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 13.
W20260709 13:10:11.977450 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 81888.8us
I20260709 13:10:11.981886 30516 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:11.981482  3021 raft_consensus.cc:2749] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:11.984634 30440 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:11.970446  2994 raft_consensus.cc:2749] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:11.984097 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:11.943476  3129 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:11.997345  3175 log.cc:927] Time spent T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 1.068s	user 0.003s	sys 0.000s
I20260709 13:10:11.997901  3038 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:12.001255  3211 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:10:12.002061 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 82721.6us
I20260709 13:10:12.003976 30441 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:11.976609  3195 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:11.979300  3104 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.011983 31146 raft_consensus.cc:606] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Received request to transfer leadership to TS 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:12.015918 31146 raft_consensus.cc:614] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:12.011704  2863 raft_consensus.cc:3055] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:11.990928  3153 raft_consensus.cc:2804] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:12.027925 31114 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
W20260709 13:10:12.032423 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 50719.6us
I20260709 13:10:12.035648 30516 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:10:12.039582  2994 raft_consensus.cc:2804] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:12.027379  3104 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:12.042362 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.042362  3021 raft_consensus.cc:2749] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:12.042429  2994 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:12.051769  2994 raft_consensus.cc:3060] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:12.041961 30516 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
W20260709 13:10:12.058585 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 72559.4us
I20260709 13:10:12.043056  2479 consensus_queue.cc:1059] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:10:12.059338  3213 raft_consensus.cc:2804] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:12.059437 30441 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:12.064268 30469 raft_consensus.cc:2468] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 12.
I20260709 13:10:12.067286 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:12.068030 30550 raft_consensus.cc:2368] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 9. Current term is 10.
I20260709 13:10:12.059850  3213 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.027992  3211 raft_consensus.cc:2749] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:12.038476  3192 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:12.071771  2479 raft_consensus.cc:3055] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:12.072453 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:12.044775  3038 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:12.072989 30625 raft_consensus.cc:1240] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:12.073071  3129 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:12.034950  3153 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:12.073284 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 45502.8us
I20260709 13:10:12.073733  3213 raft_consensus.cc:3060] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:12.044708  3104 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:12.071820 30440 leader_election.cc:400] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 election: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 9. Current term is 10.
I20260709 13:10:12.107961 30440 leader_election.cc:403] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:10:12.074172  2965 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:12.075606  3216 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:12.031281  2863 raft_consensus.cc:740] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
W20260709 13:10:12.091089 31115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.110059 30547 raft_consensus.cc:1275] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:12.106215 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:12.108538 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:12.026389  3195 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:12.112553 30550 raft_consensus.cc:1240] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:12.114435 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:12.118173 30624 raft_consensus.cc:3060] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:12.113226 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:12.123831 30622 raft_consensus.cc:2393] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 13: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:10:12.127205  2965 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 18 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:12.127899  3195 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:12.128183 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:12.133884  3216 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:12.134229  2910 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:12.100164  2479 raft_consensus.cc:740] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:12.110128  3153 raft_consensus.cc:3060] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:12.142252 31114 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:12.147647 31114 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:12.144474 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:12.162192 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:12.163185 30620 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:12.159423  3223 raft_consensus.cc:3055] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:12.178205  3223 raft_consensus.cc:740] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:12.195061 30619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b"
dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
mode: GRACEFUL
new_leader_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:49382
I20260709 13:10:12.195986 30619 raft_consensus.cc:606] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Received request to transfer leadership to TS f639301059e24dc5b0d88a46dc683326
I20260709 13:10:12.196421 30619 raft_consensus.cc:614] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:12.197257 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:12.198058 30550 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:12.203434 30542 raft_consensus.cc:1275] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:12.172734  3183 raft_consensus.cc:2749] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:12.213020  3237 raft_consensus.cc:2749] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:12.212827  3238 consensus_queue.cc:1048] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:12.178316  3192 raft_consensus.cc:2749] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:12.211463 31114 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
W20260709 13:10:12.227013 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 167629us
W20260709 13:10:12.234781 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 165792us
I20260709 13:10:12.238953 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:12.242801 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:12.243654 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:12.245821 31147 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:12.242901 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:12.248067  3226 raft_consensus.cc:493] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.248524 31146 raft_consensus.cc:2393] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 15: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:10:12.225200  3106 raft_consensus.cc:2804] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:12.252499 30472 raft_consensus.cc:1240] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:12.253399 30441 leader_election.cc:400] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Vote denied by peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) with higher term. Message: Invalid argument: T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 13. Current term is 14.
I20260709 13:10:12.253825 30441 leader_election.cc:403] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:12.257220 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:12.257256 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:12.260336 30625 raft_consensus.cc:1275] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:12.262122 31114 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:12.262807 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:12.262173  3146 consensus_queue.cc:1048] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:10:12.267527 30548 raft_consensus.cc:1275] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:12.267935  3239 raft_consensus.cc:3060] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:12.268510 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:12.269065 30474 raft_consensus.cc:3060] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:10:12.269215 31114 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:12.270735 31114 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:12.261216 30546 raft_consensus.cc:2393] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 16: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:12.272063 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:12.272574  3150 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:12.272928 30616 raft_consensus.cc:2410] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for term 14 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:10:12.277709 31147 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 13.
I20260709 13:10:12.262444 30620 raft_consensus.cc:2468] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 18.
I20260709 13:10:12.283088 30474 raft_consensus.cc:2468] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 8.
I20260709 13:10:12.284236 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:12.234000  3238 raft_consensus.cc:2749] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:12.288074 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:12.293195 31115 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:12.294603 30476 raft_consensus.cc:1275] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:12.292662  3106 raft_consensus.cc:697] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 14 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:12.297916  3106 consensus_queue.cc:237] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:12.299160  3146 consensus_queue.cc:1048] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:12.299314 31114 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:12.300256  3194 raft_consensus.cc:2804] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:12.296926  3240 raft_consensus.cc:2749] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) with higher term. Message: Invalid argument: T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 13. Current term is 14.
W20260709 13:10:12.303253 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.294528  2910 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.304572  2910 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:12.304668  2981 consensus_queue.cc:1059] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:12.224534  2863 consensus_queue.cc:260] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:12.286159  3183 raft_consensus.cc:2764] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:10:12.225744  2479 consensus_queue.cc:260] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:12.249509  3229 consensus_queue.cc:1048] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
W20260709 13:10:12.328580 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 90864.2us
I20260709 13:10:12.260017  3062 consensus_queue.cc:1059] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:10:12.294193  3083 raft_consensus.cc:2749] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:12.338719 30441 leader_election.cc:304] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:10:12.344249 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 101991us
W20260709 13:10:12.378345 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 88221.9us
I20260709 13:10:12.363374  3237 raft_consensus.cc:2749] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:12.382779 30516 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:12.374694  2479 raft_consensus.cc:3060] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:12.336342  2994 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:12.385618 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 46983.1us
W20260709 13:10:12.385619 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 92494.7us
I20260709 13:10:12.380970  2863 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:12.374305  3194 raft_consensus.cc:697] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 18 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:12.399873 30551 raft_consensus.cc:1240] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:12.402724 30441 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:12.404927  3071 raft_consensus.cc:2804] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:12.404544 30441 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:12.410162 30550 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 13.
W20260709 13:10:12.411370 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.404997  2994 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:12.248571  3226 raft_consensus.cc:515] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:12.415004  3160 raft_consensus.cc:2764] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:10:12.420995  3150 raft_consensus.cc:2749] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:12.421305  3194 consensus_queue.cc:237] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:12.422531 30441 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:10:12.458738 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 76385.2us
I20260709 13:10:12.423142  3237 raft_consensus.cc:2749] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:12.440886  3239 raft_consensus.cc:2749] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 9. Current term is 10.
I20260709 13:10:12.443980  3248 raft_consensus.cc:3055] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:12.446092  3019 raft_consensus.cc:3055] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:10:12.453617 30589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.455436 30624 raft_consensus.cc:2468] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 8.
W20260709 13:10:12.464816 30589 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:12.456593 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 67325.2us
I20260709 13:10:12.460050 30516 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:12.458388 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:12.243623  3223 consensus_queue.cc:260] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:12.407318  3071 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:12.465731 30545 raft_consensus.cc:1240] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:12.473707 30589 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:12.466742 31116 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:12.457178  3254 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:12.477327 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 54870.9us
I20260709 13:10:12.464583  3019 raft_consensus.cc:740] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:12.477016  3071 raft_consensus.cc:3060] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:12.475694  3104 consensus_queue.cc:1048] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:10:12.483923  3254 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:12.485149  3104 raft_consensus.cc:2804] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:12.485616  3104 raft_consensus.cc:697] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:12.486105  3254 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:12.486481  3104 consensus_queue.cc:237] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:12.488010  3223 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:12.463261  3248 raft_consensus.cc:740] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:12.488806  3019 consensus_queue.cc:260] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:12.489159  3248 consensus_queue.cc:260] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:12.489980  3019 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:12.490540  3248 raft_consensus.cc:3060] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:12.463009  3240 raft_consensus.cc:2749] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:12.499639 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 110578us
I20260709 13:10:12.497764  3254 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:12.492550  3150 raft_consensus.cc:2749] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:12.478194  3062 consensus_queue.cc:1048] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:10:12.500614  2994 raft_consensus.cc:2749] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:12.501667  3192 raft_consensus.cc:2749] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:12.514966 31116 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:12.522846  3257 consensus_queue.cc:1059] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:10:12.532609 30441 leader_election.cc:400] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Vote denied by peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) with higher term. Message: Invalid argument: T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 8. Current term is 9.
I20260709 13:10:12.533070 30441 leader_election.cc:403] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:12.534313 30441 leader_election.cc:304] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:12.502094 31115 leader_election.cc:304] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:10:12.538062 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 78106.8us
I20260709 13:10:12.539204 30516 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:12.539872  3268 raft_consensus.cc:2804] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:12.540025 30516 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:12.540433  3268 raft_consensus.cc:697] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 13 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:12.541056  3259 raft_consensus.cc:2749] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:12.541430  3268 consensus_queue.cc:237] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:12.542511 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.543473 30516 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:12.544787 30441 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:10:12.549093 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 47082.5us
I20260709 13:10:12.549480 31116 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:12.547851  3238 raft_consensus.cc:2749] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:12.514140  3254 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:12.548141  3259 raft_consensus.cc:2804] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:10:12.565200 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 91555.1us
I20260709 13:10:12.548924  3150 raft_consensus.cc:2804] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:12.566860  3150 raft_consensus.cc:697] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 12 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:12.567883  3150 consensus_queue.cc:237] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:12.569334  3153 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:12.550738  3240 raft_consensus.cc:3060] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:10:12.572002  3130 consensus_queue.cc:1048] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:12.558964  3104 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.576174  3104 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:12.578302  3104 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:12.550982  3239 raft_consensus.cc:2749] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:12.571529  3153 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:12.581295 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:12.552834  3183 raft_consensus.cc:2804] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:12.534430  3213 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:12.559630  3246 raft_consensus.cc:2749] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:12.548825  2994 consensus_queue.cc:1048] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:10:12.598769  2910 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:12.590025  3183 raft_consensus.cc:697] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 8 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:12.599663 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:12.566182  3259 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:12.600526 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:12.579290  3260 consensus_queue.cc:1059] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:10:12.601481  3260 raft_consensus.cc:3055] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:12.601838  3260 raft_consensus.cc:740] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:12.602452 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:12.603255 30473 raft_consensus.cc:2410] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:10:12.602962  3260 consensus_queue.cc:260] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:12.604279 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:12.600740  3259 raft_consensus.cc:3060] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:12.609593  3253 log.cc:927] Time spent T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:10:12.582208  3262 raft_consensus.cc:3055] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:12.610671  3262 raft_consensus.cc:740] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:12.582132  3264 consensus_queue.cc:1048] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:10:12.611836  3262 consensus_queue.cc:260] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:12.600549  3183 consensus_queue.cc:237] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:12.614822  2870 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:12.615389  2870 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:12.617512 30469 raft_consensus.cc:1275] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:12.618248  2870 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:12.618968 30473 raft_consensus.cc:1275] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:12.616820  3260 raft_consensus.cc:3060] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:12.623652  3254 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:12.589505 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:12.628664 30472 raft_consensus.cc:2393] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 14: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:12.637006 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:12.637593 30467 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:12.613480  3262 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:12.654268 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 109859us
I20260709 13:10:12.655789 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:12.656651 30544 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 13.
W20260709 13:10:12.658066 30517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.659978  3226 leader_election.cc:290] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:12.661711  3213 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:12.666241 30467 raft_consensus.cc:2410] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:10:12.667615 30470 raft_consensus.cc:2468] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
I20260709 13:10:12.588524  3130 consensus_queue.cc:1048] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:10:12.631353  3259 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:12.671237 30516 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:12.672372 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:12.687368  3248 raft_consensus.cc:2804] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:12.688067  3248 raft_consensus.cc:697] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 13 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:12.689015  3248 consensus_queue.cc:237] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:12.700037 30468 raft_consensus.cc:1240] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:12.714847  3259 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:12.724658  3250 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.725169  3250 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:12.737015 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:12.738534 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:12.740623 30472 raft_consensus.cc:1275] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:12.741698 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:12.742704 30472 raft_consensus.cc:2410] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:10:12.743110 31147 raft_consensus.cc:1240] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 18 LEADER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:12.744230 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:12.744947 30473 raft_consensus.cc:2376] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 13. Re-sending same reply.
I20260709 13:10:12.737216 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:12.746003 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:12.746955 30473 raft_consensus.cc:2393] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 14: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:12.739735 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:12.748149 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:12.743570 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:12.752069 30472 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 13.
I20260709 13:10:12.755223 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:12.760742 30470 raft_consensus.cc:1275] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:10:12.762156 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.676141  3254 consensus_queue.cc:1059] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:10:12.777936 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:12.780308 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:12.780382 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:12.780653 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:12.783711 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:12.726174  3240 raft_consensus.cc:2749] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) with higher term. Message: Invalid argument: T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 8. Current term is 9.
I20260709 13:10:12.792570 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:12.793413 31143 raft_consensus.cc:2468] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 13.
I20260709 13:10:12.794966 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:12.788812 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:12.799170 31144 raft_consensus.cc:2468] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 12.
I20260709 13:10:12.803908 30471 raft_consensus.cc:2468] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 9.
I20260709 13:10:12.808951 30591 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:12.810593  3266 consensus_queue.cc:1048] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.033s
W20260709 13:10:12.901713 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 55378.6us
I20260709 13:10:12.902582 30591 leader_election.cc:304] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
W20260709 13:10:12.915169 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 243945us
I20260709 13:10:12.920324 30516 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:12.846457  3062 raft_consensus.cc:2749] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:12.805902  3071 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:12.808454  3226 consensus_queue.cc:1048] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.137s
I20260709 13:10:12.980906 30549 raft_consensus.cc:1275] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:10:12.809368 30441 connection.cc:256] RPC call timeout handler was delayed by -1.1211418430000322s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1728s for a response
I20260709 13:10:12.984597 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:12.988433 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:12.989027 30470 raft_consensus.cc:2393] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 14: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:10:12.952031  3223 raft_consensus.cc:2749] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:12.986797  3130 raft_consensus.cc:493] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:12.995766 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:10:12.993754 31113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.994163 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:12.995137 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:13.000209 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:13.000967 30467 raft_consensus.cc:3060] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:13.000713 30617 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 13.
I20260709 13:10:12.974687  3229 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.007092 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:13.006568 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:13.008184 30475 raft_consensus.cc:2393] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 15: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:13.005831 30620 raft_consensus.cc:2468] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 11.
I20260709 13:10:13.008529 30469 raft_consensus.cc:1240] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:13.010697 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:13.012323 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:13.013053 31145 raft_consensus.cc:2393] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 14: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:10:13.013563  3019 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.013872  3250 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:13.014200  3019 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:13.016129  3229 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:13.018813  3229 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:12.977663  3276 raft_consensus.cc:2749] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:13.004235  3273 log.cc:927] Time spent T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.327s	user 0.001s	sys 0.000s
I20260709 13:10:13.025622 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:13.033109 30550 raft_consensus.cc:2468] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 15.
I20260709 13:10:13.051374 30441 leader_election.cc:400] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 election: Vote denied by peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453) with higher term. Message: Invalid argument: T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 12. Current term is 13.
I20260709 13:10:13.051770 30441 leader_election.cc:403] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:10:13.052768 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:13.053038 30475 raft_consensus.cc:1240] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:13.053490 30470 raft_consensus.cc:2393] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 12: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:13.054009 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:13.054214 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:13.054723 30475 raft_consensus.cc:2393] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 11: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:13.055160 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:13.055420 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:13.009187  3130 raft_consensus.cc:515] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:13.055688 30470 raft_consensus.cc:2376] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 16. Re-sending same reply.
I20260709 13:10:13.061736 31147 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 15.
I20260709 13:10:13.056046 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:13.062871 30467 raft_consensus.cc:2468] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 13.
I20260709 13:10:13.090087 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:13.089056 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:13.063457 30474 raft_consensus.cc:1275] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:13.084008 30473 raft_consensus.cc:2393] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 14: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
W20260709 13:10:13.060983  3263 log.cc:927] Time spent T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.524s	user 0.001s	sys 0.019s
I20260709 13:10:13.096937 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:13.097874 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:13.098625 30467 raft_consensus.cc:2393] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 10: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
W20260709 13:10:13.083074 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 273121us
I20260709 13:10:13.103933 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:13.104604 31148 raft_consensus.cc:3060] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:13.107246 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:13.107196 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:13.108315 31149 raft_consensus.cc:2468] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 16.
I20260709 13:10:13.109148 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:13.110245 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:13.111747 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:13.117308 31143 raft_consensus.cc:2468] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 12.
I20260709 13:10:13.062978  3071 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:10:13.119545 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 68380us
I20260709 13:10:13.122318 30467 raft_consensus.cc:1275] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:10:13.122500 30473 raft_consensus.cc:1240] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:13.122762 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:13.126637 30470 raft_consensus.cc:2468] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 13.
I20260709 13:10:13.125859 30441 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:13.128859 30467 raft_consensus.cc:1240] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:13.132097 30475 raft_consensus.cc:1240] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:13.141884 30441 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:13.142944  3237 consensus_queue.cc:1059] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:13.144517  3240 raft_consensus.cc:2749] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:13.121794  3239 raft_consensus.cc:2749] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453) with higher term. Message: Invalid argument: T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 12. Current term is 13.
I20260709 13:10:13.146737  3130 leader_election.cc:290] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:13.146867  3071 raft_consensus.cc:2804] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:13.147373  3071 raft_consensus.cc:697] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 13 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:13.156031  3285 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:13.156576  3285 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:13.157050 30473 raft_consensus.cc:1275] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:13.158699  3285 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:10:13.165588  3183 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.009s	sys 0.009s
W20260709 13:10:13.163476 30517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:13.226226 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 44864.7us
W20260709 13:10:13.258137 30517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:13.178346  3183 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.009s	sys 0.009s
I20260709 13:10:13.265446  3237 consensus_queue.cc:1243] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer cd669586cff44d4bbfcc007e213faab6 log is divergent from this leader: its last log entry 18.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
W20260709 13:10:13.266669 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 124847us
I20260709 13:10:13.148311  3071 consensus_queue.cc:237] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:13.276845 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:13.279706 30545 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 16.
I20260709 13:10:13.277384 30441 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:13.283571 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:13.284287 30545 raft_consensus.cc:2393] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 14: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:13.285127 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:13.286087 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:13.302650 30469 raft_consensus.cc:1275] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:10:13.304287  3270 log.cc:927] Time spent T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.762s	user 0.003s	sys 0.000s
I20260709 13:10:13.305938 30440 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:10:13.308696  3283 log.cc:927] Time spent T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:10:13.318254 31148 raft_consensus.cc:2468] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 14.
I20260709 13:10:13.320667  2965 consensus_queue.cc:1048] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:13.327293  2965 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.347114 30624 raft_consensus.cc:1275] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 18 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:10:13.336539  3237 raft_consensus.cc:2804] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:13.345268  3303 raft_consensus.cc:2749] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:13.337908  3192 consensus_queue.cc:1048] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:10:13.353134  3237 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:13.378331  3289 log.cc:927] Time spent T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.237s	user 0.002s	sys 0.000s
I20260709 13:10:13.373044  3237 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:10:13.380770  3278 log.cc:927] Time spent T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.589s	user 0.006s	sys 0.002s
W20260709 13:10:13.385700  3288 log.cc:927] Time spent T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:10:13.351518  2965 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:13.390116 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.391498  2965 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:13.405792 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:13.406428 30621 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 17.
I20260709 13:10:13.406535 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:13.407223 31148 raft_consensus.cc:2468] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 14.
I20260709 13:10:13.408406 30621 raft_consensus.cc:1240] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:13.408308 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:13.395340 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:13.398643 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:13.415196 30545 raft_consensus.cc:1275] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:10:13.417862 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:13.418696 30621 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 15.
I20260709 13:10:13.418999 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:13.420953 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:13.421535 30544 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 16.
I20260709 13:10:13.440002 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:13.423728 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:13.448295 30622 raft_consensus.cc:2468] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 14.
I20260709 13:10:13.458461 30618 raft_consensus.cc:1275] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:10:13.440687 30472 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 15.
I20260709 13:10:13.462056 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:13.463729 30619 raft_consensus.cc:1240] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 18 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:10:13.467684 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:13.469194 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:13.471716 31151 raft_consensus.cc:1275] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:10:13.468298 31145 raft_consensus.cc:2468] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 13.
I20260709 13:10:13.410876  3062 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.374073  3291 consensus_queue.cc:1048] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.095s
I20260709 13:10:13.475252 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:13.481307 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:13.482116 30625 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 16.
I20260709 13:10:13.484020 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:13.484588 30619 raft_consensus.cc:3060] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:13.491847 30620 raft_consensus.cc:1275] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:10:13.492409 31151 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3"
dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
mode: GRACEFUL
new_leader_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:42956
I20260709 13:10:13.494426 31151 raft_consensus.cc:606] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Received request to transfer leadership to TS 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:13.494859 31151 raft_consensus.cc:614] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:10:13.499475 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 169639us
W20260709 13:10:13.496802  3221 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.984s	user 0.031s	sys 0.034s
W20260709 13:10:13.511404 30517 leader_election.cc:336] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.538s (SENT)
I20260709 13:10:13.525298 30517 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:10:13.498234 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 220927us
W20260709 13:10:13.528628 31113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.478590  3062 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:13.525188  3221 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.013s	user 0.031s	sys 0.035s
I20260709 13:10:13.532466 30441 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
W20260709 13:10:13.548530 30591 leader_election.cc:336] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.547s (SENT)
I20260709 13:10:13.549111 30591 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
W20260709 13:10:13.556687  3280 log.cc:927] Time spent T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.769s	user 0.007s	sys 0.002s
W20260709 13:10:13.558935 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 118657us
I20260709 13:10:13.559454 30441 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:13.559648 30589 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:10:13.534853  3295 log.cc:927] Time spent T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
W20260709 13:10:13.541791  3299 log.cc:927] Time spent T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:10:13.564947 30441 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:13.543366  3276 raft_consensus.cc:2749] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:10:13.565701  3268 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.974s	user 0.026s	sys 0.031s
I20260709 13:10:13.602144 30619 raft_consensus.cc:2468] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 13.
W20260709 13:10:13.579064  3268 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.987s	user 0.027s	sys 0.031s
W20260709 13:10:13.627658 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 133749us
I20260709 13:10:13.629230 30590 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:13.632691  3308 raft_consensus.cc:2804] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:13.633134 29364 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:13.633265  3308 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:13.633680  3308 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:13.635788  3268 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.636555  3268 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:13.639894  3268 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:13.643011  3308 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:13.645889  3308 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:13.632782  2912 raft_consensus.cc:2749] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:10:13.654943 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 90111us
I20260709 13:10:13.656569 30441 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:13.686460 30590 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:13.687440 30474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 2219) took 1077 ms. Trace:
W20260709 13:10:13.689348 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 174367us
I20260709 13:10:13.627157  3276 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:13.695785 30551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43088 (request call id 2419) took 1411 ms. Trace:
I20260709 13:10:13.699368 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:13.654893  3285 raft_consensus.cc:2749] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:13.687870 30474 rpcz_store.cc:276] 0709 13:10:12.610236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.620234 (+  9998us) service_pool.cc:224] Handling call
0709 13:10:12.620577 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:13.092686 (+472109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:13.687184 (+594498us) spinlock_profiling.cc:243] Waited 442 ms on lock 0x7b5400121bd4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:10:13.687378 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1017633024}
I20260709 13:10:13.691872 30441 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:13.630697  3310 raft_consensus.cc:2749] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:10:13.704107 31114 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.704882 30547 raft_consensus.cc:2393] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 16: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:13.696221 30551 rpcz_store.cc:276] 0709 13:10:12.284290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.284437 (+   147us) service_pool.cc:224] Handling call
0709 13:10:12.294898 (+ 10461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:12.400308 (+105410us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:13.695527 (+1295219us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b54002d6254. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:10:13.695720 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":240926080}
W20260709 13:10:13.697463  3304 log.cc:927] Time spent T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 13:10:13.714046 30590 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:10:13.711367 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 162866us
I20260709 13:10:13.719976 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:10:13.716866 30591 leader_election.cc:336] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 1.694s (SENT)
I20260709 13:10:13.700404  2912 raft_consensus.cc:2804] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:13.695986  3221 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:13.724629 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:13.725322 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:13.726279 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:10:13.716019  3298 log.cc:927] Time spent T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 13:10:13.729117 30475 raft_consensus.cc:2393] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 13: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:13.724728 31114 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:13.752678 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:13.754465 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:13.754992 30474 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 17.
I20260709 13:10:13.723753  3313 raft_consensus.cc:2804] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:13.758565 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:13.701635  3276 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:13.761089 30475 raft_consensus.cc:2393] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 11: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:13.761899 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:13.731618  3071 raft_consensus.cc:2804] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:13.731622  2912 raft_consensus.cc:697] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 12 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
W20260709 13:10:13.767745  3306 log.cc:927] Time spent T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:10:13.732297 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:13.774024 30441 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:13.729343  3285 raft_consensus.cc:2749] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:13.780311 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:13.758154  3317 raft_consensus.cc:2749] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:13.788564 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:10:13.804126  3267 log.cc:927] Time spent T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 1.207s	user 0.005s	sys 0.002s
I20260709 13:10:13.804443 30472 raft_consensus.cc:2393] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 11: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:13.764307  3313 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.804929  3313 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:13.805337 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
W20260709 13:10:13.789530  3315 log.cc:927] Time spent T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:10:13.806641 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:13.790181 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:13.793761 30517 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:13.807775 30474 raft_consensus.cc:2376] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 13. Re-sending same reply.
I20260709 13:10:13.794629 31145 raft_consensus.cc:2468] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 16.
I20260709 13:10:13.795182 31147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48412 (request call id 902) took 1041 ms. Trace:
I20260709 13:10:13.795629  2479 consensus_queue.cc:1059] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:13.797364 30471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50446 (request call id 2236) took 1059 ms. Trace:
I20260709 13:10:13.797633  3071 raft_consensus.cc:697] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 14 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:13.719331  3246 consensus_queue.cc:1048] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:10:13.799181  3276 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:13.776477  3319 raft_consensus.cc:2804] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:13.799796  3323 raft_consensus.cc:2749] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:13.800495 30441 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:13.821223 30441 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:13.821645  3071 consensus_queue.cc:237] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:13.822846  3318 raft_consensus.cc:2804] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:13.823266  3318 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:13.823607  3318 raft_consensus.cc:3060] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:13.827446 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:13.827979  3310 raft_consensus.cc:2749] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:13.828228 30474 raft_consensus.cc:2393] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 16: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:13.828642  3310 consensus_queue.cc:1059] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:13.829042 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:10:13.829550  3312 log.cc:927] Time spent T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.201s	user 0.000s	sys 0.000s
I20260709 13:10:13.820336  3319 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.830119 30441 leader_election.cc:304] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:13.763481  3062 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:10:13.831233  3316 log.cc:927] Time spent T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
W20260709 13:10:13.833463  3311 log.cc:927] Time spent T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:10:13.833956  3310 raft_consensus.cc:2749] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:13.835074 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:13.817423  3268 raft_consensus.cc:2749] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:13.835937 30473 raft_consensus.cc:2410] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:10:13.811064 30471 rpcz_store.cc:276] 0709 13:10:12.737664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.739458 (+  1794us) service_pool.cc:224] Handling call
0709 13:10:13.797205 (+1057747us) spinlock_profiling.cc:243] Waited 56.1 ms on lock 0x7b54003c32d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:10:13.797294 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":128974208}
I20260709 13:10:13.810050 31147 rpcz_store.cc:276] 0709 13:10:12.753691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.753852 (+   161us) service_pool.cc:224] Handling call
0709 13:10:13.794993 (+1041141us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b54005749d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:10:13.795105 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":645586176}
I20260709 13:10:13.837877 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:13.838660 30473 raft_consensus.cc:2393] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 17: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:13.844247 30441 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:13.848449 30441 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:10:13.854254 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 294657us
I20260709 13:10:13.856395 30441 leader_election.cc:304] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:13.855724 30471 raft_consensus.cc:1275] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:10:13.815696 30517 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:13.817121 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:13.802585  2912 consensus_queue.cc:237] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:13.830660  3319 raft_consensus.cc:3060] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:13.729521  3221 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:13.830129 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:13.763232  3194 raft_consensus.cc:2804] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:13.872112  3194 raft_consensus.cc:697] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 15 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:13.873021  3194 consensus_queue.cc:237] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:13.874030  3221 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:13.853133  3323 consensus_queue.cc:1048] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:10:13.876931  3323 raft_consensus.cc:2749] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:13.877532  3323 raft_consensus.cc:2749] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:13.878657  3314 raft_consensus.cc:2804] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:13.879159  3314 raft_consensus.cc:697] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 13 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:13.862187 30473 raft_consensus.cc:3060] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:13.863492 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 47909.9us
I20260709 13:10:13.864951 30472 raft_consensus.cc:2393] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 15: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:13.820573  3308 consensus_queue.cc:1059] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:10:13.897678 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:13.882210 30517 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:13.838837  3237 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:13.902384 30517 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:13.864637  2479 raft_consensus.cc:2749] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:13.904469 30517 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:10:13.900506 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 170297us
I20260709 13:10:13.914620 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:13.917023  3332 raft_consensus.cc:3055] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:13.916006 30591 leader_election.cc:304] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:13.864504  3062 consensus_queue.cc:1048] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:10:13.904707  3221 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.925803 30591 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:13.910547  3268 raft_consensus.cc:2749] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:13.881831  3319 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:13.931526 30591 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:13.934530 30591 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:13.920663  3248 consensus_queue.cc:1048] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:10:13.923466  3285 consensus_queue.cc:1048] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:10:13.937271  3335 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:13.937973  3317 raft_consensus.cc:2749] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:13.935356  2981 consensus_queue.cc:1059] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.014s
W20260709 13:10:13.956746 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 99346.5us
I20260709 13:10:13.933880  3221 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:13.957870  3265 log.cc:927] Time spent T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 1.420s	user 0.004s	sys 0.006s
I20260709 13:10:13.958165  3333 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.975123 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:13.975329 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:13.995246 30622 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 15.
I20260709 13:10:13.923166  3332 raft_consensus.cc:740] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:13.979539 30619 raft_consensus.cc:1275] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:13.980916 30620 raft_consensus.cc:1275] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:13.926105  3314 consensus_queue.cc:237] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:14.024190 31151 raft_consensus.cc:1240] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 18 LEADER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:14.035554 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:14.029734 30441 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:14.036386 31147 raft_consensus.cc:2410] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:10:13.946014  3318 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:14.040411 30623 raft_consensus.cc:1240] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 18 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:10:14.042315  3327 raft_consensus.cc:2804] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:14.042754  3327 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:14.043144  3327 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:14.027103  3333 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:14.045760  3324 raft_consensus.cc:2749] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:14.046254  3333 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:13.981066  3246 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:14.047107  3246 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:14.048799 30542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 2385) took 1593 ms. Trace:
I20260709 13:10:14.046305  3338 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.057757  3221 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:14.049151 30542 rpcz_store.cc:276] 0709 13:10:12.455221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.455405 (+   184us) service_pool.cc:224] Handling call
0709 13:10:12.461179 (+  5774us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:12.474754 (+ 13575us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:12.474785 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:12.479943 (+  5158us) log.cc:844] Serialized 26 byte log entry
0709 13:10:12.540106 (+ 60163us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:12.540162 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.540325 (+   163us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:13.923447 (+1383122us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:10:14.048531 (+125084us) raft_consensus.cc:1685] finished
0709 13:10:14.048552 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:14.048743 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9999,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":15218,"spinlock_wait_cycles":29705600,"thread_start_us":59727,"threads_started":1,"wal-append.queue_time_us":57666}
I20260709 13:10:13.971062  3266 consensus_queue.cc:1048] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:10:14.028025  3317 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:14.050529 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 113713us
I20260709 13:10:14.069221 30591 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:14.038609  3321 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.076488 30473 raft_consensus.cc:1275] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:14.049378  3246 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:14.077018 30591 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:14.076910 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:14.052584  3308 raft_consensus.cc:2804] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:14.087627 30591 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:14.093664 30551 raft_consensus.cc:1275] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:14.097482 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:14.098323 30551 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 15.
I20260709 13:10:14.099175 30542 raft_consensus.cc:1275] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:10:14.099435 30544 raft_consensus.cc:1275] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:14.100277  3337 consensus_queue.cc:1048] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:10:14.078899  3285 raft_consensus.cc:2749] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:14.102396 30516 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:10:14.112365  3213 raft_consensus.cc:3055] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:14.112865  3213 raft_consensus.cc:740] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:14.113767  3213 consensus_queue.cc:260] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:14.096740  3332 consensus_queue.cc:260] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:14.114892  3213 raft_consensus.cc:3060] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:14.115447  3332 raft_consensus.cc:3060] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:14.121621  3276 raft_consensus.cc:3055] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:14.122110  3276 raft_consensus.cc:740] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:14.085901  3324 raft_consensus.cc:2749] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:14.092940  3250 raft_consensus.cc:2749] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:10:14.136126 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 48568.4us
I20260709 13:10:14.096271  3308 raft_consensus.cc:697] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 16 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:14.080264  3221 consensus_queue.cc:1048] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:10:14.134428 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:14.122996  3276 consensus_queue.cc:260] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:14.143633  3351 raft_consensus.cc:2749] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:14.136886 30591 leader_election.cc:304] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:14.097087  3237 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 17 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:14.061635  3338 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:14.152410  3319 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:14.153692  3019 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:10:14.155098 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.156327  3308 consensus_queue.cc:237] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:14.162812 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 60534.6us
I20260709 13:10:14.167065 30516 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:14.168923  3346 raft_consensus.cc:2804] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:14.169610  3346 raft_consensus.cc:697] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 11 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:14.170732  3346 consensus_queue.cc:237] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:14.174973  3307 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.002s	sys 0.012s
W20260709 13:10:14.175534  3307 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.002s	sys 0.012s
I20260709 13:10:14.076503  3317 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:14.129047  3071 consensus_queue.cc:1175] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "cd669586cff44d4bbfcc007e213faab6" responder_term: 8 status { last_received { term: 8 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 8 index: 9 } }
I20260709 13:10:14.084559  3321 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:14.195363  3237 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.167068  3266 raft_consensus.cc:493] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:14.235500  3266 raft_consensus.cc:515] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:14.237654  3266 leader_election.cc:290] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:14.235909  3318 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:14.167301  3211 raft_consensus.cc:2804] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:14.183275  3324 raft_consensus.cc:2804] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:10:14.249277 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 72845.7us
W20260709 13:10:14.249887 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 328776us
I20260709 13:10:14.241492  3211 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:14.246784  3324 raft_consensus.cc:493] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:14.234969  3237 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:14.268477 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 122555us
I20260709 13:10:14.274194 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:14.279855 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:14.267006  3211 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:14.283684 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:14.286985 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:14.287568 30467 raft_consensus.cc:3060] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:14.268594  3321 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:14.292501 30476 raft_consensus.cc:2393] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 16: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:14.270659  3324 raft_consensus.cc:3060] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:14.282015  3194 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.314355 30467 raft_consensus.cc:2468] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 15.
I20260709 13:10:14.322957  3194 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:14.283048  3327 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:14.325356  3194 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:14.326448  3318 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:14.326984  3318 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:14.331360 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:14.341711 31116 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:14.344233  3359 consensus_queue.cc:1059] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:14.345741 30591 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:14.347095 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:10:14.350019 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 100060us
I20260709 13:10:14.350646 30516 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:10:14.358788  3309 log.cc:927] Time spent T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.727s	user 0.002s	sys 0.000s
I20260709 13:10:14.360998 30470 raft_consensus.cc:3055] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:14.361377 30470 raft_consensus.cc:740] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:14.362200 30470 consensus_queue.cc:260] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:14.363168 30470 raft_consensus.cc:3060] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:14.345992  3262 raft_consensus.cc:2804] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:14.377301  3327 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:14.376027  3262 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:14.379282  3262 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:14.389963  3262 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:14.354202  3321 raft_consensus.cc:2749] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:14.375653  3364 consensus_queue.cc:1059] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:10:14.398510  3335 raft_consensus.cc:2749] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:14.413951 30470 raft_consensus.cc:1275] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 18 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:10:14.428862 30543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 1070) took 1447 ms. Trace:
I20260709 13:10:14.439694 30470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 1228) took 1286 ms. Trace:
W20260709 13:10:14.427613 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 77033.3us
I20260709 13:10:14.440251 30470 rpcz_store.cc:276] 0709 13:10:13.153411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:13.155954 (+  2543us) service_pool.cc:224] Handling call
0709 13:10:13.156225 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:14.360912 (+1204687us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54001d63a0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783edfdc0 00007fc783f6a1c0 00007fc783f6b231 00007fc783f67d8f 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c
0709 13:10:14.439449 (+ 78537us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:14.439644 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":275611008}
I20260709 13:10:14.443912  3372 raft_consensus.cc:3055] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:14.444388  3372 raft_consensus.cc:740] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:14.445427  3372 consensus_queue.cc:260] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:14.447126  3372 raft_consensus.cc:3060] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:14.439538 30543 rpcz_store.cc:276] 0709 13:10:12.981739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.990598 (+  8859us) service_pool.cc:224] Handling call
0709 13:10:12.990932 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:13.088781 (+ 97849us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:13.088811 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:13.089225 (+   414us) log.cc:844] Serialized 26 byte log entry
0709 13:10:13.254948 (+165723us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:13.269577 (+ 14629us) log.cc:844] Serialized 14 byte log entry
0709 13:10:13.269774 (+   197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:13.311741 (+ 41967us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b180037c8a0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e7b3f3 00007fc780e7d7c1 00007fc780e7d779 00007fc780e7d709 00007fc780e7d6d1 00007fc780e7c9cd 000000000038f354 000000000038f199 00007fc780e5e83a
0709 13:10:14.428442 (+1116701us) spinlock_profiling.cc:243] Waited 82 ms on lock 0x7b540002e9d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:10:14.428525 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:14.428587 (+    62us) raft_consensus.cc:1685] finished
0709 13:10:14.428607 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:14.428783 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63579,"prepare.queue_time_us":14552,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":22804,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":11398,"spinlock_wait_cycles":214975232,"thread_start_us":151765,"threads_started":1,"wal-append.queue_time_us":362024}
W20260709 13:10:14.412436  3313 consensus_meta.cc:287] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.600s	user 0.010s	sys 0.002s
I20260709 13:10:14.453717  3313 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:14.427356  3364 raft_consensus.cc:2804] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:14.455791  3313 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 18 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:14.461908  3324 raft_consensus.cc:515] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:14.462719  3364 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:14.467052  3364 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:14.471491  3259 raft_consensus.cc:2804] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:10:14.452507  3240 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
I20260709 13:10:14.473608 29364 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:14.477720  3324 leader_election.cc:290] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:14.478564  3359 consensus_queue.cc:1048] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:14.479998  3211 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:14.484663 30591 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:14.493283 30469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60026 (request call id 1233) took 1088 ms. Trace:
I20260709 13:10:14.493754 30469 rpcz_store.cc:276] 0709 13:10:13.404880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:13.405165 (+   285us) service_pool.cc:224] Handling call
0709 13:10:13.450128 (+ 44963us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:13.568607 (+118479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:13.568776 (+   169us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:13.578331 (+  9555us) log.cc:844] Serialized 26 byte log entry
0709 13:10:13.886595 (+308264us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:13.886645 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:13.886732 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:14.472273 (+585541us) spinlock_profiling.cc:243] Waited 27.4 ms on lock 0x7b54000cbd20. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783edddbe 00007fc783ee8930 00007fc783ee88d8 00007fc783ee8858 00007fc783ee8813 00007fc783ee7a9c 00007fc789dd3626 00007fc789dcddd8 00007fc783f247cb 00007fc783f272c0
0709 13:10:14.482825 (+ 10552us) raft_consensus.cc:1685] finished
0709 13:10:14.482850 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:14.493219 (+ 10369us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":78963,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":8893,"spinlock_wait_cycles":62987008,"thread_start_us":235098,"threads_started":2,"wal-append.queue_time_us":234026}
I20260709 13:10:14.403894  3262 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 16 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:14.496672  3313 raft_consensus.cc:2804] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:14.496315  3240 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:14.502681 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:14.503257 30470 raft_consensus.cc:3060] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:14.505388 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 221339us
W20260709 13:10:14.506479 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 157125us
I20260709 13:10:14.518445 30517 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:14.505765  3313 raft_consensus.cc:697] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:14.505565  3240 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:14.525971  3262 consensus_queue.cc:1048] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:14.529227  3276 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:14.538637  3211 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:14.540271  3313 consensus_queue.cc:237] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:14.521319  3307 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:14.533087 30517 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:14.534847 30470 raft_consensus.cc:2468] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
I20260709 13:10:14.535495  2479 raft_consensus.cc:2749] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:14.545249 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 93313.8us
I20260709 13:10:14.550763  3307 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:14.553108  3307 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:14.554577  3240 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:14.545343  3305 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:10:14.558732 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.523267  3364 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:14.561610  3364 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 17 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:14.546008 30591 leader_election.cc:304] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:14.567212  3246 consensus_queue.cc:1048] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:14.553017 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:14.570259 30471 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:14.664589 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 131567us
I20260709 13:10:14.559031  3305 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:14.677825 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:14.678679 30474 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:14.681694 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:14.685132 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:14.685830 30547 raft_consensus.cc:2468] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 14.
I20260709 13:10:14.686985 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:14.687690 30543 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:14.686928 30517 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:14.670868  3307 raft_consensus.cc:2804] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:14.698314 31114 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:10:14.673110  3211 raft_consensus.cc:2749] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:14.675128  3071 raft_consensus.cc:493] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:14.679668  3359 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:14.696616  3302 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:14.696746  3254 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:14.675010  3083 consensus_queue.cc:1048] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:10:14.715499 30543 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 16.
I20260709 13:10:14.703408  3364 raft_consensus.cc:2749] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:14.676718  3370 consensus_queue.cc:1048] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 13:10:14.695047  3373 consensus_queue.cc:1048] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:10:14.698057  3303 raft_consensus.cc:493] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:14.693749 30470 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:14.705921  3199 raft_consensus.cc:2804] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:10:14.759220 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.755016 30474 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 16.
I20260709 13:10:14.774462 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:14.775134 30474 raft_consensus.cc:2468] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 14.
I20260709 13:10:14.712440  3307 raft_consensus.cc:697] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:14.789569  3360 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.789894  3307 consensus_queue.cc:237] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:14.790159  3360 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:14.772905  3368 log.cc:927] Time spent T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:10:14.796479 30470 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 14.
W20260709 13:10:14.797108 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 102370us
I20260709 13:10:14.795372 30591 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:14.772796  3199 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:14.717020  3071 raft_consensus.cc:515] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:14.719457  3359 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:14.758575  3302 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:14.830350  3338 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:14.766942  3254 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:14.833778  3254 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:10:14.835542  3377 log.cc:927] Time spent T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:10:14.821228  3313 raft_consensus.cc:2804] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:14.836298  3313 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:14.836663  3313 raft_consensus.cc:3060] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:14.839608  3383 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:14.840200  3383 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:14.841413  3359 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:14.842243  3383 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:14.842792  3305 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:10:14.843338  3379 log.cc:927] Time spent T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:10:14.844696  3071 leader_election.cc:290] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:14.850632  2912 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:14.851174  2912 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:14.852406  3380 log.cc:927] Time spent T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:10:14.853385  2912 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:14.773535  3303 raft_consensus.cc:515] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:14.860661  3303 leader_election.cc:290] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:14.861168  3366 raft_consensus.cc:3055] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:14.861721  3366 raft_consensus.cc:740] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:14.862262 30516 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
W20260709 13:10:14.862958  3344 log.cc:927] Time spent T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.403s	user 0.000s	sys 0.003s
I20260709 13:10:14.835634  3302 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:14.839504 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:14.864531  3373 raft_consensus.cc:2749] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:14.868268  3360 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:14.868319 30468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50446 (request call id 2242) took 1143 ms. Trace:
I20260709 13:10:14.868975 30468 rpcz_store.cc:276] 0709 13:10:13.724563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:13.724671 (+   108us) service_pool.cc:224] Handling call
0709 13:10:13.753904 (+ 29233us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:13.906365 (+152461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:13.906395 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:13.912854 (+  6459us) log.cc:844] Serialized 26 byte log entry
0709 13:10:14.070436 (+157582us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:14.081403 (+ 10967us) log.cc:844] Serialized 14 byte log entry
0709 13:10:14.082249 (+   846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:14.082320 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:14.459347 (+377027us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b1800487a20. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e7b3f3 00007fc780e7d7c1 00007fc780e7d779 00007fc780e7d709 00007fc780e7d6d1 00007fc780e7c9cd 000000000038f354 000000000038f199 00007fc780e5e83a
0709 13:10:14.554900 (+ 95553us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b1800487a20. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780df5c0a 00007fc78a535219 00007fc787e3c58f 00007fc780e7b571 00007fc780e7d7c1 00007fc780e7d779 00007fc780e7d709 00007fc780e7d6d1 00007fc780e7c9cd
0709 13:10:14.862432 (+307532us) spinlock_profiling.cc:243] Waited 4.73 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:10:14.868044 (+  5612us) raft_consensus.cc:1685] finished
0709 13:10:14.868074 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:14.868244 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7767,"prepare.queue_time_us":13309,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":2310,"raft.queue_time_us":14920,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":152,"spinlock_wait_cycles":64424320,"thread_start_us":271301,"threads_started":2,"wal-append.queue_time_us":175418}
I20260709 13:10:14.820887  3199 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:14.843349 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:14.898366 31151 raft_consensus.cc:3060] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:14.825086 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:14.872643  3313 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:14.899756  3268 raft_consensus.cc:3055] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:14.900262  3268 raft_consensus.cc:740] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:14.901648  3313 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:14.878057  3259 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:14.902269  3259 raft_consensus.cc:3060] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:14.902016  3268 consensus_queue.cc:260] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:14.904134 30474 raft_consensus.cc:1240] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:14.879688  3383 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.905118  3268 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:14.905179  3383 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:14.907665  3383 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:14.913432 30475 raft_consensus.cc:1240] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:14.883376  3318 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:14.891583 30471 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 18.
I20260709 13:10:14.797838 30517 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
W20260709 13:10:14.916733 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 214293us
W20260709 13:10:14.872833  3347 log.cc:927] Time spent T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.790s	user 0.003s	sys 0.000s
I20260709 13:10:14.929672 31148 raft_consensus.cc:1275] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:14.884752  3237 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:10:14.919956 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 122193us
I20260709 13:10:14.933825 31114 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:14.922005 30550 raft_consensus.cc:1275] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:10:14.934381 30517 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
W20260709 13:10:14.897725  3357 log.cc:927] Time spent T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.561s	user 0.000s	sys 0.003s
W20260709 13:10:14.922729 30516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.926859 31151 raft_consensus.cc:2468] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 15.
I20260709 13:10:14.938905 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:14.928411 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:14.932153 31148 raft_consensus.cc:1275] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:14.940356 31147 raft_consensus.cc:1275] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:14.935576  2479 consensus_queue.cc:1048] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:14.862838  3366 consensus_queue.cc:260] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:14.932632  2994 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:14.937882 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:14.944187 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:14.944869 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:14.947137 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:14.949465 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:14.950383 30467 raft_consensus.cc:2368] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 17. Current term is 18.
I20260709 13:10:14.953467 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:14.953775 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:14.954221 30467 raft_consensus.cc:2393] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 14: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:10:14.955041 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:14.956017 31150 raft_consensus.cc:2368] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 14. Current term is 15.
I20260709 13:10:14.956657 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:14.957701 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:14.928902  3104 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.970593 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:14.958935 30471 raft_consensus.cc:1240] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 9. Current term is 10. Ops: [9.5-9.5]
W20260709 13:10:14.959545 30516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.966228 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:14.932976  3250 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:14.978614 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:14.969839 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:14.975919 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:14.955693 30467 raft_consensus.cc:2393] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 11: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:14.943660  2870 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:14.981639 30550 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:14.986356 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:14.988129 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:14.988466 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:14.951894  3229 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:14.982842 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:14.999365 31144 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 15.
I20260709 13:10:14.944670  3248 raft_consensus.cc:2749] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:14.952234  3384 raft_consensus.cc:2804] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:15.025259  3384 raft_consensus.cc:697] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 16 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:15.026189 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:15.026432  3384 consensus_queue.cc:237] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:15.029168  3321 raft_consensus.cc:493] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:15.029897  3359 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.030553  3359 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:15.001216  3285 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.031885  3285 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:15.032552  3359 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:14.983515 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:14.989080  3287 consensus_queue.cc:1059] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:10:14.994257  3360 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:14.989310  3366 raft_consensus.cc:3060] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:15.008649 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:15.011986  3237 consensus_queue.cc:1048] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:15.012679  3323 consensus_queue.cc:1048] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:15.013317  3333 consensus_queue.cc:1048] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:15.014923 30441 leader_election.cc:400] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 election: Vote denied by peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453) with higher term. Message: Invalid argument: T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 14. Current term is 15.
I20260709 13:10:15.046128 30441 leader_election.cc:403] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:10:15.038499 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:15.046823 31146 raft_consensus.cc:1275] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:10:15.047063 30545 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:14.989957  3250 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:15.050187  3199 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:15.051294  3250 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:14.979102  3104 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:15.024396 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:15.029731  3321 raft_consensus.cc:515] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:15.002840 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:15.003456  2981 consensus_queue.cc:1048] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:15.044744 30624 raft_consensus.cc:3060] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:15.047664 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:14.979167  3335 raft_consensus.cc:493] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:15.049243 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:14.993495  2870 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:15.037014 30550 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 18.
I20260709 13:10:15.047349 30441 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:15.056685 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:15.057706 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:15.058907 31144 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 13.
I20260709 13:10:15.048472  3237 consensus_queue.cc:1243] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer cd669586cff44d4bbfcc007e213faab6 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:10:15.071975 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:15.070166 31142 raft_consensus.cc:2468] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 12.
I20260709 13:10:15.076798 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:15.036777  3276 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:15.084239 30623 raft_consensus.cc:2468] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 14.
I20260709 13:10:15.034185  3285 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:15.089603 30550 raft_consensus.cc:1240] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:15.091269 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:15.063405  3369 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.054620  3213 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:15.051944  3325 raft_consensus.cc:2749] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453) with higher term. Message: Invalid argument: T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 14. Current term is 15.
I20260709 13:10:15.076917  3318 raft_consensus.cc:2804] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:15.102834  3104 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:15.103582  2870 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:15.075210  3335 raft_consensus.cc:515] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:15.063867  3259 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:15.052147  3360 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:15.075685  3317 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:15.107921  3287 consensus_queue.cc:1048] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:15.108338  3199 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:15.094046  3276 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:15.109761 30550 raft_consensus.cc:3060] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:15.110836  3321 leader_election.cc:290] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:15.112332  3369 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:15.029780  3229 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:15.113399  3213 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:15.133519 30624 raft_consensus.cc:2468] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 16.
I20260709 13:10:15.119086  3318 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.158102 30516 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:10:15.161266 31144 pending_rounds.cc:85] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6: Aborting all ops after (but not including) 9
I20260709 13:10:15.182561 31144 pending_rounds.cc:107] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:10:15.182852 31144 raft_consensus.cc:2889] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:15.183125 30516 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:10:15.162273 30517 leader_election.cc:400] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 17 election: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 17. Current term is 18.
I20260709 13:10:15.187976 30517 leader_election.cc:403] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:10:15.166188 30545 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 17.
I20260709 13:10:15.164659 31115 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:10:15.190454 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 210000us
I20260709 13:10:15.192395  3360 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:15.192963  2994 raft_consensus.cc:2749] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:15.194644 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:15.196422 30440 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:10:15.199255 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 57402.8us
I20260709 13:10:15.199756 30550 raft_consensus.cc:1275] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:15.184948  3318 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:15.200016 30517 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:15.188819  3382 raft_consensus.cc:2804] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:15.207207 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:15.208220 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:15.209122 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:15.210273 30550 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 15.
I20260709 13:10:15.210410 30517 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:15.205924 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:15.198092  2981 raft_consensus.cc:2804] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:10:15.201004 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 226993us
I20260709 13:10:15.218748 30590 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
W20260709 13:10:15.219389 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.215411 30517 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:15.221092 30550 raft_consensus.cc:1275] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:10:15.183234  3237 consensus_queue.cc:1048] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 13:10:15.223557 30590 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:15.241394 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:15.241536 30590 leader_election.cc:304] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:15.237813 30545 raft_consensus.cc:1275] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:10:15.227193 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:15.184684  3333 consensus_queue.cc:1059] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:10:15.206550  3199 raft_consensus.cc:2749] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:15.251358 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:15.201905  2994 raft_consensus.cc:2749] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 17. Current term is 18.
I20260709 13:10:15.249111 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:15.250000 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:15.263566 30620 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 13.
I20260709 13:10:15.212251  3360 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:15.206609  3382 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:15.252306 30440 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:15.237213  3321 raft_consensus.cc:2804] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:15.272202 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:15.273283 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:15.282541 30624 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:15.223383  2981 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:15.274502 30619 raft_consensus.cc:1275] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:10:15.263104 30622 raft_consensus.cc:2468] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 11.
I20260709 13:10:15.276381 30516 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:15.221194  3250 raft_consensus.cc:3060] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:15.297379 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 305558us
I20260709 13:10:15.244486  3359 raft_consensus.cc:2749] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:15.278098 30440 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:15.299746 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:15.256829  3287 consensus_queue.cc:1059] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:10:15.302536 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
W20260709 13:10:15.284570  3390 log.cc:927] Time spent T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:10:15.253311  3383 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.292243 30589 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:15.221131  3268 consensus_queue.cc:1059] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:10:15.298061  2994 raft_consensus.cc:2749] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:15.300370 30622 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 14.
I20260709 13:10:15.261281  3062 raft_consensus.cc:2749] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:15.240962  3317 consensus_queue.cc:1048] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:10:15.281102  3321 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.316485 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:15.280325  3382 raft_consensus.cc:3060] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:15.302713 30440 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:15.289362  2912 raft_consensus.cc:2804] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:15.296751  2981 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:15.276628  3387 raft_consensus.cc:2749] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:15.324066 30591 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:15.320896 30440 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:15.322861 30624 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 17.
I20260709 13:10:15.348568 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:15.305840  3333 raft_consensus.cc:2749] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:15.349331 30624 raft_consensus.cc:2393] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 14: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:10:15.296411  3240 consensus_queue.cc:1048] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:10:15.321753  3332 raft_consensus.cc:2749] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:15.355288  3308 consensus_queue.cc:1048] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:15.356731  3308 consensus_queue.cc:1048] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:15.358706  3318 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:15.350858  3237 raft_consensus.cc:2749] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:15.362265  3318 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:10:15.375276 30516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.376291  3229 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:15.377347  3259 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:15.380762  3183 raft_consensus.cc:3055] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:15.381155  3183 raft_consensus.cc:740] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:15.382066  3183 consensus_queue.cc:260] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:15.315682  3383 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:15.383316  3183 raft_consensus.cc:3060] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:15.384913  3383 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:15.308777  3104 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:15.317783  3321 raft_consensus.cc:3060] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:15.392248 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 147433us
W20260709 13:10:15.402761 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 197581us
W20260709 13:10:15.404105 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 80110.4us
I20260709 13:10:15.408535 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:15.427846  3240 raft_consensus.cc:493] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:15.428457  3240 raft_consensus.cc:515] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:15.430608  3240 leader_election.cc:290] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:10:15.433883 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 115829us
I20260709 13:10:15.435075  2870 raft_consensus.cc:2749] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:15.435119 30589 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:15.437052 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:15.438203  3398 raft_consensus.cc:2749] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:15.438808  3211 raft_consensus.cc:3055] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:15.439200  3211 raft_consensus.cc:740] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:15.439960  3211 consensus_queue.cc:260] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:15.441051  3211 raft_consensus.cc:3060] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:15.442845 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:15.443378 30548 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:15.444134 30550 raft_consensus.cc:1275] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:15.445887 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:15.446434 30550 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 14.
I20260709 13:10:15.449079 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:15.447664 30589 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:15.451234 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:15.406288  3062 raft_consensus.cc:2804] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:15.403311  2912 raft_consensus.cc:697] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 17 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:15.462525 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:15.463419 31149 raft_consensus.cc:2393] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 15: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:10:15.464345 30622 raft_consensus.cc:1240] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:15.461822 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:15.468147 30589 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:15.406762  3335 leader_election.cc:290] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:15.477020 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:15.478397 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:15.479139 30618 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:15.451924  3369 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:15.482187 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:10:15.491637 30516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.450835  3324 raft_consensus.cc:493] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:15.453589  3229 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:15.532464  3394 log.cc:927] Time spent T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:10:15.476094  3307 raft_consensus.cc:2749] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:15.481527  3104 raft_consensus.cc:2749] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:15.472069  3396 raft_consensus.cc:2749] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:15.550132  3268 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.551570 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:15.539702  3240 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.617527 30548 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 16.
I20260709 13:10:15.541728  3213 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:10:15.556766  3402 log.cc:927] Time spent T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:10:15.600198 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:15.601104  3268 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:15.604568  3382 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:15.544418  2994 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:15.546079  3373 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:15.608522 30618 raft_consensus.cc:2468] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 15.
I20260709 13:10:15.597000 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:15.683264  2981 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:15.686829  3140 raft_consensus.cc:3055] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:15.687229  3140 raft_consensus.cc:740] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
W20260709 13:10:15.691531 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.693730  3388 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.694440  3388 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:15.697180  3388 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:15.698246  3083 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
W20260709 13:10:15.704510  3406 log.cc:927] Time spent T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:10:15.706777  3397 log.cc:927] Time spent T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:10:15.698827  3083 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:15.707789  3373 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:15.708762  3083 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:15.647497  3407 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.573562 30544 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:15.621299 30516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.535074  3229 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:15.535247  3324 raft_consensus.cc:515] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:15.727308  3366 consensus_meta.cc:287] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.679s	user 0.010s	sys 0.000s
I20260709 13:10:15.728822  3324 leader_election.cc:290] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:15.729590 30625 raft_consensus.cc:1275] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:10:15.649562  2912 consensus_queue.cc:237] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:15.612800  3332 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.555451  3246 consensus_queue.cc:1059] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.091s
I20260709 13:10:15.726946  3229 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:15.740768  3388 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.647270  3240 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:15.734339  3360 raft_consensus.cc:2749] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:15.790701 30544 raft_consensus.cc:2468] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 15.
I20260709 13:10:15.714520  2994 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:15.806236 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:15.803334  3237 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:15.822225  3237 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:15.824478  3237 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:15.829322  3323 raft_consensus.cc:3055] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:15.829818  3323 raft_consensus.cc:740] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:15.830673  3323 consensus_queue.cc:260] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:15.831184 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:15.832257  3323 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:15.837934 30547 raft_consensus.cc:2393] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 14: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:15.731773  3407 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:15.746201  3332 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:15.756923  3388 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:15.804937  3333 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:10:15.840852  3397 log.cc:927] Time spent T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:10:15.841957  3250 consensus_meta.cc:287] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.540s	user 0.003s	sys 0.007s
W20260709 13:10:15.857769 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 377119us
W20260709 13:10:15.862749 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 393002us
I20260709 13:10:15.864792 30618 raft_consensus.cc:1240] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:15.866693 30618 raft_consensus.cc:1240] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 LEADER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:10:15.871361 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:15.860656  3250 raft_consensus.cc:2749] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:15.874898 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:15.873298 30618 raft_consensus.cc:1240] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:15.873860 30616 raft_consensus.cc:1240] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:15.874289 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:15.876711 30619 raft_consensus.cc:2393] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 14: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:10:15.878355 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:15.881857  3373 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:15.858507  3333 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:15.890194 30544 raft_consensus.cc:1240] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:15.893911 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:15.874915  3382 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:15.900651 31115 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:15.906863 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:15.911145 30625 raft_consensus.cc:1275] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:10:15.911569 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 438877us
I20260709 13:10:15.920558 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:15.921327 30469 raft_consensus.cc:2468] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 9.
I20260709 13:10:15.924821 30625 raft_consensus.cc:1275] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:15.892871  3268 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:15.932976 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:15.935149 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:15.906091  3317 raft_consensus.cc:493] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:15.910109  3287 raft_consensus.cc:2804] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:15.950862 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:15.930920  3401 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.935873  3237 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:15.956929 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:15.972023 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:15.968194 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:15.946866  3240 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:15.977434 30551 raft_consensus.cc:2393] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 15: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:10:15.985813  3276 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:15.990129  3332 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:15.975004  2994 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:15.974402  3237 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:15.993322  3321 consensus_meta.cc:287] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.573s	user 0.005s	sys 0.003s
I20260709 13:10:15.993745  3321 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:15.994825  3237 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:15.955948  3407 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:15.952426  3083 consensus_queue.cc:1048] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 13:10:15.985813  3424 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:15.994827 30623 raft_consensus.cc:1240] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:10:16.001008  3424 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:16.001904  3417 log.cc:927] Time spent T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:10:16.003396  3424 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:16.003481 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:10:16.013280 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.013470 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:16.013600 30589 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:15.994984  2981 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:16.016251  3335 raft_consensus.cc:2749] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:16.016976 30546 raft_consensus.cc:1275] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:10:16.017319 30546 pending_rounds.cc:85] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd: Aborting all ops after (but not including) 4
I20260709 13:10:16.017537 30546 pending_rounds.cc:107] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:10:16.017766 30546 raft_consensus.cc:2889] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:16.023959 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:16.025688 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:16.025678 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:16.027913 30589 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:16.029755 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:16.032070 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:10:16.036798 30516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:16.037320 30516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.039096 30516 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:15.939402  3062 raft_consensus.cc:697] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 18 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:15.982467  3287 raft_consensus.cc:697] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 15 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:16.055855 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:16.068125 30516 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:16.054760 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:10:16.035145  3183 consensus_meta.cc:287] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.651s	user 0.011s	sys 0.002s
I20260709 13:10:16.041168  2994 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:16.070842 30440 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:16.071357  3333 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:16.072090  3250 consensus_queue.cc:1059] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:16.072840 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:16.073725  3287 consensus_queue.cc:237] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:16.095976 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:15.979086  3401 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:15.954389  3317 raft_consensus.cc:515] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:15.995751  3321 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:16.076578 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:16.082620 30516 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:16.040737  3276 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.056752  3324 consensus_queue.cc:1048] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:10:16.066964  3382 raft_consensus.cc:2749] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:16.055583  3268 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:16.061757  2981 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.096738 30547 raft_consensus.cc:2468] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 11.
I20260709 13:10:16.041548  2870 raft_consensus.cc:2749] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:16.092553  3388 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:16.087675  3285 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.111016 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:16.112547  2981 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:16.117537 30618 raft_consensus.cc:2468] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 12.
I20260709 13:10:16.097307  3332 raft_consensus.cc:2804] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:16.100593  3360 raft_consensus.cc:3055] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:10:16.117729 30591 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.014s	sys 0.027s
W20260709 13:10:16.127650 30591 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.015s	sys 0.027s
I20260709 13:10:16.119693 30516 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:16.102236  3250 raft_consensus.cc:2749] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:16.092504  3387 consensus_queue.cc:1048] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:10:16.092305  3373 consensus_queue.cc:1048] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:10:16.131699 30440 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:10:16.142490  3411 log.cc:927] Time spent T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.380s	user 0.000s	sys 0.004s
I20260709 13:10:16.144731 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:16.145268  2981 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:16.146227 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:16.148200 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:16.148964 30619 raft_consensus.cc:2468] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 10.
I20260709 13:10:16.149931 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:16.150640 30619 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 16.
I20260709 13:10:16.157982 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:16.103215  3276 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:16.160640 30548 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 16.
I20260709 13:10:16.161839  3276 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:16.126214  3285 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:16.164323  3285 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:16.147603 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:16.129772  3359 raft_consensus.cc:2749] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:16.166658  3332 raft_consensus.cc:697] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 16 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:16.167663  3332 consensus_queue.cc:237] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:16.170550  3317 leader_election.cc:290] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:16.129732  3382 raft_consensus.cc:2749] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:16.097455  2994 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:16.133589 30546 raft_consensus.cc:2468] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9.
W20260709 13:10:16.180538 31113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.181063 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:16.181634 30621 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 14.
I20260709 13:10:16.181872 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:16.180362 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:16.184007 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:16.184686 30471 raft_consensus.cc:2468] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 13.
I20260709 13:10:16.188145 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:16.188684 30471 raft_consensus.cc:2468] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 11.
I20260709 13:10:16.166661 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:16.190577 30616 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 16.
W20260709 13:10:16.195179 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 63530.4us
W20260709 13:10:16.199970 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 261452us
I20260709 13:10:16.198674 30474 raft_consensus.cc:1275] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:16.127295  3360 raft_consensus.cc:740] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:16.205971  2912 raft_consensus.cc:2804] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:16.203769 30440 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:16.207079  2994 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:16.208779 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:10:16.209899  3422 log.cc:927] Time spent T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:10:16.210609  3428 log.cc:927] Time spent T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:10:16.216807 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:16.108094  3268 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:16.239202 30476 raft_consensus.cc:2468] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 9.
I20260709 13:10:16.243716 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:16.192282  3240 raft_consensus.cc:493] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:16.191895  3333 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:16.250905 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:16.251322 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:16.251551 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:16.260057 31148 raft_consensus.cc:2468] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 8.
I20260709 13:10:16.252336 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:16.255990 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:16.256716 31116 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:16.249903 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:16.265223 31144 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:16.258833 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:10:16.265858 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 335495us
I20260709 13:10:16.267485 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:16.273964 30474 raft_consensus.cc:1275] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:10:16.274356 31148 raft_consensus.cc:1275] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:10:16.276005  3257 consensus_queue.cc:1048] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:16.276294  3285 consensus_queue.cc:1048] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:16.267607 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:16.266176 30467 raft_consensus.cc:2468] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 11.
I20260709 13:10:16.266670 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:16.267089 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:16.242846  3395 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:16.282671  3395 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:16.284570 31145 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 13.
I20260709 13:10:16.285874  3395 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:16.288277  3333 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:16.290720  3333 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:16.239885  2912 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.293639 30547 raft_consensus.cc:2468] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 10.
I20260709 13:10:16.293679 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:16.301860 30545 raft_consensus.cc:2468] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 13.
I20260709 13:10:16.295780 30467 raft_consensus.cc:1275] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:10:16.297348 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:16.295363 31114 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:16.242622  3323 raft_consensus.cc:2804] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:16.300283 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:16.298974 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:16.306366 30475 raft_consensus.cc:2393] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 14: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:16.303344 30440 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:16.308625 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:16.305783 30625 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 14.
I20260709 13:10:16.308636 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:16.315927 30616 raft_consensus.cc:1240] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 13. Current term is 14. Ops: []
W20260709 13:10:16.339274 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.267825  3291 raft_consensus.cc:2804] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:16.306885  3323 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.307334  2912 raft_consensus.cc:3060] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:16.411381 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 97815.1us
I20260709 13:10:16.412663  3369 raft_consensus.cc:2749] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:16.416249 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 120939us
W20260709 13:10:16.417403 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.316704  3333 raft_consensus.cc:2804] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:16.432649 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:16.262631  3240 raft_consensus.cc:515] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:16.238391  3062 consensus_queue.cc:237] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:16.449642 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:16.449750 31144 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 16.
W20260709 13:10:16.456106 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 160523us
W20260709 13:10:16.462831 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 45652.1us
I20260709 13:10:16.463670 30472 raft_consensus.cc:1275] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:10:16.438702  3408 consensus_queue.cc:1048] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:10:16.378489  3291 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:16.467010  3291 raft_consensus.cc:3060] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:16.415403  3323 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:16.442067  3426 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:16.482275 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:16.503801 31144 raft_consensus.cc:2468] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 11.
I20260709 13:10:16.495175 30544 raft_consensus.cc:1275] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:10:16.443231  3333 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
W20260709 13:10:16.472788  3441 log.cc:927] Time spent T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 13:10:16.508132 30543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43088 (request call id 2452) took 1067 ms. Trace:
I20260709 13:10:16.310928  3360 consensus_queue.cc:260] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:16.513285 30590 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:16.462831  2981 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:16.518399 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:16.502908  3401 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:16.513806 30543 rpcz_store.cc:276] 0709 13:10:15.440767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.443960 (+  3193us) service_pool.cc:224] Handling call
0709 13:10:15.444233 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:15.444523 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:15.444550 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:15.444958 (+   408us) log.cc:844] Serialized 26 byte log entry
0709 13:10:15.875062 (+430104us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:15.875112 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:15.875196 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:15.883325 (+  8129us) spinlock_profiling.cc:243] Waited 5.88 ms on lock 0x7b4800261558. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc788e91aa1 00007fc788e88b37 00007fc788e889ca 00007fc788f8026f 00007fc788f7ff37 00007fc788f9455c 00007fc788f94508 00007fc788f94488 00007fc788f94443 00007fc788f936ec 00007fc787ebda96
0709 13:10:16.478415 (+595090us) raft_consensus.cc:1685] finished
0709 13:10:16.478435 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:16.508060 (+ 29625us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6305,"raft.run_cpu_time_us":1511,"raft.run_wall_time_us":429797,"spinlock_wait_cycles":13524352,"thread_start_us":429740,"threads_started":1,"wal-append.queue_time_us":643659}
I20260709 13:10:16.522972 30624 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 1222) took 1045 ms. Trace:
I20260709 13:10:16.518934 30441 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:16.513216  3333 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:16.535975 30624 rpcz_store.cc:276] 0709 13:10:15.477815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.478076 (+   261us) service_pool.cc:224] Handling call
0709 13:10:15.478328 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:15.730833 (+252505us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:15.731121 (+   288us) log.cc:844] Serialized 14 byte log entry
0709 13:10:15.968329 (+237208us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:15.968378 (+    49us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:15.968419 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.522772 (+554353us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b54001644d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:10:16.522818 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:16.522922 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":790,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":2931,"raft.queue_time_us":9663,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":49913,"spinlock_wait_cycles":580255616,"thread_start_us":236824,"threads_started":1,"wal-append.queue_time_us":338172}
I20260709 13:10:16.541687 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:16.515182  3317 raft_consensus.cc:493] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:16.519737  3427 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:16.554665 30441 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:16.561522 30550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 1096) took 1008 ms. Trace:
I20260709 13:10:16.561918 30550 rpcz_store.cc:276] 0709 13:10:15.553014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.554039 (+  1025us) service_pool.cc:224] Handling call
0709 13:10:15.554421 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:15.896361 (+341940us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:15.896404 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:15.896906 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 13:10:16.127264 (+230358us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:16.127318 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.127403 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:16.561314 (+433911us) raft_consensus.cc:1685] finished
0709 13:10:16.561333 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:16.561468 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":56995,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":3104,"thread_start_us":494636,"threads_started":2,"wal-append.queue_time_us":346505}
I20260709 13:10:16.560655  3285 raft_consensus.cc:2804] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:16.595938  3285 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.596365  3285 raft_consensus.cc:3060] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:16.597175  3421 log.cc:927] Time spent T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.377s	user 0.001s	sys 0.000s
I20260709 13:10:16.599997  3268 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:10:16.600150  3442 log.cc:927] Time spent T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:10:16.532050  3444 consensus_queue.cc:1048] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:10:16.513351  3426 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:16.603096  3426 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:16.565788  3427 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:16.534794  2981 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:16.605573  3427 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:16.606819  2981 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:16.607128 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:16.608958  3240 leader_election.cc:290] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:16.611408  3285 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:16.614091 30549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 1089) took 1629 ms. Trace:
I20260709 13:10:16.615327  3285 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:16.614476 30549 rpcz_store.cc:276] 0709 13:10:14.984683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.984963 (+   280us) service_pool.cc:224] Handling call
0709 13:10:14.985239 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:14.985575 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:14.985604 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:14.986012 (+   408us) log.cc:844] Serialized 26 byte log entry
0709 13:10:15.482432 (+496420us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b18003a0060. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e5de07 00007fc789cb8ab9 00007fc780e7a69b 00007fc780e7893f 00007fc780e7ac02 00007fc783b0220b 00007fc783b07d23 00007fc783b080d1 00007fc783f23a0f
0709 13:10:15.956104 (+473672us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:15.956146 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:15.956207 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:16.613815 (+657608us) raft_consensus.cc:1685] finished
0709 13:10:16.613834 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:16.614028 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":74,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":13941,"spinlock_wait_cycles":33935232,"thread_start_us":473507,"threads_started":1,"wal-append.queue_time_us":1099674}
W20260709 13:10:16.618188  3454 log.cc:927] Time spent T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:10:16.618921 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:16.558714  3332 raft_consensus.cc:2749] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:16.620327  3332 consensus_queue.cc:1048] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:16.622395 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:16.623703 30551 raft_consensus.cc:1240] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:16.624806 30543 raft_consensus.cc:1240] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 12. Current term is 13. Ops: []
W20260709 13:10:16.625918  3416 log.cc:927] Time spent T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:10:16.627120  3445 log.cc:927] Time spent T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:10:16.627194 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:16.632045 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:16.613034 30441 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:16.632702 31149 raft_consensus.cc:2468] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 11.
I20260709 13:10:16.633366 30441 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:16.634469 30441 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:10:16.594363  3446 log.cc:927] Time spent T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:10:16.540169  3360 raft_consensus.cc:3060] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:16.560958  3317 raft_consensus.cc:515] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:16.637876 30441 leader_election.cc:304] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:10:16.638506 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 74886.1us
I20260709 13:10:16.650507 30441 leader_election.cc:304] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:16.651089 30549 raft_consensus.cc:1240] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:16.658777 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:16.659396 31149 raft_consensus.cc:3060] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:10:16.662063 30441 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:16.588640  3140 consensus_queue.cc:260] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:16.657052  3240 raft_consensus.cc:2749] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:16.747881 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.657637  3332 raft_consensus.cc:2749] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:16.655138  3444 raft_consensus.cc:2804] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:10:16.800381 30516 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.173.3:32851 timed out after 1.521s (SENT) [suppressed 24 similar messages]
I20260709 13:10:16.718451 30618 raft_consensus.cc:1275] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:10:16.648639  3237 raft_consensus.cc:2804] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:10:16.701764 31113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.823602 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:16.806632 31149 raft_consensus.cc:2468] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 13.
I20260709 13:10:16.829346 30543 raft_consensus.cc:2468] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 12.
I20260709 13:10:16.654004  3447 raft_consensus.cc:2804] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:16.839394  3447 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:16.780858  3333 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:16.836202  3466 log.cc:927] Time spent T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:10:16.758926  3318 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.843894  3447 raft_consensus.cc:3060] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:16.783455  3460 raft_consensus.cc:3060] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:16.780751  3401 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:16.683269  3291 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:16.841444  3438 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:16.841995  3285 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:16.686645  2912 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:16.776084  3427 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:16.848320 30467 raft_consensus.cc:1240] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:16.846580  3333 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:16.754025  3323 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:16.682057  3317 leader_election.cc:290] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:16.674326  3359 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.824971  3426 raft_consensus.cc:493] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:16.688691  3461 raft_consensus.cc:2749] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:16.829605  3237 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:16.858529 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 195907us
I20260709 13:10:16.824484  3444 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:16.860697 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:16.865361 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:16.867372 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:16.900585 30468 raft_consensus.cc:2393] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 17: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:16.900770 30546 raft_consensus.cc:3060] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:16.869524 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:16.843991  3318 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:16.874722 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:16.903571 30542 raft_consensus.cc:2468] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 10.
I20260709 13:10:16.829908  3408 consensus_queue.cc:1048] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:10:16.879309 31150 raft_consensus.cc:2468] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 9.
I20260709 13:10:16.884860 30441 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:10:16.888002 31115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.874330  3438 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:16.906782 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:16.872211  3401 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:16.940776 31151 raft_consensus.cc:2393] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 13: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:10:16.875896  3285 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:16.955068  3285 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:16.884744  3426 raft_consensus.cc:515] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:16.959257  3426 leader_election.cc:290] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:16.899335  3444 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:16.975675 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 90909.5us
I20260709 13:10:16.901575  2981 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:16.900787  3237 raft_consensus.cc:3060] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:16.981562 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:16.984009 30618 raft_consensus.cc:2468] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 13.
I20260709 13:10:16.878396  3427 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:16.985340  3468 raft_consensus.cc:493] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:16.990797 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:16.991443 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:17.040100 30620 raft_consensus.cc:2468] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 13.
W20260709 13:10:16.989322  3459 log.cc:927] Time spent T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
W20260709 13:10:16.828897  3246 consensus_queue.cc:1175] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" responder_term: 14 status { last_received { term: 13 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:16.997805  3318 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:17.000895  3323 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 17 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:17.002444  3447 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:17.002895  3401 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:17.004813 30441 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:17.006923  3470 consensus_queue.cc:1059] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:17.012900  2912 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:17.016072  3291 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:10:17.021100 30371 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57542 (request call id 302) took 26340 ms (client timeout 15000 ms). Trace:
I20260709 13:10:15.674737 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:17.023406 30372 catalog_manager.cc:5697] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 9 to 13, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 13 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:17.025544  3438 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:16.884990  3359 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:17.038110 30546 raft_consensus.cc:2468] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 13.
I20260709 13:10:16.977341  3285 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:16.983054  3332 raft_consensus.cc:2749] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:16.994189 30589 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
W20260709 13:10:17.038810 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 238442us
W20260709 13:10:17.065017 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 60262.5us
W20260709 13:10:17.071882 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 198108us
I20260709 13:10:16.990072  2981 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:17.089679 30441 leader_election.cc:304] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:17.049614  3333 raft_consensus.cc:493] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:17.092540 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 98423.7us
I20260709 13:10:17.093739 30591 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:17.094208 30589 leader_election.cc:304] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:17.083902 30372 catalog_manager.cc:5697] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 12 to 13, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 13 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:17.094619 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:17.089717 30440 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:17.095532 30517 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:17.098133 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:17.098815 30545 raft_consensus.cc:2368] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 12. Current term is 13.
I20260709 13:10:17.098692 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:17.100157 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:17.100740 30543 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 14.
I20260709 13:10:17.102537 30543 raft_consensus.cc:1275] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:10:17.105705 30620 raft_consensus.cc:1275] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:10:17.110805 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:17.117604 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:17.122362 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:17.067951  3323 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:17.068673 30371 rpcz_store.cc:269] 0709 13:09:50.680955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.934029 (+253074us) service_pool.cc:224] Handling call
0709 13:10:17.021008 (+26086979us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:11.394568 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:11.395240 (+   672us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:11.395291 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:10:11.395304 (+    13us) tablet.cc:662] Decoding operations
0709 13:10:11.396251 (+   947us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:11.396340 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:11.396366 (+    26us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:10:11.397174 (+   808us) tablet.cc:701] Row locks acquired
0709 13:10:11.397222 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:10:11.397374 (+   152us) write_op.cc:270] Start()
0709 13:10:11.397514 (+   140us) write_op.cc:276] Timestamp: P: 1783602611397309 usec, L: 0
0709 13:10:11.397558 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 13:10:11.455925 (+ 58367us) log.cc:844] Serialized 3209 byte log entry
0709 13:10:11.996436 (+540511us) op_driver.cc:464] REPLICATION: finished
0709 13:10:12.028726 (+ 32290us) write_op.cc:301] APPLY: starting
0709 13:10:12.039894 (+ 11168us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:12.049962 (+ 10068us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:12.050072 (+   110us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:12.127702 (+ 77630us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:12.128002 (+   300us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:10:12.128064 (+    62us) write_op.cc:312] APPLY: finished
0709 13:10:12.128382 (+   318us) log.cc:844] Serialized 81 byte log entry
0709 13:10:12.128545 (+   163us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:12.128658 (+   113us) write_op.cc:454] Released schema lock
0709 13:10:12.128730 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:12.129162 (+   432us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:12.129191 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":20895,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":24108,"apply.run_cpu_time_us":17303,"apply.run_wall_time_us":108275,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37583,"num_ops":8,"prepare.queue_time_us":209186,"prepare.run_cpu_time_us":45245,"prepare.run_wall_time_us":305843,"raft.queue_time_us":224147,"raft.run_cpu_time_us":10007,"raft.run_wall_time_us":24410,"replication_time_us":598727,"thread_start_us":454791,"threads_started":4,"wal-append.queue_time_us":268252,"wal-append.run_cpu_time_us":109188,"wal-append.run_wall_time_us":1369984}]]}
I20260709 13:10:17.128526 30550 raft_consensus.cc:2393] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 9: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:17.047025  3468 raft_consensus.cc:515] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:17.220496 30551 raft_consensus.cc:1275] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:10:17.222446 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:17.133472 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:17.093816  3401 raft_consensus.cc:2749] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:17.090507  2912 raft_consensus.cc:2804] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:17.252012 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:17.132169  3360 raft_consensus.cc:493] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:17.221937  3062 raft_consensus.cc:2749] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:17.229401  3324 raft_consensus.cc:2749] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:17.094789  3470 raft_consensus.cc:3055] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:17.292052 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:17.173933  3268 raft_consensus.cc:493] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:17.285993 30617 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:17.294513 30516 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:17.235162  3476 raft_consensus.cc:2749] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:17.296519 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 202379us
I20260709 13:10:17.306000 30542 raft_consensus.cc:2393] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 9: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:17.297573  3360 raft_consensus.cc:515] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:17.292914  3318 raft_consensus.cc:2804] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:17.322870 30623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 1235) took 1030 ms. Trace:
I20260709 13:10:17.130615  3333 raft_consensus.cc:515] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:17.129913  3285 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:17.360586  3468 leader_election.cc:290] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:17.295466  3472 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.304996  3470 raft_consensus.cc:740] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:17.215611  3323 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:17.366983 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 277321us
W20260709 13:10:17.367527 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 272067us
W20260709 13:10:17.375519 31115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.364573  3447 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:17.290469  2912 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.377737 30623 rpcz_store.cc:276] 0709 13:10:16.292759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.299479 (+  6720us) service_pool.cc:224] Handling call
0709 13:10:16.299878 (+   399us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:16.300331 (+   453us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:16.300370 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:16.311472 (+ 11102us) log.cc:844] Serialized 52 byte log entry
0709 13:10:16.485233 (+173761us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:16.485291 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.485381 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:17.322647 (+837266us) raft_consensus.cc:1685] finished
0709 13:10:17.322665 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:17.322811 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56244,"raft.queue_time_us":6946,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":7492,"thread_start_us":29170,"threads_started":1,"wal-append.queue_time_us":382775}
W20260709 13:10:17.385169 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 291484us
I20260709 13:10:17.361774 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:17.425421 30618 raft_consensus.cc:3060] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:10:17.428478 30517 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:17.439899  3360 leader_election.cc:290] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:17.444859  2981 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:17.453476  3359 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:10:17.454459  3480 log.cc:927] Time spent T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:10:17.496577  3359 raft_consensus.cc:2804] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:10:17.497587 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 372359us
I20260709 13:10:17.454332  3140 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:17.455013  3317 consensus_queue.cc:1059] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:17.457690 30372 catalog_manager.cc:5697] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 4 to 8, leader changed from cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 8 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:17.422289  3483 consensus_queue.cc:1059] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:10:17.463052  3482 raft_consensus.cc:2749] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:17.463987 30590 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:17.465699  3427 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:17.425751  2912 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:17.466568 30622 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47446 (request call id 2739) took 1592 ms (client timeout 1521 ms). Trace:
W20260709 13:10:17.515555 30622 rpcz_store.cc:269] 0709 13:10:15.873861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.874000 (+   139us) service_pool.cc:224] Handling call
0709 13:10:17.466378 (+1592378us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54002c9054. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:10:17.466506 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2889240960}
I20260709 13:10:17.470039  3444 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:17.471130  3475 log.cc:927] Time spent T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.090s	user 0.003s	sys 0.000s
I20260709 13:10:17.472779  3333 leader_election.cc:290] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:17.474330  3285 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:10:17.475071  3417 log.cc:927] Time spent T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 1.197s	user 0.005s	sys 0.004s
I20260709 13:10:17.477133  3470 consensus_queue.cc:260] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:17.478122  3237 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:17.377681  3318 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:17.576671  3318 raft_consensus.cc:3060] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:17.392520  3062 consensus_queue.cc:1059] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.092s
I20260709 13:10:17.580243  3062 raft_consensus.cc:2804] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:17.580682  3062 raft_consensus.cc:697] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:17.581652  3062 consensus_queue.cc:237] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:17.354661  3268 raft_consensus.cc:515] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:17.425840 30515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:17.497783 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 69413.5us
I20260709 13:10:17.425249 30440 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:17.497073  3359 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:17.511950 31150 raft_consensus.cc:1275] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:10:17.594455 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 169256us
I20260709 13:10:17.513837 30618 raft_consensus.cc:2468] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 12.
I20260709 13:10:17.381611  3401 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:17.396324  3426 raft_consensus.cc:2804] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:17.606379  3426 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:17.606307  3401 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:17.606961  3426 raft_consensus.cc:3060] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:17.520915 30617 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 17.
I20260709 13:10:17.524643 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:17.546679 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:17.550772 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:17.556794  3444 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:17.557538  3429 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:17.549774  3485 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:17.559247  3460 consensus_meta.cc:287] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.687s	user 0.009s	sys 0.000s
I20260709 13:10:17.565062  3483 raft_consensus.cc:3055] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:17.575136 30468 raft_consensus.cc:1240] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:17.580715  3427 raft_consensus.cc:3055] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:17.489337  3323 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:17.399377  3472 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:17.662710  3472 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:10:17.582990 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 288646us
I20260709 13:10:17.663591 30516 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:17.591377 30372 catalog_manager.cc:5697] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 4 to 5, leader changed from cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 5 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:17.665055 30372 catalog_manager.cc:5697] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 3 to 6, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 6 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:17.665580  3318 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:17.605312  3487 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:17.668118  3487 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:17.670169  3487 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:17.611044 30517 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:10:17.623183 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 124469us
I20260709 13:10:17.672384 30441 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:17.629964  3285 raft_consensus.cc:3055] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:17.675027 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:17.675230  3285 raft_consensus.cc:740] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:17.676075  3285 consensus_queue.cc:260] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:17.677300  3388 raft_consensus.cc:2804] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:17.677734  3388 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.678084  3388 raft_consensus.cc:3060] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:17.681810  3323 consensus_queue.cc:1048] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:10:17.634573 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 170657us
W20260709 13:10:17.635393 30625 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.011s	sys 0.017s
I20260709 13:10:17.685139  2981 raft_consensus.cc:2749] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:17.667625  3318 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:10:17.685302 30625 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.012s	sys 0.017s
I20260709 13:10:17.600085  3470 raft_consensus.cc:3060] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:17.686126  2981 raft_consensus.cc:2804] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:17.686627  2981 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.686976  2981 raft_consensus.cc:3060] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:17.689311  3237 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:17.691911  3268 leader_election.cc:290] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:17.608700  3359 raft_consensus.cc:3060] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:17.609184  3458 raft_consensus.cc:2804] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:17.708913 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:17.709951 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:17.710377 30621 raft_consensus.cc:1240] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:10:17.695425 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:17.697485 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265fc568d5674c78833106e4eda814f4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:17.712146 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:17.713235 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:17.698994 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:17.701889 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:17.701924 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:17.705888 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:17.711360 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:17.619792  3401 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:17.723387 30474 raft_consensus.cc:1240] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:17.725076 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:17.725747 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:17.726228 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:17.726915 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:17.731609 30622 raft_consensus.cc:3060] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:17.742108 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:17.745730  3388 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:17.656173  3483 raft_consensus.cc:740] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:17.657177  3460 raft_consensus.cc:2749] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:17.658411  3427 raft_consensus.cc:740] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:17.763142  3427 consensus_queue.cc:260] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:17.758040  3426 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:17.746901  3384 consensus_queue.cc:1059] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:10:17.655303  3485 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:17.733336  3470 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:17.761652  3489 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.616153  3482 consensus_queue.cc:1048] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.118s
I20260709 13:10:17.709148  3458 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.637684  3429 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:17.709844  3318 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.753742  2912 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:17.775122 30622 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 14.
W20260709 13:10:17.775350 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 350116us
I20260709 13:10:17.817567 30591 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:17.818782 30441 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:17.819226 30591 leader_election.cc:304] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:17.770473  3360 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:17.770473  3474 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:17.830619 30441 leader_election.cc:304] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:17.842077 30441 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:17.830832 30591 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:17.843214 30441 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:10:17.849092 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 456781us
I20260709 13:10:17.818791  3458 raft_consensus.cc:3060] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:17.800786  3460 raft_consensus.cc:493] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:17.839186  3150 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:17.818179  3427 raft_consensus.cc:3060] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:17.880579 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.840643  3401 raft_consensus.cc:2804] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:17.838974  3387 raft_consensus.cc:2749] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:17.804246  3470 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:17.847070  3472 raft_consensus.cc:2749] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:17.818943  3487 consensus_queue.cc:1048] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:10:17.884111 30441 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:17.868357  3494 raft_consensus.cc:2749] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:17.859575  3257 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.859359  3461 raft_consensus.cc:2804] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:17.815008  3489 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:17.848744  3476 raft_consensus.cc:2749] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:17.907619  3332 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:17.913157  3150 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:17.974153  3332 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:17.975629  3150 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:17.949743  3463 raft_consensus.cc:2804] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:17.841086  3318 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:17.952327  3490 log.cc:927] Time spent T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:10:17.849463  3483 consensus_queue.cc:260] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:17.908888  3486 raft_consensus.cc:2804] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:17.962553  3388 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:17.962863  3485 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:17.965626  3429 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:17.967332  2912 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:17.968472  3426 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:17.969590  3285 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:17.911835  3401 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:17.972553  3257 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:17.971364  3359 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:18.017366  3359 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:17.858814  3474 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:18.019047  3332 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:18.019265  3474 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:17.979230  3461 raft_consensus.cc:697] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 12 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:17.977941  3472 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.940307  3460 raft_consensus.cc:515] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:17.858925  3484 consensus_queue.cc:1048] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.159s
I20260709 13:10:17.979125  3482 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:18.006920 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 122894us
I20260709 13:10:18.001825  3463 raft_consensus.cc:697] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 14 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:18.011361  3483 raft_consensus.cc:3060] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:18.011400  3318 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:18.015744  3401 raft_consensus.cc:3060] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:18.035992 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:18.036613 31151 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:10:18.036469  3463 consensus_queue.cc:237] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:17.848503  3360 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:18.033603 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:18.042244 31147 raft_consensus.cc:3060] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:18.043627 31151 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 15.
I20260709 13:10:18.046574 30441 leader_election.cc:304] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:18.020165  3472 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:18.020376  3461 consensus_queue.cc:237] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:18.077044  3472 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:18.072157  3426 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:18.039846  3482 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:18.092638 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:18.095556 31151 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 14.
W20260709 13:10:18.097374 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 486353us
I20260709 13:10:18.105683 31147 raft_consensus.cc:2468] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 12.
I20260709 13:10:18.131423  3439 raft_consensus.cc:3055] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:18.132030  3439 raft_consensus.cc:740] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:18.133019  3439 consensus_queue.cc:260] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:18.144982  3482 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:18.112262  3268 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.097373  3426 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:18.194140 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 147630us
I20260709 13:10:18.197501 30441 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:10:18.198446 30516 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.014s	sys 0.015s
W20260709 13:10:18.198904 30516 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.014s	sys 0.015s
I20260709 13:10:18.148905  3470 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:18.149363  3359 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
W20260709 13:10:18.192065  3490 log.cc:927] Time spent T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 13:10:18.199584 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 536025us
I20260709 13:10:18.209309 30441 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:18.227401 30516 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:18.228976 30516 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
W20260709 13:10:18.229592 30441 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.231801 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:18.235296 30516 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:10:18.187361  3486 raft_consensus.cc:697] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 17 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:18.236397 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:18.229533  3359 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:18.209523  3489 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:18.263000  3489 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:18.263612  3489 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:18.264453  3359 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:18.265225  3359 raft_consensus.cc:2749] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:18.241804 30469 raft_consensus.cc:1240] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:10:18.266093  3489 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:10:18.209532 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 339474us
I20260709 13:10:18.266819  3489 raft_consensus.cc:2749] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:18.268086 30589 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:18.269444  3426 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:18.270164  3426 raft_consensus.cc:2804] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:18.270556  3426 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:18.243351 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:18.270953  3426 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:18.271245 30468 raft_consensus.cc:3060] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:18.190699  3268 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:18.201233  3237 raft_consensus.cc:2749] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:18.243989 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:18.278934 30474 raft_consensus.cc:3060] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:18.227269  3470 raft_consensus.cc:2749] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:18.280422 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:18.280537 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:18.282321 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:18.283958 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:18.282429 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:18.283308 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:18.267555  3489 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.234333  3444 raft_consensus.cc:2749] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:18.284780 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:18.285283 30620 raft_consensus.cc:2468] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 13.
I20260709 13:10:18.284547 30625 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:18.288540 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:18.285835 30548 raft_consensus.cc:2393] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 14: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:18.288669 30617 raft_consensus.cc:2393] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 15: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:10:18.289206 30544 raft_consensus.cc:2468] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 13.
I20260709 13:10:18.284584 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:18.290534 30623 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 13.
I20260709 13:10:18.292451 30468 raft_consensus.cc:2468] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 14.
I20260709 13:10:18.285709 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:18.305933 30589 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:18.314697 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:18.316301 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:18.319552 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:10:18.285854 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.325353 30441 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:18.326738 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:18.327495 31151 raft_consensus.cc:2393] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 15: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:18.328047 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:18.328902 30545 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 14.
W20260709 13:10:18.329202  3499 log.cc:927] Time spent T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:10:18.329875 30441 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:18.331773  3237 raft_consensus.cc:2804] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:18.332186  3237 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:18.332614  3237 raft_consensus.cc:3060] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:18.336055  3470 raft_consensus.cc:2804] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:18.336448  3470 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:18.336792  3470 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:18.291345  3324 raft_consensus.cc:2804] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:18.284322  3285 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.341792 30625 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 15.
I20260709 13:10:18.343585 30474 raft_consensus.cc:2468] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 12.
I20260709 13:10:18.349807 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:18.350507 30468 raft_consensus.cc:2468] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 14.
I20260709 13:10:18.352397 30441 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:18.356331 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:18.357271 30625 raft_consensus.cc:2393] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 14: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:10:18.370904  3463 raft_consensus.cc:2804] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:18.372058  3463 raft_consensus.cc:697] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 15 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:18.373771  3463 consensus_queue.cc:237] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:18.327693  3460 leader_election.cc:290] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:18.315701  3489 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:18.348647  3324 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:10:18.395102 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 495150us
I20260709 13:10:18.404028 30591 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:18.406801 30591 leader_election.cc:304] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:18.415580 30591 leader_election.cc:304] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:18.424477 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:18.419766 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:18.362349  3360 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:10:18.420233 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 185009us
I20260709 13:10:18.422649 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:18.449162 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:18.454264 30546 raft_consensus.cc:3060] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:18.352083  3458 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:18.459198 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 43728.3us
I20260709 13:10:18.462669 30516 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:18.467561 30545 raft_consensus.cc:1275] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:10:18.474375 30516 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:10:18.423430  3324 raft_consensus.cc:3060] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:18.494436 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:18.364152  3285 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:18.501884 30473 raft_consensus.cc:2393] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 14: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:18.419677  3482 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:18.510681 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 316514us
I20260709 13:10:18.485419 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:18.482424 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:18.429502  3359 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.505386 30591 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:18.467069  3472 raft_consensus.cc:2749] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:18.519130 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:18.399370  3514 raft_consensus.cc:2804] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:18.512214 30475 raft_consensus.cc:2468] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 14.
W20260709 13:10:18.506446 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 177961us
I20260709 13:10:18.512526 30467 raft_consensus.cc:2368] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 9. Current term is 10.
I20260709 13:10:18.448575  3502 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:18.531008 30546 raft_consensus.cc:2468] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 12.
I20260709 13:10:18.532389 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:18.468750  3520 raft_consensus.cc:2749] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:18.540150 30624 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 14.
W20260709 13:10:18.431357  3427 consensus_meta.cc:287] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.520s	user 0.002s	sys 0.007s
I20260709 13:10:18.466702  3360 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.545473 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:18.546023 31116 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:18.511059  3062 raft_consensus.cc:2749] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:18.384500  3486 consensus_queue.cc:237] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:18.572165 31115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.526684  3514 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:18.476830  3317 consensus_queue.cc:1048] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 13:10:18.540736  3460 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:18.560441  3491 raft_consensus.cc:2749] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:18.520588  3482 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:18.572577  3287 raft_consensus.cc:2804] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:18.528502  3359 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:18.610229 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 135963us
I20260709 13:10:18.577834  3514 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:18.561789  3360 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:18.581449  3268 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:18.551323  3502 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:18.602993  3511 log.cc:927] Time spent T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.276s	user 0.000s	sys 0.001s
I20260709 13:10:18.621536 30516 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:18.626204 30550 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 18.
I20260709 13:10:18.604348  3287 raft_consensus.cc:493] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:18.594329  3460 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:18.640185  3268 consensus_queue.cc:1059] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:18.644589 30546 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 14.
W20260709 13:10:18.652684 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 136878us
I20260709 13:10:18.653836 30591 leader_election.cc:304] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:18.583994  3519 consensus_queue.cc:1059] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:10:18.657882 30542 raft_consensus.cc:2410] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
W20260709 13:10:18.636514  3508 log.cc:927] Time spent T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.273s	user 0.001s	sys 0.000s
I20260709 13:10:18.637007  3534 raft_consensus.cc:2764] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:10:18.643342  3287 raft_consensus.cc:3060] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:18.683938  3512 log.cc:927] Time spent T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
W20260709 13:10:18.684535  3516 log.cc:927] Time spent T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
I20260709 13:10:18.686288 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:18.690734  3482 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:18.691931  3482 raft_consensus.cc:3055] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:18.692332  3482 raft_consensus.cc:740] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:18.693107  3482 consensus_queue.cc:260] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:18.693851 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:18.694463 30547 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 14.
I20260709 13:10:18.695343 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:18.698427 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:18.699047 31150 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 14.
I20260709 13:10:18.699105 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:18.699679 30546 raft_consensus.cc:3060] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:18.659121 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 147276us
W20260709 13:10:18.664867  3529 log.cc:927] Time spent T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:10:18.656361  3520 raft_consensus.cc:2749] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:18.671878  3525 log.cc:927] Time spent T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:10:18.672307  3458 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:18.672235  3359 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:18.677093  3502 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:18.677416  3460 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:18.679648  3285 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:18.698482 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:10:18.670509  3522 log.cc:927] Time spent T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:10:18.702836 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:18.689034  3237 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:18.701261 30517 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:18.657104 30591 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:18.663504  3501 raft_consensus.cc:2804] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:18.722033 30542 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:18.729799 30546 raft_consensus.cc:2468] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 12.
I20260709 13:10:18.663002  3489 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:18.733992 30517 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:18.721323 30547 raft_consensus.cc:2468] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 15.
W20260709 13:10:18.735632 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 114236us
I20260709 13:10:18.738013 30516 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:18.738291 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:18.739053 30547 raft_consensus.cc:2468] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 11.
I20260709 13:10:18.739014 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:18.739885 30546 raft_consensus.cc:3060] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:18.740334 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:18.740875 30547 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 14.
I20260709 13:10:18.741667 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:18.713079  3482 raft_consensus.cc:3060] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:18.746066 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:18.748226 30472 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 18.
W20260709 13:10:18.748975 30467 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60026 (request call id 1277) took 1244 ms (client timeout 1646 ms). Trace:
W20260709 13:10:18.749498 30467 rpcz_store.cc:269] 0709 13:10:17.504930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.524364 (+ 19434us) service_pool.cc:224] Handling call
0709 13:10:18.748815 (+1224451us) spinlock_profiling.cc:243] Waited 903 ms on lock 0x7b54003db8d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:10:18.748922 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2077240576}
I20260709 13:10:18.754276  3541 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:18.754906  3541 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:18.757236  3541 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:18.758306 30470 raft_consensus.cc:1240] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 14 LEADER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:18.762945 31114 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:18.765319  3150 consensus_queue.cc:1048] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:18.766072  3324 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:18.767185 30618 raft_consensus.cc:1240] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 10. Current term is 11. Ops: []
W20260709 13:10:18.770035 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 112995us
I20260709 13:10:18.771078 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:18.772266 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:18.773245 31116 leader_election.cc:400] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 election: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 9. Current term is 10.
I20260709 13:10:18.773554 31116 leader_election.cc:403] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:10:18.770136 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:18.776808 30467 raft_consensus.cc:1275] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 18 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:10:18.777205 30546 raft_consensus.cc:2468] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 11.
I20260709 13:10:18.777859 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:18.778066 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:18.778530 30546 raft_consensus.cc:3060] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:18.778918 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:18.780916 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:18.781610 30472 raft_consensus.cc:2468] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 14.
I20260709 13:10:18.786669 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:18.733045  3502 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:18.717082  3543 raft_consensus.cc:2804] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:18.787595 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:10:18.749571  3401 consensus_meta.cc:287] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.713s	user 0.009s	sys 0.003s
I20260709 13:10:18.789258 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:18.789698 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:18.787858 30517 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:18.791788 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:18.746060  3359 raft_consensus.cc:2804] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:18.736459  3501 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:18.769171  3360 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:18.795500 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:18.814332 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:18.772095  3489 raft_consensus.cc:2804] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:18.815194 30546 raft_consensus.cc:2468] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 11.
W20260709 13:10:18.797782 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.810415 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:18.811666 30472 raft_consensus.cc:2393] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 14: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:18.816229 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:18.822559 30591 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:18.823046 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:18.795636 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:18.818411 30441 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:18.819995 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:18.824293 30467 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 14.
I20260709 13:10:18.787226  3541 raft_consensus.cc:2749] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:18.826457 30517 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:18.828820 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:18.832175 30591 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:18.829726 30589 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:10:18.808326  3517 log.cc:927] Time spent T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:10:18.796285  3520 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:18.826741  3426 consensus_meta.cc:287] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.549s	user 0.012s	sys 0.000s
W20260709 13:10:18.820982  3483 consensus_meta.cc:287] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.780s	user 0.012s	sys 0.000s
I20260709 13:10:18.838778  3492 raft_consensus.cc:2749] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:18.807948  3502 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:18.839165  3489 raft_consensus.cc:697] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 12 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
W20260709 13:10:18.841949  3470 consensus_meta.cc:287] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326: Time spent flushing consensus metadata: real 0.505s	user 0.010s	sys 0.000s
I20260709 13:10:18.811218  3431 raft_consensus.cc:2749] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:18.794027  3543 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:10:18.843075  2981 consensus_meta.cc:287] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 1.156s	user 0.014s	sys 0.000s
I20260709 13:10:18.811201  3140 consensus_queue.cc:1048] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:10:18.846498  3439 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:18.815943  3501 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:18.797880  3237 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:18.853581 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:18.854169  3528 raft_consensus.cc:2804] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:18.855201 30467 raft_consensus.cc:1240] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 11. Current term is 12. Ops: []
W20260709 13:10:18.856137  3532 log.cc:927] Time spent T 00000000000000000000000000000000 P 045170a35afe4845987482e49e9e1eb9: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:10:18.793465  3540 raft_consensus.cc:2749] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:10:18.830829  3527 log.cc:927] Time spent T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.055s	user 0.001s	sys 0.001s
I20260709 13:10:18.815762  3401 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:18.830325  3359 raft_consensus.cc:697] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 14 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:18.833935  3545 raft_consensus.cc:2804] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:18.928669 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:18.879259  3543 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:18.812319  3420 raft_consensus.cc:3060] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:18.866276 30542 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 15.
I20260709 13:10:18.804184  3324 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:18.831339  3444 raft_consensus.cc:2804] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:18.883394 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:18.826363  3514 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:18.935379 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:18.872999  3542 raft_consensus.cc:2749] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:18.915256 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:18.865021  3519 consensus_queue.cc:1048] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:10:18.875532  3484 raft_consensus.cc:2804] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:18.867991  3426 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:18.951227 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:18.952149 30616 raft_consensus.cc:2468] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 14.
I20260709 13:10:18.952219 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:10:18.931398 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 135321us
I20260709 13:10:18.868129  3520 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:18.915470  3528 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:18.928901  3545 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:18.876664  3470 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:18.952643 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:18.953047 30620 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 13.
I20260709 13:10:18.956768 30544 raft_consensus.cc:1240] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:18.964448 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee49a377a80e4f4199281fb5e44d3be6" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:18.885218  2981 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:18.957295 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8b48bc080241c98b3c2b0e1ce8c041" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:18.958000 30619 raft_consensus.cc:1240] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:18.942749 30590 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:18.959367 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:18.968648 30543 raft_consensus.cc:2393] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 17: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:18.972024 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:18.949373  3360 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:18.972222 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:18.973477 30621 raft_consensus.cc:2468] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 15.
I20260709 13:10:18.955343  3444 raft_consensus.cc:697] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 12 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:18.914440  3287 raft_consensus.cc:515] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:18.984596  3502 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:18.985033  3287 leader_election.cc:290] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:18.979611 30476 raft_consensus.cc:2393] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 15: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:18.981725 30544 raft_consensus.cc:2368] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 9. Current term is 10.
I20260709 13:10:18.972189  3483 consensus_queue.cc:1059] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:10:18.986497  3483 raft_consensus.cc:3055] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:18.967849  3547 raft_consensus.cc:493] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:18.986852  3483 raft_consensus.cc:740] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:18.987278  3547 raft_consensus.cc:515] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:18.987709  3483 consensus_queue.cc:260] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:18.989431  3547 leader_election.cc:290] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:18.982702  2981 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:18.971616  3540 raft_consensus.cc:2804] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:18.989569 30516 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:18.989625 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:18.983070 30616 raft_consensus.cc:1275] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:18.990243  3540 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:18.990595  2981 raft_consensus.cc:2749] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:18.990651  3540 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:18.986171  3360 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:19.002430  3540 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:19.007954 30516 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:19.012216 30516 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:18.960453  3528 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:18.960907  3484 raft_consensus.cc:697] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:18.963914  3545 raft_consensus.cc:3060] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:19.017493 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:19.018748 30516 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:19.020816  3062 raft_consensus.cc:3055] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:19.018774  3502 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:19.026427 30440 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:19.027511 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:19.037388 30468 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 14.
I20260709 13:10:19.030026 30547 raft_consensus.cc:2410] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:10:19.016445  3547 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.033257 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:19.035058 30620 raft_consensus.cc:2393] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 14: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:10:19.034969 30516 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:10:19.035779 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 209395us
I20260709 13:10:19.041901 30440 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:19.052241  3447 raft_consensus.cc:2804] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:19.052675  3447 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:19.052752 30440 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:19.053092  3447 raft_consensus.cc:3060] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:19.055294  3268 consensus_queue.cc:1059] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:19.055753  3515 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.055840  3401 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:19.056532  3540 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:19.061147 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:19.084698 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:19.085901 31150 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:19.036572  3062 raft_consensus.cc:740] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
W20260709 13:10:19.087252 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 71803.6us
I20260709 13:10:19.050716  3482 raft_consensus.cc:2804] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:19.085248 30440 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:19.049523  3476 raft_consensus.cc:2749] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:19.091063 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:19.092011 30440 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:19.095366 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99c151771be541b19017860da4f7218d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:19.054128  3552 raft_consensus.cc:2804] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:19.096721 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:19.096869 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:19.104115 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:18.975492  3489 consensus_queue.cc:237] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:19.031418  3359 consensus_queue.cc:237] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:19.109683 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:19.090111  3387 raft_consensus.cc:2804] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:19.054332  3547 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:19.092183  3482 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:19.109925 30440 leader_election.cc:304] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:19.106619  3552 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:19.095742  3460 raft_consensus.cc:2804] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:19.124131 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:19.133803 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:19.127059 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:19.129032 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:19.107249  3140 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:19.130860 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:19.139501 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:19.138110 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:19.140553 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:19.141215 30548 raft_consensus.cc:2368] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 14. Current term is 15.
I20260709 13:10:19.141085 31114 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:19.087868  3515 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:19.122066  3476 raft_consensus.cc:2804] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:19.137226 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:19.139127 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:19.146119 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:19.146744 30548 raft_consensus.cc:2468] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 12.
I20260709 13:10:19.125203  3387 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:19.143185 30549 raft_consensus.cc:2368] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 12. Current term is 13.
I20260709 13:10:19.139595  3460 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:19.136158 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:19.143380  3268 consensus_queue.cc:1243] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer f639301059e24dc5b0d88a46dc683326 log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:10:19.133246  3482 raft_consensus.cc:3060] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:19.133464  2981 raft_consensus.cc:2749] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:19.133667  3552 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:19.163496 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7111be574b514751972d70830d3b644f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:19.167309  3246 raft_consensus.cc:2749] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:19.138321  3458 raft_consensus.cc:2749] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:19.174495 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:19.169759 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:19.175364 30549 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:19.175897 30516 leader_election.cc:304] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:19.172469 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:19.134150  3551 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:19.171742 31150 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 15.
I20260709 13:10:19.180446 30551 raft_consensus.cc:1275] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:19.181509 30516 leader_election.cc:304] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:19.181511 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:19.163492  3387 raft_consensus.cc:3060] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:19.120416  3444 consensus_queue.cc:237] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:19.165066  3460 raft_consensus.cc:3060] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:19.119240  3484 consensus_queue.cc:237] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:19.201129  3520 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:19.165789  3514 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:19.204200 30516 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:19.189162  3565 raft_consensus.cc:2749] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:19.145776  3140 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:19.211038 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:10:19.211239 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 77801.5us
I20260709 13:10:19.212028 30474 raft_consensus.cc:1240] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:19.170532  3426 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 17 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:19.183409  3551 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:19.229477  3420 raft_consensus.cc:2749] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 9. Current term is 10.
I20260709 13:10:19.229910  3551 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:19.178179  3470 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:19.221992 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48914655f9d44751a883e36b566dcefd" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
W20260709 13:10:19.228010  3548 log.cc:927] Time spent T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:10:19.233765 30440 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:10:19.219678 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 78687.2us
I20260709 13:10:19.231741 30549 raft_consensus.cc:2468] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 15.
I20260709 13:10:19.131052  3062 consensus_queue.cc:260] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:19.210175  2981 raft_consensus.cc:2749] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:19.237679 30440 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:19.253053 30547 raft_consensus.cc:3055] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:19.239675  3062 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:19.241138  3140 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:19.242108  3458 raft_consensus.cc:2804] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:19.245594  3257 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:19.247443 31149 raft_consensus.cc:2468] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 10.
I20260709 13:10:19.249541 31114 leader_election.cc:400] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 14. Current term is 15.
I20260709 13:10:19.251065 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:19.261133 31114 leader_election.cc:403] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:10:19.257457 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 53338.7us
I20260709 13:10:19.253412 30547 raft_consensus.cc:740] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:19.262351 31114 leader_election.cc:400] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 12. Current term is 13.
I20260709 13:10:19.262645 31114 leader_election.cc:403] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:19.263170 30516 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:19.264601 30516 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:19.265295 30516 leader_election.cc:304] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:19.266207 30516 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:19.268411 30618 raft_consensus.cc:2393] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 15: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:10:19.262595 30547 consensus_queue.cc:260] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:19.277154 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:19.278002 30624 raft_consensus.cc:2468] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 13.
I20260709 13:10:19.276836 30547 raft_consensus.cc:3060] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:19.281591 30548 raft_consensus.cc:1240] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 12 LEADER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:19.267166  3476 raft_consensus.cc:697] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 11 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:19.233393  3246 consensus_queue.cc:1059] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:10:19.334129 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:19.337766  3515 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:19.280119  3140 raft_consensus.cc:2749] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 12. Current term is 13.
I20260709 13:10:19.238396  3501 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:19.348542  3501 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:19.349851  3476 consensus_queue.cc:237] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:19.352344  3387 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:19.354060 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:19.310039 30476 raft_consensus.cc:2468] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 14.
I20260709 13:10:19.311172 31115 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:19.274703  3268 raft_consensus.cc:2749] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:19.320952  3502 raft_consensus.cc:2749] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:19.276809  3551 raft_consensus.cc:2749] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:19.260380  3568 raft_consensus.cc:2749] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:19.325623  3482 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:19.293699  3556 raft_consensus.cc:2749] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 14. Current term is 15.
I20260709 13:10:19.326870  3447 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:19.331251  3577 log.cc:927] Time spent T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
W20260709 13:10:19.331573 30517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.368499 30549 raft_consensus.cc:1240] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:19.334278  3246 raft_consensus.cc:3055] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:19.268021  3458 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:19.267922  3426 raft_consensus.cc:2749] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:19.355578 30546 raft_consensus.cc:1240] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:19.282794  3562 raft_consensus.cc:2749] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:19.356691 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 45614.9us
W20260709 13:10:19.357739 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 91590.9us
I20260709 13:10:19.366045 31144 raft_consensus.cc:1275] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:19.370999 30547 raft_consensus.cc:1275] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:19.375957 30516 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:19.376425 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:19.376830 31116 leader_election.cc:304] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:19.377267 31114 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:19.378420 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:19.367445  3140 raft_consensus.cc:2804] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:19.387454 30547 raft_consensus.cc:3060] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:19.387472  3140 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:19.390911  3140 raft_consensus.cc:3060] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:19.372964  3246 raft_consensus.cc:740] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:19.392154  3246 consensus_queue.cc:260] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:19.393915  3246 raft_consensus.cc:3060] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:19.380534  3502 raft_consensus.cc:2749] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:19.395610  3576 consensus_queue.cc:1048] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:10:19.398228  3482 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:19.399665  3140 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:19.401855  3447 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:19.402930  3420 raft_consensus.cc:2749] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:19.403195  3140 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:19.405685  3483 raft_consensus.cc:3060] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:19.363919  3528 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:19.367997  3257 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:19.372058  3458 raft_consensus.cc:3060] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:19.388163  3556 raft_consensus.cc:2804] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:19.408870  3552 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:19.412328 30547 raft_consensus.cc:2468] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 12.
I20260709 13:10:19.426164 30550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43088 (request call id 2482) took 1004 ms. Trace:
I20260709 13:10:19.426717 30550 rpcz_store.cc:276] 0709 13:10:18.421453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.448786 (+ 27333us) service_pool.cc:224] Handling call
0709 13:10:19.425931 (+977145us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b54000f00d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f6c2fa 00007fc788f2db17 00007fc7824a86d4 00007fc7824a8662 00007fc7824a8591 00007fc7824a850c 00007fc7824a77c2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:10:19.426090 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":394223360}
W20260709 13:10:19.430271 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 48437.6us
I20260709 13:10:19.433938 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:19.434181 30440 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:19.378080  3387 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:19.437037  3556 raft_consensus.cc:697] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 14 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:19.443337  3552 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:19.443749  3568 raft_consensus.cc:2804] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:19.444319 30545 raft_consensus.cc:2393] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 15: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:19.432844  3257 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:19.448702  3458 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:19.429256  3194 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
W20260709 13:10:19.475179 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 90555.9us
W20260709 13:10:19.455492  3543 consensus_meta.cc:287] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.513s	user 0.008s	sys 0.000s
I20260709 13:10:19.382459  3444 consensus_queue.cc:1048] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:10:19.478510 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:19.479573  3543 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:19.489428  3257 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:19.491449  3458 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:19.477877  3194 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:19.494350  3194 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:19.472780  3545 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:19.498303 30550 raft_consensus.cc:2368] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 15. Current term is 16.
I20260709 13:10:19.459779  3528 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 19 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:19.473902  3568 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:19.503479 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 126737us
I20260709 13:10:19.514851 30625 raft_consensus.cc:2468] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 13.
I20260709 13:10:19.501946  3568 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:19.403009  3460 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:19.530436 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:19.531284 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:19.533131 30471 raft_consensus.cc:1240] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:19.533483  3556 consensus_queue.cc:237] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:19.534034  3062 consensus_queue.cc:1048] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:19.528488  3565 raft_consensus.cc:2749] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:19.535645 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:19.536325 30623 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 14.
I20260709 13:10:19.549822  3543 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:19.550568 30474 raft_consensus.cc:2393] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 15: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:19.550506  3545 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:19.553494 30543 raft_consensus.cc:2393] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 15: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:10:19.554296 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:19.555408 30440 leader_election.cc:400] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 election: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 15. Current term is 16.
W20260709 13:10:19.555572 31115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.555709 30440 leader_election.cc:403] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
W20260709 13:10:19.556737 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.557855 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:19.559154 30543 raft_consensus.cc:2393] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 14: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:19.559623 31115 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:19.561575 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:19.562282 30543 raft_consensus.cc:2393] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 13: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:19.563059 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:19.563164  3438 raft_consensus.cc:2804] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:19.563755 30543 raft_consensus.cc:2393] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 13: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:19.563704  3438 raft_consensus.cc:697] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 13 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:19.557408  3447 raft_consensus.cc:3060] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:19.564715  3438 consensus_queue.cc:237] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:19.567633 31114 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:19.575554  3550 consensus_queue.cc:1059] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:19.576668  3550 raft_consensus.cc:3055] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:19.577037  3550 raft_consensus.cc:740] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:19.577867  3550 consensus_queue.cc:260] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:19.578693 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.575553  3563 raft_consensus.cc:2749] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:19.580433  3550 raft_consensus.cc:3060] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:19.573879 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:19.584347 30543 raft_consensus.cc:3060] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:19.587950 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:19.588884 30545 raft_consensus.cc:2393] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 15: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:10:19.590171 30545 raft_consensus.cc:1275] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:19.547701  3568 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:19.600214 30543 raft_consensus.cc:2468] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 13.
W20260709 13:10:19.620330 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 59863us
I20260709 13:10:19.601325  3470 consensus_queue.cc:1048] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:10:19.623401 30440 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:19.621594 31115 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:19.630378 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:19.653402  3318 raft_consensus.cc:2804] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:19.630712  3460 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:19.653914  3318 raft_consensus.cc:697] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 13 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:19.655185  3287 raft_consensus.cc:2804] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:19.654870  3318 consensus_queue.cc:237] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:19.637037 30543 raft_consensus.cc:1240] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:19.635099 30551 raft_consensus.cc:1240] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:19.640923 30619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36130 (request call id 2307) took 1124 ms. Trace:
W20260709 13:10:19.620862  3534 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 13:10:19.665202  3568 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 19 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:19.626823  3360 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:19.668160 31114 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:19.655624  3287 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:19.668886  3447 raft_consensus.cc:2749] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 15. Current term is 16.
I20260709 13:10:19.672050 30619 rpcz_store.cc:276] 0709 13:10:18.516040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.516479 (+   439us) service_pool.cc:224] Handling call
0709 13:10:18.545345 (+ 28866us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.970114 (+424769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.640703 (+670589us) spinlock_profiling.cc:243] Waited 412 ms on lock 0x7b54001d7754. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:10:19.640868 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":948535040}
I20260709 13:10:19.673303 30516 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:10:19.674760 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:19.675153 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:10:19.675380 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 52093.3us
I20260709 13:10:19.677810  3519 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.679948  3588 raft_consensus.cc:2749] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:19.663661  3547 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:19.682300 30589 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:19.691732  3360 raft_consensus.cc:2804] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:19.679054  3287 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:19.696898 31147 raft_consensus.cc:2468] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 16.
I20260709 13:10:19.697880 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9b623a9a0446ca90b350e140072cb4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:19.698244 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:19.698752  3062 raft_consensus.cc:2804] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:19.698834 30617 raft_consensus.cc:2468] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 13.
I20260709 13:10:19.699729 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:19.704284 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:19.702543 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:19.705036 30621 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:10:19.705166 30617 raft_consensus.cc:3060] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:19.701962 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:19.708284 30618 raft_consensus.cc:2393] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 14: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:10:19.690137  3535 consensus_queue.cc:1048] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:10:19.707124 30516 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:10:19.701189  3360 raft_consensus.cc:697] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 10 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:19.714629 30621 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 15.
I20260709 13:10:19.714717  3360 consensus_queue.cc:237] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:19.701395  3062 raft_consensus.cc:697] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:19.716557  3547 raft_consensus.cc:2804] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:19.716534  3062 consensus_queue.cc:237] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:19.720232 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:19.720829 30548 raft_consensus.cc:2468] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 12.
I20260709 13:10:19.730515 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:19.732319 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:19.733078 30548 raft_consensus.cc:2393] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 16: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:19.733891 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:19.734573 30548 raft_consensus.cc:2393] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 19: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:19.692456  3519 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:19.729612 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:19.729663 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:19.741323 30617 raft_consensus.cc:2468] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 15.
I20260709 13:10:19.745752 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:19.746450 30621 raft_consensus.cc:3060] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:19.717123  3547 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:19.729887  3571 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.766306 30623 raft_consensus.cc:2393] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 17: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:19.764281 30619 raft_consensus.cc:3055] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:19.766783 30619 raft_consensus.cc:740] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:19.767505 30516 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:19.770347 30516 leader_election.cc:304] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:19.771862  3545 raft_consensus.cc:2804] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:19.772222  3545 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:19.772524  3545 raft_consensus.cc:3060] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:19.773769  3237 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.774322  3237 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:19.775511 30546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43088 (request call id 2488) took 1352 ms. Trace:
I20260709 13:10:19.775980  3533 raft_consensus.cc:2749] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:19.776773  3237 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:19.776006 30546 rpcz_store.cc:276] 0709 13:10:18.423499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.835018 (+411519us) service_pool.cc:224] Handling call
0709 13:10:18.835304 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.371902 (+536598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.775275 (+403373us) spinlock_profiling.cc:243] Waited 520 ms on lock 0x7b54000d84d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:10:19.775452 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1195925760}
I20260709 13:10:19.779665 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:19.781242  3287 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:19.781962 30546 raft_consensus.cc:1240] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 19 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:19.782445 30616 raft_consensus.cc:1240] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:19.783046 30516 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:19.784135  3564 raft_consensus.cc:2804] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:19.784660  3564 raft_consensus.cc:697] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 15 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:19.784973  3287 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:19.785570  3564 consensus_queue.cc:237] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:19.787750 30516 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:19.791522  3533 raft_consensus.cc:2749] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:19.792644 30516 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:19.793397  3533 raft_consensus.cc:2804] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:19.793773  3519 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:19.794106  3533 raft_consensus.cc:697] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 15 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:19.760039  3547 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:19.795182  3533 consensus_queue.cc:237] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:19.797398 31114 leader_election.cc:400] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 9 election: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 9. Current term is 10.
I20260709 13:10:19.769016 30621 raft_consensus.cc:2468] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 16.
I20260709 13:10:19.798497 30440 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:19.809258 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:19.810508 30543 raft_consensus.cc:2393] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 14: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:19.812548 30544 raft_consensus.cc:1275] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:10:19.814097 30589 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:19.816589 30516 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:19.806409 30619 consensus_queue.cc:260] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:19.826092 30619 raft_consensus.cc:3060] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:19.832635 30591 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:19.835752 30621 raft_consensus.cc:1275] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:19.844547 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:19.847724 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:19.848232 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:19.849254 30621 raft_consensus.cc:2393] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 15: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:19.850423 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:19.851728 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:19.852859 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:19.853933 30542 raft_consensus.cc:1240] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 14 LEADER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 13. Current term is 14. Ops: []
W20260709 13:10:19.854089 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 55394.4us
I20260709 13:10:19.857487 31143 raft_consensus.cc:1275] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:10:19.857847 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:19.858685 30616 raft_consensus.cc:2368] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 15. Current term is 16.
I20260709 13:10:19.858681 30617 raft_consensus.cc:2468] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 14.
I20260709 13:10:19.861287 30591 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:19.863081 31142 raft_consensus.cc:2393] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 15: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:10:19.822055  3237 raft_consensus.cc:2804] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:19.864485  3483 raft_consensus.cc:3060] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:19.870610  3515 raft_consensus.cc:2749] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:19.871932 30591 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:19.872777  3515 raft_consensus.cc:2749] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:19.824795  3528 raft_consensus.cc:493] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:19.853849  3427 raft_consensus.cc:493] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:19.880551  3427 raft_consensus.cc:515] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:19.883335  3427 leader_election.cc:290] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:19.828578  3552 raft_consensus.cc:2804] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:19.884948  3552 raft_consensus.cc:697] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 16 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:19.885854 30544 raft_consensus.cc:1275] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:19.886065  3552 consensus_queue.cc:237] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:19.890211 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:19.891124 31147 raft_consensus.cc:2468] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 12.
I20260709 13:10:19.758984  3438 consensus_queue.cc:1059] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.068s
I20260709 13:10:19.825263  3519 raft_consensus.cc:2804] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:19.921850 30517 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:19.940317 30517 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:19.945057 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:19.947451 30441 leader_election.cc:304] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:19.949740 31147 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073"
dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
mode: GRACEFUL
new_leader_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:42956
I20260709 13:10:19.950331 31147 raft_consensus.cc:606] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 15 LEADER]: Received request to transfer leadership to TS 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:19.925379  3427 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.951391  3427 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:19.953584  3427 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:19.954403  3463 consensus_queue.cc:1048] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:19.875655  3528 raft_consensus.cc:515] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:19.959767  3528 leader_election.cc:290] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:19.960529  3528 raft_consensus.cc:2749] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:19.961529  3528 consensus_queue.cc:1059] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:19.963541 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:19.829424  3447 consensus_queue.cc:1059] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.116s
I20260709 13:10:19.970600  3447 raft_consensus.cc:3055] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:19.973147  3387 consensus_queue.cc:1048] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:19.932127  3237 raft_consensus.cc:697] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 12 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:19.810988  3571 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:19.826610  3535 consensus_queue.cc:1175] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "092f6eb694fc4bbeab49677cccd880fd" responder_term: 12 status { last_received { term: 12 index: 8 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 11. Current term is 12. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:19.975091 30441 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:19.981202 30542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 2454) took 1290 ms. Trace:
I20260709 13:10:19.981576 30542 rpcz_store.cc:276] 0709 13:10:18.690777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.951656 (+260879us) service_pool.cc:224] Handling call
0709 13:10:18.957128 (+  5472us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.854342 (+897214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.981002 (+126660us) spinlock_profiling.cc:243] Waited 896 ms on lock 0x7b540038c554. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:10:19.981153 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2061878016}
I20260709 13:10:19.930413  3588 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.931519  3519 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:19.944478  3359 raft_consensus.cc:2749] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:19.977007  3447 raft_consensus.cc:740] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:19.950533  3483 raft_consensus.cc:2749] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:19.978853  3576 raft_consensus.cc:2749] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:19.988493 30441 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:20.035952 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:20.036818 30546 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 17.
I20260709 13:10:19.985332  3568 raft_consensus.cc:2749] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:19.986495  3519 raft_consensus.cc:3060] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:20.038985 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:10:20.041070 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.047829 30616 raft_consensus.cc:1275] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:10:20.061697 30588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.073901 30619 raft_consensus.cc:1275] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:19.992990  3486 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.085280 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:20.040421  3460 raft_consensus.cc:2749] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:19.991859  3463 consensus_queue.cc:1048] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.090s
I20260709 13:10:20.077551  3439 consensus_queue.cc:1048] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:10:19.988106  3588 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:20.116628  3535 consensus_queue.cc:1059] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:20.126389  3565 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.126569 30547 raft_consensus.cc:1240] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:20.126969  3565 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:20.127565 30550 raft_consensus.cc:1240] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:20.129011  3565 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:20.129119  3420 raft_consensus.cc:3055] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:20.129550  3420 raft_consensus.cc:740] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
W20260709 13:10:20.129989  3593 log.cc:927] Time spent T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:10:20.130424  3420 consensus_queue.cc:260] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:20.133399  3400 consensus_queue.cc:1059] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:20.134758  3400 raft_consensus.cc:3055] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:20.135342  3400 raft_consensus.cc:740] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:20.136472  3400 consensus_queue.cc:260] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:20.138113  3400 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:20.140269  3062 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:20.140906  3062 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:20.081259  3237 consensus_queue.cc:237] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:20.080242  3576 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.154953 30621 raft_consensus.cc:1275] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:20.154950 30624 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 14.
I20260709 13:10:20.131654  3483 raft_consensus.cc:3055] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:20.095212  3444 raft_consensus.cc:493] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:20.189543  3062 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:20.092248  3486 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:20.192907 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:20.202287 31147 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 15.
I20260709 13:10:20.175087  3483 raft_consensus.cc:740] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
W20260709 13:10:20.203011 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 260802us
I20260709 13:10:20.165268  3576 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:20.212383 30590 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:20.212821 31115 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:20.219347 30547 raft_consensus.cc:1275] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:10:20.144842  3447 consensus_queue.cc:260] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:20.182117  3587 consensus_queue.cc:1048] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:10:20.181548  3444 raft_consensus.cc:515] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:20.229598  3407 raft_consensus.cc:2804] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:20.254024 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:20.200872  3545 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:20.263032  3407 raft_consensus.cc:697] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 14 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:20.268812  3407 consensus_queue.cc:237] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:20.276639  3484 raft_consensus.cc:2804] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:20.276767  3486 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:20.277027  3444 leader_election.cc:290] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:20.277124  3484 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:20.257215  3571 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:20.277609  3484 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:20.244392  3470 consensus_queue.cc:1048] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:10:20.261322  3483 consensus_queue.cc:260] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:20.281342 30545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35278 (request call id 1125) took 1173 ms. Trace:
I20260709 13:10:20.281783 30545 rpcz_store.cc:276] 0709 13:10:19.107805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.592902 (+485097us) service_pool.cc:224] Handling call
0709 13:10:19.595510 (+  2608us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:19.596070 (+   560us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:19.622349 (+ 26279us) log.cc:844] Serialized 14 byte log entry
0709 13:10:19.681964 (+ 59615us) spinlock_profiling.cc:243] Waited 9.62 ms on lock 0x7b180008df40. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e5de07 00007fc789cb8ab9 00007fc780e7a69b 00007fc780e7893f 00007fc780e7ac02 00007fc783b0220b 00007fc783b07d23 00007fc783b0823a 00007fc783f72a2a
0709 13:10:19.917251 (+235287us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:19.917795 (+   544us) log.cc:844] Serialized 52 byte log entry
0709 13:10:19.917919 (+   124us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:19.918114 (+   195us) log.cc:844] Serialized 14 byte log entry
0709 13:10:19.935167 (+ 17053us) log.cc:844] Serialized 14 byte log entry
0709 13:10:20.137110 (+201943us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b180008df40. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc780e7b522 00007fc780e7d7c1 00007fc780e7d779 00007fc780e7d709 00007fc780e7d6d1 00007fc780e7c9cd 000000000038f354 000000000038f199 00007fc780e5e83a
0709 13:10:20.182397 (+ 45287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:20.182503 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:20.281144 (+ 98641us) raft_consensus.cc:1685] finished
0709 13:10:20.281163 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:20.281286 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28635,"prepare.queue_time_us":45068,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":70,"raft.queue_time_us":46132,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":37891,"spinlock_wait_cycles":154828544,"thread_start_us":465851,"threads_started":2,"wal-append.queue_time_us":462932}
I20260709 13:10:20.284817 30542 raft_consensus.cc:1240] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:20.256210  3447 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:20.290817 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:20.302681 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:10:20.308868 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 274775us
I20260709 13:10:20.312822  3318 raft_consensus.cc:493] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:20.313393  3318 raft_consensus.cc:515] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:20.320510 30473 raft_consensus.cc:1275] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:20.321908 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:20.323849 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:20.324524 30467 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 15.
I20260709 13:10:20.326066 30589 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:20.326140  3610 consensus_queue.cc:1059] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:20.327735  3062 raft_consensus.cc:2804] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:20.328193  3588 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:20.328208  3062 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.329591  3062 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:20.330870 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:20.331615  3610 consensus_queue.cc:1243] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer 092f6eb694fc4bbeab49677cccd880fd log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:10:20.332302  3427 raft_consensus.cc:3055] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:20.332636  3427 raft_consensus.cc:740] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:20.333384  3427 consensus_queue.cc:260] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:20.326014  3545 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:20.334481  3427 raft_consensus.cc:3060] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:20.346740 30622 raft_consensus.cc:1240] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:20.346647 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:20.349697  3545 consensus_queue.cc:1059] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:10:20.356385 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.356531 30545 raft_consensus.cc:1275] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:20.362612 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:20.362805 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:20.364235 31149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:20.363320 30618 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 14.
I20260709 13:10:20.339915  3576 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:20.370589 30516 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:20.355289  3533 consensus_queue.cc:1048] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
W20260709 13:10:20.395113  3547 consensus_meta.cc:287] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.600s	user 0.011s	sys 0.000s
I20260709 13:10:20.383941  3545 raft_consensus.cc:2749] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:20.395568  3547 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:20.397699  3547 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 17 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:20.401001 30617 raft_consensus.cc:1275] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:20.359140  3519 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:20.425731  3519 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:10:20.428925  3613 log.cc:927] Time spent T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.103s	user 0.002s	sys 0.000s
I20260709 13:10:20.466926 30548 raft_consensus.cc:1240] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 16. Current term is 17. Ops: []
W20260709 13:10:20.476536 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 124758us
W20260709 13:10:20.480736 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.484465 30516 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:20.489059 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:20.415103  3318 leader_election.cc:290] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:20.512015  3447 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:20.513252 31149 raft_consensus.cc:1275] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:20.521160  3533 raft_consensus.cc:2804] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:20.521749  3533 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.522142  3533 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:20.533169  3603 consensus_queue.cc:1048] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:20.533864 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:20.513274  3447 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:20.541139  3447 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:20.541450 31147 raft_consensus.cc:1275] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:20.547164 31149 raft_consensus.cc:1275] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:10:20.552114  3623 log.cc:927] Time spent T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:10:20.510994  3360 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:20.557009 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 69065.5us
I20260709 13:10:20.560431 30546 raft_consensus.cc:1275] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:20.561638 30548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43088 (request call id 2523) took 1012 ms. Trace:
I20260709 13:10:20.562121 30548 rpcz_store.cc:276] 0709 13:10:19.549179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.770013 (+220834us) service_pool.cc:224] Handling call
0709 13:10:19.770272 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:20.468098 (+697826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:20.561305 (+ 93207us) spinlock_profiling.cc:243] Waited 696 ms on lock 0x7b54002571d4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:10:20.561561 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1600333184}
I20260709 13:10:20.565551  3519 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:20.566574  3519 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:20.568231  3564 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.569043  3564 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:20.570585  3519 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:20.565106  3360 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:20.576108 30623 raft_consensus.cc:1275] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:20.573797  3360 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:20.582136  3533 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:20.585137  3619 consensus_queue.cc:1048] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:20.586282  3610 consensus_queue.cc:1048] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:20.587016  3579 consensus_queue.cc:1048] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:20.571702  3384 raft_consensus.cc:993] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6: : Instructing follower 092f6eb694fc4bbeab49677cccd880fd to start an election
I20260709 13:10:20.571750  3564 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:20.592720  3384 raft_consensus.cc:1081] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 15 LEADER]: Signalling peer 092f6eb694fc4bbeab49677cccd880fd to start an election
I20260709 13:10:20.595645 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:20.574295  3519 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.606782  3535 consensus_queue.cc:1048] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:20.612166 30548 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:35278
I20260709 13:10:20.612299  3484 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:20.613094 30548 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:20.613524 30548 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:20.613722 30625 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 15.
I20260709 13:10:20.614014 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:10:20.617340 31115 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.621628 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:20.632243  3609 consensus_queue.cc:1048] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:20.621042  3484 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:20.638485  3533 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:20.676605  3150 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:20.677786  3150 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:20.684309  3420 raft_consensus.cc:3060] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:20.642588  3318 consensus_queue.cc:1059] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 13:10:20.685916  3519 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:20.700613 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:20.704717 30548 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:20.702312  3585 consensus_queue.cc:1059] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:10:20.713330  3602 log.cc:927] Time spent T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.381s	user 0.002s	sys 0.002s
I20260709 13:10:20.717274 31142 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 15.
I20260709 13:10:20.671106  3564 consensus_queue.cc:1048] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:10:20.707090 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:20.730829 30548 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:20.745380 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:20.746444 30621 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:20.762775 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:20.753302  3543 raft_consensus.cc:3055] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:20.694967  3360 consensus_queue.cc:1048] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:10:20.732326 30623 raft_consensus.cc:2468] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 12.
W20260709 13:10:20.797327 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:20.792156  3602 log.cc:927] Time spent T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:10:20.810613  3427 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:20.811717  3427 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:20.814980  3150 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:10:20.817090  3638 log.cc:927] Time spent T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:10:20.787716  3543 raft_consensus.cc:740] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
W20260709 13:10:20.819728 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 86629.4us
W20260709 13:10:20.824133 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 86390.7us
W20260709 13:10:20.831688  3598 log.cc:927] Time spent T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.496s	user 0.003s	sys 0.001s
I20260709 13:10:20.835278 30549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43088 (request call id 2527) took 1141 ms. Trace:
I20260709 13:10:20.835628 30549 rpcz_store.cc:276] 0709 13:10:19.694217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.861316 (+167099us) service_pool.cc:224] Handling call
0709 13:10:19.861708 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:19.862146 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:19.862186 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:19.907034 (+ 44848us) log.cc:844] Serialized 26 byte log entry
0709 13:10:20.214030 (+306996us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:20.214057 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:20.214103 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:20.800699 (+586596us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:10:20.834779 (+ 34080us) raft_consensus.cc:1685] finished
0709 13:10:20.834799 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:20.835083 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2014,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":131,"spinlock_wait_cycles":44764928,"thread_start_us":279123,"threads_started":1,"wal-append.queue_time_us":371234}
I20260709 13:10:20.836926  3483 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:10:20.839462 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 55379.4us
I20260709 13:10:20.845518  3605 raft_consensus.cc:493] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:20.846427  3605 raft_consensus.cc:515] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:20.848033 30441 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.842s	user 0.005s	sys 0.017s
W20260709 13:10:20.848385 30441 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.007s	sys 0.018s
I20260709 13:10:20.851289 30623 raft_consensus.cc:1275] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:10:20.851409  3604 raft_consensus.cc:3055] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:20.851977  3604 raft_consensus.cc:740] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:20.852977 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:20.853823 30549 raft_consensus.cc:2468] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 11.
I20260709 13:10:20.853217  3604 consensus_queue.cc:260] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:20.798259 31116 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:20.845618  3384 raft_consensus.cc:3055] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:20.853134 30544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39952 (request call id 2470) took 1085 ms. Trace:
I20260709 13:10:20.853356 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:20.857652 30619 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:20.797063  3519 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:20.867574 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:20.871863 30589 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:20.872917  3519 raft_consensus.cc:2804] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:20.876874  3605 leader_election.cc:290] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:10:20.877902  3062 consensus_meta.cc:287] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.527s	user 0.007s	sys 0.018s
W20260709 13:10:20.878860  3633 log.cc:927] Time spent T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:10:20.856814  3384 raft_consensus.cc:740] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
W20260709 13:10:20.866472 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 870485us
W20260709 13:10:20.881970 31113 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.868467  3604 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:10:20.894841 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 178513us
I20260709 13:10:20.898447 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:20.899375 30474 raft_consensus.cc:2393] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 10: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:20.904017 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:20.904587 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:20.905689 30590 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:20.907202  3484 raft_consensus.cc:2804] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:20.907974  3484 raft_consensus.cc:697] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:20.909701  3427 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:20.909469  3484 consensus_queue.cc:237] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:20.913113 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:20.916384 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:20.880620  3519 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.891661 30516 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:20.923765 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:20.924603 30516 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:20.879428  3543 consensus_queue.cc:260] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:20.932168 31116 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:20.933270  3150 raft_consensus.cc:2804] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:20.933729  3150 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.924849  3519 raft_consensus.cc:3060] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:20.934156  3150 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:20.942402  3556 raft_consensus.cc:2749] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:20.945230  3631 log.cc:927] Time spent T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:10:20.946252  3150 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:20.957872  3150 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 16 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:20.959942  3543 raft_consensus.cc:3060] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:20.967185 31142 raft_consensus.cc:3055] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:20.986325 31142 raft_consensus.cc:740] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:20.986522 30619 raft_consensus.cc:2468] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 16.
I20260709 13:10:20.968088 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:20.969005 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:20.987077 30621 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 15.
I20260709 13:10:20.969704 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:20.856985 30544 rpcz_store.cc:276] 0709 13:10:19.768081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.886852 (+118771us) service_pool.cc:224] Handling call
0709 13:10:19.887221 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:19.888298 (+  1077us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:19.888365 (+    67us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:19.919488 (+ 31123us) log.cc:844] Serialized 26 byte log entry
0709 13:10:20.245740 (+326252us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:20.256359 (+ 10619us) log.cc:844] Serialized 14 byte log entry
0709 13:10:20.256600 (+   241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:20.256666 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:20.702288 (+445622us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b4400022b4c. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780da1c85 00007fc780da26a2 00007fc783b141db 00007fc783b0faaf 00007fc783b0386e 00007fc783b02bb6 00007fc783b027d8 00007fc783b0c221 00007fc783b0c1d9 00007fc783b0c169
0709 13:10:20.852615 (+150327us) raft_consensus.cc:1685] finished
0709 13:10:20.852716 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:20.852941 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10368,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":7162,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":18799,"spinlock_wait_cycles":25937152,"thread_start_us":278988,"threads_started":1,"wal-append.queue_time_us":387198}
W20260709 13:10:20.979758 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 55232.4us
I20260709 13:10:20.969022 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:20.985787 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:20.985945  3559 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.992003  3559 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:20.994132 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:20.995157 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.926954  3579 raft_consensus.cc:2749] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:20.997007 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:21.000744 30516 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:20.992524 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:20.920202  3062 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:21.008915 30516 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:10:21.004325 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 274538us
I20260709 13:10:21.000335  3533 raft_consensus.cc:2804] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:21.016417 30470 raft_consensus.cc:3060] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:21.022104 30473 raft_consensus.cc:2393] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 15: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:21.025898 30474 raft_consensus.cc:2393] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 19: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:21.028415 30468 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:21.016531  3533 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:21.003971  3564 consensus_queue.cc:1048] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:10:21.022480  3579 raft_consensus.cc:2804] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:21.037689 30475 raft_consensus.cc:1240] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 13 LEADER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 12. Current term is 13. Ops: []
W20260709 13:10:21.038338  3636 log.cc:927] Time spent T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.218s	user 0.000s	sys 0.003s
W20260709 13:10:21.050457 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:21.052927  3629 log.cc:927] Time spent T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.228s	user 0.002s	sys 0.000s
I20260709 13:10:21.057845  3519 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:21.033456  3635 log.cc:927] Time spent T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.175s	user 0.003s	sys 0.003s
I20260709 13:10:21.036751  3533 raft_consensus.cc:3060] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:21.064415 31142 consensus_queue.cc:260] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:21.069732 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:21.084069 30471 raft_consensus.cc:2468] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 14.
I20260709 13:10:21.084522 31142 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:21.085126 30474 raft_consensus.cc:2468] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 8.
I20260709 13:10:21.093170 30619 raft_consensus.cc:1275] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:10:21.032792  3384 consensus_queue.cc:260] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:21.096808 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:21.108062 30475 raft_consensus.cc:1275] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:21.109097 30619 raft_consensus.cc:1240] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 14. Current term is 15. Ops: []
W20260709 13:10:21.111747 31116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:21.118510 30517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.106554  3552 raft_consensus.cc:2804] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:21.115208 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:10:21.134826 30439 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.143391 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:21.149533 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:21.151847 30468 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 16.
I20260709 13:10:21.156483  3062 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 18 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:21.161020  3519 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:21.191972  3571 consensus_queue.cc:1059] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.063s
I20260709 13:10:21.193063  3571 raft_consensus.cc:3055] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:21.193482  3571 raft_consensus.cc:740] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:21.194432  3571 consensus_queue.cc:260] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:21.196192  3384 raft_consensus.cc:3060] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:21.204389  3552 raft_consensus.cc:697] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 16 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:21.205587  3552 consensus_queue.cc:237] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:21.204314  3651 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.208262  3651 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:21.210614 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:21.211169 30545 raft_consensus.cc:3060] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:21.219132 30441 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:21.219863 30471 raft_consensus.cc:1275] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:10:21.224613 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:21.225692 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:21.226646 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:21.219969 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:21.227883 30467 raft_consensus.cc:2468] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 12.
I20260709 13:10:21.229038 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:21.220593  3651 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:21.233502  3062 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:21.234190  3062 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:21.220731 30473 raft_consensus.cc:1240] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:21.221047 30545 raft_consensus.cc:2468] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 12.
I20260709 13:10:21.132714 30469 raft_consensus.cc:2468] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 17.
I20260709 13:10:21.245357 30544 raft_consensus.cc:1275] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:21.249883  3559 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:21.251014 31116 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:21.252801  3559 raft_consensus.cc:2804] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:21.253286  3559 raft_consensus.cc:697] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 16 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:21.254216  3559 consensus_queue.cc:237] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:21.256955 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:21.259402 30367 catalog_manager.cc:5697] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 8 to 10, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 10 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:21.261289 30367 catalog_manager.cc:5697] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 7 to 8, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 8 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:21.264128 30589 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:21.259464 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:21.265051  3607 raft_consensus.cc:2804] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:21.265647  3607 raft_consensus.cc:697] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:21.266556  3607 consensus_queue.cc:237] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:21.265642 30619 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 15.
I20260709 13:10:21.273214  3605 raft_consensus.cc:2749] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:21.274029  3605 consensus_queue.cc:1048] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:21.263211 30367 catalog_manager.cc:5697] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 8 to 10, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 10 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:21.275436  3605 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.276309  3605 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:21.278599  3605 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:21.280346  3062 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:21.282207 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:21.282917 31147 raft_consensus.cc:2468] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 14.
I20260709 13:10:21.282140 30367 catalog_manager.cc:5697] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 13 to 16, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 16 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:21.285266 30367 catalog_manager.cc:5697] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 6 to 13, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 13 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:21.288209 30590 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:21.291424  3535 raft_consensus.cc:2804] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:21.291821  3535 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:21.292255  3535 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:21.195631  3571 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:21.299091 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:21.299945 30544 raft_consensus.cc:2393] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 14: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
W20260709 13:10:21.309021 30372 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57538 (request call id 304) took 30628 ms (client timeout 15000 ms). Trace:
I20260709 13:10:21.311501  3458 consensus_queue.cc:1048] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:10:21.313611 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.320052  3458 raft_consensus.cc:493] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:21.320685  3535 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:21.324369 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:21.331526 31147 raft_consensus.cc:2468] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 14.
I20260709 13:10:21.346719  3387 consensus_queue.cc:1048] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:21.347558 30590 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:21.341876  3588 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:21.348620  3588 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:21.350984  3588 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:21.351531 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:21.351976  3062 raft_consensus.cc:2804] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:21.352499  3062 raft_consensus.cc:697] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:21.353446  3062 consensus_queue.cc:237] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:21.354565  3549 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:21.355149  3549 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:21.342021 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:21.356227 30544 raft_consensus.cc:2393] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 14: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:21.357358  3484 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:21.357285  3549 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:21.358028  3484 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:21.358278 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:21.320734  3458 raft_consensus.cc:515] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:21.360312  3484 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:21.343148  3563 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:21.346019  3439 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:21.361057  3563 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:21.361475  3439 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:21.363204  3563 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:21.363436  3439 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:21.364274 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:21.364449  3458 leader_election.cc:290] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:21.364622  3484 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:21.365177  3484 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:21.365875 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:21.366460 30469 raft_consensus.cc:2468] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 17.
I20260709 13:10:21.367064  3484 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:21.367911 31116 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:21.379882 31142 raft_consensus.cc:2468] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 16.
I20260709 13:10:21.380252 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:21.381178 30472 raft_consensus.cc:2468] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 16.
I20260709 13:10:21.381495  3439 raft_consensus.cc:2804] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:21.381903  3439 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:21.382316  3439 raft_consensus.cc:3060] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:21.385046 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:21.382349 30470 raft_consensus.cc:2468] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 15.
I20260709 13:10:21.389039 30475 raft_consensus.cc:1275] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:21.395048  3519 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:21.395617  3519 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:21.397729  3519 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:21.384346  3535 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:21.409090 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:21.286952 30367 catalog_manager.cc:5697] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
I20260709 13:10:21.412598 30367 catalog_manager.cc:5697] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 12 to 15, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 15 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:21.285666  3533 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:21.417484  3533 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:21.432677  3533 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:21.433532 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.433353  3533 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:21.435622  3533 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:10:21.437438 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 88422.5us
I20260709 13:10:21.439953 30441 leader_election.cc:400] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 election: Vote denied by peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) with higher term. Message: Invalid argument: T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for earlier term 15. Current term is 16.
I20260709 13:10:21.440073  3458 raft_consensus.cc:493] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:21.440768  3458 raft_consensus.cc:515] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:21.441885  3563 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.442395  3563 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:21.443493  3458 leader_election.cc:290] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:21.444525  3563 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:21.446067 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:21.451902  3563 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.452482  3563 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:21.458021 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:21.460853  3563 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:21.414891 30367 catalog_manager.cc:5697] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:21.441150 30441 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:21.477340 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:10:21.504496 31116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:21.504977 31116 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.506070 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:21.522138  3444 raft_consensus.cc:2804] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:21.522646  3444 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:21.522997  3444 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:21.525072 31142 raft_consensus.cc:1240] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 16 LEADER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 15. Current term is 16. Ops: []
W20260709 13:10:21.309543 30372 rpcz_store.cc:269] 0709 13:09:50.680354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.012714 (+332360us) service_pool.cc:224] Handling call
0709 13:10:21.308827 (+30296113us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:18.088183 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:18.088711 (+   528us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:18.088752 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:10:18.088768 (+    16us) tablet.cc:662] Decoding operations
0709 13:10:18.089408 (+   640us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:18.089500 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:18.089526 (+    26us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:10:18.090046 (+   520us) tablet.cc:701] Row locks acquired
0709 13:10:18.090065 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:10:18.090195 (+   130us) write_op.cc:270] Start()
0709 13:10:18.090300 (+   105us) write_op.cc:276] Timestamp: P: 1783602618090149 usec, L: 0
0709 13:10:18.090323 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:10:18.189847 (+ 99524us) log.cc:844] Serialized 2069 byte log entry
0709 13:10:19.168110 (+978263us) op_driver.cc:464] REPLICATION: finished
0709 13:10:19.226196 (+ 58086us) write_op.cc:301] APPLY: starting
0709 13:10:19.226309 (+   113us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:19.322246 (+ 95937us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:19.322380 (+   134us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:19.365916 (+ 43536us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:19.388477 (+ 22561us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:10:19.409525 (+ 21048us) write_op.cc:312] APPLY: finished
0709 13:10:19.409761 (+   236us) log.cc:844] Serialized 57 byte log entry
0709 13:10:19.409959 (+   198us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:19.410058 (+    99us) write_op.cc:454] Released schema lock
0709 13:10:19.410097 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:19.437142 (+ 27045us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:19.455952 (+ 18810us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":22622,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":57774,"apply.run_cpu_time_us":9572,"apply.run_wall_time_us":197482,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25037,"num_ops":5,"prepare.queue_time_us":393227,"prepare.run_cpu_time_us":108787,"prepare.run_wall_time_us":448716,"raft.queue_time_us":198485,"raft.run_cpu_time_us":12886,"raft.run_wall_time_us":68836,"replication_time_us":1077611,"thread_start_us":865089,"threads_started":4,"wal-append.queue_time_us":463904,"wal-append.run_cpu_time_us":13688,"wal-append.run_wall_time_us":1771148}]]}
I20260709 13:10:21.528970 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:21.532852 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:10:21.533082 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:21.535969 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 94943.2us
I20260709 13:10:21.536863 30441 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:21.539155  3447 raft_consensus.cc:2749] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:21.541527 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:21.544019 30441 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:21.570883  3387 raft_consensus.cc:2749] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:21.573644  3519 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.588053 30543 raft_consensus.cc:1240] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 16 LEADER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 15. Current term is 16. Ops: []
W20260709 13:10:21.588977 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 45059.9us
I20260709 13:10:21.562762  3484 consensus_queue.cc:1059] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
W20260709 13:10:21.576640  3579 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.010s	sys 0.008s
W20260709 13:10:21.612372  3579 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.010s	sys 0.009s
I20260709 13:10:21.615235  3439 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:21.616463  3579 raft_consensus.cc:697] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 15 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:21.618394  3439 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 17 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:21.619065 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:21.587528  3519 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:21.639019 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.622850  3484 consensus_queue.cc:1243] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer cd669586cff44d4bbfcc007e213faab6 log is divergent from this leader: its last log entry 16.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:10:21.632066  3062 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:21.665216 30517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.573009 30367 catalog_manager.cc:5697] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 1 to 10. New cstate: current_term: 10 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
I20260709 13:10:21.681259 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:21.684244 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:21.685459 30468 raft_consensus.cc:1240] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:21.686801 30470 raft_consensus.cc:2393] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 15: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:21.688501 30472 raft_consensus.cc:2393] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 12: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:21.688012  3579 consensus_queue.cc:237] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:21.691198  3652 log.cc:927] Time spent T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:10:21.694024  3519 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:21.695107 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:21.698365  3624 raft_consensus.cc:3055] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:21.700997 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:21.701961 30474 raft_consensus.cc:1240] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 19 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 18. Current term is 19. Ops: [18.9-18.9]
I20260709 13:10:21.702441 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:21.702519 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:21.703331 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:21.704977 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:21.706018 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:21.707723 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:21.709321  3444 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:21.715797  3625 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.718256 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:21.720647 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:21.722090 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:21.722896 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:21.725373 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:21.725673 31114 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:21.725931 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:21.751883 31142 raft_consensus.cc:2468] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 12.
I20260709 13:10:21.726485 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:21.752763 30616 raft_consensus.cc:3060] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:21.732781 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:21.734220 30476 raft_consensus.cc:2468] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 17.
I20260709 13:10:21.742540 30471 raft_consensus.cc:2368] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 15. Current term is 16.
I20260709 13:10:21.745524 30472 raft_consensus.cc:2393] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 14: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:21.740736 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:21.750185 30545 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 19.
I20260709 13:10:21.741695 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:21.752894 30516 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:10:21.757261 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:21.681802  3062 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:21.760126 30589 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:21.740814  3624 raft_consensus.cc:740] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:21.762480 30551 raft_consensus.cc:2393] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 17: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:21.762807 30471 raft_consensus.cc:1275] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:21.769325 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:21.764493 31114 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:21.771114 30470 raft_consensus.cc:2368] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 15. Current term is 16.
I20260709 13:10:21.756054 30543 raft_consensus.cc:2468] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 12.
I20260709 13:10:21.768591 30475 raft_consensus.cc:1240] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 13. Current term is 15. Ops: []
I20260709 13:10:21.735966  3552 consensus_queue.cc:1048] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:10:21.775502  3427 raft_consensus.cc:2804] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:21.775889  3444 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:21.777858 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:21.789008 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:21.795179  3534 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:21.795387 31116 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:21.767242  3563 raft_consensus.cc:2749] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:21.796408  3571 raft_consensus.cc:2804] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:21.796736  3547 raft_consensus.cc:2804] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:21.796597  3534 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:21.804503 30551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:21.806890 30551 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:21.775913  3427 raft_consensus.cc:493] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:21.785933  3439 raft_consensus.cc:2749] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:10:21.810052 30517 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.173.1:43133 timed out after 2.240s (SENT) [suppressed 14 similar messages]
I20260709 13:10:21.820497 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:21.819867 30616 raft_consensus.cc:2468] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 13.
I20260709 13:10:21.825325 31114 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:21.808373  3571 raft_consensus.cc:697] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 17 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:21.812855  3427 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:21.787213  3625 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:21.797314  3624 consensus_queue.cc:260] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:21.844823 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:21.847162 30473 raft_consensus.cc:2393] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 12: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:21.849895 30619 raft_consensus.cc:2468] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 14.
I20260709 13:10:21.708567 30367 catalog_manager.cc:5697] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 9 to 13, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 13 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:21.851696 30516 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:21.841886  3549 raft_consensus.cc:2749] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:21.877241 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:21.878062 30473 raft_consensus.cc:2393] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 14: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
W20260709 13:10:21.881469 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.875237  3533 raft_consensus.cc:2804] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:10:21.893114 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 80826.6us
I20260709 13:10:21.878782  3662 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.900450 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:21.904270 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:21.880805  3624 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:21.917061 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 91835.9us
I20260709 13:10:21.917726 31114 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:21.936059 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:21.936131 31114 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:21.938800 31114 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:21.941144 31114 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:10:21.938194 30516 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:21.953429  3439 raft_consensus.cc:2804] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:21.953974  3439 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:21.954326  3439 raft_consensus.cc:3060] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:21.955874 30473 raft_consensus.cc:1275] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:10:21.968748 30551 raft_consensus.cc:2468] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 15.
I20260709 13:10:21.933152  3563 raft_consensus.cc:2749] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:21.978048 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:21.979247 30548 raft_consensus.cc:1275] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:10:21.979923 30618 raft_consensus.cc:1275] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:10:21.980062 30473 raft_consensus.cc:1240] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:21.981338 30468 raft_consensus.cc:3055] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:21.981669 30468 raft_consensus.cc:740] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:21.982334  3535 consensus_queue.cc:1048] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:21.982455 30468 consensus_queue.cc:260] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:21.984151 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:21.984233 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:21.985071 30476 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 19.
I20260709 13:10:21.986255 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:21.986931 30475 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 15.
I20260709 13:10:21.983692 30468 raft_consensus.cc:3060] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:21.979375 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:21.983479 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b0408011914710a008d9e9b58f002c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:21.947273  3559 raft_consensus.cc:2749] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:21.947027  3384 raft_consensus.cc:2749] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:21.971107  3648 raft_consensus.cc:2764] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:10:21.923777  3571 consensus_queue.cc:237] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:22.003921 30440 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.991901  3646 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.025714 30468 raft_consensus.cc:1275] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
W20260709 13:10:22.030654 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 72736.7us
I20260709 13:10:21.937494  3662 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:22.031419 30468 pending_rounds.cc:85] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326: Aborting all ops after (but not including) 7
I20260709 13:10:22.041472 30468 pending_rounds.cc:107] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:10:22.048835 30468 raft_consensus.cc:2889] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:22.051990 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 52422.6us
I20260709 13:10:22.052950  3685 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
W20260709 13:10:22.053269 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:22.065311 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 105610us
W20260709 13:10:22.070406 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.049263  3533 raft_consensus.cc:697] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 13 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:21.939857 30367 catalog_manager.cc:5697] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 7 to 10, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 10 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:22.033066  3646 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:22.074928  3535 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:22.093051  3671 log.cc:927] Time spent T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
W20260709 13:10:22.104179 30517 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.109050  3547 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.109699  3547 raft_consensus.cc:3060] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:22.066510  3685 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:22.079161  3384 consensus_queue.cc:1048] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:10:22.127251  3534 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:22.132129  3062 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:22.136066 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:22.136806 30549 raft_consensus.cc:2393] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 15: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:22.138438  3648 consensus_queue.cc:1048] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:22.140156 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:22.140753 31147 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 15.
I20260709 13:10:22.141810 30616 raft_consensus.cc:1240] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 18 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:22.144027  3646 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:22.095844  3625 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:22.145450 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:22.145093 30367 catalog_manager.cc:5697] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 10 to 11, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 11 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:22.150206  3662 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:10:22.152309  3669 log.cc:927] Time spent T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:10:22.152602 30616 raft_consensus.cc:1275] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:10:22.154853 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a439756f6e7242f8b5b1ef7ea97874d4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:22.154974  3685 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:22.156263 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:22.158280 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:22.160415 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:22.161510 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:22.161623 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:22.165693 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0273ed018424f3a9529e09669fdb7b0" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:22.167258 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:22.169229  3533 consensus_queue.cc:237] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:22.170306  3439 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:22.179744 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:22.180387 30616 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 15.
I20260709 13:10:22.182587 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:22.187466 30543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:22.196928 30551 raft_consensus.cc:1275] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:22.209028 30543 raft_consensus.cc:2393] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 14: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
W20260709 13:10:22.178020 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 106933us
W20260709 13:10:22.212222 30591 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.223867 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:22.226330 30542 raft_consensus.cc:1240] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 15 LEADER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:22.147290 30367 catalog_manager.cc:5697] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:22.234091 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:22.242826 31149 raft_consensus.cc:1240] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:22.174458  3535 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:22.221573 30440 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:22.248570 31142 raft_consensus.cc:1240] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 17 LEADER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:22.249492 30616 raft_consensus.cc:1240] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:10:22.255483 31143 raft_consensus.cc:1275] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:22.259555  3458 raft_consensus.cc:2804] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:22.260516  3458 raft_consensus.cc:697] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 15 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:22.261478  3458 consensus_queue.cc:237] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:22.262473 30367 catalog_manager.cc:5697] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:22.264014 30367 catalog_manager.cc:5697] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 8 to 11, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 11 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
I20260709 13:10:22.272537 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ec00010cf4415890c61ef6278cd0cd" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:22.275574 30517 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:10:22.276755 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 138885us
I20260709 13:10:22.277465  3646 raft_consensus.cc:2749] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:22.282701 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:22.283497 30469 raft_consensus.cc:2376] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 15. Re-sending same reply.
I20260709 13:10:22.288698  3653 consensus_queue.cc:1048] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:22.290890 30517 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:22.296190 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:22.296854 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:22.297456  3653 raft_consensus.cc:2749] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:22.298704 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fd6793fef04209ae40ee4d9ba90f42" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:22.299592 30470 raft_consensus.cc:3060] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:22.307185 30517 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:22.308668  3648 raft_consensus.cc:2749] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:22.309463  3648 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.309960  3648 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:22.312523 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:22.314030 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:22.314990 30476 raft_consensus.cc:2393] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 17: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:10:22.315320 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:22.313386 30470 raft_consensus.cc:2468] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 13.
I20260709 13:10:22.313491 30475 raft_consensus.cc:2393] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 15: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:22.317973  3648 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:22.319835 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:22.315985 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:22.320741 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:22.321331 30471 raft_consensus.cc:2376] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 14. Re-sending same reply.
I20260709 13:10:22.318866 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:22.329231  3552 consensus_queue.cc:1048] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:22.347857 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:22.351766  3535 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:22.356206  3683 consensus_queue.cc:1048] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:10:22.383924 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:22.386519 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:22.387440 30542 raft_consensus.cc:2468] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 14.
I20260709 13:10:22.272377  3439 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:22.394819 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:22.395421 30617 raft_consensus.cc:2468] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 14.
I20260709 13:10:22.394286 30591 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:22.421602 30589 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:22.422490 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
W20260709 13:10:22.416049  3427 consensus_meta.cc:287] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.578s	user 0.011s	sys 0.000s
W20260709 13:10:22.434597 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 127622us
I20260709 13:10:22.435328 30517 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:22.425791  3683 raft_consensus.cc:2749] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:22.445139 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:22.444339 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:22.456735 31149 raft_consensus.cc:1275] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:10:22.445773 31143 raft_consensus.cc:2468] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 14.
I20260709 13:10:22.458316 31142 raft_consensus.cc:1275] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:10:22.424400 30516 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:22.462184 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:22.462781 30620 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:22.463745 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 72963.4us
W20260709 13:10:22.474661 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 136177us
I20260709 13:10:22.443830  3484 raft_consensus.cc:2804] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:22.442090  3552 raft_consensus.cc:2749] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:10:22.477773 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 53472.7us
I20260709 13:10:22.433432  3427 raft_consensus.cc:515] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:22.479955  3484 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.486111 30617 raft_consensus.cc:1275] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:10:22.492107  3703 consensus_queue.cc:1059] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:22.493256  3703 raft_consensus.cc:3055] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:22.493595  3703 raft_consensus.cc:740] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:22.492162  3604 consensus_queue.cc:1048] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:10:22.494491 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 59230.7us
I20260709 13:10:22.494431  3703 consensus_queue.cc:260] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:22.495327 30517 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:22.496342 30591 leader_election.cc:400] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 15. Current term is 16.
I20260709 13:10:22.474326  3549 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.376910 30367 catalog_manager.cc:5697] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 7 to 13, leader changed from cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 13 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:22.486127  3484 raft_consensus.cc:3060] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:22.501571 30620 raft_consensus.cc:2468] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 15.
I20260709 13:10:22.484221  3533 raft_consensus.cc:2804] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:22.503073 30516 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:22.514335 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:22.515178  3678 raft_consensus.cc:2804] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:22.515614  3678 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.515969  3678 raft_consensus.cc:3060] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:22.498800  3552 raft_consensus.cc:2749] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:22.523164 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:22.505352  3703 raft_consensus.cc:3060] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:22.526516 30590 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.534011 30517 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
W20260709 13:10:22.539589  3692 log.cc:927] Time spent T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
W20260709 13:10:22.540987  3693 log.cc:927] Time spent T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:10:22.506474  3533 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
W20260709 13:10:22.594548 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 57671.1us
W20260709 13:10:22.595829  3699 log.cc:927] Time spent T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
W20260709 13:10:22.605427 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 127610us
I20260709 13:10:22.543515  3318 consensus_queue.cc:1048] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:10:22.501928  3549 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:22.512317  3648 consensus_queue.cc:1048] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
W20260709 13:10:22.598141  3700 log.cc:927] Time spent T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 13:10:22.518702  3604 consensus_queue.cc:1059] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
W20260709 13:10:22.671098 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 161028us
I20260709 13:10:22.682116 30441 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:10:22.677001  3624 consensus_meta.cc:287] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79: Time spent flushing consensus metadata: real 0.765s	user 0.001s	sys 0.011s
W20260709 13:10:22.685947 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 163836us
I20260709 13:10:22.687269 31148 raft_consensus.cc:2468] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 14.
I20260709 13:10:22.671181  3533 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:22.662813  3552 raft_consensus.cc:2749] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:22.681164  3547 consensus_meta.cc:287] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd: Time spent flushing consensus metadata: real 0.570s	user 0.015s	sys 0.004s
I20260709 13:10:22.691929 30441 leader_election.cc:304] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:22.692901 30625 raft_consensus.cc:1275] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:10:22.696125 30625 pending_rounds.cc:85] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79: Aborting all ops after (but not including) 11
I20260709 13:10:22.696386 30625 pending_rounds.cc:107] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:10:22.696640 30625 raft_consensus.cc:2889] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:22.688318  3690 log.cc:927] Time spent T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.262s	user 0.000s	sys 0.003s
I20260709 13:10:22.701985 30591 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:22.692205  3604 raft_consensus.cc:3055] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:22.713099 30441 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:22.712769  3704 raft_consensus.cc:2749] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:22.719485 30441 leader_election.cc:304] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:22.723260 30441 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:22.711980  3604 raft_consensus.cc:740] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:22.727658 30517 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:22.700534  3547 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:22.729422 30471 raft_consensus.cc:1275] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 17 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:10:22.728466 30441 leader_election.cc:304] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:22.730803  3707 raft_consensus.cc:2749] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:22.730842  3463 raft_consensus.cc:2749] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:22.731632  3707 raft_consensus.cc:2749] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:22.731318  3604 consensus_queue.cc:260] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:22.727671  3704 raft_consensus.cc:2749] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:22.732615  3604 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:22.734575  3702 log.cc:927] Time spent T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.156s	user 0.003s	sys 0.000s
W20260709 13:10:22.737550 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 44236.9us
W20260709 13:10:22.740477  3694 log.cc:927] Time spent T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.513s	user 0.003s	sys 0.001s
I20260709 13:10:22.741741 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:22.744596  3484 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:22.746660  3484 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:22.739315  3678 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:22.751549 30367 catalog_manager.cc:5697] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 11 to 12, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 12 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:22.753188 30367 catalog_manager.cc:5697] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 9 to 13, leader changed from cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 13 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:22.719599  3683 raft_consensus.cc:2749] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:22.729095  3427 leader_election.cc:290] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 20 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:22.767612 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:22.768406 30542 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:22.766903 30591 leader_election.cc:400] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 election: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 15. Current term is 16.
W20260709 13:10:22.829039 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 62268.1us
I20260709 13:10:22.832571  3708 consensus_queue.cc:1048] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:10:22.842933 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 151853us
I20260709 13:10:22.843847 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:22.844559 30550 raft_consensus.cc:2393] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 15: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:22.755069 30367 catalog_manager.cc:5697] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 11 to 13, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 13 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
W20260709 13:10:22.850054 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 121668us
I20260709 13:10:22.733342  3318 raft_consensus.cc:2749] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:22.853018 30441 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:22.854389 30546 raft_consensus.cc:2393] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 13: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:22.857347 30591 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:22.829753  3703 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:22.874594 30441 leader_election.cc:304] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:22.828325  3552 consensus_queue.cc:1048] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.118s
I20260709 13:10:22.828037  3624 consensus_queue.cc:1048] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:10:22.884122  3704 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:22.888074 30441 leader_election.cc:304] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:22.886117 30591 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:22.882249  3685 raft_consensus.cc:2749] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:22.884224  3458 raft_consensus.cc:2749] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:22.908649 30591 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:22.894346  3318 raft_consensus.cc:2749] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:10:22.914422 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 55824.4us
I20260709 13:10:22.917304  3725 raft_consensus.cc:2749] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:22.882527  3604 consensus_queue.cc:1059] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:10:22.946571  3604 raft_consensus.cc:3055] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:22.947063  3604 raft_consensus.cc:740] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:22.947919  3604 consensus_queue.cc:260] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:22.895838  3704 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:22.894078  3713 raft_consensus.cc:2804] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:10:22.960212 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 64961.7us
I20260709 13:10:22.913079  3684 raft_consensus.cc:2749] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:22.900259  3703 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:22.971089 30440 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
W20260709 13:10:22.973570  3700 log.cc:927] Time spent T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:10:22.972088  3062 raft_consensus.cc:2749] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:22.980957  3604 raft_consensus.cc:3060] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:23.001358 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 96949us
W20260709 13:10:23.002570 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 82905.5us
I20260709 13:10:23.004372 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:23.004882 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:23.005332 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:23.006094 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:22.995985  3707 raft_consensus.cc:2749] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:23.010658 30468 raft_consensus.cc:2410] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:10:23.019714  3704 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:23.008831  3678 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:23.023417 30469 raft_consensus.cc:2393] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 15: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:22.989851 30367 catalog_manager.cc:5697] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 12 to 15, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 15 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:23.025247 30367 catalog_manager.cc:5697] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 5 to 6, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 6 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:23.026845 30367 catalog_manager.cc:5697] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 5 to 12, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 12 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:23.032153  3547 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:23.034447  3662 raft_consensus.cc:493] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:23.048712  3662 raft_consensus.cc:515] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:23.049674  3483 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.036674  3703 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:23.050170  3483 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:23.050981  3662 leader_election.cc:290] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:23.047763 30542 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 20.
I20260709 13:10:23.078256 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:10:23.080838 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 70403.7us
I20260709 13:10:23.081622 30591 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:23.083523 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:23.084148 30471 raft_consensus.cc:2468] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 14.
I20260709 13:10:23.052183  3483 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:23.088678 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1270ad76798e4aea9d22209a726cc454" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:23.090775 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:23.094731  3721 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.095276  3721 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:23.097468  3721 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:23.098178 30625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57140 (request call id 1356) took 1299 ms. Trace:
I20260709 13:10:23.098542 30625 rpcz_store.cc:276] 0709 13:10:21.799237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.799421 (+   184us) service_pool.cc:224] Handling call
0709 13:10:21.817821 (+ 18400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:22.697420 (+879599us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.097949 (+400529us) spinlock_profiling.cc:243] Waited 875 ms on lock 0x7b5400163fd4. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f68e01 00007fc783f6783e 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6
0709 13:10:23.098107 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2011629440}
I20260709 13:10:23.104290  3533 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:23.110908  3701 log.cc:927] Time spent T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.428s	user 0.000s	sys 0.001s
I20260709 13:10:23.107220  3533 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:23.112272 30591 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:23.118958 30591 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:23.119936  3483 raft_consensus.cc:2749] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:23.120289 30591 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:23.120748  3483 raft_consensus.cc:2749] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:23.121363  3062 raft_consensus.cc:2749] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:23.128202 30548 raft_consensus.cc:1275] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:23.132709 30544 raft_consensus.cc:1240] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:23.077723 30367 catalog_manager.cc:5697] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 5 to 13, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 13 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:23.112895  3731 raft_consensus.cc:2749] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:23.081197  3547 raft_consensus.cc:493] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:23.152328 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:23.079124  3535 raft_consensus.cc:493] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:23.152016 30517 leader_election.cc:304] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:23.156706 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:23.161104 30625 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 15.
W20260709 13:10:23.166893 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 43960.2us
I20260709 13:10:23.168555 30591 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:23.169845 30591 leader_election.cc:304] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
W20260709 13:10:23.173621 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 325542us
I20260709 13:10:23.174875 31151 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:23.166428  3535 raft_consensus.cc:515] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:23.143497  3588 consensus_queue.cc:1048] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:10:23.157250 30476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7"
dest_uuid: "f639301059e24dc5b0d88a46dc683326"
mode: GRACEFUL
new_leader_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:52370
I20260709 13:10:23.171435  3648 raft_consensus.cc:2749] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:23.172717  3484 raft_consensus.cc:2804] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:23.195174 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:23.166222  3722 raft_consensus.cc:493] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:23.200917  3722 raft_consensus.cc:515] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:23.203132  3722 leader_election.cc:290] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:23.166677  3547 raft_consensus.cc:515] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:23.195840 30516 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:10:23.199903 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:23.207340 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 72106.9us
I20260709 13:10:23.206584 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:23.211796 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fac91e8417848ac93fdc9f02381d2d5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:23.212932 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "795e206cd48a484a88a226d02f465b8f" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:23.188602  3681 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.188832  3519 raft_consensus.cc:2749] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:23.214697 31149 raft_consensus.cc:1275] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 14. (term mismatch)
I20260709 13:10:23.256459 31149 pending_rounds.cc:85] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6: Aborting all ops after (but not including) 13
I20260709 13:10:23.256704 31149 pending_rounds.cc:107] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6: Aborting uncommitted NO_OP operation due to leader change: 14.14
I20260709 13:10:23.256932 31149 raft_consensus.cc:2889] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:23.252266 30616 raft_consensus.cc:1275] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:23.258566 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:23.259182 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:23.259537 30619 raft_consensus.cc:2393] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 15: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:10:23.275141 30476 raft_consensus.cc:606] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Received request to transfer leadership to TS 092f6eb694fc4bbeab49677cccd880fd
W20260709 13:10:23.275496 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 105695us
I20260709 13:10:23.276510 30591 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:23.275723 30476 raft_consensus.cc:614] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:23.250347 30590 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:23.282441 31144 raft_consensus.cc:2393] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 13: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:10:23.214176  3535 leader_election.cc:290] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:23.269493 31115 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:23.301327 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:23.206056  3484 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:23.312904  3484 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:23.313366  3724 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.314246  3660 raft_consensus.cc:493] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.314761  3660 raft_consensus.cc:515] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:23.316010 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 46662.4us
I20260709 13:10:23.313939  3724 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:23.195237  3713 raft_consensus.cc:697] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 14 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:23.316471 30367 catalog_manager.cc:5697] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 8 to 13, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 13 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:23.317376  3719 log.cc:927] Time spent T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.402s	user 0.003s	sys 0.007s
I20260709 13:10:23.332470  3713 consensus_queue.cc:237] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:23.333252 30367 catalog_manager.cc:5697] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 6 to 9, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 9 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
W20260709 13:10:23.339259 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 62843.1us
I20260709 13:10:23.340327 30591 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:23.341988 30591 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:23.213835  3734 raft_consensus.cc:2804] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:23.357156 30544 raft_consensus.cc:1275] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:10:23.365597 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 115358us
I20260709 13:10:23.334441  3708 raft_consensus.cc:2804] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:23.404003 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:23.274803  3533 consensus_queue.cc:1048] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.089s
I20260709 13:10:23.405447 31114 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:23.340324  3535 raft_consensus.cc:2749] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:23.344516  3062 raft_consensus.cc:2749] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:23.300542  3681 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:23.355165  3734 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting leader election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:23.414808 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:23.375973  3708 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.422824 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:23.410338  3534 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.411444  3607 raft_consensus.cc:2804] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:23.412302  3483 raft_consensus.cc:2749] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:23.355199  3731 consensus_queue.cc:1048] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:10:23.412283  3668 raft_consensus.cc:2749] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:10:23.438549 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 64073.5us
I20260709 13:10:23.458767 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:23.414269  3648 consensus_queue.cc:1048] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:10:23.459774 30471 raft_consensus.cc:2410] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:10:23.463629 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:23.464212 30469 raft_consensus.cc:3060] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:23.436172 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:23.433378  3708 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:23.422020  3734 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:23.468868 30471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:23.472158 30367 catalog_manager.cc:5697] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:23.473793 30367 catalog_manager.cc:5697] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
I20260709 13:10:23.462671  3534 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:23.477088 30542 raft_consensus.cc:2468] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 14.
I20260709 13:10:23.478103  3534 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:23.484800  3547 leader_election.cc:290] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:23.485307  3741 consensus_queue.cc:1048] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.074s
I20260709 13:10:23.487195  3660 leader_election.cc:290] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:23.472823  3549 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:10:23.488673  3738 log.cc:927] Time spent T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:10:23.492676 30367 catalog_manager.cc:5697] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 13 to 15, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 15 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
I20260709 13:10:23.455220  3607 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:23.506367 30472 raft_consensus.cc:1275] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:23.507620  3724 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:23.509930  3681 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:23.512445 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:23.515563 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:23.516775 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:23.518323 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:23.519553 30517 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:23.520733 30469 raft_consensus.cc:2468] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 15.
I20260709 13:10:23.522346 30517 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:23.539646 30616 raft_consensus.cc:2468] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 14.
I20260709 13:10:23.520133  3607 raft_consensus.cc:3060] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:23.538487  3678 raft_consensus.cc:2749] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:23.556430 31142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48414 (request call id 1194) took 1104 ms. Trace:
I20260709 13:10:23.558993 31142 rpcz_store.cc:276] 0709 13:10:22.445669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.445776 (+   107us) service_pool.cc:224] Handling call
0709 13:10:22.458043 (+ 12267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:22.458624 (+   581us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.549582 (+1090958us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b54006338d0. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc783ed1571 00007fc783f678ad 00007fc788f2c419 00007fc7824a3bd4 00007fc7824a3b62 00007fc7824a3a91 00007fc7824a3a0c 00007fc7824a2cc2 00007fc7822a348c 00007fc7822a28c6 00007fc7822a226f
0709 13:10:23.549710 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27611904}
W20260709 13:10:23.546267  3709 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.006s	sys 0.008s
I20260709 13:10:23.549068  3547 raft_consensus.cc:2749] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:23.569027  3683 consensus_queue.cc:1048] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
W20260709 13:10:23.574805  3698 log.cc:927] Time spent T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.977s	user 0.016s	sys 0.006s
I20260709 13:10:23.586930 30616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48914655f9d44751a883e36b566dcefd"
dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
mode: GRACEFUL
new_leader_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:49382
I20260709 13:10:23.587567 30616 raft_consensus.cc:606] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Received request to transfer leadership to TS f639301059e24dc5b0d88a46dc683326
I20260709 13:10:23.587894 30616 raft_consensus.cc:614] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:10:23.573154 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 106193us
I20260709 13:10:23.590353 30440 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:10:23.571377  3709 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.006s	sys 0.009s
I20260709 13:10:23.594363 30440 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:23.603968  3725 consensus_queue.cc:1048] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:23.620234 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6646800b690458391bbff6a6bba535c" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:10:23.622288 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 214945us
I20260709 13:10:23.624061 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:23.625056 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:23.628317 31150 raft_consensus.cc:2410] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:10:23.637559 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:23.648938 31114 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:10:23.649760  3439 raft_consensus.cc:2804] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:23.650170  3439 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.650496  3439 raft_consensus.cc:3060] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:23.657407 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 54250.2us
I20260709 13:10:23.658282 30440 leader_election.cc:304] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:23.662648 30622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:10:23.666589  3755 log.cc:927] Time spent T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:10:23.667753  3484 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:23.680986 30619 raft_consensus.cc:1240] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:23.692026  3724 raft_consensus.cc:2749] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:23.691896  3737 raft_consensus.cc:2749] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:23.653756  3571 consensus_queue.cc:1048] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 13:10:23.702039  3463 raft_consensus.cc:2749] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:23.705582  3484 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:23.706606 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
W20260709 13:10:23.710470  3740 log.cc:927] Time spent T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.545s	user 0.000s	sys 0.010s
I20260709 13:10:23.710243  3708 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:23.711412 31145 raft_consensus.cc:1240] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 15. Current term is 16. Ops: [15.14-15.14]
W20260709 13:10:23.721118 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 63866.7us
I20260709 13:10:23.732636  3760 consensus_queue.cc:1059] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:23.733781  3463 raft_consensus.cc:3055] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:23.734174  3463 raft_consensus.cc:740] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:23.735018  3463 consensus_queue.cc:260] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:23.736379  3463 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:23.737674 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "353e93aef12a4b92b159b611a66cf3c3" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:23.741349 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:23.752998  3707 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:23.754393  3707 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:23.761209  3707 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:10:23.776511 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 45524.1us
I20260709 13:10:23.781985  3607 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:23.784578  3607 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:23.785771 30625 raft_consensus.cc:2410] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:10:23.788281 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:23.789438 30549 raft_consensus.cc:2393] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 14: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:23.803949 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:23.809276  3734 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:23.817051 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:23.817967 30473 raft_consensus.cc:2393] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 15: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:23.817801 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:23.819409 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d5e1e5ef7e43bb80b43baf4b0d0ae4" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:23.817184 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e9b511085f1474dbeaa862dd7e9d278" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:23.820010 30470 raft_consensus.cc:3060] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:23.820497 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302637c04824f67b70df2f3ee95c130" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:23.822513 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:23.823701 30517 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:23.826910 30591 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:23.823701 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5610a33c644c4e539ad503631763aa40" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:23.838089 30468 raft_consensus.cc:2393] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 15: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:23.840420 30441 leader_election.cc:304] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:23.841773 30441 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:23.843248 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:23.846135 30517 leader_election.cc:304] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:23.846335 30591 leader_election.cc:304] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:23.859285 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:23.862972 30591 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:23.864190 30467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:23.865052 31115 leader_election.cc:304] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:23.869975  3549 raft_consensus.cc:2749] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:23.871367 31115 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:23.871908  3683 raft_consensus.cc:2749] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:23.872572  3752 raft_consensus.cc:2749] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:23.811723  3734 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:23.859678  3648 raft_consensus.cc:2804] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:23.867820  3483 raft_consensus.cc:2749] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:23.875911  3458 raft_consensus.cc:2804] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:23.868050  3680 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:23.859508  3741 consensus_queue.cc:1048] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.103s
I20260709 13:10:23.946702  3484 raft_consensus.cc:2749] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:23.945574  3549 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
W20260709 13:10:24.190225 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 315231us
I20260709 13:10:24.193861 30470 raft_consensus.cc:2468] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 20.
I20260709 13:10:24.202551 30591 leader_election.cc:304] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:23.947801  3534 raft_consensus.cc:2749] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:24.165813  3458 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:24.183475  3767 log.cc:927] Time spent T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.237s	user 0.000s	sys 0.000s
I20260709 13:10:24.064846  3708 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 16 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:24.166342  3648 raft_consensus.cc:697] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 15 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:24.193361  3680 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:24.221210  3680 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:10:24.222636  3764 log.cc:927] Time spent T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 13:10:24.211167  3458 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:24.233340  3696 raft_consensus.cc:493] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:24.233963  3696 raft_consensus.cc:515] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:24.206818  3483 raft_consensus.cc:2804] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:24.236605  3483 raft_consensus.cc:697] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 20 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:24.237425  3483 consensus_queue.cc:237] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:24.239985  3439 consensus_meta.cc:287] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6: Time spent flushing consensus metadata: real 0.589s	user 0.009s	sys 0.000s
I20260709 13:10:24.240398  3439 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:24.242362  3439 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:24.256314  3735 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:24.256875  3735 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:24.258869  3735 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:24.207242  3549 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:24.274870  3549 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:24.248059  3648 consensus_queue.cc:237] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:24.302852  3696 leader_election.cc:290] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:24.373067 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:24.372748 30516 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
W20260709 13:10:24.380242 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 88209.2us
W20260709 13:10:24.383849 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 182883us
I20260709 13:10:24.386675 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:24.391983 30617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:24.392397 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:24.393188 30620 raft_consensus.cc:3060] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:24.394191 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:24.386232 30589 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:24.397542 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:24.400895 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:24.401438 30546 raft_consensus.cc:3060] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:24.380813  3713 raft_consensus.cc:2749] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:24.408857 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1560cc6404764454b2843cec97934e6b" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:24.412307 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:24.402751  3761 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:24.423930  3761 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:24.426491  3761 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:24.427686  3458 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:24.429024 30470 raft_consensus.cc:1240] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Rejecting Update request from peer 092f6eb694fc4bbeab49677cccd880fd for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:24.430124  3458 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:24.447000 30546 raft_consensus.cc:2468] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 15.
I20260709 13:10:24.402575  3681 raft_consensus.cc:493] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:24.404954  3731 raft_consensus.cc:2749] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:24.447453 30516 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:24.459359 30620 raft_consensus.cc:2468] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 15.
I20260709 13:10:24.463269 31115 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:24.467905 31114 leader_election.cc:304] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:24.468953 30625 raft_consensus.cc:1275] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:24.473869  3695 raft_consensus.cc:2749] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:24.473940 31147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:24.474694 31147 raft_consensus.cc:2368] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 14. Current term is 15.
I20260709 13:10:24.476382 31146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:24.477777 31144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0"
dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
mode: GRACEFUL
new_leader_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:42956
I20260709 13:10:24.478296 31144 raft_consensus.cc:606] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Received request to transfer leadership to TS 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:24.478623 31144 raft_consensus.cc:614] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:24.481921 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:24.463234  3648 raft_consensus.cc:2749] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:24.491752 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:24.492563 30624 raft_consensus.cc:2376] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 15. Re-sending same reply.
I20260709 13:10:24.496932 31114 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:10:24.500037 30590 leader_election.cc:400] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 election: Vote denied by peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453) with higher term. Message: Invalid argument: T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 14. Current term is 15.
I20260709 13:10:24.500321 30590 leader_election.cc:403] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:10:24.510771  3585 raft_consensus.cc:2804] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:24.511348  3585 raft_consensus.cc:697] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 15 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:24.512269  3585 consensus_queue.cc:237] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:24.505717  3734 consensus_queue.cc:1059] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 13:10:24.462448  3681 raft_consensus.cc:515] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:24.534981  3780 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:24.536113  3734 consensus_queue.cc:1059] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:24.536449  3681 leader_election.cc:290] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:24.537235  3709 raft_consensus.cc:3055] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:24.537348  3646 raft_consensus.cc:3055] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:24.537626  3709 raft_consensus.cc:740] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:24.537771  3646 raft_consensus.cc:740] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:24.538553  3646 consensus_queue.cc:260] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:24.535560  3780 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:24.541790  3780 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:24.504127  3752 raft_consensus.cc:2749] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:24.538506  3709 consensus_queue.cc:260] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:24.545732  3709 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:24.548517  3722 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:24.549011  3722 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:24.555004 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 51477.9us
W20260709 13:10:24.557301 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 57396.5us
W20260709 13:10:24.558537 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 53979.3us
I20260709 13:10:24.559695 30548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:10:24.559953 30442 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.561882  3725 raft_consensus.cc:2749] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:24.576792  3721 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:24.580709  3721 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:24.582914  3721 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:24.576843 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606c3ee77596493da2daa40edde4d1ea" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:24.562026  3062 raft_consensus.cc:2749] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453) with higher term. Message: Invalid argument: T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 14. Current term is 15.
W20260709 13:10:24.610575 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 203763us
I20260709 13:10:24.612516 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:24.613535 30616 raft_consensus.cc:2393] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 13: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:10:24.619779 30517 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:24.621251 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:24.621573  3715 raft_consensus.cc:2749] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:24.623652  3579 consensus_queue.cc:1059] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:24.624286 30620 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:24.625480  3579 raft_consensus.cc:3055] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:24.625877  3579 raft_consensus.cc:740] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:24.627076  3579 consensus_queue.cc:260] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:24.628575  3579 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:24.635193 30616 raft_consensus.cc:1275] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:24.637252 30620 raft_consensus.cc:2468] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 15.
I20260709 13:10:24.608021  3682 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:24.700991 30467 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c504e96bd6f14a19b7dfe8203129e4b4"
dest_uuid: "f639301059e24dc5b0d88a46dc683326"
mode: GRACEFUL
new_leader_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:52370
I20260709 13:10:24.727082 30467 raft_consensus.cc:606] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Received request to transfer leadership to TS 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:24.727497 30467 raft_consensus.cc:614] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:24.661003 31114 leader_election.cc:304] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:24.728514 30441 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:24.712433  3648 raft_consensus.cc:493] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:24.709367  3710 raft_consensus.cc:493] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:24.709299  3653 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:24.704814  3709 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:24.704510  3780 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:24.720458 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:10:24.721046 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 76318.3us
I20260709 13:10:24.723274  3733 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
W20260709 13:10:24.728514 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 83204.4us
I20260709 13:10:24.704092  3585 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:24.716529  3731 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.734546 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:24.729970  3708 raft_consensus.cc:2749] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:24.741138  3731 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:24.737216  3648 raft_consensus.cc:515] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:24.756901 30546 raft_consensus.cc:2410] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:10:24.735432  3653 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:24.743779  3795 raft_consensus.cc:2749] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:24.726297  3682 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:24.765702 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772a658508f4465d8c1ef039f5bcaa67" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:24.761271 30441 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:24.760447 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:24.735868  3709 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:24.737838  3780 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:24.753074  3662 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.777496 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:24.737526  3733 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:24.789817 30468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:24.786631  3754 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.784090  3662 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:24.787536 29364 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:24.761394  3796 raft_consensus.cc:493] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:24.746068  3710 raft_consensus.cc:515] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:24.786182 30470 raft_consensus.cc:2468] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 12.
I20260709 13:10:24.746027  3585 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:24.801179  3648 leader_election.cc:290] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:24.775955  3784 raft_consensus.cc:2804] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:24.802657  3784 raft_consensus.cc:697] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 15 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:24.782830  3732 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.804008 30625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:24.804313 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:24.768201  3444 consensus_queue.cc:1048] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:10:24.803054  3710 leader_election.cc:290] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:24.804666  3796 raft_consensus.cc:515] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:24.824553 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:24.828383  3796 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:24.829784  3585 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:24.831241  3682 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:24.835826 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:24.850423 30475 raft_consensus.cc:1275] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 20 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:10:24.851904  3683 consensus_queue.cc:1048] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:24.852367  3662 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:24.854391 29364 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:24.794751  3754 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:24.862557  3754 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:24.863548 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:24.864233 30620 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 18.
I20260709 13:10:24.865234  3731 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:24.865833 30441 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:24.866974  3733 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:24.867100 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:24.868644  3709 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:24.868783 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:24.870236  3780 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:24.872140 30474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:24.818650  3784 consensus_queue.cc:237] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:24.812057  3732 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:24.878400  3732 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:24.878989 30468 raft_consensus.cc:2468] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 13.
I20260709 13:10:24.879360 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:24.880000 30620 raft_consensus.cc:2468] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 13.
I20260709 13:10:24.867573  3733 raft_consensus.cc:2804] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:24.881417 30441 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:24.881630  3733 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.882048  3733 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:10:24.886873  3799 log.cc:927] Time spent T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:10:24.887490 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:24.888805 31116 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:24.890133  3752 raft_consensus.cc:2749] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:24.890094 31116 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:24.890975  3780 raft_consensus.cc:493] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:24.891557  3752 raft_consensus.cc:2749] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:24.891615  3780 raft_consensus.cc:515] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:24.894152  3662 raft_consensus.cc:2804] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:24.894589  3662 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.894914  3662 raft_consensus.cc:3060] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:24.895385 31116 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:24.896504  3752 raft_consensus.cc:2749] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:24.897413  3722 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:24.898993  3780 leader_election.cc:290] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:24.912669 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:24.912887 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:24.913544 30549 raft_consensus.cc:2393] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 16: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:24.915786 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:24.916446 30472 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 16.
I20260709 13:10:24.917713 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:24.919605 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:24.920351 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf3769ea0a34be69a628c90f1f8a721" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:24.924113 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:24.926607 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:24.927042 30591 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:24.928058 30620 raft_consensus.cc:1275] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:24.931053  3484 raft_consensus.cc:2804] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:24.931427  3484 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:24.931779  3484 raft_consensus.cc:3060] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:24.936887  3646 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:24.938444  3761 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:24.938977  3761 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:24.941087  3761 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:24.942337  3653 leader_election.cc:290] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:24.943365 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:24.943776  3653 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:24.944525 30547 raft_consensus.cc:1240] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Rejecting Update request from peer fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:24.946847 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:24.945990  3653 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:24.948143 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:24.949506 30545 raft_consensus.cc:2410] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for term 19 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:10:24.950519  3607 consensus_queue.cc:1059] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:24.951558 30542 raft_consensus.cc:1275] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 20 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:10:24.951515  3607 raft_consensus.cc:3055] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:24.952311  3607 raft_consensus.cc:740] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:24.954708  3607 consensus_queue.cc:260] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:24.955492  3786 consensus_queue.cc:1048] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:24.956112  3607 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:24.960165 30591 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:24.965426 31114 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:24.968659 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:24.968942 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:24.970319 30470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:24.972035 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:24.972632 31143 raft_consensus.cc:2468] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 13.
I20260709 13:10:24.973506 30475 raft_consensus.cc:1275] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:24.975673 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b207fb799ce4340b29ae053898e0e6c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:24.977124  3761 raft_consensus.cc:2749] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:24.980398 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:24.980928  3662 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:24.983747 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:24.988237  3653 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:24.988513 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:24.993999 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:24.994194 30620 raft_consensus.cc:1275] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:24.995056 30547 raft_consensus.cc:2468] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 13.
I20260709 13:10:25.000207 30516 leader_election.cc:304] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:25.004304 31114 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:25.007900 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:25.011868 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:25.012225 30549 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 17.
I20260709 13:10:25.012403 31114 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:25.013897  3733 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:25.007396  3681 raft_consensus.cc:2749] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:25.013741  3559 consensus_queue.cc:1048] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:25.015687  3709 consensus_queue.cc:1048] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:25.011219  3780 raft_consensus.cc:2749] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:25.053004 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d5557143454f988a101125d3b5c0d7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:10:25.061605 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 48093.2us
I20260709 13:10:25.062309 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:25.062930 30542 raft_consensus.cc:2468] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 12.
I20260709 13:10:25.066752 30517 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:25.068677 30469 raft_consensus.cc:2393] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 19: Already voted for candidate f639301059e24dc5b0d88a46dc683326 in this term.
I20260709 13:10:25.072774 31142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ac231e47e64c0c9330e153212ca4b5" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:25.048494  3682 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:25.051488  3722 raft_consensus.cc:2749] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:25.078742  3733 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 19 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:25.078920 30517 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:25.080124 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:25.080850 30616 raft_consensus.cc:2393] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 18: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:10:25.081792  3741 raft_consensus.cc:2749] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:25.082319  3734 raft_consensus.cc:2804] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:25.082741  3734 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:25.082682  3780 consensus_queue.cc:1048] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:25.083282  3734 raft_consensus.cc:3060] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:25.084836 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f8b6eff35aa4b96bf5f73d6a94db695" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:25.076392 30441 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:24.974242  3484 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:25.098384 30516 leader_election.cc:304] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:25.099702 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:25.100054 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:25.100505  3733 raft_consensus.cc:2804] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:25.100644 30544 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:10:25.100962  3733 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.101383  3733 raft_consensus.cc:3060] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:25.106491 30516 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:25.106645  3780 raft_consensus.cc:2749] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:25.110590  3780 raft_consensus.cc:2749] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:25.112273  3662 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:25.117692 30544 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 19.
I20260709 13:10:25.115274  3734 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:25.119750 30549 raft_consensus.cc:3060] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:25.128324 30516 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:25.131650 30516 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:25.124315 30440 leader_election.cc:304] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:25.134269 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:25.134903 30618 raft_consensus.cc:3060] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:25.136304 30516 leader_election.cc:304] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:25.141319 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:25.141897 30624 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:25.145900 30620 raft_consensus.cc:1240] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 12. Current term is 13. Ops: []
W20260709 13:10:25.147101 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 48305us
I20260709 13:10:25.148914  3653 raft_consensus.cc:2749] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:25.149415 30618 raft_consensus.cc:2468] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 14.
I20260709 13:10:25.155329 30547 raft_consensus.cc:1275] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:25.161434  3484 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:25.177506  3733 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:25.180222 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:25.186092  3721 consensus_queue.cc:1059] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:25.187325  3588 raft_consensus.cc:3055] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:25.187723  3588 raft_consensus.cc:740] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:25.188611  3588 consensus_queue.cc:260] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:25.190030  3588 raft_consensus.cc:3060] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:25.138283  3709 raft_consensus.cc:2749] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:25.146381  3780 raft_consensus.cc:2749] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:25.204461  3734 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:25.213677  3733 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:25.224761 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:25.225811 30473 raft_consensus.cc:2368] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 13. Current term is 14.
I20260709 13:10:25.228449 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:25.229226 31143 raft_consensus.cc:3060] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:25.140384 30591 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
W20260709 13:10:25.236820 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 112595us
W20260709 13:10:25.246479 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 106205us
I20260709 13:10:25.252345 30624 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 19.
I20260709 13:10:25.264961 30549 raft_consensus.cc:2468] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 14.
I20260709 13:10:25.235801 30441 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:25.266501  3427 raft_consensus.cc:2749] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:25.282975 30517 leader_election.cc:400] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 election: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 13. Current term is 14.
I20260709 13:10:25.283473 30517 leader_election.cc:403] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:10:25.245949  3730 raft_consensus.cc:2749] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:25.296095 30440 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f639301059e24dc5b0d88a46dc683326; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:25.298394 30440 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:25.282894  3703 raft_consensus.cc:2804] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:25.351873 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:25.363974 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:25.302518  3760 raft_consensus.cc:2749] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:25.364580 30547 raft_consensus.cc:3060] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:25.349059  3444 raft_consensus.cc:2804] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:25.368927 30591 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:25.400305 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:25.401074 30621 raft_consensus.cc:2368] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 13. Current term is 14.
I20260709 13:10:25.366752  3703 raft_consensus.cc:697] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 14 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:25.403043 30516 leader_election.cc:400] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 election: Vote denied by peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851) with higher term. Message: Invalid argument: T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 13. Current term is 14.
I20260709 13:10:25.382122  3786 raft_consensus.cc:2749] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:25.382215  3691 raft_consensus.cc:2749] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd for earlier term 13. Current term is 14.
I20260709 13:10:25.412250  3444 raft_consensus.cc:697] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 19 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:25.444578 30547 raft_consensus.cc:2468] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 14.
I20260709 13:10:25.447249  3444 consensus_queue.cc:237] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:25.447716  3703 consensus_queue.cc:237] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:25.464219  3696 consensus_queue.cc:1048] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:25.468989  3682 raft_consensus.cc:2749] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:25.483596 31143 raft_consensus.cc:2468] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 14.
W20260709 13:10:25.498325  3807 log.cc:927] Time spent T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:10:25.604172 30441 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
W20260709 13:10:25.621054 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 194275us
W20260709 13:10:25.625823 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 201164us
W20260709 13:10:25.627578 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 201282us
I20260709 13:10:25.619865  3754 raft_consensus.cc:2804] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:10:25.690358  3808 log.cc:927] Time spent T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:10:25.718636  3653 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:25.792438 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 165821us
I20260709 13:10:25.752259  3653 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:25.828604  3534 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:25.866917 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 55849us
W20260709 13:10:25.868549 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 60829.9us
W20260709 13:10:25.870271  3809 log.cc:927] Time spent T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:10:25.892509 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:25.866189  3534 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:25.902859  3662 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:25.903439  3662 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:25.910712 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:25.911535 30542 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 16.
W20260709 13:10:25.919448  3818 log.cc:927] Time spent T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:10:25.922649 30440 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:25.937659  3662 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:25.941963  3534 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:25.944623 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
W20260709 13:10:25.944864  3819 log.cc:927] Time spent T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:10:25.945327 30472 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 16.
I20260709 13:10:25.958583 30545 raft_consensus.cc:1275] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 19 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:10:25.959592  3732 raft_consensus.cc:2804] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:25.960049  3732 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:25.960461  3732 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:25.970818 30545 raft_consensus.cc:1275] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:10:25.971215 30545 pending_rounds.cc:85] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd: Aborting all ops after (but not including) 7
I20260709 13:10:25.971410 30545 pending_rounds.cc:107] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:10:25.971612 30545 raft_consensus.cc:2889] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:25.989992  3653 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:26.001672 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:26.002597 31143 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 16.
I20260709 13:10:26.007067 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:26.007915 31143 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 16.
W20260709 13:10:26.015069 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 58523.3us
I20260709 13:10:26.007431 30516 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
W20260709 13:10:26.026526 30361 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 2b207fb799ce4340b29ae053898e0e6c with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica f639301059e24dc5b0d88a46dc683326 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:26.031625 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:26.032683 30623 raft_consensus.cc:2393] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 16: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:10:26.034338 30516 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:26.038650 30620 raft_consensus.cc:1275] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:10:26.039117  3795 consensus_queue.cc:1048] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:26.039996  3653 raft_consensus.cc:2804] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:26.040405  3653 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.040743  3786 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:26.041437  3786 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:26.044759 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:26.045331 30472 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 16.
I20260709 13:10:26.051285  3821 consensus_queue.cc:1048] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:26.040787  3653 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:26.057989 30619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:26.058606 30619 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 15.
I20260709 13:10:26.064936 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:26.072402  3732 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:26.051069  3786 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:26.088855 30545 raft_consensus.cc:2393] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 16: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:26.076822 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:26.090126 31148 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 16.
I20260709 13:10:26.068243 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:26.093466 30590 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:26.076498  3715 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.078320  3607 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:26.095242  3646 raft_consensus.cc:2804] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:26.091305  3754 raft_consensus.cc:697] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 14 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:26.109318  3427 raft_consensus.cc:2804] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:26.120344  3484 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.139420 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:26.135802  3821 consensus_queue.cc:1048] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:10:26.113188  3715 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:26.146170  3653 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:26.149638  3484 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:26.151074  3646 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.158444 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:26.162679 30616 raft_consensus.cc:1275] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 19 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:10:26.159144 30545 raft_consensus.cc:2468] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 15.
I20260709 13:10:26.119990  3607 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:26.168632  3607 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:26.169401  3732 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:26.137305  3427 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:26.172075  3427 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:26.175220 30623 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 15.
I20260709 13:10:26.165017 30589 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:26.179028 30544 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 16.
I20260709 13:10:26.181697 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:26.185973 30616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:26.187981 30616 raft_consensus.cc:2393] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 16: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:10:26.151755  3484 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:26.151654  3646 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:26.199071 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:26.200158 31145 raft_consensus.cc:2393] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 16: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:10:26.208339  3754 consensus_queue.cc:237] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:26.210692  3715 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:26.212126  3653 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 17 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:26.187711  3786 raft_consensus.cc:2804] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:26.213411  3786 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.213788  3786 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:26.197629  3725 consensus_queue.cc:1048] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:10:26.218499  3646 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:26.226251 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:26.226567 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:26.229992 30544 raft_consensus.cc:2368] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 16. Current term is 17.
I20260709 13:10:26.239116 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:26.239710 30473 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:26.240947 30589 leader_election.cc:400] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 16. Current term is 17.
I20260709 13:10:26.241299 30589 leader_election.cc:403] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:26.242548 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:26.243045 30620 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:10:26.244565 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:26.247077 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:26.247658 31148 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:26.251777 30440 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:26.254241  3820 raft_consensus.cc:2804] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:26.254727  3820 raft_consensus.cc:697] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 16 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:26.256456  3646 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 17 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:26.259280 30620 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 17.
I20260709 13:10:26.266080 30544 raft_consensus.cc:1275] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:26.263422  3823 raft_consensus.cc:2749] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 16. Current term is 17.
I20260709 13:10:26.255568  3820 consensus_queue.cc:237] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:26.286134  3786 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:26.287496 30621 raft_consensus.cc:2393] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 16: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:10:26.294575 31148 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 17.
I20260709 13:10:26.294420  3427 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:26.276171  3830 consensus_queue.cc:1048] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:10:26.303107 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:26.305789 30473 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 17.
I20260709 13:10:26.309485 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:26.304447  3786 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:26.310092 30549 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:26.314174 30516 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:26.315083  3655 raft_consensus.cc:2804] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:26.315768  3655 raft_consensus.cc:697] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 17 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:26.316855  3655 consensus_queue.cc:237] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:26.317749 30549 raft_consensus.cc:2468] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 16.
I20260709 13:10:26.325016 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:26.330969 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:26.333272 30544 raft_consensus.cc:2368] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 16. Current term is 17.
I20260709 13:10:26.332568 30516 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:26.333837 30589 leader_election.cc:304] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:26.335582 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:26.328996  3427 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:26.336268 30472 raft_consensus.cc:2368] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 16. Current term is 17.
I20260709 13:10:26.339551 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:26.341696  3822 raft_consensus.cc:2749] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:10:26.342234  3819 log.cc:927] Time spent T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.085s	user 0.004s	sys 0.000s
I20260709 13:10:26.352029  3800 raft_consensus.cc:2804] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:26.343281 30591 leader_election.cc:400] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 election: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 16. Current term is 17.
I20260709 13:10:26.356431 30591 leader_election.cc:403] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
W20260709 13:10:26.342335  3845 log.cc:927] Time spent T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326: Append to log took a long time: real 0.142s	user 0.002s	sys 0.003s
I20260709 13:10:26.361245  3800 raft_consensus.cc:697] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:26.362399  3800 consensus_queue.cc:237] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:26.366096  3731 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:26.377813 30589 leader_election.cc:400] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 election: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 16. Current term is 17.
I20260709 13:10:26.379824 31148 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 16.
I20260709 13:10:26.389585 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
W20260709 13:10:26.395391  3841 log.cc:927] Time spent T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd: Append to log took a long time: real 0.143s	user 0.003s	sys 0.008s
I20260709 13:10:26.400321 30621 raft_consensus.cc:1275] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:26.401000  3813 raft_consensus.cc:493] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fe2b7d73f8c743c1ba570cfd981c4e79)
I20260709 13:10:26.422606  3813 raft_consensus.cc:515] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:26.424876  3813 leader_election.cc:290] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:26.427736 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:26.430807  3703 consensus_queue.cc:1048] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:26.432197  3444 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:26.449568  3444 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:26.453089 30620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:26.453435 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:26.453871 30620 raft_consensus.cc:2393] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 13: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:10:26.454172 31148 raft_consensus.cc:2468] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 13.
I20260709 13:10:26.455729 30441 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:26.451702  3444 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:26.457322  3760 raft_consensus.cc:2804] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:26.457686  3760 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Starting leader election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:26.458087  3760 raft_consensus.cc:3060] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:26.464740  3731 raft_consensus.cc:2749] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133) with higher term. Message: Invalid argument: T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 for earlier term 16. Current term is 17.
I20260709 13:10:26.476611 30618 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 17.
I20260709 13:10:26.477417 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfc9f90b82b84a8cb47cbee7adb0401a" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:26.486442 30547 raft_consensus.cc:2368] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 15. Current term is 16.
I20260709 13:10:26.498822 31114 leader_election.cc:400] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 15. Current term is 16.
I20260709 13:10:26.499226 31114 leader_election.cc:403] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:26.500963 30516 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:26.505038  3813 raft_consensus.cc:3060] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:10:26.516870  3653 raft_consensus.cc:2804] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:26.523841  3813 raft_consensus.cc:2749] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733) with higher term. Message: Invalid argument: T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 for earlier term 15. Current term is 16.
I20260709 13:10:26.528039  3653 raft_consensus.cc:697] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 17 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:26.566277  3483 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.566838  3483 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:26.569119  3483 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:26.569459  3760 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:26.570518  3653 consensus_queue.cc:237] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:26.574024 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326" is_pre_election: true
I20260709 13:10:26.580587 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:26.582242 30545 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 16.
I20260709 13:10:26.594062 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:26.594810 30624 raft_consensus.cc:2393] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f639301059e24dc5b0d88a46dc683326 in current term 13: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:10:26.608534 30589 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:10:26.610718  3483 raft_consensus.cc:2804] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:26.611129  3483 raft_consensus.cc:493] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.611454  3483 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:26.626016 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:26.627468  3760 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:26.668215 31148 raft_consensus.cc:2468] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 13.
I20260709 13:10:26.662257  3483 raft_consensus.cc:515] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:26.669366 30441 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:26.672264  3754 raft_consensus.cc:2804] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:26.679942 30547 raft_consensus.cc:1275] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:26.680303  3754 raft_consensus.cc:697] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 13 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:26.681173  3754 consensus_queue.cc:237] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:26.681878  3703 consensus_queue.cc:1048] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:26.702273 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:26.704561 30545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fce027eac834298aeb0b5714096adb1" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:26.705173 30545 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:26.714623 30545 raft_consensus.cc:2468] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 17.
I20260709 13:10:26.715940 30589 leader_election.cc:304] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:10:26.702903  3483 leader_election.cc:290] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 17 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:26.720520  3731 raft_consensus.cc:2804] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:26.721128  3731 raft_consensus.cc:697] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:26.722091  3731 consensus_queue.cc:237] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:26.738263 30373 catalog_manager.cc:5697] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:26.751943 31148 raft_consensus.cc:1275] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:10:26.753755  3822 consensus_queue.cc:1048] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:26.756456 30621 raft_consensus.cc:1275] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:10:26.735591 30367 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57546 (request call id 308) took 10761 ms. Trace:
I20260709 13:10:26.758294  3655 consensus_queue.cc:1048] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.007s
I20260709 13:10:26.790871 31144 raft_consensus.cc:1275] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:26.792279 30624 raft_consensus.cc:1240] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 LEADER]: Rejecting Update request from peer f639301059e24dc5b0d88a46dc683326 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:26.794534  3828 consensus_queue.cc:1048] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:26.795965  3828 consensus_queue.cc:1059] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:10:26.798424  3828 consensus_queue.cc:1243] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Peer fe2b7d73f8c743c1ba570cfd981c4e79 log is divergent from this leader: its last log entry 17.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:10:26.798897  3703 raft_consensus.cc:3055] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:26.799242  3703 raft_consensus.cc:740] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:26.805635  3703 consensus_queue.cc:260] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:26.806964  3703 raft_consensus.cc:3060] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:26.782881 30367 rpcz_store.cc:276] 0709 13:10:15.981741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.040571 (+ 58830us) service_pool.cc:224] Handling call
0709 13:10:26.735514 (+10694943us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:24.251106 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:24.251795 (+   689us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:24.264776 (+ 12981us) write_op.cc:435] Acquired schema lock
0709 13:10:24.264797 (+    21us) tablet.cc:662] Decoding operations
0709 13:10:24.266783 (+  1986us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:24.266871 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:24.266906 (+    35us) tablet.cc:685] Acquiring locks for 28 operations
0709 13:10:24.348537 (+ 81631us) tablet.cc:701] Row locks acquired
0709 13:10:24.348587 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:10:24.348799 (+   212us) write_op.cc:270] Start()
0709 13:10:24.349014 (+   215us) write_op.cc:276] Timestamp: P: 1783602624348721 usec, L: 0
0709 13:10:24.349058 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 13:10:24.433236 (+ 84178us) log.cc:844] Serialized 10984 byte log entry
0709 13:10:25.404238 (+971002us) op_driver.cc:464] REPLICATION: finished
0709 13:10:25.817887 (+413649us) write_op.cc:301] APPLY: starting
0709 13:10:25.824974 (+  7087us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:26.105660 (+280686us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:26.106997 (+  1337us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:26.390784 (+283787us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:26.391216 (+   432us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=56,key_file_lookups=56,delta_file_lookups=56,mrs_lookups=0
0709 13:10:26.391279 (+    63us) write_op.cc:312] APPLY: finished
0709 13:10:26.395939 (+  4660us) log.cc:844] Serialized 244 byte log entry
0709 13:10:26.417330 (+ 21391us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:26.417567 (+   237us) write_op.cc:454] Released schema lock
0709 13:10:26.417656 (+    89us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:26.418182 (+   526us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:26.418221 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":224020,"reported_tablets":48,"spinlock_wait_cycles":13056,"child_traces":[["op",{"apply.queue_time_us":381121,"apply.run_cpu_time_us":38616,"apply.run_wall_time_us":613911,"cfile_cache_hit":114,"cfile_cache_hit_bytes":121223,"num_ops":28,"prepare.queue_time_us":407538,"prepare.run_cpu_time_us":91189,"prepare.run_wall_time_us":360802,"raft.queue_time_us":586805,"raft.run_cpu_time_us":25121,"raft.run_wall_time_us":372876,"replication_time_us":1031514,"spinlock_wait_cycles":33024,"thread_start_us":1242666,"threads_started":5,"wal-append.queue_time_us":297811,"wal-append.run_cpu_time_us":128323,"wal-append.run_wall_time_us":1549605}]]}
I20260709 13:10:26.900427 31145 raft_consensus.cc:1275] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:10:26.904220  3731 consensus_queue.cc:1048] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:10:26.899870  3861 log.cc:927] Time spent T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:10:26.979992 30546 raft_consensus.cc:1275] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:10:26.981612  3800 consensus_queue.cc:1048] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:26.993089 31143 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:26.996268 30624 raft_consensus.cc:1275] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:10:26.999209  3734 consensus_queue.cc:1048] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:27.022506 30472 raft_consensus.cc:1275] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 17 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:10:27.059229 31143 raft_consensus.cc:1275] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:10:27.066061  3653 consensus_queue.cc:1048] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
W20260709 13:10:27.124378 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 63453.1us
W20260709 13:10:27.118672  3863 log.cc:927] Time spent T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:10:27.150879 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:10:27.151654 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 86991.7us
I20260709 13:10:27.140717  3655 consensus_queue.cc:1048] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
W20260709 13:10:27.205207 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 45707.6us
W20260709 13:10:27.231712  3871 log.cc:927] Time spent T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79: Append to log took a long time: real 0.085s	user 0.002s	sys 0.000s
W20260709 13:10:27.280077 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 190783us
I20260709 13:10:27.312083 30618 raft_consensus.cc:1275] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:10:27.326262 30545 raft_consensus.cc:1275] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:10:27.383173  3888 consensus_queue.cc:1048] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:10:27.453029 31144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a418ef882d34180817469c4e2495268"
dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
mode: GRACEFUL
new_leader_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:42956
I20260709 13:10:27.457417 31144 raft_consensus.cc:606] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 13 LEADER]: Received request to transfer leadership to TS 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:27.468118 31144 raft_consensus.cc:1275] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:10:27.479990 30618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39a5f6c7a19c4fd59922a13945641151"
dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
mode: GRACEFUL
new_leader_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:49382
I20260709 13:10:27.480549 30618 raft_consensus.cc:606] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Received request to transfer leadership to TS 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:27.480849 30618 raft_consensus.cc:614] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:10:27.483610 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 126445us
I20260709 13:10:27.503957 31145 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e"
dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
mode: GRACEFUL
new_leader_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:42956
I20260709 13:10:27.504518 31145 raft_consensus.cc:606] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 16 LEADER]: Received request to transfer leadership to TS f639301059e24dc5b0d88a46dc683326
I20260709 13:10:27.542491  3703 consensus_queue.cc:1048] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:10:27.552024 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 196974us
I20260709 13:10:27.576699 31145 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7"
dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
mode: GRACEFUL
new_leader_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:42956
I20260709 13:10:27.579547 31145 raft_consensus.cc:606] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 8 LEADER]: Received request to transfer leadership to TS f639301059e24dc5b0d88a46dc683326
I20260709 13:10:27.582115  3820 consensus_queue.cc:1048] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:27.589916 30472 raft_consensus.cc:1275] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 17 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 13:10:27.590272 30472 pending_rounds.cc:85] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326: Aborting all ops after (but not including) 11
I20260709 13:10:27.590487 30472 pending_rounds.cc:107] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 13:10:27.590701 30472 raft_consensus.cc:2889] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:27.603740  3876 consensus_queue.cc:1048] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 13:10:27.624060 31144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb22806325394ba386d8549bc4a64701"
dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
mode: GRACEFUL
new_leader_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:42956
I20260709 13:10:27.670897 30367 catalog_manager.cc:5697] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:27.674814 30367 catalog_manager.cc:5697] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 13 to 16, leader changed from cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 16 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:27.682920  3696 raft_consensus.cc:993] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6: : Instructing follower 092f6eb694fc4bbeab49677cccd880fd to start an election
I20260709 13:10:27.777454  3696 raft_consensus.cc:1081] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 13 LEADER]: Signalling peer 092f6eb694fc4bbeab49677cccd880fd to start an election
I20260709 13:10:27.683545  3810 raft_consensus.cc:993] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6: : Instructing follower f639301059e24dc5b0d88a46dc683326 to start an election
I20260709 13:10:27.734126 31144 raft_consensus.cc:606] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Received request to transfer leadership to TS f639301059e24dc5b0d88a46dc683326
I20260709 13:10:27.778687  3810 raft_consensus.cc:1081] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 16 LEADER]: Signalling peer f639301059e24dc5b0d88a46dc683326 to start an election
I20260709 13:10:27.779866 30545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a418ef882d34180817469c4e2495268"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:35278
I20260709 13:10:27.780470 30545 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:27.780835 30545 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:27.780890 30469 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e"
dest_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:60026
I20260709 13:10:27.781491 30469 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:27.781847 30469 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:27.778810 31144 raft_consensus.cc:614] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:27.789410 30545 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:27.796049 31145 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6646800b690458391bbff6a6bba535c"
dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
mode: GRACEFUL
new_leader_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:42956
I20260709 13:10:27.796622 31145 raft_consensus.cc:606] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Received request to transfer leadership to TS f639301059e24dc5b0d88a46dc683326
I20260709 13:10:27.796905 31145 raft_consensus.cc:614] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:27.798121 29364 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:10:27.799782 29364 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:10:27.763051 30373 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57542 (request call id 301) took 57331 ms (client timeout 15000 ms). Trace:
W20260709 13:10:27.800194 30373 rpcz_store.cc:269] 0709 13:09:30.431324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.431568 (+   244us) service_pool.cc:224] Handling call
0709 13:10:27.762948 (+57331380us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:26.876443 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:26.876976 (+   533us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:26.877008 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:10:26.877026 (+    18us) tablet.cc:662] Decoding operations
0709 13:10:26.889980 (+ 12954us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:26.890061 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:26.890099 (+    38us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:10:26.921534 (+ 31435us) tablet.cc:701] Row locks acquired
0709 13:10:26.932069 (+ 10535us) write_op.cc:260] PREPARE: finished
0709 13:10:26.943546 (+ 11477us) write_op.cc:270] Start()
0709 13:10:26.945093 (+  1547us) write_op.cc:276] Timestamp: P: 1783602626942845 usec, L: 0
0709 13:10:26.945135 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 13:10:26.979785 (+ 34650us) log.cc:844] Serialized 533 byte log entry
0709 13:10:27.184080 (+204295us) op_driver.cc:464] REPLICATION: finished
0709 13:10:27.371125 (+187045us) write_op.cc:301] APPLY: starting
0709 13:10:27.375599 (+  4474us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:27.481344 (+105745us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:27.481448 (+   104us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:27.489668 (+  8220us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:27.504604 (+ 14936us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:10:27.504659 (+    55us) write_op.cc:312] APPLY: finished
0709 13:10:27.504845 (+   186us) log.cc:844] Serialized 25 byte log entry
0709 13:10:27.505003 (+   158us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:27.505075 (+    72us) write_op.cc:454] Released schema lock
0709 13:10:27.505114 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:27.505506 (+   392us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:27.505544 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":178226,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":169452,"apply.run_cpu_time_us":3826,"apply.run_wall_time_us":141184,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8309,"num_ops":1,"prepare.queue_time_us":38047,"prepare.run_cpu_time_us":2902,"prepare.run_wall_time_us":103649,"replication_time_us":238790,"thread_start_us":131954,"threads_started":2}]]}
I20260709 13:10:27.809146 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:27.811766 30476 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:27.819411 30476 raft_consensus.cc:2468] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 14.
I20260709 13:10:27.823956 30517 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:27.810060 30367 catalog_manager.cc:5697] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 12 to 15, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 15 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:27.824812  3653 raft_consensus.cc:2804] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:27.810881 30469 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:27.827380 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:27.827877 30476 raft_consensus.cc:1240] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Rejecting Update request from peer cd669586cff44d4bbfcc007e213faab6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:27.828498 30623 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:27.829857 30469 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 17 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:27.825037 30367 catalog_manager.cc:5697] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 10 to 14, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 14 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
I20260709 13:10:27.825374  3653 raft_consensus.cc:697] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 14 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:27.830621  3887 consensus_queue.cc:1059] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:27.831629  3887 raft_consensus.cc:3055] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:27.831382  3653 consensus_queue.cc:237] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:27.832013  3887 raft_consensus.cc:740] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:27.832813  3887 consensus_queue.cc:260] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:27.833928  3887 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:27.838927 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:27.839543 31145 raft_consensus.cc:3055] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:27.839882 31145 raft_consensus.cc:740] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:27.842012 30623 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 17.
I20260709 13:10:27.845475 30441 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:27.846338  3703 raft_consensus.cc:2804] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:27.846808  3703 raft_consensus.cc:697] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 17 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:27.847645  3703 consensus_queue.cc:237] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:27.861137  3696 raft_consensus.cc:993] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6: : Instructing follower f639301059e24dc5b0d88a46dc683326 to start an election
I20260709 13:10:27.861625  3883 raft_consensus.cc:1081] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 8 LEADER]: Signalling peer f639301059e24dc5b0d88a46dc683326 to start an election
I20260709 13:10:27.864696 30472 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7"
dest_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:60026
I20260709 13:10:27.865259 30472 raft_consensus.cc:493] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:27.865587 30472 raft_consensus.cc:3060] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:27.842856 31145 consensus_queue.cc:260] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:27.843887 30367 catalog_manager.cc:5697] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 13 to 15, leader changed from cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 15 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:27.877111 31145 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:27.878615 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:27.877863 30367 catalog_manager.cc:5697] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 11 to 12, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 12 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
I20260709 13:10:27.880931 30367 catalog_manager.cc:5697] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 13 to 16, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 16 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
I20260709 13:10:27.882139 30367 catalog_manager.cc:5697] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:27.883313 30367 catalog_manager.cc:5697] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 9 to 16, leader changed from cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 16 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:27.888999 30367 catalog_manager.cc:5697] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
I20260709 13:10:27.891093 30545 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:27.890129 30367 catalog_manager.cc:5697] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 14 to 18, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 18 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:27.892778 30472 raft_consensus.cc:515] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:27.894302 30367 catalog_manager.cc:5697] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 10 to 17, leader changed from cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 17 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:27.895630 30367 catalog_manager.cc:5697] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 10 to 14, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 14 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
I20260709 13:10:27.897123 30367 catalog_manager.cc:5697] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 8 to 13, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 13 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
I20260709 13:10:27.898312 30367 catalog_manager.cc:5697] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 15 to 17, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 17 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
I20260709 13:10:27.899600 30367 catalog_manager.cc:5697] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 12 to 15, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 15 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
I20260709 13:10:27.900804 30367 catalog_manager.cc:5697] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 9 to 13, leader changed from cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 13 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:27.902189 30367 catalog_manager.cc:5697] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 13 to 15, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 15 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
I20260709 13:10:27.903350 30367 catalog_manager.cc:5697] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 13 to 20, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 20 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:27.904719 30367 catalog_manager.cc:5697] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 8 to 15. New cstate: current_term: 15 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
I20260709 13:10:27.910699 30472 leader_election.cc:290] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 election: Requested vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:27.914439 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:27.916004 30623 raft_consensus.cc:3060] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:27.918708 31143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:27.919283 31143 raft_consensus.cc:3055] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:27.919503 31143 raft_consensus.cc:740] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:27.921057 30367 catalog_manager.cc:5697] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 5 to 13, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 13 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
I20260709 13:10:27.922398 30367 catalog_manager.cc:5697] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } attrs { replace: true } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:27.923360 30623 raft_consensus.cc:2468] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9.
I20260709 13:10:27.925272 31143 consensus_queue.cc:260] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:27.926502 31143 raft_consensus.cc:3060] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:27.927393 30441 leader_election.cc:304] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:27.928752  3893 raft_consensus.cc:2804] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:27.929234  3893 raft_consensus.cc:697] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 9 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:27.930079  3893 consensus_queue.cc:237] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:27.934257 30367 catalog_manager.cc:5697] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 6 to 10, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 10 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:27.936467 31144 raft_consensus.cc:2468] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 14.
I20260709 13:10:27.936220 30367 catalog_manager.cc:5697] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 13 to 17, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 17 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:27.937546 30367 catalog_manager.cc:5697] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 13 to 15, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 15 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
I20260709 13:10:27.945737 31145 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 17.
I20260709 13:10:27.939925 30367 catalog_manager.cc:5697] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 13 to 14, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 14 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
I20260709 13:10:27.946969 31143 raft_consensus.cc:2468] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 9.
I20260709 13:10:27.949746 30367 catalog_manager.cc:5697] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 12 to 13, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 13 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
I20260709 13:10:27.953238 30367 catalog_manager.cc:5697] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 11 to 16, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 16 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
I20260709 13:10:27.978520 30367 catalog_manager.cc:5697] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 12 to 15, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 15 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:27.980075 30367 catalog_manager.cc:5697] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:27.981348 30367 catalog_manager.cc:5697] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 10 to 14, leader changed from fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 14 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:27.982672 30367 catalog_manager.cc:5697] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 15 to 19, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 19 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } }
I20260709 13:10:27.984061 30367 catalog_manager.cc:5697] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 10 to 11, leader changed from cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 11 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:27.985625 30367 catalog_manager.cc:5697] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 6 to 15, leader changed from cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 15 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:28.314778 31145 raft_consensus.cc:1275] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:10:28.317632  3893 consensus_queue.cc:1048] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:28.329638 30624 raft_consensus.cc:1275] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:10:28.331600  3893 consensus_queue.cc:1048] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:28.434065 30476 raft_consensus.cc:1275] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:10:28.435460  3880 consensus_queue.cc:1048] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:28.441322 30367 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57546 (request call id 309) took 1402 ms. Trace:
I20260709 13:10:28.441754 30367 rpcz_store.cc:276] 0709 13:10:27.038894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.039045 (+   151us) service_pool.cc:224] Handling call
0709 13:10:27.182227 (+143182us) spinlock_profiling.cc:243] Waited 24.8 ms on lock 0x7b540033ff90. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780e43b71 00007fc780e440b2 00007fc789dbda89 00007fc789d55da6 00007fc789d27088 00007fc789e2537e 00007fc7882e62a4 00007fc7882e6232 00007fc7882e6161 00007fc7882e60dc
0709 13:10:28.441226 (+1258999us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:28.023945 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:28.024537 (+   592us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:28.024576 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:10:28.024596 (+    20us) tablet.cc:662] Decoding operations
0709 13:10:28.027171 (+  2575us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:28.027258 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:28.027288 (+    30us) tablet.cc:685] Acquiring locks for 34 operations
0709 13:10:28.030092 (+  2804us) tablet.cc:701] Row locks acquired
0709 13:10:28.030115 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:10:28.030266 (+   151us) write_op.cc:270] Start()
0709 13:10:28.030383 (+   117us) write_op.cc:276] Timestamp: P: 1783602628030221 usec, L: 0
0709 13:10:28.030414 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:10:28.031131 (+   717us) log.cc:844] Serialized 13294 byte log entry
0709 13:10:28.076130 (+ 44999us) op_driver.cc:464] REPLICATION: finished
0709 13:10:28.113491 (+ 37361us) write_op.cc:301] APPLY: starting
0709 13:10:28.113575 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:28.175909 (+ 62334us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:28.176010 (+   101us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:28.261093 (+ 85083us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:28.261511 (+   418us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=68,key_file_lookups=68,delta_file_lookups=68,mrs_lookups=0
0709 13:10:28.261567 (+    56us) write_op.cc:312] APPLY: finished
0709 13:10:28.262114 (+   547us) log.cc:844] Serialized 292 byte log entry
0709 13:10:28.262284 (+   170us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:28.262532 (+   248us) write_op.cc:454] Released schema lock
0709 13:10:28.262618 (+    86us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:28.262982 (+   364us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:28.263010 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":40,"spinlock_wait_cycles":56960896,"child_traces":[["op",{"apply.queue_time_us":37108,"apply.run_cpu_time_us":38879,"apply.run_wall_time_us":149488,"cfile_cache_hit":138,"cfile_cache_hit_bytes":146315,"num_ops":34,"prepare.queue_time_us":7664,"prepare.run_cpu_time_us":7342,"prepare.run_wall_time_us":16934,"replication_time_us":45550,"thread_start_us":42726,"threads_started":2}]]}
I20260709 13:10:28.448896 31144 raft_consensus.cc:1275] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:10:28.456813  3877 consensus_queue.cc:1048] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:10:28.504717 31143 raft_consensus.cc:1275] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:10:28.518486 30374 catalog_manager.cc:5697] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 8 to 9, leader changed from cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 9 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:28.523934 30618 raft_consensus.cc:1275] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:10:28.541890 30374 catalog_manager.cc:5697] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:28.541941  3795 consensus_queue.cc:1048] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:10:28.569483  3893 consensus_queue.cc:1048] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:28.778258 30367 catalog_manager.cc:5697] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } attrs { replace: true } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:28.779937 30367 catalog_manager.cc:5697] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 16 to 17, leader changed from cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 17 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:28.781792 30367 catalog_manager.cc:5697] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 12 to 13, leader changed from cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 13 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:28.800884 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:10:28.865767 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 44061.8us
W20260709 13:10:28.917069 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 214153us
W20260709 13:10:29.000545 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 109554us
I20260709 13:10:29.040154 30370 catalog_manager.cc:5697] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 7 to 9, leader changed from cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 9 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:29.043344 30370 catalog_manager.cc:5697] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 7 to 10, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 10 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:29.048656 30370 catalog_manager.cc:5697] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 13 to 14, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 14 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:29.057947 30370 catalog_manager.cc:5697] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 9 to 11, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 11 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:29.048991 30367 catalog_manager.cc:5697] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 8 to 9, leader changed from cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 9 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:29.071973 30370 catalog_manager.cc:5697] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 8 to 11, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 11 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:29.073757 30370 catalog_manager.cc:5697] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
W20260709 13:10:29.084182 30374 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47208 (request call id 188) took 48933 ms (client timeout 15000 ms). Trace:
W20260709 13:10:29.116546 30374 rpcz_store.cc:269] 0709 13:09:40.151324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.155993 (+  4669us) service_pool.cc:224] Handling call
0709 13:09:40.210509 (+ 54516us) spinlock_profiling.cc:243] Waited 5.56 ms on lock 0x7b540033ff90. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780e43b71 00007fc780e440b2 00007fc789dbda89 00007fc789d55da6 00007fc789d27088 00007fc789e2537e 00007fc7882e62a4 00007fc7882e6232 00007fc7882e6161 00007fc7882e60dc
0709 13:10:28.894474 (+48683965us) spinlock_profiling.cc:243] Waited 3.22 ms on lock 0x7b6800058160. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d210ca 00007fc789d1f808 00007fc789d1de40 00007fc789e25c3e 00007fc7882e62a4 00007fc7882e6232 00007fc7882e6161 00007fc7882e60dc 00007fc7882e5392 00007fc7822a348c
0709 13:10:29.084114 (+189640us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:28.685921 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:28.687448 (+  1527us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:28.687494 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:10:28.687511 (+    17us) tablet.cc:662] Decoding operations
0709 13:10:28.688021 (+   510us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:28.688070 (+    49us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:28.688096 (+    26us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:10:28.688405 (+   309us) tablet.cc:701] Row locks acquired
0709 13:10:28.688421 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:10:28.688565 (+   144us) write_op.cc:270] Start()
0709 13:10:28.688659 (+    94us) write_op.cc:276] Timestamp: P: 1783602628688523 usec, L: 0
0709 13:10:28.688679 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:10:28.689289 (+   610us) log.cc:844] Serialized 913 byte log entry
0709 13:10:28.755162 (+ 65873us) op_driver.cc:464] REPLICATION: finished
0709 13:10:28.755565 (+   403us) write_op.cc:301] APPLY: starting
0709 13:10:28.755670 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:28.757224 (+  1554us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:28.757316 (+    92us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:28.763786 (+  6470us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:28.763955 (+   169us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:10:28.763998 (+    43us) write_op.cc:312] APPLY: finished
0709 13:10:28.764190 (+   192us) log.cc:844] Serialized 33 byte log entry
0709 13:10:28.765289 (+  1099us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:28.765370 (+    81us) write_op.cc:454] Released schema lock
0709 13:10:28.765407 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:28.765760 (+   353us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:28.765786 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":151316,"reported_tablets":33,"spinlock_wait_cycles":20202112,"child_traces":[["op",{"apply.queue_time_us":107,"apply.run_cpu_time_us":4249,"apply.run_wall_time_us":10171,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8364,"num_ops":2,"prepare.queue_time_us":96065,"prepare.run_cpu_time_us":2740,"prepare.run_wall_time_us":3668,"replication_time_us":66336,"thread_start_us":51760,"threads_started":1}]]}
I20260709 13:10:29.212209 30368 catalog_manager.cc:5697] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 9 to 11, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 11 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:29.218506 30368 catalog_manager.cc:5697] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 10 to 12, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 12 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:29.247356 30370 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57542 (request call id 303) took 17121 ms (client timeout 15000 ms). Trace:
W20260709 13:10:29.247788 30370 rpcz_store.cc:269] 0709 13:10:12.126429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.126631 (+   202us) service_pool.cc:224] Handling call
0709 13:10:29.247287 (+17120656us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:29.128563 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:29.129091 (+   528us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:29.129124 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:10:29.129137 (+    13us) tablet.cc:662] Decoding operations
0709 13:10:29.129919 (+   782us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:29.129971 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:29.129998 (+    27us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:10:29.130503 (+   505us) tablet.cc:701] Row locks acquired
0709 13:10:29.130517 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:10:29.130654 (+   137us) write_op.cc:270] Start()
0709 13:10:29.130760 (+   106us) write_op.cc:276] Timestamp: P: 1783602629130610 usec, L: 0
0709 13:10:29.130784 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:10:29.131324 (+   540us) log.cc:844] Serialized 2434 byte log entry
0709 13:10:29.146290 (+ 14966us) op_driver.cc:464] REPLICATION: finished
0709 13:10:29.146678 (+   388us) write_op.cc:301] APPLY: starting
0709 13:10:29.146747 (+    69us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:29.149640 (+  2893us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:29.149724 (+    84us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:29.156420 (+  6696us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:29.156623 (+   203us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:10:29.156665 (+    42us) write_op.cc:312] APPLY: finished
0709 13:10:29.156906 (+   241us) log.cc:844] Serialized 65 byte log entry
0709 13:10:29.157689 (+   783us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:29.157808 (+   119us) write_op.cc:454] Released schema lock
0709 13:10:29.157855 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:29.172072 (+ 14217us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:29.172106 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":205834,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":213,"apply.run_cpu_time_us":7748,"apply.run_wall_time_us":25323,"cfile_cache_hit":24,"cfile_cache_hit_bytes":25092,"num_ops":6,"prepare.queue_time_us":114,"prepare.run_cpu_time_us":3056,"prepare.run_wall_time_us":16142,"replication_time_us":15372}]]}
I20260709 13:10:29.310668 30369 catalog_manager.cc:5697] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
W20260709 13:10:29.363132 30368 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47208 (request call id 189) took 28982 ms (client timeout 15000 ms). Trace:
W20260709 13:10:29.363773 30368 rpcz_store.cc:269] 0709 13:10:00.380719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.383356 (+  2637us) service_pool.cc:224] Handling call
0709 13:10:01.022662 (+639306us) spinlock_profiling.cc:243] Waited 5.48 ms on lock 0x7b540033ff90. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc780d03db1 00007fc780e43b71 00007fc780e440b2 00007fc789dbda89 00007fc789d55da6 00007fc789d27088 00007fc789e2537e 00007fc7882e62a4 00007fc7882e6232 00007fc7882e6161 00007fc7882e60dc
0709 13:10:29.363042 (+28340380us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:29.246805 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:29.247315 (+   510us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:29.247349 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:10:29.247362 (+    13us) tablet.cc:662] Decoding operations
0709 13:10:29.247760 (+   398us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:29.247836 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:29.247876 (+    40us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:10:29.248174 (+   298us) tablet.cc:701] Row locks acquired
0709 13:10:29.248191 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:10:29.248318 (+   127us) write_op.cc:270] Start()
0709 13:10:29.248418 (+   100us) write_op.cc:276] Timestamp: P: 1783602629248279 usec, L: 0
0709 13:10:29.248450 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:10:29.248991 (+   541us) log.cc:844] Serialized 913 byte log entry
0709 13:10:29.250787 (+  1796us) op_driver.cc:464] REPLICATION: finished
0709 13:10:29.251180 (+   393us) write_op.cc:301] APPLY: starting
0709 13:10:29.251249 (+    69us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:29.252850 (+  1601us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:29.252977 (+   127us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:29.254434 (+  1457us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:29.254609 (+   175us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:10:29.254652 (+    43us) write_op.cc:312] APPLY: finished
0709 13:10:29.254825 (+   173us) log.cc:844] Serialized 33 byte log entry
0709 13:10:29.255001 (+   176us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:29.255087 (+    86us) write_op.cc:454] Released schema lock
0709 13:10:29.255129 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:29.255451 (+   322us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:29.255482 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8921,"reported_tablets":35,"spinlock_wait_cycles":12605312,"child_traces":[["op",{"apply.queue_time_us":213,"apply.run_cpu_time_us":4194,"apply.run_wall_time_us":4207,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8364,"num_ops":2,"prepare.queue_time_us":334,"prepare.run_cpu_time_us":2422,"prepare.run_wall_time_us":2422,"replication_time_us":2238}]]}
I20260709 13:10:29.410040 30546 consensus_queue.cc:237] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:29.430884 30369 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57538 (request call id 305) took 16381 ms (client timeout 15000 ms). Trace:
W20260709 13:10:29.431434 30369 rpcz_store.cc:269] 0709 13:10:13.071904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:13.087370 (+ 15466us) service_pool.cc:224] Handling call
0709 13:10:29.430807 (+16343437us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:29.373764 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:29.374305 (+   541us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:29.374338 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:10:29.374355 (+    17us) tablet.cc:662] Decoding operations
0709 13:10:29.374712 (+   357us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:29.374761 (+    49us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:29.374787 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:10:29.374962 (+   175us) tablet.cc:701] Row locks acquired
0709 13:10:29.374990 (+    28us) write_op.cc:260] PREPARE: finished
0709 13:10:29.375124 (+   134us) write_op.cc:270] Start()
0709 13:10:29.375232 (+   108us) write_op.cc:276] Timestamp: P: 1783602629375080 usec, L: 0
0709 13:10:29.375254 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:10:29.376050 (+   796us) log.cc:844] Serialized 533 byte log entry
0709 13:10:29.384478 (+  8428us) spinlock_profiling.cc:243] Waited 3.7 ms on lock 0x7b1800437560. stack: 00007fc780e49343 00007fc780e49240 00007fc7807d81d4 00007fc78a516304 00007fc78a516299 00007fc789d43de1 00007fc789d505b1 00007fc78799f41d 00007fc7879a171a 00007fc7879a16a8 00007fc7879a1628 00007fc7879a15e3 00007fc7879a07fc 00007fc789dd3626 00007fc789dcddd8 00007fc783f74310
0709 13:10:29.384544 (+    66us) op_driver.cc:464] REPLICATION: finished
0709 13:10:29.385049 (+   505us) write_op.cc:301] APPLY: starting
0709 13:10:29.385144 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:29.386054 (+   910us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:29.386078 (+    24us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:29.386854 (+   776us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:29.387037 (+   183us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:10:29.387094 (+    57us) write_op.cc:312] APPLY: finished
0709 13:10:29.387297 (+   203us) log.cc:844] Serialized 25 byte log entry
0709 13:10:29.387483 (+   186us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:29.387573 (+    90us) write_op.cc:454] Released schema lock
0709 13:10:29.387620 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:29.388069 (+   449us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:29.388134 (+    65us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":371408,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":265,"apply.run_cpu_time_us":2904,"apply.run_wall_time_us":2938,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4182,"num_ops":1,"prepare.queue_time_us":100,"prepare.run_cpu_time_us":2430,"prepare.run_wall_time_us":2591,"replication_time_us":2874,"spinlock_wait_cycles":8500992}]]}
I20260709 13:10:29.427655 30371 catalog_manager.cc:5697] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:29.474464 31143 raft_consensus.cc:1275] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:10:29.461586 30371 catalog_manager.cc:5697] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:29.476989  3937 consensus_queue.cc:1048] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:29.477407 30623 raft_consensus.cc:1275] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:10:29.479223  3937 consensus_queue.cc:1048] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:29.476711 30371 catalog_manager.cc:5697] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 9 to 12, leader changed from cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 12 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:29.489264 30371 catalog_manager.cc:5697] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 11 to 12, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 12 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:29.490885 30371 catalog_manager.cc:5697] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 14 to 16, leader changed from cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 16 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:29.503702 30371 catalog_manager.cc:5697] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 15 to 16, leader changed from cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 16 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:29.505273 30371 catalog_manager.cc:5697] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 9 to 14, leader changed from cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 14 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:29.536813  3878 raft_consensus.cc:2955] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index 3 to 12, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:29.546818 31144 raft_consensus.cc:2955] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 3 to 12, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:29.604882 30359 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f6fb8561d12345948ed56d359f5ef4f3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:29.622493 30621 raft_consensus.cc:2955] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 3 to 12, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:29.649996 30373 catalog_manager.cc:5697] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 10 to 12, leader changed from cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 12 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:29.654022 30373 catalog_manager.cc:5697] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 16 to 17, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 17 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:29.655558 30371 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47208 (request call id 190) took 8687 ms. Trace:
I20260709 13:10:29.655965 30371 rpcz_store.cc:276] 0709 13:10:20.960683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.961055 (+   372us) service_pool.cc:224] Handling call
0709 13:10:29.647746 (+8686691us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:29.536089 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:29.536666 (+   577us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:29.536706 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:10:29.536726 (+    20us) tablet.cc:662] Decoding operations
0709 13:10:29.537572 (+   846us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:29.537636 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:29.537667 (+    31us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:10:29.538269 (+   602us) tablet.cc:701] Row locks acquired
0709 13:10:29.538286 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:10:29.538429 (+   143us) write_op.cc:270] Start()
0709 13:10:29.538546 (+   117us) write_op.cc:276] Timestamp: P: 1783602629538382 usec, L: 0
0709 13:10:29.538565 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:10:29.539251 (+   686us) log.cc:844] Serialized 2814 byte log entry
0709 13:10:29.546810 (+  7559us) op_driver.cc:464] REPLICATION: finished
0709 13:10:29.553059 (+  6249us) write_op.cc:301] APPLY: starting
0709 13:10:29.553150 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:29.569415 (+ 16265us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:29.569506 (+    91us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:29.597638 (+ 28132us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:29.597833 (+   195us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 13:10:29.597880 (+    47us) write_op.cc:312] APPLY: finished
0709 13:10:29.598163 (+   283us) log.cc:844] Serialized 73 byte log entry
0709 13:10:29.598353 (+   190us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:29.598467 (+   114us) write_op.cc:454] Released schema lock
0709 13:10:29.602398 (+  3931us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:29.602777 (+   379us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:29.602807 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":21873,"reported_tablets":35,"child_traces":[["op",{"apply.queue_time_us":5997,"apply.run_cpu_time_us":10210,"apply.run_wall_time_us":49668,"cfile_cache_hit":28,"cfile_cache_hit_bytes":29274,"num_ops":7,"prepare.queue_time_us":5559,"prepare.run_cpu_time_us":3492,"prepare.run_wall_time_us":11129,"replication_time_us":8089}]]}
I20260709 13:10:29.665547 30373 catalog_manager.cc:5697] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 12 to 13, leader changed from cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 13 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:29.672367 30373 catalog_manager.cc:5697] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 11 to 14, leader changed from cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 14 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:29.682098 30373 catalog_manager.cc:5697] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 8 to 10, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 10 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:29.764603 30369 catalog_manager.cc:5697] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: config changed from index 3 to 12, VOTER f639301059e24dc5b0d88a46dc683326 (127.28.173.1) evicted. New cstate: current_term: 17 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:29.798800 30464 tablet_service.cc:1558] Processing DeleteTablet for tablet f6fb8561d12345948ed56d359f5ef4f3 with delete_type TABLET_DATA_TOMBSTONED (TS f639301059e24dc5b0d88a46dc683326 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:53858
I20260709 13:10:29.800305 30371 catalog_manager.cc:5697] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 13 to 14, leader changed from cd669586cff44d4bbfcc007e213faab6 (127.28.173.4) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 14 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:29.826611  3945 tablet_replica.cc:333] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:29.890652  3945 raft_consensus.cc:2243] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:29.891361  3945 raft_consensus.cc:2272] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:29.894438  3945 ts_tablet_manager.cc:1916] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:29.912992 30373 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57538 (request call id 306) took 1793 ms. Trace:
I20260709 13:10:29.913659 30373 rpcz_store.cc:276] 0709 13:10:28.119980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.120104 (+   124us) service_pool.cc:224] Handling call
0709 13:10:29.912916 (+1792812us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:29.729117 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:29.729668 (+   551us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:29.729702 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:10:29.729718 (+    16us) tablet.cc:662] Decoding operations
0709 13:10:29.730305 (+   587us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:29.730359 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:29.730384 (+    25us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:10:29.730889 (+   505us) tablet.cc:701] Row locks acquired
0709 13:10:29.730905 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:10:29.731028 (+   123us) write_op.cc:270] Start()
0709 13:10:29.731137 (+   109us) write_op.cc:276] Timestamp: P: 1783602629730987 usec, L: 0
0709 13:10:29.731160 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:10:29.731742 (+   582us) log.cc:844] Serialized 2054 byte log entry
0709 13:10:29.735722 (+  3980us) op_driver.cc:464] REPLICATION: finished
0709 13:10:29.736164 (+   442us) write_op.cc:301] APPLY: starting
0709 13:10:29.736238 (+    74us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:29.739012 (+  2774us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:29.739102 (+    90us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:29.744781 (+  5679us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:29.744985 (+   204us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:10:29.745040 (+    55us) write_op.cc:312] APPLY: finished
0709 13:10:29.745298 (+   258us) log.cc:844] Serialized 57 byte log entry
0709 13:10:29.746160 (+   862us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:29.746279 (+   119us) write_op.cc:454] Released schema lock
0709 13:10:29.746323 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:29.781474 (+ 35151us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:29.781512 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":239,"apply.run_cpu_time_us":7276,"apply.run_wall_time_us":45258,"cfile_cache_hit":20,"cfile_cache_hit_bytes":20910,"num_ops":5,"prepare.queue_time_us":121,"prepare.run_cpu_time_us":2898,"prepare.run_wall_time_us":2898,"replication_time_us":4440}]]}
I20260709 13:10:29.930871  3945 ts_tablet_manager.cc:1929] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.11
I20260709 13:10:29.944284  3945 log.cc:1199] T f6fb8561d12345948ed56d359f5ef4f3 P f639301059e24dc5b0d88a46dc683326: Deleting WAL directory at /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-0-root/wals/f6fb8561d12345948ed56d359f5ef4f3
I20260709 13:10:29.950351 30361 catalog_manager.cc:5028] TS f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): tablet f6fb8561d12345948ed56d359f5ef4f3 (table test-workload [id=887057791fed41a884abbab3e8d4b49f]) successfully deleted
I20260709 13:10:29.996599 30372 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57542 (request call id 304) took 2501 ms. Trace:
I20260709 13:10:29.997016 30372 rpcz_store.cc:276] 0709 13:10:27.495418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.495563 (+   145us) service_pool.cc:224] Handling call
0709 13:10:29.996497 (+2500934us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44907,"reported_tablets":49}
I20260709 13:10:30.104036 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:10:30.163875 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 65888.9us
W20260709 13:10:30.172046 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 139723us
I20260709 13:10:30.253253 30476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7"
dest_uuid: "f639301059e24dc5b0d88a46dc683326"
mode: GRACEFUL
new_leader_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:52370
I20260709 13:10:30.253901 30476 raft_consensus.cc:606] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 12 LEADER]: Received request to transfer leadership to TS 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:30.278676 30476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483"
dest_uuid: "f639301059e24dc5b0d88a46dc683326"
mode: GRACEFUL
new_leader_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:52370
I20260709 13:10:30.279264 30476 raft_consensus.cc:606] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 13 LEADER]: Received request to transfer leadership to TS 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:30.288965 30476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d"
dest_uuid: "f639301059e24dc5b0d88a46dc683326"
mode: GRACEFUL
new_leader_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:52370
I20260709 13:10:30.289635 30476 raft_consensus.cc:606] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 16 LEADER]: Received request to transfer leadership to TS 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:30.298856 30476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0842494dc2a48d89fb422524082081d"
dest_uuid: "f639301059e24dc5b0d88a46dc683326"
mode: GRACEFUL
new_leader_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:52370
I20260709 13:10:30.299446 30476 raft_consensus.cc:606] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 14 LEADER]: Received request to transfer leadership to TS 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:30.308383 30476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b"
dest_uuid: "f639301059e24dc5b0d88a46dc683326"
mode: GRACEFUL
new_leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
 from {username='slave'} at 127.0.0.1:52370
I20260709 13:10:30.308971 30476 raft_consensus.cc:606] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 15 LEADER]: Received request to transfer leadership to TS fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:30.310226 29364 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:30.311914 29364 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:30.488658  3933 raft_consensus.cc:993] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326: : Instructing follower 092f6eb694fc4bbeab49677cccd880fd to start an election
I20260709 13:10:30.489244  3933 raft_consensus.cc:1081] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 13 LEADER]: Signalling peer 092f6eb694fc4bbeab49677cccd880fd to start an election
I20260709 13:10:30.491566 30545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:43088
I20260709 13:10:30.492157 30545 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:30.492488 30545 raft_consensus.cc:3060] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:30.504211  3795 raft_consensus.cc:993] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326: : Instructing follower fe2b7d73f8c743c1ba570cfd981c4e79 to start an election
I20260709 13:10:30.504745  3795 raft_consensus.cc:1081] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 15 LEADER]: Signalling peer fe2b7d73f8c743c1ba570cfd981c4e79 to start an election
I20260709 13:10:30.506486 30618 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b"
dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
 from {username='slave'} at 127.0.0.1:36130
I20260709 13:10:30.507054 30618 raft_consensus.cc:493] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:30.507388 30618 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:30.527899 30545 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:30.533555  3893 raft_consensus.cc:993] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326: : Instructing follower 092f6eb694fc4bbeab49677cccd880fd to start an election
I20260709 13:10:30.544296  3893 raft_consensus.cc:1081] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 12 LEADER]: Signalling peer 092f6eb694fc4bbeab49677cccd880fd to start an election
I20260709 13:10:30.546154 30546 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:43088
I20260709 13:10:30.546694 30546 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:30.547029 30546 raft_consensus.cc:3060] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:30.614334 30546 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:30.617892 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:30.618495 31148 raft_consensus.cc:3060] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:30.626994 31148 raft_consensus.cc:2468] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 13.
I20260709 13:10:30.534471 30618 raft_consensus.cc:515] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:30.636674 30546 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:30.636976 30516 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:10:30.631951 30472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:30.640491 30472 raft_consensus.cc:3055] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:30.640796 30472 raft_consensus.cc:740] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:30.642037 30545 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:30.643087 30618 leader_election.cc:290] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:30.644116 30469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:30.644553 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:30.645107 30476 raft_consensus.cc:3055] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:30.644691 30469 raft_consensus.cc:3055] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:30.645416 30476 raft_consensus.cc:740] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:30.645475 30469 raft_consensus.cc:740] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:30.643219 30472 consensus_queue.cc:260] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:30.647217 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db830c61bd0a4c3d80284c8c56165b1b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:30.647723 30547 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:30.648965 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9861593ab94f7792fdd702f1d9a483" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:30.650389 31148 raft_consensus.cc:3060] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:30.646449 30469 consensus_queue.cc:260] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:30.654510 30469 raft_consensus.cc:3060] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:30.654532 30472 raft_consensus.cc:3060] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:30.649641 30476 consensus_queue.cc:260] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:30.669323 30476 raft_consensus.cc:3060] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:30.676174 30476 raft_consensus.cc:2468] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 14.
I20260709 13:10:30.678062 30517 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:30.692700 30547 raft_consensus.cc:2468] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 16.
I20260709 13:10:30.670976  3920 raft_consensus.cc:2804] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:30.701491 30469 raft_consensus.cc:2468] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 16.
I20260709 13:10:30.700047 30472 raft_consensus.cc:2468] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 13.
I20260709 13:10:30.667580 31148 raft_consensus.cc:2468] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 14.
I20260709 13:10:30.702957 30591 leader_election.cc:304] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:30.707904  3954 raft_consensus.cc:2804] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:30.708616  3954 raft_consensus.cc:697] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 14 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:30.709719  3954 consensus_queue.cc:237] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:30.715286  3952 raft_consensus.cc:2804] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:10:30.713719 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 65407.9us
I20260709 13:10:30.704875  3920 raft_consensus.cc:697] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 13 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:30.725116  3920 consensus_queue.cc:237] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:30.728531  3894 raft_consensus.cc:993] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326: : Instructing follower 092f6eb694fc4bbeab49677cccd880fd to start an election
I20260709 13:10:30.729164  3894 raft_consensus.cc:1081] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 16 LEADER]: Signalling peer 092f6eb694fc4bbeab49677cccd880fd to start an election
I20260709 13:10:30.736725  3952 raft_consensus.cc:697] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:30.797559 30550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:43088
I20260709 13:10:30.831087 30550 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:30.841813 30550 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:30.746696  3952 consensus_queue.cc:237] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:30.905428 30550 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:30.911633  3933 raft_consensus.cc:993] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326: : Instructing follower 092f6eb694fc4bbeab49677cccd880fd to start an election
I20260709 13:10:30.916950  3933 raft_consensus.cc:1081] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 14 LEADER]: Signalling peer 092f6eb694fc4bbeab49677cccd880fd to start an election
W20260709 13:10:30.914103 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 54308.6us
I20260709 13:10:30.919829 30549 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b0842494dc2a48d89fb422524082081d"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:43088
I20260709 13:10:30.920377 30549 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:30.920730 30549 raft_consensus.cc:3060] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:30.926762 30550 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 17 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:30.930249 30372 catalog_manager.cc:5697] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 12 to 13, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 13 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.946986 30372 catalog_manager.cc:5697] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 13 to 14, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 14 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:30.951938 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 77173.2us
I20260709 13:10:30.966585 30549 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:30.968858 30549 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:30.987255 31144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:30.988288 31144 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:30.997180 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:30.997857 31148 raft_consensus.cc:3060] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:31.013193 31144 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 17.
I20260709 13:10:31.019632 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:31.020347 30473 raft_consensus.cc:3055] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:31.020655 30473 raft_consensus.cc:740] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:31.021725 30473 consensus_queue.cc:260] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:31.025563 30476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0842494dc2a48d89fb422524082081d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:31.026196 30476 raft_consensus.cc:3055] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:31.026597 30476 raft_consensus.cc:740] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:31.027539 30476 consensus_queue.cc:260] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:31.030795 30476 raft_consensus.cc:3060] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:31.029639 30473 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:31.051317 30476 raft_consensus.cc:2468] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 15.
I20260709 13:10:31.053984 30473 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 17.
I20260709 13:10:31.057075 31148 raft_consensus.cc:2468] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 15.
I20260709 13:10:31.075219 30517 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:31.084045  3951 raft_consensus.cc:2804] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:31.084206 30516 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: 
I20260709 13:10:31.084729  3951 raft_consensus.cc:697] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 15 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:31.086184  3957 raft_consensus.cc:2804] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:31.085971  3951 consensus_queue.cc:237] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:31.086860  3957 raft_consensus.cc:697] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 17 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:31.088013  3957 consensus_queue.cc:237] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:31.193814 30473 raft_consensus.cc:1275] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:10:31.195554  3961 consensus_queue.cc:1048] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:31.202692 30371 catalog_manager.cc:5697] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 15 to 16, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 16 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:31.242588 31148 raft_consensus.cc:1275] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:10:31.244962  3961 consensus_queue.cc:1048] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:31.256687 31144 raft_consensus.cc:1275] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:31.258287  3951 consensus_queue.cc:1048] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:31.338897 30472 raft_consensus.cc:1275] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:31.354368 30550 raft_consensus.cc:1275] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:10:31.364293 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:31.371950  3874 consensus_queue.cc:1048] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:10:31.380106 30472 raft_consensus.cc:1275] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:10:31.382162  3949 consensus_queue.cc:1048] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:10:31.397886 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 49069.2us
I20260709 13:10:31.345082  3961 consensus_queue.cc:1048] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:10:31.460515 30372 catalog_manager.cc:5697] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 16 to 17, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 17 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:31.466042 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 98343.7us
I20260709 13:10:31.466480 30372 catalog_manager.cc:5697] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 14 to 15, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 15 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:31.534307 30475 raft_consensus.cc:1275] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:10:31.560640  3951 consensus_queue.cc:1048] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:31.573406 31145 raft_consensus.cc:1275] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:10:31.574925  3981 consensus_queue.cc:1048] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:31.584239 30475 raft_consensus.cc:1275] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 17 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:10:31.623996  3920 consensus_queue.cc:1048] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:10:31.684989 31148 raft_consensus.cc:1275] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:10:31.688742  3961 consensus_queue.cc:1048] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:10:31.912844 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 134509us
W20260709 13:10:32.417554 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 46653.3us
I20260709 13:10:32.979032 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:10:33.127890 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 49562.7us
W20260709 13:10:33.194226 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 73560.8us
I20260709 13:10:33.216840 30550 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
mode: GRACEFUL
new_leader_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:45906
I20260709 13:10:33.217581 30550 raft_consensus.cc:606] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 17 LEADER]: Received request to transfer leadership to TS f639301059e24dc5b0d88a46dc683326
I20260709 13:10:33.232092 30550 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
mode: GRACEFUL
new_leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
 from {username='slave'} at 127.0.0.1:45906
I20260709 13:10:33.232795 30550 raft_consensus.cc:606] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 11 LEADER]: Received request to transfer leadership to TS fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:33.234279 29364 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:33.236552 29364 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:10:33.256000 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 70963.7us
I20260709 13:10:33.261957  4001 raft_consensus.cc:993] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd: : Instructing follower fe2b7d73f8c743c1ba570cfd981c4e79 to start an election
I20260709 13:10:33.262506  4001 raft_consensus.cc:1081] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 11 LEADER]: Signalling peer fe2b7d73f8c743c1ba570cfd981c4e79 to start an election
I20260709 13:10:33.264539 30618 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72"
dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
 from {username='slave'} at 127.0.0.1:47446
I20260709 13:10:33.265118 30618 raft_consensus.cc:493] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:33.265475 30618 raft_consensus.cc:3060] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:33.280900 30618 raft_consensus.cc:515] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:33.296278 30618 leader_election.cc:290] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:33.298245 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:33.305371 30549 raft_consensus.cc:3055] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:33.305717 30549 raft_consensus.cc:740] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:33.306497 30549 consensus_queue.cc:260] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:33.307578 30549 raft_consensus.cc:3060] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:33.325178 30549 raft_consensus.cc:2468] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 12.
I20260709 13:10:33.354943 30589 leader_election.cc:304] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:33.355912  3996 raft_consensus.cc:2804] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:33.356415  3996 raft_consensus.cc:697] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:33.357235  3996 consensus_queue.cc:237] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:33.358038 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d641a3d4c880431b9375d9c775d7be72" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:33.358623 30475 raft_consensus.cc:3060] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:33.359702  4004 raft_consensus.cc:993] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd: : Instructing follower f639301059e24dc5b0d88a46dc683326 to start an election
I20260709 13:10:33.360440  4004 raft_consensus.cc:1081] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 17 LEADER]: Signalling peer f639301059e24dc5b0d88a46dc683326 to start an election
I20260709 13:10:33.377265 30475 raft_consensus.cc:2468] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 12.
I20260709 13:10:33.381603 30372 catalog_manager.cc:5697] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 11 to 12, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 12 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:33.416828 30476 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d"
dest_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:50430
I20260709 13:10:33.417438 30476 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:33.417801 30476 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:33.426963 30476 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:33.441201 30476 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 18 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:33.441815 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:33.442482 30549 raft_consensus.cc:3055] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:33.442818 30549 raft_consensus.cc:740] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:33.443675 30549 consensus_queue.cc:260] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:33.445194 30549 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:33.489769 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:33.490451 31145 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:33.499565 31145 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 18.
I20260709 13:10:33.515291 30549 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 18.
I20260709 13:10:33.520998 30440 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:33.521961  3987 raft_consensus.cc:2804] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:33.522524  3987 raft_consensus.cc:697] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 18 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:33.523346  3987 consensus_queue.cc:237] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:33.561170 30372 catalog_manager.cc:5697] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 17 to 18, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 18 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:33.814374 30476 raft_consensus.cc:1275] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:33.816134  3996 consensus_queue.cc:1048] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:33.903088 30546 raft_consensus.cc:1275] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:33.907043  3991 consensus_queue.cc:1048] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:33.958122 30549 raft_consensus.cc:1275] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 18 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:10:33.959673  3987 consensus_queue.cc:1048] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:10:34.002122 31148 raft_consensus.cc:1275] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 18 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:10:34.003993  4005 consensus_queue.cc:1048] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:10:34.089491 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 93186.8us
I20260709 13:10:34.238790 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:35.465242 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:35.555833 30473 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0"
dest_uuid: "f639301059e24dc5b0d88a46dc683326"
mode: GRACEFUL
new_leader_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:52370
I20260709 13:10:35.556447 30473 raft_consensus.cc:606] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 9 LEADER]: Received request to transfer leadership to TS 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:35.571435 29364 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:10:35.573088 29364 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:35.944831 31145 consensus_queue.cc:237] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:35.968757 30618 raft_consensus.cc:1275] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:10:35.970531  3963 consensus_queue.cc:1048] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:36.000895 30476 raft_consensus.cc:1275] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:10:36.009658  4000 consensus_queue.cc:1048] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:36.045322  4022 raft_consensus.cc:2955] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index 4 to 11, VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:36.089618  4019 raft_consensus.cc:993] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326: : Instructing follower 092f6eb694fc4bbeab49677cccd880fd to start an election
I20260709 13:10:36.090152  4019 raft_consensus.cc:1081] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 9 LEADER]: Signalling peer 092f6eb694fc4bbeab49677cccd880fd to start an election
I20260709 13:10:36.090816 30360 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5610a33c644c4e539ad503631763aa40 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 13)
I20260709 13:10:36.094482 30372 catalog_manager.cc:5697] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: config changed from index 4 to 11, VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) evicted. New cstate: current_term: 16 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:36.099998 30546 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
 from {username='slave'} at 127.0.0.1:43088
I20260709 13:10:36.100574 30546 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:36.100911 30546 raft_consensus.cc:3060] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:36.130692 30473 raft_consensus.cc:2955] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 4 to 11, VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:36.131588 30618 raft_consensus.cc:2955] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 4 to 11, VOTER 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } } }
I20260709 13:10:36.156275 30546 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:36.160326 30473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "f639301059e24dc5b0d88a46dc683326"
W20260709 13:10:36.160481 30440 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 54960us
I20260709 13:10:36.160928 30473 raft_consensus.cc:3055] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:36.161289 30473 raft_consensus.cc:740] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:36.162042 30473 consensus_queue.cc:260] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:36.163203 30473 raft_consensus.cc:3060] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:36.170408 30473 raft_consensus.cc:2468] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 10.
I20260709 13:10:36.171640 30517 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:36.173311  4025 raft_consensus.cc:2804] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:36.173827  4025 raft_consensus.cc:697] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 10 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:36.174661  4025 consensus_queue.cc:237] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:36.177000 30546 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 10 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:36.191923 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541099fd564e49f2ad553f250f319fb0" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:36.192584 31145 raft_consensus.cc:3060] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:36.237769 31145 raft_consensus.cc:2468] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 10.
W20260709 13:10:36.306207 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 61801.5us
I20260709 13:10:36.328251 30369 catalog_manager.cc:5697] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 9 to 10, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 10 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:36.350178 30541 tablet_service.cc:1558] Processing DeleteTablet for tablet 5610a33c644c4e539ad503631763aa40 with delete_type TABLET_DATA_TOMBSTONED (TS 092f6eb694fc4bbeab49677cccd880fd not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:36986
I20260709 13:10:36.421272  4045 tablet_replica.cc:333] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:36.428900  4045 raft_consensus.cc:2243] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.443987  4045 raft_consensus.cc:2272] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.447832  4045 ts_tablet_manager.cc:1916] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:36.536633  4045 ts_tablet_manager.cc:1929] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.10
I20260709 13:10:36.537240  4045 log.cc:1199] T 5610a33c644c4e539ad503631763aa40 P 092f6eb694fc4bbeab49677cccd880fd: Deleting WAL directory at /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602443945700-29364-0/minicluster-data/ts-1-root/wals/5610a33c644c4e539ad503631763aa40
I20260709 13:10:36.539386 30359 catalog_manager.cc:5028] TS 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): tablet 5610a33c644c4e539ad503631763aa40 (table test-workload [id=887057791fed41a884abbab3e8d4b49f]) successfully deleted
I20260709 13:10:36.574064 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:36.779804 30476 raft_consensus.cc:1275] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:36.781388  4042 consensus_queue.cc:1048] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:36.794448 31148 raft_consensus.cc:1275] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:36.796725  4042 consensus_queue.cc:1048] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:37.703135 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:37.948630 30546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a418ef882d34180817469c4e2495268"
dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
mode: GRACEFUL
new_leader_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:45906
I20260709 13:10:37.949254 30546 raft_consensus.cc:606] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 14 LEADER]: Received request to transfer leadership to TS f639301059e24dc5b0d88a46dc683326
I20260709 13:10:37.956857 29364 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:10:37.958624 29364 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:38.446728  4052 raft_consensus.cc:993] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd: : Instructing follower f639301059e24dc5b0d88a46dc683326 to start an election
I20260709 13:10:38.447255  4052 raft_consensus.cc:1081] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 14 LEADER]: Signalling peer f639301059e24dc5b0d88a46dc683326 to start an election
I20260709 13:10:38.448989 30473 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a418ef882d34180817469c4e2495268"
dest_uuid: "f639301059e24dc5b0d88a46dc683326"
 from {username='slave'} at 127.0.0.1:50430
I20260709 13:10:38.449566 30473 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:38.449904 30473 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:38.466626 30473 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:38.472553 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: true dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:38.473006 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "f639301059e24dc5b0d88a46dc683326" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: true dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:38.473140 30549 raft_consensus.cc:3055] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:38.473649 31148 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:38.473644 30549 raft_consensus.cc:740] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:38.476850 30549 consensus_queue.cc:260] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:38.477953 30549 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:38.492342 31148 raft_consensus.cc:2468] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 15.
I20260709 13:10:38.497989 30441 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326; no voters: 
I20260709 13:10:38.498896  4053 raft_consensus.cc:2804] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:38.499390  4053 raft_consensus.cc:697] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 15 LEADER]: Becoming Leader. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:38.500288  4053 consensus_queue.cc:237] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:38.523247 30473 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [CANDIDATE]: Term 15 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:38.524955 30549 raft_consensus.cc:2468] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f639301059e24dc5b0d88a46dc683326 in term 15.
I20260709 13:10:38.635969 30369 catalog_manager.cc:5697] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 reported cstate change: term changed from 14 to 15, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to f639301059e24dc5b0d88a46dc683326 (127.28.173.1). New cstate: current_term: 15 leader_uuid: "f639301059e24dc5b0d88a46dc683326" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:38.954609 30546 raft_consensus.cc:1275] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:10:38.956179  3987 consensus_queue.cc:1048] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:38.959656 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:39.091037 31148 raft_consensus.cc:1275] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Refusing update from remote peer f639301059e24dc5b0d88a46dc683326: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:10:39.093588  4053 consensus_queue.cc:1048] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:40.142179 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:40.502029 30472 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4859507b516b4f62a81b965e2686e618"
dest_uuid: "f639301059e24dc5b0d88a46dc683326"
mode: GRACEFUL
new_leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
 from {username='slave'} at 127.0.0.1:52370
I20260709 13:10:40.502704 30472 raft_consensus.cc:606] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 15 LEADER]: Received request to transfer leadership to TS fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:40.504626 29364 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:10:40.506253 29364 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:10:40.833307 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 62199.5us
W20260709 13:10:40.835878 30441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 61723.8us
I20260709 13:10:40.981935  4038 raft_consensus.cc:993] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326: : Instructing follower fe2b7d73f8c743c1ba570cfd981c4e79 to start an election
I20260709 13:10:40.983042  4038 raft_consensus.cc:1081] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 15 LEADER]: Signalling peer fe2b7d73f8c743c1ba570cfd981c4e79 to start an election
I20260709 13:10:41.042086 30623 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4859507b516b4f62a81b965e2686e618"
dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
 from {username='slave'} at 127.0.0.1:36130
I20260709 13:10:41.043256 30623 raft_consensus.cc:493] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:41.043866 30623 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:41.131291 30623 raft_consensus.cc:515] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:41.163031 30623 leader_election.cc:290] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:41.166083 30475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "f639301059e24dc5b0d88a46dc683326"
I20260709 13:10:41.167174 30475 raft_consensus.cc:3055] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:41.167526 30475 raft_consensus.cc:740] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f639301059e24dc5b0d88a46dc683326, State: Running, Role: LEADER
I20260709 13:10:41.168493 30475 consensus_queue.cc:260] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:41.171322 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4859507b516b4f62a81b965e2686e618" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:41.172310 30546 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:41.175009 30475 raft_consensus.cc:3060] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:41.230880 30475 raft_consensus.cc:2468] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 16.
I20260709 13:10:41.232692 30546 raft_consensus.cc:2468] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 16.
I20260709 13:10:41.233435 30591 leader_election.cc:304] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:41.234735  4069 raft_consensus.cc:2804] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:41.235227  4069 raft_consensus.cc:697] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:41.236531  4069 consensus_queue.cc:237] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:41.309158 30369 catalog_manager.cc:5697] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 15 to 16, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 16 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:41.507441 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:41.626277 30467 raft_consensus.cc:1275] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:10:41.628743  4057 consensus_queue.cc:1048] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:41.660708 30546 raft_consensus.cc:1275] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:10:41.662573  4071 consensus_queue.cc:1048] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:41.676651 29364 tablet_server.cc:179] TabletServer@127.28.173.1:0 shutting down...
W20260709 13:10:41.732674 31116 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 8 similar messages]
W20260709 13:10:41.826310 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 93835.7us
W20260709 13:10:41.833600 31116 consensus_peers.cc:597] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:41.841151 31116 consensus_peers.cc:597] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:41.842108 31116 consensus_peers.cc:597] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:41.886615 31116 consensus_peers.cc:597] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:41.891781 31116 consensus_peers.cc:597] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:41.897634 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 83545.9us
W20260709 13:10:41.904209 30517 consensus_peers.cc:597] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:41.935308 30517 consensus_peers.cc:597] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:41.936931 30517 consensus_peers.cc:597] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:41.940541 30517 consensus_peers.cc:597] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:41.952076 29364 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:41.955191 29364 tablet_replica.cc:333] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:41.956234 29364 raft_consensus.cc:2243] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:41.958499 29364 raft_consensus.cc:2272] T 5610a33c644c4e539ad503631763aa40 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:41.969010 30591 consensus_peers.cc:597] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:41.969791 30591 consensus_peers.cc:597] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:41.969504 29364 tablet_replica.cc:333] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:41.971771 29364 raft_consensus.cc:2243] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:41.972450 29364 raft_consensus.cc:2272] T c504e96bd6f14a19b7dfe8203129e4b4 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:41.977301 31116 consensus_peers.cc:597] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:41.981392 30517 consensus_peers.cc:597] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:41.982355 30517 consensus_peers.cc:597] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:41.982960 30517 consensus_peers.cc:597] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:41.983527 30517 consensus_peers.cc:597] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:41.981434 29364 tablet_replica.cc:333] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:41.985049 29364 raft_consensus.cc:2243] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:41.986028 29364 raft_consensus.cc:2272] T a2fd6793fef04209ae40ee4d9ba90f42 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:41.986881 30591 consensus_peers.cc:597] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:41.990742 30517 consensus_peers.cc:597] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:41.992897 29364 tablet_replica.cc:333] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:41.994264 29364 raft_consensus.cc:2243] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:41.995095 29364 raft_consensus.cc:2272] T 772a658508f4465d8c1ef039f5bcaa67 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:42.006310 30591 consensus_peers.cc:597] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:42.010047 30591 consensus_peers.cc:597] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:42.018659 30517 consensus_peers.cc:597] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:42.021273 29364 tablet_replica.cc:333] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:42.028738 29364 raft_consensus.cc:2243] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.029563 29364 raft_consensus.cc:2272] T 2b207fb799ce4340b29ae053898e0e6c P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.032496 29364 tablet_replica.cc:333] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
W20260709 13:10:42.032794 31116 consensus_peers.cc:597] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:42.033416 29364 raft_consensus.cc:2243] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.040272 29364 raft_consensus.cc:2272] T 47ac231e47e64c0c9330e153212ca4b5 P f639301059e24dc5b0d88a46dc683326 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.043278 29364 tablet_replica.cc:333] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:42.049324 29364 raft_consensus.cc:2243] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 17 LEADER]: Raft consensus shutting down.
W20260709 13:10:42.053586 30591 consensus_peers.cc:597] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:42.057004 30591 consensus_peers.cc:597] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:42.053691 29364 raft_consensus.cc:2272] T 6a9b619ab6a04af38de048edd085fe3e P f639301059e24dc5b0d88a46dc683326 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.064095 29364 tablet_replica.cc:333] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:42.064957 29364 raft_consensus.cc:2243] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.065575 29364 raft_consensus.cc:2272] T db830c61bd0a4c3d80284c8c56165b1b P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.070731 29364 tablet_replica.cc:333] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:42.073448 29364 raft_consensus.cc:2243] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Raft consensus shutting down.
W20260709 13:10:42.074052 30591 consensus_peers.cc:597] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:42.074120 29364 raft_consensus.cc:2272] T a439756f6e7242f8b5b1ef7ea97874d4 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.090866 29364 tablet_replica.cc:333] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:42.092033 29364 raft_consensus.cc:2243] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Raft consensus shutting down.
W20260709 13:10:42.094991 30591 consensus_peers.cc:597] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:42.100087 31116 consensus_peers.cc:597] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:42.092609 29364 raft_consensus.cc:2272] T 4859507b516b4f62a81b965e2686e618 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:42.107565 31116 consensus_peers.cc:597] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:42.110158 29364 tablet_replica.cc:333] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:42.113814 29364 raft_consensus.cc:2243] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.114648 29364 raft_consensus.cc:2272] T 10b0408011914710a008d9e9b58f002c P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.117595 29364 tablet_replica.cc:333] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:42.123076 29364 raft_consensus.cc:2243] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.123731 29364 raft_consensus.cc:2272] T 47d5557143454f988a101125d3b5c0d7 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.126603 29364 tablet_replica.cc:333] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
W20260709 13:10:42.127328 30517 consensus_peers.cc:597] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:42.133772 29364 raft_consensus.cc:2243] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.135569 29364 raft_consensus.cc:2272] T 7c9861593ab94f7792fdd702f1d9a483 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.146938 29364 tablet_replica.cc:333] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:42.147868 29364 raft_consensus.cc:2243] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:10:42.150180 29364 raft_consensus.cc:2272] T 53842c918e2c4018ba572aaf3dfbfe31 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.152971 29364 tablet_replica.cc:333] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:42.153779 29364 raft_consensus.cc:2243] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:10:42.155076 29364 raft_consensus.cc:2272] T 80cbe47dd35948b8b10070e934216d98 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:42.167456 30591 consensus_peers.cc:597] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:42.171523 29364 tablet_replica.cc:333] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:42.172479 29364 raft_consensus.cc:2243] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:10:42.173693 29364 raft_consensus.cc:2272] T 1a418ef882d34180817469c4e2495268 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.176865 29364 tablet_replica.cc:333] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:42.177721 29364 raft_consensus.cc:2243] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.184520 29364 raft_consensus.cc:2272] T d641a3d4c880431b9375d9c775d7be72 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.187265 29364 tablet_replica.cc:333] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:42.188190 29364 raft_consensus.cc:2243] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.194398 29364 raft_consensus.cc:2272] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P f639301059e24dc5b0d88a46dc683326 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:42.201884 30591 consensus_peers.cc:597] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:42.202618 30517 consensus_peers.cc:597] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:42.204265 29364 tablet_replica.cc:333] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:42.210304 29364 raft_consensus.cc:2243] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:10:42.211522 29364 raft_consensus.cc:2272] T bd3964085c9b4234998aecbbce16d24a P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.224220 29364 tablet_replica.cc:333] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:42.229549 29364 raft_consensus.cc:2243] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.230566 29364 raft_consensus.cc:2272] T 7111be574b514751972d70830d3b644f P f639301059e24dc5b0d88a46dc683326 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.243942 29364 tablet_replica.cc:333] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:42.245205 29364 raft_consensus.cc:2243] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.245888 29364 raft_consensus.cc:2272] T b0842494dc2a48d89fb422524082081d P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.252419 29364 tablet_replica.cc:333] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:42.253201 29364 raft_consensus.cc:2243] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.253868 29364 raft_consensus.cc:2272] T 541099fd564e49f2ad553f250f319fb0 P f639301059e24dc5b0d88a46dc683326 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.256618 29364 tablet_replica.cc:333] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:42.261451 29364 raft_consensus.cc:2243] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:10:42.263535 29364 raft_consensus.cc:2272] T 34bc3578422e49f4a6025c428fa5d426 P f639301059e24dc5b0d88a46dc683326 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.273238 29364 tablet_replica.cc:333] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:42.274981 29364 raft_consensus.cc:2243] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:10:42.279649 29364 raft_consensus.cc:2272] T 1d4c506564124bd5b3a4c756362eee6b P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.287285 29364 tablet_replica.cc:333] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:42.289665 29364 raft_consensus.cc:2243] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.290490 29364 raft_consensus.cc:2272] T 60ec00010cf4415890c61ef6278cd0cd P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.299077 29364 tablet_replica.cc:333] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:42.299882 29364 raft_consensus.cc:2243] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.300751 29364 raft_consensus.cc:2272] T 795e206cd48a484a88a226d02f465b8f P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.314781 29364 tablet_replica.cc:333] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:42.315644 29364 raft_consensus.cc:2243] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:10:42.316797 29364 raft_consensus.cc:2272] T 7e31b2accf3b4a3b8b7668571e619eb7 P f639301059e24dc5b0d88a46dc683326 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.319379 29364 tablet_replica.cc:333] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:42.320150 29364 raft_consensus.cc:2243] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.321046 29364 raft_consensus.cc:2272] T 39a5f6c7a19c4fd59922a13945641151 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.323563 29364 tablet_replica.cc:333] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:42.328289 29364 raft_consensus.cc:2243] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.329921 29364 raft_consensus.cc:2272] T 265fc568d5674c78833106e4eda814f4 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.332542 29364 tablet_replica.cc:333] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:42.353322 29364 raft_consensus.cc:2243] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.354094 29364 raft_consensus.cc:2272] T 7f8b6eff35aa4b96bf5f73d6a94db695 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.357034 29364 tablet_replica.cc:333] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:42.357873 29364 raft_consensus.cc:2243] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.363207 29364 raft_consensus.cc:2272] T a0273ed018424f3a9529e09669fdb7b0 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.365931 29364 tablet_replica.cc:333] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:42.366662 29364 raft_consensus.cc:2243] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.371066 29364 raft_consensus.cc:2272] T 5302637c04824f67b70df2f3ee95c130 P f639301059e24dc5b0d88a46dc683326 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.379716 29364 tablet_replica.cc:333] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:42.414656 29364 raft_consensus.cc:2243] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:10:42.416038 29364 raft_consensus.cc:2272] T 85088611c7e34066afbf929fc1cbe50d P f639301059e24dc5b0d88a46dc683326 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.426110 29364 tablet_replica.cc:333] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:42.438186 29364 raft_consensus.cc:2243] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:10:42.441147 29364 raft_consensus.cc:2272] T a999056752144cc99cdd136c40917d2c P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.443900 29364 tablet_replica.cc:333] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:42.444625 29364 raft_consensus.cc:2243] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:10:42.445614 29364 raft_consensus.cc:2272] T db4f54e7ad744ccb95e9f62b315f1408 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.448132 29364 tablet_replica.cc:333] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:42.448911 29364 raft_consensus.cc:2243] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:10:42.449971 29364 raft_consensus.cc:2272] T 8b8abe384b054cf09bfba7143adf03f1 P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.455529 29364 tablet_replica.cc:333] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:42.456410 29364 raft_consensus.cc:2243] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.457341 29364 raft_consensus.cc:2272] T 3fac91e8417848ac93fdc9f02381d2d5 P f639301059e24dc5b0d88a46dc683326 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.464147 29364 tablet_replica.cc:333] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:42.464887 29364 raft_consensus.cc:2243] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:10:42.465934 29364 raft_consensus.cc:2272] T cb22806325394ba386d8549bc4a64701 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.470079 29364 tablet_replica.cc:333] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:42.508703 29364 raft_consensus.cc:2243] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:10:42.510049 29364 raft_consensus.cc:2272] T a14ecc42199f4251b2f85f94871fe61f P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.518041 29364 tablet_replica.cc:333] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:42.518829 29364 raft_consensus.cc:2243] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.519531 29364 raft_consensus.cc:2272] T 9e9b511085f1474dbeaa862dd7e9d278 P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.522056 29364 tablet_replica.cc:333] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:42.522811 29364 raft_consensus.cc:2243] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.523413 29364 raft_consensus.cc:2272] T 7fce027eac834298aeb0b5714096adb1 P f639301059e24dc5b0d88a46dc683326 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.541076 29364 tablet_replica.cc:333] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:42.541888 29364 raft_consensus.cc:2243] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:10:42.542990 29364 raft_consensus.cc:2272] T 3e82bb3f413748538cf887dcc15fe04c P f639301059e24dc5b0d88a46dc683326 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.547529 29364 tablet_replica.cc:333] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:42.548257 29364 raft_consensus.cc:2243] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.548882 29364 raft_consensus.cc:2272] T 0a6e86e0a4b843478d5970b29ad63ad7 P f639301059e24dc5b0d88a46dc683326 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.552019 29364 tablet_replica.cc:333] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:42.552776 29364 raft_consensus.cc:2243] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.555471 29364 raft_consensus.cc:2272] T e6646800b690458391bbff6a6bba535c P f639301059e24dc5b0d88a46dc683326 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.558226 29364 tablet_replica.cc:333] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:42.558950 29364 raft_consensus.cc:2243] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.559994 29364 raft_consensus.cc:2272] T 48914655f9d44751a883e36b566dcefd P f639301059e24dc5b0d88a46dc683326 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.562402 29364 tablet_replica.cc:333] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:42.565788 29364 raft_consensus.cc:2243] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.566628 29364 raft_consensus.cc:2272] T 353e93aef12a4b92b159b611a66cf3c3 P f639301059e24dc5b0d88a46dc683326 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:42.576336 29364 tablet_replica.cc:333] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326: stopping tablet replica
I20260709 13:10:42.577152 29364 raft_consensus.cc:2243] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:42.578617 29364 raft_consensus.cc:2272] T 1270ad76798e4aea9d22209a726cc454 P f639301059e24dc5b0d88a46dc683326 [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:42.752313 30517 connection.cc:573] client connection to 127.28.173.1:43133 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:10:42.754976 30591 connection.cc:573] client connection to 127.28.173.1:43133 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:10:42.795394 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 48707.3us
W20260709 13:10:42.890551 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 51783.1us
W20260709 13:10:42.897589 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 101257us
W20260709 13:10:42.898919 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 100148us
W20260709 13:10:42.904541 31116 connection.cc:769] client connection to 127.28.173.1:43133 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260709 13:10:43.068276  4100 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:43.068799  4100 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:43.070902  4100 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:43.073570 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:10:43.078667 31116 leader_election.cc:336] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
I20260709 13:10:43.079110 31116 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:43.080073  4100 raft_consensus.cc:2749] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:43.219329  4105 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:43.219924  4105 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:43.227531 30517 leader_election.cc:336] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
I20260709 13:10:43.228724  4105 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:43.229880 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:43.231554 30516 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:43.232653  4105 raft_consensus.cc:2749] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:43.336171  4106 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:43.336714  4106 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:43.339062  4106 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:10:43.345541 30517 leader_election.cc:336] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
I20260709 13:10:43.356915 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:43.363498  4098 raft_consensus.cc:493] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:43.364212  4098 raft_consensus.cc:515] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:43.364727 30516 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:43.368543  4105 raft_consensus.cc:2749] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:43.372598  4104 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:43.373168  4104 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:43.376001  4104 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:43.376379 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:43.376956 31150 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 17.
I20260709 13:10:43.378036 30590 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:43.379009  4057 raft_consensus.cc:2804] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:43.379434  4057 raft_consensus.cc:493] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
W20260709 13:10:43.379727 30591 leader_election.cc:336] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
I20260709 13:10:43.379854  4057 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:43.391922 30591 leader_election.cc:336] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
I20260709 13:10:43.392939  4100 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:43.393471  4100 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:43.396593  4104 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:43.397163  4104 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:43.399348  4104 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:43.399448 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:43.400956 30590 leader_election.cc:304] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:43.406198  4098 leader_election.cc:290] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:43.406982  4098 raft_consensus.cc:2749] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:10:43.415030 31116 leader_election.cc:336] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
I20260709 13:10:43.418171  4057 raft_consensus.cc:515] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:43.423139  4100 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:43.424767 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:43.424894 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:43.425544 30547 raft_consensus.cc:2468] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 16.
I20260709 13:10:43.426757 31114 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:43.427790  4100 raft_consensus.cc:2749] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:43.435848 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 43935.4us
I20260709 13:10:43.438195 30589 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:43.440116  4105 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:43.440680  4105 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:43.442760  4105 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:43.439630  4104 raft_consensus.cc:2804] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:43.443972  4104 raft_consensus.cc:493] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:43.444355  4104 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:10:43.446909 30517 leader_election.cc:336] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
I20260709 13:10:43.448216  4100 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:43.448792  4100 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:43.451442  4100 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:43.452505 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
W20260709 13:10:43.460336 31116 leader_election.cc:336] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
I20260709 13:10:43.460798 31116 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:43.462431  4100 raft_consensus.cc:2749] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:43.478107 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:43.480862 30516 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:43.481617  4104 raft_consensus.cc:515] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:43.481961  4105 raft_consensus.cc:2749] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:43.483134  4106 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:43.509666  4104 leader_election.cc:290] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 17 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:43.503551 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a9b619ab6a04af38de048edd085fe3e" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:43.510629 31150 raft_consensus.cc:3060] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:43.513571 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842c918e2c4018ba572aaf3dfbfe31" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:43.514156 30547 raft_consensus.cc:3060] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:43.518469  4068 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:43.518966  4068 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:43.500272 30591 leader_election.cc:336] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
I20260709 13:10:43.509413  4106 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:43.521093  4068 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:43.521399  4106 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:43.522805  4106 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:43.523058 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:43.523288  4106 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:43.525858  4106 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:10:43.526584 30517 leader_election.cc:336] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
W20260709 13:10:43.526639 30591 leader_election.cc:336] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
W20260709 13:10:43.529628 30517 leader_election.cc:336] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
I20260709 13:10:43.532869  4098 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:43.533444  4098 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:43.535894  4098 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:43.539227 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:43.539774 30550 raft_consensus.cc:2468] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 13.
I20260709 13:10:43.506445  4057 leader_election.cc:290] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 18 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:43.544370 30547 raft_consensus.cc:2468] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 17.
I20260709 13:10:43.545349 31150 raft_consensus.cc:2468] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 18.
W20260709 13:10:43.546815 31116 leader_election.cc:336] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
I20260709 13:10:43.548301 31116 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:43.549978  4068 raft_consensus.cc:2749] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:43.563855 30590 leader_election.cc:304] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:10:43.564172 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:43.564781 30623 raft_consensus.cc:2468] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 13.
I20260709 13:10:43.563526  4110 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:43.565404  4110 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:43.569821  4112 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:43.569907  4110 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:43.570442  4112 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:43.566454 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:43.573293  4068 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:43.573518 30623 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 16.
I20260709 13:10:43.573822  4068 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:43.575922  4068 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:10:43.577701 30517 leader_election.cc:336] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
I20260709 13:10:43.578713  4112 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:43.567018  4098 raft_consensus.cc:2804] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:43.582387  4098 raft_consensus.cc:697] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 18 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
W20260709 13:10:43.584111 31116 leader_election.cc:336] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
I20260709 13:10:43.585109 30589 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:43.585906 30589 leader_election.cc:304] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:43.586097  4110 raft_consensus.cc:2804] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:43.592207  4110 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:43.592562  4110 raft_consensus.cc:3060] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:43.584909  4098 consensus_queue.cc:237] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:43.589520 30516 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:10:43.589439 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:43.600987 31150 raft_consensus.cc:2468] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 12.
I20260709 13:10:43.600046  4114 raft_consensus.cc:2804] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:43.602348  4112 raft_consensus.cc:2804] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:43.602766  4112 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:43.602941  4104 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:43.603120  4112 raft_consensus.cc:3060] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:43.604607 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:43.605068 30516 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:10:43.605234 30547 raft_consensus.cc:2468] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 15.
I20260709 13:10:43.606932 31114 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:10:43.608147  4068 raft_consensus.cc:2804] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:43.608542  4068 raft_consensus.cc:493] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:43.608901  4068 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:43.609930  4114 raft_consensus.cc:697] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:43.613431  4114 consensus_queue.cc:237] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:43.617003  4105 raft_consensus.cc:2804] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:43.617383  4105 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:43.617753  4105 raft_consensus.cc:3060] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:43.622823  4106 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:43.623440  4106 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:43.631970  4106 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:10:43.635354 30517 leader_election.cc:336] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
I20260709 13:10:43.603472  4104 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:43.637576  4106 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:43.639164  4106 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:43.642233 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:43.645166  4104 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:43.633899  4068 raft_consensus.cc:515] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:43.647049  4110 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:43.647764  4111 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:43.647056  4105 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:43.656486  4111 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:43.657660  4110 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:10:43.650528 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 46275.9us
I20260709 13:10:43.658579  4111 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:43.659518 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:43.653232  4113 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:43.647135  4106 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:43.659358  4105 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:43.660667  4113 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:43.660154 30547 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 16.
I20260709 13:10:43.663650 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:43.668236 30550 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 17.
I20260709 13:10:43.673002 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:43.673838  4113 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:10:43.676334 31116 leader_election.cc:336] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
I20260709 13:10:43.676304 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:43.680624  4112 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:43.682842  4112 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:43.684093 30546 raft_consensus.cc:2393] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 14: Already voted for candidate 092f6eb694fc4bbeab49677cccd880fd in this term.
I20260709 13:10:43.686666 30373 catalog_manager.cc:5697] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 17 to 18, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 18 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:43.689682  4068 leader_election.cc:290] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 16 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:43.692488  4113 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:43.692046 30373 catalog_manager.cc:5697] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 16 to 17, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 17 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:43.693040  4113 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:43.652391 30591 leader_election.cc:336] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
W20260709 13:10:43.695901 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 43537.6us
W20260709 13:10:43.696334 30591 leader_election.cc:336] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
I20260709 13:10:43.678058 30589 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:43.694897  4113 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:43.701797  4110 raft_consensus.cc:2804] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:43.702214  4110 raft_consensus.cc:493] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:43.702575  4110 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:43.699673 30589 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:43.707064  4104 raft_consensus.cc:2804] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:43.707472  4104 raft_consensus.cc:493] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:43.707885  4104 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:43.711930  4100 raft_consensus.cc:493] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:43.711702  4110 raft_consensus.cc:515] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:43.712428  4100 raft_consensus.cc:515] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:43.714476  4100 leader_election.cc:290] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:43.714982 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3964085c9b4234998aecbbce16d24a" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:43.715528 30546 raft_consensus.cc:3060] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:43.716001 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:43.716593 30623 raft_consensus.cc:2468] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 9.
I20260709 13:10:43.718477 31115 leader_election.cc:304] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:43.719245  4100 raft_consensus.cc:2804] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:10:43.719594 31116 leader_election.cc:336] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
I20260709 13:10:43.719612  4100 raft_consensus.cc:493] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:43.720930  4100 raft_consensus.cc:3060] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:43.722681 30546 raft_consensus.cc:2468] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 17.
I20260709 13:10:43.723729 30589 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:43.724705  4110 leader_election.cc:290] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 17 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:43.725338  4110 raft_consensus.cc:2804] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:43.725788  4110 raft_consensus.cc:697] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:43.726704  4110 consensus_queue.cc:237] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:43.717597 30517 leader_election.cc:336] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
I20260709 13:10:43.741819 30517 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:43.742079  4057 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
W20260709 13:10:43.742738 30517 leader_election.cc:336] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
I20260709 13:10:43.742635  4057 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:43.743256 30517 leader_election.cc:336] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
I20260709 13:10:43.743875  4112 raft_consensus.cc:2749] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:43.727726  4100 raft_consensus.cc:515] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:43.783573 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 130380us
I20260709 13:10:43.787743 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a418ef882d34180817469c4e2495268" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:43.788367 30550 raft_consensus.cc:3060] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:43.788280 30516 leader_election.cc:304] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:10:43.792424 30516 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:43.796996  4119 raft_consensus.cc:2749] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:43.792635 31172 debug-util.cc:398] Leaking SignalData structure 0x7b080036e400 after lost signal to thread 29367
W20260709 13:10:43.804080 31172 debug-util.cc:398] Leaking SignalData structure 0x7b0800267880 after lost signal to thread 30408
W20260709 13:10:43.805624 31172 debug-util.cc:398] Leaking SignalData structure 0x7b08002502a0 after lost signal to thread 30575
W20260709 13:10:43.806865 31172 debug-util.cc:398] Leaking SignalData structure 0x7b08002970a0 after lost signal to thread 30649
W20260709 13:10:43.808405 31172 debug-util.cc:398] Leaking SignalData structure 0x7b08000da8c0 after lost signal to thread 31175
I20260709 13:10:43.812085  4100 leader_election.cc:290] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:43.813036 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e31b2accf3b4a3b8b7668571e619eb7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:43.813668 30623 raft_consensus.cc:3060] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:43.791250  4114 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:43.820171  4114 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:43.821909 30623 raft_consensus.cc:2468] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 10.
I20260709 13:10:43.822400  4114 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:43.793129  4106 raft_consensus.cc:2764] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
W20260709 13:10:43.825538 30517 leader_election.cc:336] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
I20260709 13:10:43.826352 31115 leader_election.cc:304] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:43.815220  4104 raft_consensus.cc:515] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:43.837363 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 55231.6us
I20260709 13:10:43.842082 30549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:43.842504 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:43.843305 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:43.843901 30547 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 19.
I20260709 13:10:43.844585 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:43.844834 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:43.845594 30624 raft_consensus.cc:2393] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 14: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:10:43.847925 30589 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:43.848706  4124 raft_consensus.cc:2804] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:43.849090  4124 raft_consensus.cc:493] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 19 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:43.849490  4124 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:43.849866  4100 raft_consensus.cc:2804] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:43.850515  4100 raft_consensus.cc:697] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 10 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:43.851581  4100 consensus_queue.cc:237] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:43.853379 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 112085us
W20260709 13:10:43.854271 30591 leader_election.cc:336] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
I20260709 13:10:43.802711  4057 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:10:43.858749 30517 leader_election.cc:336] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
W20260709 13:10:43.859287 30517 leader_election.cc:336] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
I20260709 13:10:43.873500 30623 raft_consensus.cc:2393] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 092f6eb694fc4bbeab49677cccd880fd in current term 18: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:10:43.874907 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:43.875459 31150 raft_consensus.cc:3060] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:43.876149 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 83792.5us
I20260709 13:10:43.879649 30516 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:43.880762 30550 raft_consensus.cc:2468] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 16.
W20260709 13:10:43.884629 29364 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 30497)
I20260709 13:10:43.886006 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:43.886654 31145 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 18.
I20260709 13:10:43.890686 31150 raft_consensus.cc:2468] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 13.
I20260709 13:10:43.890834  4124 raft_consensus.cc:515] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:43.892892  4124 leader_election.cc:290] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 20 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:43.893903  4105 raft_consensus.cc:2749] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:43.895318 30516 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:43.896219  4126 raft_consensus.cc:2749] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:43.885206  4110 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:43.898120  4110 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:43.900575 30516 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:10:43.904893  4126 raft_consensus.cc:2804] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:43.905279  4126 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 18 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:43.905629  4126 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:43.900786  4104 leader_election.cc:290] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 18 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:43.902411  4113 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:43.910974  4110 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:10:43.907694 30591 leader_election.cc:336] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
I20260709 13:10:43.908166 30516 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326
W20260709 13:10:43.912606 30591 leader_election.cc:336] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
I20260709 13:10:43.913120 30591 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
W20260709 13:10:43.923238 31116 leader_election.cc:336] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
I20260709 13:10:43.911446  4113 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
W20260709 13:10:43.933512 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 54752.5us
I20260709 13:10:43.924196  4114 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:43.927731  4105 raft_consensus.cc:2804] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:43.944191  4123 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:43.946033 31114 leader_election.cc:304] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:10:43.936760  4124 raft_consensus.cc:2749] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:43.959932 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc3578422e49f4a6025c428fa5d426" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:43.960541 30550 raft_consensus.cc:3060] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:43.962203  4113 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:43.966640 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e82bb3f413748538cf887dcc15fe04c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:43.967239 30546 raft_consensus.cc:3060] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:43.948064  4105 raft_consensus.cc:697] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 13 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:43.968935 30547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:43.969494 30547 raft_consensus.cc:2468] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 14.
I20260709 13:10:43.972780  4105 consensus_queue.cc:237] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:43.976121 30517 leader_election.cc:336] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
I20260709 13:10:43.981406 30546 raft_consensus.cc:2468] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 18.
I20260709 13:10:43.949504  4123 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:43.945986  4114 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:44.010301  4114 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:10:43.996433 30591 leader_election.cc:336] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
W20260709 13:10:44.011258 30591 leader_election.cc:336] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
W20260709 13:10:44.011983 30591 leader_election.cc:336] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
I20260709 13:10:44.012461 30591 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:44.013399  4104 raft_consensus.cc:2749] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:43.992530 30550 raft_consensus.cc:2468] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 20.
I20260709 13:10:43.959228  4124 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:43.987087  4100 raft_consensus.cc:2804] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:43.991350 30369 catalog_manager.cc:5697] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 9 to 10, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 10 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:44.033587  4126 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:44.044171 30591 leader_election.cc:336] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
W20260709 13:10:44.044734 30591 leader_election.cc:336] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
W20260709 13:10:44.045162 30591 leader_election.cc:336] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
W20260709 13:10:44.063258 30591 leader_election.cc:336] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
I20260709 13:10:44.063335 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:44.071522 30618 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 14.
W20260709 13:10:44.072006 30517 leader_election.cc:336] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
I20260709 13:10:44.074944 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:44.075582 30550 raft_consensus.cc:2468] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 13.
I20260709 13:10:44.076702 30589 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:10:44.026114  4124 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:44.078800  4098 raft_consensus.cc:2804] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:44.079213  4098 raft_consensus.cc:493] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:44.079639  4098 raft_consensus.cc:3060] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:44.080184  4124 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:44.052796  4100 raft_consensus.cc:697] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 16 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:44.081709 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:44.082340 31150 raft_consensus.cc:2468] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 13.
I20260709 13:10:44.082370  4100 consensus_queue.cc:237] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:44.084547 30590 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:44.088349  4126 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 19 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:44.089184 30371 catalog_manager.cc:5697] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 12 to 13, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 13 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:44.093645 30589 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
W20260709 13:10:44.096222 31116 leader_election.cc:336] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
I20260709 13:10:44.098960 30589 leader_election.cc:304] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:10:44.097844  4127 raft_consensus.cc:2804] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:44.086357  4123 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:44.101111  4127 raft_consensus.cc:493] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:44.101554  4127 raft_consensus.cc:3060] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:44.101693  4057 raft_consensus.cc:2804] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:44.103977  4057 raft_consensus.cc:697] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 20 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:44.104898  4057 consensus_queue.cc:237] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:44.108958 30589 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:10:44.111116 30516 leader_election.cc:304] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: f639301059e24dc5b0d88a46dc683326, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:44.112119  4132 raft_consensus.cc:2749] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:44.108697  4104 raft_consensus.cc:2804] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:10:44.114830 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 168855us
I20260709 13:10:44.117260  4104 raft_consensus.cc:697] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 18 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:44.118602  4104 consensus_queue.cc:237] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:44.120769  4110 raft_consensus.cc:2804] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:44.121191  4110 raft_consensus.cc:493] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:44.121546  4110 raft_consensus.cc:3060] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:44.125914  4098 raft_consensus.cc:515] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:44.139508 31150 raft_consensus.cc:1275] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 18 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:10:44.141705  4116 consensus_queue.cc:1048] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:44.142410  4098 leader_election.cc:290] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:44.151346 30516 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:10:44.155849  4111 raft_consensus.cc:2804] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:44.156257  4111 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:44.156636  4111 raft_consensus.cc:3060] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:44.156522  4110 raft_consensus.cc:515] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:44.158844  4110 leader_election.cc:290] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:44.161984  4127 raft_consensus.cc:515] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:44.168547 30517 consensus_peers.cc:597] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:44.170503 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb22806325394ba386d8549bc4a64701" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:44.171130 31145 raft_consensus.cc:3060] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:44.170794  4127 leader_election.cc:290] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:44.176992  4111 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:44.179078  4111 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:44.184995 31145 raft_consensus.cc:2468] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 14.
I20260709 13:10:44.185089 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:44.185824 30550 raft_consensus.cc:2468] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 14.
I20260709 13:10:44.189402 30590 leader_election.cc:304] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:44.196122 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85088611c7e34066afbf929fc1cbe50d" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:44.196740 31145 raft_consensus.cc:3060] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:44.196838  4127 raft_consensus.cc:2804] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:44.205120  4127 raft_consensus.cc:697] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
W20260709 13:10:44.206557 30591 consensus_peers.cc:597] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:44.207130 30591 leader_election.cc:336] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
W20260709 13:10:44.207924 30589 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 99032.6us
I20260709 13:10:44.208792  4127 consensus_queue.cc:237] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:44.209591 31116 consensus_peers.cc:597] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:44.220217 30546 raft_consensus.cc:1275] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:10:44.221144 30544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4c506564124bd5b3a4c756362eee6b" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
W20260709 13:10:44.220217 30591 consensus_peers.cc:597] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:44.221763 30544 raft_consensus.cc:3060] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:44.222059 30591 leader_election.cc:336] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
W20260709 13:10:44.226181 30591 leader_election.cc:336] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
W20260709 13:10:44.226636 30591 leader_election.cc:336] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
W20260709 13:10:44.227348 30591 consensus_peers.cc:597] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:44.227591 30517 leader_election.cc:336] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
W20260709 13:10:44.232476 30517 consensus_peers.cc:597] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:44.233034 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14ecc42199f4251b2f85f94871fe61f" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:44.233628 30550 raft_consensus.cc:3060] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:44.242167 30550 raft_consensus.cc:2468] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 14.
I20260709 13:10:44.216917 31114 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:10:44.242417 30544 raft_consensus.cc:2468] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 15.
W20260709 13:10:44.245803 31116 consensus_peers.cc:597] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:44.245978 30546 raft_consensus.cc:1275] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:10:44.265326 30623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db4f54e7ad744ccb95e9f62b315f1408" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:44.253829  4137 raft_consensus.cc:2804] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:44.265964 30623 raft_consensus.cc:3060] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:44.266306  4137 raft_consensus.cc:493] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f639301059e24dc5b0d88a46dc683326)
I20260709 13:10:44.266714  4137 raft_consensus.cc:3060] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:44.270749 30369 catalog_manager.cc:5697] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 15 to 16, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 16 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:44.274688 30623 raft_consensus.cc:2468] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 15.
I20260709 13:10:44.248553 31145 raft_consensus.cc:2468] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 092f6eb694fc4bbeab49677cccd880fd in term 19.
W20260709 13:10:44.278766 31116 consensus_peers.cc:597] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:44.289040 30516 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326
W20260709 13:10:44.315477 30591 consensus_peers.cc:597] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:44.315303  4138 consensus_queue.cc:1048] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:10:44.316031 30591 consensus_peers.cc:597] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:44.318840 30517 consensus_peers.cc:597] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:44.320174 30589 leader_election.cc:304] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:10:44.325258 30623 raft_consensus.cc:1275] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:10:44.326043 30589 leader_election.cc:304] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:10:44.326924  4100 consensus_queue.cc:1048] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:44.328078  4139 raft_consensus.cc:2804] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:44.328614  4139 raft_consensus.cc:697] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:44.311002  4111 raft_consensus.cc:2804] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:44.331416  4111 raft_consensus.cc:697] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 19 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:44.329502  4139 consensus_queue.cc:237] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:44.332351  4111 consensus_queue.cc:237] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:44.340380 30516 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:10:44.274708  4137 raft_consensus.cc:515] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:44.349651  4105 raft_consensus.cc:2804] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:44.350154  4105 raft_consensus.cc:697] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 15 LEADER]: Becoming Leader. State: Replica: 092f6eb694fc4bbeab49677cccd880fd, State: Running, Role: LEADER
I20260709 13:10:44.338430  4057 consensus_queue.cc:1048] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:10:44.350989  4105 consensus_queue.cc:237] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:44.336001  4138 raft_consensus.cc:2804] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:44.353050  4138 raft_consensus.cc:697] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:44.353863  4138 consensus_queue.cc:237] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:44.394806  4137 leader_election.cc:290] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:44.399708 30546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8abe384b054cf09bfba7143adf03f1" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:44.400308 30546 raft_consensus.cc:3060] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:44.400440 30517 consensus_peers.cc:597] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:44.398721 30369 catalog_manager.cc:5697] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 16 to 17, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 17 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:44.408803 30517 consensus_peers.cc:597] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:44.407972 31116 leader_election.cc:336] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
W20260709 13:10:44.409468 31116 consensus_peers.cc:597] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:44.410945 30369 catalog_manager.cc:5697] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 19 to 20, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 20 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:44.414142 30369 catalog_manager.cc:5697] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 17 to 18, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 18 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:44.415694 30546 raft_consensus.cc:2468] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 15.
I20260709 13:10:44.418026 31114 leader_election.cc:304] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6; no voters: f639301059e24dc5b0d88a46dc683326
I20260709 13:10:44.416555 30369 catalog_manager.cc:5697] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 13 to 14, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 14 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:44.432991 30517 consensus_peers.cc:597] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:44.434140 30371 catalog_manager.cc:5697] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 18 to 19, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 19 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:44.437180 31116 consensus_peers.cc:597] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:44.454506 31150 raft_consensus.cc:1275] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:44.460633  4126 consensus_queue.cc:1048] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:10:44.469718 30591 consensus_peers.cc:597] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:44.470415 30591 consensus_peers.cc:597] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:44.430325  4137 raft_consensus.cc:2804] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:44.475320  4137 raft_consensus.cc:697] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 15 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:44.512465  4137 consensus_queue.cc:237] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:44.544304 30591 consensus_peers.cc:597] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:44.551608 31116 consensus_peers.cc:597] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:44.552167 31116 consensus_peers.cc:597] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:44.574818 31116 consensus_peers.cc:597] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:44.594901 30517 consensus_peers.cc:597] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:44.608163 30550 raft_consensus.cc:1275] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:10:44.609965  4100 consensus_queue.cc:1048] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:10:44.618729 30550 raft_consensus.cc:1275] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 20 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
W20260709 13:10:44.619112 30591 consensus_peers.cc:597] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:44.619645 30591 consensus_peers.cc:597] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:44.621562  4127 consensus_queue.cc:1048] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:10:44.623898 30591 consensus_peers.cc:597] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:44.624554 30591 consensus_peers.cc:597] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:44.625479 31116 consensus_peers.cc:597] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:44.625988 31116 consensus_peers.cc:597] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:44.604696 30371 catalog_manager.cc:5697] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd reported cstate change: term changed from 14 to 15, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2). New cstate: current_term: 15 leader_uuid: "092f6eb694fc4bbeab49677cccd880fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:44.639729 30373 catalog_manager.cc:5697] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 14 to 15, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 15 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:44.649358 30369 catalog_manager.cc:5697] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 13 to 14, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 14 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:44.651202 30369 catalog_manager.cc:5697] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 14 to 15, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 15 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:44.658464 30517 consensus_peers.cc:597] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:44.699862 30591 consensus_peers.cc:597] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:44.700399 30591 consensus_peers.cc:597] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:44.714931 30517 consensus_peers.cc:597] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:44.736155 30550 raft_consensus.cc:1275] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 18 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:10:44.738121  4139 consensus_queue.cc:1048] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:10:44.746388 30517 consensus_peers.cc:597] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:44.746599 30549 raft_consensus.cc:1275] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:44.749948  4104 consensus_queue.cc:1048] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:44.770115 31145 raft_consensus.cc:1275] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:10:44.772171  4124 consensus_queue.cc:1048] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:10:44.795285 30517 consensus_peers.cc:597] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:44.798825 30550 raft_consensus.cc:1275] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:44.800536  4124 consensus_queue.cc:1048] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:10:44.825736 30591 consensus_peers.cc:597] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:44.833040 31116 consensus_peers.cc:597] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:44.839437 30591 consensus_peers.cc:597] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:44.848563 30517 consensus_peers.cc:597] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:44.857875 30621 raft_consensus.cc:1275] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:10:44.859395  4112 consensus_queue.cc:1048] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:10:44.874894 30517 consensus_peers.cc:597] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:44.885056 29364 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 30497)
W20260709 13:10:44.902395 30591 consensus_peers.cc:597] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:44.937394 30517 consensus_peers.cc:597] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:44.937806 31145 raft_consensus.cc:1275] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 19 FOLLOWER]: Refusing update from remote peer 092f6eb694fc4bbeab49677cccd880fd: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 13:10:44.937487 31116 consensus_peers.cc:597] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:44.940070 30517 consensus_peers.cc:597] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:44.940239  4112 consensus_queue.cc:1048] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
W20260709 13:10:44.950830 30591 consensus_peers.cc:597] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:44.956684 30550 raft_consensus.cc:1275] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Refusing update from remote peer cd669586cff44d4bbfcc007e213faab6: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:10:44.958619  4100 consensus_queue.cc:1048] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:10:44.975742 30591 consensus_peers.cc:597] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:45.512749  4116 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.513242  4116 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:45.516203 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:45.516753 30550 raft_consensus.cc:2468] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 14.
I20260709 13:10:45.517907 30589 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:45.518594  4139 raft_consensus.cc:2804] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:45.518950  4139 raft_consensus.cc:493] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.519265  4139 raft_consensus.cc:3060] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:45.524209  4116 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:10:45.547134 30591 leader_election.cc:336] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
I20260709 13:10:45.527842  4139 raft_consensus.cc:515] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:45.554091 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a999056752144cc99cdd136c40917d2c" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd"
I20260709 13:10:45.554628 30550 raft_consensus.cc:3060] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:45.562992 30550 raft_consensus.cc:2468] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 15.
I20260709 13:10:45.567211 30589 leader_election.cc:304] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:45.568053  4116 raft_consensus.cc:2804] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:45.568547  4116 raft_consensus.cc:697] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:45.569434  4116 consensus_queue.cc:237] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:45.570319  4139 leader_election.cc:290] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 election: Requested vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:10:45.574476 30591 leader_election.cc:336] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
I20260709 13:10:45.597139 30371 catalog_manager.cc:5697] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 13 to 15, leader changed from f639301059e24dc5b0d88a46dc683326 (127.28.173.1) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 15 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:45.899001 29364 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 30497)
W20260709 13:10:46.054620 30591 consensus_peers.cc:597] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:46.113941 30550 raft_consensus.cc:1275] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:10:46.118196  4139 consensus_queue.cc:1048] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:10:46.471963 30591 consensus_peers.cc:597] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:46.605224 30591 consensus_peers.cc:597] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:46.632427 31116 consensus_peers.cc:597] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:46.637619 30517 consensus_peers.cc:597] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:46.663305 30591 consensus_peers.cc:597] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:46.695243 30517 consensus_peers.cc:597] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:46.722004 30591 consensus_peers.cc:597] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:46.722622 31116 consensus_peers.cc:597] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:46.744459 30591 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111) [suppressed 434 similar messages]
W20260709 13:10:46.747396 30591 consensus_peers.cc:597] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:46.866243 30591 consensus_peers.cc:597] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:46.886876 31116 consensus_peers.cc:597] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:46.887558 30517 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 91527.7us
W20260709 13:10:46.898614 31116 consensus_peers.cc:597] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:46.898765 30517 consensus_peers.cc:597] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:46.899529 29364 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 30497)
W20260709 13:10:46.906320 30517 consensus_peers.cc:597] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:46.907395 30591 consensus_peers.cc:597] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:46.915680 31116 consensus_peers.cc:597] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:46.923309 30517 consensus_peers.cc:597] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:47.030794 30517 consensus_peers.cc:597] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:47.054667 30591 consensus_peers.cc:597] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:47.058247 30591 consensus_peers.cc:597] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:47.058736 30591 consensus_peers.cc:597] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:47.164322 30517 consensus_peers.cc:597] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:47.788388 31116 consensus_peers.cc:597] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:47.789036 31116 consensus_peers.cc:597] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:47.817564 30591 consensus_peers.cc:597] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:47.830116 30591 consensus_peers.cc:597] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:47.831419 30591 consensus_peers.cc:597] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:47.899979 29364 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 30497)
W20260709 13:10:48.052628 30646 debug-util.cc:398] Leaking SignalData structure 0x7b08003c3700 after lost signal to thread 29367
W20260709 13:10:48.054075 30646 debug-util.cc:398] Leaking SignalData structure 0x7b08003b3580 after lost signal to thread 30408
W20260709 13:10:48.059161 30516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 859900us
W20260709 13:10:48.055737 30646 debug-util.cc:398] Leaking SignalData structure 0x7b080024c580 after lost signal to thread 30575
W20260709 13:10:48.067492 30646 debug-util.cc:398] Leaking SignalData structure 0x7b080038cda0 after lost signal to thread 30649
W20260709 13:10:48.068655 30646 debug-util.cc:398] Leaking SignalData structure 0x7b08002c4e40 after lost signal to thread 31175
W20260709 13:10:48.119016 30591 consensus_peers.cc:597] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:48.119668 30591 consensus_peers.cc:597] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:48.120424 30591 consensus_peers.cc:597] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:48.157251 30591 consensus_peers.cc:597] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:48.171715  4202 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:48.172544  4202 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:48.176501 31115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:32851, user_credentials={real_user=slave}} blocked reactor thread for 55778.9us
I20260709 13:10:48.186707  4202 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:10:48.190568 30572 debug-util.cc:398] Leaking SignalData structure 0x7b0800269f20 after lost signal to thread 29367
W20260709 13:10:48.191735 30572 debug-util.cc:398] Leaking SignalData structure 0x7b08003e5720 after lost signal to thread 30408
W20260709 13:10:48.193048 30572 debug-util.cc:398] Leaking SignalData structure 0x7b08002c7580 after lost signal to thread 30575
W20260709 13:10:48.194116 30572 debug-util.cc:398] Leaking SignalData structure 0x7b08003e80e0 after lost signal to thread 30649
W20260709 13:10:48.200742 30572 debug-util.cc:398] Leaking SignalData structure 0x7b0800358a40 after lost signal to thread 31175
W20260709 13:10:48.212769 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 60334.5us
I20260709 13:10:48.213004  4196 raft_consensus.cc:493] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader cd669586cff44d4bbfcc007e213faab6)
I20260709 13:10:48.213632  4196 raft_consensus.cc:515] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:48.215659  4196 leader_election.cc:290] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:10:48.223001 31116 consensus_peers.cc:597] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:48.223511 31116 consensus_peers.cc:597] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:48.243902 30517 consensus_peers.cc:597] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:48.251968 31116 consensus_peers.cc:597] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:48.259893 30517 consensus_peers.cc:597] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:48.262650 30517 consensus_peers.cc:597] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:48.265442 30517 consensus_peers.cc:597] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:48.267335 30542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80cbe47dd35948b8b10070e934216d98" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:48.269794 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:48.280723 30624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e5fda238ec24b13b992b82bed92951f" candidate_uuid: "092f6eb694fc4bbeab49677cccd880fd" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
W20260709 13:10:48.288945 30517 consensus_peers.cc:597] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:48.292354 30517 consensus_peers.cc:597] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:48.293007 30517 consensus_peers.cc:597] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:48.293464 30517 consensus_peers.cc:597] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:48.291862 31116 consensus_peers.cc:597] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:48.298974 31116 consensus_peers.cc:597] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:48.299707 31116 leader_election.cc:336] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
I20260709 13:10:48.301496 31116 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:48.302376  4133 raft_consensus.cc:2749] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:48.311932 30516 leader_election.cc:304] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 092f6eb694fc4bbeab49677cccd880fd; no voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:48.312819  4193 raft_consensus.cc:2749] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:10:48.520318 30591 consensus_peers.cc:597] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:48.603452 30591 consensus_peers.cc:597] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:48.646968  4190 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:48.647571  4190 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:48.651140 30550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6e86e0a4b843478d5970b29ad63ad7" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "092f6eb694fc4bbeab49677cccd880fd" is_pre_election: true
I20260709 13:10:48.681563  4190 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:10:48.693981 30591 consensus_peers.cc:597] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:48.709159 31116 leader_election.cc:336] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
I20260709 13:10:48.709717 31116 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:48.710443  4190 raft_consensus.cc:2749] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:48.900483 29364 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 30497)
W20260709 13:10:49.403980 30591 consensus_peers.cc:597] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:49.420914 30591 consensus_peers.cc:597] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:49.684041 30591 consensus_peers.cc:597] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:49.706214 30591 consensus_peers.cc:597] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:49.706712 30591 consensus_peers.cc:597] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:49.735842 30591 consensus_peers.cc:597] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:49.852226 30517 consensus_peers.cc:597] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:49.868427 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 46231.1us
W20260709 13:10:49.901018 29364 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 30497)
W20260709 13:10:49.950825 30591 consensus_peers.cc:597] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:50.126197 30517 consensus_peers.cc:597] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:50.110056 30591 consensus_peers.cc:597] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:50.156875 31116 consensus_peers.cc:597] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:50.169963 30517 consensus_peers.cc:597] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:50.203761 30517 consensus_peers.cc:597] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:50.172576 31116 consensus_peers.cc:597] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:50.216234 31116 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 43703.8us
W20260709 13:10:50.221693 30591 consensus_peers.cc:597] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:50.276567 30517 consensus_peers.cc:597] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:50.290452 30591 consensus_peers.cc:597] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:50.330252 30517 consensus_peers.cc:597] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:50.338413 31116 consensus_peers.cc:597] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:50.343312 31116 consensus_peers.cc:597] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:50.357537 31114 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:34733, user_credentials={real_user=slave}} blocked reactor thread for 52210.9us
W20260709 13:10:50.367859 31116 consensus_peers.cc:597] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:50.370210 31116 consensus_peers.cc:597] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:50.382489 30517 consensus_peers.cc:597] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:50.386001 30591 consensus_peers.cc:597] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:50.388616 30591 consensus_peers.cc:597] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:50.389178 30517 consensus_peers.cc:597] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:50.394946 30591 consensus_peers.cc:597] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:50.409706 30517 consensus_peers.cc:597] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:50.435979 30517 consensus_peers.cc:597] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:50.436522 30517 consensus_peers.cc:597] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:50.456321 30591 consensus_peers.cc:597] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:50.486500 30517 consensus_peers.cc:597] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:50.516561 31116 consensus_peers.cc:597] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:50.594594 30517 consensus_peers.cc:597] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:50.630473 30591 consensus_peers.cc:597] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:50.642726 31116 consensus_peers.cc:597] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:50.681943 31116 consensus_peers.cc:597] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:50.683498 30591 consensus_peers.cc:597] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:50.692210 30591 consensus_peers.cc:597] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:50.693022 31116 consensus_peers.cc:597] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:50.699532 30517 consensus_peers.cc:597] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:50.701195 31116 consensus_peers.cc:597] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:50.719655 30517 consensus_peers.cc:597] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:50.789728 30591 consensus_peers.cc:597] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:50.901489 29364 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 30497)
W20260709 13:10:50.916460 31116 consensus_peers.cc:597] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:51.420063 30591 consensus_peers.cc:597] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:51.517614 30591 consensus_peers.cc:597] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:51.747923 31116 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111) [suppressed 397 similar messages]
W20260709 13:10:51.854861 30591 consensus_peers.cc:597] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:51.902163 29364 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 30497)
W20260709 13:10:52.006445 30591 consensus_peers.cc:597] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:52.059950 30591 consensus_peers.cc:597] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:52.232498 30591 consensus_peers.cc:597] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:52.248912 30591 consensus_peers.cc:597] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:52.252787 30591 consensus_peers.cc:597] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:52.335963 30517 consensus_peers.cc:597] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:52.407212 30591 consensus_peers.cc:597] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:52.409943 31116 consensus_peers.cc:597] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:52.424242 30517 consensus_peers.cc:597] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:52.439502 31116 consensus_peers.cc:597] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:52.468374 30517 consensus_peers.cc:597] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:52.530635 30517 consensus_peers.cc:597] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:52.542451 30591 consensus_peers.cc:597] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:52.548471 30591 consensus_peers.cc:597] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:52.575663 30517 consensus_peers.cc:597] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:52.612649 30591 consensus_peers.cc:597] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:52.649729 31116 consensus_peers.cc:597] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:52.685091 31116 consensus_peers.cc:597] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:52.702081 30591 consensus_peers.cc:597] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:52.725409 30591 consensus_peers.cc:597] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:52.846165 30591 consensus_peers.cc:597] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:52.851500 31116 consensus_peers.cc:597] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:52.895408 30517 consensus_peers.cc:597] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:52.903060 29364 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 30497)
W20260709 13:10:52.925845 30517 consensus_peers.cc:597] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:52.926463 30517 consensus_peers.cc:597] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:52.951089 30591 consensus_peers.cc:597] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:52.968809 31116 consensus_peers.cc:597] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:52.988198 30517 consensus_peers.cc:597] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:53.007972 31116 consensus_peers.cc:597] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:53.019021 31116 consensus_peers.cc:597] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:53.048131 30517 consensus_peers.cc:597] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:53.076009 30517 consensus_peers.cc:597] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:53.200412 30517 consensus_peers.cc:597] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:53.231742 30517 consensus_peers.cc:597] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:53.258934 30591 consensus_peers.cc:597] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:53.270072 31116 consensus_peers.cc:597] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:53.292945 30517 consensus_peers.cc:597] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:53.318426 30591 consensus_peers.cc:597] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:53.322535 30517 consensus_peers.cc:597] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:53.432996 31116 consensus_peers.cc:597] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:53.433776 31116 consensus_peers.cc:597] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:53.526160 31116 consensus_peers.cc:597] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:53.545423 30591 consensus_peers.cc:597] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:53.630722 30591 consensus_peers.cc:597] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:53.687050 30591 consensus_peers.cc:597] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:53.859719 30591 consensus_peers.cc:597] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:53.903571 29364 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 30497)
W20260709 13:10:54.222113 30591 consensus_peers.cc:597] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:54.358639 30591 consensus_peers.cc:597] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:54.621075 30591 consensus_peers.cc:597] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:54.621681 30591 consensus_peers.cc:597] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:10:54.720659 29364 tablet_server.cc:196] TabletServer@127.28.173.1:0 shutdown complete.
W20260709 13:10:54.851475 30517 consensus_peers.cc:597] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:54.870720 30517 consensus_peers.cc:597] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:54.874256 30591 consensus_peers.cc:597] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:54.884301 30591 consensus_peers.cc:597] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:54.922969 30517 consensus_peers.cc:597] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:54.925124 30591 consensus_peers.cc:597] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:54.926997 31116 consensus_peers.cc:597] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:54.944262 30591 consensus_peers.cc:597] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:10:54.961333 29364 tablet_server.cc:179] TabletServer@127.28.173.2:0 shutting down...
W20260709 13:10:54.972886 30517 consensus_peers.cc:597] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:54.994405 31116 consensus_peers.cc:597] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:54.995187 30517 consensus_peers.cc:597] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:54.997689 30591 consensus_peers.cc:597] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:55.008612 30589 consensus_peers.cc:597] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.020602 30591 consensus_peers.cc:597] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:55.026827 30591 consensus_peers.cc:597] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:55.027957 30589 consensus_peers.cc:597] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.032033 30589 consensus_peers.cc:597] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.036497 30589 consensus_peers.cc:597] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.069119 30591 consensus_peers.cc:597] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:55.070888 31116 consensus_peers.cc:597] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:55.107353 31114 consensus_peers.cc:597] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.132885 30589 consensus_peers.cc:597] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.133571 30589 consensus_peers.cc:597] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.134074 30589 consensus_peers.cc:597] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.139050 30589 consensus_peers.cc:597] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.140787 30589 consensus_peers.cc:597] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.141400 30589 consensus_peers.cc:597] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.148083 31114 consensus_peers.cc:597] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.160609 30589 consensus_peers.cc:597] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:55.164732 29364 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:55.168658 29364 tablet_replica.cc:333] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:55.170027 29364 raft_consensus.cc:2243] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.170967 29364 raft_consensus.cc:2272] T ee49a377a80e4f4199281fb5e44d3be6 P 092f6eb694fc4bbeab49677cccd880fd [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.173887 29364 tablet_replica.cc:333] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:55.174731 29364 raft_consensus.cc:2243] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.175447 29364 raft_consensus.cc:2272] T c504e96bd6f14a19b7dfe8203129e4b4 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.178766 29364 tablet_replica.cc:333] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:55.179694 29364 raft_consensus.cc:2243] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.180934 29364 raft_consensus.cc:2272] T 2b207fb799ce4340b29ae053898e0e6c P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.184293 29364 tablet_replica.cc:333] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:55.185243 29364 raft_consensus.cc:2243] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.186630 29364 raft_consensus.cc:2272] T a2fd6793fef04209ae40ee4d9ba90f42 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.189342 29364 tablet_replica.cc:333] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:55.190110 29364 raft_consensus.cc:2243] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.190745 29364 raft_consensus.cc:2272] T 1d4c506564124bd5b3a4c756362eee6b P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.193315 29364 tablet_replica.cc:333] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:55.194140 29364 raft_consensus.cc:2243] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Raft consensus shutting down.
W20260709 13:10:55.212262 31114 consensus_peers.cc:597] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.214246 30589 consensus_peers.cc:597] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.227522 30589 consensus_peers.cc:597] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:55.194806 29364 raft_consensus.cc:2272] T db830c61bd0a4c3d80284c8c56165b1b P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:55.245684 31114 consensus_peers.cc:597] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:55.247098 29364 tablet_replica.cc:333] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:55.248023 29364 raft_consensus.cc:2243] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.249080 29364 raft_consensus.cc:2272] T a439756f6e7242f8b5b1ef7ea97874d4 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.251751 29364 tablet_replica.cc:333] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:55.252924 29364 raft_consensus.cc:2243] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.253613 29364 raft_consensus.cc:2272] T 4859507b516b4f62a81b965e2686e618 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:55.260660 30589 consensus_peers.cc:597] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:55.262394 29364 tablet_replica.cc:333] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:55.268067 29364 raft_consensus.cc:2243] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.270217 29364 raft_consensus.cc:2272] T 772a658508f4465d8c1ef039f5bcaa67 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.278846 29364 tablet_replica.cc:333] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
W20260709 13:10:55.300787 30591 consensus_peers.cc:597] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:55.302510 30589 consensus_peers.cc:597] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.314956 31114 consensus_peers.cc:597] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.326828 31114 consensus_peers.cc:597] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.329212 30589 consensus_peers.cc:597] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.333987 30589 consensus_peers.cc:597] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.334579 30589 consensus_peers.cc:597] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.333387 31114 consensus_peers.cc:597] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.337291 30589 consensus_peers.cc:597] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:55.339776 29364 raft_consensus.cc:2243] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.340996 29364 raft_consensus.cc:2272] T 7c9861593ab94f7792fdd702f1d9a483 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.343778 29364 tablet_replica.cc:333] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:55.344583 29364 raft_consensus.cc:2243] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.345355 29364 raft_consensus.cc:2272] T 53842c918e2c4018ba572aaf3dfbfe31 P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.347790 29364 tablet_replica.cc:333] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:55.348610 29364 raft_consensus.cc:2243] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.349750 29364 raft_consensus.cc:2272] T 541099fd564e49f2ad553f250f319fb0 P 092f6eb694fc4bbeab49677cccd880fd [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.373483 29364 tablet_replica.cc:333] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
W20260709 13:10:55.382711 31116 consensus_peers.cc:597] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:55.382876 31114 consensus_peers.cc:597] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.396371 30589 consensus_peers.cc:597] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:55.397746 29364 raft_consensus.cc:2243] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.398432 29364 raft_consensus.cc:2272] T 34bc3578422e49f4a6025c428fa5d426 P 092f6eb694fc4bbeab49677cccd880fd [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.402674 29364 tablet_replica.cc:333] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:55.403436 29364 raft_consensus.cc:2243] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.404544 29364 raft_consensus.cc:2272] T 47d5557143454f988a101125d3b5c0d7 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:55.413844 31116 consensus_peers.cc:597] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:10:55.416888 29364 tablet_replica.cc:333] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:55.417882 29364 raft_consensus.cc:2243] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.418691 29364 raft_consensus.cc:2272] T dfc9f90b82b84a8cb47cbee7adb0401a P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.421962 29364 tablet_replica.cc:333] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:55.422919 29364 raft_consensus.cc:2243] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.424316 29364 raft_consensus.cc:2272] T 795e206cd48a484a88a226d02f465b8f P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.427232 29364 tablet_replica.cc:333] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:55.428020 29364 raft_consensus.cc:2243] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.429523 29364 raft_consensus.cc:2272] T b0842494dc2a48d89fb422524082081d P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.432263 29364 tablet_replica.cc:333] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:55.433223 29364 raft_consensus.cc:2243] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.434255 29364 raft_consensus.cc:2272] T f6fb8561d12345948ed56d359f5ef4f3 P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.439460 29364 tablet_replica.cc:333] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:55.441241 29364 raft_consensus.cc:2243] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.442018 29364 raft_consensus.cc:2272] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P 092f6eb694fc4bbeab49677cccd880fd [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:55.447471 30591 consensus_peers.cc:597] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:55.451587 30589 consensus_peers.cc:597] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:55.467950 30517 consensus_peers.cc:597] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:55.478439 31114 consensus_peers.cc:597] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:55.446542 29364 tablet_replica.cc:333] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:55.485734 29364 raft_consensus.cc:2243] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.487376 29364 raft_consensus.cc:2272] T bd3964085c9b4234998aecbbce16d24a P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.489903 29364 tablet_replica.cc:333] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:55.490685 29364 raft_consensus.cc:2243] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.491914 29364 raft_consensus.cc:2272] T 80cbe47dd35948b8b10070e934216d98 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.494275 29364 tablet_replica.cc:333] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:55.495065 29364 raft_consensus.cc:2243] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.495716 29364 raft_consensus.cc:2272] T 1a418ef882d34180817469c4e2495268 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.498597 29364 tablet_replica.cc:333] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
W20260709 13:10:55.519408 30517 consensus_peers.cc:597] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:55.519894 31116 consensus_peers.cc:597] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:10:55.535838 29364 raft_consensus.cc:2243] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Raft consensus shutting down.
W20260709 13:10:55.554824 30517 consensus_peers.cc:597] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:55.559257 31116 consensus_peers.cc:597] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:10:55.538197 29364 raft_consensus.cc:2272] T d641a3d4c880431b9375d9c775d7be72 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.618575 29364 tablet_replica.cc:333] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:55.623466 29364 raft_consensus.cc:2243] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.624207 29364 raft_consensus.cc:2272] T 353e93aef12a4b92b159b611a66cf3c3 P 092f6eb694fc4bbeab49677cccd880fd [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.628124 29364 tablet_replica.cc:333] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:55.634037 29364 raft_consensus.cc:2243] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.634840 29364 raft_consensus.cc:2272] T 606c3ee77596493da2daa40edde4d1ea P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.637681 29364 tablet_replica.cc:333] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:55.638413 29364 raft_consensus.cc:2243] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.639601 29364 raft_consensus.cc:2272] T 7f8b6eff35aa4b96bf5f73d6a94db695 P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.700059 29364 tablet_replica.cc:333] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:55.700975 29364 raft_consensus.cc:2243] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.702152 29364 raft_consensus.cc:2272] T 1f895d2ed89b48cc856a4b80cdde3073 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.706687 29364 tablet_replica.cc:333] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:55.720391 29364 raft_consensus.cc:2243] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.721045 29364 raft_consensus.cc:2272] T daf3769ea0a34be69a628c90f1f8a721 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.724179 29364 tablet_replica.cc:333] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:55.725149 29364 raft_consensus.cc:2243] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.726260 29364 raft_consensus.cc:2272] T 39a5f6c7a19c4fd59922a13945641151 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.728832 29364 tablet_replica.cc:333] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:55.729712 29364 raft_consensus.cc:2243] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.730444 29364 raft_consensus.cc:2272] T 8a8b48bc080241c98b3c2b0e1ce8c041 P 092f6eb694fc4bbeab49677cccd880fd [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.735782 29364 tablet_replica.cc:333] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:55.737747 29364 raft_consensus.cc:2243] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.749462 29364 raft_consensus.cc:2272] T 47ac231e47e64c0c9330e153212ca4b5 P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.752398 29364 tablet_replica.cc:333] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:55.753159 29364 raft_consensus.cc:2243] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.753783 29364 raft_consensus.cc:2272] T 1560cc6404764454b2843cec97934e6b P 092f6eb694fc4bbeab49677cccd880fd [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.756372 29364 tablet_replica.cc:333] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:55.757088 29364 raft_consensus.cc:2243] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.757746 29364 raft_consensus.cc:2272] T 60ec00010cf4415890c61ef6278cd0cd P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.760552 29364 tablet_replica.cc:333] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:55.765329 29364 raft_consensus.cc:2243] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.773289 29364 raft_consensus.cc:2272] T 8e5fda238ec24b13b992b82bed92951f P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.775955 29364 tablet_replica.cc:333] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:55.776676 29364 raft_consensus.cc:2243] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 19 LEADER]: Raft consensus shutting down.
W20260709 13:10:55.770048 31116 consensus_peers.cc:597] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:55.777227 31116 consensus_peers.cc:597] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:10:55.779794 29364 raft_consensus.cc:2272] T 85088611c7e34066afbf929fc1cbe50d P 092f6eb694fc4bbeab49677cccd880fd [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.782518 29364 tablet_replica.cc:333] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:55.783444 29364 raft_consensus.cc:2243] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.784237 29364 raft_consensus.cc:2272] T a999056752144cc99cdd136c40917d2c P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.786984 29364 tablet_replica.cc:333] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:55.795764 29364 raft_consensus.cc:2243] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 15 LEADER]: Raft consensus shutting down.
W20260709 13:10:55.800061 30591 consensus_peers.cc:597] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:55.793040 30590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:34453, user_credentials={real_user=slave}} blocked reactor thread for 60472.1us
I20260709 13:10:55.804368 29364 raft_consensus.cc:2272] T db4f54e7ad744ccb95e9f62b315f1408 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.808375 29364 tablet_replica.cc:333] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:55.812278 29364 raft_consensus.cc:2243] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.815274 29364 raft_consensus.cc:2272] T 8b8abe384b054cf09bfba7143adf03f1 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.818073 29364 tablet_replica.cc:333] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:55.818783 29364 raft_consensus.cc:2243] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.819770 29364 raft_consensus.cc:2272] T 3fac91e8417848ac93fdc9f02381d2d5 P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.822216 29364 tablet_replica.cc:333] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:55.822947 29364 raft_consensus.cc:2243] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.823634 29364 raft_consensus.cc:2272] T 99c151771be541b19017860da4f7218d P 092f6eb694fc4bbeab49677cccd880fd [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.825628 29364 tablet_replica.cc:333] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:55.826150 29364 raft_consensus.cc:2243] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.826612 29364 raft_consensus.cc:2272] T aa9b623a9a0446ca90b350e140072cb4 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.829396 29364 tablet_replica.cc:333] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:55.830102 29364 raft_consensus.cc:2243] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.832211 29364 raft_consensus.cc:2272] T 9e9b511085f1474dbeaa862dd7e9d278 P 092f6eb694fc4bbeab49677cccd880fd [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.835908 29364 tablet_replica.cc:333] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:55.836820 29364 raft_consensus.cc:2243] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.837684 29364 raft_consensus.cc:2272] T a14ecc42199f4251b2f85f94871fe61f P 092f6eb694fc4bbeab49677cccd880fd [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.843189 29364 tablet_replica.cc:333] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:55.843933 29364 raft_consensus.cc:2243] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.844517 29364 raft_consensus.cc:2272] T 7fce027eac834298aeb0b5714096adb1 P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:55.845825 31116 consensus_peers.cc:597] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:10:55.847990 29364 tablet_replica.cc:333] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:55.848799 29364 raft_consensus.cc:2243] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.849639 29364 raft_consensus.cc:2272] T 3e82bb3f413748538cf887dcc15fe04c P 092f6eb694fc4bbeab49677cccd880fd [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.852339 29364 tablet_replica.cc:333] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:55.853017 29364 raft_consensus.cc:2243] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.854053 29364 raft_consensus.cc:2272] T 0c27ff7cbfd647edb6f31aac3e234914 P 092f6eb694fc4bbeab49677cccd880fd [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:55.856520 29364 tablet_replica.cc:333] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:55.857221 29364 raft_consensus.cc:2243] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:55.867406 29364 raft_consensus.cc:2272] T 1270ad76798e4aea9d22209a726cc454 P 092f6eb694fc4bbeab49677cccd880fd [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:55.889959 30591 consensus_peers.cc:597] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:10:55.892359 29364 tablet_replica.cc:333] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd: stopping tablet replica
I20260709 13:10:55.893189 29364 raft_consensus.cc:2243] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:10:55.894405 29364 raft_consensus.cc:2272] T 0a6e86e0a4b843478d5970b29ad63ad7 P 092f6eb694fc4bbeab49677cccd880fd [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:55.895164 31116 consensus_peers.cc:597] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:55.983280 30591 consensus_peers.cc:597] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:10:56.508900  4244 raft_consensus.cc:493] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:56.509552  4244 raft_consensus.cc:515] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:56.518258  4244 leader_election.cc:290] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:56.565685  4248 raft_consensus.cc:493] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:56.566567  4248 raft_consensus.cc:515] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:56.568885  4248 leader_election.cc:290] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:56.569612  4226 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:56.570637  4226 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:56.573119  4226 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:56.590615  4251 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:56.595626  4238 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:56.614346  4238 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:56.617416  4238 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
W20260709 13:10:56.617694 30589 leader_election.cc:336] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Network error: Client connection negotiation failed: client connection to 127.28.173.2:34733: connect: Connection refused (error 111)
I20260709 13:10:56.618199  4251 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:56.630215  4251 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:10:56.633366 31114 leader_election.cc:336] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Network error: Client connection negotiation failed: client connection to 127.28.173.2:34733: connect: Connection refused (error 111)
I20260709 13:10:56.634938  4169 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:56.635641  4169 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:56.638144  4169 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
W20260709 13:10:56.638717 31114 leader_election.cc:336] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Network error: Client connection negotiation failed: client connection to 127.28.173.2:34733: connect: Connection refused (error 111)
W20260709 13:10:56.639269 31114 leader_election.cc:336] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Network error: Client connection negotiation failed: client connection to 127.28.173.2:34733: connect: Connection refused (error 111)
I20260709 13:10:56.639858  4169 raft_consensus.cc:493] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:56.640470  4169 raft_consensus.cc:515] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:56.642544  4169 leader_election.cc:290] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:10:56.642719 31114 leader_election.cc:336] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Network error: Client connection negotiation failed: client connection to 127.28.173.2:34733: connect: Connection refused (error 111)
I20260709 13:10:56.653582  4258 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:56.654122  4258 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:56.656314  4258 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:10:56.661196 30591 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:43133, user_credentials={real_user=slave}} blocked reactor thread for 52683.3us
W20260709 13:10:56.666726 31114 leader_election.cc:336] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Network error: Client connection negotiation failed: client connection to 127.28.173.2:34733: connect: Connection refused (error 111)
I20260709 13:10:56.669266 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:56.670058 31148 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 17.
I20260709 13:10:56.677296 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:56.677906 30618 raft_consensus.cc:2468] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 17.
W20260709 13:10:56.679841 30591 consensus_peers.cc:597] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:10:56.683102 31115 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:56.688740  4258 raft_consensus.cc:2804] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:56.689100  4258 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:56.689471  4258 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:56.686493 30590 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
W20260709 13:10:56.691709 30589 leader_election.cc:336] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Network error: Client connection negotiation failed: client connection to 127.28.173.2:34733: connect: Connection refused (error 111)
I20260709 13:10:56.692198  4254 raft_consensus.cc:2804] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:56.692641  4254 raft_consensus.cc:493] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
W20260709 13:10:56.691762 30591 consensus_peers.cc:597] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:56.692939 31116 consensus_peers.cc:597] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:56.692682 30589 leader_election.cc:336] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Network error: Client connection negotiation failed: client connection to 127.28.173.2:34733: connect: Connection refused (error 111)
W20260709 13:10:56.693531 31116 leader_election.cc:336] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
W20260709 13:10:56.693905 30591 leader_election.cc:336] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
I20260709 13:10:56.693948 31116 leader_election.cc:304] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:56.693117  4254 raft_consensus.cc:3060] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:56.694774 30591 leader_election.cc:304] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
W20260709 13:10:56.695019 31116 leader_election.cc:336] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
I20260709 13:10:56.695442 31116 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:56.695601  4250 raft_consensus.cc:2749] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:56.696595 31116 leader_election.cc:336] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
W20260709 13:10:56.696828 30591 leader_election.cc:336] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
I20260709 13:10:56.697103 31116 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:56.697278 30591 leader_election.cc:304] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:56.697773  4226 raft_consensus.cc:2749] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:56.697962  4250 raft_consensus.cc:2749] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:56.698309  4226 raft_consensus.cc:2749] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:56.698853  4226 raft_consensus.cc:2749] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:56.699019 30591 consensus_peers.cc:597] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:56.702968 31116 leader_election.cc:336] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
I20260709 13:10:56.703389 31116 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:56.704212  4239 raft_consensus.cc:2749] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:56.706243  4254 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:56.708420  4258 raft_consensus.cc:515] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:56.710057  4254 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 18 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:56.710263 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:56.711038 31148 raft_consensus.cc:2393] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 18: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
W20260709 13:10:56.713382 30589 leader_election.cc:336] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Network error: Client connection negotiation failed: client connection to 127.28.173.2:34733: connect: Connection refused (error 111)
W20260709 13:10:56.715875 31114 leader_election.cc:336] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Network error: Client connection negotiation failed: client connection to 127.28.173.2:34733: connect: Connection refused (error 111)
I20260709 13:10:56.716765  4258 leader_election.cc:290] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 18 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:56.716964 30618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6fb8561d12345948ed56d359f5ef4f3" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:56.717618 30618 raft_consensus.cc:2393] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate cd669586cff44d4bbfcc007e213faab6 in current term 18: Already voted for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in this term.
I20260709 13:10:56.718525  4254 raft_consensus.cc:493] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:56.718768 31115 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:56.719082  4254 raft_consensus.cc:515] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:56.719295 30590 leader_election.cc:304] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
I20260709 13:10:56.719919  4258 raft_consensus.cc:2749] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:56.720383  4250 raft_consensus.cc:2749] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:56.726969  4254 leader_election.cc:290] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:10:56.729023 30591 leader_election.cc:336] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
W20260709 13:10:56.732954 30589 leader_election.cc:336] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Network error: Client connection negotiation failed: client connection to 127.28.173.2:34733: connect: Connection refused (error 111)
I20260709 13:10:56.733330 30589 leader_election.cc:304] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:56.733979  4254 raft_consensus.cc:2749] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:56.755714  4258 raft_consensus.cc:493] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:56.756325  4258 raft_consensus.cc:515] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:56.759989 31116 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111) [suppressed 536 similar messages]
I20260709 13:10:56.760833  4258 leader_election.cc:290] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:10:56.763319 31114 leader_election.cc:336] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Network error: Client connection negotiation failed: client connection to 127.28.173.2:34733: connect: Connection refused (error 111)
W20260709 13:10:56.763909 31116 leader_election.cc:336] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
I20260709 13:10:56.764318 31116 leader_election.cc:304] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:56.764940  4258 raft_consensus.cc:2749] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:56.822430  4254 raft_consensus.cc:493] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:56.823144  4254 raft_consensus.cc:515] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:56.830638  4254 leader_election.cc:290] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:10:56.843144 30589 leader_election.cc:336] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Network error: Client connection negotiation failed: client connection to 127.28.173.2:34733: connect: Connection refused (error 111)
W20260709 13:10:56.844945 30591 leader_election.cc:336] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
I20260709 13:10:56.845376 30591 leader_election.cc:304] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:56.846095  4254 raft_consensus.cc:2749] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:56.891199  4254 raft_consensus.cc:493] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:56.891836  4254 raft_consensus.cc:515] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:56.896242  4254 leader_election.cc:290] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:10:56.898355 30589 leader_election.cc:336] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Network error: Client connection negotiation failed: client connection to 127.28.173.2:34733: connect: Connection refused (error 111)
W20260709 13:10:56.899031 30591 leader_election.cc:336] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
I20260709 13:10:56.899426 30591 leader_election.cc:304] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:56.900131  4254 raft_consensus.cc:2749] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:56.972095 30591 consensus_peers.cc:597] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:10:56.972795  4250 raft_consensus.cc:493] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:56.973250  4250 raft_consensus.cc:515] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:56.975468  4250 leader_election.cc:290] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:10:56.982223 30591 leader_election.cc:336] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
W20260709 13:10:56.983299 30589 leader_election.cc:336] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Network error: Client connection negotiation failed: client connection to 127.28.173.2:34733: connect: Connection refused (error 111)
I20260709 13:10:56.983707 30589 leader_election.cc:304] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:56.984400  4250 raft_consensus.cc:2749] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:10:56.998929 30591 consensus_peers.cc:597] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:10:57.033190  4238 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:57.033780  4238 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:57.039239 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:57.035730  4238 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:57.059629  4250 raft_consensus.cc:493] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:57.060360  4250 raft_consensus.cc:515] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:57.061692  4253 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:57.062227  4253 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:57.064162  4253 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:57.065717  4250 leader_election.cc:290] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:10:57.068236 31114 leader_election.cc:336] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Network error: Client connection negotiation failed: client connection to 127.28.173.2:34733: connect: Connection refused (error 111)
I20260709 13:10:57.068948 31114 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, fe2b7d73f8c743c1ba570cfd981c4e79
I20260709 13:10:57.070345  4249 raft_consensus.cc:2749] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:57.070429  4226 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:57.070994  4226 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:57.072808  4226 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:57.074172 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" is_pre_election: true
I20260709 13:10:57.074756 30621 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 17.
I20260709 13:10:57.076191 31115 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:57.076977  4238 raft_consensus.cc:2804] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:57.077373  4238 raft_consensus.cc:493] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:57.077766  4238 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:57.081339 31148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
W20260709 13:10:57.089710 30405 debug-util.cc:398] Leaking SignalData structure 0x7b0800175620 after lost signal to thread 29367
W20260709 13:10:57.090778 30405 debug-util.cc:398] Leaking SignalData structure 0x7b0800395bc0 after lost signal to thread 30408
W20260709 13:10:57.092011 30405 debug-util.cc:398] Leaking SignalData structure 0x7b08000bc3a0 after lost signal to thread 30649
W20260709 13:10:57.093124 30405 debug-util.cc:398] Leaking SignalData structure 0x7b08001b2ae0 after lost signal to thread 31175
W20260709 13:10:57.103821 31114 leader_election.cc:336] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Network error: Client connection negotiation failed: client connection to 127.28.173.2:34733: connect: Connection refused (error 111)
W20260709 13:10:57.109732 30591 leader_election.cc:336] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
I20260709 13:10:57.111378  4238 raft_consensus.cc:515] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:57.120615 31148 raft_consensus.cc:2393] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe2b7d73f8c743c1ba570cfd981c4e79 in current term 18: Already voted for candidate cd669586cff44d4bbfcc007e213faab6 in this term.
I20260709 13:10:57.128638  4238 leader_election.cc:290] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 18 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851)
I20260709 13:10:57.128821 30621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c27ff7cbfd647edb6f31aac3e234914" candidate_uuid: "cd669586cff44d4bbfcc007e213faab6" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79"
I20260709 13:10:57.129453 30621 raft_consensus.cc:3060] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:57.154258 30621 raft_consensus.cc:2468] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd669586cff44d4bbfcc007e213faab6 in term 18.
W20260709 13:10:57.155297 31114 leader_election.cc:336] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Network error: Client connection negotiation failed: client connection to 127.28.173.2:34733: connect: Connection refused (error 111)
I20260709 13:10:57.155957  4169 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:57.160565  4169 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:57.162290  4169 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:57.164767 31115 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd
I20260709 13:10:57.165582  4238 raft_consensus.cc:2804] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:57.166033  4238 raft_consensus.cc:697] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 18 LEADER]: Becoming Leader. State: Replica: cd669586cff44d4bbfcc007e213faab6, State: Running, Role: LEADER
I20260709 13:10:57.166893  4238 consensus_queue.cc:237] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:57.177397 30589 leader_election.cc:336] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Network error: Client connection negotiation failed: client connection to 127.28.173.2:34733: connect: Connection refused (error 111)
I20260709 13:10:57.193945 30371 catalog_manager.cc:5697] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 reported cstate change: term changed from 17 to 18, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to cd669586cff44d4bbfcc007e213faab6 (127.28.173.4). New cstate: current_term: 18 leader_uuid: "cd669586cff44d4bbfcc007e213faab6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:57.203182 30589 leader_election.cc:304] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, cd669586cff44d4bbfcc007e213faab6
W20260709 13:10:57.206274 30591 consensus_peers.cc:597] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:10:57.207136 31150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6" is_pre_election: true
I20260709 13:10:57.208745 31150 raft_consensus.cc:2468] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 16.
I20260709 13:10:57.209103  4250 raft_consensus.cc:2749] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:10:57.209304 30589 leader_election.cc:336] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Network error: Client connection negotiation failed: client connection to 127.28.173.2:34733: connect: Connection refused (error 111)
I20260709 13:10:57.210875 30589 leader_election.cc:304] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:57.211544  4250 raft_consensus.cc:2749] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:57.216939 30590 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:57.218009  4169 raft_consensus.cc:2804] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:57.218330  4169 raft_consensus.cc:493] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:57.218624  4169 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:57.226895  4169 raft_consensus.cc:515] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:57.228828  4169 leader_election.cc:290] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 17 election: Requested vote from peers 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733), cd669586cff44d4bbfcc007e213faab6 (127.28.173.4:34453)
I20260709 13:10:57.229877 31145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f895d2ed89b48cc856a4b80cdde3073" candidate_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "cd669586cff44d4bbfcc007e213faab6"
I20260709 13:10:57.230530 31145 raft_consensus.cc:3060] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:57.245152 31145 raft_consensus.cc:2468] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe2b7d73f8c743c1ba570cfd981c4e79 in term 17.
W20260709 13:10:57.247794 30589 leader_election.cc:336] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Network error: Client connection negotiation failed: client connection to 127.28.173.2:34733: connect: Connection refused (error 111)
I20260709 13:10:57.248064 30590 leader_election.cc:304] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6, fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 
I20260709 13:10:57.248883  4169 raft_consensus.cc:2804] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:57.249333  4169 raft_consensus.cc:697] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 LEADER]: Becoming Leader. State: Replica: fe2b7d73f8c743c1ba570cfd981c4e79, State: Running, Role: LEADER
I20260709 13:10:57.250036  4169 consensus_queue.cc:237] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:57.257824 30589 leader_election.cc:336] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Network error: Client connection negotiation failed: client connection to 127.28.173.2:34733: connect: Connection refused (error 111)
I20260709 13:10:57.266570 30371 catalog_manager.cc:5697] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 reported cstate change: term changed from 16 to 17, leader changed from 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2) to fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3). New cstate: current_term: 17 leader_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:57.271837  4238 raft_consensus.cc:493] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:57.275941  4238 raft_consensus.cc:515] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:57.277980  4238 leader_election.cc:290] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:10:57.284569 31116 leader_election.cc:336] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
W20260709 13:10:57.292179 31114 leader_election.cc:336] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Network error: Client connection negotiation failed: client connection to 127.28.173.2:34733: connect: Connection refused (error 111)
I20260709 13:10:57.292675 31114 leader_election.cc:304] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:57.293777  4238 raft_consensus.cc:2749] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:57.302219  4238 raft_consensus.cc:493] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:57.302790  4238 raft_consensus.cc:515] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
W20260709 13:10:57.309700 31116 leader_election.cc:336] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
I20260709 13:10:57.312892  4238 leader_election.cc:290] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:10:57.318204 31114 leader_election.cc:336] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Network error: Client connection negotiation failed: client connection to 127.28.173.2:34733: connect: Connection refused (error 111)
I20260709 13:10:57.319141 31114 leader_election.cc:304] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:57.320287  4238 raft_consensus.cc:2749] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:57.339736  4169 raft_consensus.cc:493] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:57.340276  4169 raft_consensus.cc:515] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "fe2b7d73f8c743c1ba570cfd981c4e79" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32851 } }
I20260709 13:10:57.342259  4169 leader_election.cc:290] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:10:57.352840 30591 leader_election.cc:336] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
W20260709 13:10:57.353644 30589 leader_election.cc:336] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Network error: Client connection negotiation failed: client connection to 127.28.173.2:34733: connect: Connection refused (error 111)
I20260709 13:10:57.354084 30589 leader_election.cc:304] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe2b7d73f8c743c1ba570cfd981c4e79; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:57.355860  4253 raft_consensus.cc:2749] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:10:57.453806 30591 consensus_peers.cc:597] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:57.461786 30589 consensus_peers.cc:597] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.2:34733: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:57.475592 29364 tablet_server.cc:196] TabletServer@127.28.173.2:0 shutdown complete.
W20260709 13:10:57.562584 30589 consensus_peers.cc:597] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.2:34733: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:57.614661 29364 tablet_server.cc:179] TabletServer@127.28.173.3:0 shutting down...
W20260709 13:10:57.630715 31115 consensus_peers.cc:597] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 -> Peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Couldn't send request to peer fe2b7d73f8c743c1ba570cfd981c4e79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:57.631615 31115 consensus_peers.cc:597] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 -> Peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Couldn't send request to peer fe2b7d73f8c743c1ba570cfd981c4e79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:57.653240 31114 consensus_peers.cc:597] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.2:34733: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:57.653465 31116 consensus_peers.cc:597] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:57.657101 30591 consensus_peers.cc:597] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:57.668386 30589 consensus_peers.cc:597] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.2:34733: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:57.671317 30591 consensus_peers.cc:597] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:57.671976 30591 consensus_peers.cc:597] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:57.702489 31116 consensus_peers.cc:597] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:57.703387 30591 consensus_peers.cc:597] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:57.721131 31116 consensus_peers.cc:597] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:10:57.735394 29364 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:10:57.736025 31115 consensus_peers.cc:597] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 -> Peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Couldn't send request to peer fe2b7d73f8c743c1ba570cfd981c4e79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:57.736944 29364 tablet_replica.cc:333] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.738030 29364 raft_consensus.cc:2243] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:10:57.739389 29364 raft_consensus.cc:2272] T 2b207fb799ce4340b29ae053898e0e6c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.742736 29364 tablet_replica.cc:333] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.743675 29364 raft_consensus.cc:2243] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:10:57.744844 29364 raft_consensus.cc:2272] T c504e96bd6f14a19b7dfe8203129e4b4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.747555 29364 tablet_replica.cc:333] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.748417 29364 raft_consensus.cc:2243] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.749219 29364 raft_consensus.cc:2272] T 5610a33c644c4e539ad503631763aa40 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.752086 29364 tablet_replica.cc:333] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.752943 29364 raft_consensus.cc:2243] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.753531 29364 raft_consensus.cc:2272] T ee49a377a80e4f4199281fb5e44d3be6 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.756283 29364 tablet_replica.cc:333] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.757076 29364 raft_consensus.cc:2243] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 LEADER]: Raft consensus shutting down.
W20260709 13:10:57.757139 30589 consensus_peers.cc:597] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.2:34733: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:57.758224 29364 raft_consensus.cc:2272] T 1d4c506564124bd5b3a4c756362eee6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.760938 29364 tablet_replica.cc:333] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.761886 29364 raft_consensus.cc:2243] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.762523 29364 raft_consensus.cc:2272] T a2fd6793fef04209ae40ee4d9ba90f42 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.765501 29364 tablet_replica.cc:333] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.766338 29364 raft_consensus.cc:2243] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:10:57.767679 29364 raft_consensus.cc:2272] T 6a9b619ab6a04af38de048edd085fe3e P fe2b7d73f8c743c1ba570cfd981c4e79 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:57.768404 30591 consensus_peers.cc:597] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:10:57.770614 29364 tablet_replica.cc:333] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.771555 29364 raft_consensus.cc:2243] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.772352 29364 raft_consensus.cc:2272] T 10b0408011914710a008d9e9b58f002c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.775210 29364 tablet_replica.cc:333] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.776090 29364 raft_consensus.cc:2243] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.776639 29364 raft_consensus.cc:2272] T 47d5557143454f988a101125d3b5c0d7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.779356 29364 tablet_replica.cc:333] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.780244 29364 raft_consensus.cc:2243] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:10:57.781281 29364 raft_consensus.cc:2272] T 53842c918e2c4018ba572aaf3dfbfe31 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.783931 29364 tablet_replica.cc:333] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.784739 29364 raft_consensus.cc:2243] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:10:57.785795 29364 raft_consensus.cc:2272] T dfc9f90b82b84a8cb47cbee7adb0401a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.788522 29364 tablet_replica.cc:333] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.789288 29364 raft_consensus.cc:2243] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.789909 29364 raft_consensus.cc:2272] T 795e206cd48a484a88a226d02f465b8f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.792555 29364 tablet_replica.cc:333] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.793301 29364 raft_consensus.cc:2243] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.794021 29364 raft_consensus.cc:2272] T 7111be574b514751972d70830d3b644f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.796777 29364 tablet_replica.cc:333] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.797562 29364 raft_consensus.cc:2243] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.798269 29364 raft_consensus.cc:2272] T f6fb8561d12345948ed56d359f5ef4f3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.803395 29364 tablet_replica.cc:333] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.804535 29364 raft_consensus.cc:2243] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:10:57.805583 29364 raft_consensus.cc:2272] T db830c61bd0a4c3d80284c8c56165b1b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:57.806111 30589 consensus_peers.cc:597] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.2:34733: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:57.808297 29364 tablet_replica.cc:333] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.809108 29364 raft_consensus.cc:2243] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.809662 29364 raft_consensus.cc:2272] T a439756f6e7242f8b5b1ef7ea97874d4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.812112 29364 tablet_replica.cc:333] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.813035 29364 raft_consensus.cc:2243] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:10:57.814040 29364 raft_consensus.cc:2272] T 4859507b516b4f62a81b965e2686e618 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.815316 31145 raft_consensus.cc:1275] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Refusing update from remote peer fe2b7d73f8c743c1ba570cfd981c4e79: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:10:57.818042 29364 tablet_replica.cc:333] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.818877 29364 raft_consensus.cc:2243] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:10:57.821732  4169 consensus_queue.cc:1048] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:10:57.828737 31114 consensus_peers.cc:597] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.2:34733: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:57.830240 29364 raft_consensus.cc:2272] T 34bc3578422e49f4a6025c428fa5d426 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.833580 29364 tablet_replica.cc:333] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.837283 29364 raft_consensus.cc:2243] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:10:57.838877 29364 raft_consensus.cc:2272] T d0d5e1e5ef7e43bb80b43baf4b0d0ae4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.842375 29364 tablet_replica.cc:333] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.845597 29364 raft_consensus.cc:2243] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 LEADER]: Raft consensus shutting down.
W20260709 13:10:57.845851 31114 consensus_peers.cc:597] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.2:34733: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:57.847608 29364 raft_consensus.cc:2272] T bd3964085c9b4234998aecbbce16d24a P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.854151 29364 tablet_replica.cc:333] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.855087 29364 raft_consensus.cc:2243] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:10:57.856169 29364 raft_consensus.cc:2272] T d641a3d4c880431b9375d9c775d7be72 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.858692 29364 tablet_replica.cc:333] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.859460 29364 raft_consensus.cc:2243] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:10:57.860625 29364 raft_consensus.cc:2272] T a999056752144cc99cdd136c40917d2c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.863039 29364 tablet_replica.cc:333] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.863824 29364 raft_consensus.cc:2243] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.864526 29364 raft_consensus.cc:2272] T a0273ed018424f3a9529e09669fdb7b0 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:57.866142 31116 consensus_peers.cc:597] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:10:57.867004 29364 tablet_replica.cc:333] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.867938 29364 raft_consensus.cc:2243] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:10:57.869935 29364 raft_consensus.cc:2272] T daf3769ea0a34be69a628c90f1f8a721 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.873138 29364 tablet_replica.cc:333] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.873982 29364 raft_consensus.cc:2243] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:10:57.875043 29364 raft_consensus.cc:2272] T 60ec00010cf4415890c61ef6278cd0cd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.883921 29364 tablet_replica.cc:333] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.887373 29364 raft_consensus.cc:2243] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.888895 29364 raft_consensus.cc:2272] T 8e5fda238ec24b13b992b82bed92951f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.893143 29364 tablet_replica.cc:333] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.900463 29364 raft_consensus.cc:2243] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.901685 29364 raft_consensus.cc:2272] T 5302637c04824f67b70df2f3ee95c130 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.904265 29364 tablet_replica.cc:333] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.907553 29364 raft_consensus.cc:2243] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:10:57.910085 29364 raft_consensus.cc:2272] T 1f895d2ed89b48cc856a4b80cdde3073 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.912953 29364 tablet_replica.cc:333] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.913733 29364 raft_consensus.cc:2243] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.914417 29364 raft_consensus.cc:2272] T 7e31b2accf3b4a3b8b7668571e619eb7 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.916863 29364 tablet_replica.cc:333] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.917583 29364 raft_consensus.cc:2243] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.918174 29364 raft_consensus.cc:2272] T 39a5f6c7a19c4fd59922a13945641151 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.920609 29364 tablet_replica.cc:333] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.921308 29364 raft_consensus.cc:2243] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:10:57.922317 29364 raft_consensus.cc:2272] T 1560cc6404764454b2843cec97934e6b P fe2b7d73f8c743c1ba570cfd981c4e79 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.924714 29364 tablet_replica.cc:333] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.925370 29364 raft_consensus.cc:2243] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.925920 29364 raft_consensus.cc:2272] T 8a8b48bc080241c98b3c2b0e1ce8c041 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.928409 29364 tablet_replica.cc:333] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.929064 29364 raft_consensus.cc:2243] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:10:57.930089 29364 raft_consensus.cc:2272] T 353e93aef12a4b92b159b611a66cf3c3 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.932468 29364 tablet_replica.cc:333] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.933140 29364 raft_consensus.cc:2243] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.933712 29364 raft_consensus.cc:2272] T 0c27ff7cbfd647edb6f31aac3e234914 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.936113 29364 tablet_replica.cc:333] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.936885 29364 raft_consensus.cc:2243] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.937525 29364 raft_consensus.cc:2272] T db4f54e7ad744ccb95e9f62b315f1408 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.939870 29364 tablet_replica.cc:333] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.940510 29364 raft_consensus.cc:2243] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:10:57.941541 29364 raft_consensus.cc:2272] T 1270ad76798e4aea9d22209a726cc454 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.943940 29364 tablet_replica.cc:333] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.944639 29364 raft_consensus.cc:2243] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:10:57.945730 29364 raft_consensus.cc:2272] T e6646800b690458391bbff6a6bba535c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.948156 29364 tablet_replica.cc:333] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.948844 29364 raft_consensus.cc:2243] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.949458 29364 raft_consensus.cc:2272] T 48914655f9d44751a883e36b566dcefd P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.951901 29364 tablet_replica.cc:333] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.952562 29364 raft_consensus.cc:2243] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:10:57.953517 29364 raft_consensus.cc:2272] T a14ecc42199f4251b2f85f94871fe61f P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.955912 29364 tablet_replica.cc:333] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.956554 29364 raft_consensus.cc:2243] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.957094 29364 raft_consensus.cc:2272] T 9e9b511085f1474dbeaa862dd7e9d278 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.959503 29364 tablet_replica.cc:333] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.960197 29364 raft_consensus.cc:2243] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:10:57.961238 29364 raft_consensus.cc:2272] T 7fce027eac834298aeb0b5714096adb1 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:57.963387 31115 consensus_peers.cc:597] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 -> Peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Couldn't send request to peer fe2b7d73f8c743c1ba570cfd981c4e79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:57.963760 29364 tablet_replica.cc:333] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.964573 29364 raft_consensus.cc:2243] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:10:57.965685 29364 raft_consensus.cc:2272] T 3e82bb3f413748538cf887dcc15fe04c P fe2b7d73f8c743c1ba570cfd981c4e79 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.968236 29364 tablet_replica.cc:333] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.968958 29364 raft_consensus.cc:2243] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.969604 29364 raft_consensus.cc:2272] T 3fac91e8417848ac93fdc9f02381d2d5 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.971959 29364 tablet_replica.cc:333] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.972647 29364 raft_consensus.cc:2243] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 LEADER]: Raft consensus shutting down.
W20260709 13:10:57.972688 31115 consensus_peers.cc:597] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 -> Peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Couldn't send request to peer fe2b7d73f8c743c1ba570cfd981c4e79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:57.973858 29364 raft_consensus.cc:2272] T cb22806325394ba386d8549bc4a64701 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.976400 29364 tablet_replica.cc:333] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.977056 29364 raft_consensus.cc:2243] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.977571 29364 raft_consensus.cc:2272] T 99c151771be541b19017860da4f7218d P fe2b7d73f8c743c1ba570cfd981c4e79 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.980059 29364 tablet_replica.cc:333] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.980682 29364 raft_consensus.cc:2243] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.981173 29364 raft_consensus.cc:2272] T aa9b623a9a0446ca90b350e140072cb4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.983705 29364 tablet_replica.cc:333] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.984328 29364 raft_consensus.cc:2243] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:57.985096 29364 raft_consensus.cc:2272] T 265fc568d5674c78833106e4eda814f4 P fe2b7d73f8c743c1ba570cfd981c4e79 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:57.988554 29364 tablet_replica.cc:333] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79: stopping tablet replica
I20260709 13:10:57.989133 29364 raft_consensus.cc:2243] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:10:57.990118 29364 raft_consensus.cc:2272] T 606c3ee77596493da2daa40edde4d1ea P fe2b7d73f8c743c1ba570cfd981c4e79 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:58.003450 31115 consensus_peers.cc:597] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 -> Peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Couldn't send request to peer fe2b7d73f8c743c1ba570cfd981c4e79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:58.012849 31116 consensus_peers.cc:597] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:58.017118 31115 consensus_peers.cc:597] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 -> Peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Couldn't send request to peer fe2b7d73f8c743c1ba570cfd981c4e79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:58.032532 31115 consensus_peers.cc:597] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 -> Peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Couldn't send request to peer fe2b7d73f8c743c1ba570cfd981c4e79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:58.044691 31114 consensus_peers.cc:597] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.2:34733: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:58.051625 31115 consensus_peers.cc:597] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 -> Peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Couldn't send request to peer fe2b7d73f8c743c1ba570cfd981c4e79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:58.060031 31115 consensus_peers.cc:597] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 -> Peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Couldn't send request to peer fe2b7d73f8c743c1ba570cfd981c4e79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:58.064072 31114 consensus_peers.cc:597] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.2:34733: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:58.067333 31115 consensus_peers.cc:597] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 -> Peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Couldn't send request to peer fe2b7d73f8c743c1ba570cfd981c4e79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:58.066018 31116 consensus_peers.cc:597] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:58.100190 31115 consensus_peers.cc:597] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 -> Peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Couldn't send request to peer fe2b7d73f8c743c1ba570cfd981c4e79. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.3:32851: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:58.104279 31114 consensus_peers.cc:597] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.2:34733: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:58.106041 31115 consensus_peers.cc:597] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 -> Peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Couldn't send request to peer fe2b7d73f8c743c1ba570cfd981c4e79. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.3:32851: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:58.132753 31116 consensus_peers.cc:597] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:58.134955 31115 consensus_peers.cc:597] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 -> Peer fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): Couldn't send request to peer fe2b7d73f8c743c1ba570cfd981c4e79. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.3:32851: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:58.146992 31114 consensus_peers.cc:597] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.2:34733: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:58.170842 31114 consensus_peers.cc:597] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.2:34733: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:58.188400 31114 consensus_peers.cc:597] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.2:34733: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:58.245123 31114 consensus_peers.cc:597] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 -> Peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Couldn't send request to peer 092f6eb694fc4bbeab49677cccd880fd. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.2:34733: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:58.454721  4238 raft_consensus.cc:493] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:58.455237  4238 raft_consensus.cc:515] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:58.457229  4238 leader_election.cc:290] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:10:58.461596 31116 leader_election.cc:336] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
W20260709 13:10:58.462263 31114 leader_election.cc:336] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Network error: Client connection negotiation failed: client connection to 127.28.173.2:34733: connect: Connection refused (error 111)
I20260709 13:10:58.462630 31114 leader_election.cc:304] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:58.463271  4238 raft_consensus.cc:2749] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:58.482019 31116 consensus_peers.cc:597] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:10:58.483891 31116 consensus_peers.cc:597] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:10:58.536266 29364 tablet_server.cc:196] TabletServer@127.28.173.3:0 shutdown complete.
W20260709 13:10:58.559779 31116 consensus_peers.cc:597] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:10:58.570804  4238 raft_consensus.cc:493] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:58.571287  4238 raft_consensus.cc:515] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:58.574064  4238 leader_election.cc:290] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
W20260709 13:10:58.580927 31116 leader_election.cc:336] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
W20260709 13:10:58.581727 31114 leader_election.cc:336] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Network error: Client connection negotiation failed: client connection to 127.28.173.2:34733: connect: Connection refused (error 111)
I20260709 13:10:58.582113 31114 leader_election.cc:304] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:58.582693  4238 raft_consensus.cc:2749] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:58.640125 31116 consensus_peers.cc:597] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 -> Peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Couldn't send request to peer f639301059e24dc5b0d88a46dc683326. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:10:58.659984 29364 tablet_server.cc:179] TabletServer@127.28.173.4:0 shutting down...
I20260709 13:10:58.714557 29364 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:58.717290 29364 tablet_replica.cc:333] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6: stopping tablet replica
I20260709 13:10:58.718279 29364 raft_consensus.cc:2243] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.719115 29364 raft_consensus.cc:2272] T f6fb8561d12345948ed56d359f5ef4f3 P cd669586cff44d4bbfcc007e213faab6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.721930 29364 tablet_replica.cc:333] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6: stopping tablet replica
I20260709 13:10:58.722705 29364 raft_consensus.cc:2243] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:10:58.723723 29364 raft_consensus.cc:2272] T 5610a33c644c4e539ad503631763aa40 P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.726297 29364 tablet_replica.cc:333] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6: stopping tablet replica
I20260709 13:10:58.727029 29364 raft_consensus.cc:2243] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.727609 29364 raft_consensus.cc:2272] T 0a6e86e0a4b843478d5970b29ad63ad7 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.727741  4238 raft_consensus.cc:493] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 092f6eb694fc4bbeab49677cccd880fd)
I20260709 13:10:58.728286  4238 raft_consensus.cc:515] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f639301059e24dc5b0d88a46dc683326" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43133 } } peers { permanent_uuid: "092f6eb694fc4bbeab49677cccd880fd" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 34733 } } peers { permanent_uuid: "cd669586cff44d4bbfcc007e213faab6" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 34453 } attrs { promote: false } }
I20260709 13:10:58.730175  4238 leader_election.cc:290] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133), 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733)
I20260709 13:10:58.730361 29364 tablet_replica.cc:333] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6: stopping tablet replica
I20260709 13:10:58.731256 29364 raft_consensus.cc:2243] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.731904 29364 raft_consensus.cc:2272] T 1560cc6404764454b2843cec97934e6b P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.734790 29364 tablet_replica.cc:333] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6: stopping tablet replica
W20260709 13:10:58.735294 31114 leader_election.cc:336] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 092f6eb694fc4bbeab49677cccd880fd (127.28.173.2:34733): Network error: Client connection negotiation failed: client connection to 127.28.173.2:34733: connect: Connection refused (error 111)
I20260709 13:10:58.735599 29364 raft_consensus.cc:2243] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.736321 29364 raft_consensus.cc:2272] T e6646800b690458391bbff6a6bba535c P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:58.738791 31116 leader_election.cc:336] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f639301059e24dc5b0d88a46dc683326 (127.28.173.1:43133): Network error: Client connection negotiation failed: client connection to 127.28.173.1:43133: connect: Connection refused (error 111)
I20260709 13:10:58.739097 29364 tablet_replica.cc:333] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6: stopping tablet replica
I20260709 13:10:58.739260 31116 leader_election.cc:304] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd669586cff44d4bbfcc007e213faab6; no voters: 092f6eb694fc4bbeab49677cccd880fd, f639301059e24dc5b0d88a46dc683326
I20260709 13:10:58.739970 29364 raft_consensus.cc:2243] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 6 LEADER]: Raft consensus shutting down.
I20260709 13:10:58.739990  4238 raft_consensus.cc:2749] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:58.741118 29364 raft_consensus.cc:2272] T ee49a377a80e4f4199281fb5e44d3be6 P cd669586cff44d4bbfcc007e213faab6 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.743594 29364 tablet_replica.cc:333] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6: stopping tablet replica
I20260709 13:10:58.744417 29364 raft_consensus.cc:2243] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.744946 29364 raft_consensus.cc:2272] T 80cbe47dd35948b8b10070e934216d98 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.747457 29364 tablet_replica.cc:333] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6: stopping tablet replica
I20260709 13:10:58.748219 29364 raft_consensus.cc:2243] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:10:58.749245 29364 raft_consensus.cc:2272] T 48914655f9d44751a883e36b566dcefd P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.751686 29364 tablet_replica.cc:333] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6: stopping tablet replica
I20260709 13:10:58.752386 29364 raft_consensus.cc:2243] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:10:58.753289 29364 raft_consensus.cc:2272] T 8a8b48bc080241c98b3c2b0e1ce8c041 P cd669586cff44d4bbfcc007e213faab6 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.755620 29364 tablet_replica.cc:333] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6: stopping tablet replica
I20260709 13:10:58.756354 29364 raft_consensus.cc:2243] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:10:58.757297 29364 raft_consensus.cc:2272] T 47ac231e47e64c0c9330e153212ca4b5 P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.759753 29364 tablet_replica.cc:333] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6: stopping tablet replica
I20260709 13:10:58.760464 29364 raft_consensus.cc:2243] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:10:58.761420 29364 raft_consensus.cc:2272] T 5302637c04824f67b70df2f3ee95c130 P cd669586cff44d4bbfcc007e213faab6 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.763780 29364 tablet_replica.cc:333] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6: stopping tablet replica
I20260709 13:10:58.764500 29364 raft_consensus.cc:2243] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.764998 29364 raft_consensus.cc:2272] T 1f895d2ed89b48cc856a4b80cdde3073 P cd669586cff44d4bbfcc007e213faab6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.767681 29364 tablet_replica.cc:333] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6: stopping tablet replica
I20260709 13:10:58.768498 29364 raft_consensus.cc:2243] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.769086 29364 raft_consensus.cc:2272] T cb22806325394ba386d8549bc4a64701 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.771899 29364 tablet_replica.cc:333] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6: stopping tablet replica
I20260709 13:10:58.772660 29364 raft_consensus.cc:2243] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:10:58.773677 29364 raft_consensus.cc:2272] T aa9b623a9a0446ca90b350e140072cb4 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.776098 29364 tablet_replica.cc:333] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6: stopping tablet replica
I20260709 13:10:58.776844 29364 raft_consensus.cc:2243] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:10:58.777798 29364 raft_consensus.cc:2272] T 8b8abe384b054cf09bfba7143adf03f1 P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.780473 29364 tablet_replica.cc:333] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6: stopping tablet replica
I20260709 13:10:58.781162 29364 raft_consensus.cc:2243] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:10:58.782127 29364 raft_consensus.cc:2272] T 7e31b2accf3b4a3b8b7668571e619eb7 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.784706 29364 tablet_replica.cc:333] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6: stopping tablet replica
I20260709 13:10:58.785430 29364 raft_consensus.cc:2243] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.785919 29364 raft_consensus.cc:2272] T 2b207fb799ce4340b29ae053898e0e6c P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.788565 29364 tablet_replica.cc:333] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6: stopping tablet replica
I20260709 13:10:58.789270 29364 raft_consensus.cc:2243] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:10:58.790215 29364 raft_consensus.cc:2272] T 10b0408011914710a008d9e9b58f002c P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.792609 29364 tablet_replica.cc:333] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6: stopping tablet replica
I20260709 13:10:58.793301 29364 raft_consensus.cc:2243] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:10:58.794263 29364 raft_consensus.cc:2272] T 7f8b6eff35aa4b96bf5f73d6a94db695 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.796893 29364 tablet_replica.cc:333] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6: stopping tablet replica
I20260709 13:10:58.797592 29364 raft_consensus.cc:2243] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:10:58.798560 29364 raft_consensus.cc:2272] T 265fc568d5674c78833106e4eda814f4 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.801007 29364 tablet_replica.cc:333] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6: stopping tablet replica
I20260709 13:10:58.801716 29364 raft_consensus.cc:2243] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.802268 29364 raft_consensus.cc:2272] T 606c3ee77596493da2daa40edde4d1ea P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.804653 29364 tablet_replica.cc:333] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6: stopping tablet replica
I20260709 13:10:58.805320 29364 raft_consensus.cc:2243] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:10:58.806277 29364 raft_consensus.cc:2272] T 99c151771be541b19017860da4f7218d P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.808785 29364 tablet_replica.cc:333] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6: stopping tablet replica
I20260709 13:10:58.809476 29364 raft_consensus.cc:2243] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.810011 29364 raft_consensus.cc:2272] T daf3769ea0a34be69a628c90f1f8a721 P cd669586cff44d4bbfcc007e213faab6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.812610 29364 tablet_replica.cc:333] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6: stopping tablet replica
I20260709 13:10:58.813283 29364 raft_consensus.cc:2243] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.813864 29364 raft_consensus.cc:2272] T 541099fd564e49f2ad553f250f319fb0 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.816597 29364 tablet_replica.cc:333] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6: stopping tablet replica
I20260709 13:10:58.817260 29364 raft_consensus.cc:2243] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:10:58.818235 29364 raft_consensus.cc:2272] T a0273ed018424f3a9529e09669fdb7b0 P cd669586cff44d4bbfcc007e213faab6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.820744 29364 tablet_replica.cc:333] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6: stopping tablet replica
I20260709 13:10:58.821488 29364 raft_consensus.cc:2243] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.822032 29364 raft_consensus.cc:2272] T 85088611c7e34066afbf929fc1cbe50d P cd669586cff44d4bbfcc007e213faab6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.824636 29364 tablet_replica.cc:333] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6: stopping tablet replica
I20260709 13:10:58.825315 29364 raft_consensus.cc:2243] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 16 LEADER]: Raft consensus shutting down.
W20260709 13:10:58.825634 30360 catalog_manager.cc:4755] TS fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): ChangeConfig:REMOVE_PEER RPC failed for tablet 2b207fb799ce4340b29ae053898e0e6c: Network error: Client connection negotiation failed: client connection to 127.28.173.3:32851: connect: Connection refused (error 111)
I20260709 13:10:58.826392 29364 raft_consensus.cc:2272] T 1a418ef882d34180817469c4e2495268 P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.828970 29364 tablet_replica.cc:333] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6: stopping tablet replica
I20260709 13:10:58.829680 29364 raft_consensus.cc:2243] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:10:58.830603 29364 raft_consensus.cc:2272] T 8e5fda238ec24b13b992b82bed92951f P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.833096 29364 tablet_replica.cc:333] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6: stopping tablet replica
I20260709 13:10:58.833757 29364 raft_consensus.cc:2243] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.834321 29364 raft_consensus.cc:2272] T dfc9f90b82b84a8cb47cbee7adb0401a P cd669586cff44d4bbfcc007e213faab6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.836699 29364 tablet_replica.cc:333] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6: stopping tablet replica
I20260709 13:10:58.837349 29364 raft_consensus.cc:2243] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.837869 29364 raft_consensus.cc:2272] T 7c9861593ab94f7792fdd702f1d9a483 P cd669586cff44d4bbfcc007e213faab6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.840384 29364 tablet_replica.cc:333] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6: stopping tablet replica
I20260709 13:10:58.841014 29364 raft_consensus.cc:2243] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:10:58.841934 29364 pending_rounds.cc:70] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6: Trying to abort 1 pending ops.
I20260709 13:10:58.842147 29364 pending_rounds.cc:77] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6: Aborting op as it isn't in flight: id { term: 18 index: 16 } timestamp: 7305636483766984704 op_type: NO_OP noop_request { }
I20260709 13:10:58.842535 29364 raft_consensus.cc:2889] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 18 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:10:58.842847 29364 raft_consensus.cc:2272] T 0c27ff7cbfd647edb6f31aac3e234914 P cd669586cff44d4bbfcc007e213faab6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.845024 29364 tablet_replica.cc:333] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6: stopping tablet replica
I20260709 13:10:58.845532 29364 raft_consensus.cc:2243] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:10:58.846289 29364 raft_consensus.cc:2272] T 7111be574b514751972d70830d3b644f P cd669586cff44d4bbfcc007e213faab6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.848285 29364 tablet_replica.cc:333] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6: stopping tablet replica
I20260709 13:10:58.848754 29364 raft_consensus.cc:2243] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.849203 29364 raft_consensus.cc:2272] T 6a9b619ab6a04af38de048edd085fe3e P cd669586cff44d4bbfcc007e213faab6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.851233 29364 tablet_replica.cc:333] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6: stopping tablet replica
I20260709 13:10:58.851691 29364 raft_consensus.cc:2243] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.852185 29364 raft_consensus.cc:2272] T 772a658508f4465d8c1ef039f5bcaa67 P cd669586cff44d4bbfcc007e213faab6 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:58.854048 29364 tablet_replica.cc:333] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6: stopping tablet replica
I20260709 13:10:58.854470 29364 raft_consensus.cc:2243] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:58.854920 29364 raft_consensus.cc:2272] T b0842494dc2a48d89fb422524082081d P cd669586cff44d4bbfcc007e213faab6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:59.178483 29364 tablet_server.cc:196] TabletServer@127.28.173.4:0 shutdown complete.
I20260709 13:10:59.245052 29364 master.cc:562] Master@127.28.173.62:33437 shutting down...
W20260709 13:10:59.284052 30422 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:10:59.284359 30422 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:10:59.284657 30422 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:11:31.895439 30405 debug-util.cc:398] Leaking SignalData structure 0x7b08001a3560 after lost signal to thread 29367
W20260709 13:11:31.896104 30405 debug-util.cc:398] Leaking SignalData structure 0x7b080012fda0 after lost signal to thread 30408
W20260709 13:11:58.864166 30360 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.173.3:32851: connect: Connection refused (error 111) [suppressed 228 similar messages]
W20260709 13:11:58.867642 30360 catalog_manager.cc:4755] TS fe2b7d73f8c743c1ba570cfd981c4e79 (127.28.173.3:32851): ChangeConfig:REMOVE_PEER RPC failed for tablet 2b207fb799ce4340b29ae053898e0e6c: Network error: Client connection negotiation failed: client connection to 127.28.173.3:32851: connect: Connection refused (error 111)
I20260709 13:12:00.769088 29364 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 045170a35afe4845987482e49e9e1eb9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:00.770121 29364 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 045170a35afe4845987482e49e9e1eb9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:00.770526 29364 tablet_replica.cc:333] T 00000000000000000000000000000000 P 045170a35afe4845987482e49e9e1eb9: stopping tablet replica
I20260709 13:12:01.015148 29364 master.cc:584] Master@127.28.173.62:33437 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (254136 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:12:01.124537 29364 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.28.173.62:43215
I20260709 13:12:01.125699 29364 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:01.131639  4287 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:01.131827  4286 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:01.133039  4289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:01.134178 29364 server_base.cc:1061] running on GCE node
I20260709 13:12:01.137107 29364 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:01.137286 29364 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:01.137396 29364 hybrid_clock.cc:648] HybridClock initialized: now 1783602721137385 us; error 0 us; skew 500 ppm
I20260709 13:12:01.137853 29364 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:01.140406 29364 webserver.cc:533] Webserver started at http://127.28.173.62:46761/ using document root <none> and password file <none>
I20260709 13:12:01.140838 29364 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:01.140985 29364 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:01.141216 29364 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:01.142390 29364 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602443945700-29364-0/minicluster-data/master-0-root/instance:
uuid: "a6b539c165f7423db62dde53667fcf75"
format_stamp: "Formatted at 2026-07-09 13:12:01 on dist-test-slave-x62b"
I20260709 13:12:01.146792 29364 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 13:12:01.150034  4294 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:01.150744 29364 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:12:01.151049 29364 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602443945700-29364-0/minicluster-data/master-0-root
uuid: "a6b539c165f7423db62dde53667fcf75"
format_stamp: "Formatted at 2026-07-09 13:12:01 on dist-test-slave-x62b"
I20260709 13:12:01.151311 29364 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602443945700-29364-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602443945700-29364-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602443945700-29364-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:01.170460 29364 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:01.171630 29364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:01.211308 29364 rpc_server.cc:307] RPC server started. Bound to: 127.28.173.62:43215
I20260709 13:12:01.211416  4345 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.173.62:43215 every 8 connection(s)
I20260709 13:12:01.215445  4346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:01.226855  4346 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6b539c165f7423db62dde53667fcf75: Bootstrap starting.
I20260709 13:12:01.231392  4346 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a6b539c165f7423db62dde53667fcf75: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:01.235376  4346 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6b539c165f7423db62dde53667fcf75: No bootstrap required, opened a new log
I20260709 13:12:01.237444  4346 raft_consensus.cc:359] T 00000000000000000000000000000000 P a6b539c165f7423db62dde53667fcf75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6b539c165f7423db62dde53667fcf75" member_type: VOTER }
I20260709 13:12:01.237865  4346 raft_consensus.cc:385] T 00000000000000000000000000000000 P a6b539c165f7423db62dde53667fcf75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:01.238040  4346 raft_consensus.cc:740] T 00000000000000000000000000000000 P a6b539c165f7423db62dde53667fcf75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6b539c165f7423db62dde53667fcf75, State: Initialized, Role: FOLLOWER
I20260709 13:12:01.238660  4346 consensus_queue.cc:260] T 00000000000000000000000000000000 P a6b539c165f7423db62dde53667fcf75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6b539c165f7423db62dde53667fcf75" member_type: VOTER }
I20260709 13:12:01.239084  4346 raft_consensus.cc:399] T 00000000000000000000000000000000 P a6b539c165f7423db62dde53667fcf75 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:12:01.239290  4346 raft_consensus.cc:493] T 00000000000000000000000000000000 P a6b539c165f7423db62dde53667fcf75 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:12:01.239500  4346 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a6b539c165f7423db62dde53667fcf75 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:01.243790  4346 raft_consensus.cc:515] T 00000000000000000000000000000000 P a6b539c165f7423db62dde53667fcf75 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6b539c165f7423db62dde53667fcf75" member_type: VOTER }
I20260709 13:12:01.244251  4346 leader_election.cc:304] T 00000000000000000000000000000000 P a6b539c165f7423db62dde53667fcf75 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a6b539c165f7423db62dde53667fcf75; no voters: 
I20260709 13:12:01.245265  4346 leader_election.cc:290] T 00000000000000000000000000000000 P a6b539c165f7423db62dde53667fcf75 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:12:01.245684  4349 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a6b539c165f7423db62dde53667fcf75 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:01.247069  4349 raft_consensus.cc:697] T 00000000000000000000000000000000 P a6b539c165f7423db62dde53667fcf75 [term 1 LEADER]: Becoming Leader. State: Replica: a6b539c165f7423db62dde53667fcf75, State: Running, Role: LEADER
I20260709 13:12:01.247759  4349 consensus_queue.cc:237] T 00000000000000000000000000000000 P a6b539c165f7423db62dde53667fcf75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6b539c165f7423db62dde53667fcf75" member_type: VOTER }
I20260709 13:12:01.248193  4346 sys_catalog.cc:565] T 00000000000000000000000000000000 P a6b539c165f7423db62dde53667fcf75 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:12:01.257941  4351 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6b539c165f7423db62dde53667fcf75 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a6b539c165f7423db62dde53667fcf75. Latest consensus state: current_term: 1 leader_uuid: "a6b539c165f7423db62dde53667fcf75" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6b539c165f7423db62dde53667fcf75" member_type: VOTER } }
I20260709 13:12:01.258495  4351 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6b539c165f7423db62dde53667fcf75 [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:01.258219  4350 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6b539c165f7423db62dde53667fcf75 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a6b539c165f7423db62dde53667fcf75" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6b539c165f7423db62dde53667fcf75" member_type: VOTER } }
I20260709 13:12:01.259377  4350 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6b539c165f7423db62dde53667fcf75 [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:01.260257  4359 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:12:01.265853  4359 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:12:01.266848 29364 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:12:01.274508  4359 catalog_manager.cc:1383] Generated new cluster ID: f300c4d9a6fd48c58c17cf9975577c23
I20260709 13:12:01.274796  4359 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:12:01.301034  4359 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:12:01.302325  4359 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:12:01.316239  4359 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a6b539c165f7423db62dde53667fcf75: Generated new TSK 0
I20260709 13:12:01.316875  4359 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:12:01.333775 29364 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:01.340219  4367 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:01.341009  4368 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:01.342458  4370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:01.343760 29364 server_base.cc:1061] running on GCE node
I20260709 13:12:01.345961 29364 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:01.346259 29364 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:01.358271 29364 hybrid_clock.cc:648] HybridClock initialized: now 1783602721358100 us; error 0 us; skew 500 ppm
I20260709 13:12:01.359159 29364 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:01.362347 29364 webserver.cc:533] Webserver started at http://127.28.173.1:44623/ using document root <none> and password file <none>
I20260709 13:12:01.362934 29364 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:01.363137 29364 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:01.363476 29364 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:01.365017 29364 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602443945700-29364-0/minicluster-data/ts-0-root/instance:
uuid: "06ec58698d5444caaecea433c8419770"
format_stamp: "Formatted at 2026-07-09 13:12:01 on dist-test-slave-x62b"
I20260709 13:12:01.370132 29364 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:12:01.373976  4376 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:01.374686 29364 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:12:01.375013 29364 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602443945700-29364-0/minicluster-data/ts-0-root
uuid: "06ec58698d5444caaecea433c8419770"
format_stamp: "Formatted at 2026-07-09 13:12:01 on dist-test-slave-x62b"
I20260709 13:12:01.375263 29364 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602443945700-29364-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602443945700-29364-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602443945700-29364-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:01.390602 29364 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:01.391969 29364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:01.393623 29364 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:01.396100 29364 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:01.396277 29364 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:01.396600 29364 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:01.396749 29364 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:01.440203 29364 rpc_server.cc:307] RPC server started. Bound to: 127.28.173.1:36439
I20260709 13:12:01.440335  4438 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.173.1:36439 every 8 connection(s)
I20260709 13:12:01.446249 29364 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:01.454435  4443 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:01.456800  4444 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:01.457504  4446 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:01.459558 29364 server_base.cc:1061] running on GCE node
I20260709 13:12:01.461334  4439 heartbeater.cc:344] Connected to a master server at 127.28.173.62:43215
I20260709 13:12:01.461787  4439 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:01.462507 29364 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:01.462734 29364 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:01.462641  4439 heartbeater.cc:507] Master 127.28.173.62:43215 requested a full tablet report, sending...
I20260709 13:12:01.463076 29364 hybrid_clock.cc:648] HybridClock initialized: now 1783602721463051 us; error 0 us; skew 500 ppm
I20260709 13:12:01.463685 29364 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:01.465453  4311 ts_manager.cc:194] Registered new tserver with Master: 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:01.466463 29364 webserver.cc:533] Webserver started at http://127.28.173.2:37785/ using document root <none> and password file <none>
I20260709 13:12:01.466981 29364 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:01.467181 29364 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:01.467447 29364 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:01.467760  4311 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51262
I20260709 13:12:01.468971 29364 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602443945700-29364-0/minicluster-data/ts-1-root/instance:
uuid: "aa0ff974118b465eaa785b8a86057e87"
format_stamp: "Formatted at 2026-07-09 13:12:01 on dist-test-slave-x62b"
I20260709 13:12:01.473510 29364 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:12:01.477267  4451 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:01.478107 29364 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:12:01.478416 29364 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602443945700-29364-0/minicluster-data/ts-1-root
uuid: "aa0ff974118b465eaa785b8a86057e87"
format_stamp: "Formatted at 2026-07-09 13:12:01 on dist-test-slave-x62b"
I20260709 13:12:01.478734 29364 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602443945700-29364-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602443945700-29364-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602443945700-29364-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:01.492377 29364 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:01.493592 29364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:01.494980 29364 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:01.497207 29364 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:01.497429 29364 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:01.497676 29364 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:01.497845 29364 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:01.538970 29364 rpc_server.cc:307] RPC server started. Bound to: 127.28.173.2:45987
I20260709 13:12:01.539089  4513 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.173.2:45987 every 8 connection(s)
I20260709 13:12:01.544214 29364 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:01.551388  4517 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:01.552044  4518 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:01.554850 29364 server_base.cc:1061] running on GCE node
W20260709 13:12:01.555706  4521 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:01.556811 29364 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:12:01.556933  4514 heartbeater.cc:344] Connected to a master server at 127.28.173.62:43215
W20260709 13:12:01.557114 29364 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:01.557368 29364 hybrid_clock.cc:648] HybridClock initialized: now 1783602721557347 us; error 0 us; skew 500 ppm
I20260709 13:12:01.557416  4514 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:01.558022 29364 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:01.558363  4514 heartbeater.cc:507] Master 127.28.173.62:43215 requested a full tablet report, sending...
I20260709 13:12:01.560743 29364 webserver.cc:533] Webserver started at http://127.28.173.3:45881/ using document root <none> and password file <none>
I20260709 13:12:01.560832  4311 ts_manager.cc:194] Registered new tserver with Master: aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:01.561312 29364 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:01.561554 29364 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:01.561825 29364 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:01.562412  4311 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51274
I20260709 13:12:01.563161 29364 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602443945700-29364-0/minicluster-data/ts-2-root/instance:
uuid: "420a61707e804ce5b3773a91cc2eb424"
format_stamp: "Formatted at 2026-07-09 13:12:01 on dist-test-slave-x62b"
I20260709 13:12:01.567981 29364 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:12:01.571262  4525 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:01.572067 29364 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:12:01.572365 29364 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602443945700-29364-0/minicluster-data/ts-2-root
uuid: "420a61707e804ce5b3773a91cc2eb424"
format_stamp: "Formatted at 2026-07-09 13:12:01 on dist-test-slave-x62b"
I20260709 13:12:01.572633 29364 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602443945700-29364-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602443945700-29364-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602443945700-29364-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:01.602576 29364 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:01.603863 29364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:01.605337 29364 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:01.607479 29364 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:01.607705 29364 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:01.607971 29364 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:01.608150 29364 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:01.648460 29364 rpc_server.cc:307] RPC server started. Bound to: 127.28.173.3:33159
I20260709 13:12:01.648586  4587 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.173.3:33159 every 8 connection(s)
I20260709 13:12:01.653474 29364 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:01.661120  4591 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:01.663318  4592 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:01.665988  4594 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:01.666564  4588 heartbeater.cc:344] Connected to a master server at 127.28.173.62:43215
I20260709 13:12:01.667048  4588 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:01.667330 29364 server_base.cc:1061] running on GCE node
I20260709 13:12:01.668090  4588 heartbeater.cc:507] Master 127.28.173.62:43215 requested a full tablet report, sending...
I20260709 13:12:01.668361 29364 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:01.668640 29364 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:01.668833 29364 hybrid_clock.cc:648] HybridClock initialized: now 1783602721668818 us; error 0 us; skew 500 ppm
I20260709 13:12:01.669596 29364 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:01.670378  4311 ts_manager.cc:194] Registered new tserver with Master: 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:01.672111  4311 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51288
I20260709 13:12:01.672194 29364 webserver.cc:533] Webserver started at http://127.28.173.4:40991/ using document root <none> and password file <none>
I20260709 13:12:01.672791 29364 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:01.673007 29364 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:01.673431 29364 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:01.675189 29364 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602443945700-29364-0/minicluster-data/ts-3-root/instance:
uuid: "74758684df5649ccadd1e189eaff32dc"
format_stamp: "Formatted at 2026-07-09 13:12:01 on dist-test-slave-x62b"
I20260709 13:12:01.679544 29364 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 13:12:01.683023  4599 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:01.683776 29364 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:12:01.684176 29364 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602443945700-29364-0/minicluster-data/ts-3-root
uuid: "74758684df5649ccadd1e189eaff32dc"
format_stamp: "Formatted at 2026-07-09 13:12:01 on dist-test-slave-x62b"
I20260709 13:12:01.684420 29364 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602443945700-29364-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602443945700-29364-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602443945700-29364-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:01.710299 29364 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:01.711589 29364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:01.713104 29364 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:01.715327 29364 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:01.715570 29364 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:01.715829 29364 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:01.716019 29364 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:12:01.758399 29364 rpc_server.cc:307] RPC server started. Bound to: 127.28.173.4:42711
I20260709 13:12:01.758669  4661 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.173.4:42711 every 8 connection(s)
I20260709 13:12:01.772905  4662 heartbeater.cc:344] Connected to a master server at 127.28.173.62:43215
I20260709 13:12:01.773324  4662 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:01.774150  4662 heartbeater.cc:507] Master 127.28.173.62:43215 requested a full tablet report, sending...
I20260709 13:12:01.776235  4311 ts_manager.cc:194] Registered new tserver with Master: 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:01.776487 29364 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.015087734s
I20260709 13:12:01.778159  4311 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51296
I20260709 13:12:01.805109  4311 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51300:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:12:02.039901  4553 tablet_service.cc:1511] Processing CreateTablet for tablet 6a5fe6d7057c412e8414f2a8eadf7f44 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:12:02.040671  4627 tablet_service.cc:1511] Processing CreateTablet for tablet 6a5fe6d7057c412e8414f2a8eadf7f44 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:12:02.041572  4553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a5fe6d7057c412e8414f2a8eadf7f44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.042166  4627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a5fe6d7057c412e8414f2a8eadf7f44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.042640  4626 tablet_service.cc:1511] Processing CreateTablet for tablet 5b827ee48d56478398f009c3fa980016 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:12:02.044180  4626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b827ee48d56478398f009c3fa980016. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.046101  4552 tablet_service.cc:1511] Processing CreateTablet for tablet 2e466269360c4a538e16c342590490c0 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:12:02.047631  4552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e466269360c4a538e16c342590490c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.050730  4625 tablet_service.cc:1511] Processing CreateTablet for tablet 93ff75cd7d2c433ca9aa8f6390884032 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:12:02.052079  4625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93ff75cd7d2c433ca9aa8f6390884032. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.053902  4551 tablet_service.cc:1511] Processing CreateTablet for tablet 93ff75cd7d2c433ca9aa8f6390884032 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:12:02.055307  4551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93ff75cd7d2c433ca9aa8f6390884032. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.054992  4404 tablet_service.cc:1511] Processing CreateTablet for tablet 6a5fe6d7057c412e8414f2a8eadf7f44 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:12:02.056470  4404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a5fe6d7057c412e8414f2a8eadf7f44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.068490  4403 tablet_service.cc:1511] Processing CreateTablet for tablet 2e466269360c4a538e16c342590490c0 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:12:02.069880  4403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e466269360c4a538e16c342590490c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.073012  4402 tablet_service.cc:1511] Processing CreateTablet for tablet 5b827ee48d56478398f009c3fa980016 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:12:02.074484  4402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b827ee48d56478398f009c3fa980016. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.075469  4401 tablet_service.cc:1511] Processing CreateTablet for tablet b6256e4aa07c45c78b2bbff56a852078 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:12:02.076925  4401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6256e4aa07c45c78b2bbff56a852078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.096339  4550 tablet_service.cc:1511] Processing CreateTablet for tablet b6256e4aa07c45c78b2bbff56a852078 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:12:02.098330  4550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6256e4aa07c45c78b2bbff56a852078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.104527  4624 tablet_service.cc:1511] Processing CreateTablet for tablet acbf3f88b4514948820691784cf9c189 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:12:02.105986  4624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acbf3f88b4514948820691784cf9c189. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.106499  4401 tablet_service.cc:1511] Processing CreateTablet for tablet acbf3f88b4514948820691784cf9c189 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:12:02.107759  4401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acbf3f88b4514948820691784cf9c189. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.129972  4549 tablet_service.cc:1511] Processing CreateTablet for tablet 81197f2dcf424fbaaab746d5f8bf7c8c (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:12:02.132262  4549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81197f2dcf424fbaaab746d5f8bf7c8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.140664  4623 tablet_service.cc:1511] Processing CreateTablet for tablet 81197f2dcf424fbaaab746d5f8bf7c8c (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:12:02.143374  4623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81197f2dcf424fbaaab746d5f8bf7c8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.154424  4682 tablet_bootstrap.cc:492] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:02.159834  4404 tablet_service.cc:1511] Processing CreateTablet for tablet 81197f2dcf424fbaaab746d5f8bf7c8c (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:12:02.161269  4404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81197f2dcf424fbaaab746d5f8bf7c8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.180354  4552 tablet_service.cc:1511] Processing CreateTablet for tablet 39bf585adcc94606975982efe4640189 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:12:02.181742  4552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39bf585adcc94606975982efe4640189. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.187610  4682 tablet_bootstrap.cc:654] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 06ec58698d5444caaecea433c8419770: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:02.199910  4476 tablet_service.cc:1511] Processing CreateTablet for tablet b6256e4aa07c45c78b2bbff56a852078 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:12:02.201872  4476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6256e4aa07c45c78b2bbff56a852078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.205439  4475 tablet_service.cc:1511] Processing CreateTablet for tablet acbf3f88b4514948820691784cf9c189 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:12:02.207311  4475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acbf3f88b4514948820691784cf9c189. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.211290  4474 tablet_service.cc:1511] Processing CreateTablet for tablet 39bf585adcc94606975982efe4640189 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:12:02.212241  4549 tablet_service.cc:1511] Processing CreateTablet for tablet 69aed23cb12849fda6220c6c65580d59 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:12:02.213142  4474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39bf585adcc94606975982efe4640189. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.213914  4549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69aed23cb12849fda6220c6c65580d59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.222193  4404 tablet_service.cc:1511] Processing CreateTablet for tablet 09294b866578436a827c27702d4b1d0b (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:12:02.222216  4401 tablet_service.cc:1511] Processing CreateTablet for tablet 980616077a8445ccbe984f63131e1b44 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:12:02.224632  4623 tablet_service.cc:1511] Processing CreateTablet for tablet 39bf585adcc94606975982efe4640189 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:12:02.225610  4404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09294b866578436a827c27702d4b1d0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.226351  4623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39bf585adcc94606975982efe4640189. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.228255  4401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 980616077a8445ccbe984f63131e1b44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.229252  4625 tablet_service.cc:1511] Processing CreateTablet for tablet 09294b866578436a827c27702d4b1d0b (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:12:02.230940  4625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09294b866578436a827c27702d4b1d0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.192476  4479 tablet_service.cc:1511] Processing CreateTablet for tablet 2e466269360c4a538e16c342590490c0 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:12:02.233006  4479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e466269360c4a538e16c342590490c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.194975  4478 tablet_service.cc:1511] Processing CreateTablet for tablet 5b827ee48d56478398f009c3fa980016 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:12:02.237006  4478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b827ee48d56478398f009c3fa980016. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.197428  4477 tablet_service.cc:1511] Processing CreateTablet for tablet 93ff75cd7d2c433ca9aa8f6390884032 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:12:02.197916  4550 tablet_service.cc:1511] Processing CreateTablet for tablet 980616077a8445ccbe984f63131e1b44 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:12:02.240787  4550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 980616077a8445ccbe984f63131e1b44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.241014  4477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93ff75cd7d2c433ca9aa8f6390884032. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.250135  4473 tablet_service.cc:1511] Processing CreateTablet for tablet 980616077a8445ccbe984f63131e1b44 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:12:02.254124  4472 tablet_service.cc:1511] Processing CreateTablet for tablet 09294b866578436a827c27702d4b1d0b (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:12:02.256047  4473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 980616077a8445ccbe984f63131e1b44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.255827  4553 tablet_service.cc:1511] Processing CreateTablet for tablet ea0b275f64bf42cc88bbee81a24d3020 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
W20260709 13:12:02.259769  4358 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:02.260694  4553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea0b275f64bf42cc88bbee81a24d3020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.264420  4472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09294b866578436a827c27702d4b1d0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.270659  4626 tablet_service.cc:1511] Processing CreateTablet for tablet 69aed23cb12849fda6220c6c65580d59 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:12:02.271358  4402 tablet_service.cc:1511] Processing CreateTablet for tablet 69aed23cb12849fda6220c6c65580d59 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:12:02.272006  4626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69aed23cb12849fda6220c6c65580d59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.272609  4402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69aed23cb12849fda6220c6c65580d59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.272773  4550 tablet_service.cc:1511] Processing CreateTablet for tablet 9ca87a1b3c8043529d7a9d61b0adfdbf (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:12:02.274199  4550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ca87a1b3c8043529d7a9d61b0adfdbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.279282  4627 tablet_service.cc:1511] Processing CreateTablet for tablet ea0b275f64bf42cc88bbee81a24d3020 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:12:02.280653  4627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea0b275f64bf42cc88bbee81a24d3020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.286249  4404 tablet_service.cc:1511] Processing CreateTablet for tablet 9ca87a1b3c8043529d7a9d61b0adfdbf (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:12:02.288193  4404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ca87a1b3c8043529d7a9d61b0adfdbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.287842  4622 tablet_service.cc:1511] Processing CreateTablet for tablet a4736bb71dfa4f4b8b80e8a52895acf7 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:12:02.289573  4622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4736bb71dfa4f4b8b80e8a52895acf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.294992  4471 tablet_service.cc:1511] Processing CreateTablet for tablet ea0b275f64bf42cc88bbee81a24d3020 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:12:02.296821  4471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea0b275f64bf42cc88bbee81a24d3020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.329553  4470 tablet_service.cc:1511] Processing CreateTablet for tablet 9ca87a1b3c8043529d7a9d61b0adfdbf (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:12:02.331210  4470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ca87a1b3c8043529d7a9d61b0adfdbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.356063  4403 tablet_service.cc:1511] Processing CreateTablet for tablet a4736bb71dfa4f4b8b80e8a52895acf7 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:12:02.357456  4403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4736bb71dfa4f4b8b80e8a52895acf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.360172  4681 tablet_bootstrap.cc:492] T 5b827ee48d56478398f009c3fa980016 P 74758684df5649ccadd1e189eaff32dc: Bootstrap starting.
I20260709 13:12:02.371920  4551 tablet_service.cc:1511] Processing CreateTablet for tablet 3501a75721d543d598af7857e368e08b (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:12:02.373260  4551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3501a75721d543d598af7857e368e08b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.378062  4626 tablet_service.cc:1511] Processing CreateTablet for tablet 3501a75721d543d598af7857e368e08b (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:12:02.379544  4626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3501a75721d543d598af7857e368e08b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.386767  4401 tablet_service.cc:1511] Processing CreateTablet for tablet 3501a75721d543d598af7857e368e08b (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:12:02.389163  4401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3501a75721d543d598af7857e368e08b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.401520  4683 tablet_bootstrap.cc:492] T 93ff75cd7d2c433ca9aa8f6390884032 P 420a61707e804ce5b3773a91cc2eb424: Bootstrap starting.
I20260709 13:12:02.404973  4551 tablet_service.cc:1511] Processing CreateTablet for tablet b60a97e129dc4aa9a43f2c44ec5181a8 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:12:02.406361  4551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b60a97e129dc4aa9a43f2c44ec5181a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.418737  4681 tablet_bootstrap.cc:654] T 5b827ee48d56478398f009c3fa980016 P 74758684df5649ccadd1e189eaff32dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:02.420475  4682 tablet_bootstrap.cc:492] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 06ec58698d5444caaecea433c8419770: No bootstrap required, opened a new log
I20260709 13:12:02.423200  4404 tablet_service.cc:1511] Processing CreateTablet for tablet cb23991ab8504ee491f905a4346edee9 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:12:02.432315  4682 ts_tablet_manager.cc:1403] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.278s	user 0.055s	sys 0.075s
I20260709 13:12:02.432736  4404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb23991ab8504ee491f905a4346edee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.425563  4549 tablet_service.cc:1511] Processing CreateTablet for tablet cb23991ab8504ee491f905a4346edee9 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:12:02.436561  4549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb23991ab8504ee491f905a4346edee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.435694  4682 raft_consensus.cc:359] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:02.445053  4682 raft_consensus.cc:385] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:02.445447  4682 raft_consensus.cc:740] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:02.446442  4682 consensus_queue.cc:260] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:02.435240  4475 tablet_service.cc:1511] Processing CreateTablet for tablet a4736bb71dfa4f4b8b80e8a52895acf7 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:12:02.460608  4473 tablet_service.cc:1511] Processing CreateTablet for tablet b60a97e129dc4aa9a43f2c44ec5181a8 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:12:02.470553  4439 heartbeater.cc:499] Master 127.28.173.62:43215 was elected leader, sending a full tablet report...
I20260709 13:12:02.471702  4472 tablet_service.cc:1511] Processing CreateTablet for tablet cb23991ab8504ee491f905a4346edee9 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:12:02.476773  4402 tablet_service.cc:1511] Processing CreateTablet for tablet 9a508f846d314fa0b7ec364af09bc427 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:12:02.482517  4402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a508f846d314fa0b7ec364af09bc427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.483302  4479 tablet_service.cc:1511] Processing CreateTablet for tablet 9a508f846d314fa0b7ec364af09bc427 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:12:02.480098  4683 tablet_bootstrap.cc:654] T 93ff75cd7d2c433ca9aa8f6390884032 P 420a61707e804ce5b3773a91cc2eb424: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:02.484169  4626 tablet_service.cc:1511] Processing CreateTablet for tablet b60a97e129dc4aa9a43f2c44ec5181a8 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:12:02.486812  4626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b60a97e129dc4aa9a43f2c44ec5181a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.480922  4622 tablet_service.cc:1511] Processing CreateTablet for tablet 9a508f846d314fa0b7ec364af09bc427 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:12:02.492238  4622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a508f846d314fa0b7ec364af09bc427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.460666  4475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4736bb71dfa4f4b8b80e8a52895acf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.490625  4625 tablet_service.cc:1511] Processing CreateTablet for tablet 002595643d984c1c915975d4c4ace485 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:12:02.495926  4685 tablet_bootstrap.cc:492] T 39bf585adcc94606975982efe4640189 P aa0ff974118b465eaa785b8a86057e87: Bootstrap starting.
I20260709 13:12:02.496699  4625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 002595643d984c1c915975d4c4ace485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.502081  4681 tablet_bootstrap.cc:492] T 5b827ee48d56478398f009c3fa980016 P 74758684df5649ccadd1e189eaff32dc: No bootstrap required, opened a new log
I20260709 13:12:02.502699  4681 ts_tablet_manager.cc:1403] T 5b827ee48d56478398f009c3fa980016 P 74758684df5649ccadd1e189eaff32dc: Time spent bootstrapping tablet: real 0.162s	user 0.009s	sys 0.011s
I20260709 13:12:02.507436  4473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b60a97e129dc4aa9a43f2c44ec5181a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.508631  4472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb23991ab8504ee491f905a4346edee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.509279  4479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a508f846d314fa0b7ec364af09bc427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.514547  4478 tablet_service.cc:1511] Processing CreateTablet for tablet 04ba2c5f82234a0b8ca6cd31f26f6cfe (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:12:02.516067  4478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04ba2c5f82234a0b8ca6cd31f26f6cfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.522282  4550 tablet_service.cc:1511] Processing CreateTablet for tablet 20be30df26724e7f98f3b36f24e4df3a (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:12:02.523757  4550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20be30df26724e7f98f3b36f24e4df3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.525578  4552 tablet_service.cc:1511] Processing CreateTablet for tablet d1119afee9d6413aa2cd229073ffbcf1 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:12:02.526953  4552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1119afee9d6413aa2cd229073ffbcf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.507685  4682 ts_tablet_manager.cc:1434] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.075s	user 0.009s	sys 0.007s
I20260709 13:12:02.529083  4682 tablet_bootstrap.cc:492] T b6256e4aa07c45c78b2bbff56a852078 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:02.531913  4626 tablet_service.cc:1511] Processing CreateTablet for tablet 04ba2c5f82234a0b8ca6cd31f26f6cfe (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:12:02.532209  4623 tablet_service.cc:1511] Processing CreateTablet for tablet d0147a5552154f26a88833f9210b1358 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:12:02.533017  4681 raft_consensus.cc:359] T 5b827ee48d56478398f009c3fa980016 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:02.533838  4681 raft_consensus.cc:385] T 5b827ee48d56478398f009c3fa980016 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:02.534317  4470 tablet_service.cc:1511] Processing CreateTablet for tablet 20be30df26724e7f98f3b36f24e4df3a (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:12:02.535051  4401 tablet_service.cc:1511] Processing CreateTablet for tablet 20be30df26724e7f98f3b36f24e4df3a (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:12:02.535439  4474 tablet_service.cc:1511] Processing CreateTablet for tablet d0147a5552154f26a88833f9210b1358 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:12:02.536402  4626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04ba2c5f82234a0b8ca6cd31f26f6cfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.539706  4474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0147a5552154f26a88833f9210b1358. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.537370  4403 tablet_service.cc:1511] Processing CreateTablet for tablet d0147a5552154f26a88833f9210b1358 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:12:02.541064  4470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20be30df26724e7f98f3b36f24e4df3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.536998  4681 raft_consensus.cc:740] T 5b827ee48d56478398f009c3fa980016 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Initialized, Role: FOLLOWER
I20260709 13:12:02.481534  4551 tablet_service.cc:1511] Processing CreateTablet for tablet 002595643d984c1c915975d4c4ace485 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:12:02.547933  4623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0147a5552154f26a88833f9210b1358. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.552974  4551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 002595643d984c1c915975d4c4ace485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.553768  4553 tablet_service.cc:1511] Processing CreateTablet for tablet 5cd01d60553a435387e507f5d6240b58 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:12:02.554615  4549 tablet_service.cc:1511] Processing CreateTablet for tablet 04ba2c5f82234a0b8ca6cd31f26f6cfe (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:12:02.555285  4553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cd01d60553a435387e507f5d6240b58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.558861  4400 tablet_service.cc:1511] Processing CreateTablet for tablet d1119afee9d6413aa2cd229073ffbcf1 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:12:02.560746  4476 tablet_service.cc:1511] Processing CreateTablet for tablet 5cd01d60553a435387e507f5d6240b58 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:12:02.561952  4476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cd01d60553a435387e507f5d6240b58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.556331  4404 tablet_service.cc:1511] Processing CreateTablet for tablet 002595643d984c1c915975d4c4ace485 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:12:02.564762  4624 tablet_service.cc:1511] Processing CreateTablet for tablet 5cd01d60553a435387e507f5d6240b58 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:12:02.566056  4624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cd01d60553a435387e507f5d6240b58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.567533  4683 tablet_bootstrap.cc:492] T 93ff75cd7d2c433ca9aa8f6390884032 P 420a61707e804ce5b3773a91cc2eb424: No bootstrap required, opened a new log
I20260709 13:12:02.556419  4627 tablet_service.cc:1511] Processing CreateTablet for tablet d1119afee9d6413aa2cd229073ffbcf1 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:12:02.568136  4683 ts_tablet_manager.cc:1403] T 93ff75cd7d2c433ca9aa8f6390884032 P 420a61707e804ce5b3773a91cc2eb424: Time spent bootstrapping tablet: real 0.167s	user 0.017s	sys 0.009s
I20260709 13:12:02.568857  4627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1119afee9d6413aa2cd229073ffbcf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.568094  4514 heartbeater.cc:499] Master 127.28.173.62:43215 was elected leader, sending a full tablet report...
I20260709 13:12:02.580948  4685 tablet_bootstrap.cc:654] T 39bf585adcc94606975982efe4640189 P aa0ff974118b465eaa785b8a86057e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:02.584069  4401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20be30df26724e7f98f3b36f24e4df3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.588472  4403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0147a5552154f26a88833f9210b1358. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.591120  4400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1119afee9d6413aa2cd229073ffbcf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.564739  4549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04ba2c5f82234a0b8ca6cd31f26f6cfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.600778  4404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 002595643d984c1c915975d4c4ace485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.582394  4683 raft_consensus.cc:359] T 93ff75cd7d2c433ca9aa8f6390884032 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:02.608279  4683 raft_consensus.cc:385] T 93ff75cd7d2c433ca9aa8f6390884032 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:02.608565  4683 raft_consensus.cc:740] T 93ff75cd7d2c433ca9aa8f6390884032 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Initialized, Role: FOLLOWER
I20260709 13:12:02.609455  4683 consensus_queue.cc:260] T 93ff75cd7d2c433ca9aa8f6390884032 P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:02.615299  4548 tablet_service.cc:1511] Processing CreateTablet for tablet 35dbb9c8f1ac4eca802b0c887a4d1c27 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:12:02.616700  4548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35dbb9c8f1ac4eca802b0c887a4d1c27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.616294  4681 consensus_queue.cc:260] T 5b827ee48d56478398f009c3fa980016 P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:02.621685  4399 tablet_service.cc:1511] Processing CreateTablet for tablet 1503964d57034b31b36eecc16f2c84a0 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:12:02.623163  4399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1503964d57034b31b36eecc16f2c84a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.624678  4626 tablet_service.cc:1511] Processing CreateTablet for tablet 1503964d57034b31b36eecc16f2c84a0 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:12:02.625914  4626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1503964d57034b31b36eecc16f2c84a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.628043  4471 tablet_service.cc:1511] Processing CreateTablet for tablet 1503964d57034b31b36eecc16f2c84a0 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:12:02.629369  4471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1503964d57034b31b36eecc16f2c84a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.633622  4621 tablet_service.cc:1511] Processing CreateTablet for tablet 604a93ed898f4ab9b771487bfe278b33 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:12:02.616789  4475 tablet_service.cc:1511] Processing CreateTablet for tablet 35dbb9c8f1ac4eca802b0c887a4d1c27 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:12:02.635025  4621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 604a93ed898f4ab9b771487bfe278b33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.636039  4475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35dbb9c8f1ac4eca802b0c887a4d1c27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.637791  4553 tablet_service.cc:1511] Processing CreateTablet for tablet 604a93ed898f4ab9b771487bfe278b33 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:12:02.639133  4553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 604a93ed898f4ab9b771487bfe278b33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.640082  4687 raft_consensus.cc:493] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.662521  4687 raft_consensus.cc:515] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:02.664728  4402 tablet_service.cc:1511] Processing CreateTablet for tablet 35dbb9c8f1ac4eca802b0c887a4d1c27 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:12:02.646099  4588 heartbeater.cc:499] Master 127.28.173.62:43215 was elected leader, sending a full tablet report...
I20260709 13:12:02.646178  4690 raft_consensus.cc:493] T 93ff75cd7d2c433ca9aa8f6390884032 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.669716  4402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35dbb9c8f1ac4eca802b0c887a4d1c27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.680068  4687 leader_election.cc:290] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:02.672384  4690 raft_consensus.cc:515] T 93ff75cd7d2c433ca9aa8f6390884032 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:02.691927  4690 leader_election.cc:290] T 93ff75cd7d2c433ca9aa8f6390884032 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:02.700387  4683 ts_tablet_manager.cc:1434] T 93ff75cd7d2c433ca9aa8f6390884032 P 420a61707e804ce5b3773a91cc2eb424: Time spent starting tablet: real 0.132s	user 0.008s	sys 0.000s
I20260709 13:12:02.701145  4682 tablet_bootstrap.cc:654] T b6256e4aa07c45c78b2bbff56a852078 P 06ec58698d5444caaecea433c8419770: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:02.708595  4440 tablet.cc:2406] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 06ec58698d5444caaecea433c8419770: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:12:02.710253  4685 tablet_bootstrap.cc:492] T 39bf585adcc94606975982efe4640189 P aa0ff974118b465eaa785b8a86057e87: No bootstrap required, opened a new log
I20260709 13:12:02.710898  4685 ts_tablet_manager.cc:1403] T 39bf585adcc94606975982efe4640189 P aa0ff974118b465eaa785b8a86057e87: Time spent bootstrapping tablet: real 0.219s	user 0.010s	sys 0.007s
I20260709 13:12:02.712968  4478 tablet_service.cc:1511] Processing CreateTablet for tablet 3092a6c40d0d4610968fe09d4c7d16c0 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:12:02.725836  4662 heartbeater.cc:499] Master 127.28.173.62:43215 was elected leader, sending a full tablet report...
I20260709 13:12:02.728652  4625 tablet_service.cc:1511] Processing CreateTablet for tablet 3092a6c40d0d4610968fe09d4c7d16c0 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:12:02.730059  4625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3092a6c40d0d4610968fe09d4c7d16c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.742324  4404 tablet_service.cc:1511] Processing CreateTablet for tablet 325a5a55a44a47ce97869216b084f89d (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:12:02.743729  4404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 325a5a55a44a47ce97869216b084f89d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.744585  4478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3092a6c40d0d4610968fe09d4c7d16c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.748953  4400 tablet_service.cc:1511] Processing CreateTablet for tablet f7682a3f7f134c34a24488586461f6a4 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:12:02.749958  4685 raft_consensus.cc:359] T 39bf585adcc94606975982efe4640189 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:02.750731  4685 raft_consensus.cc:385] T 39bf585adcc94606975982efe4640189 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:02.751036  4685 raft_consensus.cc:740] T 39bf585adcc94606975982efe4640189 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Initialized, Role: FOLLOWER
I20260709 13:12:02.751791  4683 tablet_bootstrap.cc:492] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424: Bootstrap starting.
I20260709 13:12:02.757215  4476 tablet_service.cc:1511] Processing CreateTablet for tablet 325a5a55a44a47ce97869216b084f89d (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:12:02.759032  4476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 325a5a55a44a47ce97869216b084f89d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.764997  4403 tablet_service.cc:1511] Processing CreateTablet for tablet 604a93ed898f4ab9b771487bfe278b33 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:12:02.773162  4683 tablet_bootstrap.cc:654] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:02.775558  4685 consensus_queue.cc:260] T 39bf585adcc94606975982efe4640189 P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:02.781957  4470 tablet_service.cc:1511] Processing CreateTablet for tablet f7682a3f7f134c34a24488586461f6a4 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:12:02.776396  4400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7682a3f7f134c34a24488586461f6a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.783699  4470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7682a3f7f134c34a24488586461f6a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.795861  4681 ts_tablet_manager.cc:1434] T 5b827ee48d56478398f009c3fa980016 P 74758684df5649ccadd1e189eaff32dc: Time spent starting tablet: real 0.293s	user 0.007s	sys 0.011s
I20260709 13:12:02.796998  4681 tablet_bootstrap.cc:492] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 74758684df5649ccadd1e189eaff32dc: Bootstrap starting.
I20260709 13:12:02.798035  4685 ts_tablet_manager.cc:1434] T 39bf585adcc94606975982efe4640189 P aa0ff974118b465eaa785b8a86057e87: Time spent starting tablet: real 0.087s	user 0.006s	sys 0.010s
I20260709 13:12:02.797690  4399 tablet_service.cc:1511] Processing CreateTablet for tablet 584f5934b7fa4c7ab4b0b43923621e70 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:12:02.796952  4403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 604a93ed898f4ab9b771487bfe278b33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.813220  4399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 584f5934b7fa4c7ab4b0b43923621e70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.822310  4685 tablet_bootstrap.cc:492] T 980616077a8445ccbe984f63131e1b44 P aa0ff974118b465eaa785b8a86057e87: Bootstrap starting.
I20260709 13:12:02.824486  4626 tablet_service.cc:1511] Processing CreateTablet for tablet 325a5a55a44a47ce97869216b084f89d (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:12:02.825794  4626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 325a5a55a44a47ce97869216b084f89d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.826443  4471 tablet_service.cc:1511] Processing CreateTablet for tablet 6fc1ff9a8e0d49d7b58940ccec6c0540 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:12:02.827723  4471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fc1ff9a8e0d49d7b58940ccec6c0540. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.823342  4627 tablet_service.cc:1511] Processing CreateTablet for tablet 584f5934b7fa4c7ab4b0b43923621e70 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:12:02.828761  4627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 584f5934b7fa4c7ab4b0b43923621e70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.836431  4623 tablet_service.cc:1511] Processing CreateTablet for tablet 6fc1ff9a8e0d49d7b58940ccec6c0540 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:12:02.837734  4623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fc1ff9a8e0d49d7b58940ccec6c0540. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.840530  4637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5fe6d7057c412e8414f2a8eadf7f44" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
W20260709 13:12:02.842211  4380 leader_election.cc:343] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:02.847270  4681 tablet_bootstrap.cc:654] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 74758684df5649ccadd1e189eaff32dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:02.853593  4401 tablet_service.cc:1511] Processing CreateTablet for tablet 150545c47e0642229a92ede96db14fc9 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:12:02.857012  4474 tablet_service.cc:1511] Processing CreateTablet for tablet 150545c47e0642229a92ede96db14fc9 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:12:02.854961  4401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 150545c47e0642229a92ede96db14fc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.858765  4474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 150545c47e0642229a92ede96db14fc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.865180  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5fe6d7057c412e8414f2a8eadf7f44" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:02.868237  4682 tablet_bootstrap.cc:492] T b6256e4aa07c45c78b2bbff56a852078 P 06ec58698d5444caaecea433c8419770: No bootstrap required, opened a new log
W20260709 13:12:02.868410  4379 leader_election.cc:343] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:02.868841  4682 ts_tablet_manager.cc:1403] T b6256e4aa07c45c78b2bbff56a852078 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.340s	user 0.011s	sys 0.018s
I20260709 13:12:02.869009  4379 leader_election.cc:304] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06ec58698d5444caaecea433c8419770; no voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc
I20260709 13:12:02.870256  4687 raft_consensus.cc:2749] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:02.870751  4685 tablet_bootstrap.cc:654] T 980616077a8445ccbe984f63131e1b44 P aa0ff974118b465eaa785b8a86057e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:02.872185  4682 raft_consensus.cc:359] T b6256e4aa07c45c78b2bbff56a852078 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:02.872895  4682 raft_consensus.cc:385] T b6256e4aa07c45c78b2bbff56a852078 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:02.873183  4682 raft_consensus.cc:740] T b6256e4aa07c45c78b2bbff56a852078 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:02.874079  4682 consensus_queue.cc:260] T b6256e4aa07c45c78b2bbff56a852078 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:02.889640  4402 tablet_service.cc:1511] Processing CreateTablet for tablet aa241e695dbb492a971f537d1f977f21 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:12:02.892215  4553 tablet_service.cc:1511] Processing CreateTablet for tablet f7682a3f7f134c34a24488586461f6a4 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:12:02.893530  4553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7682a3f7f134c34a24488586461f6a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.894675  4548 tablet_service.cc:1511] Processing CreateTablet for tablet 3092a6c40d0d4610968fe09d4c7d16c0 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:12:02.896004  4548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3092a6c40d0d4610968fe09d4c7d16c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.895731  4402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa241e695dbb492a971f537d1f977f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.897241  4549 tablet_service.cc:1511] Processing CreateTablet for tablet 584f5934b7fa4c7ab4b0b43923621e70 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:12:02.898545  4549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 584f5934b7fa4c7ab4b0b43923621e70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.900794  4552 tablet_service.cc:1511] Processing CreateTablet for tablet 150545c47e0642229a92ede96db14fc9 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:12:02.902064  4552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 150545c47e0642229a92ede96db14fc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.900792  4551 tablet_service.cc:1511] Processing CreateTablet for tablet 6fc1ff9a8e0d49d7b58940ccec6c0540 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:12:02.905122  4551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fc1ff9a8e0d49d7b58940ccec6c0540. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.886394  4621 tablet_service.cc:1511] Processing CreateTablet for tablet aa241e695dbb492a971f537d1f977f21 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:12:02.924180  4621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa241e695dbb492a971f537d1f977f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.922451  4682 ts_tablet_manager.cc:1434] T b6256e4aa07c45c78b2bbff56a852078 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.053s	user 0.009s	sys 0.000s
I20260709 13:12:02.929111  4682 tablet_bootstrap.cc:492] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:02.933746  4683 tablet_bootstrap.cc:492] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424: No bootstrap required, opened a new log
I20260709 13:12:02.936789  4683 ts_tablet_manager.cc:1403] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424: Time spent bootstrapping tablet: real 0.210s	user 0.012s	sys 0.004s
I20260709 13:12:02.939392  4475 tablet_service.cc:1511] Processing CreateTablet for tablet aa241e695dbb492a971f537d1f977f21 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:12:02.941550  4475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa241e695dbb492a971f537d1f977f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:02.952095  4701 raft_consensus.cc:493] T 39bf585adcc94606975982efe4640189 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.952703  4701 raft_consensus.cc:515] T 39bf585adcc94606975982efe4640189 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:02.970223  4681 tablet_bootstrap.cc:492] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 74758684df5649ccadd1e189eaff32dc: No bootstrap required, opened a new log
I20260709 13:12:02.970798  4681 ts_tablet_manager.cc:1403] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 74758684df5649ccadd1e189eaff32dc: Time spent bootstrapping tablet: real 0.174s	user 0.016s	sys 0.001s
I20260709 13:12:02.971381  4489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93ff75cd7d2c433ca9aa8f6390884032" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:02.971374  4637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93ff75cd7d2c433ca9aa8f6390884032" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:02.973937  4681 raft_consensus.cc:359] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
W20260709 13:12:02.974483  4529 leader_election.cc:343] T 93ff75cd7d2c433ca9aa8f6390884032 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:02.974779  4681 raft_consensus.cc:385] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:02.975131  4681 raft_consensus.cc:740] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Initialized, Role: FOLLOWER
W20260709 13:12:02.975337  4529 leader_election.cc:343] T 93ff75cd7d2c433ca9aa8f6390884032 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:02.975921  4529 leader_election.cc:304] T 93ff75cd7d2c433ca9aa8f6390884032 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424; no voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:02.976948  4692 raft_consensus.cc:2749] T 93ff75cd7d2c433ca9aa8f6390884032 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:02.976045  4681 consensus_queue.cc:260] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:02.983580  4681 ts_tablet_manager.cc:1434] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 74758684df5649ccadd1e189eaff32dc: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:12:02.984943  4681 tablet_bootstrap.cc:492] T 93ff75cd7d2c433ca9aa8f6390884032 P 74758684df5649ccadd1e189eaff32dc: Bootstrap starting.
I20260709 13:12:02.981962  4701 leader_election.cc:290] T 39bf585adcc94606975982efe4640189 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:02.991473  4551 tablet_service.cc:1511] Processing CreateTablet for tablet a8fb0d1b4ae14754aa30516d12cdea3d (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:12:02.997759  4682 tablet_bootstrap.cc:654] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:02.998135  4685 tablet_bootstrap.cc:492] T 980616077a8445ccbe984f63131e1b44 P aa0ff974118b465eaa785b8a86057e87: No bootstrap required, opened a new log
I20260709 13:12:02.998698  4685 ts_tablet_manager.cc:1403] T 980616077a8445ccbe984f63131e1b44 P aa0ff974118b465eaa785b8a86057e87: Time spent bootstrapping tablet: real 0.177s	user 0.014s	sys 0.035s
I20260709 13:12:02.998927  4627 tablet_service.cc:1511] Processing CreateTablet for tablet a8fb0d1b4ae14754aa30516d12cdea3d (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:12:03.000336  4627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8fb0d1b4ae14754aa30516d12cdea3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.001703  4683 raft_consensus.cc:359] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:03.002449  4683 raft_consensus.cc:385] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.002262  4685 raft_consensus.cc:359] T 980616077a8445ccbe984f63131e1b44 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:03.002801  4683 raft_consensus.cc:740] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.003049  4685 raft_consensus.cc:385] T 980616077a8445ccbe984f63131e1b44 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.003401  4685 raft_consensus.cc:740] T 980616077a8445ccbe984f63131e1b44 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.007926  4551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8fb0d1b4ae14754aa30516d12cdea3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.003563  4683 consensus_queue.cc:260] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:03.011833  4683 ts_tablet_manager.cc:1434] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424: Time spent starting tablet: real 0.061s	user 0.006s	sys 0.000s
I20260709 13:12:03.017314  4402 tablet_service.cc:1511] Processing CreateTablet for tablet a8fb0d1b4ae14754aa30516d12cdea3d (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:12:03.019171  4402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8fb0d1b4ae14754aa30516d12cdea3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.026912  4681 tablet_bootstrap.cc:654] T 93ff75cd7d2c433ca9aa8f6390884032 P 74758684df5649ccadd1e189eaff32dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.015558  4683 tablet_bootstrap.cc:492] T b6256e4aa07c45c78b2bbff56a852078 P 420a61707e804ce5b3773a91cc2eb424: Bootstrap starting.
I20260709 13:12:03.035640  4691 raft_consensus.cc:493] T 5b827ee48d56478398f009c3fa980016 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.044876  4691 raft_consensus.cc:515] T 5b827ee48d56478398f009c3fa980016 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:03.047043  4691 leader_election.cc:290] T 5b827ee48d56478398f009c3fa980016 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:03.004501  4685 consensus_queue.cc:260] T 980616077a8445ccbe984f63131e1b44 P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:03.061872  4551 tablet_service.cc:1511] Processing CreateTablet for tablet 1271bae393604d56b9e376c716eb2a9e (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:12:03.063441  4551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1271bae393604d56b9e376c716eb2a9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.063321  4475 tablet_service.cc:1511] Processing CreateTablet for tablet 1271bae393604d56b9e376c716eb2a9e (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:12:03.064692  4475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1271bae393604d56b9e376c716eb2a9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.064858  4683 tablet_bootstrap.cc:654] T b6256e4aa07c45c78b2bbff56a852078 P 420a61707e804ce5b3773a91cc2eb424: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.059695  4685 ts_tablet_manager.cc:1434] T 980616077a8445ccbe984f63131e1b44 P aa0ff974118b465eaa785b8a86057e87: Time spent starting tablet: real 0.061s	user 0.010s	sys 0.000s
I20260709 13:12:03.068511  4682 tablet_bootstrap.cc:492] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770: No bootstrap required, opened a new log
I20260709 13:12:03.073293  4685 tablet_bootstrap.cc:492] T acbf3f88b4514948820691784cf9c189 P aa0ff974118b465eaa785b8a86057e87: Bootstrap starting.
I20260709 13:12:03.074607  4474 tablet_service.cc:1511] Processing CreateTablet for tablet 9d526ab043434bf0bcab814f9bbc3234 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:12:03.076383  4474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d526ab043434bf0bcab814f9bbc3234. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.076916  4682 ts_tablet_manager.cc:1403] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.148s	user 0.015s	sys 0.003s
I20260709 13:12:03.077523  4627 tablet_service.cc:1511] Processing CreateTablet for tablet 1271bae393604d56b9e376c716eb2a9e (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:12:03.078802  4627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1271bae393604d56b9e376c716eb2a9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.079355  4552 tablet_service.cc:1511] Processing CreateTablet for tablet 9d526ab043434bf0bcab814f9bbc3234 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:12:03.080638  4552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d526ab043434bf0bcab814f9bbc3234. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.082652  4402 tablet_service.cc:1511] Processing CreateTablet for tablet 9d526ab043434bf0bcab814f9bbc3234 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:12:03.083282  4637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39bf585adcc94606975982efe4640189" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:03.083874  4402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d526ab043434bf0bcab814f9bbc3234. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:03.084964  4455 leader_election.cc:343] T 39bf585adcc94606975982efe4640189 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:03.090656  4621 tablet_service.cc:1511] Processing CreateTablet for tablet a16334f2dff74513ba7ca22ca8fb5afd (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:12:03.091902  4621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a16334f2dff74513ba7ca22ca8fb5afd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.092958  4401 tablet_service.cc:1511] Processing CreateTablet for tablet a16334f2dff74513ba7ca22ca8fb5afd (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:12:03.094177  4401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a16334f2dff74513ba7ca22ca8fb5afd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.089144  4682 raft_consensus.cc:359] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:03.099360  4681 tablet_bootstrap.cc:492] T 93ff75cd7d2c433ca9aa8f6390884032 P 74758684df5649ccadd1e189eaff32dc: No bootstrap required, opened a new log
I20260709 13:12:03.096333  4682 raft_consensus.cc:385] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.099874  4681 ts_tablet_manager.cc:1403] T 93ff75cd7d2c433ca9aa8f6390884032 P 74758684df5649ccadd1e189eaff32dc: Time spent bootstrapping tablet: real 0.115s	user 0.015s	sys 0.007s
I20260709 13:12:03.100083  4682 raft_consensus.cc:740] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.100948  4682 consensus_queue.cc:260] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:03.102600  4470 tablet_service.cc:1511] Processing CreateTablet for tablet a16334f2dff74513ba7ca22ca8fb5afd (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:12:03.103906  4470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a16334f2dff74513ba7ca22ca8fb5afd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.105306  4682 ts_tablet_manager.cc:1434] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:12:03.106350  4682 tablet_bootstrap.cc:492] T 5b827ee48d56478398f009c3fa980016 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:03.110255  4681 raft_consensus.cc:359] T 93ff75cd7d2c433ca9aa8f6390884032 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:03.110960  4681 raft_consensus.cc:385] T 93ff75cd7d2c433ca9aa8f6390884032 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.112349  4549 tablet_service.cc:1511] Processing CreateTablet for tablet ff7757f22fe3408f8745bc899f3c2e4e (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:12:03.113190  4623 tablet_service.cc:1511] Processing CreateTablet for tablet ff7757f22fe3408f8745bc899f3c2e4e (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:12:03.113603  4549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff7757f22fe3408f8745bc899f3c2e4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.114491  4623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff7757f22fe3408f8745bc899f3c2e4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.117326  4404 tablet_service.cc:1511] Processing CreateTablet for tablet ff7757f22fe3408f8745bc899f3c2e4e (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:12:03.118525  4404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff7757f22fe3408f8745bc899f3c2e4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.123770  4476 tablet_service.cc:1511] Processing CreateTablet for tablet f63e5465acbf4283a97304441ba41968 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:12:03.125042  4476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f63e5465acbf4283a97304441ba41968. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.111255  4681 raft_consensus.cc:740] T 93ff75cd7d2c433ca9aa8f6390884032 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.131744  4685 tablet_bootstrap.cc:654] T acbf3f88b4514948820691784cf9c189 P aa0ff974118b465eaa785b8a86057e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.132925  4489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b827ee48d56478398f009c3fa980016" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
W20260709 13:12:03.137277  4603 leader_election.cc:343] T 5b827ee48d56478398f009c3fa980016 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:03.142841  4552 tablet_service.cc:1511] Processing CreateTablet for tablet f63e5465acbf4283a97304441ba41968 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:12:03.144723  4552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f63e5465acbf4283a97304441ba41968. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.128666  4681 consensus_queue.cc:260] T 93ff75cd7d2c433ca9aa8f6390884032 P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:03.145646  4687 raft_consensus.cc:493] T b6256e4aa07c45c78b2bbff56a852078 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.146194  4687 raft_consensus.cc:515] T b6256e4aa07c45c78b2bbff56a852078 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:03.147603  4681 ts_tablet_manager.cc:1434] T 93ff75cd7d2c433ca9aa8f6390884032 P 74758684df5649ccadd1e189eaff32dc: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.001s
I20260709 13:12:03.150136  4681 tablet_bootstrap.cc:492] T 81197f2dcf424fbaaab746d5f8bf7c8c P 74758684df5649ccadd1e189eaff32dc: Bootstrap starting.
I20260709 13:12:03.153213  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39bf585adcc94606975982efe4640189" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:03.153811  4683 tablet_bootstrap.cc:492] T b6256e4aa07c45c78b2bbff56a852078 P 420a61707e804ce5b3773a91cc2eb424: No bootstrap required, opened a new log
W20260709 13:12:03.154803  4454 leader_election.cc:343] T 39bf585adcc94606975982efe4640189 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:03.154350  4683 ts_tablet_manager.cc:1403] T b6256e4aa07c45c78b2bbff56a852078 P 420a61707e804ce5b3773a91cc2eb424: Time spent bootstrapping tablet: real 0.140s	user 0.009s	sys 0.004s
I20260709 13:12:03.155344  4454 leader_election.cc:304] T 39bf585adcc94606975982efe4640189 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa0ff974118b465eaa785b8a86057e87; no voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc
I20260709 13:12:03.159569  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6256e4aa07c45c78b2bbff56a852078" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:03.155781  4687 leader_election.cc:290] T b6256e4aa07c45c78b2bbff56a852078 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:03.167119  4681 tablet_bootstrap.cc:654] T 81197f2dcf424fbaaab746d5f8bf7c8c P 74758684df5649ccadd1e189eaff32dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.162230  4701 raft_consensus.cc:2749] T 39bf585adcc94606975982efe4640189 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:03.170277  4489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6256e4aa07c45c78b2bbff56a852078" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:03.171382  4701 raft_consensus.cc:493] T 980616077a8445ccbe984f63131e1b44 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.158783  4683 raft_consensus.cc:359] T b6256e4aa07c45c78b2bbff56a852078 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:03.173933  4701 raft_consensus.cc:515] T 980616077a8445ccbe984f63131e1b44 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:03.178002  4683 raft_consensus.cc:385] T b6256e4aa07c45c78b2bbff56a852078 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.179184  4683 raft_consensus.cc:740] T b6256e4aa07c45c78b2bbff56a852078 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.179278  4701 leader_election.cc:290] T 980616077a8445ccbe984f63131e1b44 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
W20260709 13:12:03.180454  4380 leader_election.cc:343] T b6256e4aa07c45c78b2bbff56a852078 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:03.184669  4562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980616077a8445ccbe984f63131e1b44" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:03.186359  4621 tablet_service.cc:1511] Processing CreateTablet for tablet f63e5465acbf4283a97304441ba41968 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:12:03.187849  4621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f63e5465acbf4283a97304441ba41968. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.189419  4687 raft_consensus.cc:493] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.189828  4691 raft_consensus.cc:493] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.191148  4691 raft_consensus.cc:515] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:03.193691  4691 leader_election.cc:290] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:03.195482  4404 tablet_service.cc:1511] Processing CreateTablet for tablet d0608a8abe6c4bd083d751020218957e (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:12:03.197041  4404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0608a8abe6c4bd083d751020218957e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.198346  4687 raft_consensus.cc:515] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
W20260709 13:12:03.210471  4454 leader_election.cc:343] T 980616077a8445ccbe984f63131e1b44 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:03.220317  4687 leader_election.cc:290] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:03.224066  4626 tablet_service.cc:1511] Processing CreateTablet for tablet 49047cb7a56246288b9044f8ebec130f (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:12:03.225383  4626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49047cb7a56246288b9044f8ebec130f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.228983  4562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e466269360c4a538e16c342590490c0" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:03.211303  4682 tablet_bootstrap.cc:654] T 5b827ee48d56478398f009c3fa980016 P 06ec58698d5444caaecea433c8419770: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.229652  4562 raft_consensus.cc:2468] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 0.
I20260709 13:12:03.229833  4476 tablet_service.cc:1511] Processing CreateTablet for tablet d0608a8abe6c4bd083d751020218957e (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:12:03.238458  4476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0608a8abe6c4bd083d751020218957e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.200318  4683 consensus_queue.cc:260] T b6256e4aa07c45c78b2bbff56a852078 P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:03.246853  4379 leader_election.cc:304] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: 
I20260709 13:12:03.247399  4489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e466269360c4a538e16c342590490c0" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:03.247291  4474 tablet_service.cc:1511] Processing CreateTablet for tablet 49047cb7a56246288b9044f8ebec130f (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:12:03.247730  4687 raft_consensus.cc:2804] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:03.248126  4685 tablet_bootstrap.cc:492] T acbf3f88b4514948820691784cf9c189 P aa0ff974118b465eaa785b8a86057e87: No bootstrap required, opened a new log
I20260709 13:12:03.248154  4687 raft_consensus.cc:493] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:03.248618  4474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49047cb7a56246288b9044f8ebec130f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.248771  4687 raft_consensus.cc:3060] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:03.249727  4402 tablet_service.cc:1511] Processing CreateTablet for tablet 49047cb7a56246288b9044f8ebec130f (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:12:03.250958  4402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49047cb7a56246288b9044f8ebec130f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.248792  4685 ts_tablet_manager.cc:1403] T acbf3f88b4514948820691784cf9c189 P aa0ff974118b465eaa785b8a86057e87: Time spent bootstrapping tablet: real 0.176s	user 0.018s	sys 0.000s
I20260709 13:12:03.244252  4563 raft_consensus.cc:2468] T b6256e4aa07c45c78b2bbff56a852078 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 0.
I20260709 13:12:03.252374  4692 raft_consensus.cc:493] T b6256e4aa07c45c78b2bbff56a852078 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.252918  4692 raft_consensus.cc:515] T b6256e4aa07c45c78b2bbff56a852078 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:03.253824  4551 tablet_service.cc:1511] Processing CreateTablet for tablet d0608a8abe6c4bd083d751020218957e (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:12:03.255122  4551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0608a8abe6c4bd083d751020218957e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.255313  4685 raft_consensus.cc:359] T acbf3f88b4514948820691784cf9c189 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:03.256107  4685 raft_consensus.cc:385] T acbf3f88b4514948820691784cf9c189 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.256377  4685 raft_consensus.cc:740] T acbf3f88b4514948820691784cf9c189 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.257555  4692 leader_election.cc:290] T b6256e4aa07c45c78b2bbff56a852078 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:03.258073  4692 raft_consensus.cc:493] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.258491  4692 raft_consensus.cc:515] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:03.261148  4414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b827ee48d56478398f009c3fa980016" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
W20260709 13:12:03.262475  4358 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:03.262681  4413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5fe6d7057c412e8414f2a8eadf7f44" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:03.263356  4413 raft_consensus.cc:2468] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 0.
I20260709 13:12:03.263115  4685 consensus_queue.cc:260] T acbf3f88b4514948820691784cf9c189 P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
W20260709 13:12:03.264499  4603 leader_election.cc:343] T 5b827ee48d56478398f009c3fa980016 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:03.264956  4603 leader_election.cc:304] T 5b827ee48d56478398f009c3fa980016 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc; no voters: 06ec58698d5444caaecea433c8419770, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:03.265424  4687 raft_consensus.cc:515] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:03.266084  4691 raft_consensus.cc:2749] T 5b827ee48d56478398f009c3fa980016 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:03.267503  4603 leader_election.cc:304] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 74758684df5649ccadd1e189eaff32dc; no voters: 
I20260709 13:12:03.268395  4691 raft_consensus.cc:2804] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:03.268524  4562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e466269360c4a538e16c342590490c0" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:03.268790  4691 raft_consensus.cc:493] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:03.269134  4562 raft_consensus.cc:3060] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:03.269162  4691 raft_consensus.cc:3060] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:03.271533  4379 leader_election.cc:304] T b6256e4aa07c45c78b2bbff56a852078 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:03.279289  4489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6256e4aa07c45c78b2bbff56a852078" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
W20260709 13:12:03.280977  4529 leader_election.cc:343] T b6256e4aa07c45c78b2bbff56a852078 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:03.272846  4687 leader_election.cc:290] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Requested vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:03.293536  4549 tablet_service.cc:1511] Processing CreateTablet for tablet b731fe02a6f4441e816628760bfdfb54 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:12:03.300961  4549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b731fe02a6f4441e816628760bfdfb54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.301208  4562 raft_consensus.cc:2468] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 1.
I20260709 13:12:03.302412  4379 leader_election.cc:304] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: 
I20260709 13:12:03.302625  4489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e466269360c4a538e16c342590490c0" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:03.303376  4721 raft_consensus.cc:2804] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:03.304885  4626 tablet_service.cc:1511] Processing CreateTablet for tablet b731fe02a6f4441e816628760bfdfb54 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:12:03.297823  4687 raft_consensus.cc:2804] T b6256e4aa07c45c78b2bbff56a852078 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:03.305979  4687 raft_consensus.cc:493] T b6256e4aa07c45c78b2bbff56a852078 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:03.306217  4626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b731fe02a6f4441e816628760bfdfb54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.306370  4687 raft_consensus.cc:3060] T b6256e4aa07c45c78b2bbff56a852078 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:03.307127  4692 leader_election.cc:290] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:03.316430  4404 tablet_service.cc:1511] Processing CreateTablet for tablet b731fe02a6f4441e816628760bfdfb54 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
W20260709 13:12:03.312414  4380 leader_election.cc:343] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:03.319693  4380 leader_election.cc:343] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:03.314061  4489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e466269360c4a538e16c342590490c0" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:03.320758  4404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b731fe02a6f4441e816628760bfdfb54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.326578  4685 ts_tablet_manager.cc:1434] T acbf3f88b4514948820691784cf9c189 P aa0ff974118b465eaa785b8a86057e87: Time spent starting tablet: real 0.074s	user 0.007s	sys 0.000s
I20260709 13:12:03.311794  4691 raft_consensus.cc:515] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:03.327877  4401 tablet_service.cc:1511] Processing CreateTablet for tablet 60d704077649426ab65d89dd9ff778d0 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:12:03.328662  4627 tablet_service.cc:1511] Processing CreateTablet for tablet be5e478344f14439b78f1a9bf58f4451 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:12:03.329187  4691 leader_election.cc:290] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 election: Requested vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:03.329779  4691 raft_consensus.cc:493] T 93ff75cd7d2c433ca9aa8f6390884032 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.329955  4627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be5e478344f14439b78f1a9bf58f4451. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.330210  4691 raft_consensus.cc:515] T 93ff75cd7d2c433ca9aa8f6390884032 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:03.331339  4681 tablet_bootstrap.cc:492] T 81197f2dcf424fbaaab746d5f8bf7c8c P 74758684df5649ccadd1e189eaff32dc: No bootstrap required, opened a new log
I20260709 13:12:03.331841  4681 ts_tablet_manager.cc:1403] T 81197f2dcf424fbaaab746d5f8bf7c8c P 74758684df5649ccadd1e189eaff32dc: Time spent bootstrapping tablet: real 0.182s	user 0.008s	sys 0.014s
W20260709 13:12:03.332448  4529 leader_election.cc:343] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:03.333313  4413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5fe6d7057c412e8414f2a8eadf7f44" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770"
I20260709 13:12:03.333889  4413 raft_consensus.cc:3060] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:03.333925  4552 tablet_service.cc:1511] Processing CreateTablet for tablet be5e478344f14439b78f1a9bf58f4451 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:12:03.334446  4685 tablet_bootstrap.cc:492] T 09294b866578436a827c27702d4b1d0b P aa0ff974118b465eaa785b8a86057e87: Bootstrap starting.
I20260709 13:12:03.327095  4475 tablet_service.cc:1511] Processing CreateTablet for tablet 60d704077649426ab65d89dd9ff778d0 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:12:03.335945  4552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be5e478344f14439b78f1a9bf58f4451. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.329131  4401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60d704077649426ab65d89dd9ff778d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.336572  4489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93ff75cd7d2c433ca9aa8f6390884032" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:03.327916  4682 tablet_bootstrap.cc:492] T 5b827ee48d56478398f009c3fa980016 P 06ec58698d5444caaecea433c8419770: No bootstrap required, opened a new log
I20260709 13:12:03.337275  4414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6256e4aa07c45c78b2bbff56a852078" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:03.337533  4412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e466269360c4a538e16c342590490c0" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:03.340427  4687 raft_consensus.cc:515] T b6256e4aa07c45c78b2bbff56a852078 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
W20260709 13:12:03.342316  4603 leader_election.cc:343] T 93ff75cd7d2c433ca9aa8f6390884032 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:03.342694  4414 raft_consensus.cc:2393] T b6256e4aa07c45c78b2bbff56a852078 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 420a61707e804ce5b3773a91cc2eb424 in current term 1: Already voted for candidate 06ec58698d5444caaecea433c8419770 in this term.
I20260709 13:12:03.345151  4681 raft_consensus.cc:359] T 81197f2dcf424fbaaab746d5f8bf7c8c P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:03.345427  4529 leader_election.cc:304] T b6256e4aa07c45c78b2bbff56a852078 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424; no voters: 06ec58698d5444caaecea433c8419770, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:03.345976  4681 raft_consensus.cc:385] T 81197f2dcf424fbaaab746d5f8bf7c8c P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.347141  4681 raft_consensus.cc:740] T 81197f2dcf424fbaaab746d5f8bf7c8c P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.346627  4717 raft_consensus.cc:3060] T b6256e4aa07c45c78b2bbff56a852078 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:03.341485  4475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60d704077649426ab65d89dd9ff778d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.350864  4413 raft_consensus.cc:2468] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 1.
I20260709 13:12:03.352249  4603 leader_election.cc:304] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 74758684df5649ccadd1e189eaff32dc; no voters: 
I20260709 13:12:03.356931  4548 tablet_service.cc:1511] Processing CreateTablet for tablet d088694ef66442bdbf75cc7fc1942a83 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:12:03.358259  4548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d088694ef66442bdbf75cc7fc1942a83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.359052  4470 tablet_service.cc:1511] Processing CreateTablet for tablet 98342133e28b47d8a388f9321d5fd796 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:12:03.360309  4470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98342133e28b47d8a388f9321d5fd796. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.341115  4682 ts_tablet_manager.cc:1403] T 5b827ee48d56478398f009c3fa980016 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.235s	user 0.016s	sys 0.004s
I20260709 13:12:03.365267  4399 tablet_service.cc:1511] Processing CreateTablet for tablet 98342133e28b47d8a388f9321d5fd796 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:12:03.366524  4399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98342133e28b47d8a388f9321d5fd796. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.369275  4626 tablet_service.cc:1511] Processing CreateTablet for tablet 98342133e28b47d8a388f9321d5fd796 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:12:03.370131  4626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98342133e28b47d8a388f9321d5fd796. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.370327  4551 tablet_service.cc:1511] Processing CreateTablet for tablet 60d704077649426ab65d89dd9ff778d0 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:12:03.341485  4691 leader_election.cc:290] T 93ff75cd7d2c433ca9aa8f6390884032 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:03.372025  4691 raft_consensus.cc:2804] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:03.372452  4691 raft_consensus.cc:697] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 74758684df5649ccadd1e189eaff32dc [term 1 LEADER]: Becoming Leader. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Running, Role: LEADER
I20260709 13:12:03.373302  4691 consensus_queue.cc:237] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 74758684df5649ccadd1e189eaff32dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:03.377281  4551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60d704077649426ab65d89dd9ff778d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.383834  4489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6256e4aa07c45c78b2bbff56a852078" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
W20260709 13:12:03.385263  4380 leader_election.cc:343] T b6256e4aa07c45c78b2bbff56a852078 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:03.388383  4683 ts_tablet_manager.cc:1434] T b6256e4aa07c45c78b2bbff56a852078 P 420a61707e804ce5b3773a91cc2eb424: Time spent starting tablet: real 0.233s	user 0.008s	sys 0.008s
I20260709 13:12:03.388566  4476 tablet_service.cc:1511] Processing CreateTablet for tablet be5e478344f14439b78f1a9bf58f4451 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:12:03.389930  4476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be5e478344f14439b78f1a9bf58f4451. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.389585  4681 consensus_queue.cc:260] T 81197f2dcf424fbaaab746d5f8bf7c8c P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:03.388918  4471 tablet_service.cc:1511] Processing CreateTablet for tablet 541b1e6cfdca4f609467169f4caf64ef (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:12:03.391296  4471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 541b1e6cfdca4f609467169f4caf64ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.391140  4413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980616077a8445ccbe984f63131e1b44" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:03.388900  4621 tablet_service.cc:1511] Processing CreateTablet for tablet d088694ef66442bdbf75cc7fc1942a83 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:12:03.392627  4621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d088694ef66442bdbf75cc7fc1942a83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.392117  4681 ts_tablet_manager.cc:1434] T 81197f2dcf424fbaaab746d5f8bf7c8c P 74758684df5649ccadd1e189eaff32dc: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.002s
W20260709 13:12:03.392517  4455 leader_election.cc:343] T 980616077a8445ccbe984f63131e1b44 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:03.396039  4455 leader_election.cc:304] T 980616077a8445ccbe984f63131e1b44 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa0ff974118b465eaa785b8a86057e87; no voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424
I20260709 13:12:03.396399  4682 raft_consensus.cc:359] T 5b827ee48d56478398f009c3fa980016 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:03.397164  4701 raft_consensus.cc:2749] T 980616077a8445ccbe984f63131e1b44 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:03.399888  4562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5fe6d7057c412e8414f2a8eadf7f44" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:03.401090  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5fe6d7057c412e8414f2a8eadf7f44" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:03.402387  4561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93ff75cd7d2c433ca9aa8f6390884032" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:03.403070  4561 raft_consensus.cc:2468] T 93ff75cd7d2c433ca9aa8f6390884032 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 0.
I20260709 13:12:03.403362  4682 raft_consensus.cc:385] T 5b827ee48d56478398f009c3fa980016 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.405725  4402 tablet_service.cc:1511] Processing CreateTablet for tablet d088694ef66442bdbf75cc7fc1942a83 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:12:03.406801  4402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d088694ef66442bdbf75cc7fc1942a83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.404914  4561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6256e4aa07c45c78b2bbff56a852078" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:03.409574  4602 leader_election.cc:304] T 93ff75cd7d2c433ca9aa8f6390884032 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc; no voters: aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:03.410516  4722 raft_consensus.cc:2804] T 93ff75cd7d2c433ca9aa8f6390884032 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:03.410887  4722 raft_consensus.cc:493] T 93ff75cd7d2c433ca9aa8f6390884032 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:03.411214  4722 raft_consensus.cc:3060] T 93ff75cd7d2c433ca9aa8f6390884032 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:03.412796  4717 raft_consensus.cc:2749] T b6256e4aa07c45c78b2bbff56a852078 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:03.416131  4685 tablet_bootstrap.cc:654] T 09294b866578436a827c27702d4b1d0b P aa0ff974118b465eaa785b8a86057e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.418625  4701 raft_consensus.cc:493] T acbf3f88b4514948820691784cf9c189 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.419123  4701 raft_consensus.cc:515] T acbf3f88b4514948820691784cf9c189 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:03.420020  4683 tablet_bootstrap.cc:492] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 420a61707e804ce5b3773a91cc2eb424: Bootstrap starting.
I20260709 13:12:03.421154  4701 leader_election.cc:290] T acbf3f88b4514948820691784cf9c189 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:03.393771  4681 tablet_bootstrap.cc:492] T acbf3f88b4514948820691784cf9c189 P 74758684df5649ccadd1e189eaff32dc: Bootstrap starting.
I20260709 13:12:03.436257  4413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acbf3f88b4514948820691784cf9c189" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:03.423295  4687 leader_election.cc:290] T b6256e4aa07c45c78b2bbff56a852078 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Requested vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:03.440253  4561 raft_consensus.cc:2468] T b6256e4aa07c45c78b2bbff56a852078 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 1.
I20260709 13:12:03.440982  4623 tablet_service.cc:1511] Processing CreateTablet for tablet 541b1e6cfdca4f609467169f4caf64ef (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:12:03.442399  4623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 541b1e6cfdca4f609467169f4caf64ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.443221  4379 leader_election.cc:304] T b6256e4aa07c45c78b2bbff56a852078 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:03.407176  4721 raft_consensus.cc:697] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 [term 1 LEADER]: Becoming Leader. State: Replica: 06ec58698d5444caaecea433c8419770, State: Running, Role: LEADER
W20260709 13:12:03.444865  4455 leader_election.cc:343] T acbf3f88b4514948820691784cf9c189 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:03.445050  4721 consensus_queue.cc:237] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:03.445667  4687 raft_consensus.cc:2804] T b6256e4aa07c45c78b2bbff56a852078 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:03.446169  4687 raft_consensus.cc:697] T b6256e4aa07c45c78b2bbff56a852078 P 06ec58698d5444caaecea433c8419770 [term 1 LEADER]: Becoming Leader. State: Replica: 06ec58698d5444caaecea433c8419770, State: Running, Role: LEADER
I20260709 13:12:03.446973  4687 consensus_queue.cc:237] T b6256e4aa07c45c78b2bbff56a852078 P 06ec58698d5444caaecea433c8419770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:03.447997  4549 tablet_service.cc:1511] Processing CreateTablet for tablet 541b1e6cfdca4f609467169f4caf64ef (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:12:03.423074  4682 raft_consensus.cc:740] T 5b827ee48d56478398f009c3fa980016 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.464063  4637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acbf3f88b4514948820691784cf9c189" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:03.465041  4549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 541b1e6cfdca4f609467169f4caf64ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.465853  4401 tablet_service.cc:1511] Processing CreateTablet for tablet 1c7e5d871d1c44a58c65d3f76bce55b0 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:12:03.466952  4401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c7e5d871d1c44a58c65d3f76bce55b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.419576  4722 raft_consensus.cc:515] T 93ff75cd7d2c433ca9aa8f6390884032 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:03.473289  4722 leader_election.cc:290] T 93ff75cd7d2c433ca9aa8f6390884032 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 election: Requested vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:03.474231  4682 consensus_queue.cc:260] T 5b827ee48d56478398f009c3fa980016 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:03.476087  4682 ts_tablet_manager.cc:1434] T 5b827ee48d56478398f009c3fa980016 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.113s	user 0.008s	sys 0.002s
I20260709 13:12:03.476042  4489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93ff75cd7d2c433ca9aa8f6390884032" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
W20260709 13:12:03.477607  4603 leader_election.cc:343] T 93ff75cd7d2c433ca9aa8f6390884032 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:03.480875  4310 catalog_manager.cc:5697] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 74758684df5649ccadd1e189eaff32dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 74758684df5649ccadd1e189eaff32dc (127.28.173.4). New cstate: current_term: 1 leader_uuid: "74758684df5649ccadd1e189eaff32dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:03.483151  4682 tablet_bootstrap.cc:492] T 81197f2dcf424fbaaab746d5f8bf7c8c P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
W20260709 13:12:03.471454  4602 leader_election.cc:343] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:03.500226  4455 leader_election.cc:343] T acbf3f88b4514948820691784cf9c189 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:03.500682  4455 leader_election.cc:304] T acbf3f88b4514948820691784cf9c189 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa0ff974118b465eaa785b8a86057e87; no voters: 06ec58698d5444caaecea433c8419770, 74758684df5649ccadd1e189eaff32dc
I20260709 13:12:03.501863  4701 raft_consensus.cc:2749] T acbf3f88b4514948820691784cf9c189 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:03.501915  4626 tablet_service.cc:1511] Processing CreateTablet for tablet e50b6f5a42a24867ab5f90ad6d97401e (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:12:03.503098  4626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e50b6f5a42a24867ab5f90ad6d97401e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.503424  4399 tablet_service.cc:1511] Processing CreateTablet for tablet e50b6f5a42a24867ab5f90ad6d97401e (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:12:03.504664  4399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e50b6f5a42a24867ab5f90ad6d97401e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.508186  4561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93ff75cd7d2c433ca9aa8f6390884032" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:03.508790  4561 raft_consensus.cc:3060] T 93ff75cd7d2c433ca9aa8f6390884032 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:03.514691  4681 tablet_bootstrap.cc:654] T acbf3f88b4514948820691784cf9c189 P 74758684df5649ccadd1e189eaff32dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.517868  4470 tablet_service.cc:1511] Processing CreateTablet for tablet 1c7e5d871d1c44a58c65d3f76bce55b0 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:12:03.518616  4683 tablet_bootstrap.cc:654] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 420a61707e804ce5b3773a91cc2eb424: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.521093  4561 raft_consensus.cc:2468] T 93ff75cd7d2c433ca9aa8f6390884032 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 1.
I20260709 13:12:03.522323  4602 leader_election.cc:304] T 93ff75cd7d2c433ca9aa8f6390884032 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc; no voters: aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:03.523132  4722 raft_consensus.cc:2804] T 93ff75cd7d2c433ca9aa8f6390884032 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:03.523597  4722 raft_consensus.cc:697] T 93ff75cd7d2c433ca9aa8f6390884032 P 74758684df5649ccadd1e189eaff32dc [term 1 LEADER]: Becoming Leader. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Running, Role: LEADER
I20260709 13:12:03.524165  4470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c7e5d871d1c44a58c65d3f76bce55b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.537475  4682 tablet_bootstrap.cc:654] T 81197f2dcf424fbaaab746d5f8bf7c8c P 06ec58698d5444caaecea433c8419770: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.537865  4475 tablet_service.cc:1511] Processing CreateTablet for tablet e50b6f5a42a24867ab5f90ad6d97401e (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:12:03.538905  4722 consensus_queue.cc:237] T 93ff75cd7d2c433ca9aa8f6390884032 P 74758684df5649ccadd1e189eaff32dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:03.539647  4475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e50b6f5a42a24867ab5f90ad6d97401e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.544080  4551 tablet_service.cc:1511] Processing CreateTablet for tablet 812a1b53a40e469c89b5f2aba8c59780 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:12:03.545874  4551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 812a1b53a40e469c89b5f2aba8c59780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.550444  4626 tablet_service.cc:1511] Processing CreateTablet for tablet 812a1b53a40e469c89b5f2aba8c59780 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:12:03.551301  4626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 812a1b53a40e469c89b5f2aba8c59780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.562088  4549 tablet_service.cc:1511] Processing CreateTablet for tablet 82d5a41b86eb4457a114692137ced092 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:12:03.563647  4549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82d5a41b86eb4457a114692137ced092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.564270  4548 tablet_service.cc:1511] Processing CreateTablet for tablet 1c7e5d871d1c44a58c65d3f76bce55b0 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:12:03.572655  4548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c7e5d871d1c44a58c65d3f76bce55b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.574631  4529 leader_election.cc:304] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424; no voters: 06ec58698d5444caaecea433c8419770, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:03.575799  4717 raft_consensus.cc:2749] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:03.577679  4401 tablet_service.cc:1511] Processing CreateTablet for tablet 812a1b53a40e469c89b5f2aba8c59780 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:12:03.578647  4401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 812a1b53a40e469c89b5f2aba8c59780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.589181  4683 tablet_bootstrap.cc:492] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 420a61707e804ce5b3773a91cc2eb424: No bootstrap required, opened a new log
I20260709 13:12:03.589152  4471 tablet_service.cc:1511] Processing CreateTablet for tablet 82d5a41b86eb4457a114692137ced092 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:12:03.596499  4471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82d5a41b86eb4457a114692137ced092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.598850  4621 tablet_service.cc:1511] Processing CreateTablet for tablet 82d5a41b86eb4457a114692137ced092 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:12:03.595407  4683 ts_tablet_manager.cc:1403] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 420a61707e804ce5b3773a91cc2eb424: Time spent bootstrapping tablet: real 0.206s	user 0.012s	sys 0.002s
I20260709 13:12:03.605273  4621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82d5a41b86eb4457a114692137ced092. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.605140  4402 tablet_service.cc:1511] Processing CreateTablet for tablet 47d66fc2153d419082eccd7e30643d56 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:12:03.606295  4402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47d66fc2153d419082eccd7e30643d56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.619685  4682 tablet_bootstrap.cc:492] T 81197f2dcf424fbaaab746d5f8bf7c8c P 06ec58698d5444caaecea433c8419770: No bootstrap required, opened a new log
I20260709 13:12:03.620347  4682 ts_tablet_manager.cc:1403] T 81197f2dcf424fbaaab746d5f8bf7c8c P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.137s	user 0.014s	sys 0.019s
W20260709 13:12:03.621099  4725 log.cc:927] Time spent T b6256e4aa07c45c78b2bbff56a852078 P 06ec58698d5444caaecea433c8419770: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:12:03.615760  4685 tablet_bootstrap.cc:492] T 09294b866578436a827c27702d4b1d0b P aa0ff974118b465eaa785b8a86057e87: No bootstrap required, opened a new log
I20260709 13:12:03.624423  4685 ts_tablet_manager.cc:1403] T 09294b866578436a827c27702d4b1d0b P aa0ff974118b465eaa785b8a86057e87: Time spent bootstrapping tablet: real 0.290s	user 0.027s	sys 0.009s
I20260709 13:12:03.632278  4549 tablet_service.cc:1511] Processing CreateTablet for tablet 47d66fc2153d419082eccd7e30643d56 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:12:03.633448  4549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47d66fc2153d419082eccd7e30643d56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.625694  4471 tablet_service.cc:1511] Processing CreateTablet for tablet 47d66fc2153d419082eccd7e30643d56 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:12:03.635123  4683 raft_consensus.cc:359] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:03.635845  4623 tablet_service.cc:1511] Processing CreateTablet for tablet d8033bfb7f5d423d90d60318c67df709 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:12:03.637107  4623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8033bfb7f5d423d90d60318c67df709. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.637619  4685 raft_consensus.cc:359] T 09294b866578436a827c27702d4b1d0b P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:03.638357  4685 raft_consensus.cc:385] T 09294b866578436a827c27702d4b1d0b P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.638644  4685 raft_consensus.cc:740] T 09294b866578436a827c27702d4b1d0b P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.639865  4683 raft_consensus.cc:385] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.640321  4683 raft_consensus.cc:740] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.633596  4311 catalog_manager.cc:5697] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06ec58698d5444caaecea433c8419770 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "06ec58698d5444caaecea433c8419770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:03.643795  4683 consensus_queue.cc:260] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:03.623796  4682 raft_consensus.cc:359] T 81197f2dcf424fbaaab746d5f8bf7c8c P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:03.650878  4681 tablet_bootstrap.cc:492] T acbf3f88b4514948820691784cf9c189 P 74758684df5649ccadd1e189eaff32dc: No bootstrap required, opened a new log
I20260709 13:12:03.648738  4682 raft_consensus.cc:385] T 81197f2dcf424fbaaab746d5f8bf7c8c P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.639345  4685 consensus_queue.cc:260] T 09294b866578436a827c27702d4b1d0b P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:03.652384  4683 ts_tablet_manager.cc:1434] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 420a61707e804ce5b3773a91cc2eb424: Time spent starting tablet: real 0.052s	user 0.001s	sys 0.007s
I20260709 13:12:03.653612  4682 raft_consensus.cc:740] T 81197f2dcf424fbaaab746d5f8bf7c8c P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.655473  4681 ts_tablet_manager.cc:1403] T acbf3f88b4514948820691784cf9c189 P 74758684df5649ccadd1e189eaff32dc: Time spent bootstrapping tablet: real 0.261s	user 0.015s	sys 0.031s
I20260709 13:12:03.654743  4471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47d66fc2153d419082eccd7e30643d56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.656160  4683 tablet_bootstrap.cc:492] T 81197f2dcf424fbaaab746d5f8bf7c8c P 420a61707e804ce5b3773a91cc2eb424: Bootstrap starting.
I20260709 13:12:03.657135  4626 tablet_service.cc:1511] Processing CreateTablet for tablet 9d2ef12cc13544f2960d7c1b8bef6eb7 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:12:03.657543  4402 tablet_service.cc:1511] Processing CreateTablet for tablet d8033bfb7f5d423d90d60318c67df709 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:12:03.658280  4626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d2ef12cc13544f2960d7c1b8bef6eb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.658630  4402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8033bfb7f5d423d90d60318c67df709. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.659983  4682 consensus_queue.cc:260] T 81197f2dcf424fbaaab746d5f8bf7c8c P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:03.664811  4548 tablet_service.cc:1511] Processing CreateTablet for tablet 9d2ef12cc13544f2960d7c1b8bef6eb7 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:12:03.666010  4682 ts_tablet_manager.cc:1434] T 81197f2dcf424fbaaab746d5f8bf7c8c P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260709 13:12:03.666921  4685 ts_tablet_manager.cc:1434] T 09294b866578436a827c27702d4b1d0b P aa0ff974118b465eaa785b8a86057e87: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 13:12:03.666066  4548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d2ef12cc13544f2960d7c1b8bef6eb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.667315  4682 tablet_bootstrap.cc:492] T acbf3f88b4514948820691784cf9c189 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:03.680629  4401 tablet_service.cc:1511] Processing CreateTablet for tablet 9d2ef12cc13544f2960d7c1b8bef6eb7 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:12:03.681900  4401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d2ef12cc13544f2960d7c1b8bef6eb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.682614  4685 tablet_bootstrap.cc:492] T 93ff75cd7d2c433ca9aa8f6390884032 P aa0ff974118b465eaa785b8a86057e87: Bootstrap starting.
I20260709 13:12:03.685549  4470 tablet_service.cc:1511] Processing CreateTablet for tablet f1dfa63c8b78419c9ff6ffb624a861a7 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:12:03.683326  4475 tablet_service.cc:1511] Processing CreateTablet for tablet d8033bfb7f5d423d90d60318c67df709 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:12:03.670486  4681 raft_consensus.cc:359] T acbf3f88b4514948820691784cf9c189 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:03.688109  4470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1dfa63c8b78419c9ff6ffb624a861a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.691286  4475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8033bfb7f5d423d90d60318c67df709. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.691890  4681 raft_consensus.cc:385] T acbf3f88b4514948820691784cf9c189 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.692305  4681 raft_consensus.cc:740] T acbf3f88b4514948820691784cf9c189 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.693205  4626 tablet_service.cc:1511] Processing CreateTablet for tablet f1dfa63c8b78419c9ff6ffb624a861a7 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:12:03.693064  4681 consensus_queue.cc:260] T acbf3f88b4514948820691784cf9c189 P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:03.694267  4626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1dfa63c8b78419c9ff6ffb624a861a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.701769  4682 tablet_bootstrap.cc:654] T acbf3f88b4514948820691784cf9c189 P 06ec58698d5444caaecea433c8419770: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.695618  4681 ts_tablet_manager.cc:1434] T acbf3f88b4514948820691784cf9c189 P 74758684df5649ccadd1e189eaff32dc: Time spent starting tablet: real 0.040s	user 0.003s	sys 0.003s
I20260709 13:12:03.712762  4681 tablet_bootstrap.cc:492] T 69aed23cb12849fda6220c6c65580d59 P 74758684df5649ccadd1e189eaff32dc: Bootstrap starting.
I20260709 13:12:03.711694  4683 tablet_bootstrap.cc:654] T 81197f2dcf424fbaaab746d5f8bf7c8c P 420a61707e804ce5b3773a91cc2eb424: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.724750  4471 tablet_service.cc:1511] Processing CreateTablet for tablet 3d38413c5dce44db8a755b48adacc3a8 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:12:03.727885  4471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d38413c5dce44db8a755b48adacc3a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.728936  4311 catalog_manager.cc:5697] T b6256e4aa07c45c78b2bbff56a852078 P 06ec58698d5444caaecea433c8419770 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06ec58698d5444caaecea433c8419770 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "06ec58698d5444caaecea433c8419770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:03.725136  4402 tablet_service.cc:1511] Processing CreateTablet for tablet 3d38413c5dce44db8a755b48adacc3a8 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:12:03.725816  4549 tablet_service.cc:1511] Processing CreateTablet for tablet f1dfa63c8b78419c9ff6ffb624a861a7 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:12:03.708032  4685 tablet_bootstrap.cc:654] T 93ff75cd7d2c433ca9aa8f6390884032 P aa0ff974118b465eaa785b8a86057e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.732609  4549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1dfa63c8b78419c9ff6ffb624a861a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.736488  4402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d38413c5dce44db8a755b48adacc3a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.741014  4626 tablet_service.cc:1511] Processing CreateTablet for tablet 0dc4f903fb004dd2bce3c4934f078a5d (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:12:03.741549  4401 tablet_service.cc:1511] Processing CreateTablet for tablet 0dc4f903fb004dd2bce3c4934f078a5d (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:12:03.742121  4626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dc4f903fb004dd2bce3c4934f078a5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.742615  4401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dc4f903fb004dd2bce3c4934f078a5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.744743  4309 catalog_manager.cc:5697] T 93ff75cd7d2c433ca9aa8f6390884032 P 74758684df5649ccadd1e189eaff32dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 74758684df5649ccadd1e189eaff32dc (127.28.173.4). New cstate: current_term: 1 leader_uuid: "74758684df5649ccadd1e189eaff32dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:03.750715  4470 tablet_service.cc:1511] Processing CreateTablet for tablet 0dc4f903fb004dd2bce3c4934f078a5d (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:12:03.751995  4470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dc4f903fb004dd2bce3c4934f078a5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.763263  4682 tablet_bootstrap.cc:492] T acbf3f88b4514948820691784cf9c189 P 06ec58698d5444caaecea433c8419770: No bootstrap required, opened a new log
I20260709 13:12:03.763775  4682 ts_tablet_manager.cc:1403] T acbf3f88b4514948820691784cf9c189 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.097s	user 0.009s	sys 0.001s
I20260709 13:12:03.765432  4722 raft_consensus.cc:493] T 81197f2dcf424fbaaab746d5f8bf7c8c P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.765923  4722 raft_consensus.cc:515] T 81197f2dcf424fbaaab746d5f8bf7c8c P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:03.766685  4682 raft_consensus.cc:359] T acbf3f88b4514948820691784cf9c189 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:03.767369  4682 raft_consensus.cc:385] T acbf3f88b4514948820691784cf9c189 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.767657  4682 raft_consensus.cc:740] T acbf3f88b4514948820691784cf9c189 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.767901  4722 leader_election.cc:290] T 81197f2dcf424fbaaab746d5f8bf7c8c P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:03.769440  4561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81197f2dcf424fbaaab746d5f8bf7c8c" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:03.770167  4412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81197f2dcf424fbaaab746d5f8bf7c8c" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:03.770783  4412 raft_consensus.cc:2468] T 81197f2dcf424fbaaab746d5f8bf7c8c P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 0.
I20260709 13:12:03.770681  4548 tablet_service.cc:1511] Processing CreateTablet for tablet 3d38413c5dce44db8a755b48adacc3a8 (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:12:03.771714  4551 tablet_service.cc:1511] Processing CreateTablet for tablet 3f696298fcc049c08b47cd54f901be0c (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:12:03.772042  4548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d38413c5dce44db8a755b48adacc3a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.772163  4603 leader_election.cc:304] T 81197f2dcf424fbaaab746d5f8bf7c8c P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 74758684df5649ccadd1e189eaff32dc; no voters: 
I20260709 13:12:03.772821  4551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f696298fcc049c08b47cd54f901be0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.773120  4722 raft_consensus.cc:2804] T 81197f2dcf424fbaaab746d5f8bf7c8c P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:03.773511  4722 raft_consensus.cc:493] T 81197f2dcf424fbaaab746d5f8bf7c8c P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:03.773859  4722 raft_consensus.cc:3060] T 81197f2dcf424fbaaab746d5f8bf7c8c P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:03.776825  4623 tablet_service.cc:1511] Processing CreateTablet for tablet 3f696298fcc049c08b47cd54f901be0c (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:12:03.778049  4623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f696298fcc049c08b47cd54f901be0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.779213  4681 tablet_bootstrap.cc:654] T 69aed23cb12849fda6220c6c65580d59 P 74758684df5649ccadd1e189eaff32dc: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:03.780040  4602 leader_election.cc:343] T 81197f2dcf424fbaaab746d5f8bf7c8c P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:03.783413  4399 tablet_service.cc:1511] Processing CreateTablet for tablet 3f696298fcc049c08b47cd54f901be0c (DEFAULT_TABLE table=test-workload [id=3d043c9e46dd4d0ca7295a3f97cbe004]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:12:03.784629  4399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f696298fcc049c08b47cd54f901be0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:03.793835  4685 tablet_bootstrap.cc:492] T 93ff75cd7d2c433ca9aa8f6390884032 P aa0ff974118b465eaa785b8a86057e87: No bootstrap required, opened a new log
I20260709 13:12:03.794373  4685 ts_tablet_manager.cc:1403] T 93ff75cd7d2c433ca9aa8f6390884032 P aa0ff974118b465eaa785b8a86057e87: Time spent bootstrapping tablet: real 0.112s	user 0.016s	sys 0.016s
I20260709 13:12:03.797371  4685 raft_consensus.cc:359] T 93ff75cd7d2c433ca9aa8f6390884032 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:03.798056  4685 raft_consensus.cc:385] T 93ff75cd7d2c433ca9aa8f6390884032 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.798333  4685 raft_consensus.cc:740] T 93ff75cd7d2c433ca9aa8f6390884032 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.801968  4682 consensus_queue.cc:260] T acbf3f88b4514948820691784cf9c189 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:03.805034  4683 tablet_bootstrap.cc:492] T 81197f2dcf424fbaaab746d5f8bf7c8c P 420a61707e804ce5b3773a91cc2eb424: No bootstrap required, opened a new log
I20260709 13:12:03.805653  4683 ts_tablet_manager.cc:1403] T 81197f2dcf424fbaaab746d5f8bf7c8c P 420a61707e804ce5b3773a91cc2eb424: Time spent bootstrapping tablet: real 0.150s	user 0.010s	sys 0.003s
I20260709 13:12:03.806990  4682 ts_tablet_manager.cc:1434] T acbf3f88b4514948820691784cf9c189 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.043s	user 0.004s	sys 0.002s
I20260709 13:12:03.808110  4722 raft_consensus.cc:515] T 81197f2dcf424fbaaab746d5f8bf7c8c P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:03.811329  4561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81197f2dcf424fbaaab746d5f8bf7c8c" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:03.812126  4683 raft_consensus.cc:359] T 81197f2dcf424fbaaab746d5f8bf7c8c P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:03.812819  4683 raft_consensus.cc:385] T 81197f2dcf424fbaaab746d5f8bf7c8c P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:12:03.812801  4602 leader_election.cc:343] T 81197f2dcf424fbaaab746d5f8bf7c8c P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:03.813525  4717 raft_consensus.cc:493] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.813539  4683 raft_consensus.cc:740] T 81197f2dcf424fbaaab746d5f8bf7c8c P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.814047  4717 raft_consensus.cc:515] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:03.814779  4682 tablet_bootstrap.cc:492] T 09294b866578436a827c27702d4b1d0b P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:03.816169  4717 leader_election.cc:290] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:03.817296  4637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5fe6d7057c412e8414f2a8eadf7f44" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:03.820128  4412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a5fe6d7057c412e8414f2a8eadf7f44" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:03.820917  4412 raft_consensus.cc:2393] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 420a61707e804ce5b3773a91cc2eb424 in current term 1: Already voted for candidate 74758684df5649ccadd1e189eaff32dc in this term.
I20260709 13:12:03.821326  4682 tablet_bootstrap.cc:654] T 09294b866578436a827c27702d4b1d0b P 06ec58698d5444caaecea433c8419770: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.821395  4722 leader_election.cc:290] T 81197f2dcf424fbaaab746d5f8bf7c8c P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 election: Requested vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:03.799024  4685 consensus_queue.cc:260] T 93ff75cd7d2c433ca9aa8f6390884032 P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:03.822964  4529 leader_election.cc:304] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424; no voters: 06ec58698d5444caaecea433c8419770, 74758684df5649ccadd1e189eaff32dc
I20260709 13:12:03.823239  4412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81197f2dcf424fbaaab746d5f8bf7c8c" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770"
I20260709 13:12:03.823884  4412 raft_consensus.cc:3060] T 81197f2dcf424fbaaab746d5f8bf7c8c P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:03.824514  4685 ts_tablet_manager.cc:1434] T 93ff75cd7d2c433ca9aa8f6390884032 P aa0ff974118b465eaa785b8a86057e87: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.002s
I20260709 13:12:03.825335  4681 tablet_bootstrap.cc:492] T 69aed23cb12849fda6220c6c65580d59 P 74758684df5649ccadd1e189eaff32dc: No bootstrap required, opened a new log
I20260709 13:12:03.825903  4681 ts_tablet_manager.cc:1403] T 69aed23cb12849fda6220c6c65580d59 P 74758684df5649ccadd1e189eaff32dc: Time spent bootstrapping tablet: real 0.113s	user 0.012s	sys 0.000s
I20260709 13:12:03.826363  4685 tablet_bootstrap.cc:492] T ea0b275f64bf42cc88bbee81a24d3020 P aa0ff974118b465eaa785b8a86057e87: Bootstrap starting.
I20260709 13:12:03.829875  4717 raft_consensus.cc:3060] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:03.829173  4681 raft_consensus.cc:359] T 69aed23cb12849fda6220c6c65580d59 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:03.833935  4681 raft_consensus.cc:385] T 69aed23cb12849fda6220c6c65580d59 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.834321  4681 raft_consensus.cc:740] T 69aed23cb12849fda6220c6c65580d59 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.841056  4681 consensus_queue.cc:260] T 69aed23cb12849fda6220c6c65580d59 P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:03.841734  4685 tablet_bootstrap.cc:654] T ea0b275f64bf42cc88bbee81a24d3020 P aa0ff974118b465eaa785b8a86057e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.843712  4681 ts_tablet_manager.cc:1434] T 69aed23cb12849fda6220c6c65580d59 P 74758684df5649ccadd1e189eaff32dc: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.007s
I20260709 13:12:03.844776  4681 tablet_bootstrap.cc:492] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc: Bootstrap starting.
I20260709 13:12:03.846217  4717 raft_consensus.cc:2749] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:03.814554  4683 consensus_queue.cc:260] T 81197f2dcf424fbaaab746d5f8bf7c8c P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:03.851255  4681 tablet_bootstrap.cc:654] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.855353  4683 ts_tablet_manager.cc:1434] T 81197f2dcf424fbaaab746d5f8bf7c8c P 420a61707e804ce5b3773a91cc2eb424: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.002s
I20260709 13:12:03.856702  4683 tablet_bootstrap.cc:492] T 980616077a8445ccbe984f63131e1b44 P 420a61707e804ce5b3773a91cc2eb424: Bootstrap starting.
I20260709 13:12:03.860473  4685 tablet_bootstrap.cc:492] T ea0b275f64bf42cc88bbee81a24d3020 P aa0ff974118b465eaa785b8a86057e87: No bootstrap required, opened a new log
I20260709 13:12:03.860968  4685 ts_tablet_manager.cc:1403] T ea0b275f64bf42cc88bbee81a24d3020 P aa0ff974118b465eaa785b8a86057e87: Time spent bootstrapping tablet: real 0.035s	user 0.018s	sys 0.002s
I20260709 13:12:03.863286  4681 tablet_bootstrap.cc:492] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc: No bootstrap required, opened a new log
I20260709 13:12:03.863843  4681 ts_tablet_manager.cc:1403] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.010s
I20260709 13:12:03.867770  4681 raft_consensus.cc:359] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:03.868535  4681 raft_consensus.cc:385] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.863965  4685 raft_consensus.cc:359] T ea0b275f64bf42cc88bbee81a24d3020 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:03.868912  4681 raft_consensus.cc:740] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.869072  4685 raft_consensus.cc:385] T ea0b275f64bf42cc88bbee81a24d3020 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.869964  4685 raft_consensus.cc:740] T ea0b275f64bf42cc88bbee81a24d3020 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.869831  4683 tablet_bootstrap.cc:654] T 980616077a8445ccbe984f63131e1b44 P 420a61707e804ce5b3773a91cc2eb424: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.870033  4681 consensus_queue.cc:260] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:03.872037  4701 raft_consensus.cc:493] T 09294b866578436a827c27702d4b1d0b P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.872520  4701 raft_consensus.cc:515] T 09294b866578436a827c27702d4b1d0b P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:03.873220  4681 ts_tablet_manager.cc:1434] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:12:03.874505  4701 leader_election.cc:290] T 09294b866578436a827c27702d4b1d0b P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:03.874518  4681 tablet_bootstrap.cc:492] T ea0b275f64bf42cc88bbee81a24d3020 P 74758684df5649ccadd1e189eaff32dc: Bootstrap starting.
I20260709 13:12:03.876806  4413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09294b866578436a827c27702d4b1d0b" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:03.871066  4685 consensus_queue.cc:260] T ea0b275f64bf42cc88bbee81a24d3020 P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:03.877902  4683 tablet_bootstrap.cc:492] T 980616077a8445ccbe984f63131e1b44 P 420a61707e804ce5b3773a91cc2eb424: No bootstrap required, opened a new log
I20260709 13:12:03.878122  4637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09294b866578436a827c27702d4b1d0b" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:03.878480  4683 ts_tablet_manager.cc:1403] T 980616077a8445ccbe984f63131e1b44 P 420a61707e804ce5b3773a91cc2eb424: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.001s
I20260709 13:12:03.879556  4685 ts_tablet_manager.cc:1434] T ea0b275f64bf42cc88bbee81a24d3020 P aa0ff974118b465eaa785b8a86057e87: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
W20260709 13:12:03.879774  4455 leader_election.cc:343] T 09294b866578436a827c27702d4b1d0b P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:03.880585  4685 tablet_bootstrap.cc:492] T 5b827ee48d56478398f009c3fa980016 P aa0ff974118b465eaa785b8a86057e87: Bootstrap starting.
W20260709 13:12:03.880601  4455 leader_election.cc:343] T 09294b866578436a827c27702d4b1d0b P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:03.881253  4455 leader_election.cc:304] T 09294b866578436a827c27702d4b1d0b P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa0ff974118b465eaa785b8a86057e87; no voters: 06ec58698d5444caaecea433c8419770, 74758684df5649ccadd1e189eaff32dc
I20260709 13:12:03.882406  4701 raft_consensus.cc:2749] T 09294b866578436a827c27702d4b1d0b P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:03.882997  4681 tablet_bootstrap.cc:654] T ea0b275f64bf42cc88bbee81a24d3020 P 74758684df5649ccadd1e189eaff32dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.882336  4683 raft_consensus.cc:359] T 980616077a8445ccbe984f63131e1b44 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:03.883754  4683 raft_consensus.cc:385] T 980616077a8445ccbe984f63131e1b44 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.884260  4683 raft_consensus.cc:740] T 980616077a8445ccbe984f63131e1b44 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.885440  4683 consensus_queue.cc:260] T 980616077a8445ccbe984f63131e1b44 P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:03.888779  4683 ts_tablet_manager.cc:1434] T 980616077a8445ccbe984f63131e1b44 P 420a61707e804ce5b3773a91cc2eb424: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:12:03.889803  4412 raft_consensus.cc:2468] T 81197f2dcf424fbaaab746d5f8bf7c8c P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 1.
I20260709 13:12:03.895654  4683 tablet_bootstrap.cc:492] T 69aed23cb12849fda6220c6c65580d59 P 420a61707e804ce5b3773a91cc2eb424: Bootstrap starting.
I20260709 13:12:03.895449  4603 leader_election.cc:304] T 81197f2dcf424fbaaab746d5f8bf7c8c P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 74758684df5649ccadd1e189eaff32dc; no voters: 420a61707e804ce5b3773a91cc2eb424
I20260709 13:12:03.896728  4685 tablet_bootstrap.cc:654] T 5b827ee48d56478398f009c3fa980016 P aa0ff974118b465eaa785b8a86057e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.896910  4722 raft_consensus.cc:2804] T 81197f2dcf424fbaaab746d5f8bf7c8c P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:03.897480  4722 raft_consensus.cc:697] T 81197f2dcf424fbaaab746d5f8bf7c8c P 74758684df5649ccadd1e189eaff32dc [term 1 LEADER]: Becoming Leader. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Running, Role: LEADER
I20260709 13:12:03.898011  4682 tablet_bootstrap.cc:492] T 09294b866578436a827c27702d4b1d0b P 06ec58698d5444caaecea433c8419770: No bootstrap required, opened a new log
I20260709 13:12:03.898535  4682 ts_tablet_manager.cc:1403] T 09294b866578436a827c27702d4b1d0b P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.091s	user 0.021s	sys 0.016s
I20260709 13:12:03.898339  4722 consensus_queue.cc:237] T 81197f2dcf424fbaaab746d5f8bf7c8c P 74758684df5649ccadd1e189eaff32dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:03.901690  4682 raft_consensus.cc:359] T 09294b866578436a827c27702d4b1d0b P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:03.902411  4682 raft_consensus.cc:385] T 09294b866578436a827c27702d4b1d0b P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.902699  4682 raft_consensus.cc:740] T 09294b866578436a827c27702d4b1d0b P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.904021  4683 tablet_bootstrap.cc:654] T 69aed23cb12849fda6220c6c65580d59 P 420a61707e804ce5b3773a91cc2eb424: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.905921  4682 consensus_queue.cc:260] T 09294b866578436a827c27702d4b1d0b P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:03.909286  4685 tablet_bootstrap.cc:492] T 5b827ee48d56478398f009c3fa980016 P aa0ff974118b465eaa785b8a86057e87: No bootstrap required, opened a new log
I20260709 13:12:03.909399  4691 consensus_queue.cc:1048] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 74758684df5649ccadd1e189eaff32dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:03.910310  4685 ts_tablet_manager.cc:1403] T 5b827ee48d56478398f009c3fa980016 P aa0ff974118b465eaa785b8a86057e87: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.003s
I20260709 13:12:03.909931  4682 ts_tablet_manager.cc:1434] T 09294b866578436a827c27702d4b1d0b P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 13:12:03.912746  4682 tablet_bootstrap.cc:492] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:03.914345  4685 raft_consensus.cc:359] T 5b827ee48d56478398f009c3fa980016 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:03.915130  4685 raft_consensus.cc:385] T 5b827ee48d56478398f009c3fa980016 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.915596  4685 raft_consensus.cc:740] T 5b827ee48d56478398f009c3fa980016 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.916769  4685 consensus_queue.cc:260] T 5b827ee48d56478398f009c3fa980016 P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:03.928676  4682 tablet_bootstrap.cc:654] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.929728  4685 ts_tablet_manager.cc:1434] T 5b827ee48d56478398f009c3fa980016 P aa0ff974118b465eaa785b8a86057e87: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:12:03.933264  4685 tablet_bootstrap.cc:492] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87: Bootstrap starting.
I20260709 13:12:03.936045  4683 tablet_bootstrap.cc:492] T 69aed23cb12849fda6220c6c65580d59 P 420a61707e804ce5b3773a91cc2eb424: No bootstrap required, opened a new log
I20260709 13:12:03.936607  4683 ts_tablet_manager.cc:1403] T 69aed23cb12849fda6220c6c65580d59 P 420a61707e804ce5b3773a91cc2eb424: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.022s
I20260709 13:12:03.938252  4721 raft_consensus.cc:493] T 5b827ee48d56478398f009c3fa980016 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.938899  4721 raft_consensus.cc:515] T 5b827ee48d56478398f009c3fa980016 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:03.941421  4721 leader_election.cc:290] T 5b827ee48d56478398f009c3fa980016 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:03.941524  4685 tablet_bootstrap.cc:654] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:03.943557  4637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b827ee48d56478398f009c3fa980016" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:03.944141  4701 raft_consensus.cc:493] T 93ff75cd7d2c433ca9aa8f6390884032 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.944386  4637 raft_consensus.cc:2468] T 5b827ee48d56478398f009c3fa980016 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 0.
I20260709 13:12:03.944803  4701 raft_consensus.cc:515] T 93ff75cd7d2c433ca9aa8f6390884032 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:03.947407  4701 leader_election.cc:290] T 93ff75cd7d2c433ca9aa8f6390884032 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:03.949347  4561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93ff75cd7d2c433ca9aa8f6390884032" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:03.950384  4561 raft_consensus.cc:2393] T 93ff75cd7d2c433ca9aa8f6390884032 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aa0ff974118b465eaa785b8a86057e87 in current term 1: Already voted for candidate 74758684df5649ccadd1e189eaff32dc in this term.
I20260709 13:12:03.952438  4380 leader_election.cc:304] T 5b827ee48d56478398f009c3fa980016 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 74758684df5649ccadd1e189eaff32dc; no voters: 
I20260709 13:12:03.954074  4489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b827ee48d56478398f009c3fa980016" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:03.954816  4489 raft_consensus.cc:2468] T 5b827ee48d56478398f009c3fa980016 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 0.
I20260709 13:12:03.956010  4721 raft_consensus.cc:2804] T 5b827ee48d56478398f009c3fa980016 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:03.956600  4721 raft_consensus.cc:493] T 5b827ee48d56478398f009c3fa980016 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:03.957121  4721 raft_consensus.cc:3060] T 5b827ee48d56478398f009c3fa980016 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:03.941432  4683 raft_consensus.cc:359] T 69aed23cb12849fda6220c6c65580d59 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:03.961609  4683 raft_consensus.cc:385] T 69aed23cb12849fda6220c6c65580d59 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.962801  4683 raft_consensus.cc:740] T 69aed23cb12849fda6220c6c65580d59 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.964382  4683 consensus_queue.cc:260] T 69aed23cb12849fda6220c6c65580d59 P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:03.969110  4683 ts_tablet_manager.cc:1434] T 69aed23cb12849fda6220c6c65580d59 P 420a61707e804ce5b3773a91cc2eb424: Time spent starting tablet: real 0.032s	user 0.000s	sys 0.006s
I20260709 13:12:03.960322  4685 tablet_bootstrap.cc:492] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87: No bootstrap required, opened a new log
I20260709 13:12:03.973472  4685 ts_tablet_manager.cc:1403] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.001s
I20260709 13:12:03.975618  4637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93ff75cd7d2c433ca9aa8f6390884032" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:03.976498  4685 raft_consensus.cc:359] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:03.980010  4455 leader_election.cc:304] T 93ff75cd7d2c433ca9aa8f6390884032 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa0ff974118b465eaa785b8a86057e87; no voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc
I20260709 13:12:03.980525  4687 consensus_queue.cc:1048] T b6256e4aa07c45c78b2bbff56a852078 P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:03.981175  4701 raft_consensus.cc:3060] T 93ff75cd7d2c433ca9aa8f6390884032 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:03.977520  4685 raft_consensus.cc:385] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:03.985333  4685 raft_consensus.cc:740] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Initialized, Role: FOLLOWER
I20260709 13:12:03.986632  4685 consensus_queue.cc:260] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:03.998203  4683 tablet_bootstrap.cc:492] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424: Bootstrap starting.
I20260709 13:12:03.999450  4701 raft_consensus.cc:2749] T 93ff75cd7d2c433ca9aa8f6390884032 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:12:04.000357  4380 consensus_peers.cc:597] T b6256e4aa07c45c78b2bbff56a852078 P 06ec58698d5444caaecea433c8419770 -> Peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Couldn't send request to peer aa0ff974118b465eaa785b8a86057e87. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:04.003139  4743 raft_consensus.cc:493] T 980616077a8445ccbe984f63131e1b44 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.003633  4743 raft_consensus.cc:515] T 980616077a8445ccbe984f63131e1b44 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:04.004590  4685 ts_tablet_manager.cc:1434] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.000s
I20260709 13:12:04.005631  4685 tablet_bootstrap.cc:492] T b6256e4aa07c45c78b2bbff56a852078 P aa0ff974118b465eaa785b8a86057e87: Bootstrap starting.
I20260709 13:12:04.005738  4743 leader_election.cc:290] T 980616077a8445ccbe984f63131e1b44 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:04.007727  4413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980616077a8445ccbe984f63131e1b44" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
W20260709 13:12:04.008993  4529 leader_election.cc:343] T 980616077a8445ccbe984f63131e1b44 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:04.013922  4489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980616077a8445ccbe984f63131e1b44" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:04.014619  4489 raft_consensus.cc:2468] T 980616077a8445ccbe984f63131e1b44 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 0.
I20260709 13:12:04.016105  4529 leader_election.cc:304] T 980616077a8445ccbe984f63131e1b44 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 06ec58698d5444caaecea433c8419770
I20260709 13:12:04.017139  4683 tablet_bootstrap.cc:654] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.017206  4743 raft_consensus.cc:2804] T 980616077a8445ccbe984f63131e1b44 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:04.017774  4743 raft_consensus.cc:493] T 980616077a8445ccbe984f63131e1b44 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:04.018131  4743 raft_consensus.cc:3060] T 980616077a8445ccbe984f63131e1b44 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.012701  4721 raft_consensus.cc:515] T 5b827ee48d56478398f009c3fa980016 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:04.032321  4691 raft_consensus.cc:493] T 69aed23cb12849fda6220c6c65580d59 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.032401  4489 raft_consensus.cc:3060] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.032964  4691 raft_consensus.cc:515] T 69aed23cb12849fda6220c6c65580d59 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:04.035086  4691 leader_election.cc:290] T 69aed23cb12849fda6220c6c65580d59 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:04.036855  4754 raft_consensus.cc:493] T acbf3f88b4514948820691784cf9c189 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.037508  4754 raft_consensus.cc:515] T acbf3f88b4514948820691784cf9c189 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:04.039410  4754 leader_election.cc:290] T acbf3f88b4514948820691784cf9c189 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:04.040078  4488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b827ee48d56478398f009c3fa980016" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:04.041204  4681 tablet_bootstrap.cc:492] T ea0b275f64bf42cc88bbee81a24d3020 P 74758684df5649ccadd1e189eaff32dc: No bootstrap required, opened a new log
I20260709 13:12:04.041704  4488 raft_consensus.cc:3060] T 5b827ee48d56478398f009c3fa980016 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.041942  4681 ts_tablet_manager.cc:1403] T ea0b275f64bf42cc88bbee81a24d3020 P 74758684df5649ccadd1e189eaff32dc: Time spent bootstrapping tablet: real 0.168s	user 0.040s	sys 0.033s
I20260709 13:12:04.043651  4682 tablet_bootstrap.cc:492] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770: No bootstrap required, opened a new log
I20260709 13:12:04.044314  4682 ts_tablet_manager.cc:1403] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.132s	user 0.017s	sys 0.038s
I20260709 13:12:04.046669  4681 raft_consensus.cc:359] T ea0b275f64bf42cc88bbee81a24d3020 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:04.047415  4681 raft_consensus.cc:385] T ea0b275f64bf42cc88bbee81a24d3020 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.046994  4682 raft_consensus.cc:359] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:04.048117  4681 raft_consensus.cc:740] T ea0b275f64bf42cc88bbee81a24d3020 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.048390  4682 raft_consensus.cc:385] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.048805  4682 raft_consensus.cc:740] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.057096  4488 raft_consensus.cc:2468] T 5b827ee48d56478398f009c3fa980016 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 1.
I20260709 13:12:04.058579  4681 consensus_queue.cc:260] T ea0b275f64bf42cc88bbee81a24d3020 P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:04.054602  4682 consensus_queue.cc:260] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:04.060527  4685 tablet_bootstrap.cc:654] T b6256e4aa07c45c78b2bbff56a852078 P aa0ff974118b465eaa785b8a86057e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.062170  4721 leader_election.cc:290] T 5b827ee48d56478398f009c3fa980016 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Requested vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:04.068606  4561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69aed23cb12849fda6220c6c65580d59" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:04.069295  4561 raft_consensus.cc:2468] T 69aed23cb12849fda6220c6c65580d59 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 0.
I20260709 13:12:04.077677  4743 raft_consensus.cc:515] T 980616077a8445ccbe984f63131e1b44 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:04.077896  4602 leader_election.cc:304] T 69aed23cb12849fda6220c6c65580d59 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc; no voters: 
I20260709 13:12:04.079418  4753 consensus_queue.cc:1048] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 74758684df5649ccadd1e189eaff32dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:04.083156  4681 ts_tablet_manager.cc:1434] T ea0b275f64bf42cc88bbee81a24d3020 P 74758684df5649ccadd1e189eaff32dc: Time spent starting tablet: real 0.039s	user 0.004s	sys 0.002s
I20260709 13:12:04.085561  4681 tablet_bootstrap.cc:492] T a4736bb71dfa4f4b8b80e8a52895acf7 P 74758684df5649ccadd1e189eaff32dc: Bootstrap starting.
I20260709 13:12:04.079883  4743 leader_election.cc:290] T 980616077a8445ccbe984f63131e1b44 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 election: Requested vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:04.082638  4488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980616077a8445ccbe984f63131e1b44" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:04.087976  4682 ts_tablet_manager.cc:1434] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.002s
I20260709 13:12:04.089958  4682 tablet_bootstrap.cc:492] T 980616077a8445ccbe984f63131e1b44 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:04.081372  4753 raft_consensus.cc:2804] T 69aed23cb12849fda6220c6c65580d59 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:04.094777  4488 raft_consensus.cc:3060] T 980616077a8445ccbe984f63131e1b44 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.101011  4753 raft_consensus.cc:493] T 69aed23cb12849fda6220c6c65580d59 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:04.089808  4687 consensus_queue.cc:1048] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:12:04.117558  4760 consensus_queue.cc:1048] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:12:04.114719  4753 raft_consensus.cc:3060] T 69aed23cb12849fda6220c6c65580d59 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.122416  4637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b827ee48d56478398f009c3fa980016" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:04.122566  4414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980616077a8445ccbe984f63131e1b44" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770"
I20260709 13:12:04.123070  4637 raft_consensus.cc:3060] T 5b827ee48d56478398f009c3fa980016 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.123391  4411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acbf3f88b4514948820691784cf9c189" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:04.123654  4685 tablet_bootstrap.cc:492] T b6256e4aa07c45c78b2bbff56a852078 P aa0ff974118b465eaa785b8a86057e87: No bootstrap required, opened a new log
I20260709 13:12:04.123091  4412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69aed23cb12849fda6220c6c65580d59" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:04.124068  4411 raft_consensus.cc:2468] T acbf3f88b4514948820691784cf9c189 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 0.
I20260709 13:12:04.124233  4685 ts_tablet_manager.cc:1403] T b6256e4aa07c45c78b2bbff56a852078 P aa0ff974118b465eaa785b8a86057e87: Time spent bootstrapping tablet: real 0.119s	user 0.015s	sys 0.011s
I20260709 13:12:04.127106  4685 raft_consensus.cc:359] T b6256e4aa07c45c78b2bbff56a852078 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:04.127734  4685 raft_consensus.cc:385] T b6256e4aa07c45c78b2bbff56a852078 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.128016  4685 raft_consensus.cc:740] T b6256e4aa07c45c78b2bbff56a852078 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Initialized, Role: FOLLOWER
W20260709 13:12:04.128111  4603 leader_election.cc:343] T 69aed23cb12849fda6220c6c65580d59 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:04.128825  4489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acbf3f88b4514948820691784cf9c189" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:04.129109  4603 leader_election.cc:304] T acbf3f88b4514948820691784cf9c189 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 74758684df5649ccadd1e189eaff32dc; no voters: 
I20260709 13:12:04.129483  4489 raft_consensus.cc:2468] T acbf3f88b4514948820691784cf9c189 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 0.
I20260709 13:12:04.130857  4758 raft_consensus.cc:2804] T acbf3f88b4514948820691784cf9c189 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:04.131295  4758 raft_consensus.cc:493] T acbf3f88b4514948820691784cf9c189 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:04.131651  4758 raft_consensus.cc:3060] T acbf3f88b4514948820691784cf9c189 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.131841  4761 consensus_queue.cc:1048] T 93ff75cd7d2c433ca9aa8f6390884032 P 74758684df5649ccadd1e189eaff32dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:12:04.129593  4685 consensus_queue.cc:260] T b6256e4aa07c45c78b2bbff56a852078 P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:04.136266  4701 raft_consensus.cc:493] T ea0b275f64bf42cc88bbee81a24d3020 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.135982  4685 ts_tablet_manager.cc:1434] T b6256e4aa07c45c78b2bbff56a852078 P aa0ff974118b465eaa785b8a86057e87: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:12:04.139464  4683 tablet_bootstrap.cc:492] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424: No bootstrap required, opened a new log
I20260709 13:12:04.136754  4701 raft_consensus.cc:515] T ea0b275f64bf42cc88bbee81a24d3020 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:04.139962  4683 ts_tablet_manager.cc:1403] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424: Time spent bootstrapping tablet: real 0.142s	user 0.020s	sys 0.019s
I20260709 13:12:04.140379  4685 tablet_bootstrap.cc:492] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87: Bootstrap starting.
I20260709 13:12:04.140655  4691 consensus_queue.cc:1048] T 93ff75cd7d2c433ca9aa8f6390884032 P 74758684df5649ccadd1e189eaff32dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:04.141371  4701 leader_election.cc:290] T ea0b275f64bf42cc88bbee81a24d3020 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:04.142688  4636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea0b275f64bf42cc88bbee81a24d3020" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:04.142788  4683 raft_consensus.cc:359] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:04.143523  4683 raft_consensus.cc:385] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.143441  4636 raft_consensus.cc:2468] T ea0b275f64bf42cc88bbee81a24d3020 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 0.
I20260709 13:12:04.152803  4310 catalog_manager.cc:5697] T 81197f2dcf424fbaaab746d5f8bf7c8c P 74758684df5649ccadd1e189eaff32dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 74758684df5649ccadd1e189eaff32dc (127.28.173.4). New cstate: current_term: 1 leader_uuid: "74758684df5649ccadd1e189eaff32dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:04.144289  4559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea0b275f64bf42cc88bbee81a24d3020" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:04.129577  4488 raft_consensus.cc:2468] T 980616077a8445ccbe984f63131e1b44 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 1.
I20260709 13:12:04.156739  4681 tablet_bootstrap.cc:654] T a4736bb71dfa4f4b8b80e8a52895acf7 P 74758684df5649ccadd1e189eaff32dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.160532  4455 leader_election.cc:304] T ea0b275f64bf42cc88bbee81a24d3020 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:04.161211  4758 raft_consensus.cc:515] T acbf3f88b4514948820691784cf9c189 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:04.162103  4682 tablet_bootstrap.cc:654] T 980616077a8445ccbe984f63131e1b44 P 06ec58698d5444caaecea433c8419770: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.163093  4637 raft_consensus.cc:2468] T 5b827ee48d56478398f009c3fa980016 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 1.
I20260709 13:12:04.163318  4758 leader_election.cc:290] T acbf3f88b4514948820691784cf9c189 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 election: Requested vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:04.159127  4683 raft_consensus.cc:740] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.170568  4529 leader_election.cc:304] T 980616077a8445ccbe984f63131e1b44 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:04.171348  4743 raft_consensus.cc:2804] T 980616077a8445ccbe984f63131e1b44 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:12:04.171650  4454 leader_election.cc:343] T ea0b275f64bf42cc88bbee81a24d3020 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:04.171823  4743 raft_consensus.cc:697] T 980616077a8445ccbe984f63131e1b44 P 420a61707e804ce5b3773a91cc2eb424 [term 1 LEADER]: Becoming Leader. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Running, Role: LEADER
I20260709 13:12:04.172056  4413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acbf3f88b4514948820691784cf9c189" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770"
I20260709 13:12:04.172665  4413 raft_consensus.cc:3060] T acbf3f88b4514948820691784cf9c189 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.172746  4743 consensus_queue.cc:237] T 980616077a8445ccbe984f63131e1b44 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:04.165295  4701 raft_consensus.cc:2804] T ea0b275f64bf42cc88bbee81a24d3020 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:04.175384  4701 raft_consensus.cc:493] T ea0b275f64bf42cc88bbee81a24d3020 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:04.175743  4701 raft_consensus.cc:3060] T ea0b275f64bf42cc88bbee81a24d3020 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.178094  4683 consensus_queue.cc:260] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:04.179291  4717 raft_consensus.cc:493] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.180371  4717 raft_consensus.cc:515] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:04.156013  4380 leader_election.cc:304] T 5b827ee48d56478398f009c3fa980016 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:04.182119  4721 raft_consensus.cc:2804] T 5b827ee48d56478398f009c3fa980016 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:04.182557  4717 leader_election.cc:290] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:04.182642  4721 raft_consensus.cc:697] T 5b827ee48d56478398f009c3fa980016 P 06ec58698d5444caaecea433c8419770 [term 1 LEADER]: Becoming Leader. State: Replica: 06ec58698d5444caaecea433c8419770, State: Running, Role: LEADER
I20260709 13:12:04.183586  4721 consensus_queue.cc:237] T 5b827ee48d56478398f009c3fa980016 P 06ec58698d5444caaecea433c8419770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:04.170385  4753 raft_consensus.cc:515] T 69aed23cb12849fda6220c6c65580d59 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:04.185322  4637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3501a75721d543d598af7857e368e08b" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:04.185977  4637 raft_consensus.cc:2468] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 0.
I20260709 13:12:04.187420  4757 raft_consensus.cc:493] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:04.186987  4380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:45987, user_credentials={real_user=slave}} blocked reactor thread for 49890.9us
I20260709 13:12:04.189205  4757 raft_consensus.cc:515] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:04.194191  4487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acbf3f88b4514948820691784cf9c189" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:04.194839  4487 raft_consensus.cc:3060] T acbf3f88b4514948820691784cf9c189 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.195096  4685 tablet_bootstrap.cc:654] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.206403  4412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e466269360c4a538e16c342590490c0" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:04.206635  4683 ts_tablet_manager.cc:1434] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424: Time spent starting tablet: real 0.066s	user 0.010s	sys 0.002s
I20260709 13:12:04.208739  4683 tablet_bootstrap.cc:492] T ea0b275f64bf42cc88bbee81a24d3020 P 420a61707e804ce5b3773a91cc2eb424: Bootstrap starting.
I20260709 13:12:04.196305  4529 leader_election.cc:304] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc; no voters: 
I20260709 13:12:04.209456  4411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3501a75721d543d598af7857e368e08b" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
W20260709 13:12:04.210613  4529 leader_election.cc:343] T 980616077a8445ccbe984f63131e1b44 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:04.211681  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69aed23cb12849fda6220c6c65580d59" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:04.212296  4563 raft_consensus.cc:3060] T 69aed23cb12849fda6220c6c65580d59 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.215945  4757 leader_election.cc:290] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:04.216969  4683 tablet_bootstrap.cc:654] T ea0b275f64bf42cc88bbee81a24d3020 P 420a61707e804ce5b3773a91cc2eb424: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.218690  4559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e466269360c4a538e16c342590490c0" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:04.220721  4743 raft_consensus.cc:2804] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:04.231233  4760 raft_consensus.cc:493] T 09294b866578436a827c27702d4b1d0b P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.231878  4760 raft_consensus.cc:515] T 09294b866578436a827c27702d4b1d0b P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:04.232684  4563 raft_consensus.cc:2468] T 69aed23cb12849fda6220c6c65580d59 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 1.
I20260709 13:12:04.234401  4760 leader_election.cc:290] T 09294b866578436a827c27702d4b1d0b P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
W20260709 13:12:04.227056  4529 leader_election.cc:343] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:04.236840  4637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09294b866578436a827c27702d4b1d0b" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:04.237454  4454 leader_election.cc:304] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa0ff974118b465eaa785b8a86057e87; no voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424
I20260709 13:12:04.238185  4486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09294b866578436a827c27702d4b1d0b" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:04.238817  4486 raft_consensus.cc:2468] T 09294b866578436a827c27702d4b1d0b P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 0.
I20260709 13:12:04.236796  4602 leader_election.cc:304] T 69aed23cb12849fda6220c6c65580d59 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc; no voters: 
I20260709 13:12:04.222541  4743 raft_consensus.cc:493] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:04.240124  4380 leader_election.cc:304] T 09294b866578436a827c27702d4b1d0b P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, aa0ff974118b465eaa785b8a86057e87; no voters: 
W20260709 13:12:04.257890  4380 leader_election.cc:343] T 09294b866578436a827c27702d4b1d0b P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:04.239827  4691 raft_consensus.cc:2804] T 69aed23cb12849fda6220c6c65580d59 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:04.259430  4691 raft_consensus.cc:697] T 69aed23cb12849fda6220c6c65580d59 P 74758684df5649ccadd1e189eaff32dc [term 1 LEADER]: Becoming Leader. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Running, Role: LEADER
I20260709 13:12:04.241360  4411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69aed23cb12849fda6220c6c65580d59" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770"
I20260709 13:12:04.260562  4691 consensus_queue.cc:237] T 69aed23cb12849fda6220c6c65580d59 P 74758684df5649ccadd1e189eaff32dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
W20260709 13:12:04.261281  4603 leader_election.cc:343] T 69aed23cb12849fda6220c6c65580d59 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:04.267297  4358 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:04.268091  4717 raft_consensus.cc:493] T 81197f2dcf424fbaaab746d5f8bf7c8c P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.268595  4717 raft_consensus.cc:515] T 81197f2dcf424fbaaab746d5f8bf7c8c P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:04.269518  4307 catalog_manager.cc:5697] T 5b827ee48d56478398f009c3fa980016 P 06ec58698d5444caaecea433c8419770 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06ec58698d5444caaecea433c8419770 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "06ec58698d5444caaecea433c8419770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:04.270746  4717 leader_election.cc:290] T 81197f2dcf424fbaaab746d5f8bf7c8c P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:04.272567  4637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81197f2dcf424fbaaab746d5f8bf7c8c" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:04.277906  4721 raft_consensus.cc:2804] T 09294b866578436a827c27702d4b1d0b P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:04.278699  4411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81197f2dcf424fbaaab746d5f8bf7c8c" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:04.279841  4411 raft_consensus.cc:2393] T 81197f2dcf424fbaaab746d5f8bf7c8c P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 420a61707e804ce5b3773a91cc2eb424 in current term 1: Already voted for candidate 74758684df5649ccadd1e189eaff32dc in this term.
I20260709 13:12:04.252625  4753 leader_election.cc:290] T 69aed23cb12849fda6220c6c65580d59 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 election: Requested vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:04.275887  4487 raft_consensus.cc:2468] T acbf3f88b4514948820691784cf9c189 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 1.
I20260709 13:12:04.239802  4701 raft_consensus.cc:515] T ea0b275f64bf42cc88bbee81a24d3020 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:04.252733  4413 raft_consensus.cc:2468] T acbf3f88b4514948820691784cf9c189 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 1.
I20260709 13:12:04.255910  4743 raft_consensus.cc:3060] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.288920  4560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea0b275f64bf42cc88bbee81a24d3020" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:04.289611  4683 tablet_bootstrap.cc:492] T ea0b275f64bf42cc88bbee81a24d3020 P 420a61707e804ce5b3773a91cc2eb424: No bootstrap required, opened a new log
I20260709 13:12:04.290177  4683 ts_tablet_manager.cc:1403] T ea0b275f64bf42cc88bbee81a24d3020 P 420a61707e804ce5b3773a91cc2eb424: Time spent bootstrapping tablet: real 0.082s	user 0.022s	sys 0.026s
W20260709 13:12:04.291242  4454 leader_election.cc:343] T ea0b275f64bf42cc88bbee81a24d3020 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:04.292879  4683 raft_consensus.cc:359] T ea0b275f64bf42cc88bbee81a24d3020 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:04.293555  4683 raft_consensus.cc:385] T ea0b275f64bf42cc88bbee81a24d3020 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.293849  4683 raft_consensus.cc:740] T ea0b275f64bf42cc88bbee81a24d3020 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.294543  4683 consensus_queue.cc:260] T ea0b275f64bf42cc88bbee81a24d3020 P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:04.296496  4683 ts_tablet_manager.cc:1434] T ea0b275f64bf42cc88bbee81a24d3020 P 420a61707e804ce5b3773a91cc2eb424: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:12:04.297406  4683 tablet_bootstrap.cc:492] T 39bf585adcc94606975982efe4640189 P 420a61707e804ce5b3773a91cc2eb424: Bootstrap starting.
I20260709 13:12:04.300235  4529 leader_election.cc:304] T 81197f2dcf424fbaaab746d5f8bf7c8c P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424; no voters: 06ec58698d5444caaecea433c8419770, 74758684df5649ccadd1e189eaff32dc
I20260709 13:12:04.301440  4603 leader_election.cc:304] T acbf3f88b4514948820691784cf9c189 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 74758684df5649ccadd1e189eaff32dc; no voters: 
I20260709 13:12:04.302268  4753 raft_consensus.cc:2804] T acbf3f88b4514948820691784cf9c189 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:04.302776  4753 raft_consensus.cc:697] T acbf3f88b4514948820691784cf9c189 P 74758684df5649ccadd1e189eaff32dc [term 1 LEADER]: Becoming Leader. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Running, Role: LEADER
I20260709 13:12:04.305132  4753 consensus_queue.cc:237] T acbf3f88b4514948820691784cf9c189 P 74758684df5649ccadd1e189eaff32dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:04.308012  4774 raft_consensus.cc:3060] T 81197f2dcf424fbaaab746d5f8bf7c8c P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.307739  4309 catalog_manager.cc:5697] T 69aed23cb12849fda6220c6c65580d59 P 74758684df5649ccadd1e189eaff32dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 74758684df5649ccadd1e189eaff32dc (127.28.173.4). New cstate: current_term: 1 leader_uuid: "74758684df5649ccadd1e189eaff32dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:04.311966  4775 raft_consensus.cc:2749] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:04.283172  4721 raft_consensus.cc:493] T 09294b866578436a827c27702d4b1d0b P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:04.321300  4774 raft_consensus.cc:2749] T 81197f2dcf424fbaaab746d5f8bf7c8c P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:04.316462  4721 raft_consensus.cc:3060] T 09294b866578436a827c27702d4b1d0b P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.323680  4683 tablet_bootstrap.cc:654] T 39bf585adcc94606975982efe4640189 P 420a61707e804ce5b3773a91cc2eb424: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.336987  4691 consensus_queue.cc:1048] T 81197f2dcf424fbaaab746d5f8bf7c8c P 74758684df5649ccadd1e189eaff32dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:04.344677  4701 leader_election.cc:290] T ea0b275f64bf42cc88bbee81a24d3020 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 election: Requested vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:04.345314  4637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea0b275f64bf42cc88bbee81a24d3020" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:04.345957  4637 raft_consensus.cc:3060] T ea0b275f64bf42cc88bbee81a24d3020 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.352335  4691 consensus_queue.cc:1048] T 81197f2dcf424fbaaab746d5f8bf7c8c P 74758684df5649ccadd1e189eaff32dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:04.356253  4681 tablet_bootstrap.cc:492] T a4736bb71dfa4f4b8b80e8a52895acf7 P 74758684df5649ccadd1e189eaff32dc: No bootstrap required, opened a new log
I20260709 13:12:04.356714  4681 ts_tablet_manager.cc:1403] T a4736bb71dfa4f4b8b80e8a52895acf7 P 74758684df5649ccadd1e189eaff32dc: Time spent bootstrapping tablet: real 0.271s	user 0.013s	sys 0.008s
I20260709 13:12:04.360474  4637 raft_consensus.cc:2468] T ea0b275f64bf42cc88bbee81a24d3020 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 1.
I20260709 13:12:04.361653  4455 leader_election.cc:304] T ea0b275f64bf42cc88bbee81a24d3020 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87; no voters: 420a61707e804ce5b3773a91cc2eb424
I20260709 13:12:04.362725  4701 raft_consensus.cc:2804] T ea0b275f64bf42cc88bbee81a24d3020 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:04.363456  4701 raft_consensus.cc:697] T ea0b275f64bf42cc88bbee81a24d3020 P aa0ff974118b465eaa785b8a86057e87 [term 1 LEADER]: Becoming Leader. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Running, Role: LEADER
I20260709 13:12:04.362674  4681 raft_consensus.cc:359] T a4736bb71dfa4f4b8b80e8a52895acf7 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:04.364352  4681 raft_consensus.cc:385] T a4736bb71dfa4f4b8b80e8a52895acf7 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.364881  4681 raft_consensus.cc:740] T a4736bb71dfa4f4b8b80e8a52895acf7 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.364382  4701 consensus_queue.cc:237] T ea0b275f64bf42cc88bbee81a24d3020 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:04.365142  4309 catalog_manager.cc:5697] T acbf3f88b4514948820691784cf9c189 P 74758684df5649ccadd1e189eaff32dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 74758684df5649ccadd1e189eaff32dc (127.28.173.4). New cstate: current_term: 1 leader_uuid: "74758684df5649ccadd1e189eaff32dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:04.366068  4681 consensus_queue.cc:260] T a4736bb71dfa4f4b8b80e8a52895acf7 P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:04.370239  4721 raft_consensus.cc:515] T 09294b866578436a827c27702d4b1d0b P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:04.372330  4721 leader_election.cc:290] T 09294b866578436a827c27702d4b1d0b P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Requested vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:04.372829  4682 tablet_bootstrap.cc:492] T 980616077a8445ccbe984f63131e1b44 P 06ec58698d5444caaecea433c8419770: No bootstrap required, opened a new log
I20260709 13:12:04.373243  4681 ts_tablet_manager.cc:1434] T a4736bb71dfa4f4b8b80e8a52895acf7 P 74758684df5649ccadd1e189eaff32dc: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:12:04.363678  4743 raft_consensus.cc:515] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:04.374850  4681 tablet_bootstrap.cc:492] T 39bf585adcc94606975982efe4640189 P 74758684df5649ccadd1e189eaff32dc: Bootstrap starting.
I20260709 13:12:04.377406  4743 leader_election.cc:290] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 election: Requested vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:04.375684  4691 raft_consensus.cc:493] T a4736bb71dfa4f4b8b80e8a52895acf7 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.378713  4691 raft_consensus.cc:515] T a4736bb71dfa4f4b8b80e8a52895acf7 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:04.380584  4636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3501a75721d543d598af7857e368e08b" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:04.381242  4636 raft_consensus.cc:3060] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.381660  4411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4736bb71dfa4f4b8b80e8a52895acf7" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:04.382596  4691 leader_election.cc:290] T a4736bb71dfa4f4b8b80e8a52895acf7 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
W20260709 13:12:04.383153  4603 leader_election.cc:343] T a4736bb71dfa4f4b8b80e8a52895acf7 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:04.385684  4411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3501a75721d543d598af7857e368e08b" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770"
W20260709 13:12:04.387357  4529 leader_election.cc:343] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:04.373277  4682 ts_tablet_manager.cc:1403] T 980616077a8445ccbe984f63131e1b44 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.284s	user 0.013s	sys 0.003s
I20260709 13:12:04.388130  4637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09294b866578436a827c27702d4b1d0b" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:04.389039  4487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4736bb71dfa4f4b8b80e8a52895acf7" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:04.388170  4489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09294b866578436a827c27702d4b1d0b" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:04.390492  4489 raft_consensus.cc:3060] T 09294b866578436a827c27702d4b1d0b P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.392864  4488 raft_consensus.cc:3060] T b6256e4aa07c45c78b2bbff56a852078 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:04.393971  4603 leader_election.cc:343] T a4736bb71dfa4f4b8b80e8a52895acf7 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:04.394496  4603 leader_election.cc:304] T a4736bb71dfa4f4b8b80e8a52895acf7 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc; no voters: 06ec58698d5444caaecea433c8419770, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:04.395918  4753 raft_consensus.cc:2749] T a4736bb71dfa4f4b8b80e8a52895acf7 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:04.396822  4681 tablet_bootstrap.cc:654] T 39bf585adcc94606975982efe4640189 P 74758684df5649ccadd1e189eaff32dc: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:04.399101  4380 leader_election.cc:343] T 09294b866578436a827c27702d4b1d0b P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:04.403256  4682 raft_consensus.cc:359] T 980616077a8445ccbe984f63131e1b44 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:04.403808  4682 raft_consensus.cc:385] T 980616077a8445ccbe984f63131e1b44 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.404078  4682 raft_consensus.cc:740] T 980616077a8445ccbe984f63131e1b44 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.410764  4685 tablet_bootstrap.cc:492] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87: No bootstrap required, opened a new log
I20260709 13:12:04.411175  4685 ts_tablet_manager.cc:1403] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87: Time spent bootstrapping tablet: real 0.271s	user 0.015s	sys 0.007s
I20260709 13:12:04.411669  4682 consensus_queue.cc:260] T 980616077a8445ccbe984f63131e1b44 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:04.416646  4685 raft_consensus.cc:359] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:04.417847  4685 raft_consensus.cc:385] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.418134  4685 raft_consensus.cc:740] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.418887  4685 consensus_queue.cc:260] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:04.421205  4685 ts_tablet_manager.cc:1434] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:12:04.422091  4685 tablet_bootstrap.cc:492] T a4736bb71dfa4f4b8b80e8a52895acf7 P aa0ff974118b465eaa785b8a86057e87: Bootstrap starting.
I20260709 13:12:04.424533  4760 raft_consensus.cc:493] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.425019  4760 raft_consensus.cc:515] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:04.427053  4760 leader_election.cc:290] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:04.428033  4683 tablet_bootstrap.cc:492] T 39bf585adcc94606975982efe4640189 P 420a61707e804ce5b3773a91cc2eb424: No bootstrap required, opened a new log
I20260709 13:12:04.428545  4683 ts_tablet_manager.cc:1403] T 39bf585adcc94606975982efe4640189 P 420a61707e804ce5b3773a91cc2eb424: Time spent bootstrapping tablet: real 0.131s	user 0.018s	sys 0.012s
I20260709 13:12:04.428576  4560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca87a1b3c8043529d7a9d61b0adfdbf" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:04.429826  4489 raft_consensus.cc:2468] T 09294b866578436a827c27702d4b1d0b P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 1.
I20260709 13:12:04.431609  4683 raft_consensus.cc:359] T 39bf585adcc94606975982efe4640189 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
W20260709 13:12:04.432360  4379 leader_election.cc:343] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:04.432381  4683 raft_consensus.cc:385] T 39bf585adcc94606975982efe4640189 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.433100  4683 raft_consensus.cc:740] T 39bf585adcc94606975982efe4640189 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.434101  4683 consensus_queue.cc:260] T 39bf585adcc94606975982efe4640189 P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:04.435348  4380 leader_election.cc:304] T 09294b866578436a827c27702d4b1d0b P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06ec58698d5444caaecea433c8419770, aa0ff974118b465eaa785b8a86057e87; no voters: 74758684df5649ccadd1e189eaff32dc
I20260709 13:12:04.436755  4683 ts_tablet_manager.cc:1434] T 39bf585adcc94606975982efe4640189 P 420a61707e804ce5b3773a91cc2eb424: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:04.437283  4721 raft_consensus.cc:2804] T 09294b866578436a827c27702d4b1d0b P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:04.437680  4683 tablet_bootstrap.cc:492] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 420a61707e804ce5b3773a91cc2eb424: Bootstrap starting.
I20260709 13:12:04.437800  4721 raft_consensus.cc:697] T 09294b866578436a827c27702d4b1d0b P 06ec58698d5444caaecea433c8419770 [term 1 LEADER]: Becoming Leader. State: Replica: 06ec58698d5444caaecea433c8419770, State: Running, Role: LEADER
I20260709 13:12:04.438712  4721 consensus_queue.cc:237] T 09294b866578436a827c27702d4b1d0b P 06ec58698d5444caaecea433c8419770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:04.439458  4685 tablet_bootstrap.cc:654] T a4736bb71dfa4f4b8b80e8a52895acf7 P aa0ff974118b465eaa785b8a86057e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.439638  4489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca87a1b3c8043529d7a9d61b0adfdbf" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:04.440388  4489 raft_consensus.cc:2468] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 0.
I20260709 13:12:04.442818  4380 leader_election.cc:304] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06ec58698d5444caaecea433c8419770, aa0ff974118b465eaa785b8a86057e87; no voters: 420a61707e804ce5b3773a91cc2eb424
I20260709 13:12:04.443953  4760 raft_consensus.cc:2804] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:04.444317  4760 raft_consensus.cc:493] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:04.444558  4681 tablet_bootstrap.cc:492] T 39bf585adcc94606975982efe4640189 P 74758684df5649ccadd1e189eaff32dc: No bootstrap required, opened a new log
I20260709 13:12:04.444855  4760 raft_consensus.cc:3060] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.445114  4681 ts_tablet_manager.cc:1403] T 39bf585adcc94606975982efe4640189 P 74758684df5649ccadd1e189eaff32dc: Time spent bootstrapping tablet: real 0.071s	user 0.012s	sys 0.001s
I20260709 13:12:04.448036  4681 raft_consensus.cc:359] T 39bf585adcc94606975982efe4640189 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:04.428578  4307 catalog_manager.cc:5697] T 980616077a8445ccbe984f63131e1b44 P 420a61707e804ce5b3773a91cc2eb424 reported cstate change: term changed from 0 to 1, leader changed from <none> to 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3). New cstate: current_term: 1 leader_uuid: "420a61707e804ce5b3773a91cc2eb424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:04.444257  4683 tablet_bootstrap.cc:654] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 420a61707e804ce5b3773a91cc2eb424: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.448673  4681 raft_consensus.cc:385] T 39bf585adcc94606975982efe4640189 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.450719  4681 raft_consensus.cc:740] T 39bf585adcc94606975982efe4640189 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.451555  4681 consensus_queue.cc:260] T 39bf585adcc94606975982efe4640189 P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:04.452659  4682 ts_tablet_manager.cc:1434] T 980616077a8445ccbe984f63131e1b44 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.064s	user 0.006s	sys 0.000s
I20260709 13:12:04.457000  4681 ts_tablet_manager.cc:1434] T 39bf585adcc94606975982efe4640189 P 74758684df5649ccadd1e189eaff32dc: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.002s
I20260709 13:12:04.457573  4636 raft_consensus.cc:2468] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 1.
I20260709 13:12:04.457934  4681 tablet_bootstrap.cc:492] T 09294b866578436a827c27702d4b1d0b P 74758684df5649ccadd1e189eaff32dc: Bootstrap starting.
I20260709 13:12:04.459026  4683 tablet_bootstrap.cc:492] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 420a61707e804ce5b3773a91cc2eb424: No bootstrap required, opened a new log
I20260709 13:12:04.458760  4529 leader_election.cc:304] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc; no voters: 06ec58698d5444caaecea433c8419770
I20260709 13:12:04.459652  4743 raft_consensus.cc:2804] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:04.459928  4682 tablet_bootstrap.cc:492] T a4736bb71dfa4f4b8b80e8a52895acf7 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:04.460180  4743 raft_consensus.cc:697] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [term 1 LEADER]: Becoming Leader. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Running, Role: LEADER
I20260709 13:12:04.461021  4743 consensus_queue.cc:237] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:04.464389  4760 raft_consensus.cc:515] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:04.467432  4489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca87a1b3c8043529d7a9d61b0adfdbf" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:04.468010  4685 tablet_bootstrap.cc:492] T a4736bb71dfa4f4b8b80e8a52895acf7 P aa0ff974118b465eaa785b8a86057e87: No bootstrap required, opened a new log
I20260709 13:12:04.468568  4685 ts_tablet_manager.cc:1403] T a4736bb71dfa4f4b8b80e8a52895acf7 P aa0ff974118b465eaa785b8a86057e87: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.000s
I20260709 13:12:04.471283  4685 raft_consensus.cc:359] T a4736bb71dfa4f4b8b80e8a52895acf7 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:04.474418  4775 raft_consensus.cc:493] T b6256e4aa07c45c78b2bbff56a852078 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:04.474968  4775 raft_consensus.cc:515] T b6256e4aa07c45c78b2bbff56a852078 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:04.468003  4489 raft_consensus.cc:3060] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.474452  4683 ts_tablet_manager.cc:1403] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 420a61707e804ce5b3773a91cc2eb424: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.000s
I20260709 13:12:04.478713  4683 raft_consensus.cc:359] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:04.479323  4683 raft_consensus.cc:385] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.479628  4683 raft_consensus.cc:740] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.479724  4775 leader_election.cc:290] T b6256e4aa07c45c78b2bbff56a852078 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:04.480810  4562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6256e4aa07c45c78b2bbff56a852078" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:04.471892  4685 raft_consensus.cc:385] T a4736bb71dfa4f4b8b80e8a52895acf7 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.482555  4411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6256e4aa07c45c78b2bbff56a852078" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:04.482502  4683 consensus_queue.cc:260] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:04.479426  4560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca87a1b3c8043529d7a9d61b0adfdbf" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:04.483897  4560 raft_consensus.cc:3060] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.482189  4685 raft_consensus.cc:740] T a4736bb71dfa4f4b8b80e8a52895acf7 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.486083  4683 ts_tablet_manager.cc:1434] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 420a61707e804ce5b3773a91cc2eb424: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:12:04.485072  4310 catalog_manager.cc:5697] T 09294b866578436a827c27702d4b1d0b P 06ec58698d5444caaecea433c8419770 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06ec58698d5444caaecea433c8419770 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "06ec58698d5444caaecea433c8419770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:04.487007  4683 tablet_bootstrap.cc:492] T b60a97e129dc4aa9a43f2c44ec5181a8 P 420a61707e804ce5b3773a91cc2eb424: Bootstrap starting.
I20260709 13:12:04.488536  4455 leader_election.cc:304] T b6256e4aa07c45c78b2bbff56a852078 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa0ff974118b465eaa785b8a86057e87; no voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424
I20260709 13:12:04.488834  4681 tablet_bootstrap.cc:654] T 09294b866578436a827c27702d4b1d0b P 74758684df5649ccadd1e189eaff32dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.489725  4775 raft_consensus.cc:2749] T b6256e4aa07c45c78b2bbff56a852078 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:04.485129  4685 consensus_queue.cc:260] T a4736bb71dfa4f4b8b80e8a52895acf7 P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:04.493788  4685 ts_tablet_manager.cc:1434] T a4736bb71dfa4f4b8b80e8a52895acf7 P aa0ff974118b465eaa785b8a86057e87: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 13:12:04.493825  4560 raft_consensus.cc:2468] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 1.
I20260709 13:12:04.494872  4685 tablet_bootstrap.cc:492] T b60a97e129dc4aa9a43f2c44ec5181a8 P aa0ff974118b465eaa785b8a86057e87: Bootstrap starting.
I20260709 13:12:04.495253  4379 leader_election.cc:304] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: 
I20260709 13:12:04.496181  4721 raft_consensus.cc:2804] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:04.496640  4683 tablet_bootstrap.cc:654] T b60a97e129dc4aa9a43f2c44ec5181a8 P 420a61707e804ce5b3773a91cc2eb424: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.496691  4721 raft_consensus.cc:697] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770 [term 1 LEADER]: Becoming Leader. State: Replica: 06ec58698d5444caaecea433c8419770, State: Running, Role: LEADER
I20260709 13:12:04.497794  4721 consensus_queue.cc:237] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:04.502442  4760 leader_election.cc:290] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Requested vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:04.503998  4489 raft_consensus.cc:2468] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 1.
I20260709 13:12:04.504844  4682 tablet_bootstrap.cc:654] T a4736bb71dfa4f4b8b80e8a52895acf7 P 06ec58698d5444caaecea433c8419770: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.507630  4685 tablet_bootstrap.cc:654] T b60a97e129dc4aa9a43f2c44ec5181a8 P aa0ff974118b465eaa785b8a86057e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.508147  4691 raft_consensus.cc:493] T 39bf585adcc94606975982efe4640189 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.508617  4691 raft_consensus.cc:515] T 39bf585adcc94606975982efe4640189 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:04.510797  4691 leader_election.cc:290] T 39bf585adcc94606975982efe4640189 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:04.514855  4560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39bf585adcc94606975982efe4640189" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:04.514510  4311 catalog_manager.cc:5697] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 reported cstate change: term changed from 0 to 1, leader changed from <none> to 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3). New cstate: current_term: 1 leader_uuid: "420a61707e804ce5b3773a91cc2eb424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:04.515468  4560 raft_consensus.cc:2468] T 39bf585adcc94606975982efe4640189 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 0.
I20260709 13:12:04.516702  4602 leader_election.cc:304] T 39bf585adcc94606975982efe4640189 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc; no voters: 
I20260709 13:12:04.517702  4691 raft_consensus.cc:2804] T 39bf585adcc94606975982efe4640189 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:04.518082  4691 raft_consensus.cc:493] T 39bf585adcc94606975982efe4640189 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:04.518400  4691 raft_consensus.cc:3060] T 39bf585adcc94606975982efe4640189 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.520972  4488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39bf585adcc94606975982efe4640189" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:04.521322  4681 tablet_bootstrap.cc:492] T 09294b866578436a827c27702d4b1d0b P 74758684df5649ccadd1e189eaff32dc: No bootstrap required, opened a new log
I20260709 13:12:04.522025  4681 ts_tablet_manager.cc:1403] T 09294b866578436a827c27702d4b1d0b P 74758684df5649ccadd1e189eaff32dc: Time spent bootstrapping tablet: real 0.064s	user 0.014s	sys 0.008s
I20260709 13:12:04.521953  4488 raft_consensus.cc:2468] T 39bf585adcc94606975982efe4640189 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 0.
I20260709 13:12:04.525532  4681 raft_consensus.cc:359] T 09294b866578436a827c27702d4b1d0b P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:04.526428  4681 raft_consensus.cc:385] T 09294b866578436a827c27702d4b1d0b P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.526768  4681 raft_consensus.cc:740] T 09294b866578436a827c27702d4b1d0b P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.527776  4681 consensus_queue.cc:260] T 09294b866578436a827c27702d4b1d0b P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:04.538002  4743 raft_consensus.cc:493] T ea0b275f64bf42cc88bbee81a24d3020 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.538693  4743 raft_consensus.cc:515] T ea0b275f64bf42cc88bbee81a24d3020 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:04.541356  4743 leader_election.cc:290] T ea0b275f64bf42cc88bbee81a24d3020 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:04.544275  4636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea0b275f64bf42cc88bbee81a24d3020" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:04.545081  4636 raft_consensus.cc:2393] T ea0b275f64bf42cc88bbee81a24d3020 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 420a61707e804ce5b3773a91cc2eb424 in current term 1: Already voted for candidate aa0ff974118b465eaa785b8a86057e87 in this term.
I20260709 13:12:04.550199  4488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea0b275f64bf42cc88bbee81a24d3020" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:04.552387  4529 leader_election.cc:304] T ea0b275f64bf42cc88bbee81a24d3020 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424; no voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:04.553867  4743 raft_consensus.cc:3060] T ea0b275f64bf42cc88bbee81a24d3020 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.554811  4681 ts_tablet_manager.cc:1434] T 09294b866578436a827c27702d4b1d0b P 74758684df5649ccadd1e189eaff32dc: Time spent starting tablet: real 0.032s	user 0.004s	sys 0.004s
I20260709 13:12:04.556140  4681 tablet_bootstrap.cc:492] T b60a97e129dc4aa9a43f2c44ec5181a8 P 74758684df5649ccadd1e189eaff32dc: Bootstrap starting.
I20260709 13:12:04.562453  4309 catalog_manager.cc:5697] T ea0b275f64bf42cc88bbee81a24d3020 P aa0ff974118b465eaa785b8a86057e87 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa0ff974118b465eaa785b8a86057e87 (127.28.173.2). New cstate: current_term: 1 leader_uuid: "aa0ff974118b465eaa785b8a86057e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:04.564028  4681 tablet_bootstrap.cc:654] T b60a97e129dc4aa9a43f2c44ec5181a8 P 74758684df5649ccadd1e189eaff32dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.576534  4681 tablet_bootstrap.cc:492] T b60a97e129dc4aa9a43f2c44ec5181a8 P 74758684df5649ccadd1e189eaff32dc: No bootstrap required, opened a new log
I20260709 13:12:04.577121  4681 ts_tablet_manager.cc:1403] T b60a97e129dc4aa9a43f2c44ec5181a8 P 74758684df5649ccadd1e189eaff32dc: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260709 13:12:04.591370  4691 raft_consensus.cc:515] T 39bf585adcc94606975982efe4640189 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:04.594168  4682 tablet_bootstrap.cc:492] T a4736bb71dfa4f4b8b80e8a52895acf7 P 06ec58698d5444caaecea433c8419770: No bootstrap required, opened a new log
I20260709 13:12:04.595650  4743 raft_consensus.cc:2749] T ea0b275f64bf42cc88bbee81a24d3020 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:04.597878  4682 ts_tablet_manager.cc:1403] T a4736bb71dfa4f4b8b80e8a52895acf7 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.138s	user 0.026s	sys 0.016s
I20260709 13:12:04.600132  4488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39bf585adcc94606975982efe4640189" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:04.600703  4488 raft_consensus.cc:3060] T 39bf585adcc94606975982efe4640189 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.600672  4682 raft_consensus.cc:359] T a4736bb71dfa4f4b8b80e8a52895acf7 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:04.601456  4682 raft_consensus.cc:385] T a4736bb71dfa4f4b8b80e8a52895acf7 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.601753  4682 raft_consensus.cc:740] T a4736bb71dfa4f4b8b80e8a52895acf7 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.602604  4682 consensus_queue.cc:260] T a4736bb71dfa4f4b8b80e8a52895acf7 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:04.605038  4682 ts_tablet_manager.cc:1434] T a4736bb71dfa4f4b8b80e8a52895acf7 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:04.605933  4682 tablet_bootstrap.cc:492] T 69aed23cb12849fda6220c6c65580d59 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:04.602499  4310 catalog_manager.cc:5697] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06ec58698d5444caaecea433c8419770 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "06ec58698d5444caaecea433c8419770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:04.611022  4488 raft_consensus.cc:2468] T 39bf585adcc94606975982efe4640189 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 1.
I20260709 13:12:04.611575  4682 tablet_bootstrap.cc:654] T 69aed23cb12849fda6220c6c65580d59 P 06ec58698d5444caaecea433c8419770: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.612231  4603 leader_election.cc:304] T 39bf585adcc94606975982efe4640189 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:04.613152  4722 raft_consensus.cc:2804] T 39bf585adcc94606975982efe4640189 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:04.613641  4722 raft_consensus.cc:697] T 39bf585adcc94606975982efe4640189 P 74758684df5649ccadd1e189eaff32dc [term 1 LEADER]: Becoming Leader. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Running, Role: LEADER
I20260709 13:12:04.614032  4681 raft_consensus.cc:359] T b60a97e129dc4aa9a43f2c44ec5181a8 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:04.614624  4722 consensus_queue.cc:237] T 39bf585adcc94606975982efe4640189 P 74758684df5649ccadd1e189eaff32dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:04.618430  4685 tablet_bootstrap.cc:492] T b60a97e129dc4aa9a43f2c44ec5181a8 P aa0ff974118b465eaa785b8a86057e87: No bootstrap required, opened a new log
I20260709 13:12:04.622713  4685 ts_tablet_manager.cc:1403] T b60a97e129dc4aa9a43f2c44ec5181a8 P aa0ff974118b465eaa785b8a86057e87: Time spent bootstrapping tablet: real 0.128s	user 0.024s	sys 0.022s
I20260709 13:12:04.621986  4681 raft_consensus.cc:385] T b60a97e129dc4aa9a43f2c44ec5181a8 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.625438  4685 raft_consensus.cc:359] T b60a97e129dc4aa9a43f2c44ec5181a8 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:04.625917  4681 raft_consensus.cc:740] T b60a97e129dc4aa9a43f2c44ec5181a8 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.628011  4758 raft_consensus.cc:493] T 09294b866578436a827c27702d4b1d0b P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.628150  4681 consensus_queue.cc:260] T b60a97e129dc4aa9a43f2c44ec5181a8 P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:04.631009  4682 tablet_bootstrap.cc:492] T 69aed23cb12849fda6220c6c65580d59 P 06ec58698d5444caaecea433c8419770: No bootstrap required, opened a new log
I20260709 13:12:04.631507  4682 ts_tablet_manager.cc:1403] T 69aed23cb12849fda6220c6c65580d59 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.000s
I20260709 13:12:04.632236  4681 ts_tablet_manager.cc:1434] T b60a97e129dc4aa9a43f2c44ec5181a8 P 74758684df5649ccadd1e189eaff32dc: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.003s
I20260709 13:12:04.626178  4685 raft_consensus.cc:385] T b60a97e129dc4aa9a43f2c44ec5181a8 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.618631  4560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39bf585adcc94606975982efe4640189" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:04.633186  4681 tablet_bootstrap.cc:492] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 74758684df5649ccadd1e189eaff32dc: Bootstrap starting.
I20260709 13:12:04.633437  4560 raft_consensus.cc:3060] T 39bf585adcc94606975982efe4640189 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.628556  4758 raft_consensus.cc:515] T 09294b866578436a827c27702d4b1d0b P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:04.636857  4758 leader_election.cc:290] T 09294b866578436a827c27702d4b1d0b P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:04.638494  4411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09294b866578436a827c27702d4b1d0b" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:04.638238  4310 catalog_manager.cc:5697] T 39bf585adcc94606975982efe4640189 P 74758684df5649ccadd1e189eaff32dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 74758684df5649ccadd1e189eaff32dc (127.28.173.4). New cstate: current_term: 1 leader_uuid: "74758684df5649ccadd1e189eaff32dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:04.619411  4691 leader_election.cc:290] T 39bf585adcc94606975982efe4640189 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 election: Requested vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:04.641213  4488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09294b866578436a827c27702d4b1d0b" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:04.641554  4681 tablet_bootstrap.cc:654] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 74758684df5649ccadd1e189eaff32dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.642149  4488 raft_consensus.cc:2393] T 09294b866578436a827c27702d4b1d0b P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74758684df5649ccadd1e189eaff32dc in current term 1: Already voted for candidate 06ec58698d5444caaecea433c8419770 in this term.
I20260709 13:12:04.643712  4603 leader_election.cc:304] T 09294b866578436a827c27702d4b1d0b P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc; no voters: 06ec58698d5444caaecea433c8419770, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:04.643533  4560 raft_consensus.cc:2468] T 39bf585adcc94606975982efe4640189 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 1.
I20260709 13:12:04.644240  4685 raft_consensus.cc:740] T b60a97e129dc4aa9a43f2c44ec5181a8 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.646260  4682 raft_consensus.cc:359] T 69aed23cb12849fda6220c6c65580d59 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:04.646942  4682 raft_consensus.cc:385] T 69aed23cb12849fda6220c6c65580d59 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.647217  4682 raft_consensus.cc:740] T 69aed23cb12849fda6220c6c65580d59 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.647423  4685 consensus_queue.cc:260] T b60a97e129dc4aa9a43f2c44ec5181a8 P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:04.650853  4685 ts_tablet_manager.cc:1434] T b60a97e129dc4aa9a43f2c44ec5181a8 P aa0ff974118b465eaa785b8a86057e87: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.000s
I20260709 13:12:04.653285  4683 tablet_bootstrap.cc:492] T b60a97e129dc4aa9a43f2c44ec5181a8 P 420a61707e804ce5b3773a91cc2eb424: No bootstrap required, opened a new log
I20260709 13:12:04.653872  4683 ts_tablet_manager.cc:1403] T b60a97e129dc4aa9a43f2c44ec5181a8 P 420a61707e804ce5b3773a91cc2eb424: Time spent bootstrapping tablet: real 0.167s	user 0.033s	sys 0.075s
I20260709 13:12:04.654209  4685 tablet_bootstrap.cc:492] T cb23991ab8504ee491f905a4346edee9 P aa0ff974118b465eaa785b8a86057e87: Bootstrap starting.
I20260709 13:12:04.647917  4682 consensus_queue.cc:260] T 69aed23cb12849fda6220c6c65580d59 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:04.648388  4691 raft_consensus.cc:3060] T 09294b866578436a827c27702d4b1d0b P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.657203  4721 raft_consensus.cc:493] T 69aed23cb12849fda6220c6c65580d59 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.657667  4721 raft_consensus.cc:515] T 69aed23cb12849fda6220c6c65580d59 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:04.658224  4683 raft_consensus.cc:359] T b60a97e129dc4aa9a43f2c44ec5181a8 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:04.659097  4683 raft_consensus.cc:385] T b60a97e129dc4aa9a43f2c44ec5181a8 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.659410  4683 raft_consensus.cc:740] T b60a97e129dc4aa9a43f2c44ec5181a8 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.660033  4721 leader_election.cc:290] T 69aed23cb12849fda6220c6c65580d59 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:04.660262  4683 consensus_queue.cc:260] T b60a97e129dc4aa9a43f2c44ec5181a8 P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:04.661582  4682 ts_tablet_manager.cc:1434] T 69aed23cb12849fda6220c6c65580d59 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:12:04.662515  4682 tablet_bootstrap.cc:492] T 3501a75721d543d598af7857e368e08b P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:04.663053  4683 ts_tablet_manager.cc:1434] T b60a97e129dc4aa9a43f2c44ec5181a8 P 420a61707e804ce5b3773a91cc2eb424: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:12:04.663051  4636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69aed23cb12849fda6220c6c65580d59" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:04.668218  4682 tablet_bootstrap.cc:654] T 3501a75721d543d598af7857e368e08b P 06ec58698d5444caaecea433c8419770: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.677863  4560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69aed23cb12849fda6220c6c65580d59" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:04.678987  4560 raft_consensus.cc:2393] T 69aed23cb12849fda6220c6c65580d59 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 06ec58698d5444caaecea433c8419770 in current term 1: Already voted for candidate 74758684df5649ccadd1e189eaff32dc in this term.
I20260709 13:12:04.680557  4683 tablet_bootstrap.cc:492] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424: Bootstrap starting.
I20260709 13:12:04.686010  4379 leader_election.cc:304] T 69aed23cb12849fda6220c6c65580d59 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06ec58698d5444caaecea433c8419770; no voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc
I20260709 13:12:04.687500  4743 raft_consensus.cc:493] T b60a97e129dc4aa9a43f2c44ec5181a8 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.688186  4743 raft_consensus.cc:515] T b60a97e129dc4aa9a43f2c44ec5181a8 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:04.690881  4743 leader_election.cc:290] T b60a97e129dc4aa9a43f2c44ec5181a8 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:04.691941  4722 consensus_queue.cc:1048] T 69aed23cb12849fda6220c6c65580d59 P 74758684df5649ccadd1e189eaff32dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:04.691951  4683 tablet_bootstrap.cc:654] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.694268  4636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b60a97e129dc4aa9a43f2c44ec5181a8" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:04.695127  4636 raft_consensus.cc:2468] T b60a97e129dc4aa9a43f2c44ec5181a8 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 0.
I20260709 13:12:04.697293  4721 raft_consensus.cc:3060] T 69aed23cb12849fda6220c6c65580d59 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.697358  4488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b60a97e129dc4aa9a43f2c44ec5181a8" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:04.698238  4488 raft_consensus.cc:2468] T b60a97e129dc4aa9a43f2c44ec5181a8 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 0.
I20260709 13:12:04.700314  4529 leader_election.cc:304] T b60a97e129dc4aa9a43f2c44ec5181a8 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:04.702059  4774 raft_consensus.cc:2804] T b60a97e129dc4aa9a43f2c44ec5181a8 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:04.702525  4774 raft_consensus.cc:493] T b60a97e129dc4aa9a43f2c44ec5181a8 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:04.702934  4774 raft_consensus.cc:3060] T b60a97e129dc4aa9a43f2c44ec5181a8 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.713727  4753 consensus_queue.cc:1048] T acbf3f88b4514948820691784cf9c189 P 74758684df5649ccadd1e189eaff32dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:04.715590  4717 consensus_queue.cc:1048] T 980616077a8445ccbe984f63131e1b44 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:04.721279  4760 raft_consensus.cc:493] T 980616077a8445ccbe984f63131e1b44 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.721947  4760 raft_consensus.cc:515] T 980616077a8445ccbe984f63131e1b44 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:04.731055  4760 leader_election.cc:290] T 980616077a8445ccbe984f63131e1b44 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:04.732563  4489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980616077a8445ccbe984f63131e1b44" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:04.732753  4774 raft_consensus.cc:515] T b60a97e129dc4aa9a43f2c44ec5181a8 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:04.733475  4562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "980616077a8445ccbe984f63131e1b44" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:04.733842  4760 consensus_queue.cc:1048] T 5b827ee48d56478398f009c3fa980016 P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:04.734899  4774 leader_election.cc:290] T b60a97e129dc4aa9a43f2c44ec5181a8 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 election: Requested vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:04.735440  4379 leader_election.cc:304] T 980616077a8445ccbe984f63131e1b44 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06ec58698d5444caaecea433c8419770; no voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:04.737134  4759 raft_consensus.cc:2749] T 980616077a8445ccbe984f63131e1b44 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:04.739403  4691 raft_consensus.cc:2749] T 09294b866578436a827c27702d4b1d0b P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:04.739686  4489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b60a97e129dc4aa9a43f2c44ec5181a8" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:04.740417  4489 raft_consensus.cc:3060] T b60a97e129dc4aa9a43f2c44ec5181a8 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.740765  4685 tablet_bootstrap.cc:654] T cb23991ab8504ee491f905a4346edee9 P aa0ff974118b465eaa785b8a86057e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.745204  4637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b60a97e129dc4aa9a43f2c44ec5181a8" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:04.745949  4637 raft_consensus.cc:3060] T b60a97e129dc4aa9a43f2c44ec5181a8 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.751331  4753 consensus_queue.cc:1048] T acbf3f88b4514948820691784cf9c189 P 74758684df5649ccadd1e189eaff32dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:04.759560  4721 raft_consensus.cc:2749] T 69aed23cb12849fda6220c6c65580d59 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:04.766808  4753 consensus_queue.cc:1048] T 69aed23cb12849fda6220c6c65580d59 P 74758684df5649ccadd1e189eaff32dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:04.789438  4681 tablet_bootstrap.cc:492] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 74758684df5649ccadd1e189eaff32dc: No bootstrap required, opened a new log
I20260709 13:12:04.789968  4681 ts_tablet_manager.cc:1403] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 74758684df5649ccadd1e189eaff32dc: Time spent bootstrapping tablet: real 0.157s	user 0.035s	sys 0.061s
I20260709 13:12:04.792317  4682 tablet_bootstrap.cc:492] T 3501a75721d543d598af7857e368e08b P 06ec58698d5444caaecea433c8419770: No bootstrap required, opened a new log
I20260709 13:12:04.792814  4682 ts_tablet_manager.cc:1403] T 3501a75721d543d598af7857e368e08b P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.130s	user 0.066s	sys 0.029s
I20260709 13:12:04.795540  4682 raft_consensus.cc:359] T 3501a75721d543d598af7857e368e08b P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:04.796229  4682 raft_consensus.cc:385] T 3501a75721d543d598af7857e368e08b P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.796480  4682 raft_consensus.cc:740] T 3501a75721d543d598af7857e368e08b P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.797116  4682 consensus_queue.cc:260] T 3501a75721d543d598af7857e368e08b P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:04.798070  4759 consensus_queue.cc:1048] T 5b827ee48d56478398f009c3fa980016 P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:04.799506  4759 raft_consensus.cc:493] T 3501a75721d543d598af7857e368e08b P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.799945  4759 raft_consensus.cc:515] T 3501a75721d543d598af7857e368e08b P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:04.802076  4759 leader_election.cc:290] T 3501a75721d543d598af7857e368e08b P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:04.802194  4637 raft_consensus.cc:2468] T b60a97e129dc4aa9a43f2c44ec5181a8 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 1.
I20260709 13:12:04.803915  4529 leader_election.cc:304] T b60a97e129dc4aa9a43f2c44ec5181a8 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc; no voters: 
I20260709 13:12:04.806171  4681 raft_consensus.cc:359] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:04.807318  4681 raft_consensus.cc:385] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.807406  4743 raft_consensus.cc:2804] T b60a97e129dc4aa9a43f2c44ec5181a8 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:04.807624  4681 raft_consensus.cc:740] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.808022  4743 raft_consensus.cc:697] T b60a97e129dc4aa9a43f2c44ec5181a8 P 420a61707e804ce5b3773a91cc2eb424 [term 1 LEADER]: Becoming Leader. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Running, Role: LEADER
I20260709 13:12:04.808456  4681 consensus_queue.cc:260] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:04.812760  4743 consensus_queue.cc:237] T b60a97e129dc4aa9a43f2c44ec5181a8 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:04.817422  4560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3501a75721d543d598af7857e368e08b" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:04.819923  4682 ts_tablet_manager.cc:1434] T 3501a75721d543d598af7857e368e08b P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
I20260709 13:12:04.820950  4682 tablet_bootstrap.cc:492] T cb23991ab8504ee491f905a4346edee9 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:04.820946  4637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3501a75721d543d598af7857e368e08b" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:04.821898  4637 raft_consensus.cc:2393] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 06ec58698d5444caaecea433c8419770 in current term 1: Already voted for candidate 420a61707e804ce5b3773a91cc2eb424 in this term.
I20260709 13:12:04.826802  4681 ts_tablet_manager.cc:1434] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 74758684df5649ccadd1e189eaff32dc: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.002s
I20260709 13:12:04.809254  4489 raft_consensus.cc:2468] T b60a97e129dc4aa9a43f2c44ec5181a8 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 1.
I20260709 13:12:04.829632  4380 leader_election.cc:304] T 3501a75721d543d598af7857e368e08b P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06ec58698d5444caaecea433c8419770; no voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc
I20260709 13:12:04.831646  4683 tablet_bootstrap.cc:492] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424: No bootstrap required, opened a new log
I20260709 13:12:04.832368  4681 tablet_bootstrap.cc:492] T 002595643d984c1c915975d4c4ace485 P 74758684df5649ccadd1e189eaff32dc: Bootstrap starting.
I20260709 13:12:04.839464  4681 tablet_bootstrap.cc:654] T 002595643d984c1c915975d4c4ace485 P 74758684df5649ccadd1e189eaff32dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.840108  4683 ts_tablet_manager.cc:1403] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424: Time spent bootstrapping tablet: real 0.160s	user 0.008s	sys 0.036s
I20260709 13:12:04.842288  4721 raft_consensus.cc:3060] T 3501a75721d543d598af7857e368e08b P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.842921  4411 raft_consensus.cc:3060] T 980616077a8445ccbe984f63131e1b44 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.842834  4683 raft_consensus.cc:359] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:04.843685  4683 raft_consensus.cc:385] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.844063  4683 raft_consensus.cc:740] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.844728  4683 consensus_queue.cc:260] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:04.853863  4721 raft_consensus.cc:2749] T 3501a75721d543d598af7857e368e08b P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:04.858423  4682 tablet_bootstrap.cc:654] T cb23991ab8504ee491f905a4346edee9 P 06ec58698d5444caaecea433c8419770: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.857570  4701 raft_consensus.cc:493] T a4736bb71dfa4f4b8b80e8a52895acf7 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.862236  4701 raft_consensus.cc:515] T a4736bb71dfa4f4b8b80e8a52895acf7 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:04.863096  4683 ts_tablet_manager.cc:1434] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.001s
I20260709 13:12:04.864243  4701 leader_election.cc:290] T a4736bb71dfa4f4b8b80e8a52895acf7 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:04.864251  4683 tablet_bootstrap.cc:492] T 5cd01d60553a435387e507f5d6240b58 P 420a61707e804ce5b3773a91cc2eb424: Bootstrap starting.
I20260709 13:12:04.867499  4685 tablet_bootstrap.cc:492] T cb23991ab8504ee491f905a4346edee9 P aa0ff974118b465eaa785b8a86057e87: No bootstrap required, opened a new log
I20260709 13:12:04.867995  4685 ts_tablet_manager.cc:1403] T cb23991ab8504ee491f905a4346edee9 P aa0ff974118b465eaa785b8a86057e87: Time spent bootstrapping tablet: real 0.214s	user 0.009s	sys 0.009s
I20260709 13:12:04.881410  4683 tablet_bootstrap.cc:654] T 5cd01d60553a435387e507f5d6240b58 P 420a61707e804ce5b3773a91cc2eb424: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.886231  4685 raft_consensus.cc:359] T cb23991ab8504ee491f905a4346edee9 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:04.887223  4685 raft_consensus.cc:385] T cb23991ab8504ee491f905a4346edee9 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.887557  4685 raft_consensus.cc:740] T cb23991ab8504ee491f905a4346edee9 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.891152  4685 consensus_queue.cc:260] T cb23991ab8504ee491f905a4346edee9 P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:04.893275  4637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4736bb71dfa4f4b8b80e8a52895acf7" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:04.893564  4412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4736bb71dfa4f4b8b80e8a52895acf7" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:04.893916  4637 raft_consensus.cc:2468] T a4736bb71dfa4f4b8b80e8a52895acf7 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 0.
I20260709 13:12:04.894250  4412 raft_consensus.cc:2468] T a4736bb71dfa4f4b8b80e8a52895acf7 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 0.
I20260709 13:12:04.895188  4455 leader_election.cc:304] T a4736bb71dfa4f4b8b80e8a52895acf7 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:04.895645  4759 consensus_queue.cc:1048] T 09294b866578436a827c27702d4b1d0b P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:04.901873  4685 ts_tablet_manager.cc:1434] T cb23991ab8504ee491f905a4346edee9 P aa0ff974118b465eaa785b8a86057e87: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.002s
I20260709 13:12:04.905121  4685 tablet_bootstrap.cc:492] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P aa0ff974118b465eaa785b8a86057e87: Bootstrap starting.
I20260709 13:12:04.908155  4757 raft_consensus.cc:2804] T a4736bb71dfa4f4b8b80e8a52895acf7 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:04.908591  4757 raft_consensus.cc:493] T a4736bb71dfa4f4b8b80e8a52895acf7 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:04.908978  4757 raft_consensus.cc:3060] T a4736bb71dfa4f4b8b80e8a52895acf7 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.911204  4682 tablet_bootstrap.cc:492] T cb23991ab8504ee491f905a4346edee9 P 06ec58698d5444caaecea433c8419770: No bootstrap required, opened a new log
I20260709 13:12:04.911695  4682 ts_tablet_manager.cc:1403] T cb23991ab8504ee491f905a4346edee9 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.091s	user 0.007s	sys 0.003s
I20260709 13:12:04.921082  4685 tablet_bootstrap.cc:654] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P aa0ff974118b465eaa785b8a86057e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.922593  4682 raft_consensus.cc:359] T cb23991ab8504ee491f905a4346edee9 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:04.923346  4682 raft_consensus.cc:385] T cb23991ab8504ee491f905a4346edee9 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.923614  4682 raft_consensus.cc:740] T cb23991ab8504ee491f905a4346edee9 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.916556  4311 catalog_manager.cc:5697] T b60a97e129dc4aa9a43f2c44ec5181a8 P 420a61707e804ce5b3773a91cc2eb424 reported cstate change: term changed from 0 to 1, leader changed from <none> to 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3). New cstate: current_term: 1 leader_uuid: "420a61707e804ce5b3773a91cc2eb424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:04.924263  4682 consensus_queue.cc:260] T cb23991ab8504ee491f905a4346edee9 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:04.924958  4683 tablet_bootstrap.cc:492] T 5cd01d60553a435387e507f5d6240b58 P 420a61707e804ce5b3773a91cc2eb424: No bootstrap required, opened a new log
I20260709 13:12:04.925451  4683 ts_tablet_manager.cc:1403] T 5cd01d60553a435387e507f5d6240b58 P 420a61707e804ce5b3773a91cc2eb424: Time spent bootstrapping tablet: real 0.061s	user 0.010s	sys 0.008s
I20260709 13:12:04.925820  4717 consensus_queue.cc:1048] T 980616077a8445ccbe984f63131e1b44 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:04.926892  4682 ts_tablet_manager.cc:1434] T cb23991ab8504ee491f905a4346edee9 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:12:04.927845  4682 tablet_bootstrap.cc:492] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:04.934562  4682 tablet_bootstrap.cc:654] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.936370  4683 raft_consensus.cc:359] T 5cd01d60553a435387e507f5d6240b58 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:04.937259  4683 raft_consensus.cc:385] T 5cd01d60553a435387e507f5d6240b58 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.937582  4683 raft_consensus.cc:740] T 5cd01d60553a435387e507f5d6240b58 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.938395  4683 consensus_queue.cc:260] T 5cd01d60553a435387e507f5d6240b58 P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:04.940894  4683 ts_tablet_manager.cc:1434] T 5cd01d60553a435387e507f5d6240b58 P 420a61707e804ce5b3773a91cc2eb424: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:12:04.941993  4683 tablet_bootstrap.cc:492] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424: Bootstrap starting.
I20260709 13:12:04.944033  4757 raft_consensus.cc:515] T a4736bb71dfa4f4b8b80e8a52895acf7 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:04.947566  4683 tablet_bootstrap.cc:654] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.948204  4682 tablet_bootstrap.cc:492] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770: No bootstrap required, opened a new log
I20260709 13:12:04.948676  4682 ts_tablet_manager.cc:1403] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.006s
I20260709 13:12:04.948899  4636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4736bb71dfa4f4b8b80e8a52895acf7" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:04.949524  4636 raft_consensus.cc:3060] T a4736bb71dfa4f4b8b80e8a52895acf7 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.951426  4682 raft_consensus.cc:359] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:04.952109  4682 raft_consensus.cc:385] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.952380  4682 raft_consensus.cc:740] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.953248  4682 consensus_queue.cc:260] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:04.957306  4682 ts_tablet_manager.cc:1434] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:04.956923  4717 consensus_queue.cc:1048] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:04.958302  4682 tablet_bootstrap.cc:492] T d0147a5552154f26a88833f9210b1358 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:04.962751  4636 raft_consensus.cc:2468] T a4736bb71dfa4f4b8b80e8a52895acf7 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 1.
I20260709 13:12:04.964221  4455 leader_election.cc:304] T a4736bb71dfa4f4b8b80e8a52895acf7 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:04.965137  4682 tablet_bootstrap.cc:654] T d0147a5552154f26a88833f9210b1358 P 06ec58698d5444caaecea433c8419770: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.965076  4701 raft_consensus.cc:2804] T a4736bb71dfa4f4b8b80e8a52895acf7 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:04.965656  4701 raft_consensus.cc:697] T a4736bb71dfa4f4b8b80e8a52895acf7 P aa0ff974118b465eaa785b8a86057e87 [term 1 LEADER]: Becoming Leader. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Running, Role: LEADER
I20260709 13:12:04.946385  4681 tablet_bootstrap.cc:492] T 002595643d984c1c915975d4c4ace485 P 74758684df5649ccadd1e189eaff32dc: No bootstrap required, opened a new log
I20260709 13:12:04.966470  4701 consensus_queue.cc:237] T a4736bb71dfa4f4b8b80e8a52895acf7 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:04.966464  4681 ts_tablet_manager.cc:1403] T 002595643d984c1c915975d4c4ace485 P 74758684df5649ccadd1e189eaff32dc: Time spent bootstrapping tablet: real 0.134s	user 0.018s	sys 0.009s
I20260709 13:12:04.972147  4759 raft_consensus.cc:493] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.972692  4759 raft_consensus.cc:515] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:04.974850  4759 leader_election.cc:290] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:04.975348  4759 consensus_queue.cc:1048] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:04.979471  4681 raft_consensus.cc:359] T 002595643d984c1c915975d4c4ace485 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:04.981650  4412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4736bb71dfa4f4b8b80e8a52895acf7" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770"
I20260709 13:12:04.981799  4486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a508f846d314fa0b7ec364af09bc427" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:04.982223  4685 tablet_bootstrap.cc:492] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P aa0ff974118b465eaa785b8a86057e87: No bootstrap required, opened a new log
I20260709 13:12:05.004431  4685 ts_tablet_manager.cc:1403] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P aa0ff974118b465eaa785b8a86057e87: Time spent bootstrapping tablet: real 0.100s	user 0.019s	sys 0.012s
I20260709 13:12:05.007158  4685 raft_consensus.cc:359] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:04.982702  4758 raft_consensus.cc:493] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.010419  4758 raft_consensus.cc:515] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:05.011788  4636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a508f846d314fa0b7ec364af09bc427" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:05.012560  4758 leader_election.cc:290] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:04.980672  4757 leader_election.cc:290] T a4736bb71dfa4f4b8b80e8a52895acf7 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 election: Requested vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:05.013046  4775 consensus_queue.cc:1048] T ea0b275f64bf42cc88bbee81a24d3020 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:05.013108  4685 raft_consensus.cc:385] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.015692  4685 raft_consensus.cc:740] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.016481  4685 consensus_queue.cc:260] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:05.017830  4488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ba2c5f82234a0b8ca6cd31f26f6cfe" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:05.018455  4488 raft_consensus.cc:2468] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 0.
I20260709 13:12:05.018769  4685 ts_tablet_manager.cc:1434] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P aa0ff974118b465eaa785b8a86057e87: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:12:05.020443  4717 consensus_queue.cc:1048] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:05.003755  4412 raft_consensus.cc:3060] T a4736bb71dfa4f4b8b80e8a52895acf7 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.022980  4310 catalog_manager.cc:5697] T a4736bb71dfa4f4b8b80e8a52895acf7 P aa0ff974118b465eaa785b8a86057e87 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa0ff974118b465eaa785b8a86057e87 (127.28.173.2). New cstate: current_term: 1 leader_uuid: "aa0ff974118b465eaa785b8a86057e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:05.025843  4380 leader_election.cc:343] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.034088  4682 tablet_bootstrap.cc:492] T d0147a5552154f26a88833f9210b1358 P 06ec58698d5444caaecea433c8419770: No bootstrap required, opened a new log
W20260709 13:12:05.034919  4380 leader_election.cc:343] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.035104  4682 ts_tablet_manager.cc:1403] T d0147a5552154f26a88833f9210b1358 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.077s	user 0.009s	sys 0.005s
I20260709 13:12:05.035349  4380 leader_election.cc:304] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06ec58698d5444caaecea433c8419770; no voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:05.036707  4687 raft_consensus.cc:2749] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:05.037284  4760 consensus_queue.cc:1048] T 09294b866578436a827c27702d4b1d0b P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:05.037686  4759 consensus_queue.cc:1048] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:05.043363  4412 raft_consensus.cc:2468] T a4736bb71dfa4f4b8b80e8a52895acf7 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 1.
I20260709 13:12:05.029167  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ba2c5f82234a0b8ca6cd31f26f6cfe" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:05.030117  4775 consensus_queue.cc:1048] T ea0b275f64bf42cc88bbee81a24d3020 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:05.020426  4603 leader_election.cc:304] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87; no voters: 
W20260709 13:12:05.051477  4602 leader_election.cc:343] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.041074  4682 raft_consensus.cc:359] T d0147a5552154f26a88833f9210b1358 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:05.019665  4685 tablet_bootstrap.cc:492] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87: Bootstrap starting.
I20260709 13:12:05.003177  4681 raft_consensus.cc:385] T 002595643d984c1c915975d4c4ace485 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.044617  4717 raft_consensus.cc:493] T 5cd01d60553a435387e507f5d6240b58 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.053066  4682 raft_consensus.cc:385] T d0147a5552154f26a88833f9210b1358 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.053300  4758 raft_consensus.cc:2804] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:05.057590  4717 raft_consensus.cc:515] T 5cd01d60553a435387e507f5d6240b58 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:05.034067  4683 tablet_bootstrap.cc:492] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424: No bootstrap required, opened a new log
I20260709 13:12:05.056917  4681 raft_consensus.cc:740] T 002595643d984c1c915975d4c4ace485 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.060006  4717 leader_election.cc:290] T 5cd01d60553a435387e507f5d6240b58 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:05.063761  4683 ts_tablet_manager.cc:1403] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424: Time spent bootstrapping tablet: real 0.122s	user 0.027s	sys 0.027s
I20260709 13:12:05.057678  4758 raft_consensus.cc:493] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.064371  4681 consensus_queue.cc:260] T 002595643d984c1c915975d4c4ace485 P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:05.070989  4681 ts_tablet_manager.cc:1434] T 002595643d984c1c915975d4c4ace485 P 74758684df5649ccadd1e189eaff32dc: Time spent starting tablet: real 0.099s	user 0.005s	sys 0.001s
I20260709 13:12:05.074843  4681 tablet_bootstrap.cc:492] T d1119afee9d6413aa2cd229073ffbcf1 P 74758684df5649ccadd1e189eaff32dc: Bootstrap starting.
I20260709 13:12:05.065296  4637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd01d60553a435387e507f5d6240b58" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:05.066325  4683 raft_consensus.cc:359] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:05.081666  4683 raft_consensus.cc:385] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.081990  4683 raft_consensus.cc:740] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Initialized, Role: FOLLOWER
W20260709 13:12:05.082664  4529 leader_election.cc:343] T 5cd01d60553a435387e507f5d6240b58 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.057580  4682 raft_consensus.cc:740] T d0147a5552154f26a88833f9210b1358 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.064982  4758 raft_consensus.cc:3060] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.072113  4487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd01d60553a435387e507f5d6240b58" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:05.083325  4683 consensus_queue.cc:260] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:05.084053  4717 raft_consensus.cc:493] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.084528  4717 raft_consensus.cc:515] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:05.085716  4683 ts_tablet_manager.cc:1434] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 13:12:05.086757  4683 tablet_bootstrap.cc:492] T d1119afee9d6413aa2cd229073ffbcf1 P 420a61707e804ce5b3773a91cc2eb424: Bootstrap starting.
I20260709 13:12:05.087670  4717 leader_election.cc:290] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:05.087576  4411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb23991ab8504ee491f905a4346edee9" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:05.088835  4411 raft_consensus.cc:2468] T cb23991ab8504ee491f905a4346edee9 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 0.
I20260709 13:12:05.089918  4529 leader_election.cc:304] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: 
I20260709 13:12:05.090925  4717 raft_consensus.cc:2804] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:05.091338  4717 raft_consensus.cc:493] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.091907  4717 raft_consensus.cc:3060] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.092461  4682 consensus_queue.cc:260] T d0147a5552154f26a88833f9210b1358 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:05.091274  4758 raft_consensus.cc:515] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:05.093976  4683 tablet_bootstrap.cc:654] T d1119afee9d6413aa2cd229073ffbcf1 P 420a61707e804ce5b3773a91cc2eb424: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.096122  4562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ba2c5f82234a0b8ca6cd31f26f6cfe" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:05.096539  4487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ba2c5f82234a0b8ca6cd31f26f6cfe" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:05.097078  4487 raft_consensus.cc:3060] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:05.097642  4602 leader_election.cc:343] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.099977  4682 ts_tablet_manager.cc:1434] T d0147a5552154f26a88833f9210b1358 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.065s	user 0.003s	sys 0.004s
I20260709 13:12:05.100956  4682 tablet_bootstrap.cc:492] T 002595643d984c1c915975d4c4ace485 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:05.101079  4683 tablet_bootstrap.cc:492] T d1119afee9d6413aa2cd229073ffbcf1 P 420a61707e804ce5b3773a91cc2eb424: No bootstrap required, opened a new log
I20260709 13:12:05.101619  4683 ts_tablet_manager.cc:1403] T d1119afee9d6413aa2cd229073ffbcf1 P 420a61707e804ce5b3773a91cc2eb424: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.003s
I20260709 13:12:05.101436  4717 raft_consensus.cc:515] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:05.103526  4717 leader_election.cc:290] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 election: Requested vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:05.103937  4758 leader_election.cc:290] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 election: Requested vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:05.104458  4683 raft_consensus.cc:359] T d1119afee9d6413aa2cd229073ffbcf1 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:05.105121  4683 raft_consensus.cc:385] T d1119afee9d6413aa2cd229073ffbcf1 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.105034  4411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb23991ab8504ee491f905a4346edee9" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770"
I20260709 13:12:05.105499  4683 raft_consensus.cc:740] T d1119afee9d6413aa2cd229073ffbcf1 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.105669  4411 raft_consensus.cc:3060] T cb23991ab8504ee491f905a4346edee9 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.106021  4487 raft_consensus.cc:2468] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 1.
I20260709 13:12:05.106178  4683 consensus_queue.cc:260] T d1119afee9d6413aa2cd229073ffbcf1 P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:05.107522  4603 leader_election.cc:304] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87; no voters: 420a61707e804ce5b3773a91cc2eb424
I20260709 13:12:05.108404  4691 consensus_queue.cc:1048] T 39bf585adcc94606975982efe4640189 P 74758684df5649ccadd1e189eaff32dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:05.109865  4691 raft_consensus.cc:2804] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:05.110299  4691 raft_consensus.cc:697] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 74758684df5649ccadd1e189eaff32dc [term 1 LEADER]: Becoming Leader. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Running, Role: LEADER
I20260709 13:12:05.111109  4691 consensus_queue.cc:237] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 74758684df5649ccadd1e189eaff32dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:05.113201  4488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb23991ab8504ee491f905a4346edee9" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:05.113874  4488 raft_consensus.cc:2468] T cb23991ab8504ee491f905a4346edee9 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 0.
I20260709 13:12:05.108392  4683 ts_tablet_manager.cc:1434] T d1119afee9d6413aa2cd229073ffbcf1 P 420a61707e804ce5b3773a91cc2eb424: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:12:05.114425  4682 tablet_bootstrap.cc:654] T 002595643d984c1c915975d4c4ace485 P 06ec58698d5444caaecea433c8419770: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.115321  4683 tablet_bootstrap.cc:492] T 002595643d984c1c915975d4c4ace485 P 420a61707e804ce5b3773a91cc2eb424: Bootstrap starting.
W20260709 13:12:05.120524  4529 leader_election.cc:343] T 5cd01d60553a435387e507f5d6240b58 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.120707  4489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb23991ab8504ee491f905a4346edee9" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:05.122170  4489 raft_consensus.cc:3060] T cb23991ab8504ee491f905a4346edee9 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.123092  4685 tablet_bootstrap.cc:654] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.121408  4529 leader_election.cc:304] T 5cd01d60553a435387e507f5d6240b58 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424; no voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:05.125901  4683 tablet_bootstrap.cc:654] T 002595643d984c1c915975d4c4ace485 P 420a61707e804ce5b3773a91cc2eb424: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.136615  4774 raft_consensus.cc:2749] T 5cd01d60553a435387e507f5d6240b58 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:05.138896  4411 raft_consensus.cc:2468] T cb23991ab8504ee491f905a4346edee9 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 1.
I20260709 13:12:05.142048  4529 leader_election.cc:304] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: 
I20260709 13:12:05.142551  4489 raft_consensus.cc:2468] T cb23991ab8504ee491f905a4346edee9 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 1.
I20260709 13:12:05.144225  4774 raft_consensus.cc:2804] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:05.144882  4774 raft_consensus.cc:697] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424 [term 1 LEADER]: Becoming Leader. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Running, Role: LEADER
I20260709 13:12:05.145998  4774 consensus_queue.cc:237] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:05.161276  4681 tablet_bootstrap.cc:654] T d1119afee9d6413aa2cd229073ffbcf1 P 74758684df5649ccadd1e189eaff32dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.166949  4682 tablet_bootstrap.cc:492] T 002595643d984c1c915975d4c4ace485 P 06ec58698d5444caaecea433c8419770: No bootstrap required, opened a new log
I20260709 13:12:05.167439  4682 ts_tablet_manager.cc:1403] T 002595643d984c1c915975d4c4ace485 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.067s	user 0.013s	sys 0.013s
I20260709 13:12:05.169620  4683 tablet_bootstrap.cc:492] T 002595643d984c1c915975d4c4ace485 P 420a61707e804ce5b3773a91cc2eb424: No bootstrap required, opened a new log
I20260709 13:12:05.170122  4683 ts_tablet_manager.cc:1403] T 002595643d984c1c915975d4c4ace485 P 420a61707e804ce5b3773a91cc2eb424: Time spent bootstrapping tablet: real 0.055s	user 0.026s	sys 0.010s
I20260709 13:12:05.170914  4309 catalog_manager.cc:5697] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 74758684df5649ccadd1e189eaff32dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 74758684df5649ccadd1e189eaff32dc (127.28.173.4). New cstate: current_term: 1 leader_uuid: "74758684df5649ccadd1e189eaff32dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:05.172794  4683 raft_consensus.cc:359] T 002595643d984c1c915975d4c4ace485 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:05.173484  4683 raft_consensus.cc:385] T 002595643d984c1c915975d4c4ace485 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.173775  4683 raft_consensus.cc:740] T 002595643d984c1c915975d4c4ace485 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.174098  4758 consensus_queue.cc:1048] T 39bf585adcc94606975982efe4640189 P 74758684df5649ccadd1e189eaff32dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:05.174450  4683 consensus_queue.cc:260] T 002595643d984c1c915975d4c4ace485 P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:05.176579  4683 ts_tablet_manager.cc:1434] T 002595643d984c1c915975d4c4ace485 P 420a61707e804ce5b3773a91cc2eb424: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:12:05.176183  4308 catalog_manager.cc:5697] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424 reported cstate change: term changed from 0 to 1, leader changed from <none> to 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3). New cstate: current_term: 1 leader_uuid: "420a61707e804ce5b3773a91cc2eb424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:05.177493  4683 tablet_bootstrap.cc:492] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 420a61707e804ce5b3773a91cc2eb424: Bootstrap starting.
I20260709 13:12:05.178721  4682 raft_consensus.cc:359] T 002595643d984c1c915975d4c4ace485 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:05.179400  4682 raft_consensus.cc:385] T 002595643d984c1c915975d4c4ace485 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.179666  4682 raft_consensus.cc:740] T 002595643d984c1c915975d4c4ace485 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.180603  4682 consensus_queue.cc:260] T 002595643d984c1c915975d4c4ace485 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:05.182951  4682 ts_tablet_manager.cc:1434] T 002595643d984c1c915975d4c4ace485 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.004s
I20260709 13:12:05.185353  4682 tablet_bootstrap.cc:492] T 1503964d57034b31b36eecc16f2c84a0 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:05.191088  4683 tablet_bootstrap.cc:654] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 420a61707e804ce5b3773a91cc2eb424: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.191787  4682 tablet_bootstrap.cc:654] T 1503964d57034b31b36eecc16f2c84a0 P 06ec58698d5444caaecea433c8419770: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.204200  4681 tablet_bootstrap.cc:492] T d1119afee9d6413aa2cd229073ffbcf1 P 74758684df5649ccadd1e189eaff32dc: No bootstrap required, opened a new log
I20260709 13:12:05.204710  4681 ts_tablet_manager.cc:1403] T d1119afee9d6413aa2cd229073ffbcf1 P 74758684df5649ccadd1e189eaff32dc: Time spent bootstrapping tablet: real 0.130s	user 0.015s	sys 0.006s
I20260709 13:12:05.210117  4685 tablet_bootstrap.cc:492] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87: No bootstrap required, opened a new log
I20260709 13:12:05.210615  4685 ts_tablet_manager.cc:1403] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87: Time spent bootstrapping tablet: real 0.191s	user 0.012s	sys 0.000s
I20260709 13:12:05.213251  4685 raft_consensus.cc:359] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:05.213909  4685 raft_consensus.cc:385] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.214190  4685 raft_consensus.cc:740] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.214857  4685 consensus_queue.cc:260] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:05.220525  4683 tablet_bootstrap.cc:492] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 420a61707e804ce5b3773a91cc2eb424: No bootstrap required, opened a new log
I20260709 13:12:05.221024  4683 ts_tablet_manager.cc:1403] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 420a61707e804ce5b3773a91cc2eb424: Time spent bootstrapping tablet: real 0.044s	user 0.016s	sys 0.012s
I20260709 13:12:05.221434  4682 tablet_bootstrap.cc:492] T 1503964d57034b31b36eecc16f2c84a0 P 06ec58698d5444caaecea433c8419770: No bootstrap required, opened a new log
I20260709 13:12:05.221901  4682 ts_tablet_manager.cc:1403] T 1503964d57034b31b36eecc16f2c84a0 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.006s
I20260709 13:12:05.224409  4682 raft_consensus.cc:359] T 1503964d57034b31b36eecc16f2c84a0 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:05.225087  4682 raft_consensus.cc:385] T 1503964d57034b31b36eecc16f2c84a0 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.225351  4682 raft_consensus.cc:740] T 1503964d57034b31b36eecc16f2c84a0 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.226099  4682 consensus_queue.cc:260] T 1503964d57034b31b36eecc16f2c84a0 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:05.227928  4683 raft_consensus.cc:359] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:05.228412  4682 ts_tablet_manager.cc:1434] T 1503964d57034b31b36eecc16f2c84a0 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:12:05.228637  4683 raft_consensus.cc:385] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.228989  4683 raft_consensus.cc:740] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.229401  4682 tablet_bootstrap.cc:492] T d1119afee9d6413aa2cd229073ffbcf1 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:05.229867  4685 ts_tablet_manager.cc:1434] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:12:05.229633  4683 consensus_queue.cc:260] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:05.231243  4774 consensus_queue.cc:1048] T b60a97e129dc4aa9a43f2c44ec5181a8 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:05.232978  4683 ts_tablet_manager.cc:1434] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 420a61707e804ce5b3773a91cc2eb424: Time spent starting tablet: real 0.012s	user 0.011s	sys 0.000s
I20260709 13:12:05.233840  4683 tablet_bootstrap.cc:492] T 604a93ed898f4ab9b771487bfe278b33 P 420a61707e804ce5b3773a91cc2eb424: Bootstrap starting.
I20260709 13:12:05.234253  4685 tablet_bootstrap.cc:492] T 5cd01d60553a435387e507f5d6240b58 P aa0ff974118b465eaa785b8a86057e87: Bootstrap starting.
I20260709 13:12:05.235126  4717 raft_consensus.cc:493] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.235780  4682 tablet_bootstrap.cc:654] T d1119afee9d6413aa2cd229073ffbcf1 P 06ec58698d5444caaecea433c8419770: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.235579  4717 raft_consensus.cc:515] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:05.237756  4717 leader_election.cc:290] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:05.239450  4683 tablet_bootstrap.cc:654] T 604a93ed898f4ab9b771487bfe278b33 P 420a61707e804ce5b3773a91cc2eb424: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.240263  4486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ba2c5f82234a0b8ca6cd31f26f6cfe" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:05.241143  4486 raft_consensus.cc:2393] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 420a61707e804ce5b3773a91cc2eb424 in current term 1: Already voted for candidate 74758684df5649ccadd1e189eaff32dc in this term.
I20260709 13:12:05.241255  4636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ba2c5f82234a0b8ca6cd31f26f6cfe" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:05.247735  4682 tablet_bootstrap.cc:492] T d1119afee9d6413aa2cd229073ffbcf1 P 06ec58698d5444caaecea433c8419770: No bootstrap required, opened a new log
I20260709 13:12:05.248214  4682 ts_tablet_manager.cc:1403] T d1119afee9d6413aa2cd229073ffbcf1 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.007s
I20260709 13:12:05.249303  4529 leader_election.cc:304] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424; no voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:05.250923  4717 raft_consensus.cc:3060] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.250938  4682 raft_consensus.cc:359] T d1119afee9d6413aa2cd229073ffbcf1 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:05.251873  4682 raft_consensus.cc:385] T d1119afee9d6413aa2cd229073ffbcf1 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.252138  4682 raft_consensus.cc:740] T d1119afee9d6413aa2cd229073ffbcf1 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.252859  4682 consensus_queue.cc:260] T d1119afee9d6413aa2cd229073ffbcf1 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:05.255365  4682 ts_tablet_manager.cc:1434] T d1119afee9d6413aa2cd229073ffbcf1 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:05.258011  4682 tablet_bootstrap.cc:492] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:05.267781  4682 tablet_bootstrap.cc:654] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.280393  4685 tablet_bootstrap.cc:654] T 5cd01d60553a435387e507f5d6240b58 P aa0ff974118b465eaa785b8a86057e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.283134  4683 tablet_bootstrap.cc:492] T 604a93ed898f4ab9b771487bfe278b33 P 420a61707e804ce5b3773a91cc2eb424: No bootstrap required, opened a new log
I20260709 13:12:05.283674  4683 ts_tablet_manager.cc:1403] T 604a93ed898f4ab9b771487bfe278b33 P 420a61707e804ce5b3773a91cc2eb424: Time spent bootstrapping tablet: real 0.050s	user 0.020s	sys 0.022s
I20260709 13:12:05.287360  4683 raft_consensus.cc:359] T 604a93ed898f4ab9b771487bfe278b33 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:05.288394  4683 raft_consensus.cc:385] T 604a93ed898f4ab9b771487bfe278b33 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.288775  4683 raft_consensus.cc:740] T 604a93ed898f4ab9b771487bfe278b33 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.289621  4683 consensus_queue.cc:260] T 604a93ed898f4ab9b771487bfe278b33 P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:05.292696  4683 ts_tablet_manager.cc:1434] T 604a93ed898f4ab9b771487bfe278b33 P 420a61707e804ce5b3773a91cc2eb424: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:12:05.299057  4683 tablet_bootstrap.cc:492] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 420a61707e804ce5b3773a91cc2eb424: Bootstrap starting.
I20260709 13:12:05.300443  4681 raft_consensus.cc:359] T d1119afee9d6413aa2cd229073ffbcf1 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:05.301115  4681 raft_consensus.cc:385] T d1119afee9d6413aa2cd229073ffbcf1 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.301358  4681 raft_consensus.cc:740] T d1119afee9d6413aa2cd229073ffbcf1 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.302022  4681 consensus_queue.cc:260] T d1119afee9d6413aa2cd229073ffbcf1 P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:05.304944  4681 ts_tablet_manager.cc:1434] T d1119afee9d6413aa2cd229073ffbcf1 P 74758684df5649ccadd1e189eaff32dc: Time spent starting tablet: real 0.100s	user 0.005s	sys 0.002s
I20260709 13:12:05.305840  4681 tablet_bootstrap.cc:492] T 3092a6c40d0d4610968fe09d4c7d16c0 P 74758684df5649ccadd1e189eaff32dc: Bootstrap starting.
I20260709 13:12:05.307727  4683 tablet_bootstrap.cc:654] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 420a61707e804ce5b3773a91cc2eb424: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.313823  4717 raft_consensus.cc:2749] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:05.321135  4760 raft_consensus.cc:493] T d0147a5552154f26a88833f9210b1358 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.321671  4760 raft_consensus.cc:515] T d0147a5552154f26a88833f9210b1358 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:05.325282  4636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0147a5552154f26a88833f9210b1358" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:05.330446  4681 tablet_bootstrap.cc:654] T 3092a6c40d0d4610968fe09d4c7d16c0 P 74758684df5649ccadd1e189eaff32dc: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:05.331176  4380 leader_election.cc:343] T d0147a5552154f26a88833f9210b1358 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.323688  4760 leader_election.cc:290] T d0147a5552154f26a88833f9210b1358 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:05.342770  4685 tablet_bootstrap.cc:492] T 5cd01d60553a435387e507f5d6240b58 P aa0ff974118b465eaa785b8a86057e87: No bootstrap required, opened a new log
I20260709 13:12:05.343160  4683 tablet_bootstrap.cc:492] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 420a61707e804ce5b3773a91cc2eb424: No bootstrap required, opened a new log
I20260709 13:12:05.343264  4685 ts_tablet_manager.cc:1403] T 5cd01d60553a435387e507f5d6240b58 P aa0ff974118b465eaa785b8a86057e87: Time spent bootstrapping tablet: real 0.109s	user 0.021s	sys 0.005s
I20260709 13:12:05.343657  4683 ts_tablet_manager.cc:1403] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 420a61707e804ce5b3773a91cc2eb424: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.003s
I20260709 13:12:05.346906  4683 raft_consensus.cc:359] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:05.347558  4683 raft_consensus.cc:385] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.347824  4683 raft_consensus.cc:740] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.348483  4683 consensus_queue.cc:260] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:05.345985  4685 raft_consensus.cc:359] T 5cd01d60553a435387e507f5d6240b58 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
W20260709 13:12:05.350615  4358 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:05.350625  4683 ts_tablet_manager.cc:1434] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 420a61707e804ce5b3773a91cc2eb424: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:05.350648  4489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0147a5552154f26a88833f9210b1358" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:05.351661  4685 raft_consensus.cc:385] T 5cd01d60553a435387e507f5d6240b58 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.352540  4683 tablet_bootstrap.cc:492] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424: Bootstrap starting.
I20260709 13:12:05.352538  4685 raft_consensus.cc:740] T 5cd01d60553a435387e507f5d6240b58 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Initialized, Role: FOLLOWER
W20260709 13:12:05.352870  4380 leader_election.cc:343] T d0147a5552154f26a88833f9210b1358 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.353430  4380 leader_election.cc:304] T d0147a5552154f26a88833f9210b1358 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06ec58698d5444caaecea433c8419770; no voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:05.353622  4685 consensus_queue.cc:260] T 5cd01d60553a435387e507f5d6240b58 P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:05.354641  4760 raft_consensus.cc:2749] T d0147a5552154f26a88833f9210b1358 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:05.355942  4685 ts_tablet_manager.cc:1434] T 5cd01d60553a435387e507f5d6240b58 P aa0ff974118b465eaa785b8a86057e87: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260709 13:12:05.362704  4774 consensus_queue.cc:1048] T b60a97e129dc4aa9a43f2c44ec5181a8 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:05.365034  4683 tablet_bootstrap.cc:654] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.367722  4682 tablet_bootstrap.cc:492] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770: No bootstrap required, opened a new log
I20260709 13:12:05.370966  4691 raft_consensus.cc:493] T 002595643d984c1c915975d4c4ace485 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.370201  4685 tablet_bootstrap.cc:492] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87: Bootstrap starting.
I20260709 13:12:05.371434  4701 consensus_queue.cc:1048] T a4736bb71dfa4f4b8b80e8a52895acf7 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:05.371483  4691 raft_consensus.cc:515] T 002595643d984c1c915975d4c4ace485 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:05.373777  4691 leader_election.cc:290] T 002595643d984c1c915975d4c4ace485 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:05.374100  4849 raft_consensus.cc:493] T 002595643d984c1c915975d4c4ace485 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.374567  4849 raft_consensus.cc:515] T 002595643d984c1c915975d4c4ace485 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:05.375280  4412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002595643d984c1c915975d4c4ace485" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:05.376595  4849 leader_election.cc:290] T 002595643d984c1c915975d4c4ace485 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:05.377518  4412 raft_consensus.cc:2468] T 002595643d984c1c915975d4c4ace485 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 0.
I20260709 13:12:05.378854  4682 ts_tablet_manager.cc:1403] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.121s	user 0.016s	sys 0.017s
I20260709 13:12:05.379220  4562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002595643d984c1c915975d4c4ace485" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:05.379879  4562 raft_consensus.cc:2468] T 002595643d984c1c915975d4c4ace485 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 0.
I20260709 13:12:05.378876  4603 leader_election.cc:304] T 002595643d984c1c915975d4c4ace485 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 74758684df5649ccadd1e189eaff32dc; no voters: 
I20260709 13:12:05.378927  4635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002595643d984c1c915975d4c4ace485" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:05.382862  4635 raft_consensus.cc:2468] T 002595643d984c1c915975d4c4ace485 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 0.
I20260709 13:12:05.383070  4412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002595643d984c1c915975d4c4ace485" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:05.383682  4412 raft_consensus.cc:2468] T 002595643d984c1c915975d4c4ace485 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 0.
I20260709 13:12:05.384689  4691 raft_consensus.cc:2804] T 002595643d984c1c915975d4c4ace485 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:05.385030  4691 raft_consensus.cc:493] T 002595643d984c1c915975d4c4ace485 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.385317  4691 raft_consensus.cc:3060] T 002595643d984c1c915975d4c4ace485 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.385450  4529 leader_election.cc:304] T 002595643d984c1c915975d4c4ace485 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: 
I20260709 13:12:05.386248  4849 raft_consensus.cc:2804] T 002595643d984c1c915975d4c4ace485 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:05.386612  4849 raft_consensus.cc:493] T 002595643d984c1c915975d4c4ace485 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.386910  4849 raft_consensus.cc:3060] T 002595643d984c1c915975d4c4ace485 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.392246  4682 raft_consensus.cc:359] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:05.393044  4682 raft_consensus.cc:385] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.393366  4682 raft_consensus.cc:740] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.398108  4685 tablet_bootstrap.cc:654] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.400543  4682 consensus_queue.cc:260] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:05.401628  4760 raft_consensus.cc:493] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.402217  4760 raft_consensus.cc:515] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:05.405876  4681 tablet_bootstrap.cc:492] T 3092a6c40d0d4610968fe09d4c7d16c0 P 74758684df5649ccadd1e189eaff32dc: No bootstrap required, opened a new log
I20260709 13:12:05.406351  4681 ts_tablet_manager.cc:1403] T 3092a6c40d0d4610968fe09d4c7d16c0 P 74758684df5649ccadd1e189eaff32dc: Time spent bootstrapping tablet: real 0.101s	user 0.021s	sys 0.014s
I20260709 13:12:05.407160  4489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20be30df26724e7f98f3b36f24e4df3a" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
W20260709 13:12:05.408499  4380 leader_election.cc:343] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.409157  4681 raft_consensus.cc:359] T 3092a6c40d0d4610968fe09d4c7d16c0 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:05.410239  4681 raft_consensus.cc:385] T 3092a6c40d0d4610968fe09d4c7d16c0 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.410570  4681 raft_consensus.cc:740] T 3092a6c40d0d4610968fe09d4c7d16c0 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.410451  4849 raft_consensus.cc:515] T 002595643d984c1c915975d4c4ace485 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:05.411450  4681 consensus_queue.cc:260] T 3092a6c40d0d4610968fe09d4c7d16c0 P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:05.412552  4849 leader_election.cc:290] T 002595643d984c1c915975d4c4ace485 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 election: Requested vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:05.414260  4683 tablet_bootstrap.cc:492] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424: No bootstrap required, opened a new log
I20260709 13:12:05.414088  4635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002595643d984c1c915975d4c4ace485" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:05.414724  4683 ts_tablet_manager.cc:1403] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424: Time spent bootstrapping tablet: real 0.062s	user 0.008s	sys 0.003s
I20260709 13:12:05.415251  4681 ts_tablet_manager.cc:1434] T 3092a6c40d0d4610968fe09d4c7d16c0 P 74758684df5649ccadd1e189eaff32dc: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:12:05.416340  4681 tablet_bootstrap.cc:492] T d0147a5552154f26a88833f9210b1358 P 74758684df5649ccadd1e189eaff32dc: Bootstrap starting.
I20260709 13:12:05.417518  4412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002595643d984c1c915975d4c4ace485" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770"
I20260709 13:12:05.419112  4757 consensus_queue.cc:1048] T a4736bb71dfa4f4b8b80e8a52895acf7 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:05.418084  4412 raft_consensus.cc:3060] T 002595643d984c1c915975d4c4ace485 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.422672  4681 tablet_bootstrap.cc:654] T d0147a5552154f26a88833f9210b1358 P 74758684df5649ccadd1e189eaff32dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.425964  4760 leader_election.cc:290] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:05.426944  4562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20be30df26724e7f98f3b36f24e4df3a" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:05.427636  4562 raft_consensus.cc:2468] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 0.
I20260709 13:12:05.428746  4379 leader_election.cc:304] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:05.429188  4691 raft_consensus.cc:515] T 002595643d984c1c915975d4c4ace485 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:05.429975  4760 raft_consensus.cc:2804] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:05.430326  4635 raft_consensus.cc:2393] T 002595643d984c1c915975d4c4ace485 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 420a61707e804ce5b3773a91cc2eb424 in current term 1: Already voted for candidate 74758684df5649ccadd1e189eaff32dc in this term.
I20260709 13:12:05.430558  4760 raft_consensus.cc:493] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.430932  4760 raft_consensus.cc:3060] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.434113  4681 tablet_bootstrap.cc:492] T d0147a5552154f26a88833f9210b1358 P 74758684df5649ccadd1e189eaff32dc: No bootstrap required, opened a new log
I20260709 13:12:05.434574  4681 ts_tablet_manager.cc:1403] T d0147a5552154f26a88833f9210b1358 P 74758684df5649ccadd1e189eaff32dc: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.008s
I20260709 13:12:05.440124  4681 raft_consensus.cc:359] T d0147a5552154f26a88833f9210b1358 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:05.441075  4681 raft_consensus.cc:385] T d0147a5552154f26a88833f9210b1358 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.441443  4681 raft_consensus.cc:740] T d0147a5552154f26a88833f9210b1358 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.442327  4681 consensus_queue.cc:260] T d0147a5552154f26a88833f9210b1358 P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:05.446079  4681 ts_tablet_manager.cc:1434] T d0147a5552154f26a88833f9210b1358 P 74758684df5649ccadd1e189eaff32dc: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:12:05.447382  4681 tablet_bootstrap.cc:492] T 1503964d57034b31b36eecc16f2c84a0 P 74758684df5649ccadd1e189eaff32dc: Bootstrap starting.
I20260709 13:12:05.457329  4412 raft_consensus.cc:2468] T 002595643d984c1c915975d4c4ace485 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 1.
I20260709 13:12:05.458890  4683 raft_consensus.cc:359] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:05.460961  4683 raft_consensus.cc:385] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.461246  4683 raft_consensus.cc:740] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.462383  4683 consensus_queue.cc:260] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:05.467713  4683 ts_tablet_manager.cc:1434] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424: Time spent starting tablet: real 0.053s	user 0.005s	sys 0.003s
I20260709 13:12:05.468662  4683 tablet_bootstrap.cc:492] T 3092a6c40d0d4610968fe09d4c7d16c0 P 420a61707e804ce5b3773a91cc2eb424: Bootstrap starting.
I20260709 13:12:05.474578  4683 tablet_bootstrap.cc:654] T 3092a6c40d0d4610968fe09d4c7d16c0 P 420a61707e804ce5b3773a91cc2eb424: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.475152  4562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002595643d984c1c915975d4c4ace485" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:05.476253  4562 raft_consensus.cc:2393] T 002595643d984c1c915975d4c4ace485 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 74758684df5649ccadd1e189eaff32dc in current term 1: Already voted for candidate 420a61707e804ce5b3773a91cc2eb424 in this term.
I20260709 13:12:05.474426  4691 leader_election.cc:290] T 002595643d984c1c915975d4c4ace485 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 election: Requested vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:05.476823  4411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002595643d984c1c915975d4c4ace485" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770"
I20260709 13:12:05.477650  4411 raft_consensus.cc:2393] T 002595643d984c1c915975d4c4ace485 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 74758684df5649ccadd1e189eaff32dc in current term 1: Already voted for candidate 420a61707e804ce5b3773a91cc2eb424 in this term.
I20260709 13:12:05.478068  4529 leader_election.cc:304] T 002595643d984c1c915975d4c4ace485 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: 74758684df5649ccadd1e189eaff32dc
I20260709 13:12:05.479074  4603 leader_election.cc:304] T 002595643d984c1c915975d4c4ace485 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc; no voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424
I20260709 13:12:05.480742  4849 raft_consensus.cc:2804] T 002595643d984c1c915975d4c4ace485 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:05.483114  4849 raft_consensus.cc:697] T 002595643d984c1c915975d4c4ace485 P 420a61707e804ce5b3773a91cc2eb424 [term 1 LEADER]: Becoming Leader. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Running, Role: LEADER
I20260709 13:12:05.484237  4849 consensus_queue.cc:237] T 002595643d984c1c915975d4c4ace485 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:05.485220  4760 raft_consensus.cc:515] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:05.488358  4681 tablet_bootstrap.cc:654] T 1503964d57034b31b36eecc16f2c84a0 P 74758684df5649ccadd1e189eaff32dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.489693  4682 ts_tablet_manager.cc:1434] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.110s	user 0.006s	sys 0.003s
I20260709 13:12:05.492883  4717 raft_consensus.cc:493] T 604a93ed898f4ab9b771487bfe278b33 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.493350  4717 raft_consensus.cc:515] T 604a93ed898f4ab9b771487bfe278b33 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:05.501044  4717 leader_election.cc:290] T 604a93ed898f4ab9b771487bfe278b33 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:05.502897  4411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604a93ed898f4ab9b771487bfe278b33" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
W20260709 13:12:05.505206  4529 leader_election.cc:343] T 604a93ed898f4ab9b771487bfe278b33 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.510385  4743 raft_consensus.cc:493] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.510963  4743 raft_consensus.cc:515] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:05.493325  4682 tablet_bootstrap.cc:492] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:05.514268  4743 leader_election.cc:290] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:05.516752  4411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dbb9c8f1ac4eca802b0c887a4d1c27" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:05.517993  4489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dbb9c8f1ac4eca802b0c887a4d1c27" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
W20260709 13:12:05.518628  4529 leader_election.cc:343] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:05.519593  4529 leader_election.cc:343] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.520192  4529 leader_election.cc:304] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424; no voters: 06ec58698d5444caaecea433c8419770, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:05.521605  4717 raft_consensus.cc:2749] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:05.525826  4636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604a93ed898f4ab9b771487bfe278b33" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:05.526635  4691 raft_consensus.cc:2749] T 002595643d984c1c915975d4c4ace485 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:05.531512  4489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20be30df26724e7f98f3b36f24e4df3a" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
W20260709 13:12:05.533282  4380 leader_election.cc:343] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.540551  4760 leader_election.cc:290] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Requested vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:05.541658  4562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20be30df26724e7f98f3b36f24e4df3a" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:05.539727  4682 tablet_bootstrap.cc:654] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 06ec58698d5444caaecea433c8419770: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.542272  4562 raft_consensus.cc:3060] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.544035  4685 tablet_bootstrap.cc:492] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87: No bootstrap required, opened a new log
I20260709 13:12:05.544478  4685 ts_tablet_manager.cc:1403] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87: Time spent bootstrapping tablet: real 0.174s	user 0.048s	sys 0.061s
I20260709 13:12:05.544798  4717 raft_consensus.cc:493] T d1119afee9d6413aa2cd229073ffbcf1 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.545274  4717 raft_consensus.cc:515] T d1119afee9d6413aa2cd229073ffbcf1 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:05.547293  4717 leader_election.cc:290] T d1119afee9d6413aa2cd229073ffbcf1 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:05.547983  4637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1119afee9d6413aa2cd229073ffbcf1" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:05.548658  4637 raft_consensus.cc:2468] T d1119afee9d6413aa2cd229073ffbcf1 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 0.
I20260709 13:12:05.550426  4411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1119afee9d6413aa2cd229073ffbcf1" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:05.551157  4411 raft_consensus.cc:2468] T d1119afee9d6413aa2cd229073ffbcf1 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 0.
I20260709 13:12:05.551837  4562 raft_consensus.cc:2468] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 1.
I20260709 13:12:05.552331  4529 leader_election.cc:304] T d1119afee9d6413aa2cd229073ffbcf1 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: 
I20260709 13:12:05.553190  4717 raft_consensus.cc:2804] T d1119afee9d6413aa2cd229073ffbcf1 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:05.553545  4379 leader_election.cc:304] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:05.553716  4685 raft_consensus.cc:359] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:05.554435  4685 raft_consensus.cc:385] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.554567  4760 raft_consensus.cc:2804] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:05.554721  4685 raft_consensus.cc:740] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.553567  4717 raft_consensus.cc:493] T d1119afee9d6413aa2cd229073ffbcf1 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.555174  4760 raft_consensus.cc:697] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770 [term 1 LEADER]: Becoming Leader. State: Replica: 06ec58698d5444caaecea433c8419770, State: Running, Role: LEADER
I20260709 13:12:05.555292  4717 raft_consensus.cc:3060] T d1119afee9d6413aa2cd229073ffbcf1 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.555759  4685 consensus_queue.cc:260] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:05.556319  4760 consensus_queue.cc:237] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:05.557878  4685 ts_tablet_manager.cc:1434] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:12:05.559221  4685 tablet_bootstrap.cc:492] T d0147a5552154f26a88833f9210b1358 P aa0ff974118b465eaa785b8a86057e87: Bootstrap starting.
I20260709 13:12:05.563942  4758 consensus_queue.cc:1048] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 74758684df5649ccadd1e189eaff32dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:05.568614  4685 tablet_bootstrap.cc:654] T d0147a5552154f26a88833f9210b1358 P aa0ff974118b465eaa785b8a86057e87: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:05.570508  4529 leader_election.cc:343] T 604a93ed898f4ab9b771487bfe278b33 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.570989  4529 leader_election.cc:304] T 604a93ed898f4ab9b771487bfe278b33 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424; no voters: 06ec58698d5444caaecea433c8419770, 74758684df5649ccadd1e189eaff32dc
I20260709 13:12:05.565384  4717 raft_consensus.cc:515] T d1119afee9d6413aa2cd229073ffbcf1 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:05.584731  4311 catalog_manager.cc:5697] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06ec58698d5444caaecea433c8419770 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "06ec58698d5444caaecea433c8419770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:05.586427  4717 leader_election.cc:290] T d1119afee9d6413aa2cd229073ffbcf1 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 election: Requested vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:05.587103  4636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1119afee9d6413aa2cd229073ffbcf1" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:05.587709  4636 raft_consensus.cc:3060] T d1119afee9d6413aa2cd229073ffbcf1 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.587625  4411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1119afee9d6413aa2cd229073ffbcf1" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770"
I20260709 13:12:05.572568  4683 tablet_bootstrap.cc:492] T 3092a6c40d0d4610968fe09d4c7d16c0 P 420a61707e804ce5b3773a91cc2eb424: No bootstrap required, opened a new log
I20260709 13:12:05.572911  4774 raft_consensus.cc:2749] T 604a93ed898f4ab9b771487bfe278b33 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:05.588910  4683 ts_tablet_manager.cc:1403] T 3092a6c40d0d4610968fe09d4c7d16c0 P 420a61707e804ce5b3773a91cc2eb424: Time spent bootstrapping tablet: real 0.120s	user 0.019s	sys 0.014s
I20260709 13:12:05.573388  4758 consensus_queue.cc:1048] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 74758684df5649ccadd1e189eaff32dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:05.591730  4683 raft_consensus.cc:359] T 3092a6c40d0d4610968fe09d4c7d16c0 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:05.592406  4683 raft_consensus.cc:385] T 3092a6c40d0d4610968fe09d4c7d16c0 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.592628  4683 raft_consensus.cc:740] T 3092a6c40d0d4610968fe09d4c7d16c0 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.593228  4683 consensus_queue.cc:260] T 3092a6c40d0d4610968fe09d4c7d16c0 P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:05.594949  4683 ts_tablet_manager.cc:1434] T 3092a6c40d0d4610968fe09d4c7d16c0 P 420a61707e804ce5b3773a91cc2eb424: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:12:05.595767  4683 tablet_bootstrap.cc:492] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 420a61707e804ce5b3773a91cc2eb424: Bootstrap starting.
I20260709 13:12:05.597415  4636 raft_consensus.cc:2468] T d1119afee9d6413aa2cd229073ffbcf1 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 1.
I20260709 13:12:05.600692  4685 tablet_bootstrap.cc:492] T d0147a5552154f26a88833f9210b1358 P aa0ff974118b465eaa785b8a86057e87: No bootstrap required, opened a new log
I20260709 13:12:05.601155  4685 ts_tablet_manager.cc:1403] T d0147a5552154f26a88833f9210b1358 P aa0ff974118b465eaa785b8a86057e87: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.010s
I20260709 13:12:05.602212  4683 tablet_bootstrap.cc:654] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 420a61707e804ce5b3773a91cc2eb424: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.602805  4529 leader_election.cc:304] T d1119afee9d6413aa2cd229073ffbcf1 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc; no voters: 
I20260709 13:12:05.603654  4774 raft_consensus.cc:2804] T d1119afee9d6413aa2cd229073ffbcf1 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:05.604149  4774 raft_consensus.cc:697] T d1119afee9d6413aa2cd229073ffbcf1 P 420a61707e804ce5b3773a91cc2eb424 [term 1 LEADER]: Becoming Leader. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Running, Role: LEADER
I20260709 13:12:05.603896  4685 raft_consensus.cc:359] T d0147a5552154f26a88833f9210b1358 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:05.604925  4685 raft_consensus.cc:385] T d0147a5552154f26a88833f9210b1358 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.605304  4685 raft_consensus.cc:740] T d0147a5552154f26a88833f9210b1358 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.605624  4681 tablet_bootstrap.cc:492] T 1503964d57034b31b36eecc16f2c84a0 P 74758684df5649ccadd1e189eaff32dc: No bootstrap required, opened a new log
I20260709 13:12:05.614827  4681 ts_tablet_manager.cc:1403] T 1503964d57034b31b36eecc16f2c84a0 P 74758684df5649ccadd1e189eaff32dc: Time spent bootstrapping tablet: real 0.168s	user 0.019s	sys 0.016s
I20260709 13:12:05.604964  4774 consensus_queue.cc:237] T d1119afee9d6413aa2cd229073ffbcf1 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:05.588349  4411 raft_consensus.cc:3060] T d1119afee9d6413aa2cd229073ffbcf1 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.614897  4685 consensus_queue.cc:260] T d0147a5552154f26a88833f9210b1358 P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:05.617915  4685 ts_tablet_manager.cc:1434] T d0147a5552154f26a88833f9210b1358 P aa0ff974118b465eaa785b8a86057e87: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:12:05.618467  4681 raft_consensus.cc:359] T 1503964d57034b31b36eecc16f2c84a0 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:05.618856  4685 tablet_bootstrap.cc:492] T 1503964d57034b31b36eecc16f2c84a0 P aa0ff974118b465eaa785b8a86057e87: Bootstrap starting.
I20260709 13:12:05.619134  4681 raft_consensus.cc:385] T 1503964d57034b31b36eecc16f2c84a0 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.619517  4681 raft_consensus.cc:740] T 1503964d57034b31b36eecc16f2c84a0 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.585837  4310 catalog_manager.cc:5697] T 002595643d984c1c915975d4c4ace485 P 420a61707e804ce5b3773a91cc2eb424 reported cstate change: term changed from 0 to 1, leader changed from <none> to 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3). New cstate: current_term: 1 leader_uuid: "420a61707e804ce5b3773a91cc2eb424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:05.625053  4681 consensus_queue.cc:260] T 1503964d57034b31b36eecc16f2c84a0 P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:05.626741  4682 tablet_bootstrap.cc:492] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 06ec58698d5444caaecea433c8419770: No bootstrap required, opened a new log
I20260709 13:12:05.627136  4681 ts_tablet_manager.cc:1434] T 1503964d57034b31b36eecc16f2c84a0 P 74758684df5649ccadd1e189eaff32dc: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:12:05.627213  4682 ts_tablet_manager.cc:1403] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.134s	user 0.019s	sys 0.007s
I20260709 13:12:05.629186  4681 tablet_bootstrap.cc:492] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc: Bootstrap starting.
I20260709 13:12:05.630316  4757 raft_consensus.cc:493] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.630793  4757 raft_consensus.cc:515] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:05.631341  4682 raft_consensus.cc:359] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:05.632068  4682 raft_consensus.cc:385] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.632359  4682 raft_consensus.cc:740] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.637013  4757 leader_election.cc:290] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:05.639376  4636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a508f846d314fa0b7ec364af09bc427" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:05.627748  4411 raft_consensus.cc:2468] T d1119afee9d6413aa2cd229073ffbcf1 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 1.
I20260709 13:12:05.640525  4412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a508f846d314fa0b7ec364af09bc427" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:05.634824  4682 consensus_queue.cc:260] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:05.642866  4685 tablet_bootstrap.cc:654] T 1503964d57034b31b36eecc16f2c84a0 P aa0ff974118b465eaa785b8a86057e87: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:05.643803  4455 leader_election.cc:343] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.644387  4412 raft_consensus.cc:2468] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 0.
I20260709 13:12:05.645664  4683 tablet_bootstrap.cc:492] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 420a61707e804ce5b3773a91cc2eb424: No bootstrap required, opened a new log
I20260709 13:12:05.646133  4683 ts_tablet_manager.cc:1403] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 420a61707e804ce5b3773a91cc2eb424: Time spent bootstrapping tablet: real 0.051s	user 0.006s	sys 0.019s
I20260709 13:12:05.646751  4717 consensus_queue.cc:1048] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:05.650770  4682 ts_tablet_manager.cc:1434] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 13:12:05.651468  4455 leader_election.cc:304] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06ec58698d5444caaecea433c8419770, aa0ff974118b465eaa785b8a86057e87; no voters: 74758684df5649ccadd1e189eaff32dc
I20260709 13:12:05.651718  4682 tablet_bootstrap.cc:492] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:05.651717  4683 raft_consensus.cc:359] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:05.655040  4683 raft_consensus.cc:385] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.655311  4683 raft_consensus.cc:740] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.655879  4775 raft_consensus.cc:2804] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:05.656268  4775 raft_consensus.cc:493] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.656742  4775 raft_consensus.cc:3060] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.656291  4683 consensus_queue.cc:260] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:05.658843  4683 ts_tablet_manager.cc:1434] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 420a61707e804ce5b3773a91cc2eb424: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:12:05.659756  4683 tablet_bootstrap.cc:492] T 584f5934b7fa4c7ab4b0b43923621e70 P 420a61707e804ce5b3773a91cc2eb424: Bootstrap starting.
I20260709 13:12:05.683801  4775 raft_consensus.cc:515] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:05.684060  4310 catalog_manager.cc:5697] T d1119afee9d6413aa2cd229073ffbcf1 P 420a61707e804ce5b3773a91cc2eb424 reported cstate change: term changed from 0 to 1, leader changed from <none> to 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3). New cstate: current_term: 1 leader_uuid: "420a61707e804ce5b3773a91cc2eb424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:05.686158  4760 raft_consensus.cc:493] T 1503964d57034b31b36eecc16f2c84a0 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.686685  4760 raft_consensus.cc:515] T 1503964d57034b31b36eecc16f2c84a0 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:05.688357  4775 leader_election.cc:290] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 election: Requested vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:05.688728  4760 leader_election.cc:290] T 1503964d57034b31b36eecc16f2c84a0 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:05.691490  4488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1503964d57034b31b36eecc16f2c84a0" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:05.692634  4682 tablet_bootstrap.cc:654] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.692339  4412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a508f846d314fa0b7ec364af09bc427" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770"
I20260709 13:12:05.693465  4636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1503964d57034b31b36eecc16f2c84a0" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:05.694131  4636 raft_consensus.cc:2468] T 1503964d57034b31b36eecc16f2c84a0 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 0.
I20260709 13:12:05.693241  4412 raft_consensus.cc:3060] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.695140  4637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a508f846d314fa0b7ec364af09bc427" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc"
W20260709 13:12:05.697300  4380 leader_election.cc:343] T 1503964d57034b31b36eecc16f2c84a0 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:05.699168  4455 leader_election.cc:343] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.700276  4380 leader_election.cc:304] T 1503964d57034b31b36eecc16f2c84a0 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 74758684df5649ccadd1e189eaff32dc; no voters: aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:05.701860  4760 raft_consensus.cc:2804] T 1503964d57034b31b36eecc16f2c84a0 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:05.702421  4760 raft_consensus.cc:493] T 1503964d57034b31b36eecc16f2c84a0 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.705287  4760 raft_consensus.cc:3060] T 1503964d57034b31b36eecc16f2c84a0 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.721226  4412 raft_consensus.cc:2468] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 1.
I20260709 13:12:05.720991  4760 raft_consensus.cc:515] T 1503964d57034b31b36eecc16f2c84a0 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:05.723657  4455 leader_election.cc:304] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06ec58698d5444caaecea433c8419770, aa0ff974118b465eaa785b8a86057e87; no voters: 74758684df5649ccadd1e189eaff32dc
I20260709 13:12:05.725232  4775 raft_consensus.cc:2804] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:05.726476  4775 raft_consensus.cc:697] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [term 1 LEADER]: Becoming Leader. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Running, Role: LEADER
I20260709 13:12:05.727016  4760 leader_election.cc:290] T 1503964d57034b31b36eecc16f2c84a0 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Requested vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:05.727353  4775 consensus_queue.cc:237] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:05.728188  4637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1503964d57034b31b36eecc16f2c84a0" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:05.728536  4489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1503964d57034b31b36eecc16f2c84a0" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:05.728767  4637 raft_consensus.cc:3060] T 1503964d57034b31b36eecc16f2c84a0 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:05.730023  4380 leader_election.cc:343] T 1503964d57034b31b36eecc16f2c84a0 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.732375  4681 tablet_bootstrap.cc:654] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.737188  4774 raft_consensus.cc:493] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.737742  4774 raft_consensus.cc:515] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:05.741655  4774 leader_election.cc:290] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:05.744057  4488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7682a3f7f134c34a24488586461f6a4" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
W20260709 13:12:05.745756  4529 leader_election.cc:343] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.748188  4637 raft_consensus.cc:2468] T 1503964d57034b31b36eecc16f2c84a0 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 1.
I20260709 13:12:05.749857  4380 leader_election.cc:304] T 1503964d57034b31b36eecc16f2c84a0 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 74758684df5649ccadd1e189eaff32dc; no voters: aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:05.752692  4687 raft_consensus.cc:2804] T 1503964d57034b31b36eecc16f2c84a0 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:05.753342  4687 raft_consensus.cc:697] T 1503964d57034b31b36eecc16f2c84a0 P 06ec58698d5444caaecea433c8419770 [term 1 LEADER]: Becoming Leader. State: Replica: 06ec58698d5444caaecea433c8419770, State: Running, Role: LEADER
I20260709 13:12:05.754391  4687 consensus_queue.cc:237] T 1503964d57034b31b36eecc16f2c84a0 P 06ec58698d5444caaecea433c8419770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:05.757052  4774 consensus_queue.cc:1048] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:05.750406  4412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7682a3f7f134c34a24488586461f6a4" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:05.767225  4682 tablet_bootstrap.cc:492] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770: No bootstrap required, opened a new log
I20260709 13:12:05.767879  4683 tablet_bootstrap.cc:654] T 584f5934b7fa4c7ab4b0b43923621e70 P 420a61707e804ce5b3773a91cc2eb424: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.767902  4682 ts_tablet_manager.cc:1403] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.116s	user 0.022s	sys 0.019s
W20260709 13:12:05.771160  4529 leader_election.cc:343] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.771705  4529 leader_election.cc:304] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424; no voters: 06ec58698d5444caaecea433c8419770, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:05.775144  4685 tablet_bootstrap.cc:492] T 1503964d57034b31b36eecc16f2c84a0 P aa0ff974118b465eaa785b8a86057e87: No bootstrap required, opened a new log
I20260709 13:12:05.775635  4685 ts_tablet_manager.cc:1403] T 1503964d57034b31b36eecc16f2c84a0 P aa0ff974118b465eaa785b8a86057e87: Time spent bootstrapping tablet: real 0.157s	user 0.014s	sys 0.013s
I20260709 13:12:05.778085  4682 raft_consensus.cc:359] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:05.778910  4682 raft_consensus.cc:385] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.779258  4682 raft_consensus.cc:740] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.774380  4743 raft_consensus.cc:2749] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:05.784176  4682 consensus_queue.cc:260] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:05.785806  4685 raft_consensus.cc:359] T 1503964d57034b31b36eecc16f2c84a0 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:05.786527  4685 raft_consensus.cc:385] T 1503964d57034b31b36eecc16f2c84a0 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.786787  4685 raft_consensus.cc:740] T 1503964d57034b31b36eecc16f2c84a0 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.786998  4682 ts_tablet_manager.cc:1434] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:12:05.787428  4685 consensus_queue.cc:260] T 1503964d57034b31b36eecc16f2c84a0 P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:05.788077  4682 tablet_bootstrap.cc:492] T 604a93ed898f4ab9b771487bfe278b33 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:05.789285  4685 ts_tablet_manager.cc:1434] T 1503964d57034b31b36eecc16f2c84a0 P aa0ff974118b465eaa785b8a86057e87: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.002s
I20260709 13:12:05.790009  4685 tablet_bootstrap.cc:492] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P aa0ff974118b465eaa785b8a86057e87: Bootstrap starting.
I20260709 13:12:05.793463  4754 raft_consensus.cc:493] T 3092a6c40d0d4610968fe09d4c7d16c0 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.791797  4308 catalog_manager.cc:5697] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa0ff974118b465eaa785b8a86057e87 (127.28.173.2). New cstate: current_term: 1 leader_uuid: "aa0ff974118b465eaa785b8a86057e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:05.794109  4754 raft_consensus.cc:515] T 3092a6c40d0d4610968fe09d4c7d16c0 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:05.794838  4717 raft_consensus.cc:493] T 3092a6c40d0d4610968fe09d4c7d16c0 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.795070  4682 tablet_bootstrap.cc:654] T 604a93ed898f4ab9b771487bfe278b33 P 06ec58698d5444caaecea433c8419770: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.795399  4717 raft_consensus.cc:515] T 3092a6c40d0d4610968fe09d4c7d16c0 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:05.796643  4754 leader_election.cc:290] T 3092a6c40d0d4610968fe09d4c7d16c0 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:05.797353  4486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3092a6c40d0d4610968fe09d4c7d16c0" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:05.797955  4717 leader_election.cc:290] T 3092a6c40d0d4610968fe09d4c7d16c0 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
W20260709 13:12:05.799206  4603 leader_election.cc:343] T 3092a6c40d0d4610968fe09d4c7d16c0 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.799746  4562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3092a6c40d0d4610968fe09d4c7d16c0" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:05.800601  4486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3092a6c40d0d4610968fe09d4c7d16c0" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:05.799742  4637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3092a6c40d0d4610968fe09d4c7d16c0" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:05.802183  4637 raft_consensus.cc:2468] T 3092a6c40d0d4610968fe09d4c7d16c0 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 0.
W20260709 13:12:05.802903  4529 leader_election.cc:343] T 3092a6c40d0d4610968fe09d4c7d16c0 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.803140  4775 raft_consensus.cc:493] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.800731  4562 raft_consensus.cc:2468] T 3092a6c40d0d4610968fe09d4c7d16c0 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 0.
I20260709 13:12:05.803663  4775 raft_consensus.cc:515] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:05.804533  4685 tablet_bootstrap.cc:654] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P aa0ff974118b465eaa785b8a86057e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.803753  4529 leader_election.cc:304] T 3092a6c40d0d4610968fe09d4c7d16c0 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc; no voters: aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:05.806049  4775 leader_election.cc:290] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:05.807152  4602 leader_election.cc:304] T 3092a6c40d0d4610968fe09d4c7d16c0 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc; no voters: aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:05.807768  4562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20be30df26724e7f98f3b36f24e4df3a" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:05.810138  4562 raft_consensus.cc:2393] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aa0ff974118b465eaa785b8a86057e87 in current term 1: Already voted for candidate 06ec58698d5444caaecea433c8419770 in this term.
I20260709 13:12:05.808619  4754 raft_consensus.cc:2804] T 3092a6c40d0d4610968fe09d4c7d16c0 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:05.812279  4754 raft_consensus.cc:493] T 3092a6c40d0d4610968fe09d4c7d16c0 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.812726  4754 raft_consensus.cc:3060] T 3092a6c40d0d4610968fe09d4c7d16c0 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.809114  4412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20be30df26724e7f98f3b36f24e4df3a" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:05.822331  4455 leader_election.cc:304] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa0ff974118b465eaa785b8a86057e87; no voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424
I20260709 13:12:05.823678  4775 raft_consensus.cc:3060] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.824576  4757 raft_consensus.cc:493] T 5cd01d60553a435387e507f5d6240b58 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.825045  4757 raft_consensus.cc:515] T 5cd01d60553a435387e507f5d6240b58 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:05.826821  4758 raft_consensus.cc:493] T d0147a5552154f26a88833f9210b1358 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.827026  4757 leader_election.cc:290] T 5cd01d60553a435387e507f5d6240b58 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:05.827342  4758 raft_consensus.cc:515] T d0147a5552154f26a88833f9210b1358 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:05.828831  4562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd01d60553a435387e507f5d6240b58" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:05.829514  4562 raft_consensus.cc:2468] T 5cd01d60553a435387e507f5d6240b58 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 0.
I20260709 13:12:05.830443  4775 raft_consensus.cc:2749] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:05.831030  4454 leader_election.cc:304] T 5cd01d60553a435387e507f5d6240b58 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:05.831547  4412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0147a5552154f26a88833f9210b1358" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:05.832420  4412 raft_consensus.cc:2468] T d0147a5552154f26a88833f9210b1358 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 0.
I20260709 13:12:05.834681  4637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd01d60553a435387e507f5d6240b58" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:05.808472  4717 raft_consensus.cc:2804] T 3092a6c40d0d4610968fe09d4c7d16c0 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:05.835775  4717 raft_consensus.cc:493] T 3092a6c40d0d4610968fe09d4c7d16c0 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.836310  4717 raft_consensus.cc:3060] T 3092a6c40d0d4610968fe09d4c7d16c0 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.836472  4743 raft_consensus.cc:493] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.836901  4603 leader_election.cc:304] T d0147a5552154f26a88833f9210b1358 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 74758684df5649ccadd1e189eaff32dc; no voters: 
I20260709 13:12:05.836987  4743 raft_consensus.cc:515] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:05.837957  4775 raft_consensus.cc:2804] T 5cd01d60553a435387e507f5d6240b58 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:05.838165  4722 raft_consensus.cc:2804] T d0147a5552154f26a88833f9210b1358 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:05.841599  4722 raft_consensus.cc:493] T d0147a5552154f26a88833f9210b1358 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:05.841638  4455 leader_election.cc:343] T 5cd01d60553a435387e507f5d6240b58 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.842077  4722 raft_consensus.cc:3060] T d0147a5552154f26a88833f9210b1358 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.843242  4486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0147a5552154f26a88833f9210b1358" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:05.844002  4486 raft_consensus.cc:2468] T d0147a5552154f26a88833f9210b1358 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 0.
I20260709 13:12:05.850306  4486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1ff9a8e0d49d7b58940ccec6c0540" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:05.850342  4637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1ff9a8e0d49d7b58940ccec6c0540" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:05.839355  4743 leader_election.cc:290] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:05.830667  4758 leader_election.cc:290] T d0147a5552154f26a88833f9210b1358 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
W20260709 13:12:05.853471  4529 leader_election.cc:343] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:05.855173  4529 leader_election.cc:343] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.855885  4529 leader_election.cc:304] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424; no voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:05.856598  4743 raft_consensus.cc:2749] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:05.859077  4775 raft_consensus.cc:493] T 5cd01d60553a435387e507f5d6240b58 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.855151  4722 raft_consensus.cc:515] T d0147a5552154f26a88833f9210b1358 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:05.840778  4754 raft_consensus.cc:515] T 3092a6c40d0d4610968fe09d4c7d16c0 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:05.862010  4754 leader_election.cc:290] T 3092a6c40d0d4610968fe09d4c7d16c0 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 election: Requested vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:05.862749  4488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3092a6c40d0d4610968fe09d4c7d16c0" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:05.859493  4775 raft_consensus.cc:3060] T 5cd01d60553a435387e507f5d6240b58 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:05.864241  4603 leader_election.cc:343] T 3092a6c40d0d4610968fe09d4c7d16c0 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.862900  4412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0147a5552154f26a88833f9210b1358" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770"
I20260709 13:12:05.865168  4412 raft_consensus.cc:3060] T d0147a5552154f26a88833f9210b1358 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.880198  4685 tablet_bootstrap.cc:492] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P aa0ff974118b465eaa785b8a86057e87: No bootstrap required, opened a new log
I20260709 13:12:05.881567  4562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3092a6c40d0d4610968fe09d4c7d16c0" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:05.882006  4775 raft_consensus.cc:515] T 5cd01d60553a435387e507f5d6240b58 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:05.884414  4681 tablet_bootstrap.cc:492] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc: No bootstrap required, opened a new log
I20260709 13:12:05.884876  4681 ts_tablet_manager.cc:1403] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc: Time spent bootstrapping tablet: real 0.256s	user 0.025s	sys 0.005s
I20260709 13:12:05.886693  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd01d60553a435387e507f5d6240b58" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:05.887598  4563 raft_consensus.cc:3060] T 5cd01d60553a435387e507f5d6240b58 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.887996  4717 raft_consensus.cc:515] T 3092a6c40d0d4610968fe09d4c7d16c0 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:05.890203  4717 leader_election.cc:290] T 3092a6c40d0d4610968fe09d4c7d16c0 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 election: Requested vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:05.887542  4681 raft_consensus.cc:359] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:05.892083  4681 raft_consensus.cc:385] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.892581  4681 raft_consensus.cc:740] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.895370  4562 raft_consensus.cc:2393] T 3092a6c40d0d4610968fe09d4c7d16c0 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 74758684df5649ccadd1e189eaff32dc in current term 1: Already voted for candidate 420a61707e804ce5b3773a91cc2eb424 in this term.
I20260709 13:12:05.900389  4486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0147a5552154f26a88833f9210b1358" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:05.901799  4486 raft_consensus.cc:3060] T d0147a5552154f26a88833f9210b1358 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.898880  4308 catalog_manager.cc:5697] T 1503964d57034b31b36eecc16f2c84a0 P 06ec58698d5444caaecea433c8419770 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06ec58698d5444caaecea433c8419770 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "06ec58698d5444caaecea433c8419770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:05.900421  4681 consensus_queue.cc:260] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:05.893672  4775 leader_election.cc:290] T 5cd01d60553a435387e507f5d6240b58 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 election: Requested vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:05.913169  4681 ts_tablet_manager.cc:1434] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:12:05.913362  4682 tablet_bootstrap.cc:492] T 604a93ed898f4ab9b771487bfe278b33 P 06ec58698d5444caaecea433c8419770: No bootstrap required, opened a new log
I20260709 13:12:05.913839  4682 ts_tablet_manager.cc:1403] T 604a93ed898f4ab9b771487bfe278b33 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.126s	user 0.040s	sys 0.011s
I20260709 13:12:05.914242  4602 leader_election.cc:304] T 3092a6c40d0d4610968fe09d4c7d16c0 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc; no voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:05.915798  4754 raft_consensus.cc:2749] T 3092a6c40d0d4610968fe09d4c7d16c0 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:05.893021  4685 ts_tablet_manager.cc:1403] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P aa0ff974118b465eaa785b8a86057e87: Time spent bootstrapping tablet: real 0.103s	user 0.006s	sys 0.007s
I20260709 13:12:05.917878  4682 raft_consensus.cc:359] T 604a93ed898f4ab9b771487bfe278b33 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:05.918577  4682 raft_consensus.cc:385] T 604a93ed898f4ab9b771487bfe278b33 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.918833  4682 raft_consensus.cc:740] T 604a93ed898f4ab9b771487bfe278b33 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.906140  4743 consensus_queue.cc:1048] T 002595643d984c1c915975d4c4ace485 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:05.919486  4682 consensus_queue.cc:260] T 604a93ed898f4ab9b771487bfe278b33 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:05.920140  4685 raft_consensus.cc:359] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:05.920825  4685 raft_consensus.cc:385] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.921083  4685 raft_consensus.cc:740] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.899817  4722 leader_election.cc:290] T d0147a5552154f26a88833f9210b1358 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 election: Requested vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:05.909377  4488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3092a6c40d0d4610968fe09d4c7d16c0" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:05.894832  4637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd01d60553a435387e507f5d6240b58" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:05.897580  4683 tablet_bootstrap.cc:492] T 584f5934b7fa4c7ab4b0b43923621e70 P 420a61707e804ce5b3773a91cc2eb424: No bootstrap required, opened a new log
W20260709 13:12:05.923839  4455 leader_election.cc:343] T 5cd01d60553a435387e507f5d6240b58 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.924090  4683 ts_tablet_manager.cc:1403] T 584f5934b7fa4c7ab4b0b43923621e70 P 420a61707e804ce5b3773a91cc2eb424: Time spent bootstrapping tablet: real 0.265s	user 0.035s	sys 0.026s
I20260709 13:12:05.910928  4412 raft_consensus.cc:2468] T d0147a5552154f26a88833f9210b1358 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 1.
I20260709 13:12:05.926724  4683 raft_consensus.cc:359] T 584f5934b7fa4c7ab4b0b43923621e70 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:05.927420  4683 raft_consensus.cc:385] T 584f5934b7fa4c7ab4b0b43923621e70 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.927712  4683 raft_consensus.cc:740] T 584f5934b7fa4c7ab4b0b43923621e70 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.927562  4603 leader_election.cc:304] T d0147a5552154f26a88833f9210b1358 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 74758684df5649ccadd1e189eaff32dc; no voters: 
I20260709 13:12:05.928534  4722 raft_consensus.cc:2804] T d0147a5552154f26a88833f9210b1358 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:05.928479  4683 consensus_queue.cc:260] T 584f5934b7fa4c7ab4b0b43923621e70 P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:05.928761  4636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3092a6c40d0d4610968fe09d4c7d16c0" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:05.929148  4722 raft_consensus.cc:697] T d0147a5552154f26a88833f9210b1358 P 74758684df5649ccadd1e189eaff32dc [term 1 LEADER]: Becoming Leader. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Running, Role: LEADER
I20260709 13:12:05.929610  4636 raft_consensus.cc:2393] T 3092a6c40d0d4610968fe09d4c7d16c0 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 420a61707e804ce5b3773a91cc2eb424 in current term 1: Already voted for candidate 74758684df5649ccadd1e189eaff32dc in this term.
I20260709 13:12:05.930001  4722 consensus_queue.cc:237] T d0147a5552154f26a88833f9210b1358 P 74758684df5649ccadd1e189eaff32dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:05.930621  4683 ts_tablet_manager.cc:1434] T 584f5934b7fa4c7ab4b0b43923621e70 P 420a61707e804ce5b3773a91cc2eb424: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:12:05.931586  4683 tablet_bootstrap.cc:492] T 150545c47e0642229a92ede96db14fc9 P 420a61707e804ce5b3773a91cc2eb424: Bootstrap starting.
I20260709 13:12:05.909394  4486 raft_consensus.cc:2468] T d0147a5552154f26a88833f9210b1358 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 1.
I20260709 13:12:05.935485  4563 raft_consensus.cc:2468] T 5cd01d60553a435387e507f5d6240b58 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 1.
I20260709 13:12:05.921640  4682 ts_tablet_manager.cc:1434] T 604a93ed898f4ab9b771487bfe278b33 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:05.941639  4757 raft_consensus.cc:493] T 1503964d57034b31b36eecc16f2c84a0 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.937217  4683 tablet_bootstrap.cc:654] T 150545c47e0642229a92ede96db14fc9 P 420a61707e804ce5b3773a91cc2eb424: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.942233  4454 leader_election.cc:304] T 5cd01d60553a435387e507f5d6240b58 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 74758684df5649ccadd1e189eaff32dc
I20260709 13:12:05.942123  4757 raft_consensus.cc:515] T 1503964d57034b31b36eecc16f2c84a0 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:05.942185  4682 tablet_bootstrap.cc:492] T 584f5934b7fa4c7ab4b0b43923621e70 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:05.937950  4681 tablet_bootstrap.cc:492] T 5cd01d60553a435387e507f5d6240b58 P 74758684df5649ccadd1e189eaff32dc: Bootstrap starting.
I20260709 13:12:05.944526  4757 leader_election.cc:290] T 1503964d57034b31b36eecc16f2c84a0 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:05.945043  4757 raft_consensus.cc:2804] T 5cd01d60553a435387e507f5d6240b58 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:05.945483  4757 raft_consensus.cc:697] T 5cd01d60553a435387e507f5d6240b58 P aa0ff974118b465eaa785b8a86057e87 [term 1 LEADER]: Becoming Leader. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Running, Role: LEADER
I20260709 13:12:05.946274  4757 consensus_queue.cc:237] T 5cd01d60553a435387e507f5d6240b58 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:05.949719  4682 tablet_bootstrap.cc:654] T 584f5934b7fa4c7ab4b0b43923621e70 P 06ec58698d5444caaecea433c8419770: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.954152  4685 consensus_queue.cc:260] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:05.954713  4681 tablet_bootstrap.cc:654] T 5cd01d60553a435387e507f5d6240b58 P 74758684df5649ccadd1e189eaff32dc: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:05.951124  4529 leader_election.cc:343] T 3092a6c40d0d4610968fe09d4c7d16c0 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.955144  4529 leader_election.cc:304] T 3092a6c40d0d4610968fe09d4c7d16c0 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424; no voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:05.955945  4774 raft_consensus.cc:2749] T 3092a6c40d0d4610968fe09d4c7d16c0 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:05.956893  4774 consensus_queue.cc:1048] T 002595643d984c1c915975d4c4ace485 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:05.961081  4687 raft_consensus.cc:493] T 604a93ed898f4ab9b771487bfe278b33 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.961571  4687 raft_consensus.cc:515] T 604a93ed898f4ab9b771487bfe278b33 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:05.961790  4311 catalog_manager.cc:5697] T d0147a5552154f26a88833f9210b1358 P 74758684df5649ccadd1e189eaff32dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 74758684df5649ccadd1e189eaff32dc (127.28.173.4). New cstate: current_term: 1 leader_uuid: "74758684df5649ccadd1e189eaff32dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:05.963577  4687 leader_election.cc:290] T 604a93ed898f4ab9b771487bfe278b33 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:05.964316  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604a93ed898f4ab9b771487bfe278b33" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:05.964987  4563 raft_consensus.cc:2468] T 604a93ed898f4ab9b771487bfe278b33 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 0.
I20260709 13:12:05.965075  4634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604a93ed898f4ab9b771487bfe278b33" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:05.966243  4379 leader_election.cc:304] T 604a93ed898f4ab9b771487bfe278b33 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: 
W20260709 13:12:05.967195  4380 leader_election.cc:343] T 604a93ed898f4ab9b771487bfe278b33 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:05.967571  4687 raft_consensus.cc:2804] T 604a93ed898f4ab9b771487bfe278b33 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:05.968129  4687 raft_consensus.cc:493] T 604a93ed898f4ab9b771487bfe278b33 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.969527  4683 tablet_bootstrap.cc:492] T 150545c47e0642229a92ede96db14fc9 P 420a61707e804ce5b3773a91cc2eb424: No bootstrap required, opened a new log
I20260709 13:12:05.969981  4687 raft_consensus.cc:3060] T 604a93ed898f4ab9b771487bfe278b33 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.970147  4683 ts_tablet_manager.cc:1403] T 150545c47e0642229a92ede96db14fc9 P 420a61707e804ce5b3773a91cc2eb424: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.000s
I20260709 13:12:05.972851  4683 raft_consensus.cc:359] T 150545c47e0642229a92ede96db14fc9 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:05.973479  4683 raft_consensus.cc:385] T 150545c47e0642229a92ede96db14fc9 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.973733  4683 raft_consensus.cc:740] T 150545c47e0642229a92ede96db14fc9 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.974362  4683 consensus_queue.cc:260] T 150545c47e0642229a92ede96db14fc9 P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:05.975386  4682 tablet_bootstrap.cc:492] T 584f5934b7fa4c7ab4b0b43923621e70 P 06ec58698d5444caaecea433c8419770: No bootstrap required, opened a new log
I20260709 13:12:05.975914  4682 ts_tablet_manager.cc:1403] T 584f5934b7fa4c7ab4b0b43923621e70 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.004s
I20260709 13:12:05.978791  4683 ts_tablet_manager.cc:1434] T 150545c47e0642229a92ede96db14fc9 P 420a61707e804ce5b3773a91cc2eb424: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:12:05.979724  4683 tablet_bootstrap.cc:492] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424: Bootstrap starting.
I20260709 13:12:05.983940  4681 tablet_bootstrap.cc:492] T 5cd01d60553a435387e507f5d6240b58 P 74758684df5649ccadd1e189eaff32dc: No bootstrap required, opened a new log
I20260709 13:12:05.984419  4681 ts_tablet_manager.cc:1403] T 5cd01d60553a435387e507f5d6240b58 P 74758684df5649ccadd1e189eaff32dc: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.000s
I20260709 13:12:05.990898  4721 consensus_queue.cc:1048] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:05.992249  4681 raft_consensus.cc:359] T 5cd01d60553a435387e507f5d6240b58 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:05.992955  4681 raft_consensus.cc:385] T 5cd01d60553a435387e507f5d6240b58 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.993749  4685 ts_tablet_manager.cc:1434] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P aa0ff974118b465eaa785b8a86057e87: Time spent starting tablet: real 0.076s	user 0.005s	sys 0.005s
I20260709 13:12:05.996568  4685 tablet_bootstrap.cc:492] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P aa0ff974118b465eaa785b8a86057e87: Bootstrap starting.
I20260709 13:12:05.993234  4681 raft_consensus.cc:740] T 5cd01d60553a435387e507f5d6240b58 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.997727  4682 raft_consensus.cc:359] T 584f5934b7fa4c7ab4b0b43923621e70 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:05.998271  4682 raft_consensus.cc:385] T 584f5934b7fa4c7ab4b0b43923621e70 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.998497  4682 raft_consensus.cc:740] T 584f5934b7fa4c7ab4b0b43923621e70 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.999121  4682 consensus_queue.cc:260] T 584f5934b7fa4c7ab4b0b43923621e70 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:06.000722  4683 tablet_bootstrap.cc:654] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:06.004598  4455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:42711, user_credentials={real_user=slave}} blocked reactor thread for 61674.7us
I20260709 13:12:06.009583  4412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1503964d57034b31b36eecc16f2c84a0" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:06.009594  4635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1503964d57034b31b36eecc16f2c84a0" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:06.011299  4635 raft_consensus.cc:2393] T 1503964d57034b31b36eecc16f2c84a0 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aa0ff974118b465eaa785b8a86057e87 in current term 1: Already voted for candidate 06ec58698d5444caaecea433c8419770 in this term.
I20260709 13:12:06.012995  4681 consensus_queue.cc:260] T 5cd01d60553a435387e507f5d6240b58 P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:06.017551  4682 ts_tablet_manager.cc:1434] T 584f5934b7fa4c7ab4b0b43923621e70 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.001s
I20260709 13:12:06.018549  4682 tablet_bootstrap.cc:492] T 325a5a55a44a47ce97869216b084f89d P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:06.019968  4681 ts_tablet_manager.cc:1434] T 5cd01d60553a435387e507f5d6240b58 P 74758684df5649ccadd1e189eaff32dc: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 13:12:06.009835  4687 raft_consensus.cc:515] T 604a93ed898f4ab9b771487bfe278b33 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:06.020993  4681 tablet_bootstrap.cc:492] T 604a93ed898f4ab9b771487bfe278b33 P 74758684df5649ccadd1e189eaff32dc: Bootstrap starting.
I20260709 13:12:06.023113  4562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604a93ed898f4ab9b771487bfe278b33" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:06.023685  4562 raft_consensus.cc:3060] T 604a93ed898f4ab9b771487bfe278b33 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.016669  4685 tablet_bootstrap.cc:654] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P aa0ff974118b465eaa785b8a86057e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:06.028733  4455 leader_election.cc:304] T 1503964d57034b31b36eecc16f2c84a0 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa0ff974118b465eaa785b8a86057e87; no voters: 06ec58698d5444caaecea433c8419770, 74758684df5649ccadd1e189eaff32dc
I20260709 13:12:06.029850  4681 tablet_bootstrap.cc:654] T 604a93ed898f4ab9b771487bfe278b33 P 74758684df5649ccadd1e189eaff32dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:06.035094  4879 raft_consensus.cc:3060] T 1503964d57034b31b36eecc16f2c84a0 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.040773  4721 raft_consensus.cc:493] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.041561  4310 catalog_manager.cc:5697] T 5cd01d60553a435387e507f5d6240b58 P aa0ff974118b465eaa785b8a86057e87 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa0ff974118b465eaa785b8a86057e87 (127.28.173.2). New cstate: current_term: 1 leader_uuid: "aa0ff974118b465eaa785b8a86057e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:06.041272  4721 raft_consensus.cc:515] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:06.052433  4683 tablet_bootstrap.cc:492] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424: No bootstrap required, opened a new log
I20260709 13:12:06.053066  4683 ts_tablet_manager.cc:1403] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424: Time spent bootstrapping tablet: real 0.074s	user 0.015s	sys 0.005s
I20260709 13:12:06.055279  4682 tablet_bootstrap.cc:654] T 325a5a55a44a47ce97869216b084f89d P 06ec58698d5444caaecea433c8419770: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:06.056638  4683 raft_consensus.cc:359] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:06.058410  4721 leader_election.cc:290] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:06.059319  4681 tablet_bootstrap.cc:492] T 604a93ed898f4ab9b771487bfe278b33 P 74758684df5649ccadd1e189eaff32dc: No bootstrap required, opened a new log
I20260709 13:12:06.059837  4560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dbb9c8f1ac4eca802b0c887a4d1c27" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:06.065630  4560 raft_consensus.cc:2468] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 0.
I20260709 13:12:06.066845  4379 leader_election.cc:304] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: 
I20260709 13:12:06.063894  4683 raft_consensus.cc:385] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:06.067605  4683 raft_consensus.cc:740] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Initialized, Role: FOLLOWER
I20260709 13:12:06.068486  4681 ts_tablet_manager.cc:1403] T 604a93ed898f4ab9b771487bfe278b33 P 74758684df5649ccadd1e189eaff32dc: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.012s
I20260709 13:12:06.067701  4721 raft_consensus.cc:2804] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:06.068663  4683 consensus_queue.cc:260] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:06.069226  4721 raft_consensus.cc:493] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:06.069589  4721 raft_consensus.cc:3060] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.073110  4681 raft_consensus.cc:359] T 604a93ed898f4ab9b771487bfe278b33 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:06.073866  4681 raft_consensus.cc:385] T 604a93ed898f4ab9b771487bfe278b33 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:06.074472  4681 raft_consensus.cc:740] T 604a93ed898f4ab9b771487bfe278b33 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Initialized, Role: FOLLOWER
I20260709 13:12:06.075222  4683 ts_tablet_manager.cc:1434] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.002s
I20260709 13:12:06.077732  4683 tablet_bootstrap.cc:492] T 9d526ab043434bf0bcab814f9bbc3234 P 420a61707e804ce5b3773a91cc2eb424: Bootstrap starting.
I20260709 13:12:06.061961  4687 leader_election.cc:290] T 604a93ed898f4ab9b771487bfe278b33 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Requested vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:06.076072  4681 consensus_queue.cc:260] T 604a93ed898f4ab9b771487bfe278b33 P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:06.092971  4683 tablet_bootstrap.cc:654] T 9d526ab043434bf0bcab814f9bbc3234 P 420a61707e804ce5b3773a91cc2eb424: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:06.103140  4879 raft_consensus.cc:2749] T 1503964d57034b31b36eecc16f2c84a0 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:06.107048  4721 raft_consensus.cc:515] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:06.109769  4721 leader_election.cc:290] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Requested vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:06.116076  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dbb9c8f1ac4eca802b0c887a4d1c27" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:06.120121  4635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604a93ed898f4ab9b771487bfe278b33" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:06.120759  4635 raft_consensus.cc:3060] T 604a93ed898f4ab9b771487bfe278b33 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.121054  4488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dbb9c8f1ac4eca802b0c887a4d1c27" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:06.121671  4488 raft_consensus.cc:2468] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 0.
I20260709 13:12:06.120163  4685 tablet_bootstrap.cc:492] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P aa0ff974118b465eaa785b8a86057e87: No bootstrap required, opened a new log
I20260709 13:12:06.123334  4685 ts_tablet_manager.cc:1403] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P aa0ff974118b465eaa785b8a86057e87: Time spent bootstrapping tablet: real 0.129s	user 0.022s	sys 0.004s
I20260709 13:12:06.123657  4488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dbb9c8f1ac4eca802b0c887a4d1c27" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:06.124214  4488 raft_consensus.cc:3060] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.126963  4685 raft_consensus.cc:359] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:06.131469  4488 raft_consensus.cc:2468] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 1.
I20260709 13:12:06.132711  4563 raft_consensus.cc:3060] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.115368  4562 raft_consensus.cc:2468] T 604a93ed898f4ab9b771487bfe278b33 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 1.
I20260709 13:12:06.135243  4379 leader_election.cc:304] T 604a93ed898f4ab9b771487bfe278b33 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: 
I20260709 13:12:06.136351  4687 raft_consensus.cc:2804] T 604a93ed898f4ab9b771487bfe278b33 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:06.136861  4687 raft_consensus.cc:697] T 604a93ed898f4ab9b771487bfe278b33 P 06ec58698d5444caaecea433c8419770 [term 1 LEADER]: Becoming Leader. State: Replica: 06ec58698d5444caaecea433c8419770, State: Running, Role: LEADER
I20260709 13:12:06.137665  4687 consensus_queue.cc:237] T 604a93ed898f4ab9b771487bfe278b33 P 06ec58698d5444caaecea433c8419770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:06.138908  4635 raft_consensus.cc:2468] T 604a93ed898f4ab9b771487bfe278b33 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 1.
I20260709 13:12:06.139865  4685 raft_consensus.cc:385] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:06.140352  4685 raft_consensus.cc:740] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Initialized, Role: FOLLOWER
I20260709 13:12:06.141170  4685 consensus_queue.cc:260] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:06.142716  4380 leader_election.cc:304] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:06.143746  4760 raft_consensus.cc:2804] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:06.144579  4683 tablet_bootstrap.cc:492] T 9d526ab043434bf0bcab814f9bbc3234 P 420a61707e804ce5b3773a91cc2eb424: No bootstrap required, opened a new log
I20260709 13:12:06.145141  4683 ts_tablet_manager.cc:1403] T 9d526ab043434bf0bcab814f9bbc3234 P 420a61707e804ce5b3773a91cc2eb424: Time spent bootstrapping tablet: real 0.069s	user 0.018s	sys 0.023s
I20260709 13:12:06.145551  4743 raft_consensus.cc:493] T 150545c47e0642229a92ede96db14fc9 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.146190  4743 raft_consensus.cc:515] T 150545c47e0642229a92ede96db14fc9 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:06.150566  4743 leader_election.cc:290] T 150545c47e0642229a92ede96db14fc9 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:06.152534  4488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "150545c47e0642229a92ede96db14fc9" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:06.153116  4683 raft_consensus.cc:359] T 9d526ab043434bf0bcab814f9bbc3234 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
W20260709 13:12:06.154191  4529 leader_election.cc:343] T 150545c47e0642229a92ede96db14fc9 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:06.143702  4681 ts_tablet_manager.cc:1434] T 604a93ed898f4ab9b771487bfe278b33 P 74758684df5649ccadd1e189eaff32dc: Time spent starting tablet: real 0.075s	user 0.006s	sys 0.001s
I20260709 13:12:06.154178  4683 raft_consensus.cc:385] T 9d526ab043434bf0bcab814f9bbc3234 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:06.160439  4681 tablet_bootstrap.cc:492] T 325a5a55a44a47ce97869216b084f89d P 74758684df5649ccadd1e189eaff32dc: Bootstrap starting.
I20260709 13:12:06.159924  4683 raft_consensus.cc:740] T 9d526ab043434bf0bcab814f9bbc3234 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Initialized, Role: FOLLOWER
I20260709 13:12:06.161844  4683 consensus_queue.cc:260] T 9d526ab043434bf0bcab814f9bbc3234 P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:06.165704  4683 ts_tablet_manager.cc:1434] T 9d526ab043434bf0bcab814f9bbc3234 P 420a61707e804ce5b3773a91cc2eb424: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.004s
I20260709 13:12:06.167619  4563 raft_consensus.cc:2468] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 1.
I20260709 13:12:06.181226  4685 ts_tablet_manager.cc:1434] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P aa0ff974118b465eaa785b8a86057e87: Time spent starting tablet: real 0.058s	user 0.009s	sys 0.000s
I20260709 13:12:06.182626  4685 tablet_bootstrap.cc:492] T 325a5a55a44a47ce97869216b084f89d P aa0ff974118b465eaa785b8a86057e87: Bootstrap starting.
I20260709 13:12:06.184213  4891 consensus_queue.cc:1048] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:06.184851  4895 raft_consensus.cc:493] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.200579  4682 tablet_bootstrap.cc:492] T 325a5a55a44a47ce97869216b084f89d P 06ec58698d5444caaecea433c8419770: No bootstrap required, opened a new log
I20260709 13:12:06.201144  4682 ts_tablet_manager.cc:1403] T 325a5a55a44a47ce97869216b084f89d P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.183s	user 0.033s	sys 0.016s
I20260709 13:12:06.204452  4682 raft_consensus.cc:359] T 325a5a55a44a47ce97869216b084f89d P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:06.207062  4685 tablet_bootstrap.cc:654] T 325a5a55a44a47ce97869216b084f89d P aa0ff974118b465eaa785b8a86057e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:06.207289  4682 raft_consensus.cc:385] T 325a5a55a44a47ce97869216b084f89d P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:06.207705  4682 raft_consensus.cc:740] T 325a5a55a44a47ce97869216b084f89d P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:06.210940  4683 tablet_bootstrap.cc:492] T 1271bae393604d56b9e376c716eb2a9e P 420a61707e804ce5b3773a91cc2eb424: Bootstrap starting.
I20260709 13:12:06.209762  4682 consensus_queue.cc:260] T 325a5a55a44a47ce97869216b084f89d P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:06.226432  4634 raft_consensus.cc:3060] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.234220  4743 consensus_queue.cc:1048] T d1119afee9d6413aa2cd229073ffbcf1 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:06.237920  4683 tablet_bootstrap.cc:654] T 1271bae393604d56b9e376c716eb2a9e P 420a61707e804ce5b3773a91cc2eb424: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:06.187709  4380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:45987, user_credentials={real_user=slave}} blocked reactor thread for 44077.4us
I20260709 13:12:06.192730  4895 raft_consensus.cc:515] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:06.241324  4682 ts_tablet_manager.cc:1434] T 325a5a55a44a47ce97869216b084f89d P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.040s	user 0.009s	sys 0.000s
I20260709 13:12:06.244746  4682 tablet_bootstrap.cc:492] T aa241e695dbb492a971f537d1f977f21 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:06.212334  4760 raft_consensus.cc:697] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 06ec58698d5444caaecea433c8419770 [term 1 LEADER]: Becoming Leader. State: Replica: 06ec58698d5444caaecea433c8419770, State: Running, Role: LEADER
I20260709 13:12:06.250131  4681 tablet_bootstrap.cc:654] T 325a5a55a44a47ce97869216b084f89d P 74758684df5649ccadd1e189eaff32dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:06.252029  4774 consensus_queue.cc:1048] T d1119afee9d6413aa2cd229073ffbcf1 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:12:06.257397  4884 consensus_queue.cc:1048] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:06.240660  4743 raft_consensus.cc:493] T 584f5934b7fa4c7ab4b0b43923621e70 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.263535  4743 raft_consensus.cc:515] T 584f5934b7fa4c7ab4b0b43923621e70 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:06.266119  4743 leader_election.cc:290] T 584f5934b7fa4c7ab4b0b43923621e70 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:06.267980  4722 raft_consensus.cc:493] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.268622  4722 raft_consensus.cc:515] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:06.283239  4895 leader_election.cc:290] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:06.284328  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7682a3f7f134c34a24488586461f6a4" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:06.285310  4563 raft_consensus.cc:2468] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 0.
I20260709 13:12:06.286633  4379 leader_election.cc:304] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: 
I20260709 13:12:06.288900  4411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "150545c47e0642229a92ede96db14fc9" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:06.287590  4895 raft_consensus.cc:2804] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:06.290304  4488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a508f846d314fa0b7ec364af09bc427" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:06.293251  4895 raft_consensus.cc:493] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:06.293648  4895 raft_consensus.cc:3060] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.271513  4722 leader_election.cc:290] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:06.294596  4412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584f5934b7fa4c7ab4b0b43923621e70" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:06.295254  4412 raft_consensus.cc:2468] T 584f5934b7fa4c7ab4b0b43923621e70 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 0.
I20260709 13:12:06.297111  4308 catalog_manager.cc:5697] T 604a93ed898f4ab9b771487bfe278b33 P 06ec58698d5444caaecea433c8419770 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06ec58698d5444caaecea433c8419770 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "06ec58698d5444caaecea433c8419770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:06.299433  4634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584f5934b7fa4c7ab4b0b43923621e70" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:06.300715  4895 raft_consensus.cc:515] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
W20260709 13:12:06.302407  4529 leader_election.cc:343] T 584f5934b7fa4c7ab4b0b43923621e70 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:06.303619  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7682a3f7f134c34a24488586461f6a4" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:06.303826  4722 raft_consensus.cc:493] T 5cd01d60553a435387e507f5d6240b58 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.304215  4563 raft_consensus.cc:3060] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.304322  4722 raft_consensus.cc:515] T 5cd01d60553a435387e507f5d6240b58 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:06.304646  4412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a508f846d314fa0b7ec364af09bc427" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:06.305297  4412 raft_consensus.cc:2468] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 1.
I20260709 13:12:06.306459  4722 leader_election.cc:290] T 5cd01d60553a435387e507f5d6240b58 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:06.307047  4488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd01d60553a435387e507f5d6240b58" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:06.308173  4562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd01d60553a435387e507f5d6240b58" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:06.308068  4760 consensus_queue.cc:237] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 06ec58698d5444caaecea433c8419770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:06.308959  4562 raft_consensus.cc:2393] T 5cd01d60553a435387e507f5d6240b58 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74758684df5649ccadd1e189eaff32dc in current term 1: Already voted for candidate aa0ff974118b465eaa785b8a86057e87 in this term.
I20260709 13:12:06.310012  4603 leader_election.cc:304] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 74758684df5649ccadd1e189eaff32dc; no voters: aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:06.310309  4602 leader_election.cc:304] T 5cd01d60553a435387e507f5d6240b58 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc; no voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:06.315917  4563 raft_consensus.cc:2468] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 1.
I20260709 13:12:06.316165  4682 tablet_bootstrap.cc:654] T aa241e695dbb492a971f537d1f977f21 P 06ec58698d5444caaecea433c8419770: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:06.317210  4379 leader_election.cc:304] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: 
I20260709 13:12:06.318008  4722 raft_consensus.cc:3060] T 5cd01d60553a435387e507f5d6240b58 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.321071  4891 raft_consensus.cc:2804] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:06.321611  4891 raft_consensus.cc:697] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770 [term 1 LEADER]: Becoming Leader. State: Replica: 06ec58698d5444caaecea433c8419770, State: Running, Role: LEADER
I20260709 13:12:06.322561  4891 consensus_queue.cc:237] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:06.329093  4895 leader_election.cc:290] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Requested vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:06.331420  4685 tablet_bootstrap.cc:492] T 325a5a55a44a47ce97869216b084f89d P aa0ff974118b465eaa785b8a86057e87: No bootstrap required, opened a new log
I20260709 13:12:06.331658  4683 tablet_bootstrap.cc:492] T 1271bae393604d56b9e376c716eb2a9e P 420a61707e804ce5b3773a91cc2eb424: No bootstrap required, opened a new log
I20260709 13:12:06.331931  4685 ts_tablet_manager.cc:1403] T 325a5a55a44a47ce97869216b084f89d P aa0ff974118b465eaa785b8a86057e87: Time spent bootstrapping tablet: real 0.150s	user 0.034s	sys 0.047s
I20260709 13:12:06.332499  4683 ts_tablet_manager.cc:1403] T 1271bae393604d56b9e376c716eb2a9e P 420a61707e804ce5b3773a91cc2eb424: Time spent bootstrapping tablet: real 0.122s	user 0.012s	sys 0.006s
I20260709 13:12:06.341931  4681 tablet_bootstrap.cc:492] T 325a5a55a44a47ce97869216b084f89d P 74758684df5649ccadd1e189eaff32dc: No bootstrap required, opened a new log
I20260709 13:12:06.342455  4681 ts_tablet_manager.cc:1403] T 325a5a55a44a47ce97869216b084f89d P 74758684df5649ccadd1e189eaff32dc: Time spent bootstrapping tablet: real 0.183s	user 0.008s	sys 0.003s
I20260709 13:12:06.343442  4683 raft_consensus.cc:359] T 1271bae393604d56b9e376c716eb2a9e P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:06.340229  4754 raft_consensus.cc:2804] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:12:06.347630  4529 leader_election.cc:343] T 150545c47e0642229a92ede96db14fc9 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:06.348096  4529 leader_election.cc:304] T 150545c47e0642229a92ede96db14fc9 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424; no voters: 06ec58698d5444caaecea433c8419770, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:06.349336  4754 raft_consensus.cc:493] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting leader election (detected failure of leader aa0ff974118b465eaa785b8a86057e87)
I20260709 13:12:06.349439  4529 leader_election.cc:304] T 584f5934b7fa4c7ab4b0b43923621e70 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: 74758684df5649ccadd1e189eaff32dc
I20260709 13:12:06.349772  4754 raft_consensus.cc:3060] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:06.350792  4774 raft_consensus.cc:2749] T 150545c47e0642229a92ede96db14fc9 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:06.351940  4774 raft_consensus.cc:2804] T 584f5934b7fa4c7ab4b0b43923621e70 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:06.352288  4774 raft_consensus.cc:493] T 584f5934b7fa4c7ab4b0b43923621e70 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:06.352626  4774 raft_consensus.cc:3060] T 584f5934b7fa4c7ab4b0b43923621e70 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.356722  4682 tablet_bootstrap.cc:492] T aa241e695dbb492a971f537d1f977f21 P 06ec58698d5444caaecea433c8419770: No bootstrap required, opened a new log
I20260709 13:12:06.357218  4682 ts_tablet_manager.cc:1403] T aa241e695dbb492a971f537d1f977f21 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.113s	user 0.008s	sys 0.003s
I20260709 13:12:06.357360  4754 raft_consensus.cc:515] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:06.357730  4898 consensus_queue.cc:1048] T 1503964d57034b31b36eecc16f2c84a0 P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:06.359647  4754 leader_election.cc:290] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 election: Requested vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:06.345435  4681 raft_consensus.cc:359] T 325a5a55a44a47ce97869216b084f89d P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:06.361270  4681 raft_consensus.cc:385] T 325a5a55a44a47ce97869216b084f89d P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:06.361557  4681 raft_consensus.cc:740] T 325a5a55a44a47ce97869216b084f89d P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Initialized, Role: FOLLOWER
I20260709 13:12:06.362231  4681 consensus_queue.cc:260] T 325a5a55a44a47ce97869216b084f89d P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:06.334805  4685 raft_consensus.cc:359] T 325a5a55a44a47ce97869216b084f89d P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:06.363544  4685 raft_consensus.cc:385] T 325a5a55a44a47ce97869216b084f89d P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:06.363801  4685 raft_consensus.cc:740] T 325a5a55a44a47ce97869216b084f89d P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Initialized, Role: FOLLOWER
I20260709 13:12:06.364547  4489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a508f846d314fa0b7ec364af09bc427" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:06.365593  4487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7682a3f7f134c34a24488586461f6a4" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:06.368681  4489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7682a3f7f134c34a24488586461f6a4" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:06.369180  4681 ts_tablet_manager.cc:1434] T 325a5a55a44a47ce97869216b084f89d P 74758684df5649ccadd1e189eaff32dc: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 13:12:06.370129  4681 tablet_bootstrap.cc:492] T 584f5934b7fa4c7ab4b0b43923621e70 P 74758684df5649ccadd1e189eaff32dc: Bootstrap starting.
I20260709 13:12:06.360888  4682 raft_consensus.cc:359] T aa241e695dbb492a971f537d1f977f21 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:06.360100  4683 raft_consensus.cc:385] T 1271bae393604d56b9e376c716eb2a9e P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:06.370851  4683 raft_consensus.cc:740] T 1271bae393604d56b9e376c716eb2a9e P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Initialized, Role: FOLLOWER
I20260709 13:12:06.371534  4683 consensus_queue.cc:260] T 1271bae393604d56b9e376c716eb2a9e P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:06.370554  4682 raft_consensus.cc:385] T aa241e695dbb492a971f537d1f977f21 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:06.373109  4682 raft_consensus.cc:740] T aa241e695dbb492a971f537d1f977f21 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:06.375537  4685 consensus_queue.cc:260] T 325a5a55a44a47ce97869216b084f89d P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:06.374006  4682 consensus_queue.cc:260] T aa241e695dbb492a971f537d1f977f21 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:06.377307  4683 ts_tablet_manager.cc:1434] T 1271bae393604d56b9e376c716eb2a9e P 420a61707e804ce5b3773a91cc2eb424: Time spent starting tablet: real 0.036s	user 0.003s	sys 0.003s
I20260709 13:12:06.379668  4683 tablet_bootstrap.cc:492] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424: Bootstrap starting.
I20260709 13:12:06.386637  4682 ts_tablet_manager.cc:1434] T aa241e695dbb492a971f537d1f977f21 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.002s
I20260709 13:12:06.395174  4636 raft_consensus.cc:1240] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Rejecting Update request from peer aa0ff974118b465eaa785b8a86057e87 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:06.405102  4895 consensus_queue.cc:1048] T 1503964d57034b31b36eecc16f2c84a0 P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:06.391562  4743 raft_consensus.cc:493] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.407641  4743 raft_consensus.cc:515] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:06.409751  4743 leader_election.cc:290] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:06.412401  4633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fb0d1b4ae14754aa30516d12cdea3d" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:06.414616  4681 tablet_bootstrap.cc:654] T 584f5934b7fa4c7ab4b0b43923621e70 P 74758684df5649ccadd1e189eaff32dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:06.418517  4682 tablet_bootstrap.cc:492] T 150545c47e0642229a92ede96db14fc9 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
W20260709 13:12:06.419605  4529 leader_election.cc:343] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:06.409638  4310 catalog_manager.cc:5697] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 06ec58698d5444caaecea433c8419770 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06ec58698d5444caaecea433c8419770 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "06ec58698d5444caaecea433c8419770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:06.423759  4683 tablet_bootstrap.cc:654] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:06.373912  4884 consensus_queue.cc:1048] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.037s
I20260709 13:12:06.426240  4310 catalog_manager.cc:5697] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06ec58698d5444caaecea433c8419770 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "06ec58698d5444caaecea433c8419770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:06.430224  4685 ts_tablet_manager.cc:1434] T 325a5a55a44a47ce97869216b084f89d P aa0ff974118b465eaa785b8a86057e87: Time spent starting tablet: real 0.098s	user 0.007s	sys 0.000s
I20260709 13:12:06.425690  4413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a508f846d314fa0b7ec364af09bc427" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770"
I20260709 13:12:06.433175  4685 tablet_bootstrap.cc:492] T 3092a6c40d0d4610968fe09d4c7d16c0 P aa0ff974118b465eaa785b8a86057e87: Bootstrap starting.
I20260709 13:12:06.431589  4413 raft_consensus.cc:3060] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:06.434157  4758 consensus_queue.cc:1048] T d0147a5552154f26a88833f9210b1358 P 74758684df5649ccadd1e189eaff32dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:12:06.428282  4412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fb0d1b4ae14754aa30516d12cdea3d" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:06.445870  4413 raft_consensus.cc:2468] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 2.
W20260709 13:12:06.447256  4529 leader_election.cc:343] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:06.448679  4685 tablet_bootstrap.cc:654] T 3092a6c40d0d4610968fe09d4c7d16c0 P aa0ff974118b465eaa785b8a86057e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:06.453400  4879 consensus_queue.cc:1048] T 5cd01d60553a435387e507f5d6240b58 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:06.452637  4603 leader_election.cc:304] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 74758684df5649ccadd1e189eaff32dc; no voters: aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:06.455631  4691 raft_consensus.cc:2804] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:06.448848  4722 raft_consensus.cc:2749] T 5cd01d60553a435387e507f5d6240b58 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:06.456663  4682 tablet_bootstrap.cc:654] T 150545c47e0642229a92ede96db14fc9 P 06ec58698d5444caaecea433c8419770: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:06.452836  4758 consensus_queue.cc:1048] T d0147a5552154f26a88833f9210b1358 P 74758684df5649ccadd1e189eaff32dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:12:06.447679  4529 leader_election.cc:304] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424; no voters: 06ec58698d5444caaecea433c8419770, 74758684df5649ccadd1e189eaff32dc
W20260709 13:12:06.453647  4380 leader_election.cc:343] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:06.463572  4743 raft_consensus.cc:2749] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:06.447592  4774 raft_consensus.cc:515] T 584f5934b7fa4c7ab4b0b43923621e70 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
W20260709 13:12:06.464414  4380 leader_election.cc:343] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:06.475632  4774 leader_election.cc:290] T 584f5934b7fa4c7ab4b0b43923621e70 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 election: Requested vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:06.475163  4691 raft_consensus.cc:697] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc [term 2 LEADER]: Becoming Leader. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Running, Role: LEADER
I20260709 13:12:06.510174  4413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584f5934b7fa4c7ab4b0b43923621e70" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770"
I20260709 13:12:06.523727  4634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584f5934b7fa4c7ab4b0b43923621e70" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:06.535171  4411 raft_consensus.cc:1240] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Rejecting Update request from peer aa0ff974118b465eaa785b8a86057e87 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
W20260709 13:12:06.536072  4358 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:06.536147  4884 consensus_queue.cc:1048] T 5cd01d60553a435387e507f5d6240b58 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:06.478369  4879 consensus_queue.cc:1059] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.028s
W20260709 13:12:06.541318  4529 leader_election.cc:343] T 584f5934b7fa4c7ab4b0b43923621e70 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:06.548700  4774 raft_consensus.cc:493] T 9d526ab043434bf0bcab814f9bbc3234 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.551973  4691 consensus_queue.cc:237] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:06.541767  4413 raft_consensus.cc:3060] T 584f5934b7fa4c7ab4b0b43923621e70 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.549986  4774 raft_consensus.cc:515] T 9d526ab043434bf0bcab814f9bbc3234 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:06.563879  4682 tablet_bootstrap.cc:492] T 150545c47e0642229a92ede96db14fc9 P 06ec58698d5444caaecea433c8419770: No bootstrap required, opened a new log
I20260709 13:12:06.564348  4682 ts_tablet_manager.cc:1403] T 150545c47e0642229a92ede96db14fc9 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.146s	user 0.018s	sys 0.008s
I20260709 13:12:06.567548  4682 raft_consensus.cc:359] T 150545c47e0642229a92ede96db14fc9 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:06.568184  4682 raft_consensus.cc:385] T 150545c47e0642229a92ede96db14fc9 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:06.568436  4681 tablet_bootstrap.cc:492] T 584f5934b7fa4c7ab4b0b43923621e70 P 74758684df5649ccadd1e189eaff32dc: No bootstrap required, opened a new log
I20260709 13:12:06.569011  4681 ts_tablet_manager.cc:1403] T 584f5934b7fa4c7ab4b0b43923621e70 P 74758684df5649ccadd1e189eaff32dc: Time spent bootstrapping tablet: real 0.199s	user 0.020s	sys 0.009s
I20260709 13:12:06.568432  4682 raft_consensus.cc:740] T 150545c47e0642229a92ede96db14fc9 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:06.571969  4682 consensus_queue.cc:260] T 150545c47e0642229a92ede96db14fc9 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:06.575099  4682 ts_tablet_manager.cc:1434] T 150545c47e0642229a92ede96db14fc9 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:12:06.576805  4682 tablet_bootstrap.cc:492] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:06.581039  4685 tablet_bootstrap.cc:492] T 3092a6c40d0d4610968fe09d4c7d16c0 P aa0ff974118b465eaa785b8a86057e87: No bootstrap required, opened a new log
I20260709 13:12:06.581511  4685 ts_tablet_manager.cc:1403] T 3092a6c40d0d4610968fe09d4c7d16c0 P aa0ff974118b465eaa785b8a86057e87: Time spent bootstrapping tablet: real 0.151s	user 0.015s	sys 0.010s
I20260709 13:12:06.589085  4760 raft_consensus.cc:493] T aa241e695dbb492a971f537d1f977f21 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.584342  4884 consensus_queue.cc:1059] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:12:06.601270  4760 raft_consensus.cc:515] T aa241e695dbb492a971f537d1f977f21 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:06.583245  4681 raft_consensus.cc:359] T 584f5934b7fa4c7ab4b0b43923621e70 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:06.605050  4681 raft_consensus.cc:385] T 584f5934b7fa4c7ab4b0b43923621e70 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:06.605338  4681 raft_consensus.cc:740] T 584f5934b7fa4c7ab4b0b43923621e70 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Initialized, Role: FOLLOWER
I20260709 13:12:06.608625  4681 consensus_queue.cc:260] T 584f5934b7fa4c7ab4b0b43923621e70 P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:06.664750  4310 catalog_manager.cc:5697] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc reported cstate change: term changed from 1 to 2, leader changed from aa0ff974118b465eaa785b8a86057e87 (127.28.173.2) to 74758684df5649ccadd1e189eaff32dc (127.28.173.4). New cstate: current_term: 2 leader_uuid: "74758684df5649ccadd1e189eaff32dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:06.668253  4603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:45987, user_credentials={real_user=slave}} blocked reactor thread for 46406.1us
I20260709 13:12:06.668596  4682 tablet_bootstrap.cc:654] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:06.673058  4683 tablet_bootstrap.cc:492] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424: No bootstrap required, opened a new log
I20260709 13:12:06.673549  4683 ts_tablet_manager.cc:1403] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424: Time spent bootstrapping tablet: real 0.295s	user 0.014s	sys 0.008s
I20260709 13:12:06.674515  4681 ts_tablet_manager.cc:1434] T 584f5934b7fa4c7ab4b0b43923621e70 P 74758684df5649ccadd1e189eaff32dc: Time spent starting tablet: real 0.105s	user 0.010s	sys 0.002s
I20260709 13:12:06.675463  4681 tablet_bootstrap.cc:492] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 74758684df5649ccadd1e189eaff32dc: Bootstrap starting.
I20260709 13:12:06.676280  4760 leader_election.cc:290] T aa241e695dbb492a971f537d1f977f21 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:06.673552  4685 raft_consensus.cc:359] T 3092a6c40d0d4610968fe09d4c7d16c0 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:06.677676  4685 raft_consensus.cc:385] T 3092a6c40d0d4610968fe09d4c7d16c0 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:06.681200  4685 raft_consensus.cc:740] T 3092a6c40d0d4610968fe09d4c7d16c0 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Initialized, Role: FOLLOWER
I20260709 13:12:06.681834  4685 consensus_queue.cc:260] T 3092a6c40d0d4610968fe09d4c7d16c0 P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:06.683983  4879 raft_consensus.cc:493] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.685032  4879 raft_consensus.cc:515] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:06.680826  4774 leader_election.cc:290] T 9d526ab043434bf0bcab814f9bbc3234 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:06.686478  4895 consensus_queue.cc:1048] T 604a93ed898f4ab9b771487bfe278b33 P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:06.687383  4685 ts_tablet_manager.cc:1434] T 3092a6c40d0d4610968fe09d4c7d16c0 P aa0ff974118b465eaa785b8a86057e87: Time spent starting tablet: real 0.106s	user 0.008s	sys 0.007s
I20260709 13:12:06.687739  4681 tablet_bootstrap.cc:654] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 74758684df5649ccadd1e189eaff32dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:06.724598  4637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa241e695dbb492a971f537d1f977f21" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:06.723937  4412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d526ab043434bf0bcab814f9bbc3234" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
W20260709 13:12:06.725939  4454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:33159, user_credentials={real_user=slave}} blocked reactor thread for 54418.4us
I20260709 13:12:06.689592  4879 leader_election.cc:290] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:06.691211  4413 raft_consensus.cc:2468] T 584f5934b7fa4c7ab4b0b43923621e70 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 1.
I20260709 13:12:06.700723  4757 raft_consensus.cc:3055] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:06.731635  4757 raft_consensus.cc:740] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Running, Role: LEADER
I20260709 13:12:06.732724  4757 consensus_queue.cc:260] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:06.734018  4757 raft_consensus.cc:3060] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:06.734658  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1ff9a8e0d49d7b58940ccec6c0540" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:06.735283  4563 raft_consensus.cc:2468] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 0.
I20260709 13:12:06.689316  4487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d526ab043434bf0bcab814f9bbc3234" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:06.703064  4849 raft_consensus.cc:493] T 1271bae393604d56b9e376c716eb2a9e P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.742452  4849 raft_consensus.cc:515] T 1271bae393604d56b9e376c716eb2a9e P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:06.715782  4683 raft_consensus.cc:359] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:06.744102  4683 raft_consensus.cc:385] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:06.744419  4683 raft_consensus.cc:740] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Initialized, Role: FOLLOWER
I20260709 13:12:06.746913  4849 leader_election.cc:290] T 1271bae393604d56b9e376c716eb2a9e P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:06.747804  4685 tablet_bootstrap.cc:492] T f7682a3f7f134c34a24488586461f6a4 P aa0ff974118b465eaa785b8a86057e87: Bootstrap starting.
I20260709 13:12:06.752171  4634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1271bae393604d56b9e376c716eb2a9e" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:06.753751  4454 leader_election.cc:304] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 
W20260709 13:12:06.754402  4529 leader_election.cc:343] T 1271bae393604d56b9e376c716eb2a9e P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:06.755215  4923 raft_consensus.cc:2804] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:06.755600  4923 raft_consensus.cc:493] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:06.755959  4923 raft_consensus.cc:3060] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.756381  4681 tablet_bootstrap.cc:492] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 74758684df5649ccadd1e189eaff32dc: No bootstrap required, opened a new log
I20260709 13:12:06.756855  4681 ts_tablet_manager.cc:1403] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 74758684df5649ccadd1e189eaff32dc: Time spent bootstrapping tablet: real 0.082s	user 0.005s	sys 0.005s
I20260709 13:12:06.758661  4682 tablet_bootstrap.cc:492] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770: No bootstrap required, opened a new log
I20260709 13:12:06.759127  4682 ts_tablet_manager.cc:1403] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.183s	user 0.010s	sys 0.000s
I20260709 13:12:06.760035  4685 tablet_bootstrap.cc:654] T f7682a3f7f134c34a24488586461f6a4 P aa0ff974118b465eaa785b8a86057e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:06.761679  4682 raft_consensus.cc:359] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:06.762339  4682 raft_consensus.cc:385] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:06.762591  4682 raft_consensus.cc:740] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:06.747566  4683 consensus_queue.cc:260] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:06.767493  4683 ts_tablet_manager.cc:1434] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424: Time spent starting tablet: real 0.094s	user 0.006s	sys 0.000s
I20260709 13:12:06.768368  4683 tablet_bootstrap.cc:492] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424: Bootstrap starting.
W20260709 13:12:06.769229  4529 leader_election.cc:343] T 9d526ab043434bf0bcab814f9bbc3234 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:06.769907  4529 leader_election.cc:304] T 584f5934b7fa4c7ab4b0b43923621e70 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: 74758684df5649ccadd1e189eaff32dc
W20260709 13:12:06.748342  4455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:42711, user_credentials={real_user=slave}} blocked reactor thread for 57602.7us
I20260709 13:12:06.774351  4682 consensus_queue.cc:260] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:06.776001  4774 raft_consensus.cc:2804] T 584f5934b7fa4c7ab4b0b43923621e70 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:06.776222  4685 tablet_bootstrap.cc:492] T f7682a3f7f134c34a24488586461f6a4 P aa0ff974118b465eaa785b8a86057e87: No bootstrap required, opened a new log
I20260709 13:12:06.776530  4774 raft_consensus.cc:697] T 584f5934b7fa4c7ab4b0b43923621e70 P 420a61707e804ce5b3773a91cc2eb424 [term 1 LEADER]: Becoming Leader. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Running, Role: LEADER
I20260709 13:12:06.776918  4685 ts_tablet_manager.cc:1403] T f7682a3f7f134c34a24488586461f6a4 P aa0ff974118b465eaa785b8a86057e87: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.006s
I20260709 13:12:06.777078  4634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1ff9a8e0d49d7b58940ccec6c0540" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:06.777426  4774 consensus_queue.cc:237] T 584f5934b7fa4c7ab4b0b43923621e70 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:06.779798  4685 raft_consensus.cc:359] T f7682a3f7f134c34a24488586461f6a4 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:06.780663  4685 raft_consensus.cc:385] T f7682a3f7f134c34a24488586461f6a4 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:06.781064  4685 raft_consensus.cc:740] T f7682a3f7f134c34a24488586461f6a4 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Initialized, Role: FOLLOWER
I20260709 13:12:06.779927  4923 raft_consensus.cc:515] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:06.782035  4682 ts_tablet_manager.cc:1434] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:12:06.782994  4682 tablet_bootstrap.cc:492] T ff7757f22fe3408f8745bc899f3c2e4e P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:06.785073  4683 tablet_bootstrap.cc:654] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:06.781838  4685 consensus_queue.cc:260] T f7682a3f7f134c34a24488586461f6a4 P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:06.787199  4914 raft_consensus.cc:493] T 325a5a55a44a47ce97869216b084f89d P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.787562  4923 leader_election.cc:290] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 election: Requested vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:06.787658  4914 raft_consensus.cc:515] T 325a5a55a44a47ce97869216b084f89d P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:06.788914  4487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa241e695dbb492a971f537d1f977f21" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:06.790946  4413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325a5a55a44a47ce97869216b084f89d" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:06.791755  4413 raft_consensus.cc:2468] T 325a5a55a44a47ce97869216b084f89d P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 0.
I20260709 13:12:06.793615  4603 leader_election.cc:304] T 325a5a55a44a47ce97869216b084f89d P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 74758684df5649ccadd1e189eaff32dc; no voters: 
I20260709 13:12:06.795710  4915 raft_consensus.cc:2804] T 325a5a55a44a47ce97869216b084f89d P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:06.796187  4915 raft_consensus.cc:493] T 325a5a55a44a47ce97869216b084f89d P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:06.796561  4915 raft_consensus.cc:3060] T 325a5a55a44a47ce97869216b084f89d P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.834515  4685 ts_tablet_manager.cc:1434] T f7682a3f7f134c34a24488586461f6a4 P aa0ff974118b465eaa785b8a86057e87: Time spent starting tablet: real 0.057s	user 0.028s	sys 0.019s
I20260709 13:12:06.802887  4637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1ff9a8e0d49d7b58940ccec6c0540" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:06.846714  4685 tablet_bootstrap.cc:492] T 150545c47e0642229a92ede96db14fc9 P aa0ff974118b465eaa785b8a86057e87: Bootstrap starting.
I20260709 13:12:06.801411  4488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1271bae393604d56b9e376c716eb2a9e" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:06.834697  4914 leader_election.cc:290] T 325a5a55a44a47ce97869216b084f89d P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:06.840046  4486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325a5a55a44a47ce97869216b084f89d" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
W20260709 13:12:06.807163  4380 leader_election.cc:343] T aa241e695dbb492a971f537d1f977f21 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:06.851779  4486 raft_consensus.cc:2468] T 325a5a55a44a47ce97869216b084f89d P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 0.
W20260709 13:12:06.852221  4380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:42711, user_credentials={real_user=slave}} blocked reactor thread for 45102.1us
I20260709 13:12:06.821969  4915 raft_consensus.cc:515] T 325a5a55a44a47ce97869216b084f89d P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:06.817510  4562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1ff9a8e0d49d7b58940ccec6c0540" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:06.854243  4685 tablet_bootstrap.cc:654] T 150545c47e0642229a92ede96db14fc9 P aa0ff974118b465eaa785b8a86057e87: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:06.855669  4455 leader_election.cc:343] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:06.855765  4681 raft_consensus.cc:359] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:06.856570  4681 raft_consensus.cc:385] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:06.855019  4562 raft_consensus.cc:3060] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.859990  4682 tablet_bootstrap.cc:654] T ff7757f22fe3408f8745bc899f3c2e4e P 06ec58698d5444caaecea433c8419770: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:06.859931  4760 consensus_queue.cc:1048] T 604a93ed898f4ab9b771487bfe278b33 P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:06.857152  4914 raft_consensus.cc:493] T 584f5934b7fa4c7ab4b0b43923621e70 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.861536  4914 raft_consensus.cc:515] T 584f5934b7fa4c7ab4b0b43923621e70 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
W20260709 13:12:06.837522  4529 leader_election.cc:343] T 9d526ab043434bf0bcab814f9bbc3234 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:06.862597  4529 leader_election.cc:304] T 9d526ab043434bf0bcab814f9bbc3234 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424; no voters: 06ec58698d5444caaecea433c8419770, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:06.867838  4914 leader_election.cc:290] T 584f5934b7fa4c7ab4b0b43923621e70 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:06.868101  4774 raft_consensus.cc:2749] T 9d526ab043434bf0bcab814f9bbc3234 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:06.868762  4683 tablet_bootstrap.cc:492] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424: No bootstrap required, opened a new log
I20260709 13:12:06.869447  4413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584f5934b7fa4c7ab4b0b43923621e70" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:06.870301  4413 raft_consensus.cc:2393] T 584f5934b7fa4c7ab4b0b43923621e70 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74758684df5649ccadd1e189eaff32dc in current term 1: Already voted for candidate 420a61707e804ce5b3773a91cc2eb424 in this term.
I20260709 13:12:06.871713  4683 ts_tablet_manager.cc:1403] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424: Time spent bootstrapping tablet: real 0.104s	user 0.011s	sys 0.000s
I20260709 13:12:06.872913  4915 leader_election.cc:290] T 325a5a55a44a47ce97869216b084f89d P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 election: Requested vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:06.874948  4683 raft_consensus.cc:359] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:06.876643  4413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325a5a55a44a47ce97869216b084f89d" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770"
I20260709 13:12:06.885023  4757 raft_consensus.cc:493] T 3092a6c40d0d4610968fe09d4c7d16c0 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.885286  4413 raft_consensus.cc:3060] T 325a5a55a44a47ce97869216b084f89d P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.885690  4757 raft_consensus.cc:515] T 3092a6c40d0d4610968fe09d4c7d16c0 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:06.884642  4486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "325a5a55a44a47ce97869216b084f89d" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:06.883616  4898 consensus_queue.cc:1048] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:06.888151  4683 raft_consensus.cc:385] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:06.856913  4681 raft_consensus.cc:740] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Initialized, Role: FOLLOWER
I20260709 13:12:06.899158  4683 raft_consensus.cc:740] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Initialized, Role: FOLLOWER
I20260709 13:12:06.899605  4681 consensus_queue.cc:260] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:06.899888  4683 consensus_queue.cc:260] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:06.901763  4681 ts_tablet_manager.cc:1434] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 74758684df5649ccadd1e189eaff32dc: Time spent starting tablet: real 0.145s	user 0.007s	sys 0.001s
I20260709 13:12:06.902026  4683 ts_tablet_manager.cc:1434] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.000s
I20260709 13:12:06.902644  4681 tablet_bootstrap.cc:492] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc: Bootstrap starting.
I20260709 13:12:06.902890  4683 tablet_bootstrap.cc:492] T f63e5465acbf4283a97304441ba41968 P 420a61707e804ce5b3773a91cc2eb424: Bootstrap starting.
I20260709 13:12:06.894085  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "584f5934b7fa4c7ab4b0b43923621e70" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:06.895947  4562 raft_consensus.cc:2468] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 1.
I20260709 13:12:06.904560  4634 raft_consensus.cc:2468] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 0.
I20260709 13:12:06.905634  4454 leader_election.cc:304] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 74758684df5649ccadd1e189eaff32dc
I20260709 13:12:06.906883  4923 raft_consensus.cc:2804] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:12:06.895591  4380 leader_election.cc:343] T aa241e695dbb492a971f537d1f977f21 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:06.895955  4685 tablet_bootstrap.cc:492] T 150545c47e0642229a92ede96db14fc9 P aa0ff974118b465eaa785b8a86057e87: No bootstrap required, opened a new log
I20260709 13:12:06.897807  4487 raft_consensus.cc:3060] T f7682a3f7f134c34a24488586461f6a4 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.907397  4923 raft_consensus.cc:697] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P aa0ff974118b465eaa785b8a86057e87 [term 1 LEADER]: Becoming Leader. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Running, Role: LEADER
I20260709 13:12:06.907545  4380 leader_election.cc:304] T aa241e695dbb492a971f537d1f977f21 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06ec58698d5444caaecea433c8419770; no voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:06.908393  4923 consensus_queue.cc:237] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:06.915649  4685 ts_tablet_manager.cc:1403] T 150545c47e0642229a92ede96db14fc9 P aa0ff974118b465eaa785b8a86057e87: Time spent bootstrapping tablet: real 0.069s	user 0.013s	sys 0.023s
I20260709 13:12:06.918630  4681 tablet_bootstrap.cc:654] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:06.918785  4760 raft_consensus.cc:2749] T aa241e695dbb492a971f537d1f977f21 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:06.920694  4486 raft_consensus.cc:3060] T 325a5a55a44a47ce97869216b084f89d P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.920863  4757 leader_election.cc:290] T 3092a6c40d0d4610968fe09d4c7d16c0 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:06.922415  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3092a6c40d0d4610968fe09d4c7d16c0" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:06.923200  4563 raft_consensus.cc:2393] T 3092a6c40d0d4610968fe09d4c7d16c0 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aa0ff974118b465eaa785b8a86057e87 in current term 1: Already voted for candidate 420a61707e804ce5b3773a91cc2eb424 in this term.
I20260709 13:12:06.932076  4413 raft_consensus.cc:2468] T 325a5a55a44a47ce97869216b084f89d P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 1.
I20260709 13:12:06.932823  4898 raft_consensus.cc:493] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.933250  4603 leader_election.cc:304] T 325a5a55a44a47ce97869216b084f89d P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 74758684df5649ccadd1e189eaff32dc; no voters: 
I20260709 13:12:06.932343  4685 raft_consensus.cc:359] T 150545c47e0642229a92ede96db14fc9 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
W20260709 13:12:06.934459  4529 leader_election.cc:343] T 1271bae393604d56b9e376c716eb2a9e P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:06.934487  4685 raft_consensus.cc:385] T 150545c47e0642229a92ede96db14fc9 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:06.935225  4685 raft_consensus.cc:740] T 150545c47e0642229a92ede96db14fc9 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Initialized, Role: FOLLOWER
I20260709 13:12:06.935112  4529 leader_election.cc:304] T 1271bae393604d56b9e376c716eb2a9e P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424; no voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:06.936507  4915 raft_consensus.cc:2804] T 325a5a55a44a47ce97869216b084f89d P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:06.933692  4486 raft_consensus.cc:2468] T 325a5a55a44a47ce97869216b084f89d P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 1.
I20260709 13:12:06.933303  4898 raft_consensus.cc:515] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:06.937017  4915 raft_consensus.cc:697] T 325a5a55a44a47ce97869216b084f89d P 74758684df5649ccadd1e189eaff32dc [term 1 LEADER]: Becoming Leader. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Running, Role: LEADER
I20260709 13:12:06.937686  4685 consensus_queue.cc:260] T 150545c47e0642229a92ede96db14fc9 P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:06.937919  4915 consensus_queue.cc:237] T 325a5a55a44a47ce97869216b084f89d P 74758684df5649ccadd1e189eaff32dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:06.938552  4898 leader_election.cc:290] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:06.939087  4898 consensus_queue.cc:1048] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:06.940181  4685 ts_tablet_manager.cc:1434] T 150545c47e0642229a92ede96db14fc9 P aa0ff974118b465eaa785b8a86057e87: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:12:06.936510  4911 raft_consensus.cc:2749] T 1271bae393604d56b9e376c716eb2a9e P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:06.940665  4634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3092a6c40d0d4610968fe09d4c7d16c0" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:06.941113  4685 tablet_bootstrap.cc:492] T aa241e695dbb492a971f537d1f977f21 P aa0ff974118b465eaa785b8a86057e87: Bootstrap starting.
I20260709 13:12:06.941406  4634 raft_consensus.cc:2393] T 3092a6c40d0d4610968fe09d4c7d16c0 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aa0ff974118b465eaa785b8a86057e87 in current term 1: Already voted for candidate 74758684df5649ccadd1e189eaff32dc in this term.
I20260709 13:12:06.942844  4911 raft_consensus.cc:493] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.943292  4911 raft_consensus.cc:515] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:06.945348  4911 leader_election.cc:290] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:06.949299  4602 leader_election.cc:304] T 584f5934b7fa4c7ab4b0b43923621e70 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc; no voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424
I20260709 13:12:06.950695  4455 leader_election.cc:304] T 3092a6c40d0d4610968fe09d4c7d16c0 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa0ff974118b465eaa785b8a86057e87; no voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc
I20260709 13:12:06.951349  4914 raft_consensus.cc:3060] T 584f5934b7fa4c7ab4b0b43923621e70 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.955083  4683 tablet_bootstrap.cc:654] T f63e5465acbf4283a97304441ba41968 P 420a61707e804ce5b3773a91cc2eb424: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:06.955914  4562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fb0d1b4ae14754aa30516d12cdea3d" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:06.953188  4486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0608a8abe6c4bd083d751020218957e" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:06.960696  4311 catalog_manager.cc:5697] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P aa0ff974118b465eaa785b8a86057e87 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa0ff974118b465eaa785b8a86057e87 (127.28.173.2). New cstate: current_term: 1 leader_uuid: "aa0ff974118b465eaa785b8a86057e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:06.954437  4923 raft_consensus.cc:3060] T 3092a6c40d0d4610968fe09d4c7d16c0 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.957603  4937 raft_consensus.cc:493] T 150545c47e0642229a92ede96db14fc9 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.958456  4562 raft_consensus.cc:2468] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 0.
W20260709 13:12:06.973078  4529 leader_election.cc:343] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:06.977931  4379 leader_election.cc:304] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: 
I20260709 13:12:06.979215  4760 raft_consensus.cc:2804] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:06.979588  4760 raft_consensus.cc:493] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:06.979924  4760 raft_consensus.cc:3060] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.981562  4413 raft_consensus.cc:1275] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Refusing update from remote peer 74758684df5649ccadd1e189eaff32dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:06.986531  4758 consensus_queue.cc:1048] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:06.987128  4760 raft_consensus.cc:515] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:06.990020  4562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fb0d1b4ae14754aa30516d12cdea3d" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:06.990612  4562 raft_consensus.cc:3060] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.993398  4682 tablet_bootstrap.cc:492] T ff7757f22fe3408f8745bc899f3c2e4e P 06ec58698d5444caaecea433c8419770: No bootstrap required, opened a new log
I20260709 13:12:06.993919  4682 ts_tablet_manager.cc:1403] T ff7757f22fe3408f8745bc899f3c2e4e P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.211s	user 0.013s	sys 0.002s
I20260709 13:12:06.996754  4682 raft_consensus.cc:359] T ff7757f22fe3408f8745bc899f3c2e4e P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:06.997426  4682 raft_consensus.cc:385] T ff7757f22fe3408f8745bc899f3c2e4e P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:06.997838  4682 raft_consensus.cc:740] T ff7757f22fe3408f8745bc899f3c2e4e P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:06.998270  4760 leader_election.cc:290] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Requested vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:06.997334  4562 raft_consensus.cc:2468] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 1.
I20260709 13:12:06.970995  4937 raft_consensus.cc:515] T 150545c47e0642229a92ede96db14fc9 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:06.998613  4682 consensus_queue.cc:260] T ff7757f22fe3408f8745bc899f3c2e4e P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:06.999568  4379 leader_election.cc:304] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: 
I20260709 13:12:06.992022  4681 tablet_bootstrap.cc:492] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc: No bootstrap required, opened a new log
I20260709 13:12:07.000777  4682 ts_tablet_manager.cc:1434] T ff7757f22fe3408f8745bc899f3c2e4e P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:07.001039  4681 ts_tablet_manager.cc:1403] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc: Time spent bootstrapping tablet: real 0.099s	user 0.003s	sys 0.014s
W20260709 13:12:06.968385  4380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:45987, user_credentials={real_user=slave}} blocked reactor thread for 59364.7us
I20260709 13:12:07.001632  4682 tablet_bootstrap.cc:492] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:07.002591  4939 raft_consensus.cc:2804] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:07.003440  4939 raft_consensus.cc:697] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770 [term 1 LEADER]: Becoming Leader. State: Replica: 06ec58698d5444caaecea433c8419770, State: Running, Role: LEADER
I20260709 13:12:06.998574  4685 tablet_bootstrap.cc:654] T aa241e695dbb492a971f537d1f977f21 P aa0ff974118b465eaa785b8a86057e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:06.987234  4914 raft_consensus.cc:2749] T 584f5934b7fa4c7ab4b0b43923621e70 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:07.009141  4939 consensus_queue.cc:237] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:07.011736  4937 leader_election.cc:290] T 150545c47e0642229a92ede96db14fc9 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:07.012506  4682 tablet_bootstrap.cc:654] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.012805  4560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "150545c47e0642229a92ede96db14fc9" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:07.013448  4560 raft_consensus.cc:2468] T 150545c47e0642229a92ede96db14fc9 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 0.
I20260709 13:12:07.014516  4379 leader_election.cc:304] T 150545c47e0642229a92ede96db14fc9 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: 
I20260709 13:12:07.015177  4634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fb0d1b4ae14754aa30516d12cdea3d" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:07.016381  4760 raft_consensus.cc:2804] T 150545c47e0642229a92ede96db14fc9 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:07.016927  4760 raft_consensus.cc:493] T 150545c47e0642229a92ede96db14fc9 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:07.017359  4760 raft_consensus.cc:3060] T 150545c47e0642229a92ede96db14fc9 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.019054  4634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fb0d1b4ae14754aa30516d12cdea3d" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:07.003682  4681 raft_consensus.cc:359] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:07.024446  4681 raft_consensus.cc:385] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.024716  4681 raft_consensus.cc:740] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.024825  4486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "150545c47e0642229a92ede96db14fc9" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:07.025559  4486 raft_consensus.cc:2468] T 150545c47e0642229a92ede96db14fc9 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 0.
I20260709 13:12:07.025444  4681 consensus_queue.cc:260] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:07.028312  4308 catalog_manager.cc:5697] T 325a5a55a44a47ce97869216b084f89d P 74758684df5649ccadd1e189eaff32dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 74758684df5649ccadd1e189eaff32dc (127.28.173.4). New cstate: current_term: 1 leader_uuid: "74758684df5649ccadd1e189eaff32dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:07.036760  4683 tablet_bootstrap.cc:492] T f63e5465acbf4283a97304441ba41968 P 420a61707e804ce5b3773a91cc2eb424: No bootstrap required, opened a new log
I20260709 13:12:07.037422  4683 ts_tablet_manager.cc:1403] T f63e5465acbf4283a97304441ba41968 P 420a61707e804ce5b3773a91cc2eb424: Time spent bootstrapping tablet: real 0.135s	user 0.010s	sys 0.001s
I20260709 13:12:07.046680  4683 raft_consensus.cc:359] T f63e5465acbf4283a97304441ba41968 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
W20260709 13:12:07.028963  4380 leader_election.cc:343] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:07.048394  4380 leader_election.cc:343] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.023715  4923 raft_consensus.cc:2749] T 3092a6c40d0d4610968fe09d4c7d16c0 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:07.033968  4486 raft_consensus.cc:1275] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Refusing update from remote peer 74758684df5649ccadd1e189eaff32dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:07.050926  4681 ts_tablet_manager.cc:1434] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc: Time spent starting tablet: real 0.050s	user 0.004s	sys 0.003s
I20260709 13:12:07.035624  4685 tablet_bootstrap.cc:492] T aa241e695dbb492a971f537d1f977f21 P aa0ff974118b465eaa785b8a86057e87: No bootstrap required, opened a new log
I20260709 13:12:07.051424  4691 consensus_queue.cc:1048] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:07.051110  4310 catalog_manager.cc:5697] T 584f5934b7fa4c7ab4b0b43923621e70 P 420a61707e804ce5b3773a91cc2eb424 reported cstate change: term changed from 0 to 1, leader changed from <none> to 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3). New cstate: current_term: 1 leader_uuid: "420a61707e804ce5b3773a91cc2eb424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:07.055105  4412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0608a8abe6c4bd083d751020218957e" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:07.056658  4685 ts_tablet_manager.cc:1403] T aa241e695dbb492a971f537d1f977f21 P aa0ff974118b465eaa785b8a86057e87: Time spent bootstrapping tablet: real 0.116s	user 0.009s	sys 0.003s
I20260709 13:12:07.056468  4939 consensus_queue.cc:1048] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:07.058689  4939 consensus_queue.cc:1048] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:07.047585  4683 raft_consensus.cc:385] T f63e5465acbf4283a97304441ba41968 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.060078  4683 raft_consensus.cc:740] T f63e5465acbf4283a97304441ba41968 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.061101  4683 consensus_queue.cc:260] T f63e5465acbf4283a97304441ba41968 P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:07.062273  4681 tablet_bootstrap.cc:492] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc: Bootstrap starting.
W20260709 13:12:07.068923  4529 leader_election.cc:343] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.069550  4529 leader_election.cc:304] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424; no voters: 06ec58698d5444caaecea433c8419770, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:07.072184  4774 raft_consensus.cc:2749] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:07.073477  4682 tablet_bootstrap.cc:492] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770: No bootstrap required, opened a new log
I20260709 13:12:07.073719  4685 raft_consensus.cc:359] T aa241e695dbb492a971f537d1f977f21 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:07.073966  4682 ts_tablet_manager.cc:1403] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.073s	user 0.020s	sys 0.031s
I20260709 13:12:07.074371  4685 raft_consensus.cc:385] T aa241e695dbb492a971f537d1f977f21 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.076035  4683 ts_tablet_manager.cc:1434] T f63e5465acbf4283a97304441ba41968 P 420a61707e804ce5b3773a91cc2eb424: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.002s
I20260709 13:12:07.076996  4683 tablet_bootstrap.cc:492] T b731fe02a6f4441e816628760bfdfb54 P 420a61707e804ce5b3773a91cc2eb424: Bootstrap starting.
I20260709 13:12:07.077200  4682 raft_consensus.cc:359] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:07.078251  4682 raft_consensus.cc:385] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.078516  4682 raft_consensus.cc:740] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.078581  4911 raft_consensus.cc:493] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.079061  4911 raft_consensus.cc:515] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:07.079337  4682 consensus_queue.cc:260] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:07.081036  4911 leader_election.cc:290] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:07.083470  4682 ts_tablet_manager.cc:1434] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:12:07.083527  4634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7757f22fe3408f8745bc899f3c2e4e" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:07.084542  4682 tablet_bootstrap.cc:492] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
W20260709 13:12:07.085001  4529 leader_election.cc:343] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.086475  4412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7757f22fe3408f8745bc899f3c2e4e" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:07.087113  4412 raft_consensus.cc:2468] T ff7757f22fe3408f8745bc899f3c2e4e P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 0.
I20260709 13:12:07.074653  4685 raft_consensus.cc:740] T aa241e695dbb492a971f537d1f977f21 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.090839  4682 tablet_bootstrap.cc:654] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.093211  4529 leader_election.cc:304] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: 74758684df5649ccadd1e189eaff32dc
I20260709 13:12:07.094462  4911 raft_consensus.cc:2804] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:07.094959  4911 raft_consensus.cc:493] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:07.095408  4911 raft_consensus.cc:3060] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.098088  4898 raft_consensus.cc:493] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.098588  4898 raft_consensus.cc:515] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:07.100553  4898 leader_election.cc:290] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:07.101655  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d526ab043434bf0bcab814f9bbc3234" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:07.110476  4563 raft_consensus.cc:2468] T 9d526ab043434bf0bcab814f9bbc3234 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 0.
I20260709 13:12:07.111625  4379 leader_election.cc:304] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: 
I20260709 13:12:07.108791  4488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d526ab043434bf0bcab814f9bbc3234" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:07.113914  4898 raft_consensus.cc:2804] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:07.114279  4898 raft_consensus.cc:493] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:07.114609  4898 raft_consensus.cc:3060] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.090410  4685 consensus_queue.cc:260] T aa241e695dbb492a971f537d1f977f21 P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:07.121815  4898 raft_consensus.cc:515] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:07.122882  4760 raft_consensus.cc:515] T 150545c47e0642229a92ede96db14fc9 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:07.124850  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d526ab043434bf0bcab814f9bbc3234" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:07.125525  4563 raft_consensus.cc:3060] T 9d526ab043434bf0bcab814f9bbc3234 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.129930  4310 catalog_manager.cc:5697] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06ec58698d5444caaecea433c8419770 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "06ec58698d5444caaecea433c8419770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:07.131417  4685 ts_tablet_manager.cc:1434] T aa241e695dbb492a971f537d1f977f21 P aa0ff974118b465eaa785b8a86057e87: Time spent starting tablet: real 0.074s	user 0.007s	sys 0.001s
I20260709 13:12:07.133144  4685 tablet_bootstrap.cc:492] T f63e5465acbf4283a97304441ba41968 P aa0ff974118b465eaa785b8a86057e87: Bootstrap starting.
I20260709 13:12:07.138052  4563 raft_consensus.cc:2468] T 9d526ab043434bf0bcab814f9bbc3234 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 1.
I20260709 13:12:07.140722  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "150545c47e0642229a92ede96db14fc9" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:07.140779  4379 leader_election.cc:304] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: 
I20260709 13:12:07.141283  4563 raft_consensus.cc:3060] T 150545c47e0642229a92ede96db14fc9 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.141726  4760 leader_election.cc:290] T 150545c47e0642229a92ede96db14fc9 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Requested vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
W20260709 13:12:07.146169  4380 leader_election.cc:343] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.146938  4488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "150545c47e0642229a92ede96db14fc9" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:07.152088  4488 raft_consensus.cc:3060] T 150545c47e0642229a92ede96db14fc9 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.147361  4895 raft_consensus.cc:2804] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:07.152252  4898 leader_election.cc:290] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Requested vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:07.154989  4563 raft_consensus.cc:2468] T 150545c47e0642229a92ede96db14fc9 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 1.
I20260709 13:12:07.156739  4379 leader_election.cc:304] T 150545c47e0642229a92ede96db14fc9 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: 
I20260709 13:12:07.159652  4895 raft_consensus.cc:697] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770 [term 1 LEADER]: Becoming Leader. State: Replica: 06ec58698d5444caaecea433c8419770, State: Running, Role: LEADER
I20260709 13:12:07.161130  4895 consensus_queue.cc:237] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:07.164608  4898 raft_consensus.cc:2804] T 150545c47e0642229a92ede96db14fc9 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:07.165141  4898 raft_consensus.cc:697] T 150545c47e0642229a92ede96db14fc9 P 06ec58698d5444caaecea433c8419770 [term 1 LEADER]: Becoming Leader. State: Replica: 06ec58698d5444caaecea433c8419770, State: Running, Role: LEADER
I20260709 13:12:07.165966  4898 consensus_queue.cc:237] T 150545c47e0642229a92ede96db14fc9 P 06ec58698d5444caaecea433c8419770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:07.171327  4488 raft_consensus.cc:2468] T 150545c47e0642229a92ede96db14fc9 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 1.
I20260709 13:12:07.147627  4487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d526ab043434bf0bcab814f9bbc3234" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:07.175256  4911 raft_consensus.cc:515] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:07.178077  4634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7757f22fe3408f8745bc899f3c2e4e" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:07.179559  4681 tablet_bootstrap.cc:654] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.179606  4683 tablet_bootstrap.cc:654] T b731fe02a6f4441e816628760bfdfb54 P 420a61707e804ce5b3773a91cc2eb424: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:07.180099  4529 leader_election.cc:343] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.177304  4911 leader_election.cc:290] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 election: Requested vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:07.187750  4413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7757f22fe3408f8745bc899f3c2e4e" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770"
W20260709 13:12:07.187160  4380 leader_election.cc:343] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.189299  4413 raft_consensus.cc:3060] T ff7757f22fe3408f8745bc899f3c2e4e P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.199062  4685 tablet_bootstrap.cc:654] T f63e5465acbf4283a97304441ba41968 P aa0ff974118b465eaa785b8a86057e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.201596  4413 raft_consensus.cc:2468] T ff7757f22fe3408f8745bc899f3c2e4e P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 1.
I20260709 13:12:07.202522  4529 leader_election.cc:304] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: 74758684df5649ccadd1e189eaff32dc
I20260709 13:12:07.203948  4911 raft_consensus.cc:2804] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:07.207269  4911 raft_consensus.cc:697] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424 [term 1 LEADER]: Becoming Leader. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Running, Role: LEADER
I20260709 13:12:07.208245  4911 consensus_queue.cc:237] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:07.209470  4682 tablet_bootstrap.cc:492] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770: No bootstrap required, opened a new log
I20260709 13:12:07.209955  4682 ts_tablet_manager.cc:1403] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.126s	user 0.053s	sys 0.046s
I20260709 13:12:07.213327  4682 raft_consensus.cc:359] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:07.213971  4682 raft_consensus.cc:385] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.214224  4682 raft_consensus.cc:740] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.214952  4682 consensus_queue.cc:260] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:07.218178  4682 ts_tablet_manager.cc:1434] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:12:07.218448  4681 tablet_bootstrap.cc:492] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc: No bootstrap required, opened a new log
I20260709 13:12:07.218916  4681 ts_tablet_manager.cc:1403] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc: Time spent bootstrapping tablet: real 0.167s	user 0.018s	sys 0.003s
I20260709 13:12:07.219179  4682 tablet_bootstrap.cc:492] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:07.218278  4310 catalog_manager.cc:5697] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06ec58698d5444caaecea433c8419770 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "06ec58698d5444caaecea433c8419770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:07.222466  4681 raft_consensus.cc:359] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:07.222944  4685 tablet_bootstrap.cc:492] T f63e5465acbf4283a97304441ba41968 P aa0ff974118b465eaa785b8a86057e87: No bootstrap required, opened a new log
I20260709 13:12:07.223161  4681 raft_consensus.cc:385] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.223438  4685 ts_tablet_manager.cc:1403] T f63e5465acbf4283a97304441ba41968 P aa0ff974118b465eaa785b8a86057e87: Time spent bootstrapping tablet: real 0.091s	user 0.009s	sys 0.002s
I20260709 13:12:07.223523  4681 raft_consensus.cc:740] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.224460  4681 consensus_queue.cc:260] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:07.225574  4682 tablet_bootstrap.cc:654] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.226073  4685 raft_consensus.cc:359] T f63e5465acbf4283a97304441ba41968 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:07.226691  4685 raft_consensus.cc:385] T f63e5465acbf4283a97304441ba41968 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.226956  4685 raft_consensus.cc:740] T f63e5465acbf4283a97304441ba41968 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.227667  4685 consensus_queue.cc:260] T f63e5465acbf4283a97304441ba41968 P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:07.233253  4681 ts_tablet_manager.cc:1434] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:12:07.234213  4681 tablet_bootstrap.cc:492] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc: Bootstrap starting.
I20260709 13:12:07.245311  4682 tablet_bootstrap.cc:492] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770: No bootstrap required, opened a new log
I20260709 13:12:07.246085  4682 ts_tablet_manager.cc:1403] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.002s
I20260709 13:12:07.250696  4685 ts_tablet_manager.cc:1434] T f63e5465acbf4283a97304441ba41968 P aa0ff974118b465eaa785b8a86057e87: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:12:07.256085  4685 tablet_bootstrap.cc:492] T 9d526ab043434bf0bcab814f9bbc3234 P aa0ff974118b465eaa785b8a86057e87: Bootstrap starting.
I20260709 13:12:07.252616  4307 catalog_manager.cc:5697] T 150545c47e0642229a92ede96db14fc9 P 06ec58698d5444caaecea433c8419770 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06ec58698d5444caaecea433c8419770 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "06ec58698d5444caaecea433c8419770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:07.262233  4683 tablet_bootstrap.cc:492] T b731fe02a6f4441e816628760bfdfb54 P 420a61707e804ce5b3773a91cc2eb424: No bootstrap required, opened a new log
I20260709 13:12:07.264711  4685 tablet_bootstrap.cc:654] T 9d526ab043434bf0bcab814f9bbc3234 P aa0ff974118b465eaa785b8a86057e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.265849  4683 ts_tablet_manager.cc:1403] T b731fe02a6f4441e816628760bfdfb54 P 420a61707e804ce5b3773a91cc2eb424: Time spent bootstrapping tablet: real 0.189s	user 0.012s	sys 0.010s
I20260709 13:12:07.268369  4683 raft_consensus.cc:359] T b731fe02a6f4441e816628760bfdfb54 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:07.269083  4683 raft_consensus.cc:385] T b731fe02a6f4441e816628760bfdfb54 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.269351  4683 raft_consensus.cc:740] T b731fe02a6f4441e816628760bfdfb54 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.270049  4683 consensus_queue.cc:260] T b731fe02a6f4441e816628760bfdfb54 P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:07.264498  4308 catalog_manager.cc:5697] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424 reported cstate change: term changed from 0 to 1, leader changed from <none> to 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3). New cstate: current_term: 1 leader_uuid: "420a61707e804ce5b3773a91cc2eb424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:07.278594  4682 raft_consensus.cc:359] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:07.279284  4682 raft_consensus.cc:385] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.279542  4682 raft_consensus.cc:740] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.280210  4682 consensus_queue.cc:260] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:07.281119  4681 tablet_bootstrap.cc:654] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.280723  4683 ts_tablet_manager.cc:1434] T b731fe02a6f4441e816628760bfdfb54 P 420a61707e804ce5b3773a91cc2eb424: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:12:07.285207  4683 tablet_bootstrap.cc:492] T be5e478344f14439b78f1a9bf58f4451 P 420a61707e804ce5b3773a91cc2eb424: Bootstrap starting.
I20260709 13:12:07.294297  4682 ts_tablet_manager.cc:1434] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 13:12:07.295269  4682 tablet_bootstrap.cc:492] T 49047cb7a56246288b9044f8ebec130f P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:07.293689  4849 raft_consensus.cc:493] T f63e5465acbf4283a97304441ba41968 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.297992  4849 raft_consensus.cc:515] T f63e5465acbf4283a97304441ba41968 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:07.300096  4849 leader_election.cc:290] T f63e5465acbf4283a97304441ba41968 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:07.300858  4682 tablet_bootstrap.cc:654] T 49047cb7a56246288b9044f8ebec130f P 06ec58698d5444caaecea433c8419770: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.301396  4691 raft_consensus.cc:493] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.301865  4634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f63e5465acbf4283a97304441ba41968" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:07.301913  4691 raft_consensus.cc:515] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
W20260709 13:12:07.304698  4529 leader_election.cc:343] T f63e5465acbf4283a97304441ba41968 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.304996  4412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa241e695dbb492a971f537d1f977f21" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:07.305962  4412 raft_consensus.cc:2468] T aa241e695dbb492a971f537d1f977f21 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 0.
I20260709 13:12:07.306620  4683 tablet_bootstrap.cc:654] T be5e478344f14439b78f1a9bf58f4451 P 420a61707e804ce5b3773a91cc2eb424: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.307452  4603 leader_election.cc:304] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 74758684df5649ccadd1e189eaff32dc; no voters: 
I20260709 13:12:07.309553  4915 raft_consensus.cc:2804] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:07.309926  4915 raft_consensus.cc:493] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:07.310309  4915 raft_consensus.cc:3060] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.315529  4487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f63e5465acbf4283a97304441ba41968" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:07.316443  4487 raft_consensus.cc:2468] T f63e5465acbf4283a97304441ba41968 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 0.
I20260709 13:12:07.321456  4634 raft_consensus.cc:3060] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.321599  4529 leader_election.cc:304] T f63e5465acbf4283a97304441ba41968 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 74758684df5649ccadd1e189eaff32dc
I20260709 13:12:07.328497  4691 leader_election.cc:290] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:07.330710  4923 consensus_queue.cc:1048] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:07.340073  4683 tablet_bootstrap.cc:492] T be5e478344f14439b78f1a9bf58f4451 P 420a61707e804ce5b3773a91cc2eb424: No bootstrap required, opened a new log
I20260709 13:12:07.340572  4683 ts_tablet_manager.cc:1403] T be5e478344f14439b78f1a9bf58f4451 P 420a61707e804ce5b3773a91cc2eb424: Time spent bootstrapping tablet: real 0.059s	user 0.018s	sys 0.005s
I20260709 13:12:07.332520  4487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa241e695dbb492a971f537d1f977f21" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:07.343343  4487 raft_consensus.cc:2468] T aa241e695dbb492a971f537d1f977f21 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 0.
I20260709 13:12:07.334293  4743 raft_consensus.cc:2804] T f63e5465acbf4283a97304441ba41968 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:07.344619  4743 raft_consensus.cc:493] T f63e5465acbf4283a97304441ba41968 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:07.344978  4743 raft_consensus.cc:3060] T f63e5465acbf4283a97304441ba41968 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.347324  4915 raft_consensus.cc:515] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:07.349797  4685 tablet_bootstrap.cc:492] T 9d526ab043434bf0bcab814f9bbc3234 P aa0ff974118b465eaa785b8a86057e87: No bootstrap required, opened a new log
I20260709 13:12:07.350061  4682 tablet_bootstrap.cc:492] T 49047cb7a56246288b9044f8ebec130f P 06ec58698d5444caaecea433c8419770: No bootstrap required, opened a new log
I20260709 13:12:07.350296  4685 ts_tablet_manager.cc:1403] T 9d526ab043434bf0bcab814f9bbc3234 P aa0ff974118b465eaa785b8a86057e87: Time spent bootstrapping tablet: real 0.099s	user 0.014s	sys 0.009s
I20260709 13:12:07.349941  4911 consensus_queue.cc:1048] T 584f5934b7fa4c7ab4b0b43923621e70 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:07.350594  4682 ts_tablet_manager.cc:1403] T 49047cb7a56246288b9044f8ebec130f P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.056s	user 0.023s	sys 0.014s
I20260709 13:12:07.354108  4915 leader_election.cc:290] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 election: Requested vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:07.356518  4412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa241e695dbb492a971f537d1f977f21" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770"
I20260709 13:12:07.357131  4412 raft_consensus.cc:3060] T aa241e695dbb492a971f537d1f977f21 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.358877  4685 raft_consensus.cc:359] T 9d526ab043434bf0bcab814f9bbc3234 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:07.359190  4682 raft_consensus.cc:359] T 49047cb7a56246288b9044f8ebec130f P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:07.359980  4682 raft_consensus.cc:385] T 49047cb7a56246288b9044f8ebec130f P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.359750  4683 raft_consensus.cc:359] T be5e478344f14439b78f1a9bf58f4451 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:07.360539  4683 raft_consensus.cc:385] T be5e478344f14439b78f1a9bf58f4451 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.360891  4683 raft_consensus.cc:740] T be5e478344f14439b78f1a9bf58f4451 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.359573  4685 raft_consensus.cc:385] T 9d526ab043434bf0bcab814f9bbc3234 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.361590  4683 consensus_queue.cc:260] T be5e478344f14439b78f1a9bf58f4451 P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:07.362583  4681 tablet_bootstrap.cc:492] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc: No bootstrap required, opened a new log
I20260709 13:12:07.362900  4487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa241e695dbb492a971f537d1f977f21" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:07.363358  4685 raft_consensus.cc:740] T 9d526ab043434bf0bcab814f9bbc3234 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.363736  4681 ts_tablet_manager.cc:1403] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc: Time spent bootstrapping tablet: real 0.130s	user 0.008s	sys 0.022s
I20260709 13:12:07.363694  4487 raft_consensus.cc:3060] T aa241e695dbb492a971f537d1f977f21 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.364428  4685 consensus_queue.cc:260] T 9d526ab043434bf0bcab814f9bbc3234 P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:07.360404  4682 raft_consensus.cc:740] T 49047cb7a56246288b9044f8ebec130f P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.365949  4682 consensus_queue.cc:260] T 49047cb7a56246288b9044f8ebec130f P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:07.366642  4681 raft_consensus.cc:359] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:07.367272  4681 raft_consensus.cc:385] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.367580  4681 raft_consensus.cc:740] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.368230  4682 ts_tablet_manager.cc:1434] T 49047cb7a56246288b9044f8ebec130f P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:12:07.368237  4681 consensus_queue.cc:260] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:07.373181  4487 raft_consensus.cc:2468] T aa241e695dbb492a971f537d1f977f21 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 1.
I20260709 13:12:07.390062  4685 ts_tablet_manager.cc:1434] T 9d526ab043434bf0bcab814f9bbc3234 P aa0ff974118b465eaa785b8a86057e87: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.003s
I20260709 13:12:07.391467  4685 tablet_bootstrap.cc:492] T a16334f2dff74513ba7ca22ca8fb5afd P aa0ff974118b465eaa785b8a86057e87: Bootstrap starting.
I20260709 13:12:07.373498  4895 raft_consensus.cc:493] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.393006  4895 raft_consensus.cc:515] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:07.393673  4743 raft_consensus.cc:515] T f63e5465acbf4283a97304441ba41968 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:07.395112  4895 leader_election.cc:290] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:07.373929  4681 ts_tablet_manager.cc:1434] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:12:07.397246  4488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f63e5465acbf4283a97304441ba41968" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:07.369776  4683 ts_tablet_manager.cc:1434] T be5e478344f14439b78f1a9bf58f4451 P 420a61707e804ce5b3773a91cc2eb424: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:12:07.376087  4898 raft_consensus.cc:493] T 49047cb7a56246288b9044f8ebec130f P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.397850  4488 raft_consensus.cc:3060] T f63e5465acbf4283a97304441ba41968 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.398185  4898 raft_consensus.cc:515] T 49047cb7a56246288b9044f8ebec130f P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:07.399994  4603 leader_election.cc:304] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:07.400256  4898 leader_election.cc:290] T 49047cb7a56246288b9044f8ebec130f P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:07.401238  4637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a16334f2dff74513ba7ca22ca8fb5afd" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:07.401677  4754 raft_consensus.cc:2804] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:07.401865  4637 raft_consensus.cc:2468] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 0.
I20260709 13:12:07.376989  4923 consensus_queue.cc:1048] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:07.402213  4754 raft_consensus.cc:697] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc [term 1 LEADER]: Becoming Leader. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Running, Role: LEADER
I20260709 13:12:07.377676  4682 tablet_bootstrap.cc:492] T 60d704077649426ab65d89dd9ff778d0 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:07.403118  4754 consensus_queue.cc:237] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:07.404057  4634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49047cb7a56246288b9044f8ebec130f" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:07.407532  4682 tablet_bootstrap.cc:654] T 60d704077649426ab65d89dd9ff778d0 P 06ec58698d5444caaecea433c8419770: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.381544  4915 consensus_queue.cc:1048] T 325a5a55a44a47ce97869216b084f89d P 74758684df5649ccadd1e189eaff32dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:07.387738  4911 raft_consensus.cc:493] T be5e478344f14439b78f1a9bf58f4451 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.408708  4911 raft_consensus.cc:515] T be5e478344f14439b78f1a9bf58f4451 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:07.409255  4486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a16334f2dff74513ba7ca22ca8fb5afd" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:07.410311  4691 consensus_queue.cc:1048] T 325a5a55a44a47ce97869216b084f89d P 74758684df5649ccadd1e189eaff32dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:07.412282  4911 leader_election.cc:290] T be5e478344f14439b78f1a9bf58f4451 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:07.389221  4412 raft_consensus.cc:2468] T aa241e695dbb492a971f537d1f977f21 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 1.
I20260709 13:12:07.414815  4486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49047cb7a56246288b9044f8ebec130f" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
W20260709 13:12:07.415880  4380 leader_election.cc:343] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:07.416706  4380 leader_election.cc:343] T 49047cb7a56246288b9044f8ebec130f P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.419636  4898 raft_consensus.cc:493] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.420141  4898 raft_consensus.cc:515] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:07.422118  4898 leader_election.cc:290] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:07.423486  4560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0608a8abe6c4bd083d751020218957e" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:07.424346  4560 raft_consensus.cc:2468] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 0.
I20260709 13:12:07.425998  4379 leader_election.cc:304] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: 
I20260709 13:12:07.427062  4898 raft_consensus.cc:2804] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:07.427515  4898 raft_consensus.cc:493] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:07.427958  4898 raft_consensus.cc:3060] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.428818  4774 consensus_queue.cc:1048] T 584f5934b7fa4c7ab4b0b43923621e70 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:07.433209  4634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5e478344f14439b78f1a9bf58f4451" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:07.435727  4681 tablet_bootstrap.cc:492] T ff7757f22fe3408f8745bc899f3c2e4e P 74758684df5649ccadd1e189eaff32dc: Bootstrap starting.
I20260709 13:12:07.437677  4487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0608a8abe6c4bd083d751020218957e" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:07.439136  4487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5e478344f14439b78f1a9bf58f4451" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
W20260709 13:12:07.445119  4380 leader_election.cc:343] T 49047cb7a56246288b9044f8ebec130f P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.445695  4634 raft_consensus.cc:3060] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:07.447975  4529 leader_election.cc:343] T be5e478344f14439b78f1a9bf58f4451 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.397269  4685 tablet_bootstrap.cc:654] T a16334f2dff74513ba7ca22ca8fb5afd P aa0ff974118b465eaa785b8a86057e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.409155  4683 tablet_bootstrap.cc:492] T 541b1e6cfdca4f609467169f4caf64ef P 420a61707e804ce5b3773a91cc2eb424: Bootstrap starting.
I20260709 13:12:07.445672  4380 leader_election.cc:304] T 49047cb7a56246288b9044f8ebec130f P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06ec58698d5444caaecea433c8419770; no voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:07.458693  4380 leader_election.cc:304] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 74758684df5649ccadd1e189eaff32dc; no voters: aa0ff974118b465eaa785b8a86057e87
W20260709 13:12:07.455859  4529 leader_election.cc:343] T be5e478344f14439b78f1a9bf58f4451 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.460593  4529 leader_election.cc:304] T be5e478344f14439b78f1a9bf58f4451 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424; no voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:07.471146  4774 raft_consensus.cc:2749] T be5e478344f14439b78f1a9bf58f4451 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:07.452965  4743 leader_election.cc:290] T f63e5465acbf4283a97304441ba41968 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 election: Requested vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:07.482867  4637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f63e5465acbf4283a97304441ba41968" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc"
W20260709 13:12:07.486495  4529 leader_election.cc:343] T f63e5465acbf4283a97304441ba41968 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.487339  4743 raft_consensus.cc:493] T b731fe02a6f4441e816628760bfdfb54 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.488092  4681 tablet_bootstrap.cc:654] T ff7757f22fe3408f8745bc899f3c2e4e P 74758684df5649ccadd1e189eaff32dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.461163  4760 raft_consensus.cc:2749] T 49047cb7a56246288b9044f8ebec130f P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:07.487845  4743 raft_consensus.cc:515] T b731fe02a6f4441e816628760bfdfb54 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:07.486649  4683 tablet_bootstrap.cc:654] T 541b1e6cfdca4f609467169f4caf64ef P 420a61707e804ce5b3773a91cc2eb424: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:07.492152  4380 leader_election.cc:343] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.499687  4412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b731fe02a6f4441e816628760bfdfb54" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:07.501520  4637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b731fe02a6f4441e816628760bfdfb54" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:07.505611  4891 consensus_queue.cc:1048] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:07.492552  4760 raft_consensus.cc:2804] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:07.506922  4760 raft_consensus.cc:493] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:07.507267  4760 raft_consensus.cc:3060] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.493196  4743 leader_election.cc:290] T b731fe02a6f4441e816628760bfdfb54 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
W20260709 13:12:07.513439  4529 leader_election.cc:343] T b731fe02a6f4441e816628760bfdfb54 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.526320  4308 catalog_manager.cc:5697] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 74758684df5649ccadd1e189eaff32dc (127.28.173.4). New cstate: current_term: 1 leader_uuid: "74758684df5649ccadd1e189eaff32dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:07.534808  4898 raft_consensus.cc:515] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:07.476157  4488 raft_consensus.cc:2468] T f63e5465acbf4283a97304441ba41968 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 1.
W20260709 13:12:07.541023  4529 leader_election.cc:343] T b731fe02a6f4441e816628760bfdfb54 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.542141  4754 raft_consensus.cc:493] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.555797  4529 leader_election.cc:304] T b731fe02a6f4441e816628760bfdfb54 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424; no voters: 06ec58698d5444caaecea433c8419770, 74758684df5649ccadd1e189eaff32dc
I20260709 13:12:07.556308  4754 raft_consensus.cc:515] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:07.557125  4743 raft_consensus.cc:2749] T b731fe02a6f4441e816628760bfdfb54 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:07.558090  4529 leader_election.cc:304] T f63e5465acbf4283a97304441ba41968 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 74758684df5649ccadd1e189eaff32dc
I20260709 13:12:07.545246  4682 tablet_bootstrap.cc:492] T 60d704077649426ab65d89dd9ff778d0 P 06ec58698d5444caaecea433c8419770: No bootstrap required, opened a new log
I20260709 13:12:07.559146  4682 ts_tablet_manager.cc:1403] T 60d704077649426ab65d89dd9ff778d0 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.182s	user 0.009s	sys 0.003s
I20260709 13:12:07.559329  4743 raft_consensus.cc:2804] T f63e5465acbf4283a97304441ba41968 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:07.559906  4743 raft_consensus.cc:697] T f63e5465acbf4283a97304441ba41968 P 420a61707e804ce5b3773a91cc2eb424 [term 1 LEADER]: Becoming Leader. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Running, Role: LEADER
I20260709 13:12:07.560668  4562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fb0d1b4ae14754aa30516d12cdea3d" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:07.560732  4743 consensus_queue.cc:237] T f63e5465acbf4283a97304441ba41968 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:07.561810  4682 raft_consensus.cc:359] T 60d704077649426ab65d89dd9ff778d0 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:07.562508  4682 raft_consensus.cc:385] T 60d704077649426ab65d89dd9ff778d0 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.562754  4682 raft_consensus.cc:740] T 60d704077649426ab65d89dd9ff778d0 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.562841  4754 leader_election.cc:290] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:07.553704  4685 tablet_bootstrap.cc:492] T a16334f2dff74513ba7ca22ca8fb5afd P aa0ff974118b465eaa785b8a86057e87: No bootstrap required, opened a new log
I20260709 13:12:07.563714  4685 ts_tablet_manager.cc:1403] T a16334f2dff74513ba7ca22ca8fb5afd P aa0ff974118b465eaa785b8a86057e87: Time spent bootstrapping tablet: real 0.173s	user 0.016s	sys 0.009s
I20260709 13:12:07.564749  4682 consensus_queue.cc:260] T 60d704077649426ab65d89dd9ff778d0 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:07.568421  4939 consensus_queue.cc:1048] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:12:07.583949  4682 ts_tablet_manager.cc:1434] T 60d704077649426ab65d89dd9ff778d0 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.004s
I20260709 13:12:07.586401  4939 consensus_queue.cc:1048] T 150545c47e0642229a92ede96db14fc9 P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:07.587610  4923 raft_consensus.cc:493] T 9d526ab043434bf0bcab814f9bbc3234 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.588116  4923 raft_consensus.cc:515] T 9d526ab043434bf0bcab814f9bbc3234 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:07.590166  4923 leader_election.cc:290] T 9d526ab043434bf0bcab814f9bbc3234 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:07.591342  4412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fb0d1b4ae14754aa30516d12cdea3d" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:07.593209  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d526ab043434bf0bcab814f9bbc3234" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:07.593972  4563 raft_consensus.cc:2393] T 9d526ab043434bf0bcab814f9bbc3234 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aa0ff974118b465eaa785b8a86057e87 in current term 1: Already voted for candidate 06ec58698d5444caaecea433c8419770 in this term.
I20260709 13:12:07.595057  4685 raft_consensus.cc:359] T a16334f2dff74513ba7ca22ca8fb5afd P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:07.596197  4412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d526ab043434bf0bcab814f9bbc3234" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:07.596984  4898 leader_election.cc:290] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Requested vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:07.597446  4487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0608a8abe6c4bd083d751020218957e" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:07.574810  4760 raft_consensus.cc:515] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:07.599890  4760 leader_election.cc:290] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Requested vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:07.600247  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0608a8abe6c4bd083d751020218957e" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:07.600445  4760 consensus_queue.cc:1048] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:07.600839  4563 raft_consensus.cc:3060] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.600013  4603 leader_election.cc:304] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc; no voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424
I20260709 13:12:07.607558  4455 leader_election.cc:304] T 9d526ab043434bf0bcab814f9bbc3234 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa0ff974118b465eaa785b8a86057e87; no voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424
I20260709 13:12:07.595738  4685 raft_consensus.cc:385] T a16334f2dff74513ba7ca22ca8fb5afd P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.609193  4685 raft_consensus.cc:740] T a16334f2dff74513ba7ca22ca8fb5afd P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.609254  4923 raft_consensus.cc:3060] T 9d526ab043434bf0bcab814f9bbc3234 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.610001  4685 consensus_queue.cc:260] T a16334f2dff74513ba7ca22ca8fb5afd P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:07.615837  4634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a16334f2dff74513ba7ca22ca8fb5afd" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:07.616420  4634 raft_consensus.cc:3060] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.611292  4691 raft_consensus.cc:2749] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:07.620096  4682 tablet_bootstrap.cc:492] T 98342133e28b47d8a388f9321d5fd796 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:07.624984  4563 raft_consensus.cc:2468] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 1.
I20260709 13:12:07.626188  4685 ts_tablet_manager.cc:1434] T a16334f2dff74513ba7ca22ca8fb5afd P aa0ff974118b465eaa785b8a86057e87: Time spent starting tablet: real 0.062s	user 0.006s	sys 0.000s
I20260709 13:12:07.627404  4685 tablet_bootstrap.cc:492] T 1271bae393604d56b9e376c716eb2a9e P aa0ff974118b465eaa785b8a86057e87: Bootstrap starting.
W20260709 13:12:07.628328  4380 leader_election.cc:343] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.632651  4939 consensus_queue.cc:1048] T 150545c47e0642229a92ede96db14fc9 P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:07.632737  4488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a16334f2dff74513ba7ca22ca8fb5afd" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:07.633597  4488 raft_consensus.cc:3060] T a16334f2dff74513ba7ca22ca8fb5afd P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.636351  4379 leader_election.cc:304] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:07.638360  4634 raft_consensus.cc:2468] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 1.
I20260709 13:12:07.640894  4895 raft_consensus.cc:2804] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:07.641527  4895 raft_consensus.cc:697] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770 [term 1 LEADER]: Becoming Leader. State: Replica: 06ec58698d5444caaecea433c8419770, State: Running, Role: LEADER
I20260709 13:12:07.642608  4895 consensus_queue.cc:237] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:07.649029  4683 tablet_bootstrap.cc:492] T 541b1e6cfdca4f609467169f4caf64ef P 420a61707e804ce5b3773a91cc2eb424: No bootstrap required, opened a new log
I20260709 13:12:07.649518  4683 ts_tablet_manager.cc:1403] T 541b1e6cfdca4f609467169f4caf64ef P 420a61707e804ce5b3773a91cc2eb424: Time spent bootstrapping tablet: real 0.250s	user 0.007s	sys 0.010s
I20260709 13:12:07.655246  4683 raft_consensus.cc:359] T 541b1e6cfdca4f609467169f4caf64ef P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:07.656205  4683 raft_consensus.cc:385] T 541b1e6cfdca4f609467169f4caf64ef P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.656582  4683 raft_consensus.cc:740] T 541b1e6cfdca4f609467169f4caf64ef P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.657409  4923 raft_consensus.cc:2749] T 9d526ab043434bf0bcab814f9bbc3234 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:07.657435  4683 consensus_queue.cc:260] T 541b1e6cfdca4f609467169f4caf64ef P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
W20260709 13:12:07.665060  4529 consensus_peers.cc:597] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424 -> Peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Couldn't send request to peer 74758684df5649ccadd1e189eaff32dc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:07.665179  4681 tablet_bootstrap.cc:492] T ff7757f22fe3408f8745bc899f3c2e4e P 74758684df5649ccadd1e189eaff32dc: No bootstrap required, opened a new log
I20260709 13:12:07.668179  4681 ts_tablet_manager.cc:1403] T ff7757f22fe3408f8745bc899f3c2e4e P 74758684df5649ccadd1e189eaff32dc: Time spent bootstrapping tablet: real 0.259s	user 0.012s	sys 0.008s
I20260709 13:12:07.669061  4683 ts_tablet_manager.cc:1434] T 541b1e6cfdca4f609467169f4caf64ef P 420a61707e804ce5b3773a91cc2eb424: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:12:07.670066  4683 tablet_bootstrap.cc:492] T d088694ef66442bdbf75cc7fc1942a83 P 420a61707e804ce5b3773a91cc2eb424: Bootstrap starting.
I20260709 13:12:07.670826  4681 raft_consensus.cc:359] T ff7757f22fe3408f8745bc899f3c2e4e P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:07.673323  4681 raft_consensus.cc:385] T ff7757f22fe3408f8745bc899f3c2e4e P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:12:07.673475  4380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:45987, user_credentials={real_user=slave}} blocked reactor thread for 44267.2us
I20260709 13:12:07.673772  4681 raft_consensus.cc:740] T ff7757f22fe3408f8745bc899f3c2e4e P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.675330  4380 leader_election.cc:304] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 74758684df5649ccadd1e189eaff32dc; no voters: 
I20260709 13:12:07.674983  4681 consensus_queue.cc:260] T ff7757f22fe3408f8745bc899f3c2e4e P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:07.673831  4311 catalog_manager.cc:5697] T f63e5465acbf4283a97304441ba41968 P 420a61707e804ce5b3773a91cc2eb424 reported cstate change: term changed from 0 to 1, leader changed from <none> to 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3). New cstate: current_term: 1 leader_uuid: "420a61707e804ce5b3773a91cc2eb424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:07.679441  4682 tablet_bootstrap.cc:654] T 98342133e28b47d8a388f9321d5fd796 P 06ec58698d5444caaecea433c8419770: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.682595  4939 raft_consensus.cc:2804] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:07.686429  4681 ts_tablet_manager.cc:1434] T ff7757f22fe3408f8745bc899f3c2e4e P 74758684df5649ccadd1e189eaff32dc: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.003s
I20260709 13:12:07.687713  4681 tablet_bootstrap.cc:492] T 1271bae393604d56b9e376c716eb2a9e P 74758684df5649ccadd1e189eaff32dc: Bootstrap starting.
I20260709 13:12:07.680701  4743 consensus_queue.cc:1048] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:12:07.694875  4488 raft_consensus.cc:2468] T a16334f2dff74513ba7ca22ca8fb5afd P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 1.
I20260709 13:12:07.706936  4980 consensus_queue.cc:1048] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:12:07.752673  4939 raft_consensus.cc:697] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770 [term 1 LEADER]: Becoming Leader. State: Replica: 06ec58698d5444caaecea433c8419770, State: Running, Role: LEADER
I20260709 13:12:07.765358  4685 tablet_bootstrap.cc:654] T 1271bae393604d56b9e376c716eb2a9e P aa0ff974118b465eaa785b8a86057e87: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:07.761638  4358 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:07.785647  4683 tablet_bootstrap.cc:654] T d088694ef66442bdbf75cc7fc1942a83 P 420a61707e804ce5b3773a91cc2eb424: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.785387  4939 consensus_queue.cc:237] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:07.805790  4982 raft_consensus.cc:493] T 60d704077649426ab65d89dd9ff778d0 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.806525  4982 raft_consensus.cc:515] T 60d704077649426ab65d89dd9ff778d0 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:07.818892  4982 leader_election.cc:290] T 60d704077649426ab65d89dd9ff778d0 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:07.820257  4681 tablet_bootstrap.cc:654] T 1271bae393604d56b9e376c716eb2a9e P 74758684df5649ccadd1e189eaff32dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.826416  4562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d704077649426ab65d89dd9ff778d0" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:07.830183  4486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d704077649426ab65d89dd9ff778d0" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
W20260709 13:12:07.830755  4379 leader_election.cc:343] T 60d704077649426ab65d89dd9ff778d0 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.826464  4308 catalog_manager.cc:5697] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06ec58698d5444caaecea433c8419770 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "06ec58698d5444caaecea433c8419770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:07.846954  4380 leader_election.cc:343] T 60d704077649426ab65d89dd9ff778d0 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.847404  4380 leader_election.cc:304] T 60d704077649426ab65d89dd9ff778d0 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06ec58698d5444caaecea433c8419770; no voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:07.848917  4915 consensus_queue.cc:1048] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:07.864878  4685 tablet_bootstrap.cc:492] T 1271bae393604d56b9e376c716eb2a9e P aa0ff974118b465eaa785b8a86057e87: No bootstrap required, opened a new log
I20260709 13:12:07.867779  4685 ts_tablet_manager.cc:1403] T 1271bae393604d56b9e376c716eb2a9e P aa0ff974118b465eaa785b8a86057e87: Time spent bootstrapping tablet: real 0.241s	user 0.017s	sys 0.004s
I20260709 13:12:07.870463  4685 raft_consensus.cc:359] T 1271bae393604d56b9e376c716eb2a9e P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:07.865749  4683 tablet_bootstrap.cc:492] T d088694ef66442bdbf75cc7fc1942a83 P 420a61707e804ce5b3773a91cc2eb424: No bootstrap required, opened a new log
I20260709 13:12:07.871418  4683 ts_tablet_manager.cc:1403] T d088694ef66442bdbf75cc7fc1942a83 P 420a61707e804ce5b3773a91cc2eb424: Time spent bootstrapping tablet: real 0.202s	user 0.012s	sys 0.009s
I20260709 13:12:07.873610  4682 tablet_bootstrap.cc:492] T 98342133e28b47d8a388f9321d5fd796 P 06ec58698d5444caaecea433c8419770: No bootstrap required, opened a new log
I20260709 13:12:07.874117  4682 ts_tablet_manager.cc:1403] T 98342133e28b47d8a388f9321d5fd796 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.259s	user 0.025s	sys 0.016s
I20260709 13:12:07.852711  4895 raft_consensus.cc:2749] T 60d704077649426ab65d89dd9ff778d0 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:07.874002  4683 raft_consensus.cc:359] T d088694ef66442bdbf75cc7fc1942a83 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:07.875355  4683 raft_consensus.cc:385] T d088694ef66442bdbf75cc7fc1942a83 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.875996  4683 raft_consensus.cc:740] T d088694ef66442bdbf75cc7fc1942a83 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.875687  4685 raft_consensus.cc:385] T 1271bae393604d56b9e376c716eb2a9e P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.876760  4685 raft_consensus.cc:740] T 1271bae393604d56b9e376c716eb2a9e P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.878451  4685 consensus_queue.cc:260] T 1271bae393604d56b9e376c716eb2a9e P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:07.877413  4683 consensus_queue.cc:260] T d088694ef66442bdbf75cc7fc1942a83 P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:07.879966  4774 raft_consensus.cc:493] T 541b1e6cfdca4f609467169f4caf64ef P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.876669  4682 raft_consensus.cc:359] T 98342133e28b47d8a388f9321d5fd796 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:07.880887  4682 raft_consensus.cc:385] T 98342133e28b47d8a388f9321d5fd796 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.880637  4774 raft_consensus.cc:515] T 541b1e6cfdca4f609467169f4caf64ef P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:07.881181  4682 raft_consensus.cc:740] T 98342133e28b47d8a388f9321d5fd796 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.881968  4682 consensus_queue.cc:260] T 98342133e28b47d8a388f9321d5fd796 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:07.883424  4682 ts_tablet_manager.cc:1434] T 98342133e28b47d8a388f9321d5fd796 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:12:07.883880  4487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541b1e6cfdca4f609467169f4caf64ef" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:07.884343  4682 tablet_bootstrap.cc:492] T b731fe02a6f4441e816628760bfdfb54 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:07.886435  4634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541b1e6cfdca4f609467169f4caf64ef" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
W20260709 13:12:07.887883  4529 leader_election.cc:343] T 541b1e6cfdca4f609467169f4caf64ef P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.889209  4774 leader_election.cc:290] T 541b1e6cfdca4f609467169f4caf64ef P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:07.890704  4683 ts_tablet_manager.cc:1434] T d088694ef66442bdbf75cc7fc1942a83 P 420a61707e804ce5b3773a91cc2eb424: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.000s
I20260709 13:12:07.891408  4683 tablet_bootstrap.cc:492] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424: Bootstrap starting.
I20260709 13:12:07.891765  4681 tablet_bootstrap.cc:492] T 1271bae393604d56b9e376c716eb2a9e P 74758684df5649ccadd1e189eaff32dc: No bootstrap required, opened a new log
I20260709 13:12:07.892254  4681 ts_tablet_manager.cc:1403] T 1271bae393604d56b9e376c716eb2a9e P 74758684df5649ccadd1e189eaff32dc: Time spent bootstrapping tablet: real 0.205s	user 0.011s	sys 0.001s
I20260709 13:12:07.893597  4682 tablet_bootstrap.cc:654] T b731fe02a6f4441e816628760bfdfb54 P 06ec58698d5444caaecea433c8419770: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.895274  4683 tablet_bootstrap.cc:654] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.894953  4681 raft_consensus.cc:359] T 1271bae393604d56b9e376c716eb2a9e P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:07.879933  4685 ts_tablet_manager.cc:1434] T 1271bae393604d56b9e376c716eb2a9e P aa0ff974118b465eaa785b8a86057e87: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.002s
I20260709 13:12:07.895680  4681 raft_consensus.cc:385] T 1271bae393604d56b9e376c716eb2a9e P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.896661  4681 raft_consensus.cc:740] T 1271bae393604d56b9e376c716eb2a9e P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.896934  4685 tablet_bootstrap.cc:492] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87: Bootstrap starting.
I20260709 13:12:07.904901  4685 tablet_bootstrap.cc:654] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.898945  4681 consensus_queue.cc:260] T 1271bae393604d56b9e376c716eb2a9e P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
W20260709 13:12:07.906214  4529 leader_election.cc:343] T 541b1e6cfdca4f609467169f4caf64ef P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.906594  4529 leader_election.cc:304] T 541b1e6cfdca4f609467169f4caf64ef P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424; no voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:07.911237  4774 raft_consensus.cc:2749] T 541b1e6cfdca4f609467169f4caf64ef P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:07.913204  4681 ts_tablet_manager.cc:1434] T 1271bae393604d56b9e376c716eb2a9e P 74758684df5649ccadd1e189eaff32dc: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 13:12:07.914175  4681 tablet_bootstrap.cc:492] T 49047cb7a56246288b9044f8ebec130f P 74758684df5649ccadd1e189eaff32dc: Bootstrap starting.
I20260709 13:12:07.924078  4681 tablet_bootstrap.cc:654] T 49047cb7a56246288b9044f8ebec130f P 74758684df5649ccadd1e189eaff32dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.925364  4682 tablet_bootstrap.cc:492] T b731fe02a6f4441e816628760bfdfb54 P 06ec58698d5444caaecea433c8419770: No bootstrap required, opened a new log
I20260709 13:12:07.925861  4682 ts_tablet_manager.cc:1403] T b731fe02a6f4441e816628760bfdfb54 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.042s	user 0.018s	sys 0.000s
I20260709 13:12:07.932951  4682 raft_consensus.cc:359] T b731fe02a6f4441e816628760bfdfb54 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:07.933734  4310 catalog_manager.cc:5697] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06ec58698d5444caaecea433c8419770 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "06ec58698d5444caaecea433c8419770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:07.937716  4682 raft_consensus.cc:385] T b731fe02a6f4441e816628760bfdfb54 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.938058  4682 raft_consensus.cc:740] T b731fe02a6f4441e816628760bfdfb54 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.942142  4682 consensus_queue.cc:260] T b731fe02a6f4441e816628760bfdfb54 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:07.944211  4682 ts_tablet_manager.cc:1434] T b731fe02a6f4441e816628760bfdfb54 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.003s
I20260709 13:12:07.946260  4682 tablet_bootstrap.cc:492] T d088694ef66442bdbf75cc7fc1942a83 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:07.956588  4685 tablet_bootstrap.cc:492] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87: No bootstrap required, opened a new log
I20260709 13:12:07.958832  4682 tablet_bootstrap.cc:654] T d088694ef66442bdbf75cc7fc1942a83 P 06ec58698d5444caaecea433c8419770: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.962515  4685 ts_tablet_manager.cc:1403] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87: Time spent bootstrapping tablet: real 0.066s	user 0.011s	sys 0.008s
I20260709 13:12:07.959856  4988 raft_consensus.cc:493] T b731fe02a6f4441e816628760bfdfb54 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.965698  4988 raft_consensus.cc:515] T b731fe02a6f4441e816628760bfdfb54 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:07.969650  4562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b731fe02a6f4441e816628760bfdfb54" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:07.970494  4562 raft_consensus.cc:2468] T b731fe02a6f4441e816628760bfdfb54 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 0.
I20260709 13:12:07.971684  4379 leader_election.cc:304] T b731fe02a6f4441e816628760bfdfb54 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: 
I20260709 13:12:07.973040  4682 tablet_bootstrap.cc:492] T d088694ef66442bdbf75cc7fc1942a83 P 06ec58698d5444caaecea433c8419770: No bootstrap required, opened a new log
I20260709 13:12:07.974370  4637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b731fe02a6f4441e816628760bfdfb54" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:07.975023  4682 ts_tablet_manager.cc:1403] T d088694ef66442bdbf75cc7fc1942a83 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.003s
W20260709 13:12:07.976174  4380 leader_election.cc:343] T b731fe02a6f4441e816628760bfdfb54 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.977774  4988 leader_election.cc:290] T b731fe02a6f4441e816628760bfdfb54 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:07.977041  4760 raft_consensus.cc:2804] T b731fe02a6f4441e816628760bfdfb54 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:07.978945  4760 raft_consensus.cc:493] T b731fe02a6f4441e816628760bfdfb54 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:07.979498  4760 raft_consensus.cc:3060] T b731fe02a6f4441e816628760bfdfb54 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.985124  4685 raft_consensus.cc:359] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:07.986311  4685 raft_consensus.cc:385] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.986733  4685 raft_consensus.cc:740] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.989781  4682 raft_consensus.cc:359] T d088694ef66442bdbf75cc7fc1942a83 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:07.997727  4682 raft_consensus.cc:385] T d088694ef66442bdbf75cc7fc1942a83 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.998204  4682 raft_consensus.cc:740] T d088694ef66442bdbf75cc7fc1942a83 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.998095  4915 consensus_queue.cc:1048] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:07.999655  4682 consensus_queue.cc:260] T d088694ef66442bdbf75cc7fc1942a83 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:08.003284  4682 ts_tablet_manager.cc:1434] T d088694ef66442bdbf75cc7fc1942a83 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.004s
I20260709 13:12:07.996701  4760 raft_consensus.cc:515] T b731fe02a6f4441e816628760bfdfb54 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:07.987665  4685 consensus_queue.cc:260] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
W20260709 13:12:08.004678  4455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:42711, user_credentials={real_user=slave}} blocked reactor thread for 91597.3us
I20260709 13:12:08.007068  4685 ts_tablet_manager.cc:1434] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 13:12:08.008381  4685 tablet_bootstrap.cc:492] T 49047cb7a56246288b9044f8ebec130f P aa0ff974118b465eaa785b8a86057e87: Bootstrap starting.
I20260709 13:12:08.019030  4915 raft_consensus.cc:493] T 1271bae393604d56b9e376c716eb2a9e P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.019731  4915 raft_consensus.cc:515] T 1271bae393604d56b9e376c716eb2a9e P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:08.023180  4562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b731fe02a6f4441e816628760bfdfb54" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:08.023972  4562 raft_consensus.cc:3060] T b731fe02a6f4441e816628760bfdfb54 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.027984  4561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1271bae393604d56b9e376c716eb2a9e" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:08.028947  4561 raft_consensus.cc:2468] T 1271bae393604d56b9e376c716eb2a9e P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 0.
I20260709 13:12:08.030786  4602 leader_election.cc:304] T 1271bae393604d56b9e376c716eb2a9e P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc; no voters: 
I20260709 13:12:08.033638  4754 raft_consensus.cc:2804] T 1271bae393604d56b9e376c716eb2a9e P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:08.034186  4754 raft_consensus.cc:493] T 1271bae393604d56b9e376c716eb2a9e P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.004668  4682 tablet_bootstrap.cc:492] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:08.034698  4754 raft_consensus.cc:3060] T 1271bae393604d56b9e376c716eb2a9e P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.036990  4562 raft_consensus.cc:2468] T b731fe02a6f4441e816628760bfdfb54 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 1.
I20260709 13:12:08.044886  4379 leader_election.cc:304] T b731fe02a6f4441e816628760bfdfb54 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: 
I20260709 13:12:08.046099  4988 raft_consensus.cc:2804] T b731fe02a6f4441e816628760bfdfb54 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:08.046743  4988 raft_consensus.cc:697] T b731fe02a6f4441e816628760bfdfb54 P 06ec58698d5444caaecea433c8419770 [term 1 LEADER]: Becoming Leader. State: Replica: 06ec58698d5444caaecea433c8419770, State: Running, Role: LEADER
I20260709 13:12:08.047780  4988 consensus_queue.cc:237] T b731fe02a6f4441e816628760bfdfb54 P 06ec58698d5444caaecea433c8419770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:08.057070  4758 raft_consensus.cc:493] T 3092a6c40d0d4610968fe09d4c7d16c0 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.057717  4758 raft_consensus.cc:515] T 3092a6c40d0d4610968fe09d4c7d16c0 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:08.048220  4915 leader_election.cc:290] T 1271bae393604d56b9e376c716eb2a9e P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:08.075577  4760 leader_election.cc:290] T b731fe02a6f4441e816628760bfdfb54 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Requested vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:08.078574  4634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b731fe02a6f4441e816628760bfdfb54" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:08.043316  4685 tablet_bootstrap.cc:654] T 49047cb7a56246288b9044f8ebec130f P aa0ff974118b465eaa785b8a86057e87: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:08.080559  4380 leader_election.cc:343] T b731fe02a6f4441e816628760bfdfb54 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:08.086069  4561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3092a6c40d0d4610968fe09d4c7d16c0" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:08.087071  4561 raft_consensus.cc:2468] T 3092a6c40d0d4610968fe09d4c7d16c0 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 1.
I20260709 13:12:08.088967  4602 leader_election.cc:304] T 3092a6c40d0d4610968fe09d4c7d16c0 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc; no voters: 
I20260709 13:12:08.090198  4915 raft_consensus.cc:2804] T 3092a6c40d0d4610968fe09d4c7d16c0 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:08.090766  4915 raft_consensus.cc:493] T 3092a6c40d0d4610968fe09d4c7d16c0 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.091269  4915 raft_consensus.cc:3060] T 3092a6c40d0d4610968fe09d4c7d16c0 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:08.093077  4682 tablet_bootstrap.cc:654] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 06ec58698d5444caaecea433c8419770: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.082175  4758 leader_election.cc:290] T 3092a6c40d0d4610968fe09d4c7d16c0 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:08.109335  4685 tablet_bootstrap.cc:492] T 49047cb7a56246288b9044f8ebec130f P aa0ff974118b465eaa785b8a86057e87: No bootstrap required, opened a new log
I20260709 13:12:08.109962  4685 ts_tablet_manager.cc:1403] T 49047cb7a56246288b9044f8ebec130f P aa0ff974118b465eaa785b8a86057e87: Time spent bootstrapping tablet: real 0.102s	user 0.011s	sys 0.003s
I20260709 13:12:08.113525  4685 raft_consensus.cc:359] T 49047cb7a56246288b9044f8ebec130f P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:08.114383  4685 raft_consensus.cc:385] T 49047cb7a56246288b9044f8ebec130f P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.114725  4685 raft_consensus.cc:740] T 49047cb7a56246288b9044f8ebec130f P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.115710  4760 raft_consensus.cc:493] T d088694ef66442bdbf75cc7fc1942a83 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.116353  4760 raft_consensus.cc:515] T d088694ef66442bdbf75cc7fc1942a83 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:08.126585  4760 leader_election.cc:290] T d088694ef66442bdbf75cc7fc1942a83 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:08.127485  4562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d088694ef66442bdbf75cc7fc1942a83" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:08.128381  4562 raft_consensus.cc:2468] T d088694ef66442bdbf75cc7fc1942a83 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 0.
I20260709 13:12:08.130110  4379 leader_election.cc:304] T d088694ef66442bdbf75cc7fc1942a83 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: 
I20260709 13:12:08.130348  4691 raft_consensus.cc:493] T ff7757f22fe3408f8745bc899f3c2e4e P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.131033  4691 raft_consensus.cc:515] T ff7757f22fe3408f8745bc899f3c2e4e P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:08.131968  4891 raft_consensus.cc:2804] T d088694ef66442bdbf75cc7fc1942a83 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:08.132347  4891 raft_consensus.cc:493] T d088694ef66442bdbf75cc7fc1942a83 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.132676  4891 raft_consensus.cc:3060] T d088694ef66442bdbf75cc7fc1942a83 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.133069  4691 leader_election.cc:290] T ff7757f22fe3408f8745bc899f3c2e4e P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:08.133970  4487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1271bae393604d56b9e376c716eb2a9e" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:08.134652  4487 raft_consensus.cc:2468] T 1271bae393604d56b9e376c716eb2a9e P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 0.
I20260709 13:12:08.135990  4634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d088694ef66442bdbf75cc7fc1942a83" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
W20260709 13:12:08.137526  4529 consensus_peers.cc:597] T f63e5465acbf4283a97304441ba41968 P 420a61707e804ce5b3773a91cc2eb424 -> Peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Couldn't send request to peer 74758684df5649ccadd1e189eaff32dc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:08.138291  4562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7757f22fe3408f8745bc899f3c2e4e" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:08.146798  4685 consensus_queue.cc:260] T 49047cb7a56246288b9044f8ebec130f P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:08.151371  4891 raft_consensus.cc:515] T d088694ef66442bdbf75cc7fc1942a83 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:08.154817  4487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3092a6c40d0d4610968fe09d4c7d16c0" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:08.155346  4891 leader_election.cc:290] T d088694ef66442bdbf75cc7fc1942a83 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Requested vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:08.155534  4487 raft_consensus.cc:2468] T 3092a6c40d0d4610968fe09d4c7d16c0 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 1.
I20260709 13:12:08.159900  4562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d088694ef66442bdbf75cc7fc1942a83" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:08.161063  4681 tablet_bootstrap.cc:492] T 49047cb7a56246288b9044f8ebec130f P 74758684df5649ccadd1e189eaff32dc: No bootstrap required, opened a new log
I20260709 13:12:08.161566  4681 ts_tablet_manager.cc:1403] T 49047cb7a56246288b9044f8ebec130f P 74758684df5649ccadd1e189eaff32dc: Time spent bootstrapping tablet: real 0.248s	user 0.061s	sys 0.106s
I20260709 13:12:08.165052  4683 tablet_bootstrap.cc:492] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424: No bootstrap required, opened a new log
I20260709 13:12:08.165517  4683 ts_tablet_manager.cc:1403] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424: Time spent bootstrapping tablet: real 0.274s	user 0.083s	sys 0.113s
I20260709 13:12:08.160483  4562 raft_consensus.cc:3060] T d088694ef66442bdbf75cc7fc1942a83 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.168207  4683 raft_consensus.cc:359] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:08.168877  4683 raft_consensus.cc:385] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.169173  4683 raft_consensus.cc:740] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.168457  4310 catalog_manager.cc:5697] T b731fe02a6f4441e816628760bfdfb54 P 06ec58698d5444caaecea433c8419770 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06ec58698d5444caaecea433c8419770 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "06ec58698d5444caaecea433c8419770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:08.169813  4634 raft_consensus.cc:3060] T ff7757f22fe3408f8745bc899f3c2e4e P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.170953  4685 ts_tablet_manager.cc:1434] T 49047cb7a56246288b9044f8ebec130f P aa0ff974118b465eaa785b8a86057e87: Time spent starting tablet: real 0.061s	user 0.008s	sys 0.000s
I20260709 13:12:08.169836  4683 consensus_queue.cc:260] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:08.173583  4683 ts_tablet_manager.cc:1434] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:08.176818  4685 tablet_bootstrap.cc:492] T 98342133e28b47d8a388f9321d5fd796 P aa0ff974118b465eaa785b8a86057e87: Bootstrap starting.
I20260709 13:12:08.046978  4754 raft_consensus.cc:515] T 1271bae393604d56b9e376c716eb2a9e P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:08.180370  4683 tablet_bootstrap.cc:492] T 812a1b53a40e469c89b5f2aba8c59780 P 420a61707e804ce5b3773a91cc2eb424: Bootstrap starting.
I20260709 13:12:08.189023  4412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7757f22fe3408f8745bc899f3c2e4e" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:08.198963  4685 tablet_bootstrap.cc:654] T 98342133e28b47d8a388f9321d5fd796 P aa0ff974118b465eaa785b8a86057e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.187531  4681 raft_consensus.cc:359] T 49047cb7a56246288b9044f8ebec130f P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:08.199885  4681 raft_consensus.cc:385] T 49047cb7a56246288b9044f8ebec130f P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.200235  4681 raft_consensus.cc:740] T 49047cb7a56246288b9044f8ebec130f P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.202342  4681 consensus_queue.cc:260] T 49047cb7a56246288b9044f8ebec130f P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:08.209517  4923 raft_consensus.cc:493] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.210034  4923 raft_consensus.cc:515] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:08.203838  4915 raft_consensus.cc:515] T 3092a6c40d0d4610968fe09d4c7d16c0 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:08.214709  4915 leader_election.cc:290] T 3092a6c40d0d4610968fe09d4c7d16c0 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 election: Requested vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:08.215871  4923 leader_election.cc:290] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:08.217706  4485 raft_consensus.cc:3060] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.219684  4754 leader_election.cc:290] T 1271bae393604d56b9e376c716eb2a9e P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 election: Requested vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:08.212805  4743 consensus_queue.cc:1048] T f63e5465acbf4283a97304441ba41968 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:08.232424  4849 raft_consensus.cc:493] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.247407  4681 ts_tablet_manager.cc:1434] T 49047cb7a56246288b9044f8ebec130f P 74758684df5649ccadd1e189eaff32dc: Time spent starting tablet: real 0.086s	user 0.015s	sys 0.001s
W20260709 13:12:08.231995  4602 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:33159, user_credentials={real_user=slave}} blocked reactor thread for 94720.7us
I20260709 13:12:08.248543  4681 tablet_bootstrap.cc:492] T f63e5465acbf4283a97304441ba41968 P 74758684df5649ccadd1e189eaff32dc: Bootstrap starting.
I20260709 13:12:08.253520  4562 raft_consensus.cc:2468] T d088694ef66442bdbf75cc7fc1942a83 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 1.
I20260709 13:12:08.260265  4635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d088694ef66442bdbf75cc7fc1942a83" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:08.258661  4681 tablet_bootstrap.cc:654] T f63e5465acbf4283a97304441ba41968 P 74758684df5649ccadd1e189eaff32dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.267628  4379 leader_election.cc:304] T d088694ef66442bdbf75cc7fc1942a83 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: 
I20260709 13:12:08.268883  4891 raft_consensus.cc:2804] T d088694ef66442bdbf75cc7fc1942a83 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:08.269487  4891 raft_consensus.cc:697] T d088694ef66442bdbf75cc7fc1942a83 P 06ec58698d5444caaecea433c8419770 [term 1 LEADER]: Becoming Leader. State: Replica: 06ec58698d5444caaecea433c8419770, State: Running, Role: LEADER
I20260709 13:12:08.270437  4891 consensus_queue.cc:237] T d088694ef66442bdbf75cc7fc1942a83 P 06ec58698d5444caaecea433c8419770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:08.274736  4413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0608a8abe6c4bd083d751020218957e" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:08.249608  4849 raft_consensus.cc:515] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:08.278393  4849 leader_election.cc:290] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:08.279215  4683 tablet_bootstrap.cc:654] T 812a1b53a40e469c89b5f2aba8c59780 P 420a61707e804ce5b3773a91cc2eb424: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:08.280838  4603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:36439, user_credentials={real_user=slave}} blocked reactor thread for 75541.6us
I20260709 13:12:08.282094  4562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0608a8abe6c4bd083d751020218957e" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:08.283175  4562 raft_consensus.cc:2393] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aa0ff974118b465eaa785b8a86057e87 in current term 1: Already voted for candidate 06ec58698d5444caaecea433c8419770 in this term.
W20260709 13:12:08.284700  4380 leader_election.cc:343] T d088694ef66442bdbf75cc7fc1942a83 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:08.286101  4380 leader_election.cc:343] T d088694ef66442bdbf75cc7fc1942a83 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:08.291121  4603 leader_election.cc:304] T ff7757f22fe3408f8745bc899f3c2e4e P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc; no voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424
I20260709 13:12:08.292665  4682 tablet_bootstrap.cc:492] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 06ec58698d5444caaecea433c8419770: No bootstrap required, opened a new log
I20260709 13:12:08.293129  4682 ts_tablet_manager.cc:1403] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.289s	user 0.028s	sys 0.015s
W20260709 13:12:08.297148  4529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:45987, user_credentials={real_user=slave}} blocked reactor thread for 88482.4us
I20260709 13:12:08.292179  4939 consensus_queue.cc:1048] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:12:08.292484  4982 consensus_queue.cc:1048] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:12:08.297904  4998 raft_consensus.cc:493] T 49047cb7a56246288b9044f8ebec130f P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.298368  4998 raft_consensus.cc:515] T 49047cb7a56246288b9044f8ebec130f P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:08.299949  4454 leader_election.cc:304] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa0ff974118b465eaa785b8a86057e87; no voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424
I20260709 13:12:08.300336  4998 leader_election.cc:290] T 49047cb7a56246288b9044f8ebec130f P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:08.300833  4998 raft_consensus.cc:2749] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:08.303524  4637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49047cb7a56246288b9044f8ebec130f" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:08.304122  4637 raft_consensus.cc:2468] T 49047cb7a56246288b9044f8ebec130f P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 0.
I20260709 13:12:08.308396  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3092a6c40d0d4610968fe09d4c7d16c0" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:08.309006  4563 raft_consensus.cc:3060] T 3092a6c40d0d4610968fe09d4c7d16c0 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:08.310726  4561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1271bae393604d56b9e376c716eb2a9e" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:08.314383  4561 raft_consensus.cc:3060] T 1271bae393604d56b9e376c716eb2a9e P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.317070  4760 consensus_queue.cc:1048] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:08.318282  4760 consensus_queue.cc:1048] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:08.317795  4455 leader_election.cc:304] T 49047cb7a56246288b9044f8ebec130f P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:08.316653  4413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49047cb7a56246288b9044f8ebec130f" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:08.320643  4413 raft_consensus.cc:2468] T 49047cb7a56246288b9044f8ebec130f P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 0.
I20260709 13:12:08.320730  4487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d704077649426ab65d89dd9ff778d0" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:08.322803  4930 raft_consensus.cc:2804] T 49047cb7a56246288b9044f8ebec130f P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:08.323212  4930 raft_consensus.cc:493] T 49047cb7a56246288b9044f8ebec130f P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.323527  4930 raft_consensus.cc:3060] T 49047cb7a56246288b9044f8ebec130f P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:08.328266  4529 leader_election.cc:343] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:08.347471  4489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1271bae393604d56b9e376c716eb2a9e" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:08.348367  4489 raft_consensus.cc:3060] T 1271bae393604d56b9e376c716eb2a9e P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.326825  4561 raft_consensus.cc:2468] T 1271bae393604d56b9e376c716eb2a9e P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 1.
I20260709 13:12:08.359612  4488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3092a6c40d0d4610968fe09d4c7d16c0" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:08.360246  4488 raft_consensus.cc:3060] T 3092a6c40d0d4610968fe09d4c7d16c0 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:08.337886  4563 raft_consensus.cc:2468] T 3092a6c40d0d4610968fe09d4c7d16c0 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 2.
I20260709 13:12:08.356477  4980 raft_consensus.cc:493] T 98342133e28b47d8a388f9321d5fd796 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.381168  4412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d704077649426ab65d89dd9ff778d0" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:08.381865  4412 raft_consensus.cc:2468] T 60d704077649426ab65d89dd9ff778d0 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 0.
I20260709 13:12:08.389387  4758 raft_consensus.cc:2749] T ff7757f22fe3408f8745bc899f3c2e4e P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:08.386454  4980 raft_consensus.cc:515] T 98342133e28b47d8a388f9321d5fd796 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:08.397354  4980 leader_election.cc:290] T 98342133e28b47d8a388f9321d5fd796 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:08.394315  4930 raft_consensus.cc:515] T 49047cb7a56246288b9044f8ebec130f P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:08.392968  4685 tablet_bootstrap.cc:492] T 98342133e28b47d8a388f9321d5fd796 P aa0ff974118b465eaa785b8a86057e87: No bootstrap required, opened a new log
I20260709 13:12:08.398630  4685 ts_tablet_manager.cc:1403] T 98342133e28b47d8a388f9321d5fd796 P aa0ff974118b465eaa785b8a86057e87: Time spent bootstrapping tablet: real 0.227s	user 0.026s	sys 0.036s
I20260709 13:12:08.402653  4482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98342133e28b47d8a388f9321d5fd796" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:08.403144  4682 raft_consensus.cc:359] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
W20260709 13:12:08.403754  4380 leader_election.cc:343] T 98342133e28b47d8a388f9321d5fd796 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:08.403955  4682 raft_consensus.cc:385] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.404237  4682 raft_consensus.cc:740] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.407006  4685 raft_consensus.cc:359] T 98342133e28b47d8a388f9321d5fd796 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:08.408910  4682 consensus_queue.cc:260] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:08.407668  4685 raft_consensus.cc:385] T 98342133e28b47d8a388f9321d5fd796 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.411021  4685 raft_consensus.cc:740] T 98342133e28b47d8a388f9321d5fd796 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.411120  4682 ts_tablet_manager.cc:1434] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.118s	user 0.004s	sys 0.002s
I20260709 13:12:08.413080  4681 tablet_bootstrap.cc:492] T f63e5465acbf4283a97304441ba41968 P 74758684df5649ccadd1e189eaff32dc: No bootstrap required, opened a new log
I20260709 13:12:08.413561  4681 ts_tablet_manager.cc:1403] T f63e5465acbf4283a97304441ba41968 P 74758684df5649ccadd1e189eaff32dc: Time spent bootstrapping tablet: real 0.165s	user 0.009s	sys 0.011s
I20260709 13:12:08.416669  4602 leader_election.cc:304] T 1271bae393604d56b9e376c716eb2a9e P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc; no voters: 
I20260709 13:12:08.416195  4681 raft_consensus.cc:359] T f63e5465acbf4283a97304441ba41968 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:08.417649  4489 raft_consensus.cc:2468] T 1271bae393604d56b9e376c716eb2a9e P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 1.
I20260709 13:12:08.416739  4488 raft_consensus.cc:2468] T 3092a6c40d0d4610968fe09d4c7d16c0 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 2.
I20260709 13:12:08.418358  5006 raft_consensus.cc:2804] T 1271bae393604d56b9e376c716eb2a9e P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:08.418897  5006 raft_consensus.cc:697] T 1271bae393604d56b9e376c716eb2a9e P 74758684df5649ccadd1e189eaff32dc [term 1 LEADER]: Becoming Leader. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Running, Role: LEADER
I20260709 13:12:08.420500  5006 consensus_queue.cc:237] T 1271bae393604d56b9e376c716eb2a9e P 74758684df5649ccadd1e189eaff32dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:08.421149  4682 tablet_bootstrap.cc:492] T e50b6f5a42a24867ab5f90ad6d97401e P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:08.425560  4603 leader_election.cc:304] T 3092a6c40d0d4610968fe09d4c7d16c0 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:08.426668  4758 raft_consensus.cc:2804] T 3092a6c40d0d4610968fe09d4c7d16c0 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:08.426913  4635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49047cb7a56246288b9044f8ebec130f" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:08.427402  4758 raft_consensus.cc:697] T 3092a6c40d0d4610968fe09d4c7d16c0 P 74758684df5649ccadd1e189eaff32dc [term 2 LEADER]: Becoming Leader. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Running, Role: LEADER
I20260709 13:12:08.427532  4635 raft_consensus.cc:3060] T 49047cb7a56246288b9044f8ebec130f P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.428299  4758 consensus_queue.cc:237] T 3092a6c40d0d4610968fe09d4c7d16c0 P 74758684df5649ccadd1e189eaff32dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:08.429422  4682 tablet_bootstrap.cc:654] T e50b6f5a42a24867ab5f90ad6d97401e P 06ec58698d5444caaecea433c8419770: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.417821  4681 raft_consensus.cc:385] T f63e5465acbf4283a97304441ba41968 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.429883  4681 raft_consensus.cc:740] T f63e5465acbf4283a97304441ba41968 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.430564  4681 consensus_queue.cc:260] T f63e5465acbf4283a97304441ba41968 P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:08.432324  4681 ts_tablet_manager.cc:1434] T f63e5465acbf4283a97304441ba41968 P 74758684df5649ccadd1e189eaff32dc: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:12:08.410312  4308 catalog_manager.cc:5697] T d088694ef66442bdbf75cc7fc1942a83 P 06ec58698d5444caaecea433c8419770 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06ec58698d5444caaecea433c8419770 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "06ec58698d5444caaecea433c8419770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:08.445469  4683 tablet_bootstrap.cc:492] T 812a1b53a40e469c89b5f2aba8c59780 P 420a61707e804ce5b3773a91cc2eb424: No bootstrap required, opened a new log
I20260709 13:12:08.446071  4683 ts_tablet_manager.cc:1403] T 812a1b53a40e469c89b5f2aba8c59780 P 420a61707e804ce5b3773a91cc2eb424: Time spent bootstrapping tablet: real 0.266s	user 0.013s	sys 0.000s
I20260709 13:12:08.452132  4683 raft_consensus.cc:359] T 812a1b53a40e469c89b5f2aba8c59780 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:08.453049  4683 raft_consensus.cc:385] T 812a1b53a40e469c89b5f2aba8c59780 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.453384  4683 raft_consensus.cc:740] T 812a1b53a40e469c89b5f2aba8c59780 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.433198  4681 tablet_bootstrap.cc:492] T b731fe02a6f4441e816628760bfdfb54 P 74758684df5649ccadd1e189eaff32dc: Bootstrap starting.
I20260709 13:12:08.434089  4930 leader_election.cc:290] T 49047cb7a56246288b9044f8ebec130f P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 election: Requested vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:08.433990  4637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98342133e28b47d8a388f9321d5fd796" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:08.435470  4412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49047cb7a56246288b9044f8ebec130f" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770"
I20260709 13:12:08.436147  4685 consensus_queue.cc:260] T 98342133e28b47d8a388f9321d5fd796 P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
W20260709 13:12:08.464989  4529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:36439, user_credentials={real_user=slave}} blocked reactor thread for 93070.4us
I20260709 13:12:08.466210  4529 leader_election.cc:304] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:08.467540  4683 consensus_queue.cc:260] T 812a1b53a40e469c89b5f2aba8c59780 P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:08.464103  4635 raft_consensus.cc:2468] T 49047cb7a56246288b9044f8ebec130f P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 1.
I20260709 13:12:08.471551  4412 raft_consensus.cc:3060] T 49047cb7a56246288b9044f8ebec130f P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.484740  4685 ts_tablet_manager.cc:1434] T 98342133e28b47d8a388f9321d5fd796 P aa0ff974118b465eaa785b8a86057e87: Time spent starting tablet: real 0.086s	user 0.005s	sys 0.003s
I20260709 13:12:08.486119  4685 tablet_bootstrap.cc:492] T be5e478344f14439b78f1a9bf58f4451 P aa0ff974118b465eaa785b8a86057e87: Bootstrap starting.
I20260709 13:12:08.475972  4774 raft_consensus.cc:2804] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:08.477921  4982 raft_consensus.cc:493] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.497417  4682 tablet_bootstrap.cc:492] T e50b6f5a42a24867ab5f90ad6d97401e P 06ec58698d5444caaecea433c8419770: No bootstrap required, opened a new log
I20260709 13:12:08.489739  4774 raft_consensus.cc:493] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.497963  4682 ts_tablet_manager.cc:1403] T e50b6f5a42a24867ab5f90ad6d97401e P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.077s	user 0.020s	sys 0.002s
I20260709 13:12:08.498191  4774 raft_consensus.cc:3060] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.510710  4923 raft_consensus.cc:493] T 98342133e28b47d8a388f9321d5fd796 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.511257  4923 raft_consensus.cc:515] T 98342133e28b47d8a388f9321d5fd796 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:08.505858  4982 raft_consensus.cc:515] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:08.513259  4923 leader_election.cc:290] T 98342133e28b47d8a388f9321d5fd796 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:08.513963  4982 leader_election.cc:290] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
W20260709 13:12:08.519510  4380 leader_election.cc:343] T 98342133e28b47d8a388f9321d5fd796 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:08.520293  4380 leader_election.cc:304] T 98342133e28b47d8a388f9321d5fd796 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06ec58698d5444caaecea433c8419770; no voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:08.522389  4982 raft_consensus.cc:2749] T 98342133e28b47d8a388f9321d5fd796 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:08.527594  4488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7e5d871d1c44a58c65d3f76bce55b0" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:08.528612  4561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7e5d871d1c44a58c65d3f76bce55b0" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:08.529518  4410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98342133e28b47d8a388f9321d5fd796" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:08.530117  4410 raft_consensus.cc:2468] T 98342133e28b47d8a388f9321d5fd796 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 0.
W20260709 13:12:08.532099  4379 leader_election.cc:343] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:08.534700  4455 leader_election.cc:304] T 98342133e28b47d8a388f9321d5fd796 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, aa0ff974118b465eaa785b8a86057e87; no voters: 
W20260709 13:12:08.535331  4380 leader_election.cc:343] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:08.535543  4930 raft_consensus.cc:2804] T 98342133e28b47d8a388f9321d5fd796 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:08.535778  4380 leader_election.cc:304] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06ec58698d5444caaecea433c8419770; no voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:08.536033  4930 raft_consensus.cc:493] T 98342133e28b47d8a388f9321d5fd796 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.536435  4930 raft_consensus.cc:3060] T 98342133e28b47d8a388f9321d5fd796 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.538242  4891 raft_consensus.cc:2749] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:08.544866  4635 raft_consensus.cc:3060] T f63e5465acbf4283a97304441ba41968 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.563534  4455 leader_election.cc:304] T 49047cb7a56246288b9044f8ebec130f P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:08.564301  4682 raft_consensus.cc:359] T e50b6f5a42a24867ab5f90ad6d97401e P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:08.565806  4682 raft_consensus.cc:385] T e50b6f5a42a24867ab5f90ad6d97401e P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.566129  4682 raft_consensus.cc:740] T e50b6f5a42a24867ab5f90ad6d97401e P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.566870  4682 consensus_queue.cc:260] T e50b6f5a42a24867ab5f90ad6d97401e P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:08.573196  4683 ts_tablet_manager.cc:1434] T 812a1b53a40e469c89b5f2aba8c59780 P 420a61707e804ce5b3773a91cc2eb424: Time spent starting tablet: real 0.127s	user 0.037s	sys 0.018s
I20260709 13:12:08.576485  4683 tablet_bootstrap.cc:492] T 82d5a41b86eb4457a114692137ced092 P 420a61707e804ce5b3773a91cc2eb424: Bootstrap starting.
I20260709 13:12:08.586694  4412 raft_consensus.cc:2468] T 49047cb7a56246288b9044f8ebec130f P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 1.
I20260709 13:12:08.589412  4774 raft_consensus.cc:515] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:08.590161  4998 raft_consensus.cc:2804] T 49047cb7a56246288b9044f8ebec130f P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:08.590881  4998 raft_consensus.cc:697] T 49047cb7a56246288b9044f8ebec130f P aa0ff974118b465eaa785b8a86057e87 [term 1 LEADER]: Becoming Leader. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Running, Role: LEADER
I20260709 13:12:08.572825  4634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98342133e28b47d8a388f9321d5fd796" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:08.598150  4930 raft_consensus.cc:515] T 98342133e28b47d8a388f9321d5fd796 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:08.600871  4682 ts_tablet_manager.cc:1434] T e50b6f5a42a24867ab5f90ad6d97401e P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.102s	user 0.006s	sys 0.001s
I20260709 13:12:08.603158  4998 consensus_queue.cc:237] T 49047cb7a56246288b9044f8ebec130f P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:08.605988  4682 tablet_bootstrap.cc:492] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:08.613144  4685 tablet_bootstrap.cc:654] T be5e478344f14439b78f1a9bf58f4451 P aa0ff974118b465eaa785b8a86057e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.629168  4930 leader_election.cc:290] T 98342133e28b47d8a388f9321d5fd796 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 election: Requested vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:08.642411  4774 leader_election.cc:290] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 election: Requested vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:08.732729  4681 tablet_bootstrap.cc:654] T b731fe02a6f4441e816628760bfdfb54 P 74758684df5649ccadd1e189eaff32dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.740828  4683 tablet_bootstrap.cc:654] T 82d5a41b86eb4457a114692137ced092 P 420a61707e804ce5b3773a91cc2eb424: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.755487  4682 tablet_bootstrap.cc:654] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.815307  4982 raft_consensus.cc:493] T e50b6f5a42a24867ab5f90ad6d97401e P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.816177  4982 raft_consensus.cc:515] T e50b6f5a42a24867ab5f90ad6d97401e P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:08.818549  4982 leader_election.cc:290] T e50b6f5a42a24867ab5f90ad6d97401e P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:08.869132  4635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e50b6f5a42a24867ab5f90ad6d97401e" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:08.937522  4681 tablet_bootstrap.cc:492] T b731fe02a6f4441e816628760bfdfb54 P 74758684df5649ccadd1e189eaff32dc: No bootstrap required, opened a new log
I20260709 13:12:08.938344  4681 ts_tablet_manager.cc:1403] T b731fe02a6f4441e816628760bfdfb54 P 74758684df5649ccadd1e189eaff32dc: Time spent bootstrapping tablet: real 0.505s	user 0.013s	sys 0.003s
I20260709 13:12:09.079391  4681 raft_consensus.cc:359] T b731fe02a6f4441e816628760bfdfb54 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:09.080476  4681 raft_consensus.cc:385] T b731fe02a6f4441e816628760bfdfb54 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.080883  4681 raft_consensus.cc:740] T b731fe02a6f4441e816628760bfdfb54 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.081894  4681 consensus_queue.cc:260] T b731fe02a6f4441e816628760bfdfb54 P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:09.086972  4685 tablet_bootstrap.cc:492] T be5e478344f14439b78f1a9bf58f4451 P aa0ff974118b465eaa785b8a86057e87: No bootstrap required, opened a new log
I20260709 13:12:09.095624  4685 ts_tablet_manager.cc:1403] T be5e478344f14439b78f1a9bf58f4451 P aa0ff974118b465eaa785b8a86057e87: Time spent bootstrapping tablet: real 0.610s	user 0.006s	sys 0.010s
I20260709 13:12:09.098981  4685 raft_consensus.cc:359] T be5e478344f14439b78f1a9bf58f4451 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:09.123500  4685 raft_consensus.cc:385] T be5e478344f14439b78f1a9bf58f4451 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.132939  4685 raft_consensus.cc:740] T be5e478344f14439b78f1a9bf58f4451 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.142933  4685 consensus_queue.cc:260] T be5e478344f14439b78f1a9bf58f4451 P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:09.176314  4681 ts_tablet_manager.cc:1434] T b731fe02a6f4441e816628760bfdfb54 P 74758684df5649ccadd1e189eaff32dc: Time spent starting tablet: real 0.238s	user 0.008s	sys 0.000s
I20260709 13:12:09.240799  4685 ts_tablet_manager.cc:1434] T be5e478344f14439b78f1a9bf58f4451 P aa0ff974118b465eaa785b8a86057e87: Time spent starting tablet: real 0.145s	user 0.003s	sys 0.004s
I20260709 13:12:09.242069  4685 tablet_bootstrap.cc:492] T 60d704077649426ab65d89dd9ff778d0 P aa0ff974118b465eaa785b8a86057e87: Bootstrap starting.
I20260709 13:12:09.264766  4681 tablet_bootstrap.cc:492] T be5e478344f14439b78f1a9bf58f4451 P 74758684df5649ccadd1e189eaff32dc: Bootstrap starting.
W20260709 13:12:09.269028  4682 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.015s	sys 0.012s
W20260709 13:12:09.269416  4682 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.015s	sys 0.012s
W20260709 13:12:09.271234  4380 leader_election.cc:343] T e50b6f5a42a24867ab5f90ad6d97401e P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.271595  4682 tablet_bootstrap.cc:492] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770: No bootstrap required, opened a new log
I20260709 13:12:09.272656  4682 ts_tablet_manager.cc:1403] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.671s	user 0.028s	sys 0.013s
I20260709 13:12:09.275205  4682 raft_consensus.cc:359] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:09.275941  4682 raft_consensus.cc:385] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.276221  4682 raft_consensus.cc:740] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.276861  4682 consensus_queue.cc:260] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:09.277694  4683 tablet_bootstrap.cc:492] T 82d5a41b86eb4457a114692137ced092 P 420a61707e804ce5b3773a91cc2eb424: No bootstrap required, opened a new log
I20260709 13:12:09.278155  4683 ts_tablet_manager.cc:1403] T 82d5a41b86eb4457a114692137ced092 P 420a61707e804ce5b3773a91cc2eb424: Time spent bootstrapping tablet: real 0.702s	user 0.014s	sys 0.005s
I20260709 13:12:09.278334  4682 ts_tablet_manager.cc:1434] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:12:09.280584  4683 raft_consensus.cc:359] T 82d5a41b86eb4457a114692137ced092 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:09.281169  4683 raft_consensus.cc:385] T 82d5a41b86eb4457a114692137ced092 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.281391  4683 raft_consensus.cc:740] T 82d5a41b86eb4457a114692137ced092 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.282033  4683 consensus_queue.cc:260] T 82d5a41b86eb4457a114692137ced092 P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:09.297441  4682 tablet_bootstrap.cc:492] T 47d66fc2153d419082eccd7e30643d56 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:09.307205  4683 ts_tablet_manager.cc:1434] T 82d5a41b86eb4457a114692137ced092 P 420a61707e804ce5b3773a91cc2eb424: Time spent starting tablet: real 0.029s	user 0.019s	sys 0.007s
I20260709 13:12:09.308355  4683 tablet_bootstrap.cc:492] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424: Bootstrap starting.
I20260709 13:12:09.311228  5041 raft_consensus.cc:493] T 812a1b53a40e469c89b5f2aba8c59780 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.311865  5041 raft_consensus.cc:515] T 812a1b53a40e469c89b5f2aba8c59780 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:09.313143  4682 tablet_bootstrap.cc:654] T 47d66fc2153d419082eccd7e30643d56 P 06ec58698d5444caaecea433c8419770: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.314073  5041 leader_election.cc:290] T 812a1b53a40e469c89b5f2aba8c59780 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:09.314617  4683 tablet_bootstrap.cc:654] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.322353  4685 tablet_bootstrap.cc:654] T 60d704077649426ab65d89dd9ff778d0 P aa0ff974118b465eaa785b8a86057e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.325345  4681 tablet_bootstrap.cc:654] T be5e478344f14439b78f1a9bf58f4451 P 74758684df5649ccadd1e189eaff32dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.345557  4681 tablet_bootstrap.cc:492] T be5e478344f14439b78f1a9bf58f4451 P 74758684df5649ccadd1e189eaff32dc: No bootstrap required, opened a new log
I20260709 13:12:09.346230  4681 ts_tablet_manager.cc:1403] T be5e478344f14439b78f1a9bf58f4451 P 74758684df5649ccadd1e189eaff32dc: Time spent bootstrapping tablet: real 0.169s	user 0.011s	sys 0.003s
I20260709 13:12:09.350157  4682 tablet_bootstrap.cc:492] T 47d66fc2153d419082eccd7e30643d56 P 06ec58698d5444caaecea433c8419770: No bootstrap required, opened a new log
I20260709 13:12:09.351639  4682 ts_tablet_manager.cc:1403] T 47d66fc2153d419082eccd7e30643d56 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.068s	user 0.014s	sys 0.001s
I20260709 13:12:09.358254  4685 tablet_bootstrap.cc:492] T 60d704077649426ab65d89dd9ff778d0 P aa0ff974118b465eaa785b8a86057e87: No bootstrap required, opened a new log
I20260709 13:12:09.358799  4685 ts_tablet_manager.cc:1403] T 60d704077649426ab65d89dd9ff778d0 P aa0ff974118b465eaa785b8a86057e87: Time spent bootstrapping tablet: real 0.117s	user 0.013s	sys 0.001s
I20260709 13:12:09.358407  4681 raft_consensus.cc:359] T be5e478344f14439b78f1a9bf58f4451 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:09.359129  4681 raft_consensus.cc:385] T be5e478344f14439b78f1a9bf58f4451 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.359408  4681 raft_consensus.cc:740] T be5e478344f14439b78f1a9bf58f4451 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.355265  4682 raft_consensus.cc:359] T 47d66fc2153d419082eccd7e30643d56 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
W20260709 13:12:09.359691  4488 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.010s	sys 0.036s
I20260709 13:12:09.361922  4685 raft_consensus.cc:359] T 60d704077649426ab65d89dd9ff778d0 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
W20260709 13:12:09.383239  4488 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.811s	user 0.014s	sys 0.036s
W20260709 13:12:09.383442  4455 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.803s	user 0.005s	sys 0.010s
W20260709 13:12:09.383876  4455 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.006s	sys 0.010s
W20260709 13:12:09.384183  4455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:42711, user_credentials={real_user=slave}} blocked reactor thread for 820692us
I20260709 13:12:09.386787  4410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98342133e28b47d8a388f9321d5fd796" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770"
I20260709 13:12:09.387372  4410 raft_consensus.cc:3060] T 98342133e28b47d8a388f9321d5fd796 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.402527  5030 consensus_queue.cc:1048] T 49047cb7a56246288b9044f8ebec130f P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:09.412436  4487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e50b6f5a42a24867ab5f90ad6d97401e" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:09.415449  5046 raft_consensus.cc:493] T 82d5a41b86eb4457a114692137ced092 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.416092  5046 raft_consensus.cc:515] T 82d5a41b86eb4457a114692137ced092 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:09.418032  4410 raft_consensus.cc:2468] T 98342133e28b47d8a388f9321d5fd796 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 1.
I20260709 13:12:09.418200  5046 leader_election.cc:290] T 82d5a41b86eb4457a114692137ced092 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:09.383428  4685 raft_consensus.cc:385] T 60d704077649426ab65d89dd9ff778d0 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.419512  4685 raft_consensus.cc:740] T 60d704077649426ab65d89dd9ff778d0 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.422825  4685 consensus_queue.cc:260] T 60d704077649426ab65d89dd9ff778d0 P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:09.451040  5046 raft_consensus.cc:493] T be5e478344f14439b78f1a9bf58f4451 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.451745  5046 raft_consensus.cc:515] T be5e478344f14439b78f1a9bf58f4451 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:09.452181  4980 consensus_queue.cc:1048] T d088694ef66442bdbf75cc7fc1942a83 P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:09.454205  5046 leader_election.cc:290] T be5e478344f14439b78f1a9bf58f4451 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:09.458882  4682 raft_consensus.cc:385] T 47d66fc2153d419082eccd7e30643d56 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.459233  4682 raft_consensus.cc:740] T 47d66fc2153d419082eccd7e30643d56 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.460119  4682 consensus_queue.cc:260] T 47d66fc2153d419082eccd7e30643d56 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:09.460490  4412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d704077649426ab65d89dd9ff778d0" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770"
I20260709 13:12:09.461159  4412 raft_consensus.cc:3060] T 60d704077649426ab65d89dd9ff778d0 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.360028  4681 consensus_queue.cc:260] T be5e478344f14439b78f1a9bf58f4451 P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:09.469239  4683 tablet_bootstrap.cc:492] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424: No bootstrap required, opened a new log
I20260709 13:12:09.469942  4683 ts_tablet_manager.cc:1403] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424: Time spent bootstrapping tablet: real 0.162s	user 0.064s	sys 0.069s
I20260709 13:12:09.473963  4683 raft_consensus.cc:359] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:09.474866  4683 raft_consensus.cc:385] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.475204  4683 raft_consensus.cc:740] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.476032  4683 consensus_queue.cc:260] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:09.494874  4681 ts_tablet_manager.cc:1434] T be5e478344f14439b78f1a9bf58f4451 P 74758684df5649ccadd1e189eaff32dc: Time spent starting tablet: real 0.148s	user 0.006s	sys 0.010s
I20260709 13:12:09.495785  4682 ts_tablet_manager.cc:1434] T 47d66fc2153d419082eccd7e30643d56 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.144s	user 0.016s	sys 0.000s
W20260709 13:12:09.496767  4455 leader_election.cc:343] T 98342133e28b47d8a388f9321d5fd796 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.500039  4455 leader_election.cc:304] T 98342133e28b47d8a388f9321d5fd796 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:09.511567  4488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d5a41b86eb4457a114692137ced092" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:09.503261  5030 raft_consensus.cc:2804] T 98342133e28b47d8a388f9321d5fd796 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:09.514781  5030 raft_consensus.cc:697] T 98342133e28b47d8a388f9321d5fd796 P aa0ff974118b465eaa785b8a86057e87 [term 1 LEADER]: Becoming Leader. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Running, Role: LEADER
I20260709 13:12:09.515636  5030 consensus_queue.cc:237] T 98342133e28b47d8a388f9321d5fd796 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:09.516115  4482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5e478344f14439b78f1a9bf58f4451" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:09.516772  4482 raft_consensus.cc:2468] T be5e478344f14439b78f1a9bf58f4451 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 0.
I20260709 13:12:09.523907  4628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812a1b53a40e469c89b5f2aba8c59780" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:09.525374  4628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d5a41b86eb4457a114692137ced092" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:09.528028  4988 consensus_queue.cc:1048] T b731fe02a6f4441e816628760bfdfb54 P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:09.502377  4636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98342133e28b47d8a388f9321d5fd796" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:09.530228  4630 raft_consensus.cc:3060] T b731fe02a6f4441e816628760bfdfb54 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.532083  4485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d704077649426ab65d89dd9ff778d0" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:09.532730  4485 raft_consensus.cc:3060] T 60d704077649426ab65d89dd9ff778d0 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.525439  4629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5e478344f14439b78f1a9bf58f4451" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:09.536271  4629 raft_consensus.cc:2468] T be5e478344f14439b78f1a9bf58f4451 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 0.
I20260709 13:12:09.541273  4412 raft_consensus.cc:2468] T 60d704077649426ab65d89dd9ff778d0 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 1.
W20260709 13:12:09.547711  4380 leader_election.cc:343] T e50b6f5a42a24867ab5f90ad6d97401e P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.553714  4380 leader_election.cc:304] T e50b6f5a42a24867ab5f90ad6d97401e P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06ec58698d5444caaecea433c8419770; no voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87
W20260709 13:12:09.562608  4603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:36439, user_credentials={real_user=slave}} blocked reactor thread for 58516.8us
I20260709 13:12:09.566994  4685 ts_tablet_manager.cc:1434] T 60d704077649426ab65d89dd9ff778d0 P aa0ff974118b465eaa785b8a86057e87: Time spent starting tablet: real 0.208s	user 0.036s	sys 0.024s
I20260709 13:12:09.561480  4988 raft_consensus.cc:2749] T e50b6f5a42a24867ab5f90ad6d97401e P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:09.570667  4685 tablet_bootstrap.cc:492] T 541b1e6cfdca4f609467169f4caf64ef P aa0ff974118b465eaa785b8a86057e87: Bootstrap starting.
W20260709 13:12:09.587893  4529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:45987, user_credentials={real_user=slave}} blocked reactor thread for 44338.2us
I20260709 13:12:09.570101  5038 raft_consensus.cc:493] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:09.589380  4529 leader_election.cc:343] T 82d5a41b86eb4457a114692137ced092 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.592645  4529 leader_election.cc:304] T be5e478344f14439b78f1a9bf58f4451 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:09.569085  4758 consensus_queue.cc:1048] T 1271bae393604d56b9e376c716eb2a9e P 74758684df5649ccadd1e189eaff32dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
W20260709 13:12:09.595855  4529 leader_election.cc:343] T 812a1b53a40e469c89b5f2aba8c59780 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.600356  5042 raft_consensus.cc:2804] T be5e478344f14439b78f1a9bf58f4451 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:09.600752  5042 raft_consensus.cc:493] T be5e478344f14439b78f1a9bf58f4451 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.601171  5042 raft_consensus.cc:3060] T be5e478344f14439b78f1a9bf58f4451 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.603046  5053 consensus_queue.cc:1048] T 49047cb7a56246288b9044f8ebec130f P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:12:09.618992  4681 tablet_bootstrap.cc:492] T 98342133e28b47d8a388f9321d5fd796 P 74758684df5649ccadd1e189eaff32dc: Bootstrap starting.
I20260709 13:12:09.593974  5038 raft_consensus.cc:515] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:09.611694  4308 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51262 (request call id 61) took 1201 ms. Trace:
I20260709 13:12:09.621737  5038 leader_election.cc:290] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:09.623675  4487 raft_consensus.cc:1275] T 3092a6c40d0d4610968fe09d4c7d16c0 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Refusing update from remote peer 74758684df5649ccadd1e189eaff32dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:12:09.621258  4308 rpcz_store.cc:276] 0709 13:12:08.405513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:08.406898 (+  1385us) service_pool.cc:224] Handling call
0709 13:12:09.606647 (+1199749us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:08.450569 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:08.451445 (+   876us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:08.451497 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:12:08.451684 (+   187us) tablet.cc:662] Decoding operations
0709 13:12:08.460135 (+  8451us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:08.464489 (+  4354us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:08.467166 (+  2677us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:12:08.476712 (+  9546us) tablet.cc:701] Row locks acquired
0709 13:12:08.477808 (+  1096us) write_op.cc:260] PREPARE: finished
0709 13:12:08.489577 (+ 11769us) write_op.cc:270] Start()
0709 13:12:08.491968 (+  2391us) write_op.cc:276] Timestamp: P: 1783602728488300 usec, L: 0
0709 13:12:08.495886 (+  3918us) op_driver.cc:348] REPLICATION: starting
0709 13:12:08.496542 (+   656us) log.cc:844] Serialized 537 byte log entry
0709 13:12:08.498339 (+  1797us) op_driver.cc:464] REPLICATION: finished
0709 13:12:08.498728 (+   389us) write_op.cc:301] APPLY: starting
0709 13:12:08.498808 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:08.498901 (+    93us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:08.499000 (+    99us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:08.499178 (+   178us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:08.499314 (+   136us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:12:08.499353 (+    39us) write_op.cc:312] APPLY: finished
0709 13:12:08.499536 (+   183us) log.cc:844] Serialized 22 byte log entry
0709 13:12:08.499678 (+   142us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:08.499750 (+    72us) write_op.cc:454] Released schema lock
0709 13:12:08.499796 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:08.500113 (+   317us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:08.500137 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":179633,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":211,"apply.run_cpu_time_us":1356,"apply.run_wall_time_us":1355,"num_ops":1,"prepare.queue_time_us":111,"prepare.run_cpu_time_us":2905,"prepare.run_wall_time_us":46230,"replication_time_us":2336}]]}
I20260709 13:12:09.626354  4682 tablet_bootstrap.cc:492] T d8033bfb7f5d423d90d60318c67df709 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:09.628870  4485 raft_consensus.cc:2468] T 60d704077649426ab65d89dd9ff778d0 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 1.
I20260709 13:12:09.630522  5042 raft_consensus.cc:515] T be5e478344f14439b78f1a9bf58f4451 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:09.630908  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812a1b53a40e469c89b5f2aba8c59780" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:09.631827  4563 raft_consensus.cc:2468] T 812a1b53a40e469c89b5f2aba8c59780 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 0.
I20260709 13:12:09.633539  4379 leader_election.cc:304] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: 
I20260709 13:12:09.635273  4685 tablet_bootstrap.cc:654] T 541b1e6cfdca4f609467169f4caf64ef P aa0ff974118b465eaa785b8a86057e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.635306  4311 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51274 (request call id 67) took 1124 ms. Trace:
I20260709 13:12:09.637713  4311 rpcz_store.cc:276] 0709 13:12:08.510498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:08.513759 (+  3261us) service_pool.cc:224] Handling call
0709 13:12:09.635245 (+1121486us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1066849,"reported_tablets":3}
W20260709 13:12:09.639144  4455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:42711, user_credentials={real_user=slave}} blocked reactor thread for 75787.9us
I20260709 13:12:09.653156  4683 ts_tablet_manager.cc:1434] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424: Time spent starting tablet: real 0.183s	user 0.032s	sys 0.044s
I20260709 13:12:09.635352  5038 raft_consensus.cc:2804] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:09.657444  4683 tablet_bootstrap.cc:492] T 47d66fc2153d419082eccd7e30643d56 P 420a61707e804ce5b3773a91cc2eb424: Bootstrap starting.
W20260709 13:12:09.656522  4603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:36439, user_credentials={real_user=slave}} blocked reactor thread for 88958.7us
I20260709 13:12:09.658602  5042 leader_election.cc:290] T be5e478344f14439b78f1a9bf58f4451 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 election: Requested vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
W20260709 13:12:09.659526  4529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:42711, user_credentials={real_user=slave}} blocked reactor thread for 62989us
W20260709 13:12:09.660204  4529 leader_election.cc:343] T 82d5a41b86eb4457a114692137ced092 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.660575  4529 leader_election.cc:304] T 82d5a41b86eb4457a114692137ced092 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424; no voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87
W20260709 13:12:09.661338  4455 leader_election.cc:343] T 98342133e28b47d8a388f9321d5fd796 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.657307  5038 raft_consensus.cc:493] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.664573  5038 raft_consensus.cc:3060] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.669660  5042 raft_consensus.cc:2749] T 82d5a41b86eb4457a114692137ced092 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:12:09.674327  4380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:45987, user_credentials={real_user=slave}} blocked reactor thread for 95140.5us
I20260709 13:12:09.684201  4488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5e478344f14439b78f1a9bf58f4451" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:09.684815  4488 raft_consensus.cc:3060] T be5e478344f14439b78f1a9bf58f4451 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.689494  4629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be5e478344f14439b78f1a9bf58f4451" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:09.690287  4629 raft_consensus.cc:3060] T be5e478344f14439b78f1a9bf58f4451 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.688318  4529 leader_election.cc:304] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: 
I20260709 13:12:09.680112  5042 raft_consensus.cc:493] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.696202  5042 raft_consensus.cc:515] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:09.698195  5042 leader_election.cc:290] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:09.698107  4629 raft_consensus.cc:2468] T be5e478344f14439b78f1a9bf58f4451 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 1.
W20260709 13:12:09.699043  4380 consensus_peers.cc:597] T d088694ef66442bdbf75cc7fc1942a83 P 06ec58698d5444caaecea433c8419770 -> Peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Couldn't send request to peer 74758684df5649ccadd1e189eaff32dc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:09.702399  4488 raft_consensus.cc:2468] T be5e478344f14439b78f1a9bf58f4451 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 1.
I20260709 13:12:09.706028  4634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812a1b53a40e469c89b5f2aba8c59780" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:09.717190  4413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812a1b53a40e469c89b5f2aba8c59780" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:09.724463  5042 raft_consensus.cc:2804] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:09.725063  5042 raft_consensus.cc:697] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [term 1 LEADER]: Becoming Leader. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Running, Role: LEADER
I20260709 13:12:09.725925  5042 consensus_queue.cc:237] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:09.727166  4310 catalog_manager.cc:5697] T 1271bae393604d56b9e376c716eb2a9e P 74758684df5649ccadd1e189eaff32dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 74758684df5649ccadd1e189eaff32dc (127.28.173.4). New cstate: current_term: 1 leader_uuid: "74758684df5649ccadd1e189eaff32dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:09.732707  5051 consensus_queue.cc:1048] T b731fe02a6f4441e816628760bfdfb54 P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:09.733608  4529 leader_election.cc:304] T be5e478344f14439b78f1a9bf58f4451 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc; no voters: 
I20260709 13:12:09.734388  5046 raft_consensus.cc:2804] T be5e478344f14439b78f1a9bf58f4451 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:09.734427  4555 raft_consensus.cc:1275] T 3092a6c40d0d4610968fe09d4c7d16c0 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Refusing update from remote peer 74758684df5649ccadd1e189eaff32dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:12:09.734999  5046 raft_consensus.cc:697] T be5e478344f14439b78f1a9bf58f4451 P 420a61707e804ce5b3773a91cc2eb424 [term 1 LEADER]: Becoming Leader. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Running, Role: LEADER
I20260709 13:12:09.735867  5046 consensus_queue.cc:237] T be5e478344f14439b78f1a9bf58f4451 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:09.736352  5068 consensus_queue.cc:1048] T 3092a6c40d0d4610968fe09d4c7d16c0 P 74758684df5649ccadd1e189eaff32dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:12:09.741884  4380 leader_election.cc:343] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.749087  4681 tablet_bootstrap.cc:654] T 98342133e28b47d8a388f9321d5fd796 P 74758684df5649ccadd1e189eaff32dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.750809  5038 raft_consensus.cc:515] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:09.753885  4414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7e5d871d1c44a58c65d3f76bce55b0" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:09.754572  4414 raft_consensus.cc:2468] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 0.
I20260709 13:12:09.755357  5038 leader_election.cc:290] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Requested vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:09.756481  4633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812a1b53a40e469c89b5f2aba8c59780" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:09.770197  4413 raft_consensus.cc:2393] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 420a61707e804ce5b3773a91cc2eb424 in current term 1: Already voted for candidate 06ec58698d5444caaecea433c8419770 in this term.
I20260709 13:12:09.770581  4307 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51288 (request call id 66) took 1292 ms. Trace:
W20260709 13:12:09.742353  4603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:45987, user_credentials={real_user=slave}} blocked reactor thread for 55443.1us
I20260709 13:12:09.786023  4529 leader_election.cc:304] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: 
I20260709 13:12:09.787644  4529 leader_election.cc:304] T 812a1b53a40e469c89b5f2aba8c59780 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424; no voters: 06ec58698d5444caaecea433c8419770, 74758684df5649ccadd1e189eaff32dc
W20260709 13:12:09.789055  4380 leader_election.cc:343] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.792097  4488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7e5d871d1c44a58c65d3f76bce55b0" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:09.771121  4307 rpcz_store.cc:276] 0709 13:12:08.488762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:08.491304 (+  2542us) service_pool.cc:224] Handling call
0709 13:12:09.770499 (+1279195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":977481,"reported_tablets":1}
I20260709 13:12:09.793277  5060 raft_consensus.cc:3060] T 812a1b53a40e469c89b5f2aba8c59780 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:09.794404  4529 leader_election.cc:343] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.796135  4683 tablet_bootstrap.cc:654] T 47d66fc2153d419082eccd7e30643d56 P 420a61707e804ce5b3773a91cc2eb424: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.801689  5046 raft_consensus.cc:2804] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:09.811189  5066 consensus_queue.cc:1048] T 3092a6c40d0d4610968fe09d4c7d16c0 P 74758684df5649ccadd1e189eaff32dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:12:09.808506  5046 raft_consensus.cc:493] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.813194  5046 raft_consensus.cc:3060] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.816195  5050 consensus_queue.cc:1048] T 1271bae393604d56b9e376c716eb2a9e P 74758684df5649ccadd1e189eaff32dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:12:09.823163  4682 tablet_bootstrap.cc:654] T d8033bfb7f5d423d90d60318c67df709 P 06ec58698d5444caaecea433c8419770: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.823730  5060 raft_consensus.cc:2749] T 812a1b53a40e469c89b5f2aba8c59780 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:09.843271  4685 tablet_bootstrap.cc:492] T 541b1e6cfdca4f609467169f4caf64ef P aa0ff974118b465eaa785b8a86057e87: No bootstrap required, opened a new log
I20260709 13:12:09.843924  4685 ts_tablet_manager.cc:1403] T 541b1e6cfdca4f609467169f4caf64ef P aa0ff974118b465eaa785b8a86057e87: Time spent bootstrapping tablet: real 0.273s	user 0.021s	sys 0.021s
I20260709 13:12:09.852452  4685 raft_consensus.cc:359] T 541b1e6cfdca4f609467169f4caf64ef P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:09.853303  4685 raft_consensus.cc:385] T 541b1e6cfdca4f609467169f4caf64ef P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.856122  4685 raft_consensus.cc:740] T 541b1e6cfdca4f609467169f4caf64ef P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.873929  4557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812a1b53a40e469c89b5f2aba8c59780" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
W20260709 13:12:09.891778  5072 log.cc:927] Time spent T 3092a6c40d0d4610968fe09d4c7d16c0 P 420a61707e804ce5b3773a91cc2eb424: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:12:09.897171  4683 tablet_bootstrap.cc:492] T 47d66fc2153d419082eccd7e30643d56 P 420a61707e804ce5b3773a91cc2eb424: No bootstrap required, opened a new log
I20260709 13:12:09.898133  4683 ts_tablet_manager.cc:1403] T 47d66fc2153d419082eccd7e30643d56 P 420a61707e804ce5b3773a91cc2eb424: Time spent bootstrapping tablet: real 0.243s	user 0.012s	sys 0.007s
I20260709 13:12:09.901248  5038 raft_consensus.cc:493] T 47d66fc2153d419082eccd7e30643d56 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.901877  5038 raft_consensus.cc:515] T 47d66fc2153d419082eccd7e30643d56 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:09.975371  4683 raft_consensus.cc:359] T 47d66fc2153d419082eccd7e30643d56 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:09.987112  4683 raft_consensus.cc:385] T 47d66fc2153d419082eccd7e30643d56 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.987782  4683 raft_consensus.cc:740] T 47d66fc2153d419082eccd7e30643d56 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.995376  4557 raft_consensus.cc:2468] T 812a1b53a40e469c89b5f2aba8c59780 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 1.
I20260709 13:12:10.012223  4683 consensus_queue.cc:260] T 47d66fc2153d419082eccd7e30643d56 P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:09.872718  4685 consensus_queue.cc:260] T 541b1e6cfdca4f609467169f4caf64ef P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:10.021665  4685 ts_tablet_manager.cc:1434] T 541b1e6cfdca4f609467169f4caf64ef P aa0ff974118b465eaa785b8a86057e87: Time spent starting tablet: real 0.177s	user 0.005s	sys 0.002s
I20260709 13:12:09.995995  5038 leader_election.cc:290] T 47d66fc2153d419082eccd7e30643d56 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:09.960246  5046 raft_consensus.cc:515] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:10.060528  4681 tablet_bootstrap.cc:492] T 98342133e28b47d8a388f9321d5fd796 P 74758684df5649ccadd1e189eaff32dc: No bootstrap required, opened a new log
I20260709 13:12:10.061296  4681 ts_tablet_manager.cc:1403] T 98342133e28b47d8a388f9321d5fd796 P 74758684df5649ccadd1e189eaff32dc: Time spent bootstrapping tablet: real 0.443s	user 0.021s	sys 0.047s
I20260709 13:12:10.062906  4685 tablet_bootstrap.cc:492] T 1c7e5d871d1c44a58c65d3f76bce55b0 P aa0ff974118b465eaa785b8a86057e87: Bootstrap starting.
I20260709 13:12:10.153582  4682 tablet_bootstrap.cc:492] T d8033bfb7f5d423d90d60318c67df709 P 06ec58698d5444caaecea433c8419770: No bootstrap required, opened a new log
I20260709 13:12:10.154772  4682 ts_tablet_manager.cc:1403] T d8033bfb7f5d423d90d60318c67df709 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.529s	user 0.016s	sys 0.005s
I20260709 13:12:10.176579  4681 raft_consensus.cc:359] T 98342133e28b47d8a388f9321d5fd796 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:10.177625  4681 raft_consensus.cc:385] T 98342133e28b47d8a388f9321d5fd796 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.177965  4681 raft_consensus.cc:740] T 98342133e28b47d8a388f9321d5fd796 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.179692  4681 consensus_queue.cc:260] T 98342133e28b47d8a388f9321d5fd796 P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
W20260709 13:12:10.185176  5088 log.cc:927] Time spent T 00000000000000000000000000000000 P a6b539c165f7423db62dde53667fcf75: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:12:10.186721  4562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d66fc2153d419082eccd7e30643d56" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:10.187247  4562 raft_consensus.cc:2468] T 47d66fc2153d419082eccd7e30643d56 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 0.
I20260709 13:12:10.188349  4683 ts_tablet_manager.cc:1434] T 47d66fc2153d419082eccd7e30643d56 P 420a61707e804ce5b3773a91cc2eb424: Time spent starting tablet: real 0.290s	user 0.008s	sys 0.013s
I20260709 13:12:10.190279  4681 ts_tablet_manager.cc:1434] T 98342133e28b47d8a388f9321d5fd796 P 74758684df5649ccadd1e189eaff32dc: Time spent starting tablet: real 0.128s	user 0.007s	sys 0.001s
I20260709 13:12:10.192153  5046 leader_election.cc:290] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 election: Requested vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:10.196117  4379 leader_election.cc:304] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: 74758684df5649ccadd1e189eaff32dc
I20260709 13:12:10.196928  5038 raft_consensus.cc:2804] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:10.197391  5038 raft_consensus.cc:697] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770 [term 1 LEADER]: Becoming Leader. State: Replica: 06ec58698d5444caaecea433c8419770, State: Running, Role: LEADER
I20260709 13:12:10.200445  5053 raft_consensus.cc:493] T 541b1e6cfdca4f609467169f4caf64ef P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.200942  5053 raft_consensus.cc:515] T 541b1e6cfdca4f609467169f4caf64ef P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:10.198231  5038 consensus_queue.cc:237] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:10.203015  5053 leader_election.cc:290] T 541b1e6cfdca4f609467169f4caf64ef P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:10.208897  4683 tablet_bootstrap.cc:492] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 420a61707e804ce5b3773a91cc2eb424: Bootstrap starting.
I20260709 13:12:10.210187  4681 tablet_bootstrap.cc:492] T d088694ef66442bdbf75cc7fc1942a83 P 74758684df5649ccadd1e189eaff32dc: Bootstrap starting.
I20260709 13:12:10.219439  4379 leader_election.cc:304] T 47d66fc2153d419082eccd7e30643d56 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: 
I20260709 13:12:10.220489  5097 raft_consensus.cc:2804] T 47d66fc2153d419082eccd7e30643d56 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:10.220868  5097 raft_consensus.cc:493] T 47d66fc2153d419082eccd7e30643d56 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.221179  5097 raft_consensus.cc:3060] T 47d66fc2153d419082eccd7e30643d56 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.221150  4311 catalog_manager.cc:5697] T 49047cb7a56246288b9044f8ebec130f P aa0ff974118b465eaa785b8a86057e87 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa0ff974118b465eaa785b8a86057e87 (127.28.173.2). New cstate: current_term: 1 leader_uuid: "aa0ff974118b465eaa785b8a86057e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:10.222466  4682 raft_consensus.cc:359] T d8033bfb7f5d423d90d60318c67df709 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:10.223147  4682 raft_consensus.cc:385] T d8033bfb7f5d423d90d60318c67df709 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.223397  4682 raft_consensus.cc:740] T d8033bfb7f5d423d90d60318c67df709 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.225920  4555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541b1e6cfdca4f609467169f4caf64ef" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:10.226554  4685 tablet_bootstrap.cc:654] T 1c7e5d871d1c44a58c65d3f76bce55b0 P aa0ff974118b465eaa785b8a86057e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.226579  4555 raft_consensus.cc:2468] T 541b1e6cfdca4f609467169f4caf64ef P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 0.
I20260709 13:12:10.229470  4682 consensus_queue.cc:260] T d8033bfb7f5d423d90d60318c67df709 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:10.231110  4311 catalog_manager.cc:5697] T 98342133e28b47d8a388f9321d5fd796 P aa0ff974118b465eaa785b8a86057e87 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa0ff974118b465eaa785b8a86057e87 (127.28.173.2). New cstate: current_term: 1 leader_uuid: "aa0ff974118b465eaa785b8a86057e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:10.255532  4358 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:10.263782  4488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7e5d871d1c44a58c65d3f76bce55b0" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:10.272765  4681 tablet_bootstrap.cc:654] T d088694ef66442bdbf75cc7fc1942a83 P 74758684df5649ccadd1e189eaff32dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.279318  4682 ts_tablet_manager.cc:1434] T d8033bfb7f5d423d90d60318c67df709 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.124s	user 0.006s	sys 0.001s
I20260709 13:12:10.280544  4682 tablet_bootstrap.cc:492] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:10.281029  4683 tablet_bootstrap.cc:654] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 420a61707e804ce5b3773a91cc2eb424: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.247256  4454 leader_election.cc:304] T 541b1e6cfdca4f609467169f4caf64ef P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:10.276958  5030 raft_consensus.cc:493] T f63e5465acbf4283a97304441ba41968 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 420a61707e804ce5b3773a91cc2eb424)
I20260709 13:12:10.318122  5101 raft_consensus.cc:493] T 49047cb7a56246288b9044f8ebec130f P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aa0ff974118b465eaa785b8a86057e87)
I20260709 13:12:10.318787  5101 raft_consensus.cc:515] T 49047cb7a56246288b9044f8ebec130f P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:10.318028  4482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d66fc2153d419082eccd7e30643d56" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:10.324501  4681 tablet_bootstrap.cc:492] T d088694ef66442bdbf75cc7fc1942a83 P 74758684df5649ccadd1e189eaff32dc: No bootstrap required, opened a new log
I20260709 13:12:10.326700  5097 raft_consensus.cc:515] T 47d66fc2153d419082eccd7e30643d56 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
W20260709 13:12:10.314172  4454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:33159, user_credentials={real_user=slave}} blocked reactor thread for 69532.8us
I20260709 13:12:10.327486  4682 tablet_bootstrap.cc:654] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 06ec58698d5444caaecea433c8419770: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.347563  5097 leader_election.cc:290] T 47d66fc2153d419082eccd7e30643d56 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Requested vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:10.324986  4681 ts_tablet_manager.cc:1403] T d088694ef66442bdbf75cc7fc1942a83 P 74758684df5649ccadd1e189eaff32dc: Time spent bootstrapping tablet: real 0.117s	user 0.010s	sys 0.013s
I20260709 13:12:10.314983  5053 raft_consensus.cc:2804] T 541b1e6cfdca4f609467169f4caf64ef P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:10.355206  4681 raft_consensus.cc:359] T d088694ef66442bdbf75cc7fc1942a83 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:10.356040  4681 raft_consensus.cc:385] T d088694ef66442bdbf75cc7fc1942a83 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.348475  5053 raft_consensus.cc:493] T 541b1e6cfdca4f609467169f4caf64ef P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.361155  4681 raft_consensus.cc:740] T d088694ef66442bdbf75cc7fc1942a83 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.366853  4488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d66fc2153d419082eccd7e30643d56" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:10.371006  4681 consensus_queue.cc:260] T d088694ef66442bdbf75cc7fc1942a83 P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:10.373322  4637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541b1e6cfdca4f609467169f4caf64ef" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:10.376683  4681 ts_tablet_manager.cc:1434] T d088694ef66442bdbf75cc7fc1942a83 P 74758684df5649ccadd1e189eaff32dc: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:12:10.377948  4681 tablet_bootstrap.cc:492] T e50b6f5a42a24867ab5f90ad6d97401e P 74758684df5649ccadd1e189eaff32dc: Bootstrap starting.
I20260709 13:12:10.385596  4634 raft_consensus.cc:3060] T 98342133e28b47d8a388f9321d5fd796 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.386523  4681 tablet_bootstrap.cc:654] T e50b6f5a42a24867ab5f90ad6d97401e P 74758684df5649ccadd1e189eaff32dc: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:10.390547  4529 leader_election.cc:343] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.343513  5101 leader_election.cc:290] T 49047cb7a56246288b9044f8ebec130f P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
W20260709 13:12:10.390558  4380 leader_election.cc:343] T 47d66fc2153d419082eccd7e30643d56 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.316078  5030 raft_consensus.cc:515] T f63e5465acbf4283a97304441ba41968 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:10.369098  5053 raft_consensus.cc:3060] T 541b1e6cfdca4f609467169f4caf64ef P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.391867  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d66fc2153d419082eccd7e30643d56" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
W20260709 13:12:10.409699  4380 leader_election.cc:343] T 47d66fc2153d419082eccd7e30643d56 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:10.414412  4603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.1:36439, user_credentials={real_user=slave}} blocked reactor thread for 228431us
W20260709 13:12:10.415688  4455 leader_election.cc:343] T 541b1e6cfdca4f609467169f4caf64ef P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.418357  5065 consensus_queue.cc:1048] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:12:10.400769  5060 consensus_queue.cc:1048] T be5e478344f14439b78f1a9bf58f4451 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 13:12:10.434005  5046 consensus_queue.cc:1048] T be5e478344f14439b78f1a9bf58f4451 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:10.435994  5030 leader_election.cc:290] T f63e5465acbf4283a97304441ba41968 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:10.415733  4563 raft_consensus.cc:3060] T 47d66fc2153d419082eccd7e30643d56 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.456389  4555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f63e5465acbf4283a97304441ba41968" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:10.457365  5053 raft_consensus.cc:515] T 541b1e6cfdca4f609467169f4caf64ef P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:10.457433  4683 tablet_bootstrap.cc:492] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 420a61707e804ce5b3773a91cc2eb424: No bootstrap required, opened a new log
I20260709 13:12:10.460875  4683 ts_tablet_manager.cc:1403] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 420a61707e804ce5b3773a91cc2eb424: Time spent bootstrapping tablet: real 0.272s	user 0.013s	sys 0.011s
I20260709 13:12:10.466135  4310 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51296 (request call id 68) took 1968 ms. Trace:
I20260709 13:12:10.468914  5056 raft_consensus.cc:493] T d088694ef66442bdbf75cc7fc1942a83 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.469448  5056 raft_consensus.cc:515] T d088694ef66442bdbf75cc7fc1942a83 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:10.470182  4633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f63e5465acbf4283a97304441ba41968" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:10.471510  5056 leader_election.cc:290] T d088694ef66442bdbf75cc7fc1942a83 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:10.477381  4489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49047cb7a56246288b9044f8ebec130f" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:10.480019  4683 raft_consensus.cc:359] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:10.494436  4683 raft_consensus.cc:385] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.494737  4683 raft_consensus.cc:740] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.495586  4683 consensus_queue.cc:260] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:10.496240  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49047cb7a56246288b9044f8ebec130f" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:10.498253  4683 ts_tablet_manager.cc:1434] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 420a61707e804ce5b3773a91cc2eb424: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 13:12:10.499470  4683 tablet_bootstrap.cc:492] T 3f696298fcc049c08b47cd54f901be0c P 420a61707e804ce5b3773a91cc2eb424: Bootstrap starting.
I20260709 13:12:10.466518  4310 rpcz_store.cc:276] 0709 13:12:08.497664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:08.499992 (+  2328us) service_pool.cc:224] Handling call
0709 13:12:10.466074 (+1966082us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:09.848087 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:09.849287 (+  1200us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:09.849342 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:12:09.849369 (+    27us) tablet.cc:662] Decoding operations
0709 13:12:09.849797 (+   428us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:09.849889 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:09.849936 (+    47us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:12:09.850160 (+   224us) tablet.cc:701] Row locks acquired
0709 13:12:09.850186 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:12:09.850353 (+   167us) write_op.cc:270] Start()
0709 13:12:09.850493 (+   140us) write_op.cc:276] Timestamp: P: 1783602729850303 usec, L: 0
0709 13:12:09.850522 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:12:09.893660 (+ 43138us) log.cc:844] Serialized 537 byte log entry
0709 13:12:10.258668 (+365008us) op_driver.cc:464] REPLICATION: finished
0709 13:12:10.388160 (+129492us) write_op.cc:301] APPLY: starting
0709 13:12:10.388249 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:10.388350 (+   101us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:10.388488 (+   138us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:10.388730 (+   242us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:10.388919 (+   189us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:12:10.388962 (+    43us) write_op.cc:312] APPLY: finished
0709 13:12:10.404090 (+ 15128us) log.cc:844] Serialized 22 byte log entry
0709 13:12:10.407991 (+  3901us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:10.412344 (+  4353us) write_op.cc:454] Released schema lock
0709 13:12:10.416028 (+  3684us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:10.428794 (+ 12766us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:10.428855 (+    61us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1100672,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":129224,"apply.run_cpu_time_us":2059,"apply.run_wall_time_us":40589,"num_ops":1,"prepare.queue_time_us":105808,"prepare.run_cpu_time_us":57369,"prepare.run_wall_time_us":214262,"raft.queue_time_us":72542,"raft.run_cpu_time_us":24412,"raft.run_wall_time_us":68020,"replication_time_us":407975,"thread_start_us":398855,"threads_started":4,"wal-append.queue_time_us":165888}]]}
I20260709 13:12:10.503535  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7e5d871d1c44a58c65d3f76bce55b0" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770"
I20260709 13:12:10.504179  4409 raft_consensus.cc:3060] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.483620  4455 leader_election.cc:304] T f63e5465acbf4283a97304441ba41968 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa0ff974118b465eaa785b8a86057e87; no voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc
I20260709 13:12:10.505237  5030 raft_consensus.cc:2749] T f63e5465acbf4283a97304441ba41968 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:10.486114  4560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d088694ef66442bdbf75cc7fc1942a83" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:10.490686  4685 tablet_bootstrap.cc:492] T 1c7e5d871d1c44a58c65d3f76bce55b0 P aa0ff974118b465eaa785b8a86057e87: No bootstrap required, opened a new log
I20260709 13:12:10.507089  4685 ts_tablet_manager.cc:1403] T 1c7e5d871d1c44a58c65d3f76bce55b0 P aa0ff974118b465eaa785b8a86057e87: Time spent bootstrapping tablet: real 0.444s	user 0.017s	sys 0.011s
I20260709 13:12:10.507553  5064 consensus_queue.cc:1048] T 98342133e28b47d8a388f9321d5fd796 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:10.513720  4685 raft_consensus.cc:359] T 1c7e5d871d1c44a58c65d3f76bce55b0 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:10.514474  4685 raft_consensus.cc:385] T 1c7e5d871d1c44a58c65d3f76bce55b0 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.514887  4685 raft_consensus.cc:740] T 1c7e5d871d1c44a58c65d3f76bce55b0 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.513778  5046 raft_consensus.cc:493] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.520084  5046 raft_consensus.cc:515] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:10.521665  4683 tablet_bootstrap.cc:654] T 3f696298fcc049c08b47cd54f901be0c P 420a61707e804ce5b3773a91cc2eb424: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.526109  4603 leader_election.cc:304] T 49047cb7a56246288b9044f8ebec130f P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc; no voters: 06ec58698d5444caaecea433c8419770, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:10.538098  4682 tablet_bootstrap.cc:492] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 06ec58698d5444caaecea433c8419770: No bootstrap required, opened a new log
I20260709 13:12:10.528786  4685 consensus_queue.cc:260] T 1c7e5d871d1c44a58c65d3f76bce55b0 P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:10.538786  4682 ts_tablet_manager.cc:1403] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.258s	user 0.021s	sys 0.023s
I20260709 13:12:10.542029  4563 raft_consensus.cc:2468] T 47d66fc2153d419082eccd7e30643d56 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 1.
I20260709 13:12:10.547230  4310 catalog_manager.cc:5697] T be5e478344f14439b78f1a9bf58f4451 P aa0ff974118b465eaa785b8a86057e87 reported cstate change: term changed from 0 to 1, leader changed from <none> to 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3). New cstate: current_term: 1 leader_uuid: "420a61707e804ce5b3773a91cc2eb424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } }
I20260709 13:12:10.552362  4685 ts_tablet_manager.cc:1434] T 1c7e5d871d1c44a58c65d3f76bce55b0 P aa0ff974118b465eaa785b8a86057e87: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.001s
I20260709 13:12:10.552510  4310 catalog_manager.cc:5697] T 3092a6c40d0d4610968fe09d4c7d16c0 P aa0ff974118b465eaa785b8a86057e87 reported cstate change: term changed from 0 to 2, leader changed from <none> to 74758684df5649ccadd1e189eaff32dc (127.28.173.4). New cstate: current_term: 2 leader_uuid: "74758684df5649ccadd1e189eaff32dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } }
I20260709 13:12:10.587386  4685 tablet_bootstrap.cc:492] T 82d5a41b86eb4457a114692137ced092 P aa0ff974118b465eaa785b8a86057e87: Bootstrap starting.
I20260709 13:12:10.588969  4414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d088694ef66442bdbf75cc7fc1942a83" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:10.590261  5102 raft_consensus.cc:2749] T 49047cb7a56246288b9044f8ebec130f P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:10.590996  5098 raft_consensus.cc:493] T d8033bfb7f5d423d90d60318c67df709 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.591521  5098 raft_consensus.cc:515] T d8033bfb7f5d423d90d60318c67df709 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:10.592249  4629 raft_consensus.cc:3060] T d088694ef66442bdbf75cc7fc1942a83 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.593649  5098 leader_election.cc:290] T d8033bfb7f5d423d90d60318c67df709 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:10.594697  4409 raft_consensus.cc:2468] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 1.
I20260709 13:12:10.596158  5045 consensus_queue.cc:1048] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:10.597689  5100 consensus_queue.cc:1048] T 98342133e28b47d8a388f9321d5fd796 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.057s
I20260709 13:12:10.584844  4310 catalog_manager.cc:5697] T 60d704077649426ab65d89dd9ff778d0 P aa0ff974118b465eaa785b8a86057e87 reported cstate change: term changed from 0 to 1, leader changed from <none> to 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3). New cstate: current_term: 1 leader_uuid: "420a61707e804ce5b3773a91cc2eb424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } }
I20260709 13:12:10.617841  4603 leader_election.cc:304] T d088694ef66442bdbf75cc7fc1942a83 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc; no voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424
I20260709 13:12:10.621068  4529 leader_election.cc:304] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:10.629228  4482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8033bfb7f5d423d90d60318c67df709" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:10.652369  5053 leader_election.cc:290] T 541b1e6cfdca4f609467169f4caf64ef P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 election: Requested vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:10.653861  5046 leader_election.cc:290] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:10.654151  4633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541b1e6cfdca4f609467169f4caf64ef" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:10.655337  4681 tablet_bootstrap.cc:492] T e50b6f5a42a24867ab5f90ad6d97401e P 74758684df5649ccadd1e189eaff32dc: No bootstrap required, opened a new log
I20260709 13:12:10.655846  4681 ts_tablet_manager.cc:1403] T e50b6f5a42a24867ab5f90ad6d97401e P 74758684df5649ccadd1e189eaff32dc: Time spent bootstrapping tablet: real 0.278s	user 0.019s	sys 0.025s
I20260709 13:12:10.658357  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541b1e6cfdca4f609467169f4caf64ef" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:10.658931  4563 raft_consensus.cc:3060] T 541b1e6cfdca4f609467169f4caf64ef P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:10.661131  4455 leader_election.cc:343] T 541b1e6cfdca4f609467169f4caf64ef P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.607122  4379 leader_election.cc:304] T 47d66fc2153d419082eccd7e30643d56 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:10.666019  5038 raft_consensus.cc:2804] T 47d66fc2153d419082eccd7e30643d56 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:10.667109  4682 raft_consensus.cc:359] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:10.667650  4682 raft_consensus.cc:385] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.667899  4682 raft_consensus.cc:740] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.671141  4682 consensus_queue.cc:260] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
W20260709 13:12:10.666139  4379 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:33159, user_credentials={real_user=slave}} blocked reactor thread for 79560.6us
I20260709 13:12:10.669785  4681 raft_consensus.cc:359] T e50b6f5a42a24867ab5f90ad6d97401e P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:10.677989  4681 raft_consensus.cc:385] T e50b6f5a42a24867ab5f90ad6d97401e P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.678365  4681 raft_consensus.cc:740] T e50b6f5a42a24867ab5f90ad6d97401e P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.679170  4681 consensus_queue.cc:260] T e50b6f5a42a24867ab5f90ad6d97401e P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
W20260709 13:12:10.687561  4658 debug-util.cc:398] Leaking SignalData structure 0x7b080005c260 after lost signal to thread 29367
W20260709 13:12:10.688674  4658 debug-util.cc:398] Leaking SignalData structure 0x7b0800303d40 after lost signal to thread 4345
I20260709 13:12:10.691731  4682 ts_tablet_manager.cc:1434] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.153s	user 0.007s	sys 0.000s
I20260709 13:12:10.692720  4563 raft_consensus.cc:2468] T 541b1e6cfdca4f609467169f4caf64ef P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 1.
I20260709 13:12:10.695868  4682 tablet_bootstrap.cc:492] T 0dc4f903fb004dd2bce3c4934f078a5d P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:10.670627  5038 raft_consensus.cc:697] T 47d66fc2153d419082eccd7e30643d56 P 06ec58698d5444caaecea433c8419770 [term 1 LEADER]: Becoming Leader. State: Replica: 06ec58698d5444caaecea433c8419770, State: Running, Role: LEADER
W20260709 13:12:10.689924  4658 debug-util.cc:398] Leaking SignalData structure 0x7b08002b3580 after lost signal to thread 4438
I20260709 13:12:10.709380  4681 ts_tablet_manager.cc:1434] T e50b6f5a42a24867ab5f90ad6d97401e P 74758684df5649ccadd1e189eaff32dc: Time spent starting tablet: real 0.053s	user 0.005s	sys 0.001s
I20260709 13:12:10.711236  4636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2ef12cc13544f2960d7c1b8bef6eb7" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:10.712376  5093 raft_consensus.cc:2804] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:10.712873  5093 raft_consensus.cc:697] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [term 1 LEADER]: Becoming Leader. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Running, Role: LEADER
I20260709 13:12:10.713318  4414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2ef12cc13544f2960d7c1b8bef6eb7" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:10.713680  5093 consensus_queue.cc:237] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:10.714190  4414 raft_consensus.cc:2468] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 0.
I20260709 13:12:10.719061  4681 tablet_bootstrap.cc:492] T 541b1e6cfdca4f609467169f4caf64ef P 74758684df5649ccadd1e189eaff32dc: Bootstrap starting.
W20260709 13:12:10.706601  4380 leader_election.cc:343] T d8033bfb7f5d423d90d60318c67df709 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.748394  5057 raft_consensus.cc:493] T 1c7e5d871d1c44a58c65d3f76bce55b0 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:10.772411  4658 debug-util.cc:398] Leaking SignalData structure 0x7b0800054880 after lost signal to thread 4513
I20260709 13:12:10.786262  5038 consensus_queue.cc:237] T 47d66fc2153d419082eccd7e30643d56 P 06ec58698d5444caaecea433c8419770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:10.814936  4682 tablet_bootstrap.cc:654] T 0dc4f903fb004dd2bce3c4934f078a5d P 06ec58698d5444caaecea433c8419770: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.818267  4683 tablet_bootstrap.cc:492] T 3f696298fcc049c08b47cd54f901be0c P 420a61707e804ce5b3773a91cc2eb424: No bootstrap required, opened a new log
I20260709 13:12:10.827524  4683 ts_tablet_manager.cc:1403] T 3f696298fcc049c08b47cd54f901be0c P 420a61707e804ce5b3773a91cc2eb424: Time spent bootstrapping tablet: real 0.328s	user 0.019s	sys 0.022s
I20260709 13:12:10.820796  4685 tablet_bootstrap.cc:654] T 82d5a41b86eb4457a114692137ced092 P aa0ff974118b465eaa785b8a86057e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.727559  4529 leader_election.cc:304] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: 
W20260709 13:12:10.828765  4529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:36439, user_credentials={real_user=slave}} blocked reactor thread for 101348us
I20260709 13:12:10.831547  5046 raft_consensus.cc:2804] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:10.832005  5046 raft_consensus.cc:493] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.832332  5046 raft_consensus.cc:3060] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:10.833487  4658 debug-util.cc:398] Leaking SignalData structure 0x7b08003fc9a0 after lost signal to thread 4587
W20260709 13:12:10.834733  4658 debug-util.cc:398] Leaking SignalData structure 0x7b0800082300 after lost signal to thread 4661
W20260709 13:12:10.835446  4658 debug-util.cc:398] Leaking SignalData structure 0x7b08003cda20 after lost signal to thread 5016
I20260709 13:12:10.841581  4683 raft_consensus.cc:359] T 3f696298fcc049c08b47cd54f901be0c P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:10.843755  4683 raft_consensus.cc:385] T 3f696298fcc049c08b47cd54f901be0c P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.818856  4630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8033bfb7f5d423d90d60318c67df709" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:10.844163  4683 raft_consensus.cc:740] T 3f696298fcc049c08b47cd54f901be0c P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Initialized, Role: FOLLOWER
W20260709 13:12:10.879468  4455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:42711, user_credentials={real_user=slave}} blocked reactor thread for 162122us
W20260709 13:12:10.875718  4529 leader_election.cc:343] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.884507  4683 consensus_queue.cc:260] T 3f696298fcc049c08b47cd54f901be0c P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:10.899134  4683 ts_tablet_manager.cc:1434] T 3f696298fcc049c08b47cd54f901be0c P 420a61707e804ce5b3773a91cc2eb424: Time spent starting tablet: real 0.071s	user 0.007s	sys 0.000s
I20260709 13:12:10.899962  4683 tablet_bootstrap.cc:492] T f1dfa63c8b78419c9ff6ffb624a861a7 P 420a61707e804ce5b3773a91cc2eb424: Bootstrap starting.
I20260709 13:12:10.882445  5046 raft_consensus.cc:515] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:10.904269  4681 tablet_bootstrap.cc:654] T 541b1e6cfdca4f609467169f4caf64ef P 74758684df5649ccadd1e189eaff32dc: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:10.898093  4380 leader_election.cc:343] T d8033bfb7f5d423d90d60318c67df709 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.906273  4380 leader_election.cc:304] T d8033bfb7f5d423d90d60318c67df709 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06ec58698d5444caaecea433c8419770; no voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:10.914611  4630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2ef12cc13544f2960d7c1b8bef6eb7" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:10.910090  4988 raft_consensus.cc:2749] T d8033bfb7f5d423d90d60318c67df709 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:10.843288  5057 raft_consensus.cc:515] T 1c7e5d871d1c44a58c65d3f76bce55b0 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:10.922013  5057 leader_election.cc:290] T 1c7e5d871d1c44a58c65d3f76bce55b0 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:10.931137  4454 leader_election.cc:304] T 541b1e6cfdca4f609467169f4caf64ef P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 74758684df5649ccadd1e189eaff32dc
I20260709 13:12:10.931413  4685 tablet_bootstrap.cc:492] T 82d5a41b86eb4457a114692137ced092 P aa0ff974118b465eaa785b8a86057e87: No bootstrap required, opened a new log
I20260709 13:12:10.933182  4685 ts_tablet_manager.cc:1403] T 82d5a41b86eb4457a114692137ced092 P aa0ff974118b465eaa785b8a86057e87: Time spent bootstrapping tablet: real 0.347s	user 0.014s	sys 0.007s
I20260709 13:12:10.940313  4685 raft_consensus.cc:359] T 82d5a41b86eb4457a114692137ced092 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:10.941000  4685 raft_consensus.cc:385] T 82d5a41b86eb4457a114692137ced092 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.941283  4685 raft_consensus.cc:740] T 82d5a41b86eb4457a114692137ced092 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Initialized, Role: FOLLOWER
W20260709 13:12:10.942091  4380 consensus_peers.cc:597] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770 -> Peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Couldn't send request to peer 74758684df5649ccadd1e189eaff32dc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:10.948572  4685 consensus_queue.cc:260] T 82d5a41b86eb4457a114692137ced092 P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
W20260709 13:12:10.953706  4529 leader_election.cc:343] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.967765  4685 ts_tablet_manager.cc:1434] T 82d5a41b86eb4457a114692137ced092 P aa0ff974118b465eaa785b8a86057e87: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260709 13:12:10.967404  5046 leader_election.cc:290] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 election: Requested vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:10.961781  4410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7e5d871d1c44a58c65d3f76bce55b0" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:10.972044  4410 raft_consensus.cc:2393] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aa0ff974118b465eaa785b8a86057e87 in current term 1: Already voted for candidate 420a61707e804ce5b3773a91cc2eb424 in this term.
I20260709 13:12:10.972856  4683 tablet_bootstrap.cc:654] T f1dfa63c8b78419c9ff6ffb624a861a7 P 420a61707e804ce5b3773a91cc2eb424: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:10.973984  5128 log.cc:927] Time spent T 98342133e28b47d8a388f9321d5fd796 P aa0ff974118b465eaa785b8a86057e87: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:12:10.962688  5129 raft_consensus.cc:2804] T 541b1e6cfdca4f609467169f4caf64ef P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:10.980118  4685 tablet_bootstrap.cc:492] T e50b6f5a42a24867ab5f90ad6d97401e P aa0ff974118b465eaa785b8a86057e87: Bootstrap starting.
I20260709 13:12:10.967191  5056 raft_consensus.cc:2749] T d088694ef66442bdbf75cc7fc1942a83 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:11.000007  5097 consensus_queue.cc:1048] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:10.981317  5129 raft_consensus.cc:697] T 541b1e6cfdca4f609467169f4caf64ef P aa0ff974118b465eaa785b8a86057e87 [term 1 LEADER]: Becoming Leader. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Running, Role: LEADER
W20260709 13:12:11.019088  4603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:45987, user_credentials={real_user=slave}} blocked reactor thread for 62818.6us
I20260709 13:12:11.032811  5129 consensus_queue.cc:237] T 541b1e6cfdca4f609467169f4caf64ef P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:11.038046  4560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7e5d871d1c44a58c65d3f76bce55b0" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:11.050696  4682 tablet_bootstrap.cc:492] T 0dc4f903fb004dd2bce3c4934f078a5d P 06ec58698d5444caaecea433c8419770: No bootstrap required, opened a new log
I20260709 13:12:11.051252  4682 ts_tablet_manager.cc:1403] T 0dc4f903fb004dd2bce3c4934f078a5d P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.358s	user 0.027s	sys 0.014s
I20260709 13:12:11.053872  4685 tablet_bootstrap.cc:654] T e50b6f5a42a24867ab5f90ad6d97401e P aa0ff974118b465eaa785b8a86057e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:11.056088  4682 raft_consensus.cc:359] T 0dc4f903fb004dd2bce3c4934f078a5d P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:11.057443  4682 raft_consensus.cc:385] T 0dc4f903fb004dd2bce3c4934f078a5d P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.057662  4682 raft_consensus.cc:740] T 0dc4f903fb004dd2bce3c4934f078a5d P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.064241  4307 catalog_manager.cc:5697] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06ec58698d5444caaecea433c8419770 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "06ec58698d5444caaecea433c8419770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:11.068691  4682 consensus_queue.cc:260] T 0dc4f903fb004dd2bce3c4934f078a5d P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:11.071513  4682 ts_tablet_manager.cc:1434] T 0dc4f903fb004dd2bce3c4934f078a5d P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:12:11.072433  4682 tablet_bootstrap.cc:492] T 3d38413c5dce44db8a755b48adacc3a8 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:11.078615  4681 tablet_bootstrap.cc:492] T 541b1e6cfdca4f609467169f4caf64ef P 74758684df5649ccadd1e189eaff32dc: No bootstrap required, opened a new log
I20260709 13:12:11.079304  4681 ts_tablet_manager.cc:1403] T 541b1e6cfdca4f609467169f4caf64ef P 74758684df5649ccadd1e189eaff32dc: Time spent bootstrapping tablet: real 0.369s	user 0.008s	sys 0.015s
W20260709 13:12:11.097122  4529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:42711, user_credentials={real_user=slave}} blocked reactor thread for 140557us
I20260709 13:12:11.104061  4682 tablet_bootstrap.cc:654] T 3d38413c5dce44db8a755b48adacc3a8 P 06ec58698d5444caaecea433c8419770: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:11.114740  4454 leader_election.cc:304] T 1c7e5d871d1c44a58c65d3f76bce55b0 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa0ff974118b465eaa785b8a86057e87; no voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424
I20260709 13:12:11.115705  5043 raft_consensus.cc:3060] T 1c7e5d871d1c44a58c65d3f76bce55b0 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:11.117009  4683 tablet_bootstrap.cc:492] T f1dfa63c8b78419c9ff6ffb624a861a7 P 420a61707e804ce5b3773a91cc2eb424: No bootstrap required, opened a new log
I20260709 13:12:11.117645  4683 ts_tablet_manager.cc:1403] T f1dfa63c8b78419c9ff6ffb624a861a7 P 420a61707e804ce5b3773a91cc2eb424: Time spent bootstrapping tablet: real 0.218s	user 0.049s	sys 0.025s
I20260709 13:12:11.129940  4681 raft_consensus.cc:359] T 541b1e6cfdca4f609467169f4caf64ef P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:11.130759  4681 raft_consensus.cc:385] T 541b1e6cfdca4f609467169f4caf64ef P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.131031  4681 raft_consensus.cc:740] T 541b1e6cfdca4f609467169f4caf64ef P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.131655  4681 consensus_queue.cc:260] T 541b1e6cfdca4f609467169f4caf64ef P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:11.148903  5112 raft_consensus.cc:493] T e50b6f5a42a24867ab5f90ad6d97401e P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.149420  5112 raft_consensus.cc:515] T e50b6f5a42a24867ab5f90ad6d97401e P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:11.145277  4683 raft_consensus.cc:359] T f1dfa63c8b78419c9ff6ffb624a861a7 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:11.151531  4683 raft_consensus.cc:385] T f1dfa63c8b78419c9ff6ffb624a861a7 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.151947  4683 raft_consensus.cc:740] T f1dfa63c8b78419c9ff6ffb624a861a7 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.152760  4683 consensus_queue.cc:260] T f1dfa63c8b78419c9ff6ffb624a861a7 P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:11.153393  4681 ts_tablet_manager.cc:1434] T 541b1e6cfdca4f609467169f4caf64ef P 74758684df5649ccadd1e189eaff32dc: Time spent starting tablet: real 0.074s	user 0.007s	sys 0.000s
I20260709 13:12:11.155628  4681 tablet_bootstrap.cc:492] T 812a1b53a40e469c89b5f2aba8c59780 P 74758684df5649ccadd1e189eaff32dc: Bootstrap starting.
I20260709 13:12:11.156831  5041 raft_consensus.cc:493] T 3f696298fcc049c08b47cd54f901be0c P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.172857  4307 catalog_manager.cc:5697] T 47d66fc2153d419082eccd7e30643d56 P 06ec58698d5444caaecea433c8419770 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06ec58698d5444caaecea433c8419770 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "06ec58698d5444caaecea433c8419770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:11.172338  5041 raft_consensus.cc:515] T 3f696298fcc049c08b47cd54f901be0c P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:11.177134  5112 leader_election.cc:290] T e50b6f5a42a24867ab5f90ad6d97401e P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:11.177994  5041 leader_election.cc:290] T 3f696298fcc049c08b47cd54f901be0c P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:11.180850  4414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2ef12cc13544f2960d7c1b8bef6eb7" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770"
I20260709 13:12:11.181506  4414 raft_consensus.cc:3060] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:11.183247  4487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e50b6f5a42a24867ab5f90ad6d97401e" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
W20260709 13:12:11.186066  4603 leader_election.cc:343] T e50b6f5a42a24867ab5f90ad6d97401e P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.188036  4410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f696298fcc049c08b47cd54f901be0c" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:11.185186  5043 raft_consensus.cc:2749] T 1c7e5d871d1c44a58c65d3f76bce55b0 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:11.191083  4629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f696298fcc049c08b47cd54f901be0c" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:11.191741  4683 ts_tablet_manager.cc:1434] T f1dfa63c8b78419c9ff6ffb624a861a7 P 420a61707e804ce5b3773a91cc2eb424: Time spent starting tablet: real 0.074s	user 0.007s	sys 0.001s
I20260709 13:12:11.194439  4683 tablet_bootstrap.cc:492] T 3d38413c5dce44db8a755b48adacc3a8 P 420a61707e804ce5b3773a91cc2eb424: Bootstrap starting.
W20260709 13:12:11.197635  4529 leader_election.cc:343] T 3f696298fcc049c08b47cd54f901be0c P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:11.199795  4529 leader_election.cc:343] T 3f696298fcc049c08b47cd54f901be0c P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.201999  4529 leader_election.cc:304] T 3f696298fcc049c08b47cd54f901be0c P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424; no voters: 06ec58698d5444caaecea433c8419770, 74758684df5649ccadd1e189eaff32dc
I20260709 13:12:11.203697  5096 raft_consensus.cc:2749] T 3f696298fcc049c08b47cd54f901be0c P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:11.205964  5043 raft_consensus.cc:493] T 82d5a41b86eb4457a114692137ced092 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.206470  5043 raft_consensus.cc:515] T 82d5a41b86eb4457a114692137ced092 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:11.208444  5043 leader_election.cc:290] T 82d5a41b86eb4457a114692137ced092 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:11.211114  4409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e50b6f5a42a24867ab5f90ad6d97401e" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:11.211772  4409 raft_consensus.cc:2468] T e50b6f5a42a24867ab5f90ad6d97401e P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 0.
I20260709 13:12:11.212857  4603 leader_election.cc:304] T e50b6f5a42a24867ab5f90ad6d97401e P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 74758684df5649ccadd1e189eaff32dc; no voters: aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:11.213827  5056 raft_consensus.cc:2804] T e50b6f5a42a24867ab5f90ad6d97401e P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:11.214176  5056 raft_consensus.cc:493] T e50b6f5a42a24867ab5f90ad6d97401e P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:11.214499  5056 raft_consensus.cc:3060] T e50b6f5a42a24867ab5f90ad6d97401e P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:11.220256  4683 tablet_bootstrap.cc:654] T 3d38413c5dce44db8a755b48adacc3a8 P 420a61707e804ce5b3773a91cc2eb424: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:11.222365  4633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d5a41b86eb4457a114692137ced092" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
W20260709 13:12:11.228499  4455 leader_election.cc:343] T 82d5a41b86eb4457a114692137ced092 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.228420  4308 catalog_manager.cc:5697] T 541b1e6cfdca4f609467169f4caf64ef P aa0ff974118b465eaa785b8a86057e87 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa0ff974118b465eaa785b8a86057e87 (127.28.173.2). New cstate: current_term: 1 leader_uuid: "aa0ff974118b465eaa785b8a86057e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:11.233783  4685 tablet_bootstrap.cc:492] T e50b6f5a42a24867ab5f90ad6d97401e P aa0ff974118b465eaa785b8a86057e87: No bootstrap required, opened a new log
I20260709 13:12:11.234275  4685 ts_tablet_manager.cc:1403] T e50b6f5a42a24867ab5f90ad6d97401e P aa0ff974118b465eaa785b8a86057e87: Time spent bootstrapping tablet: real 0.258s	user 0.014s	sys 0.030s
I20260709 13:12:11.237496  4685 raft_consensus.cc:359] T e50b6f5a42a24867ab5f90ad6d97401e P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:11.238401  4685 raft_consensus.cc:385] T e50b6f5a42a24867ab5f90ad6d97401e P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.238685  4685 raft_consensus.cc:740] T e50b6f5a42a24867ab5f90ad6d97401e P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.239332  4685 consensus_queue.cc:260] T e50b6f5a42a24867ab5f90ad6d97401e P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:11.241139  5096 consensus_queue.cc:1048] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:11.241639  4685 ts_tablet_manager.cc:1434] T e50b6f5a42a24867ab5f90ad6d97401e P aa0ff974118b465eaa785b8a86057e87: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:11.242588  4685 tablet_bootstrap.cc:492] T 47d66fc2153d419082eccd7e30643d56 P aa0ff974118b465eaa785b8a86057e87: Bootstrap starting.
I20260709 13:12:11.227505  5056 raft_consensus.cc:515] T e50b6f5a42a24867ab5f90ad6d97401e P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
W20260709 13:12:11.244769  4380 consensus_peers.cc:597] T 47d66fc2153d419082eccd7e30643d56 P 06ec58698d5444caaecea433c8419770 -> Peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Couldn't send request to peer aa0ff974118b465eaa785b8a86057e87. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:11.259076  5056 leader_election.cc:290] T e50b6f5a42a24867ab5f90ad6d97401e P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 election: Requested vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:11.259706  4413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e50b6f5a42a24867ab5f90ad6d97401e" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770"
I20260709 13:12:11.260008  4487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e50b6f5a42a24867ab5f90ad6d97401e" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:11.260386  4413 raft_consensus.cc:3060] T e50b6f5a42a24867ab5f90ad6d97401e P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:11.260558  4487 raft_consensus.cc:3060] T e50b6f5a42a24867ab5f90ad6d97401e P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:11.267153  4413 raft_consensus.cc:2468] T e50b6f5a42a24867ab5f90ad6d97401e P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 1.
W20260709 13:12:11.267513  5144 log.cc:927] Time spent T 541b1e6cfdca4f609467169f4caf64ef P aa0ff974118b465eaa785b8a86057e87: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:12:11.268122  4560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d5a41b86eb4457a114692137ced092" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:11.268772  4560 raft_consensus.cc:2468] T 82d5a41b86eb4457a114692137ced092 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 0.
I20260709 13:12:11.269220  4603 leader_election.cc:304] T e50b6f5a42a24867ab5f90ad6d97401e P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 74758684df5649ccadd1e189eaff32dc; no voters: 
I20260709 13:12:11.269625  4414 raft_consensus.cc:2468] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 1.
I20260709 13:12:11.270131  5101 raft_consensus.cc:2804] T e50b6f5a42a24867ab5f90ad6d97401e P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:11.270637  5101 raft_consensus.cc:697] T e50b6f5a42a24867ab5f90ad6d97401e P 74758684df5649ccadd1e189eaff32dc [term 1 LEADER]: Becoming Leader. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Running, Role: LEADER
I20260709 13:12:11.267158  4487 raft_consensus.cc:2468] T e50b6f5a42a24867ab5f90ad6d97401e P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 1.
I20260709 13:12:11.273778  4529 leader_election.cc:304] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: 74758684df5649ccadd1e189eaff32dc
I20260709 13:12:11.299068  4681 tablet_bootstrap.cc:654] T 812a1b53a40e469c89b5f2aba8c59780 P 74758684df5649ccadd1e189eaff32dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:11.310141  4311 catalog_manager.cc:5697] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 reported cstate change: term changed from 0 to 1, leader changed from <none> to 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3). New cstate: current_term: 1 leader_uuid: "420a61707e804ce5b3773a91cc2eb424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:11.271476  5101 consensus_queue.cc:237] T e50b6f5a42a24867ab5f90ad6d97401e P 74758684df5649ccadd1e189eaff32dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:11.281104  5143 raft_consensus.cc:2804] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:11.321666  5143 raft_consensus.cc:697] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 420a61707e804ce5b3773a91cc2eb424 [term 1 LEADER]: Becoming Leader. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Running, Role: LEADER
I20260709 13:12:11.328495  4685 tablet_bootstrap.cc:654] T 47d66fc2153d419082eccd7e30643d56 P aa0ff974118b465eaa785b8a86057e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:11.322867  5143 consensus_queue.cc:237] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:11.347241  4683 tablet_bootstrap.cc:492] T 3d38413c5dce44db8a755b48adacc3a8 P 420a61707e804ce5b3773a91cc2eb424: No bootstrap required, opened a new log
I20260709 13:12:11.347762  4683 ts_tablet_manager.cc:1403] T 3d38413c5dce44db8a755b48adacc3a8 P 420a61707e804ce5b3773a91cc2eb424: Time spent bootstrapping tablet: real 0.154s	user 0.016s	sys 0.020s
I20260709 13:12:11.341003  4454 leader_election.cc:304] T 82d5a41b86eb4457a114692137ced092 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 74758684df5649ccadd1e189eaff32dc
W20260709 13:12:11.386684  4454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.3:33159, user_credentials={real_user=slave}} blocked reactor thread for 58243.6us
I20260709 13:12:11.387737  5057 raft_consensus.cc:2804] T 82d5a41b86eb4457a114692137ced092 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:11.388162  5057 raft_consensus.cc:493] T 82d5a41b86eb4457a114692137ced092 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:11.388506  5057 raft_consensus.cc:3060] T 82d5a41b86eb4457a114692137ced092 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:11.379508  5106 raft_consensus.cc:493] T 541b1e6cfdca4f609467169f4caf64ef P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.432883  5141 consensus_queue.cc:1048] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:12:11.437503  5093 raft_consensus.cc:493] T f1dfa63c8b78419c9ff6ffb624a861a7 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.452961  4683 raft_consensus.cc:359] T 3d38413c5dce44db8a755b48adacc3a8 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:11.454466  4683 raft_consensus.cc:385] T 3d38413c5dce44db8a755b48adacc3a8 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.454756  4683 raft_consensus.cc:740] T 3d38413c5dce44db8a755b48adacc3a8 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.454190  4307 catalog_manager.cc:5697] T e50b6f5a42a24867ab5f90ad6d97401e P 74758684df5649ccadd1e189eaff32dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 74758684df5649ccadd1e189eaff32dc (127.28.173.4). New cstate: current_term: 1 leader_uuid: "74758684df5649ccadd1e189eaff32dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:11.455403  4358 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:11.455476  4683 consensus_queue.cc:260] T 3d38413c5dce44db8a755b48adacc3a8 P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:11.457764  4683 ts_tablet_manager.cc:1434] T 3d38413c5dce44db8a755b48adacc3a8 P 420a61707e804ce5b3773a91cc2eb424: Time spent starting tablet: real 0.110s	user 0.016s	sys 0.018s
I20260709 13:12:11.462929  5057 raft_consensus.cc:515] T 82d5a41b86eb4457a114692137ced092 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:11.465494  5057 leader_election.cc:290] T 82d5a41b86eb4457a114692137ced092 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 election: Requested vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:11.469621  4681 tablet_bootstrap.cc:492] T 812a1b53a40e469c89b5f2aba8c59780 P 74758684df5649ccadd1e189eaff32dc: No bootstrap required, opened a new log
I20260709 13:12:11.470148  4681 ts_tablet_manager.cc:1403] T 812a1b53a40e469c89b5f2aba8c59780 P 74758684df5649ccadd1e189eaff32dc: Time spent bootstrapping tablet: real 0.315s	user 0.020s	sys 0.018s
I20260709 13:12:11.460472  5093 raft_consensus.cc:515] T f1dfa63c8b78419c9ff6ffb624a861a7 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:11.429646  5106 raft_consensus.cc:515] T 541b1e6cfdca4f609467169f4caf64ef P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:11.484046  5106 leader_election.cc:290] T 541b1e6cfdca4f609467169f4caf64ef P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:11.484854  4555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d5a41b86eb4457a114692137ced092" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:11.485219  4488 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541b1e6cfdca4f609467169f4caf64ef" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:11.485505  4555 raft_consensus.cc:3060] T 82d5a41b86eb4457a114692137ced092 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:11.494402  4682 tablet_bootstrap.cc:492] T 3d38413c5dce44db8a755b48adacc3a8 P 06ec58698d5444caaecea433c8419770: No bootstrap required, opened a new log
I20260709 13:12:11.494946  4682 ts_tablet_manager.cc:1403] T 3d38413c5dce44db8a755b48adacc3a8 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.423s	user 0.019s	sys 0.012s
I20260709 13:12:11.494117  4555 raft_consensus.cc:2468] T 82d5a41b86eb4457a114692137ced092 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 1.
I20260709 13:12:11.502841  4560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541b1e6cfdca4f609467169f4caf64ef" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:11.503993  4560 raft_consensus.cc:2393] T 541b1e6cfdca4f609467169f4caf64ef P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74758684df5649ccadd1e189eaff32dc in current term 1: Already voted for candidate aa0ff974118b465eaa785b8a86057e87 in this term.
I20260709 13:12:11.504153  5093 leader_election.cc:290] T f1dfa63c8b78419c9ff6ffb624a861a7 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:11.505893  4602 leader_election.cc:304] T 541b1e6cfdca4f609467169f4caf64ef P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc; no voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:11.508735  4631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1dfa63c8b78419c9ff6ffb624a861a7" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:11.507740  5056 raft_consensus.cc:3060] T 541b1e6cfdca4f609467169f4caf64ef P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:11.519038  4685 tablet_bootstrap.cc:492] T 47d66fc2153d419082eccd7e30643d56 P aa0ff974118b465eaa785b8a86057e87: No bootstrap required, opened a new log
I20260709 13:12:11.519709  4685 ts_tablet_manager.cc:1403] T 47d66fc2153d419082eccd7e30643d56 P aa0ff974118b465eaa785b8a86057e87: Time spent bootstrapping tablet: real 0.277s	user 0.016s	sys 0.006s
I20260709 13:12:11.525362  4681 raft_consensus.cc:359] T 812a1b53a40e469c89b5f2aba8c59780 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:11.525918  4681 raft_consensus.cc:385] T 812a1b53a40e469c89b5f2aba8c59780 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.526134  4681 raft_consensus.cc:740] T 812a1b53a40e469c89b5f2aba8c59780 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.526626  4681 consensus_queue.cc:260] T 812a1b53a40e469c89b5f2aba8c59780 P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:11.532899  5056 raft_consensus.cc:2749] T 541b1e6cfdca4f609467169f4caf64ef P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:12:11.511740  4529 leader_election.cc:343] T f1dfa63c8b78419c9ff6ffb624a861a7 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:11.611572  4529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.4:42711, user_credentials={real_user=slave}} blocked reactor thread for 99728.8us
I20260709 13:12:11.614219  4482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1dfa63c8b78419c9ff6ffb624a861a7" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:11.621708  4681 ts_tablet_manager.cc:1434] T 812a1b53a40e469c89b5f2aba8c59780 P 74758684df5649ccadd1e189eaff32dc: Time spent starting tablet: real 0.151s	user 0.006s	sys 0.001s
I20260709 13:12:11.621120  4682 raft_consensus.cc:359] T 3d38413c5dce44db8a755b48adacc3a8 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:11.622771  4682 raft_consensus.cc:385] T 3d38413c5dce44db8a755b48adacc3a8 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.623194  4682 raft_consensus.cc:740] T 3d38413c5dce44db8a755b48adacc3a8 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.624452  4682 consensus_queue.cc:260] T 3d38413c5dce44db8a755b48adacc3a8 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:11.665886  4685 raft_consensus.cc:359] T 47d66fc2153d419082eccd7e30643d56 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:11.666920  4685 raft_consensus.cc:385] T 47d66fc2153d419082eccd7e30643d56 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.667230  4685 raft_consensus.cc:740] T 47d66fc2153d419082eccd7e30643d56 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.678925  4685 consensus_queue.cc:260] T 47d66fc2153d419082eccd7e30643d56 P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:11.682515  5143 raft_consensus.cc:493] T 3d38413c5dce44db8a755b48adacc3a8 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.683526  4891 raft_consensus.cc:493] T 0dc4f903fb004dd2bce3c4934f078a5d P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.683310  5143 raft_consensus.cc:515] T 3d38413c5dce44db8a755b48adacc3a8 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:11.684295  4891 raft_consensus.cc:515] T 0dc4f903fb004dd2bce3c4934f078a5d P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:11.686137  5143 leader_election.cc:290] T 3d38413c5dce44db8a755b48adacc3a8 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:11.686726  4891 leader_election.cc:290] T 0dc4f903fb004dd2bce3c4934f078a5d P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
W20260709 13:12:11.690431  4529 leader_election.cc:343] T f1dfa63c8b78419c9ff6ffb624a861a7 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.703948  4681 tablet_bootstrap.cc:492] T 82d5a41b86eb4457a114692137ced092 P 74758684df5649ccadd1e189eaff32dc: Bootstrap starting.
I20260709 13:12:11.708616  4633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d5a41b86eb4457a114692137ced092" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:11.710618  4454 leader_election.cc:304] T 82d5a41b86eb4457a114692137ced092 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:11.711011  4529 leader_election.cc:304] T f1dfa63c8b78419c9ff6ffb624a861a7 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424; no voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:11.724814  4486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc4f903fb004dd2bce3c4934f078a5d" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:11.731148  5093 raft_consensus.cc:2749] T f1dfa63c8b78419c9ff6ffb624a861a7 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:11.732342  5161 raft_consensus.cc:2804] T 82d5a41b86eb4457a114692137ced092 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:11.740438  4682 ts_tablet_manager.cc:1434] T 3d38413c5dce44db8a755b48adacc3a8 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.245s	user 0.034s	sys 0.029s
I20260709 13:12:11.740522  4482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d38413c5dce44db8a755b48adacc3a8" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:11.735276  5161 raft_consensus.cc:697] T 82d5a41b86eb4457a114692137ced092 P aa0ff974118b465eaa785b8a86057e87 [term 1 LEADER]: Becoming Leader. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Running, Role: LEADER
I20260709 13:12:11.742504  4633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc4f903fb004dd2bce3c4934f078a5d" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:11.748939  5161 consensus_queue.cc:237] T 82d5a41b86eb4457a114692137ced092 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
W20260709 13:12:11.746032  4455 leader_election.cc:343] T 82d5a41b86eb4457a114692137ced092 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.749809  4682 tablet_bootstrap.cc:492] T 3f696298fcc049c08b47cd54f901be0c P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
W20260709 13:12:11.757467  4380 leader_election.cc:343] T 0dc4f903fb004dd2bce3c4934f078a5d P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.760640  4685 ts_tablet_manager.cc:1434] T 47d66fc2153d419082eccd7e30643d56 P aa0ff974118b465eaa785b8a86057e87: Time spent starting tablet: real 0.241s	user 0.007s	sys 0.002s
I20260709 13:12:11.762485  4685 tablet_bootstrap.cc:492] T d8033bfb7f5d423d90d60318c67df709 P aa0ff974118b465eaa785b8a86057e87: Bootstrap starting.
W20260709 13:12:11.772444  4529 leader_election.cc:343] T 3d38413c5dce44db8a755b48adacc3a8 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.773500  5129 consensus_queue.cc:1048] T 541b1e6cfdca4f609467169f4caf64ef P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:11.783203  5159 raft_consensus.cc:493] T 47d66fc2153d419082eccd7e30643d56 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.783869  5159 raft_consensus.cc:515] T 47d66fc2153d419082eccd7e30643d56 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:11.788374  4682 tablet_bootstrap.cc:654] T 3f696298fcc049c08b47cd54f901be0c P 06ec58698d5444caaecea433c8419770: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:11.791610  4982 consensus_queue.cc:1048] T 47d66fc2153d419082eccd7e30643d56 P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:11.793220  4558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d66fc2153d419082eccd7e30643d56" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:11.794251  4558 raft_consensus.cc:2393] T 47d66fc2153d419082eccd7e30643d56 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aa0ff974118b465eaa785b8a86057e87 in current term 1: Already voted for candidate 06ec58698d5444caaecea433c8419770 in this term.
I20260709 13:12:11.797923  4413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d38413c5dce44db8a755b48adacc3a8" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:11.798650  4413 raft_consensus.cc:2468] T 3d38413c5dce44db8a755b48adacc3a8 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 0.
I20260709 13:12:11.806367  4634 raft_consensus.cc:3060] T 812a1b53a40e469c89b5f2aba8c59780 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:11.810755  5159 leader_election.cc:290] T 47d66fc2153d419082eccd7e30643d56 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:11.837698  5129 consensus_queue.cc:1048] T 541b1e6cfdca4f609467169f4caf64ef P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:12:11.845373  4307 catalog_manager.cc:5697] T 82d5a41b86eb4457a114692137ced092 P aa0ff974118b465eaa785b8a86057e87 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa0ff974118b465eaa785b8a86057e87 (127.28.173.2). New cstate: current_term: 1 leader_uuid: "aa0ff974118b465eaa785b8a86057e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:11.875691  4681 tablet_bootstrap.cc:654] T 82d5a41b86eb4457a114692137ced092 P 74758684df5649ccadd1e189eaff32dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:11.881538  5102 consensus_queue.cc:1048] T e50b6f5a42a24867ab5f90ad6d97401e P 74758684df5649ccadd1e189eaff32dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:11.882035  4682 tablet_bootstrap.cc:492] T 3f696298fcc049c08b47cd54f901be0c P 06ec58698d5444caaecea433c8419770: No bootstrap required, opened a new log
I20260709 13:12:11.882629  4682 ts_tablet_manager.cc:1403] T 3f696298fcc049c08b47cd54f901be0c P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.133s	user 0.014s	sys 0.006s
I20260709 13:12:11.882994  4529 leader_election.cc:304] T 3d38413c5dce44db8a755b48adacc3a8 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:11.897178  5041 raft_consensus.cc:2804] T 3d38413c5dce44db8a755b48adacc3a8 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:11.897795  5041 raft_consensus.cc:493] T 3d38413c5dce44db8a755b48adacc3a8 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:11.898250  5041 raft_consensus.cc:3060] T 3d38413c5dce44db8a755b48adacc3a8 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:11.907347  4685 tablet_bootstrap.cc:654] T d8033bfb7f5d423d90d60318c67df709 P aa0ff974118b465eaa785b8a86057e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:11.910513  4411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d66fc2153d419082eccd7e30643d56" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
W20260709 13:12:11.912081  4380 leader_election.cc:343] T 0dc4f903fb004dd2bce3c4934f078a5d P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.912091  4682 raft_consensus.cc:359] T 3f696298fcc049c08b47cd54f901be0c P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:11.915408  4682 raft_consensus.cc:385] T 3f696298fcc049c08b47cd54f901be0c P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.915699  4682 raft_consensus.cc:740] T 3f696298fcc049c08b47cd54f901be0c P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.916574  4682 consensus_queue.cc:260] T 3f696298fcc049c08b47cd54f901be0c P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:11.918431  4682 ts_tablet_manager.cc:1434] T 3f696298fcc049c08b47cd54f901be0c P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:12:11.912525  4380 leader_election.cc:304] T 0dc4f903fb004dd2bce3c4934f078a5d P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06ec58698d5444caaecea433c8419770; no voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:11.929116  5056 consensus_queue.cc:1048] T e50b6f5a42a24867ab5f90ad6d97401e P 74758684df5649ccadd1e189eaff32dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:12:11.933231  4982 raft_consensus.cc:2749] T 0dc4f903fb004dd2bce3c4934f078a5d P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:11.937976  4486 raft_consensus.cc:3060] T 47d66fc2153d419082eccd7e30643d56 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:11.940119  4529 consensus_peers.cc:597] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 420a61707e804ce5b3773a91cc2eb424 -> Peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Couldn't send request to peer 74758684df5649ccadd1e189eaff32dc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:11.969121  4455 leader_election.cc:304] T 47d66fc2153d419082eccd7e30643d56 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa0ff974118b465eaa785b8a86057e87; no voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424
I20260709 13:12:12.025305  4307 catalog_manager.cc:5697] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 420a61707e804ce5b3773a91cc2eb424 reported cstate change: term changed from 0 to 1, leader changed from <none> to 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3). New cstate: current_term: 1 leader_uuid: "420a61707e804ce5b3773a91cc2eb424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:12.055352  4685 tablet_bootstrap.cc:492] T d8033bfb7f5d423d90d60318c67df709 P aa0ff974118b465eaa785b8a86057e87: No bootstrap required, opened a new log
I20260709 13:12:12.055905  4685 ts_tablet_manager.cc:1403] T d8033bfb7f5d423d90d60318c67df709 P aa0ff974118b465eaa785b8a86057e87: Time spent bootstrapping tablet: real 0.294s	user 0.007s	sys 0.019s
I20260709 13:12:12.076802  4685 raft_consensus.cc:359] T d8033bfb7f5d423d90d60318c67df709 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:12.077558  4685 raft_consensus.cc:385] T d8033bfb7f5d423d90d60318c67df709 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:12.077836  4685 raft_consensus.cc:740] T d8033bfb7f5d423d90d60318c67df709 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Initialized, Role: FOLLOWER
I20260709 13:12:12.078528  4685 consensus_queue.cc:260] T d8033bfb7f5d423d90d60318c67df709 P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:12.082576  4685 ts_tablet_manager.cc:1434] T d8033bfb7f5d423d90d60318c67df709 P aa0ff974118b465eaa785b8a86057e87: Time spent starting tablet: real 0.026s	user 0.003s	sys 0.003s
I20260709 13:12:12.083726  4685 tablet_bootstrap.cc:492] T f1dfa63c8b78419c9ff6ffb624a861a7 P aa0ff974118b465eaa785b8a86057e87: Bootstrap starting.
I20260709 13:12:12.067376  5041 raft_consensus.cc:515] T 3d38413c5dce44db8a755b48adacc3a8 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:12.087935  5041 leader_election.cc:290] T 3d38413c5dce44db8a755b48adacc3a8 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 election: Requested vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:12.091929  4482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d38413c5dce44db8a755b48adacc3a8" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:12.097543  4685 tablet_bootstrap.cc:654] T f1dfa63c8b78419c9ff6ffb624a861a7 P aa0ff974118b465eaa785b8a86057e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:12.102439  5096 consensus_queue.cc:1048] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:12.109207  4681 tablet_bootstrap.cc:492] T 82d5a41b86eb4457a114692137ced092 P 74758684df5649ccadd1e189eaff32dc: No bootstrap required, opened a new log
I20260709 13:12:12.109788  4681 ts_tablet_manager.cc:1403] T 82d5a41b86eb4457a114692137ced092 P 74758684df5649ccadd1e189eaff32dc: Time spent bootstrapping tablet: real 0.406s	user 0.022s	sys 0.018s
W20260709 13:12:12.111331  4529 leader_election.cc:343] T 3d38413c5dce44db8a755b48adacc3a8 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:12.118017  4982 raft_consensus.cc:493] T 3f696298fcc049c08b47cd54f901be0c P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.118516  4982 raft_consensus.cc:515] T 3f696298fcc049c08b47cd54f901be0c P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:12.120777  4982 leader_election.cc:290] T 3f696298fcc049c08b47cd54f901be0c P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:12.120556  4681 raft_consensus.cc:359] T 82d5a41b86eb4457a114692137ced092 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:12.121300  4681 raft_consensus.cc:385] T 82d5a41b86eb4457a114692137ced092 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:12.121584  4556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f696298fcc049c08b47cd54f901be0c" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:12.122397  4556 raft_consensus.cc:2468] T 3f696298fcc049c08b47cd54f901be0c P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 0.
I20260709 13:12:12.123766  4379 leader_election.cc:304] T 3f696298fcc049c08b47cd54f901be0c P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: 
I20260709 13:12:12.121635  4681 raft_consensus.cc:740] T 82d5a41b86eb4457a114692137ced092 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Initialized, Role: FOLLOWER
I20260709 13:12:12.126350  4681 consensus_queue.cc:260] T 82d5a41b86eb4457a114692137ced092 P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:12.124953  4982 raft_consensus.cc:2804] T 3f696298fcc049c08b47cd54f901be0c P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:12.128255  4982 raft_consensus.cc:493] T 3f696298fcc049c08b47cd54f901be0c P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:12.128654  4982 raft_consensus.cc:3060] T 3f696298fcc049c08b47cd54f901be0c P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:12.130271  5171 log.cc:927] Time spent T 812a1b53a40e469c89b5f2aba8c59780 P 74758684df5649ccadd1e189eaff32dc: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:12:12.151919  5043 raft_consensus.cc:2749] T 47d66fc2153d419082eccd7e30643d56 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:12.152725  4412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d38413c5dce44db8a755b48adacc3a8" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770"
I20260709 13:12:12.153697  4412 raft_consensus.cc:3060] T 3d38413c5dce44db8a755b48adacc3a8 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.165526  4412 raft_consensus.cc:2468] T 3d38413c5dce44db8a755b48adacc3a8 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 1.
I20260709 13:12:12.173540  4633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f696298fcc049c08b47cd54f901be0c" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:12.182760  5112 raft_consensus.cc:493] T 82d5a41b86eb4457a114692137ced092 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.183259  5112 raft_consensus.cc:515] T 82d5a41b86eb4457a114692137ced092 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:12.185156  4681 ts_tablet_manager.cc:1434] T 82d5a41b86eb4457a114692137ced092 P 74758684df5649ccadd1e189eaff32dc: Time spent starting tablet: real 0.075s	user 0.006s	sys 0.001s
I20260709 13:12:12.190258  5112 leader_election.cc:290] T 82d5a41b86eb4457a114692137ced092 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:12.198261  4556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d5a41b86eb4457a114692137ced092" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:12.199195  4556 raft_consensus.cc:2393] T 82d5a41b86eb4457a114692137ced092 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74758684df5649ccadd1e189eaff32dc in current term 1: Already voted for candidate aa0ff974118b465eaa785b8a86057e87 in this term.
W20260709 13:12:12.205421  4380 leader_election.cc:343] T 3f696298fcc049c08b47cd54f901be0c P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:12.209270  4529 leader_election.cc:304] T 3d38413c5dce44db8a755b48adacc3a8 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:12.219352  4681 tablet_bootstrap.cc:492] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 74758684df5649ccadd1e189eaff32dc: Bootstrap starting.
I20260709 13:12:12.220412  5045 raft_consensus.cc:2804] T 3d38413c5dce44db8a755b48adacc3a8 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:12.221462  5045 raft_consensus.cc:697] T 3d38413c5dce44db8a755b48adacc3a8 P 420a61707e804ce5b3773a91cc2eb424 [term 1 LEADER]: Becoming Leader. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Running, Role: LEADER
I20260709 13:12:12.223651  4685 tablet_bootstrap.cc:492] T f1dfa63c8b78419c9ff6ffb624a861a7 P aa0ff974118b465eaa785b8a86057e87: No bootstrap required, opened a new log
I20260709 13:12:12.224150  4685 ts_tablet_manager.cc:1403] T f1dfa63c8b78419c9ff6ffb624a861a7 P aa0ff974118b465eaa785b8a86057e87: Time spent bootstrapping tablet: real 0.141s	user 0.017s	sys 0.025s
I20260709 13:12:12.222504  5045 consensus_queue.cc:237] T 3d38413c5dce44db8a755b48adacc3a8 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:12.240594  4636 raft_consensus.cc:3060] T 82d5a41b86eb4457a114692137ced092 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.251560  5043 consensus_queue.cc:1048] T 82d5a41b86eb4457a114692137ced092 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:12.256088  4685 raft_consensus.cc:359] T f1dfa63c8b78419c9ff6ffb624a861a7 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:12.256794  4685 raft_consensus.cc:385] T f1dfa63c8b78419c9ff6ffb624a861a7 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:12.259833  4681 tablet_bootstrap.cc:654] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 74758684df5649ccadd1e189eaff32dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:12.257066  4685 raft_consensus.cc:740] T f1dfa63c8b78419c9ff6ffb624a861a7 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Initialized, Role: FOLLOWER
I20260709 13:12:12.272426  4685 consensus_queue.cc:260] T f1dfa63c8b78419c9ff6ffb624a861a7 P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:12.277948  4685 ts_tablet_manager.cc:1434] T f1dfa63c8b78419c9ff6ffb624a861a7 P aa0ff974118b465eaa785b8a86057e87: Time spent starting tablet: real 0.054s	user 0.002s	sys 0.005s
I20260709 13:12:12.272372  4982 raft_consensus.cc:515] T 3f696298fcc049c08b47cd54f901be0c P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:12.281996  5043 raft_consensus.cc:493] T d8033bfb7f5d423d90d60318c67df709 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.282519  5043 raft_consensus.cc:515] T d8033bfb7f5d423d90d60318c67df709 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:12.284487  5043 leader_election.cc:290] T d8033bfb7f5d423d90d60318c67df709 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:12.285017  5043 consensus_queue.cc:1048] T 82d5a41b86eb4457a114692137ced092 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:12.285943  4482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d5a41b86eb4457a114692137ced092" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:12.287602  4603 leader_election.cc:304] T 82d5a41b86eb4457a114692137ced092 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc; no voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:12.291236  5106 raft_consensus.cc:2749] T 82d5a41b86eb4457a114692137ced092 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:12.299278  4556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f696298fcc049c08b47cd54f901be0c" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:12.299877  4556 raft_consensus.cc:3060] T 3f696298fcc049c08b47cd54f901be0c P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.304276  4685 tablet_bootstrap.cc:492] T 3d38413c5dce44db8a755b48adacc3a8 P aa0ff974118b465eaa785b8a86057e87: Bootstrap starting.
I20260709 13:12:12.305888  4413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8033bfb7f5d423d90d60318c67df709" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:12.309239  4413 raft_consensus.cc:2468] T d8033bfb7f5d423d90d60318c67df709 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 0.
I20260709 13:12:12.309346  4633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8033bfb7f5d423d90d60318c67df709" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
W20260709 13:12:12.310945  4455 leader_election.cc:343] T d8033bfb7f5d423d90d60318c67df709 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:12.319185  4633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f696298fcc049c08b47cd54f901be0c" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:12.325923  4982 leader_election.cc:290] T 3f696298fcc049c08b47cd54f901be0c P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Requested vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
W20260709 13:12:12.328425  4380 leader_election.cc:343] T 3f696298fcc049c08b47cd54f901be0c P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:12.329371  4310 catalog_manager.cc:5697] T 3d38413c5dce44db8a755b48adacc3a8 P 420a61707e804ce5b3773a91cc2eb424 reported cstate change: term changed from 0 to 1, leader changed from <none> to 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3). New cstate: current_term: 1 leader_uuid: "420a61707e804ce5b3773a91cc2eb424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:12.331447  4556 raft_consensus.cc:2468] T 3f696298fcc049c08b47cd54f901be0c P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 1.
I20260709 13:12:12.331913  4681 tablet_bootstrap.cc:492] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 74758684df5649ccadd1e189eaff32dc: No bootstrap required, opened a new log
I20260709 13:12:12.332461  4681 ts_tablet_manager.cc:1403] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 74758684df5649ccadd1e189eaff32dc: Time spent bootstrapping tablet: real 0.122s	user 0.014s	sys 0.000s
I20260709 13:12:12.332747  4379 leader_election.cc:304] T 3f696298fcc049c08b47cd54f901be0c P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: 74758684df5649ccadd1e189eaff32dc
I20260709 13:12:12.333801  4982 raft_consensus.cc:2804] T 3f696298fcc049c08b47cd54f901be0c P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:12.334431  4982 raft_consensus.cc:697] T 3f696298fcc049c08b47cd54f901be0c P 06ec58698d5444caaecea433c8419770 [term 1 LEADER]: Becoming Leader. State: Replica: 06ec58698d5444caaecea433c8419770, State: Running, Role: LEADER
I20260709 13:12:12.335536  4681 raft_consensus.cc:359] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:12.336208  4681 raft_consensus.cc:385] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:12.336449  4681 raft_consensus.cc:740] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Initialized, Role: FOLLOWER
I20260709 13:12:12.336515  4982 consensus_queue.cc:237] T 3f696298fcc049c08b47cd54f901be0c P 06ec58698d5444caaecea433c8419770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:12.337317  4681 consensus_queue.cc:260] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:12.341219  4681 ts_tablet_manager.cc:1434] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 74758684df5649ccadd1e189eaff32dc: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:12:12.342202  4681 tablet_bootstrap.cc:492] T d8033bfb7f5d423d90d60318c67df709 P 74758684df5649ccadd1e189eaff32dc: Bootstrap starting.
I20260709 13:12:12.343713  4633 raft_consensus.cc:3060] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.348206  4681 tablet_bootstrap.cc:654] T d8033bfb7f5d423d90d60318c67df709 P 74758684df5649ccadd1e189eaff32dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:12.342124  4455 leader_election.cc:304] T d8033bfb7f5d423d90d60318c67df709 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06ec58698d5444caaecea433c8419770, aa0ff974118b465eaa785b8a86057e87; no voters: 74758684df5649ccadd1e189eaff32dc
I20260709 13:12:12.358624  4685 tablet_bootstrap.cc:654] T 3d38413c5dce44db8a755b48adacc3a8 P aa0ff974118b465eaa785b8a86057e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:12.359229  5043 raft_consensus.cc:2804] T d8033bfb7f5d423d90d60318c67df709 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:12.359607  5043 raft_consensus.cc:493] T d8033bfb7f5d423d90d60318c67df709 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:12.360041  5043 raft_consensus.cc:3060] T d8033bfb7f5d423d90d60318c67df709 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.387452  5043 raft_consensus.cc:515] T d8033bfb7f5d423d90d60318c67df709 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:12.392941  4681 tablet_bootstrap.cc:492] T d8033bfb7f5d423d90d60318c67df709 P 74758684df5649ccadd1e189eaff32dc: No bootstrap required, opened a new log
I20260709 13:12:12.392517  4310 catalog_manager.cc:5697] T 3f696298fcc049c08b47cd54f901be0c P 06ec58698d5444caaecea433c8419770 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06ec58698d5444caaecea433c8419770 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "06ec58698d5444caaecea433c8419770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:12.393420  4681 ts_tablet_manager.cc:1403] T d8033bfb7f5d423d90d60318c67df709 P 74758684df5649ccadd1e189eaff32dc: Time spent bootstrapping tablet: real 0.051s	user 0.009s	sys 0.016s
I20260709 13:12:12.394982  4634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8033bfb7f5d423d90d60318c67df709" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:12.396232  4681 raft_consensus.cc:359] T d8033bfb7f5d423d90d60318c67df709 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:12.397002  4681 raft_consensus.cc:385] T d8033bfb7f5d423d90d60318c67df709 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:12.397280  4681 raft_consensus.cc:740] T d8033bfb7f5d423d90d60318c67df709 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Initialized, Role: FOLLOWER
I20260709 13:12:12.398133  5056 raft_consensus.cc:493] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 420a61707e804ce5b3773a91cc2eb424)
I20260709 13:12:12.398711  5056 raft_consensus.cc:515] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:12.403033  4413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8033bfb7f5d423d90d60318c67df709" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770"
I20260709 13:12:12.404223  4413 raft_consensus.cc:3060] T d8033bfb7f5d423d90d60318c67df709 P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.398109  4681 consensus_queue.cc:260] T d8033bfb7f5d423d90d60318c67df709 P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
W20260709 13:12:12.405489  4455 leader_election.cc:343] T d8033bfb7f5d423d90d60318c67df709 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:12.410192  4410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2ef12cc13544f2960d7c1b8bef6eb7" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:12.403766  4558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d2ef12cc13544f2960d7c1b8bef6eb7" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:12.408658  5056 leader_election.cc:290] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:12.413605  4603 leader_election.cc:304] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc; no voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424
I20260709 13:12:12.392567  5043 leader_election.cc:290] T d8033bfb7f5d423d90d60318c67df709 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 election: Requested vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:12.420912  4413 raft_consensus.cc:2468] T d8033bfb7f5d423d90d60318c67df709 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 1.
I20260709 13:12:12.424693  4455 leader_election.cc:304] T d8033bfb7f5d423d90d60318c67df709 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06ec58698d5444caaecea433c8419770, aa0ff974118b465eaa785b8a86057e87; no voters: 74758684df5649ccadd1e189eaff32dc
I20260709 13:12:12.425220  5112 raft_consensus.cc:2749] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:12.425581  5161 raft_consensus.cc:2804] T d8033bfb7f5d423d90d60318c67df709 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:12.426168  5161 raft_consensus.cc:697] T d8033bfb7f5d423d90d60318c67df709 P aa0ff974118b465eaa785b8a86057e87 [term 1 LEADER]: Becoming Leader. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Running, Role: LEADER
I20260709 13:12:12.427064  5161 consensus_queue.cc:237] T d8033bfb7f5d423d90d60318c67df709 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:12.424155  5043 raft_consensus.cc:493] T f1dfa63c8b78419c9ff6ffb624a861a7 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.433043  5043 raft_consensus.cc:515] T f1dfa63c8b78419c9ff6ffb624a861a7 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:12.433904  4681 ts_tablet_manager.cc:1434] T d8033bfb7f5d423d90d60318c67df709 P 74758684df5649ccadd1e189eaff32dc: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.001s
I20260709 13:12:12.435065  5043 leader_election.cc:290] T f1dfa63c8b78419c9ff6ffb624a861a7 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:12.435979  4558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1dfa63c8b78419c9ff6ffb624a861a7" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:12.436690  4558 raft_consensus.cc:2468] T f1dfa63c8b78419c9ff6ffb624a861a7 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 0.
I20260709 13:12:12.438022  4454 leader_election.cc:304] T f1dfa63c8b78419c9ff6ffb624a861a7 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:12.438880  5043 raft_consensus.cc:2804] T f1dfa63c8b78419c9ff6ffb624a861a7 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:12.439332  5043 raft_consensus.cc:493] T f1dfa63c8b78419c9ff6ffb624a861a7 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:12.439767  5043 raft_consensus.cc:3060] T f1dfa63c8b78419c9ff6ffb624a861a7 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.445483  4633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1dfa63c8b78419c9ff6ffb624a861a7" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:12.447760  4681 tablet_bootstrap.cc:492] T f1dfa63c8b78419c9ff6ffb624a861a7 P 74758684df5649ccadd1e189eaff32dc: Bootstrap starting.
W20260709 13:12:12.451089  4455 leader_election.cc:343] T f1dfa63c8b78419c9ff6ffb624a861a7 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:12.456928  4685 tablet_bootstrap.cc:492] T 3d38413c5dce44db8a755b48adacc3a8 P aa0ff974118b465eaa785b8a86057e87: No bootstrap required, opened a new log
I20260709 13:12:12.457442  4685 ts_tablet_manager.cc:1403] T 3d38413c5dce44db8a755b48adacc3a8 P aa0ff974118b465eaa785b8a86057e87: Time spent bootstrapping tablet: real 0.153s	user 0.012s	sys 0.017s
I20260709 13:12:12.460546  4685 raft_consensus.cc:359] T 3d38413c5dce44db8a755b48adacc3a8 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:12.461213  4685 raft_consensus.cc:385] T 3d38413c5dce44db8a755b48adacc3a8 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:12.461838  4685 raft_consensus.cc:740] T 3d38413c5dce44db8a755b48adacc3a8 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Initialized, Role: FOLLOWER
I20260709 13:12:12.463761  4685 consensus_queue.cc:260] T 3d38413c5dce44db8a755b48adacc3a8 P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:12.467473  4685 ts_tablet_manager.cc:1434] T 3d38413c5dce44db8a755b48adacc3a8 P aa0ff974118b465eaa785b8a86057e87: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:12:12.468505  4685 tablet_bootstrap.cc:492] T 0dc4f903fb004dd2bce3c4934f078a5d P aa0ff974118b465eaa785b8a86057e87: Bootstrap starting.
I20260709 13:12:12.511674  4685 tablet_bootstrap.cc:654] T 0dc4f903fb004dd2bce3c4934f078a5d P aa0ff974118b465eaa785b8a86057e87: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:12.513007  4681 tablet_bootstrap.cc:654] T f1dfa63c8b78419c9ff6ffb624a861a7 P 74758684df5649ccadd1e189eaff32dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:12.515851  5043 raft_consensus.cc:515] T f1dfa63c8b78419c9ff6ffb624a861a7 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:12.516043  4308 catalog_manager.cc:5697] T d8033bfb7f5d423d90d60318c67df709 P aa0ff974118b465eaa785b8a86057e87 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa0ff974118b465eaa785b8a86057e87 (127.28.173.2). New cstate: current_term: 1 leader_uuid: "aa0ff974118b465eaa785b8a86057e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:12.522990  4685 tablet_bootstrap.cc:492] T 0dc4f903fb004dd2bce3c4934f078a5d P aa0ff974118b465eaa785b8a86057e87: No bootstrap required, opened a new log
I20260709 13:12:12.523442  4685 ts_tablet_manager.cc:1403] T 0dc4f903fb004dd2bce3c4934f078a5d P aa0ff974118b465eaa785b8a86057e87: Time spent bootstrapping tablet: real 0.055s	user 0.009s	sys 0.000s
I20260709 13:12:12.538105  5112 raft_consensus.cc:493] T d8033bfb7f5d423d90d60318c67df709 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.538654  5112 raft_consensus.cc:515] T d8033bfb7f5d423d90d60318c67df709 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:12.539669  4556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1dfa63c8b78419c9ff6ffb624a861a7" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:12.540505  4556 raft_consensus.cc:3060] T f1dfa63c8b78419c9ff6ffb624a861a7 P 420a61707e804ce5b3773a91cc2eb424 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.541293  4413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8033bfb7f5d423d90d60318c67df709" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:12.542148  4413 raft_consensus.cc:2393] T d8033bfb7f5d423d90d60318c67df709 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74758684df5649ccadd1e189eaff32dc in current term 1: Already voted for candidate aa0ff974118b465eaa785b8a86057e87 in this term.
I20260709 13:12:12.543782  5112 leader_election.cc:290] T d8033bfb7f5d423d90d60318c67df709 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:12.545400  4485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8033bfb7f5d423d90d60318c67df709" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:12.536953  4685 raft_consensus.cc:359] T 0dc4f903fb004dd2bce3c4934f078a5d P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:12.547223  4685 raft_consensus.cc:385] T 0dc4f903fb004dd2bce3c4934f078a5d P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:12.547451  4685 raft_consensus.cc:740] T 0dc4f903fb004dd2bce3c4934f078a5d P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Initialized, Role: FOLLOWER
I20260709 13:12:12.546806  4603 leader_election.cc:304] T d8033bfb7f5d423d90d60318c67df709 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc; no voters: 06ec58698d5444caaecea433c8419770, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:12.548549  5112 raft_consensus.cc:3060] T d8033bfb7f5d423d90d60318c67df709 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.552197  5043 leader_election.cc:290] T f1dfa63c8b78419c9ff6ffb624a861a7 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 election: Requested vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:12.553100  4633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1dfa63c8b78419c9ff6ffb624a861a7" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:12.555728  4556 raft_consensus.cc:2468] T f1dfa63c8b78419c9ff6ffb624a861a7 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 1.
I20260709 13:12:12.558792  4454 leader_election.cc:304] T f1dfa63c8b78419c9ff6ffb624a861a7 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:12.559567  5043 raft_consensus.cc:2804] T f1dfa63c8b78419c9ff6ffb624a861a7 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:12.560211  4685 consensus_queue.cc:260] T 0dc4f903fb004dd2bce3c4934f078a5d P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:12.562000  5112 raft_consensus.cc:2749] T d8033bfb7f5d423d90d60318c67df709 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:12:12.563230  4455 leader_election.cc:343] T f1dfa63c8b78419c9ff6ffb624a861a7 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:12.566075  5043 raft_consensus.cc:697] T f1dfa63c8b78419c9ff6ffb624a861a7 P aa0ff974118b465eaa785b8a86057e87 [term 1 LEADER]: Becoming Leader. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Running, Role: LEADER
I20260709 13:12:12.567003  5043 consensus_queue.cc:237] T f1dfa63c8b78419c9ff6ffb624a861a7 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:12.567929  4685 ts_tablet_manager.cc:1434] T 0dc4f903fb004dd2bce3c4934f078a5d P aa0ff974118b465eaa785b8a86057e87: Time spent starting tablet: real 0.044s	user 0.009s	sys 0.000s
I20260709 13:12:12.572300  4681 tablet_bootstrap.cc:492] T f1dfa63c8b78419c9ff6ffb624a861a7 P 74758684df5649ccadd1e189eaff32dc: No bootstrap required, opened a new log
I20260709 13:12:12.572818  4681 ts_tablet_manager.cc:1403] T f1dfa63c8b78419c9ff6ffb624a861a7 P 74758684df5649ccadd1e189eaff32dc: Time spent bootstrapping tablet: real 0.129s	user 0.023s	sys 0.006s
I20260709 13:12:12.575521  4681 raft_consensus.cc:359] T f1dfa63c8b78419c9ff6ffb624a861a7 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:12.576295  4681 raft_consensus.cc:385] T f1dfa63c8b78419c9ff6ffb624a861a7 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:12.576614  4681 raft_consensus.cc:740] T f1dfa63c8b78419c9ff6ffb624a861a7 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Initialized, Role: FOLLOWER
I20260709 13:12:12.577369  4681 consensus_queue.cc:260] T f1dfa63c8b78419c9ff6ffb624a861a7 P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:12.579960  4681 ts_tablet_manager.cc:1434] T f1dfa63c8b78419c9ff6ffb624a861a7 P 74758684df5649ccadd1e189eaff32dc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:12.581089  4681 tablet_bootstrap.cc:492] T 0dc4f903fb004dd2bce3c4934f078a5d P 74758684df5649ccadd1e189eaff32dc: Bootstrap starting.
I20260709 13:12:12.587476  4681 tablet_bootstrap.cc:654] T 0dc4f903fb004dd2bce3c4934f078a5d P 74758684df5649ccadd1e189eaff32dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:12.592247  4308 catalog_manager.cc:5697] T f1dfa63c8b78419c9ff6ffb624a861a7 P aa0ff974118b465eaa785b8a86057e87 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa0ff974118b465eaa785b8a86057e87 (127.28.173.2). New cstate: current_term: 1 leader_uuid: "aa0ff974118b465eaa785b8a86057e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:12.596606  5043 raft_consensus.cc:493] T 3d38413c5dce44db8a755b48adacc3a8 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.597241  5043 raft_consensus.cc:515] T 3d38413c5dce44db8a755b48adacc3a8 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:12.599920  4410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d38413c5dce44db8a755b48adacc3a8" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:12.600679  4410 raft_consensus.cc:2393] T 3d38413c5dce44db8a755b48adacc3a8 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aa0ff974118b465eaa785b8a86057e87 in current term 1: Already voted for candidate 420a61707e804ce5b3773a91cc2eb424 in this term.
I20260709 13:12:12.602437  5043 leader_election.cc:290] T 3d38413c5dce44db8a755b48adacc3a8 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:12.603703  4556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d38413c5dce44db8a755b48adacc3a8" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:12.606374  4454 leader_election.cc:304] T 3d38413c5dce44db8a755b48adacc3a8 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa0ff974118b465eaa785b8a86057e87; no voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424
I20260709 13:12:12.614513  4681 tablet_bootstrap.cc:492] T 0dc4f903fb004dd2bce3c4934f078a5d P 74758684df5649ccadd1e189eaff32dc: No bootstrap required, opened a new log
I20260709 13:12:12.615096  4681 ts_tablet_manager.cc:1403] T 0dc4f903fb004dd2bce3c4934f078a5d P 74758684df5649ccadd1e189eaff32dc: Time spent bootstrapping tablet: real 0.034s	user 0.008s	sys 0.020s
I20260709 13:12:12.618235  4681 raft_consensus.cc:359] T 0dc4f903fb004dd2bce3c4934f078a5d P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:12.618964  4681 raft_consensus.cc:385] T 0dc4f903fb004dd2bce3c4934f078a5d P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:12.619031  5043 raft_consensus.cc:3060] T 3d38413c5dce44db8a755b48adacc3a8 P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.619279  4681 raft_consensus.cc:740] T 0dc4f903fb004dd2bce3c4934f078a5d P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Initialized, Role: FOLLOWER
I20260709 13:12:12.620280  4681 consensus_queue.cc:260] T 0dc4f903fb004dd2bce3c4934f078a5d P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:12.622713  4681 ts_tablet_manager.cc:1434] T 0dc4f903fb004dd2bce3c4934f078a5d P 74758684df5649ccadd1e189eaff32dc: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:12:12.623803  4681 tablet_bootstrap.cc:492] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc: Bootstrap starting.
I20260709 13:12:12.630158  4681 tablet_bootstrap.cc:654] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:12.649825  5043 raft_consensus.cc:2749] T 3d38413c5dce44db8a755b48adacc3a8 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:12.653887  4681 tablet_bootstrap.cc:492] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc: No bootstrap required, opened a new log
I20260709 13:12:12.654388  4681 ts_tablet_manager.cc:1403] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc: Time spent bootstrapping tablet: real 0.031s	user 0.008s	sys 0.012s
I20260709 13:12:12.658357  4681 raft_consensus.cc:359] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:12.659206  4681 raft_consensus.cc:385] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:12.659469  4681 raft_consensus.cc:740] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Initialized, Role: FOLLOWER
I20260709 13:12:12.660169  4681 consensus_queue.cc:260] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:12.680111  4681 ts_tablet_manager.cc:1434] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:12:12.684775  5030 raft_consensus.cc:493] T 0dc4f903fb004dd2bce3c4934f078a5d P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.685351  5030 raft_consensus.cc:515] T 0dc4f903fb004dd2bce3c4934f078a5d P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:12.686343  5141 consensus_queue.cc:1048] T 3d38413c5dce44db8a755b48adacc3a8 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:12.688594  5030 leader_election.cc:290] T 0dc4f903fb004dd2bce3c4934f078a5d P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:12.689126  4410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc4f903fb004dd2bce3c4934f078a5d" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:12.689435  4633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc4f903fb004dd2bce3c4934f078a5d" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:12.689797  4410 raft_consensus.cc:2468] T 0dc4f903fb004dd2bce3c4934f078a5d P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 0.
I20260709 13:12:12.690042  4633 raft_consensus.cc:2468] T 0dc4f903fb004dd2bce3c4934f078a5d P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 0.
I20260709 13:12:12.690961  4455 leader_election.cc:304] T 0dc4f903fb004dd2bce3c4934f078a5d P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:12.691706  5043 raft_consensus.cc:2804] T 0dc4f903fb004dd2bce3c4934f078a5d P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:12.693470  5043 raft_consensus.cc:493] T 0dc4f903fb004dd2bce3c4934f078a5d P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:12.693943  5043 raft_consensus.cc:3060] T 0dc4f903fb004dd2bce3c4934f078a5d P aa0ff974118b465eaa785b8a86057e87 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:12.711879  4358 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:12.717600  5096 consensus_queue.cc:1048] T 3d38413c5dce44db8a755b48adacc3a8 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:12.726307  5043 raft_consensus.cc:515] T 0dc4f903fb004dd2bce3c4934f078a5d P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:12.735987  5043 leader_election.cc:290] T 0dc4f903fb004dd2bce3c4934f078a5d P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 election: Requested vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:12.741602  4633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc4f903fb004dd2bce3c4934f078a5d" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:12.744112  4633 raft_consensus.cc:3060] T 0dc4f903fb004dd2bce3c4934f078a5d P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.742470  4410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc4f903fb004dd2bce3c4934f078a5d" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770"
I20260709 13:12:12.744853  4410 raft_consensus.cc:3060] T 0dc4f903fb004dd2bce3c4934f078a5d P 06ec58698d5444caaecea433c8419770 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.752147  4633 raft_consensus.cc:2468] T 0dc4f903fb004dd2bce3c4934f078a5d P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 1.
I20260709 13:12:12.752961  4410 raft_consensus.cc:2468] T 0dc4f903fb004dd2bce3c4934f078a5d P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 1.
I20260709 13:12:12.753645  4455 leader_election.cc:304] T 0dc4f903fb004dd2bce3c4934f078a5d P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:12.754367  5043 raft_consensus.cc:2804] T 0dc4f903fb004dd2bce3c4934f078a5d P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:12.754846  5043 raft_consensus.cc:697] T 0dc4f903fb004dd2bce3c4934f078a5d P aa0ff974118b465eaa785b8a86057e87 [term 1 LEADER]: Becoming Leader. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Running, Role: LEADER
I20260709 13:12:12.755586  5043 consensus_queue.cc:237] T 0dc4f903fb004dd2bce3c4934f078a5d P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:12.769186  4310 catalog_manager.cc:5697] T 0dc4f903fb004dd2bce3c4934f078a5d P aa0ff974118b465eaa785b8a86057e87 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa0ff974118b465eaa785b8a86057e87 (127.28.173.2). New cstate: current_term: 1 leader_uuid: "aa0ff974118b465eaa785b8a86057e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:12.794731  5056 raft_consensus.cc:493] T f1dfa63c8b78419c9ff6ffb624a861a7 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.795358  5056 raft_consensus.cc:515] T f1dfa63c8b78419c9ff6ffb624a861a7 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:12.798193  4485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1dfa63c8b78419c9ff6ffb624a861a7" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:12.798784  5056 leader_election.cc:290] T f1dfa63c8b78419c9ff6ffb624a861a7 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:12.800297  4558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1dfa63c8b78419c9ff6ffb624a861a7" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:12.801221  4558 raft_consensus.cc:2393] T f1dfa63c8b78419c9ff6ffb624a861a7 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74758684df5649ccadd1e189eaff32dc in current term 1: Already voted for candidate aa0ff974118b465eaa785b8a86057e87 in this term.
I20260709 13:12:12.802294  4602 leader_election.cc:304] T f1dfa63c8b78419c9ff6ffb624a861a7 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc; no voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:12.803644  5056 raft_consensus.cc:3060] T f1dfa63c8b78419c9ff6ffb624a861a7 P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.810768  5056 raft_consensus.cc:2749] T f1dfa63c8b78419c9ff6ffb624a861a7 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:12.835260  4982 consensus_queue.cc:1048] T 3f696298fcc049c08b47cd54f901be0c P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:12:12.857400  4633 raft_consensus.cc:3060] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.868960  4982 consensus_queue.cc:1048] T 3f696298fcc049c08b47cd54f901be0c P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:12:12.880064  5043 consensus_queue.cc:1048] T d8033bfb7f5d423d90d60318c67df709 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:12:12.952409  5203 log.cc:927] Time spent T d8033bfb7f5d423d90d60318c67df709 P 06ec58698d5444caaecea433c8419770: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:12:12.973546  5043 consensus_queue.cc:1048] T d8033bfb7f5d423d90d60318c67df709 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:12.996764  5190 consensus_queue.cc:1048] T f1dfa63c8b78419c9ff6ffb624a861a7 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:13.036495  5030 consensus_queue.cc:1048] T f1dfa63c8b78419c9ff6ffb624a861a7 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:13.141207  5030 consensus_queue.cc:1048] T 0dc4f903fb004dd2bce3c4934f078a5d P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:13.160686  5043 consensus_queue.cc:1048] T 0dc4f903fb004dd2bce3c4934f078a5d P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:14.225950 29364 tablet_server.cc:179] TabletServer@127.28.173.1:0 shutting down...
W20260709 13:12:14.234153  4603 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:12:14.247627  4603 consensus_peers.cc:597] T 325a5a55a44a47ce97869216b084f89d P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:14.296751  4529 consensus_peers.cc:597] T 584f5934b7fa4c7ab4b0b43923621e70 P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:14.315122 29364 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:12:14.318004  4455 consensus_peers.cc:597] T a4736bb71dfa4f4b8b80e8a52895acf7 P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:14.318811  4455 consensus_peers.cc:597] T d8033bfb7f5d423d90d60318c67df709 P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:14.322084 29364 tablet_replica.cc:333] T 3f696298fcc049c08b47cd54f901be0c P 06ec58698d5444caaecea433c8419770: stopping tablet replica
I20260709 13:12:14.323290 29364 raft_consensus.cc:2243] T 3f696298fcc049c08b47cd54f901be0c P 06ec58698d5444caaecea433c8419770 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:14.324493 29364 raft_consensus.cc:2272] T 3f696298fcc049c08b47cd54f901be0c P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:14.328847 29364 tablet_replica.cc:333] T 3d38413c5dce44db8a755b48adacc3a8 P 06ec58698d5444caaecea433c8419770: stopping tablet replica
I20260709 13:12:14.329939 29364 raft_consensus.cc:2243] T 3d38413c5dce44db8a755b48adacc3a8 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:14.330610 29364 raft_consensus.cc:2272] T 3d38413c5dce44db8a755b48adacc3a8 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:14.336032 29364 tablet_replica.cc:333] T 47d66fc2153d419082eccd7e30643d56 P 06ec58698d5444caaecea433c8419770: stopping tablet replica
I20260709 13:12:14.337003 29364 raft_consensus.cc:2243] T 47d66fc2153d419082eccd7e30643d56 P 06ec58698d5444caaecea433c8419770 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:14.338285 29364 raft_consensus.cc:2272] T 47d66fc2153d419082eccd7e30643d56 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:14.336395  4603 consensus_peers.cc:597] T acbf3f88b4514948820691784cf9c189 P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:14.341560 29364 tablet_replica.cc:333] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770: stopping tablet replica
W20260709 13:12:14.344624  4529 consensus_peers.cc:597] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:14.350833  4529 consensus_peers.cc:597] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:14.351197  4603 consensus_peers.cc:597] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:14.353008 29364 raft_consensus.cc:2243] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:14.354168 29364 raft_consensus.cc:2272] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:14.357144 29364 tablet_replica.cc:333] T e50b6f5a42a24867ab5f90ad6d97401e P 06ec58698d5444caaecea433c8419770: stopping tablet replica
I20260709 13:12:14.357999 29364 raft_consensus.cc:2243] T e50b6f5a42a24867ab5f90ad6d97401e P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:14.358600 29364 raft_consensus.cc:2272] T e50b6f5a42a24867ab5f90ad6d97401e P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:14.361649 29364 tablet_replica.cc:333] T b731fe02a6f4441e816628760bfdfb54 P 06ec58698d5444caaecea433c8419770: stopping tablet replica
I20260709 13:12:14.362565 29364 raft_consensus.cc:2243] T b731fe02a6f4441e816628760bfdfb54 P 06ec58698d5444caaecea433c8419770 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:14.363626 29364 raft_consensus.cc:2272] T b731fe02a6f4441e816628760bfdfb54 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:14.369000 29364 tablet_replica.cc:333] T 98342133e28b47d8a388f9321d5fd796 P 06ec58698d5444caaecea433c8419770: stopping tablet replica
I20260709 13:12:14.369789 29364 raft_consensus.cc:2243] T 98342133e28b47d8a388f9321d5fd796 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:14.370344 29364 raft_consensus.cc:2272] T 98342133e28b47d8a388f9321d5fd796 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:14.372663 29364 tablet_replica.cc:333] T 60d704077649426ab65d89dd9ff778d0 P 06ec58698d5444caaecea433c8419770: stopping tablet replica
I20260709 13:12:14.373327 29364 raft_consensus.cc:2243] T 60d704077649426ab65d89dd9ff778d0 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:14.373816 29364 raft_consensus.cc:2272] T 60d704077649426ab65d89dd9ff778d0 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:14.375921 29364 tablet_replica.cc:333] T 49047cb7a56246288b9044f8ebec130f P 06ec58698d5444caaecea433c8419770: stopping tablet replica
I20260709 13:12:14.376432 29364 raft_consensus.cc:2243] T 49047cb7a56246288b9044f8ebec130f P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:14.376885 29364 raft_consensus.cc:2272] T 49047cb7a56246288b9044f8ebec130f P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:14.379750 29364 tablet_replica.cc:333] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770: stopping tablet replica
I20260709 13:12:14.380534 29364 raft_consensus.cc:2243] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:14.381819 29364 raft_consensus.cc:2272] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:14.385679  4529 consensus_peers.cc:597] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:14.386195 29364 tablet_replica.cc:333] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770: stopping tablet replica
W20260709 13:12:14.387177  4455 consensus_peers.cc:597] T 98342133e28b47d8a388f9321d5fd796 P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:14.387210 29364 raft_consensus.cc:2243] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:14.388581 29364 raft_consensus.cc:2272] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:14.391393 29364 tablet_replica.cc:333] T ff7757f22fe3408f8745bc899f3c2e4e P 06ec58698d5444caaecea433c8419770: stopping tablet replica
I20260709 13:12:14.392349 29364 raft_consensus.cc:2243] T ff7757f22fe3408f8745bc899f3c2e4e P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:14.392833 29364 raft_consensus.cc:2272] T ff7757f22fe3408f8745bc899f3c2e4e P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:14.395643 29364 tablet_replica.cc:333] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770: stopping tablet replica
I20260709 13:12:14.396569 29364 raft_consensus.cc:2243] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:14.397564 29364 raft_consensus.cc:2272] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:14.400243 29364 tablet_replica.cc:333] T 325a5a55a44a47ce97869216b084f89d P 06ec58698d5444caaecea433c8419770: stopping tablet replica
W20260709 13:12:14.399413  4529 consensus_peers.cc:597] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:14.401193 29364 raft_consensus.cc:2243] T 325a5a55a44a47ce97869216b084f89d P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:14.401772 29364 raft_consensus.cc:2272] T 325a5a55a44a47ce97869216b084f89d P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:14.403735  4455 consensus_peers.cc:597] T 49047cb7a56246288b9044f8ebec130f P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:14.404475 29364 tablet_replica.cc:333] T 604a93ed898f4ab9b771487bfe278b33 P 06ec58698d5444caaecea433c8419770: stopping tablet replica
I20260709 13:12:14.405138 29364 raft_consensus.cc:2243] T 604a93ed898f4ab9b771487bfe278b33 P 06ec58698d5444caaecea433c8419770 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:14.405949 29364 raft_consensus.cc:2272] T 604a93ed898f4ab9b771487bfe278b33 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:14.408210 29364 tablet_replica.cc:333] T aa241e695dbb492a971f537d1f977f21 P 06ec58698d5444caaecea433c8419770: stopping tablet replica
I20260709 13:12:14.409008 29364 raft_consensus.cc:2243] T aa241e695dbb492a971f537d1f977f21 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:14.409504 29364 raft_consensus.cc:2272] T aa241e695dbb492a971f537d1f977f21 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:14.412326 29364 tablet_replica.cc:333] T d1119afee9d6413aa2cd229073ffbcf1 P 06ec58698d5444caaecea433c8419770: stopping tablet replica
I20260709 13:12:14.413069 29364 raft_consensus.cc:2243] T d1119afee9d6413aa2cd229073ffbcf1 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:12:14.413527  4603 consensus_peers.cc:597] T e50b6f5a42a24867ab5f90ad6d97401e P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:14.413651 29364 raft_consensus.cc:2272] T d1119afee9d6413aa2cd229073ffbcf1 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:14.416559 29364 tablet_replica.cc:333] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770: stopping tablet replica
I20260709 13:12:14.417603 29364 raft_consensus.cc:2243] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:14.418594 29364 raft_consensus.cc:2272] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:14.421186 29364 tablet_replica.cc:333] T 584f5934b7fa4c7ab4b0b43923621e70 P 06ec58698d5444caaecea433c8419770: stopping tablet replica
I20260709 13:12:14.421738 29364 raft_consensus.cc:2243] T 584f5934b7fa4c7ab4b0b43923621e70 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:14.422197 29364 raft_consensus.cc:2272] T 584f5934b7fa4c7ab4b0b43923621e70 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:14.424496 29364 tablet_replica.cc:333] T b6256e4aa07c45c78b2bbff56a852078 P 06ec58698d5444caaecea433c8419770: stopping tablet replica
I20260709 13:12:14.425160 29364 raft_consensus.cc:2243] T b6256e4aa07c45c78b2bbff56a852078 P 06ec58698d5444caaecea433c8419770 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:14.426571 29364 raft_consensus.cc:2272] T b6256e4aa07c45c78b2bbff56a852078 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:14.429327 29364 tablet_replica.cc:333] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 06ec58698d5444caaecea433c8419770: stopping tablet replica
I20260709 13:12:14.430260 29364 raft_consensus.cc:2243] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 06ec58698d5444caaecea433c8419770 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:12:14.429275  4455 consensus_peers.cc:597] T 0dc4f903fb004dd2bce3c4934f078a5d P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:14.431123 29364 raft_consensus.cc:2272] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:14.433857 29364 tablet_replica.cc:333] T acbf3f88b4514948820691784cf9c189 P 06ec58698d5444caaecea433c8419770: stopping tablet replica
I20260709 13:12:14.434924 29364 raft_consensus.cc:2243] T acbf3f88b4514948820691784cf9c189 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:14.435458 29364 raft_consensus.cc:2272] T acbf3f88b4514948820691784cf9c189 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:14.437933 29364 tablet_replica.cc:333] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770: stopping tablet replica
I20260709 13:12:14.438709 29364 raft_consensus.cc:2243] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:14.439556 29364 raft_consensus.cc:2272] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:14.441526 29364 tablet_replica.cc:333] T 1503964d57034b31b36eecc16f2c84a0 P 06ec58698d5444caaecea433c8419770: stopping tablet replica
I20260709 13:12:14.442055 29364 raft_consensus.cc:2243] T 1503964d57034b31b36eecc16f2c84a0 P 06ec58698d5444caaecea433c8419770 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:14.442740 29364 raft_consensus.cc:2272] T 1503964d57034b31b36eecc16f2c84a0 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:14.444768 29364 tablet_replica.cc:333] T d088694ef66442bdbf75cc7fc1942a83 P 06ec58698d5444caaecea433c8419770: stopping tablet replica
I20260709 13:12:14.445274 29364 raft_consensus.cc:2243] T d088694ef66442bdbf75cc7fc1942a83 P 06ec58698d5444caaecea433c8419770 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:14.446142 29364 raft_consensus.cc:2272] T d088694ef66442bdbf75cc7fc1942a83 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:14.448765 29364 tablet_replica.cc:333] T 002595643d984c1c915975d4c4ace485 P 06ec58698d5444caaecea433c8419770: stopping tablet replica
I20260709 13:12:14.449401 29364 raft_consensus.cc:2243] T 002595643d984c1c915975d4c4ace485 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:14.449890 29364 raft_consensus.cc:2272] T 002595643d984c1c915975d4c4ace485 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:14.451462  4603 consensus_peers.cc:597] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:14.452327 29364 tablet_replica.cc:333] T a4736bb71dfa4f4b8b80e8a52895acf7 P 06ec58698d5444caaecea433c8419770: stopping tablet replica
I20260709 13:12:14.452977 29364 raft_consensus.cc:2243] T a4736bb71dfa4f4b8b80e8a52895acf7 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:14.453526 29364 raft_consensus.cc:2272] T a4736bb71dfa4f4b8b80e8a52895acf7 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:14.456231 29364 tablet_replica.cc:333] T 69aed23cb12849fda6220c6c65580d59 P 06ec58698d5444caaecea433c8419770: stopping tablet replica
I20260709 13:12:14.456998 29364 raft_consensus.cc:2243] T 69aed23cb12849fda6220c6c65580d59 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:14.457602 29364 raft_consensus.cc:2272] T 69aed23cb12849fda6220c6c65580d59 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:14.460626 29364 tablet_replica.cc:333] T d8033bfb7f5d423d90d60318c67df709 P 06ec58698d5444caaecea433c8419770: stopping tablet replica
I20260709 13:12:14.461359 29364 raft_consensus.cc:2243] T d8033bfb7f5d423d90d60318c67df709 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:14.461819 29364 raft_consensus.cc:2272] T d8033bfb7f5d423d90d60318c67df709 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:14.463657 29364 tablet_replica.cc:333] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770: stopping tablet replica
I20260709 13:12:14.464329 29364 raft_consensus.cc:2243] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:14.465329 29364 raft_consensus.cc:2272] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:14.467849 29364 tablet_replica.cc:333] T 0dc4f903fb004dd2bce3c4934f078a5d P 06ec58698d5444caaecea433c8419770: stopping tablet replica
I20260709 13:12:14.468545 29364 raft_consensus.cc:2243] T 0dc4f903fb004dd2bce3c4934f078a5d P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:14.469053 29364 raft_consensus.cc:2272] T 0dc4f903fb004dd2bce3c4934f078a5d P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:14.471493 29364 tablet_replica.cc:333] T 09294b866578436a827c27702d4b1d0b P 06ec58698d5444caaecea433c8419770: stopping tablet replica
I20260709 13:12:14.472208 29364 raft_consensus.cc:2243] T 09294b866578436a827c27702d4b1d0b P 06ec58698d5444caaecea433c8419770 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:14.473232 29364 raft_consensus.cc:2272] T 09294b866578436a827c27702d4b1d0b P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:14.475695 29364 tablet_replica.cc:333] T 5b827ee48d56478398f009c3fa980016 P 06ec58698d5444caaecea433c8419770: stopping tablet replica
I20260709 13:12:14.476334 29364 raft_consensus.cc:2243] T 5b827ee48d56478398f009c3fa980016 P 06ec58698d5444caaecea433c8419770 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:12:14.476866  4603 consensus_peers.cc:597] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:14.477250 29364 raft_consensus.cc:2272] T 5b827ee48d56478398f009c3fa980016 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:14.479719 29364 tablet_replica.cc:333] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770: stopping tablet replica
I20260709 13:12:14.480319 29364 raft_consensus.cc:2243] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:14.480737 29364 raft_consensus.cc:2272] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:14.482705 29364 tablet_replica.cc:333] T cb23991ab8504ee491f905a4346edee9 P 06ec58698d5444caaecea433c8419770: stopping tablet replica
I20260709 13:12:14.483234 29364 raft_consensus.cc:2243] T cb23991ab8504ee491f905a4346edee9 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:14.483729 29364 raft_consensus.cc:2272] T cb23991ab8504ee491f905a4346edee9 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:14.486133 29364 tablet_replica.cc:333] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 06ec58698d5444caaecea433c8419770: stopping tablet replica
I20260709 13:12:14.486631 29364 raft_consensus.cc:2243] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:14.487044 29364 raft_consensus.cc:2272] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:14.489442 29364 tablet_replica.cc:333] T 980616077a8445ccbe984f63131e1b44 P 06ec58698d5444caaecea433c8419770: stopping tablet replica
I20260709 13:12:14.489962 29364 raft_consensus.cc:2243] T 980616077a8445ccbe984f63131e1b44 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:14.490399 29364 raft_consensus.cc:2272] T 980616077a8445ccbe984f63131e1b44 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:14.492362 29364 tablet_replica.cc:333] T 3501a75721d543d598af7857e368e08b P 06ec58698d5444caaecea433c8419770: stopping tablet replica
I20260709 13:12:14.492861 29364 raft_consensus.cc:2243] T 3501a75721d543d598af7857e368e08b P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:14.493232 29364 raft_consensus.cc:2272] T 3501a75721d543d598af7857e368e08b P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:14.495391 29364 tablet_replica.cc:333] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 06ec58698d5444caaecea433c8419770: stopping tablet replica
I20260709 13:12:14.496075 29364 raft_consensus.cc:2243] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:14.496501 29364 raft_consensus.cc:2272] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:14.498826 29364 tablet_replica.cc:333] T 150545c47e0642229a92ede96db14fc9 P 06ec58698d5444caaecea433c8419770: stopping tablet replica
I20260709 13:12:14.499339 29364 raft_consensus.cc:2243] T 150545c47e0642229a92ede96db14fc9 P 06ec58698d5444caaecea433c8419770 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:14.500264 29364 raft_consensus.cc:2272] T 150545c47e0642229a92ede96db14fc9 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:14.502568 29364 tablet_replica.cc:333] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770: stopping tablet replica
I20260709 13:12:14.503301 29364 raft_consensus.cc:2243] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:14.504302 29364 raft_consensus.cc:2272] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:14.508054 29364 tablet_replica.cc:333] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770: stopping tablet replica
I20260709 13:12:14.508787 29364 raft_consensus.cc:2243] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:14.509611 29364 raft_consensus.cc:2272] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:14.511662 29364 tablet_replica.cc:333] T d0147a5552154f26a88833f9210b1358 P 06ec58698d5444caaecea433c8419770: stopping tablet replica
I20260709 13:12:14.512192 29364 raft_consensus.cc:2243] T d0147a5552154f26a88833f9210b1358 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:14.512598 29364 raft_consensus.cc:2272] T d0147a5552154f26a88833f9210b1358 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:14.515154 29364 tablet_replica.cc:333] T 81197f2dcf424fbaaab746d5f8bf7c8c P 06ec58698d5444caaecea433c8419770: stopping tablet replica
I20260709 13:12:14.515793 29364 raft_consensus.cc:2243] T 81197f2dcf424fbaaab746d5f8bf7c8c P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:14.516355 29364 raft_consensus.cc:2272] T 81197f2dcf424fbaaab746d5f8bf7c8c P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:14.519040 29364 tablet_replica.cc:333] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 06ec58698d5444caaecea433c8419770: stopping tablet replica
I20260709 13:12:14.521401 29364 raft_consensus.cc:2243] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:12:14.521517  4603 consensus_peers.cc:597] T 69aed23cb12849fda6220c6c65580d59 P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:14.522042 29364 raft_consensus.cc:2272] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:14.529845  4603 consensus_peers.cc:597] T 81197f2dcf424fbaaab746d5f8bf7c8c P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:14.549422  4529 consensus_peers.cc:597] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:14.553869  4529 consensus_peers.cc:597] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:14.600687 29364 tablet_server.cc:196] TabletServer@127.28.173.1:0 shutdown complete.
W20260709 13:12:14.651487  4529 consensus_peers.cc:597] T d1119afee9d6413aa2cd229073ffbcf1 P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:14.654284  4529 consensus_peers.cc:597] T 980616077a8445ccbe984f63131e1b44 P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:14.665424  4603 consensus_peers.cc:597] T d0147a5552154f26a88833f9210b1358 P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:14.683529  4529 consensus_peers.cc:597] T 002595643d984c1c915975d4c4ace485 P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:14.708922  4529 consensus_peers.cc:597] T 3d38413c5dce44db8a755b48adacc3a8 P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:14.711565 29364 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:14.720445  5219 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:14.721568  5220 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:14.725615 29364 server_base.cc:1061] running on GCE node
W20260709 13:12:14.726099  5222 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:14.729658 29364 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:14.730000 29364 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:14.730245 29364 hybrid_clock.cc:648] HybridClock initialized: now 1783602734730228 us; error 0 us; skew 500 ppm
I20260709 13:12:14.731067 29364 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:14.734757 29364 webserver.cc:533] Webserver started at http://127.28.173.1:44623/ using document root <none> and password file <none>
I20260709 13:12:14.735440 29364 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:14.735684 29364 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:12:14.740928 29364 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:12:14.750157  5227 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:14.751078 29364 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:12:14.751439 29364 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602443945700-29364-0/minicluster-data/ts-0-root
uuid: "06ec58698d5444caaecea433c8419770"
format_stamp: "Formatted at 2026-07-09 13:12:01 on dist-test-slave-x62b"
I20260709 13:12:14.751991 29364 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602443945700-29364-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602443945700-29364-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602443945700-29364-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:14.801117 29364 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:14.802873 29364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:14.824937 29364 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:14.832011  5234 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 13:12:15.131979 29364 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:12:15.132306 29364 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.302s	user 0.009s	sys 0.001s
I20260709 13:12:15.132611 29364 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:12:15.137036  5234 tablet_bootstrap.cc:492] T 49047cb7a56246288b9044f8ebec130f P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:15.163414  5234 tablet_bootstrap.cc:492] T 49047cb7a56246288b9044f8ebec130f P 06ec58698d5444caaecea433c8419770: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:15.164422  5234 tablet_bootstrap.cc:492] T 49047cb7a56246288b9044f8ebec130f P 06ec58698d5444caaecea433c8419770: Bootstrap complete.
I20260709 13:12:15.165102  5234 ts_tablet_manager.cc:1403] T 49047cb7a56246288b9044f8ebec130f P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.008s
I20260709 13:12:15.167619  5234 raft_consensus.cc:359] T 49047cb7a56246288b9044f8ebec130f P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:15.168327  5234 raft_consensus.cc:740] T 49047cb7a56246288b9044f8ebec130f P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:15.169080  5234 consensus_queue.cc:260] T 49047cb7a56246288b9044f8ebec130f P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:15.198118  5234 ts_tablet_manager.cc:1434] T 49047cb7a56246288b9044f8ebec130f P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.033s	user 0.015s	sys 0.012s
I20260709 13:12:15.200320  5234 tablet_bootstrap.cc:492] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:15.244249  5234 tablet_bootstrap.cc:492] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:15.245193  5234 tablet_bootstrap.cc:492] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770: Bootstrap complete.
I20260709 13:12:15.245812  5234 ts_tablet_manager.cc:1403] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.047s	user 0.016s	sys 0.016s
I20260709 13:12:15.248253  5234 raft_consensus.cc:359] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:15.248939  5234 raft_consensus.cc:740] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:15.249639  5234 consensus_queue.cc:260] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:15.251437  5234 ts_tablet_manager.cc:1434] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:12:15.252189  5234 tablet_bootstrap.cc:492] T 98342133e28b47d8a388f9321d5fd796 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:15.269097  5234 tablet_bootstrap.cc:492] T 98342133e28b47d8a388f9321d5fd796 P 06ec58698d5444caaecea433c8419770: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:15.269948  5234 tablet_bootstrap.cc:492] T 98342133e28b47d8a388f9321d5fd796 P 06ec58698d5444caaecea433c8419770: Bootstrap complete.
I20260709 13:12:15.270517  5234 ts_tablet_manager.cc:1403] T 98342133e28b47d8a388f9321d5fd796 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.004s
I20260709 13:12:15.272781  5234 raft_consensus.cc:359] T 98342133e28b47d8a388f9321d5fd796 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:15.273399  5234 raft_consensus.cc:740] T 98342133e28b47d8a388f9321d5fd796 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:15.274025  5234 consensus_queue.cc:260] T 98342133e28b47d8a388f9321d5fd796 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:15.275749  5234 ts_tablet_manager.cc:1434] T 98342133e28b47d8a388f9321d5fd796 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:12:15.276480  5234 tablet_bootstrap.cc:492] T 0dc4f903fb004dd2bce3c4934f078a5d P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:15.292971  5234 tablet_bootstrap.cc:492] T 0dc4f903fb004dd2bce3c4934f078a5d P 06ec58698d5444caaecea433c8419770: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:15.293952  5234 tablet_bootstrap.cc:492] T 0dc4f903fb004dd2bce3c4934f078a5d P 06ec58698d5444caaecea433c8419770: Bootstrap complete.
I20260709 13:12:15.294629  5234 ts_tablet_manager.cc:1403] T 0dc4f903fb004dd2bce3c4934f078a5d P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 13:12:15.297328  5234 raft_consensus.cc:359] T 0dc4f903fb004dd2bce3c4934f078a5d P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:15.298019  5234 raft_consensus.cc:740] T 0dc4f903fb004dd2bce3c4934f078a5d P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:15.298659  5234 consensus_queue.cc:260] T 0dc4f903fb004dd2bce3c4934f078a5d P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:15.300793  5234 ts_tablet_manager.cc:1434] T 0dc4f903fb004dd2bce3c4934f078a5d P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:12:15.301591  5234 tablet_bootstrap.cc:492] T d8033bfb7f5d423d90d60318c67df709 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:15.316993  5234 tablet_bootstrap.cc:492] T d8033bfb7f5d423d90d60318c67df709 P 06ec58698d5444caaecea433c8419770: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:15.317924  5234 tablet_bootstrap.cc:492] T d8033bfb7f5d423d90d60318c67df709 P 06ec58698d5444caaecea433c8419770: Bootstrap complete.
I20260709 13:12:15.318573  5234 ts_tablet_manager.cc:1403] T d8033bfb7f5d423d90d60318c67df709 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 13:12:15.321026  5234 raft_consensus.cc:359] T d8033bfb7f5d423d90d60318c67df709 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:15.321708  5234 raft_consensus.cc:740] T d8033bfb7f5d423d90d60318c67df709 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:15.322506  5234 consensus_queue.cc:260] T d8033bfb7f5d423d90d60318c67df709 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:15.324642  5234 ts_tablet_manager.cc:1434] T d8033bfb7f5d423d90d60318c67df709 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:12:15.325446  5234 tablet_bootstrap.cc:492] T cb23991ab8504ee491f905a4346edee9 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:15.344345  5234 tablet_bootstrap.cc:492] T cb23991ab8504ee491f905a4346edee9 P 06ec58698d5444caaecea433c8419770: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:15.345211  5234 tablet_bootstrap.cc:492] T cb23991ab8504ee491f905a4346edee9 P 06ec58698d5444caaecea433c8419770: Bootstrap complete.
I20260709 13:12:15.345789  5234 ts_tablet_manager.cc:1403] T cb23991ab8504ee491f905a4346edee9 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.000s
I20260709 13:12:15.348111  5234 raft_consensus.cc:359] T cb23991ab8504ee491f905a4346edee9 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:15.348740  5234 raft_consensus.cc:740] T cb23991ab8504ee491f905a4346edee9 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:15.349372  5234 consensus_queue.cc:260] T cb23991ab8504ee491f905a4346edee9 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:15.351135  5234 ts_tablet_manager.cc:1434] T cb23991ab8504ee491f905a4346edee9 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:12:15.351868  5234 tablet_bootstrap.cc:492] T 3d38413c5dce44db8a755b48adacc3a8 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:15.363581  5096 raft_consensus.cc:493] T 47d66fc2153d419082eccd7e30643d56 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.364130  5096 raft_consensus.cc:515] T 47d66fc2153d419082eccd7e30643d56 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:15.366519  5234 tablet_bootstrap.cc:492] T 3d38413c5dce44db8a755b48adacc3a8 P 06ec58698d5444caaecea433c8419770: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:15.367445  5234 tablet_bootstrap.cc:492] T 3d38413c5dce44db8a755b48adacc3a8 P 06ec58698d5444caaecea433c8419770: Bootstrap complete.
I20260709 13:12:15.368068  5234 ts_tablet_manager.cc:1403] T 3d38413c5dce44db8a755b48adacc3a8 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.016s	user 0.016s	sys 0.000s
I20260709 13:12:15.369380  4485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d66fc2153d419082eccd7e30643d56" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:15.370541  5234 raft_consensus.cc:359] T 3d38413c5dce44db8a755b48adacc3a8 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:15.371285  5234 raft_consensus.cc:740] T 3d38413c5dce44db8a755b48adacc3a8 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:15.372087  5234 consensus_queue.cc:260] T 3d38413c5dce44db8a755b48adacc3a8 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:15.374125  5234 ts_tablet_manager.cc:1434] T 3d38413c5dce44db8a755b48adacc3a8 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:12:15.374949  5234 tablet_bootstrap.cc:492] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:15.375224  5030 raft_consensus.cc:493] T f7682a3f7f134c34a24488586461f6a4 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.375741  5030 raft_consensus.cc:515] T f7682a3f7f134c34a24488586461f6a4 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:15.377743  5030 leader_election.cc:290] T f7682a3f7f134c34a24488586461f6a4 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:15.380101  4556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7682a3f7f134c34a24488586461f6a4" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:15.384152  5099 raft_consensus.cc:493] T 3f696298fcc049c08b47cd54f901be0c P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.400683  5099 raft_consensus.cc:515] T 3f696298fcc049c08b47cd54f901be0c P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:15.402701  5099 leader_election.cc:290] T 3f696298fcc049c08b47cd54f901be0c P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:15.385341  5056 raft_consensus.cc:493] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.403755  5056 raft_consensus.cc:515] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:15.405447  5056 leader_election.cc:290] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:15.390769  5112 raft_consensus.cc:493] T 812a1b53a40e469c89b5f2aba8c59780 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.409657  5112 raft_consensus.cc:515] T 812a1b53a40e469c89b5f2aba8c59780 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
W20260709 13:12:15.413569  4455 leader_election.cc:336] T f7682a3f7f134c34a24488586461f6a4 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:15.414009  4455 leader_election.cc:304] T f7682a3f7f134c34a24488586461f6a4 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa0ff974118b465eaa785b8a86057e87; no voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424
I20260709 13:12:15.414767  5030 raft_consensus.cc:2749] T f7682a3f7f134c34a24488586461f6a4 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:15.420079  5096 leader_election.cc:290] T 47d66fc2153d419082eccd7e30643d56 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
W20260709 13:12:15.420601  4529 leader_election.cc:336] T 47d66fc2153d419082eccd7e30643d56 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:15.422547  4529 leader_election.cc:304] T 47d66fc2153d419082eccd7e30643d56 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424; no voters: 06ec58698d5444caaecea433c8419770, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:15.423525  5234 tablet_bootstrap.cc:492] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:15.424521  5234 tablet_bootstrap.cc:492] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770: Bootstrap complete.
I20260709 13:12:15.424844  5096 raft_consensus.cc:2749] T 47d66fc2153d419082eccd7e30643d56 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:15.425196  5234 ts_tablet_manager.cc:1403] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.050s	user 0.022s	sys 0.020s
I20260709 13:12:15.427973  5234 raft_consensus.cc:359] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:15.428633  5234 raft_consensus.cc:740] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:15.429427  5234 consensus_queue.cc:260] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:15.411573  5112 leader_election.cc:290] T 812a1b53a40e469c89b5f2aba8c59780 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:15.431138  4636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f696298fcc049c08b47cd54f901be0c" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:15.431629  5234 ts_tablet_manager.cc:1434] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:12:15.431759  4636 raft_consensus.cc:2468] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 1.
I20260709 13:12:15.432519  5234 tablet_bootstrap.cc:492] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:15.432816 29364 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:12:15.433167 29364 ts_tablet_manager.cc:595] Time spent register tablets: real 0.301s	user 0.240s	sys 0.002s
I20260709 13:12:15.436295  4556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f696298fcc049c08b47cd54f901be0c" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:15.436949  4556 raft_consensus.cc:2468] T 3f696298fcc049c08b47cd54f901be0c P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 1.
I20260709 13:12:15.443073  4556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812a1b53a40e469c89b5f2aba8c59780" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:15.445290  5096 raft_consensus.cc:493] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.445869  5096 raft_consensus.cc:515] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:15.448818  5030 raft_consensus.cc:493] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.449492  5030 raft_consensus.cc:515] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:15.454687  5234 tablet_bootstrap.cc:492] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:15.455370  5030 leader_election.cc:290] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:15.455662  5234 tablet_bootstrap.cc:492] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770: Bootstrap complete.
I20260709 13:12:15.456514  5234 ts_tablet_manager.cc:1403] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.024s	user 0.019s	sys 0.004s
I20260709 13:12:15.456389  4556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca87a1b3c8043529d7a9d61b0adfdbf" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:15.459321  5234 raft_consensus.cc:359] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:15.459438  5112 raft_consensus.cc:493] T d088694ef66442bdbf75cc7fc1942a83 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.460058  5234 raft_consensus.cc:740] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:15.460769  5112 raft_consensus.cc:515] T d088694ef66442bdbf75cc7fc1942a83 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:15.461223  5234 consensus_queue.cc:260] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:15.462888  5238 raft_consensus.cc:493] T 604a93ed898f4ab9b771487bfe278b33 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.463337  5234 ts_tablet_manager.cc:1434] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:12:15.464175  5234 tablet_bootstrap.cc:492] T d1119afee9d6413aa2cd229073ffbcf1 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:15.463380  5238 raft_consensus.cc:515] T 604a93ed898f4ab9b771487bfe278b33 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:15.467543  5238 leader_election.cc:290] T 604a93ed898f4ab9b771487bfe278b33 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:15.471391  4602 leader_election.cc:304] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc; no voters: 
I20260709 13:12:15.472815  5216 raft_consensus.cc:2804] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:15.473388  5216 raft_consensus.cc:493] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.473929  5216 raft_consensus.cc:3060] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.477530  4556 raft_consensus.cc:2468] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 1.
I20260709 13:12:15.482287  4454 leader_election.cc:304] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:15.483896  5030 raft_consensus.cc:2804] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:15.484661  5234 tablet_bootstrap.cc:492] T d1119afee9d6413aa2cd229073ffbcf1 P 06ec58698d5444caaecea433c8419770: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:15.485744  5234 tablet_bootstrap.cc:492] T d1119afee9d6413aa2cd229073ffbcf1 P 06ec58698d5444caaecea433c8419770: Bootstrap complete.
I20260709 13:12:15.486399  5234 ts_tablet_manager.cc:1403] T d1119afee9d6413aa2cd229073ffbcf1 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.004s
I20260709 13:12:15.489249  4529 leader_election.cc:304] T 3f696298fcc049c08b47cd54f901be0c P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc; no voters: 
I20260709 13:12:15.489472  5234 raft_consensus.cc:359] T d1119afee9d6413aa2cd229073ffbcf1 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:15.490208  5234 raft_consensus.cc:740] T d1119afee9d6413aa2cd229073ffbcf1 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:15.490506  5214 raft_consensus.cc:493] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.484452  5030 raft_consensus.cc:493] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.491035  5214 raft_consensus.cc:515] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:15.491080  5234 consensus_queue.cc:260] T d1119afee9d6413aa2cd229073ffbcf1 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:15.491758  5030 raft_consensus.cc:3060] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.493193  5214 leader_election.cc:290] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:15.493536  5234 ts_tablet_manager.cc:1434] T d1119afee9d6413aa2cd229073ffbcf1 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:15.494391  5234 tablet_bootstrap.cc:492] T 002595643d984c1c915975d4c4ace485 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:15.494542  5214 raft_consensus.cc:2804] T 3f696298fcc049c08b47cd54f901be0c P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:15.494927  5214 raft_consensus.cc:493] T 3f696298fcc049c08b47cd54f901be0c P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.495258  5214 raft_consensus.cc:3060] T 3f696298fcc049c08b47cd54f901be0c P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.495944  5096 leader_election.cc:290] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:15.496804  4636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604a93ed898f4ab9b771487bfe278b33" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:15.498231  5112 leader_election.cc:290] T d088694ef66442bdbf75cc7fc1942a83 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:15.501207  4556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d088694ef66442bdbf75cc7fc1942a83" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
W20260709 13:12:15.501473  4529 leader_election.cc:336] T 3f696298fcc049c08b47cd54f901be0c P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
W20260709 13:12:15.505690  4529 leader_election.cc:336] T 604a93ed898f4ab9b771487bfe278b33 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:15.506199  4529 leader_election.cc:304] T 604a93ed898f4ab9b771487bfe278b33 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424; no voters: 06ec58698d5444caaecea433c8419770, 74758684df5649ccadd1e189eaff32dc
W20260709 13:12:15.508404  4529 leader_election.cc:336] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
W20260709 13:12:15.511521  4603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:45987, user_credentials={real_user=slave}} blocked reactor thread for 113569us
I20260709 13:12:15.509501  5238 raft_consensus.cc:2749] T 604a93ed898f4ab9b771487bfe278b33 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:15.524194  5096 raft_consensus.cc:493] T b6256e4aa07c45c78b2bbff56a852078 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.524860  5096 raft_consensus.cc:515] T b6256e4aa07c45c78b2bbff56a852078 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:15.527434  5096 leader_election.cc:290] T b6256e4aa07c45c78b2bbff56a852078 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:15.530418  5030 raft_consensus.cc:515] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:15.530777  5214 raft_consensus.cc:515] T 3f696298fcc049c08b47cd54f901be0c P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:15.538851  5216 raft_consensus.cc:515] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:15.543217  5030 leader_election.cc:290] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 election: Requested vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
W20260709 13:12:15.560672  4455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:42711, user_credentials={real_user=slave}} blocked reactor thread for 52075.5us
I20260709 13:12:15.561450  5096 raft_consensus.cc:493] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.544700  4556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca87a1b3c8043529d7a9d61b0adfdbf" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:15.562073  5096 raft_consensus.cc:515] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:15.564160  5096 leader_election.cc:290] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:15.562395  4556 raft_consensus.cc:3060] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.566008  5234 tablet_bootstrap.cc:492] T 002595643d984c1c915975d4c4ace485 P 06ec58698d5444caaecea433c8419770: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:12:15.581208  4603 leader_election.cc:336] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
W20260709 13:12:15.582306  4603 leader_election.cc:336] T 812a1b53a40e469c89b5f2aba8c59780 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:15.582798  4603 leader_election.cc:304] T 812a1b53a40e469c89b5f2aba8c59780 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc; no voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424
I20260709 13:12:15.586287  5234 tablet_bootstrap.cc:492] T 002595643d984c1c915975d4c4ace485 P 06ec58698d5444caaecea433c8419770: Bootstrap complete.
I20260709 13:12:15.587255  5234 ts_tablet_manager.cc:1403] T 002595643d984c1c915975d4c4ace485 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.093s	user 0.020s	sys 0.004s
I20260709 13:12:15.585628  5112 raft_consensus.cc:2749] T 812a1b53a40e469c89b5f2aba8c59780 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:15.593147  5216 leader_election.cc:290] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 election: Requested vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:15.598140  4556 raft_consensus.cc:2468] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 2.
I20260709 13:12:15.597988  5234 raft_consensus.cc:359] T 002595643d984c1c915975d4c4ace485 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:15.598897  5234 raft_consensus.cc:740] T 002595643d984c1c915975d4c4ace485 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:15.599439  4485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7682a3f7f134c34a24488586461f6a4" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:15.600066  4485 raft_consensus.cc:2468] T f7682a3f7f134c34a24488586461f6a4 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 1.
I20260709 13:12:15.600394  5214 leader_election.cc:290] T 3f696298fcc049c08b47cd54f901be0c P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 election: Requested vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:15.600580  4482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca87a1b3c8043529d7a9d61b0adfdbf" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:15.601400  4482 raft_consensus.cc:2393] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 420a61707e804ce5b3773a91cc2eb424 in current term 2: Already voted for candidate aa0ff974118b465eaa785b8a86057e87 in this term.
W20260709 13:12:15.601804  4455 leader_election.cc:336] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:15.599989  5234 consensus_queue.cc:260] T 002595643d984c1c915975d4c4ace485 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:15.603760  5234 ts_tablet_manager.cc:1434] T 002595643d984c1c915975d4c4ace485 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:12:15.603958  4454 leader_election.cc:304] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:15.604562  5234 tablet_bootstrap.cc:492] T 150545c47e0642229a92ede96db14fc9 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
W20260709 13:12:15.605791  4529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:42711, user_credentials={real_user=slave}} blocked reactor thread for 93859.4us
I20260709 13:12:15.606506  5260 raft_consensus.cc:493] T 47d66fc2153d419082eccd7e30643d56 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.606102  5237 raft_consensus.cc:2804] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:15.608172  5260 raft_consensus.cc:515] T 47d66fc2153d419082eccd7e30643d56 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:15.608944  5237 raft_consensus.cc:697] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [term 2 LEADER]: Becoming Leader. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Running, Role: LEADER
I20260709 13:12:15.610116  4633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fb0d1b4ae14754aa30516d12cdea3d" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:15.610520  5260 leader_election.cc:290] T 47d66fc2153d419082eccd7e30643d56 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:15.609905  5237 consensus_queue.cc:237] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:15.617074  4558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d66fc2153d419082eccd7e30643d56" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:15.617651  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f696298fcc049c08b47cd54f901be0c" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:15.617758  4558 raft_consensus.cc:2468] T 47d66fc2153d419082eccd7e30643d56 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 1.
I20260709 13:12:15.618353  4563 raft_consensus.cc:2393] T 3f696298fcc049c08b47cd54f901be0c P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 74758684df5649ccadd1e189eaff32dc in current term 2: Already voted for candidate 420a61707e804ce5b3773a91cc2eb424 in this term.
I20260709 13:12:15.619863  4636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f696298fcc049c08b47cd54f901be0c" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:15.620599  4636 raft_consensus.cc:2393] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 420a61707e804ce5b3773a91cc2eb424 in current term 2: Already voted for candidate 74758684df5649ccadd1e189eaff32dc in this term.
W20260709 13:12:15.625125  4529 leader_election.cc:336] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
W20260709 13:12:15.610076  4603 leader_election.cc:336] T d088694ef66442bdbf75cc7fc1942a83 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:15.628451  4603 leader_election.cc:304] T d088694ef66442bdbf75cc7fc1942a83 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc; no voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424
I20260709 13:12:15.629297  5112 raft_consensus.cc:2749] T d088694ef66442bdbf75cc7fc1942a83 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:15.630124  5112 raft_consensus.cc:493] T 09294b866578436a827c27702d4b1d0b P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.630559  5112 raft_consensus.cc:515] T 09294b866578436a827c27702d4b1d0b P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
W20260709 13:12:15.631701  4603 leader_election.cc:336] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:15.632499  4454 leader_election.cc:304] T 47d66fc2153d419082eccd7e30643d56 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:15.632790  5112 leader_election.cc:290] T 09294b866578436a827c27702d4b1d0b P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:15.633647  5259 raft_consensus.cc:2804] T 47d66fc2153d419082eccd7e30643d56 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:15.634299  5259 raft_consensus.cc:493] T 47d66fc2153d419082eccd7e30643d56 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.634683  5259 raft_consensus.cc:3060] T 47d66fc2153d419082eccd7e30643d56 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.635422  4486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09294b866578436a827c27702d4b1d0b" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:15.639279  4602 leader_election.cc:304] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc; no voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424
I20260709 13:12:15.640372  5247 raft_consensus.cc:2749] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:12:15.640552  4603 leader_election.cc:336] T 09294b866578436a827c27702d4b1d0b P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:15.642160  4603 leader_election.cc:304] T 09294b866578436a827c27702d4b1d0b P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc; no voters: 06ec58698d5444caaecea433c8419770, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:15.642524  5259 raft_consensus.cc:515] T 47d66fc2153d419082eccd7e30643d56 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:15.643621  5247 raft_consensus.cc:2749] T 09294b866578436a827c27702d4b1d0b P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:15.644910  5247 raft_consensus.cc:493] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.645519  5247 raft_consensus.cc:515] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:15.648217  5247 leader_election.cc:290] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
W20260709 13:12:15.652594  4603 leader_election.cc:336] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:15.653780  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d66fc2153d419082eccd7e30643d56" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:15.654407  4563 raft_consensus.cc:3060] T 47d66fc2153d419082eccd7e30643d56 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:15.656002  4529 leader_election.cc:336] T b6256e4aa07c45c78b2bbff56a852078 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
W20260709 13:12:15.656710  4529 leader_election.cc:336] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:15.658466  4529 leader_election.cc:304] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424; no voters: 06ec58698d5444caaecea433c8419770, 74758684df5649ccadd1e189eaff32dc
I20260709 13:12:15.661465  5259 leader_election.cc:290] T 47d66fc2153d419082eccd7e30643d56 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 election: Requested vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:15.662382  4563 raft_consensus.cc:2468] T 47d66fc2153d419082eccd7e30643d56 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 2.
I20260709 13:12:15.663616  4454 leader_election.cc:304] T 47d66fc2153d419082eccd7e30643d56 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:15.664419  5265 raft_consensus.cc:2749] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:15.664495  5260 raft_consensus.cc:2804] T 47d66fc2153d419082eccd7e30643d56 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:15.665307  5260 raft_consensus.cc:697] T 47d66fc2153d419082eccd7e30643d56 P aa0ff974118b465eaa785b8a86057e87 [term 2 LEADER]: Becoming Leader. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Running, Role: LEADER
I20260709 13:12:15.666115  5260 consensus_queue.cc:237] T 47d66fc2153d419082eccd7e30643d56 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:15.668440  5234 tablet_bootstrap.cc:492] T 150545c47e0642229a92ede96db14fc9 P 06ec58698d5444caaecea433c8419770: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:15.669494  5234 tablet_bootstrap.cc:492] T 150545c47e0642229a92ede96db14fc9 P 06ec58698d5444caaecea433c8419770: Bootstrap complete.
I20260709 13:12:15.670251  5234 ts_tablet_manager.cc:1403] T 150545c47e0642229a92ede96db14fc9 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.066s	user 0.029s	sys 0.020s
W20260709 13:12:15.670961  4529 leader_election.cc:336] T 3f696298fcc049c08b47cd54f901be0c P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
W20260709 13:12:15.671115  4455 leader_election.cc:336] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:15.671409  4529 leader_election.cc:304] T 3f696298fcc049c08b47cd54f901be0c P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424; no voters: 06ec58698d5444caaecea433c8419770, 74758684df5649ccadd1e189eaff32dc
I20260709 13:12:15.673187  5234 raft_consensus.cc:359] T 150545c47e0642229a92ede96db14fc9 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:15.674057  5234 raft_consensus.cc:740] T 150545c47e0642229a92ede96db14fc9 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:15.674563  5265 raft_consensus.cc:2749] T 3f696298fcc049c08b47cd54f901be0c P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:15.675014  5234 consensus_queue.cc:260] T 150545c47e0642229a92ede96db14fc9 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:15.676720  5260 raft_consensus.cc:493] T a16334f2dff74513ba7ca22ca8fb5afd P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.677232  5260 raft_consensus.cc:515] T a16334f2dff74513ba7ca22ca8fb5afd P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:15.677945  5234 ts_tablet_manager.cc:1434] T 150545c47e0642229a92ede96db14fc9 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:15.678999  5234 tablet_bootstrap.cc:492] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:15.679526  4529 leader_election.cc:304] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 06ec58698d5444caaecea433c8419770
I20260709 13:12:15.680768  4482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6256e4aa07c45c78b2bbff56a852078" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:15.679018  5260 leader_election.cc:290] T a16334f2dff74513ba7ca22ca8fb5afd P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
W20260709 13:12:15.680927  4455 leader_election.cc:336] T 47d66fc2153d419082eccd7e30643d56 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:15.682940  5265 raft_consensus.cc:2804] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:15.683879  4636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a16334f2dff74513ba7ca22ca8fb5afd" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:15.683341  5265 raft_consensus.cc:493] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.684976  5265 raft_consensus.cc:3060] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:15.686848  4455 leader_election.cc:336] T 47d66fc2153d419082eccd7e30643d56 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:15.690438  4310 catalog_manager.cc:5697] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 reported cstate change: term changed from 1 to 2, leader changed from 06ec58698d5444caaecea433c8419770 (127.28.173.1) to aa0ff974118b465eaa785b8a86057e87 (127.28.173.2). New cstate: current_term: 2 leader_uuid: "aa0ff974118b465eaa785b8a86057e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:15.692489  5265 raft_consensus.cc:515] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:15.694481  5265 leader_election.cc:290] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 election: Requested vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:15.695477  4529 leader_election.cc:304] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424; no voters: 06ec58698d5444caaecea433c8419770, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:15.696702  5096 raft_consensus.cc:2749] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:15.697283  4529 leader_election.cc:304] T b6256e4aa07c45c78b2bbff56a852078 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424; no voters: 06ec58698d5444caaecea433c8419770, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:15.698186  5096 raft_consensus.cc:2749] T b6256e4aa07c45c78b2bbff56a852078 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:15.701501  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fb0d1b4ae14754aa30516d12cdea3d" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:15.702312  4563 raft_consensus.cc:2468] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 1.
I20260709 13:12:15.705540  4602 leader_election.cc:304] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc; no voters: 06ec58698d5444caaecea433c8419770
I20260709 13:12:15.706718  4482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7682a3f7f134c34a24488586461f6a4" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:15.707307  4482 raft_consensus.cc:3060] T f7682a3f7f134c34a24488586461f6a4 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:15.708178  4455 leader_election.cc:336] T a16334f2dff74513ba7ca22ca8fb5afd P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:15.705792  5260 raft_consensus.cc:493] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.708608  4455 leader_election.cc:304] T a16334f2dff74513ba7ca22ca8fb5afd P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa0ff974118b465eaa785b8a86057e87; no voters: 06ec58698d5444caaecea433c8419770, 74758684df5649ccadd1e189eaff32dc
I20260709 13:12:15.709128  5260 raft_consensus.cc:515] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:15.711251  5247 raft_consensus.cc:2804] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:15.711257  5259 raft_consensus.cc:2749] T a16334f2dff74513ba7ca22ca8fb5afd P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:15.711669  5247 raft_consensus.cc:493] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.712198  5247 raft_consensus.cc:3060] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.712002  5260 leader_election.cc:290] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:15.716266  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dbb9c8f1ac4eca802b0c887a4d1c27" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
W20260709 13:12:15.717270  4455 leader_election.cc:336] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:15.715572  4482 raft_consensus.cc:2468] T f7682a3f7f134c34a24488586461f6a4 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 2.
I20260709 13:12:15.718086  4454 leader_election.cc:304] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa0ff974118b465eaa785b8a86057e87; no voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424
I20260709 13:12:15.719261  5259 raft_consensus.cc:2749] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:15.722997  4529 leader_election.cc:304] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 
W20260709 13:12:15.723964  4529 leader_election.cc:336] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:15.724027  5258 raft_consensus.cc:493] T 150545c47e0642229a92ede96db14fc9 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.724901  5265 raft_consensus.cc:2804] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:15.724730  5258 raft_consensus.cc:515] T 150545c47e0642229a92ede96db14fc9 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:15.725410  5265 raft_consensus.cc:697] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [term 2 LEADER]: Becoming Leader. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Running, Role: LEADER
I20260709 13:12:15.727372  5265 consensus_queue.cc:237] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:15.727859  5096 raft_consensus.cc:493] T b731fe02a6f4441e816628760bfdfb54 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.728358  5096 raft_consensus.cc:515] T b731fe02a6f4441e816628760bfdfb54 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:15.727629  5258 leader_election.cc:290] T 150545c47e0642229a92ede96db14fc9 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:15.730312  5096 leader_election.cc:290] T b731fe02a6f4441e816628760bfdfb54 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:15.735852  4636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b731fe02a6f4441e816628760bfdfb54" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:15.736228  4482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "150545c47e0642229a92ede96db14fc9" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:15.740204  5096 raft_consensus.cc:493] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.740967  5096 raft_consensus.cc:515] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:15.743778  5096 leader_election.cc:290] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:15.748867  4482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0608a8abe6c4bd083d751020218957e" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:15.749257  5234 tablet_bootstrap.cc:492] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:15.750349  5234 tablet_bootstrap.cc:492] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770: Bootstrap complete.
W20260709 13:12:15.751032  4529 leader_election.cc:336] T 150545c47e0642229a92ede96db14fc9 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:15.751477  5234 ts_tablet_manager.cc:1403] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.073s	user 0.021s	sys 0.003s
I20260709 13:12:15.751494  4529 leader_election.cc:304] T 150545c47e0642229a92ede96db14fc9 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424; no voters: 06ec58698d5444caaecea433c8419770, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:15.753750  5265 raft_consensus.cc:2749] T 150545c47e0642229a92ede96db14fc9 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:15.754444  5265 raft_consensus.cc:493] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.754540  5234 raft_consensus.cc:359] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:15.754912  5265 raft_consensus.cc:515] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:15.755362  5234 raft_consensus.cc:740] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:15.756187  5234 consensus_queue.cc:260] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:15.757210  5265 leader_election.cc:290] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
W20260709 13:12:15.758111  4529 leader_election.cc:336] T b731fe02a6f4441e816628760bfdfb54 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:15.758571  5234 ts_tablet_manager.cc:1434] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:15.759557  5234 tablet_bootstrap.cc:492] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:15.758539  4529 leader_election.cc:304] T b731fe02a6f4441e816628760bfdfb54 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424; no voters: 06ec58698d5444caaecea433c8419770, 74758684df5649ccadd1e189eaff32dc
I20260709 13:12:15.764282  5265 raft_consensus.cc:2749] T b731fe02a6f4441e816628760bfdfb54 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:15.767230  5247 raft_consensus.cc:515] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:15.769670  5247 leader_election.cc:290] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 election: Requested vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:15.773248  4482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20be30df26724e7f98f3b36f24e4df3a" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:15.774520  5265 raft_consensus.cc:493] T d088694ef66442bdbf75cc7fc1942a83 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.775101  5265 raft_consensus.cc:515] T d088694ef66442bdbf75cc7fc1942a83 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:15.777205  5265 leader_election.cc:290] T d088694ef66442bdbf75cc7fc1942a83 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:15.777707  4308 catalog_manager.cc:5697] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 reported cstate change: term changed from 1 to 2, leader changed from 06ec58698d5444caaecea433c8419770 (127.28.173.1) to 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3). New cstate: current_term: 2 leader_uuid: "420a61707e804ce5b3773a91cc2eb424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:15.779349  4529 leader_election.cc:336] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
W20260709 13:12:15.779667  4603 leader_election.cc:336] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:15.779937  5247 raft_consensus.cc:493] T 604a93ed898f4ab9b771487bfe278b33 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.779875  4529 leader_election.cc:304] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424; no voters: 06ec58698d5444caaecea433c8419770, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:15.780821  5265 raft_consensus.cc:2749] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:15.787106  4636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d088694ef66442bdbf75cc7fc1942a83" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:15.787676  4636 raft_consensus.cc:2468] T d088694ef66442bdbf75cc7fc1942a83 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 1.
I20260709 13:12:15.789150  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fb0d1b4ae14754aa30516d12cdea3d" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:15.789865  4563 raft_consensus.cc:3060] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:15.790014  4529 leader_election.cc:336] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:15.791373  5112 raft_consensus.cc:493] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.790561  4529 leader_election.cc:304] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424; no voters: 06ec58698d5444caaecea433c8419770, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:15.792462  5265 raft_consensus.cc:2749] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:15.794265  4529 leader_election.cc:304] T d088694ef66442bdbf75cc7fc1942a83 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc; no voters: 
I20260709 13:12:15.792249  5112 raft_consensus.cc:515] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:15.797700  5265 raft_consensus.cc:2804] T d088694ef66442bdbf75cc7fc1942a83 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:15.798080  5265 raft_consensus.cc:493] T d088694ef66442bdbf75cc7fc1942a83 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.798439  5265 raft_consensus.cc:3060] T d088694ef66442bdbf75cc7fc1942a83 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.799891  5256 raft_consensus.cc:493] T 5b827ee48d56478398f009c3fa980016 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.800279  4563 raft_consensus.cc:2468] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 2.
I20260709 13:12:15.800414  5256 raft_consensus.cc:515] T 5b827ee48d56478398f009c3fa980016 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:15.802594  5256 leader_election.cc:290] T 5b827ee48d56478398f009c3fa980016 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:15.804308  4310 catalog_manager.cc:5697] T 47d66fc2153d419082eccd7e30643d56 P aa0ff974118b465eaa785b8a86057e87 reported cstate change: term changed from 1 to 2, leader changed from 06ec58698d5444caaecea433c8419770 (127.28.173.1) to aa0ff974118b465eaa785b8a86057e87 (127.28.173.2). New cstate: current_term: 2 leader_uuid: "aa0ff974118b465eaa785b8a86057e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:15.806840  4482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b827ee48d56478398f009c3fa980016" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:15.809321  4602 leader_election.cc:304] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc; no voters: 06ec58698d5444caaecea433c8419770
I20260709 13:12:15.811074  5216 raft_consensus.cc:2804] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:15.807049  5265 raft_consensus.cc:515] T d088694ef66442bdbf75cc7fc1942a83 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
W20260709 13:12:15.811299  4529 leader_election.cc:336] T d088694ef66442bdbf75cc7fc1942a83 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:15.811885  5216 raft_consensus.cc:697] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [term 2 LEADER]: Becoming Leader. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Running, Role: LEADER
I20260709 13:12:15.815001  5216 consensus_queue.cc:237] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:15.816440  5265 leader_election.cc:290] T d088694ef66442bdbf75cc7fc1942a83 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 election: Requested vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:15.817052  4633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d088694ef66442bdbf75cc7fc1942a83" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:15.813061  5260 raft_consensus.cc:493] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.813241  5096 raft_consensus.cc:493] T 9d526ab043434bf0bcab814f9bbc3234 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.817687  4633 raft_consensus.cc:3060] T d088694ef66442bdbf75cc7fc1942a83 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.818080  5260 raft_consensus.cc:515] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:15.818185  5096 raft_consensus.cc:515] T 9d526ab043434bf0bcab814f9bbc3234 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:15.820349  5096 leader_election.cc:290] T 9d526ab043434bf0bcab814f9bbc3234 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:15.822806  4482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d526ab043434bf0bcab814f9bbc3234" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:15.809443  5112 leader_election.cc:290] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
W20260709 13:12:15.830835  4455 leader_election.cc:336] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:15.833998  4633 raft_consensus.cc:2468] T d088694ef66442bdbf75cc7fc1942a83 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 2.
W20260709 13:12:15.834585  4529 leader_election.cc:336] T 9d526ab043434bf0bcab814f9bbc3234 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:15.834486  5247 raft_consensus.cc:515] T 604a93ed898f4ab9b771487bfe278b33 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:15.835189  5234 tablet_bootstrap.cc:492] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 06ec58698d5444caaecea433c8419770: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:15.835175  4529 leader_election.cc:304] T 9d526ab043434bf0bcab814f9bbc3234 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424; no voters: 06ec58698d5444caaecea433c8419770, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:15.836195  5096 raft_consensus.cc:2749] T 9d526ab043434bf0bcab814f9bbc3234 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:15.836374  5234 tablet_bootstrap.cc:492] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 06ec58698d5444caaecea433c8419770: Bootstrap complete.
W20260709 13:12:15.836370  4529 leader_election.cc:336] T d088694ef66442bdbf75cc7fc1942a83 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:15.837088  5234 ts_tablet_manager.cc:1403] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.078s	user 0.017s	sys 0.000s
I20260709 13:12:15.838243  4529 leader_election.cc:304] T d088694ef66442bdbf75cc7fc1942a83 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc; no voters: 06ec58698d5444caaecea433c8419770
I20260709 13:12:15.839044  5260 leader_election.cc:290] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:15.839159  5096 raft_consensus.cc:2804] T d088694ef66442bdbf75cc7fc1942a83 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:15.839939  5096 raft_consensus.cc:697] T d088694ef66442bdbf75cc7fc1942a83 P 420a61707e804ce5b3773a91cc2eb424 [term 2 LEADER]: Becoming Leader. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Running, Role: LEADER
I20260709 13:12:15.839685  5234 raft_consensus.cc:359] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:15.840732  4482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a16334f2dff74513ba7ca22ca8fb5afd" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:15.840791  5096 consensus_queue.cc:237] T d088694ef66442bdbf75cc7fc1942a83 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:15.844811  4482 raft_consensus.cc:2468] T a16334f2dff74513ba7ca22ca8fb5afd P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 1.
I20260709 13:12:15.845484  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0608a8abe6c4bd083d751020218957e" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:15.845837  4558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604a93ed898f4ab9b771487bfe278b33" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:15.846099  4563 raft_consensus.cc:2468] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 1.
I20260709 13:12:15.846499  4558 raft_consensus.cc:2468] T 604a93ed898f4ab9b771487bfe278b33 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 1.
I20260709 13:12:15.844029  5247 leader_election.cc:290] T 604a93ed898f4ab9b771487bfe278b33 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:15.847573  4602 leader_election.cc:304] T 604a93ed898f4ab9b771487bfe278b33 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc; no voters: 
I20260709 13:12:15.848093  4454 leader_election.cc:304] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 06ec58698d5444caaecea433c8419770
I20260709 13:12:15.849047  5259 raft_consensus.cc:2804] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:15.849416  5259 raft_consensus.cc:493] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.849782  5259 raft_consensus.cc:3060] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.849576  5238 raft_consensus.cc:493] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.852141  5238 raft_consensus.cc:515] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:15.852743  5260 raft_consensus.cc:493] T 150545c47e0642229a92ede96db14fc9 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.853302  5260 raft_consensus.cc:515] T 150545c47e0642229a92ede96db14fc9 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:15.854157  5238 leader_election.cc:290] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
W20260709 13:12:15.843016  4603 leader_election.cc:336] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
W20260709 13:12:15.855840  4603 leader_election.cc:336] T 5b827ee48d56478398f009c3fa980016 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:15.856460  5112 raft_consensus.cc:2804] T 604a93ed898f4ab9b771487bfe278b33 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:15.859189  5112 raft_consensus.cc:493] T 604a93ed898f4ab9b771487bfe278b33 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.858548  4603 leader_election.cc:304] T 5b827ee48d56478398f009c3fa980016 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc; no voters: 06ec58698d5444caaecea433c8419770, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:15.840404  5234 raft_consensus.cc:740] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:15.859602  5112 raft_consensus.cc:3060] T 604a93ed898f4ab9b771487bfe278b33 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.859215  5238 raft_consensus.cc:493] T 812a1b53a40e469c89b5f2aba8c59780 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.860558  5238 raft_consensus.cc:515] T 812a1b53a40e469c89b5f2aba8c59780 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:15.862130  5234 consensus_queue.cc:260] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:15.864233  5256 raft_consensus.cc:493] T 1503964d57034b31b36eecc16f2c84a0 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.866559  4482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dbb9c8f1ac4eca802b0c887a4d1c27" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:15.864843  5256 raft_consensus.cc:515] T 1503964d57034b31b36eecc16f2c84a0 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:15.867087  5056 raft_consensus.cc:2749] T 5b827ee48d56478398f009c3fa980016 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:15.867218  4482 raft_consensus.cc:2468] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 1.
I20260709 13:12:15.868785  5237 raft_consensus.cc:493] T b6256e4aa07c45c78b2bbff56a852078 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.869468  5237 raft_consensus.cc:515] T b6256e4aa07c45c78b2bbff56a852078 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:15.870584  5263 raft_consensus.cc:493] T 1503964d57034b31b36eecc16f2c84a0 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.871073  5263 raft_consensus.cc:515] T 1503964d57034b31b36eecc16f2c84a0 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:15.871580  5030 raft_consensus.cc:493] T 9d526ab043434bf0bcab814f9bbc3234 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.869745  4558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "150545c47e0642229a92ede96db14fc9" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:15.872148  5030 raft_consensus.cc:515] T 9d526ab043434bf0bcab814f9bbc3234 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:15.872709  4558 raft_consensus.cc:2468] T 150545c47e0642229a92ede96db14fc9 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 1.
I20260709 13:12:15.874219  4454 leader_election.cc:304] T 150545c47e0642229a92ede96db14fc9 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:15.875037  5261 raft_consensus.cc:2804] T 150545c47e0642229a92ede96db14fc9 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:15.875418  5261 raft_consensus.cc:493] T 150545c47e0642229a92ede96db14fc9 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.875581  4603 leader_election.cc:304] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87; no voters: 06ec58698d5444caaecea433c8419770
I20260709 13:12:15.876336  5056 raft_consensus.cc:2804] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:15.876389  5237 leader_election.cc:290] T b6256e4aa07c45c78b2bbff56a852078 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:15.876825  5056 raft_consensus.cc:493] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.877231  5056 raft_consensus.cc:3060] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.878132  5256 leader_election.cc:290] T 1503964d57034b31b36eecc16f2c84a0 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:15.878887  4558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d526ab043434bf0bcab814f9bbc3234" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:15.879508  4558 raft_consensus.cc:2468] T 9d526ab043434bf0bcab814f9bbc3234 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 1.
I20260709 13:12:15.875990  5263 leader_election.cc:290] T 1503964d57034b31b36eecc16f2c84a0 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:15.875994  5030 leader_election.cc:290] T 9d526ab043434bf0bcab814f9bbc3234 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:15.880445  4633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1503964d57034b31b36eecc16f2c84a0" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:15.881042  4633 raft_consensus.cc:2468] T 1503964d57034b31b36eecc16f2c84a0 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 1.
I20260709 13:12:15.882124  4556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6256e4aa07c45c78b2bbff56a852078" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:15.882738  4556 raft_consensus.cc:2468] T b6256e4aa07c45c78b2bbff56a852078 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 1.
I20260709 13:12:15.881078  5234 ts_tablet_manager.cc:1434] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.044s	user 0.009s	sys 0.000s
I20260709 13:12:15.875770  5261 raft_consensus.cc:3060] T 150545c47e0642229a92ede96db14fc9 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.884684  5234 tablet_bootstrap.cc:492] T d088694ef66442bdbf75cc7fc1942a83 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:15.886186  5259 raft_consensus.cc:515] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:15.889853  5260 leader_election.cc:290] T 150545c47e0642229a92ede96db14fc9 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
W20260709 13:12:15.887434  4455 leader_election.cc:336] T 150545c47e0642229a92ede96db14fc9 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:15.890126  4454 leader_election.cc:304] T 9d526ab043434bf0bcab814f9bbc3234 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 
W20260709 13:12:15.890921  4603 leader_election.cc:336] T 604a93ed898f4ab9b771487bfe278b33 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:15.891180  4454 leader_election.cc:304] T b6256e4aa07c45c78b2bbff56a852078 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:15.888090  5056 raft_consensus.cc:515] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
W20260709 13:12:15.891654  4603 leader_election.cc:336] T 1503964d57034b31b36eecc16f2c84a0 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:15.875029  5238 leader_election.cc:290] T 812a1b53a40e469c89b5f2aba8c59780 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:15.898933  4636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812a1b53a40e469c89b5f2aba8c59780" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:15.900789  4636 raft_consensus.cc:2468] T 812a1b53a40e469c89b5f2aba8c59780 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 1.
I20260709 13:12:15.890074  5259 leader_election.cc:290] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 election: Requested vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:15.898049  4529 leader_election.cc:304] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:15.894807  5237 raft_consensus.cc:2804] T b6256e4aa07c45c78b2bbff56a852078 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:15.905699  4455 leader_election.cc:304] T 1503964d57034b31b36eecc16f2c84a0 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:15.908200  5056 leader_election.cc:290] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 election: Requested vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:15.908260  5237 raft_consensus.cc:493] T b6256e4aa07c45c78b2bbff56a852078 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.908886  5237 raft_consensus.cc:3060] T b6256e4aa07c45c78b2bbff56a852078 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.909341  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0608a8abe6c4bd083d751020218957e" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:15.909891  4563 raft_consensus.cc:3060] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.911051  5030 raft_consensus.cc:493] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.907996  5265 raft_consensus.cc:2804] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:15.911996  5265 raft_consensus.cc:493] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.891197  5260 raft_consensus.cc:2804] T 9d526ab043434bf0bcab814f9bbc3234 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:12:15.906832  4529 leader_election.cc:336] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
W20260709 13:12:15.912555  4455 leader_election.cc:336] T 9d526ab043434bf0bcab814f9bbc3234 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:15.918279  4529 leader_election.cc:304] T 812a1b53a40e469c89b5f2aba8c59780 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc; no voters: 
W20260709 13:12:15.918706  4455 leader_election.cc:336] T 1503964d57034b31b36eecc16f2c84a0 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:15.919133  4563 raft_consensus.cc:2468] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 2.
W20260709 13:12:15.924211  4455 leader_election.cc:336] T b6256e4aa07c45c78b2bbff56a852078 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:15.894658  4482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1503964d57034b31b36eecc16f2c84a0" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:15.912339  5265 raft_consensus.cc:3060] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.913251  5259 raft_consensus.cc:2804] T 1503964d57034b31b36eecc16f2c84a0 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:15.944159  5056 raft_consensus.cc:493] T b731fe02a6f4441e816628760bfdfb54 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.944702  5056 raft_consensus.cc:515] T b731fe02a6f4441e816628760bfdfb54 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:15.911602  5030 raft_consensus.cc:515] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:15.928023  5260 raft_consensus.cc:493] T 9d526ab043434bf0bcab814f9bbc3234 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.934474  5238 raft_consensus.cc:2804] T 812a1b53a40e469c89b5f2aba8c59780 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:15.948706  5238 raft_consensus.cc:493] T 812a1b53a40e469c89b5f2aba8c59780 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.955312  5238 raft_consensus.cc:3060] T 812a1b53a40e469c89b5f2aba8c59780 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.956414  5112 raft_consensus.cc:515] T 604a93ed898f4ab9b771487bfe278b33 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:15.958461  5112 leader_election.cc:290] T 604a93ed898f4ab9b771487bfe278b33 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 election: Requested vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:15.959127  5237 raft_consensus.cc:515] T b6256e4aa07c45c78b2bbff56a852078 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:15.962350  5261 raft_consensus.cc:515] T 150545c47e0642229a92ede96db14fc9 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:15.964110  5056 leader_election.cc:290] T b731fe02a6f4441e816628760bfdfb54 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:15.969223  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "604a93ed898f4ab9b771487bfe278b33" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:15.969985  4563 raft_consensus.cc:3060] T 604a93ed898f4ab9b771487bfe278b33 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.944765  5259 raft_consensus.cc:493] T 1503964d57034b31b36eecc16f2c84a0 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.946642  5099 raft_consensus.cc:493] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.949460  5260 raft_consensus.cc:3060] T 9d526ab043434bf0bcab814f9bbc3234 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.979264  5295 raft_consensus.cc:493] T 09294b866578436a827c27702d4b1d0b P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.978539  5099 raft_consensus.cc:515] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:15.979864  5237 leader_election.cc:290] T b6256e4aa07c45c78b2bbff56a852078 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 election: Requested vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:15.980579  5237 raft_consensus.cc:493] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:15.981029  5237 raft_consensus.cc:515] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:15.981374  5261 leader_election.cc:290] T 150545c47e0642229a92ede96db14fc9 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 election: Requested vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:15.981683  5099 leader_election.cc:290] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:15.981931  5030 leader_election.cc:290] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:15.974992  5259 raft_consensus.cc:3060] T 1503964d57034b31b36eecc16f2c84a0 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.962913  5238 raft_consensus.cc:515] T 812a1b53a40e469c89b5f2aba8c59780 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:15.984647  4485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e466269360c4a538e16c342590490c0" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:15.995632  4485 raft_consensus.cc:2468] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 1.
I20260709 13:12:15.993363  4308 catalog_manager.cc:5697] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc reported cstate change: term changed from 1 to 2, leader changed from 06ec58698d5444caaecea433c8419770 (127.28.173.1) to 74758684df5649ccadd1e189eaff32dc (127.28.173.4). New cstate: current_term: 2 leader_uuid: "74758684df5649ccadd1e189eaff32dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:15.991636  4310 catalog_manager.cc:5697] T d088694ef66442bdbf75cc7fc1942a83 P 420a61707e804ce5b3773a91cc2eb424 reported cstate change: term changed from 1 to 2, leader changed from 06ec58698d5444caaecea433c8419770 (127.28.173.1) to 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3). New cstate: current_term: 2 leader_uuid: "420a61707e804ce5b3773a91cc2eb424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:15.996729  4454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:33159, user_credentials={real_user=slave}} blocked reactor thread for 82967.6us
I20260709 13:12:15.996815  4529 leader_election.cc:304] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:15.985736  4556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b731fe02a6f4441e816628760bfdfb54" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:15.979827  5295 raft_consensus.cc:515] T 09294b866578436a827c27702d4b1d0b P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:16.002540  4556 raft_consensus.cc:2468] T b731fe02a6f4441e816628760bfdfb54 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 1.
I20260709 13:12:16.008373  5096 raft_consensus.cc:2804] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:16.008654  4562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6256e4aa07c45c78b2bbff56a852078" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:16.008960  5096 raft_consensus.cc:493] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:16.009405  4562 raft_consensus.cc:3060] T b6256e4aa07c45c78b2bbff56a852078 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.009477  5096 raft_consensus.cc:3060] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.983065  5237 leader_election.cc:290] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:16.012465  5238 leader_election.cc:290] T 812a1b53a40e469c89b5f2aba8c59780 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 election: Requested vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
W20260709 13:12:16.012759  4455 leader_election.cc:336] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:16.019294  4563 raft_consensus.cc:2468] T 604a93ed898f4ab9b771487bfe278b33 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 2.
I20260709 13:12:16.025347  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "150545c47e0642229a92ede96db14fc9" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:16.025950  4563 raft_consensus.cc:3060] T 150545c47e0642229a92ede96db14fc9 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.022665  4562 raft_consensus.cc:2468] T b6256e4aa07c45c78b2bbff56a852078 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 2.
W20260709 13:12:16.034607  4603 leader_election.cc:336] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:16.037266  4485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a16334f2dff74513ba7ca22ca8fb5afd" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:16.036329  5237 raft_consensus.cc:493] T 5b827ee48d56478398f009c3fa980016 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:16.037827  4485 raft_consensus.cc:3060] T a16334f2dff74513ba7ca22ca8fb5afd P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.038223  5237 raft_consensus.cc:515] T 5b827ee48d56478398f009c3fa980016 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:16.039207  4454 leader_election.cc:304] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 06ec58698d5444caaecea433c8419770
I20260709 13:12:16.040198  5237 leader_election.cc:290] T 5b827ee48d56478398f009c3fa980016 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:16.040309  4454 leader_election.cc:304] T b6256e4aa07c45c78b2bbff56a852078 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:16.040771  5237 raft_consensus.cc:2804] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:16.041235  5237 raft_consensus.cc:697] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [term 2 LEADER]: Becoming Leader. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Running, Role: LEADER
I20260709 13:12:16.041720  5234 tablet_bootstrap.cc:492] T d088694ef66442bdbf75cc7fc1942a83 P 06ec58698d5444caaecea433c8419770: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:16.041940  4562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e466269360c4a538e16c342590490c0" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:16.042608  5234 tablet_bootstrap.cc:492] T d088694ef66442bdbf75cc7fc1942a83 P 06ec58698d5444caaecea433c8419770: Bootstrap complete.
I20260709 13:12:16.042712  4636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09294b866578436a827c27702d4b1d0b" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:16.043273  5234 ts_tablet_manager.cc:1403] T d088694ef66442bdbf75cc7fc1942a83 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.159s	user 0.027s	sys 0.015s
I20260709 13:12:16.043431  5261 raft_consensus.cc:2804] T b6256e4aa07c45c78b2bbff56a852078 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:16.043929  4558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20be30df26724e7f98f3b36f24e4df3a" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:16.044559  4558 raft_consensus.cc:2468] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 1.
I20260709 13:12:16.043972  5261 raft_consensus.cc:697] T b6256e4aa07c45c78b2bbff56a852078 P aa0ff974118b465eaa785b8a86057e87 [term 2 LEADER]: Becoming Leader. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Running, Role: LEADER
I20260709 13:12:16.043290  4636 raft_consensus.cc:2468] T 09294b866578436a827c27702d4b1d0b P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 1.
I20260709 13:12:16.046999  4454 leader_election.cc:304] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:16.049537  5237 consensus_queue.cc:237] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:16.052531  5030 raft_consensus.cc:2804] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:16.052933  5030 raft_consensus.cc:493] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:16.053251  5030 raft_consensus.cc:3060] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.056216  4485 raft_consensus.cc:2468] T a16334f2dff74513ba7ca22ca8fb5afd P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 2.
I20260709 13:12:16.058092  5234 raft_consensus.cc:359] T d088694ef66442bdbf75cc7fc1942a83 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:16.058760  5234 raft_consensus.cc:740] T d088694ef66442bdbf75cc7fc1942a83 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:16.060086  5295 leader_election.cc:290] T 09294b866578436a827c27702d4b1d0b P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:16.060357  5261 consensus_queue.cc:237] T b6256e4aa07c45c78b2bbff56a852078 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
W20260709 13:12:16.062656  4529 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.2:45987, user_credentials={real_user=slave}} blocked reactor thread for 65922.3us
I20260709 13:12:16.059481  5234 consensus_queue.cc:260] T d088694ef66442bdbf75cc7fc1942a83 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
W20260709 13:12:16.064996  4529 leader_election.cc:336] T 812a1b53a40e469c89b5f2aba8c59780 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:16.066485  5234 ts_tablet_manager.cc:1434] T d088694ef66442bdbf75cc7fc1942a83 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:12:16.068003  5234 tablet_bootstrap.cc:492] T aa241e695dbb492a971f537d1f977f21 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:16.068050  4633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b827ee48d56478398f009c3fa980016" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:16.070719  4633 raft_consensus.cc:2468] T 5b827ee48d56478398f009c3fa980016 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 1.
I20260709 13:12:16.070648  4602 leader_election.cc:304] T b731fe02a6f4441e816628760bfdfb54 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc; no voters: 
I20260709 13:12:16.072110  5030 raft_consensus.cc:515] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:16.073164  4563 raft_consensus.cc:2468] T 150545c47e0642229a92ede96db14fc9 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 2.
I20260709 13:12:16.073366  4602 leader_election.cc:304] T 604a93ed898f4ab9b771487bfe278b33 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc; no voters: 
I20260709 13:12:16.074271  5056 raft_consensus.cc:2804] T b731fe02a6f4441e816628760bfdfb54 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:16.074280  4454 leader_election.cc:304] T 150545c47e0642229a92ede96db14fc9 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:16.074662  5056 raft_consensus.cc:493] T b731fe02a6f4441e816628760bfdfb54 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:16.075012  5056 raft_consensus.cc:3060] T b731fe02a6f4441e816628760bfdfb54 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.082087  4636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812a1b53a40e469c89b5f2aba8c59780" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:16.082628  4636 raft_consensus.cc:3060] T 812a1b53a40e469c89b5f2aba8c59780 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.083576  5030 leader_election.cc:290] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 election: Requested vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:16.084509  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20be30df26724e7f98f3b36f24e4df3a" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:16.087262  4563 raft_consensus.cc:3060] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.085837  5247 raft_consensus.cc:2804] T 604a93ed898f4ab9b771487bfe278b33 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:16.082787  5295 raft_consensus.cc:2804] T 150545c47e0642229a92ede96db14fc9 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:16.098923  4563 raft_consensus.cc:2468] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 2.
I20260709 13:12:16.100740  5295 raft_consensus.cc:697] T 150545c47e0642229a92ede96db14fc9 P aa0ff974118b465eaa785b8a86057e87 [term 2 LEADER]: Becoming Leader. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Running, Role: LEADER
I20260709 13:12:16.105374  5056 raft_consensus.cc:515] T b731fe02a6f4441e816628760bfdfb54 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:16.105458  4454 leader_election.cc:304] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:16.106798  5247 raft_consensus.cc:697] T 604a93ed898f4ab9b771487bfe278b33 P 74758684df5649ccadd1e189eaff32dc [term 2 LEADER]: Becoming Leader. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Running, Role: LEADER
I20260709 13:12:16.107507  5293 raft_consensus.cc:2804] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:16.108044  5293 raft_consensus.cc:697] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [term 2 LEADER]: Becoming Leader. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Running, Role: LEADER
I20260709 13:12:16.107663  5247 consensus_queue.cc:237] T 604a93ed898f4ab9b771487bfe278b33 P 74758684df5649ccadd1e189eaff32dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:16.108349  5295 consensus_queue.cc:237] T 150545c47e0642229a92ede96db14fc9 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:16.108860  5293 consensus_queue.cc:237] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:16.113119  4603 leader_election.cc:304] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87; no voters: 06ec58698d5444caaecea433c8419770
I20260709 13:12:16.114063  4636 raft_consensus.cc:2468] T 812a1b53a40e469c89b5f2aba8c59780 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 2.
W20260709 13:12:16.115726  4603 leader_election.cc:336] T 604a93ed898f4ab9b771487bfe278b33 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
W20260709 13:12:16.120018  4529 leader_election.cc:336] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
W20260709 13:12:16.116720  4603 leader_election.cc:336] T b731fe02a6f4441e816628760bfdfb54 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:16.129269  5260 raft_consensus.cc:515] T 9d526ab043434bf0bcab814f9bbc3234 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:16.129660  5096 raft_consensus.cc:515] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:16.131453  5260 leader_election.cc:290] T 9d526ab043434bf0bcab814f9bbc3234 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 election: Requested vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:16.132330  4562 raft_consensus.cc:2393] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aa0ff974118b465eaa785b8a86057e87 in current term 2: Already voted for candidate 420a61707e804ce5b3773a91cc2eb424 in this term.
I20260709 13:12:16.140431  5056 leader_election.cc:290] T b731fe02a6f4441e816628760bfdfb54 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 election: Requested vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:16.141836  4556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d526ab043434bf0bcab814f9bbc3234" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:16.142514  4556 raft_consensus.cc:3060] T 9d526ab043434bf0bcab814f9bbc3234 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.122609  5256 raft_consensus.cc:2804] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:16.145429  4563 raft_consensus.cc:1275] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Refusing update from remote peer aa0ff974118b465eaa785b8a86057e87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:16.152196  4556 raft_consensus.cc:2468] T 9d526ab043434bf0bcab814f9bbc3234 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 2.
I20260709 13:12:16.154892  4454 leader_election.cc:304] T 9d526ab043434bf0bcab814f9bbc3234 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:16.156024  5263 raft_consensus.cc:2804] T 9d526ab043434bf0bcab814f9bbc3234 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:16.156518  5263 raft_consensus.cc:697] T 9d526ab043434bf0bcab814f9bbc3234 P aa0ff974118b465eaa785b8a86057e87 [term 2 LEADER]: Becoming Leader. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Running, Role: LEADER
I20260709 13:12:16.156641  5305 consensus_queue.cc:1048] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:16.157364  5263 consensus_queue.cc:237] T 9d526ab043434bf0bcab814f9bbc3234 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:16.161285  5259 raft_consensus.cc:515] T 1503964d57034b31b36eecc16f2c84a0 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:16.131786  5096 leader_election.cc:290] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 election: Requested vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:16.185503  5256 raft_consensus.cc:697] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [term 2 LEADER]: Becoming Leader. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Running, Role: LEADER
I20260709 13:12:16.186792  5256 consensus_queue.cc:237] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:16.183269  4482 raft_consensus.cc:2393] T 1503964d57034b31b36eecc16f2c84a0 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74758684df5649ccadd1e189eaff32dc in current term 2: Already voted for candidate aa0ff974118b465eaa785b8a86057e87 in this term.
I20260709 13:12:16.163342  5259 leader_election.cc:290] T 1503964d57034b31b36eecc16f2c84a0 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 election: Requested vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
W20260709 13:12:16.205000  4455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:42711, user_credentials={real_user=slave}} blocked reactor thread for 126104us
I20260709 13:12:16.205727  4455 leader_election.cc:304] T 09294b866578436a827c27702d4b1d0b P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:16.211334  4455 leader_election.cc:304] T 5b827ee48d56478398f009c3fa980016 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:16.213088  4556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b731fe02a6f4441e816628760bfdfb54" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:16.213531  4556 raft_consensus.cc:3060] T b731fe02a6f4441e816628760bfdfb54 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.185256  5265 raft_consensus.cc:515] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:16.217093  4529 leader_election.cc:304] T 812a1b53a40e469c89b5f2aba8c59780 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc; no voters: 
I20260709 13:12:16.217716  5265 leader_election.cc:290] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 election: Requested vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:16.218353  5265 raft_consensus.cc:2804] T 812a1b53a40e469c89b5f2aba8c59780 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:16.212656  5259 raft_consensus.cc:2804] T 09294b866578436a827c27702d4b1d0b P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:16.221760  5259 raft_consensus.cc:493] T 09294b866578436a827c27702d4b1d0b P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:16.222110  5259 raft_consensus.cc:3060] T 09294b866578436a827c27702d4b1d0b P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.223474  5265 raft_consensus.cc:697] T 812a1b53a40e469c89b5f2aba8c59780 P 420a61707e804ce5b3773a91cc2eb424 [term 2 LEADER]: Becoming Leader. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Running, Role: LEADER
I20260709 13:12:16.224411  5265 consensus_queue.cc:237] T 812a1b53a40e469c89b5f2aba8c59780 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:16.236195  4556 raft_consensus.cc:2468] T b731fe02a6f4441e816628760bfdfb54 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 2.
W20260709 13:12:16.243095  4529 leader_election.cc:336] T 812a1b53a40e469c89b5f2aba8c59780 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:16.247465  4602 leader_election.cc:304] T b731fe02a6f4441e816628760bfdfb54 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc; no voters: 
I20260709 13:12:16.261248  4485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e466269360c4a538e16c342590490c0" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:16.261965  4485 raft_consensus.cc:3060] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.255157  5112 raft_consensus.cc:2804] T b731fe02a6f4441e816628760bfdfb54 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:16.271766  4482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dbb9c8f1ac4eca802b0c887a4d1c27" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:16.272527  4482 raft_consensus.cc:3060] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.275295  5310 raft_consensus.cc:2804] T 5b827ee48d56478398f009c3fa980016 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:16.275920  5310 raft_consensus.cc:493] T 5b827ee48d56478398f009c3fa980016 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:16.276376  5310 raft_consensus.cc:3060] T 5b827ee48d56478398f009c3fa980016 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.281760  4485 raft_consensus.cc:2468] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 2.
I20260709 13:12:16.267225  5112 raft_consensus.cc:697] T b731fe02a6f4441e816628760bfdfb54 P 74758684df5649ccadd1e189eaff32dc [term 2 LEADER]: Becoming Leader. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Running, Role: LEADER
I20260709 13:12:16.305213  4603 leader_election.cc:304] T 1503964d57034b31b36eecc16f2c84a0 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc; no voters: 06ec58698d5444caaecea433c8419770, aa0ff974118b465eaa785b8a86057e87
W20260709 13:12:16.284173  4455 leader_election.cc:336] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:16.311380  4482 raft_consensus.cc:2468] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 2.
I20260709 13:12:16.313288  4454 leader_election.cc:304] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa0ff974118b465eaa785b8a86057e87; no voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424
W20260709 13:12:16.314281  4455 leader_election.cc:336] T b6256e4aa07c45c78b2bbff56a852078 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
W20260709 13:12:16.314842  4455 leader_election.cc:336] T 150545c47e0642229a92ede96db14fc9 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
W20260709 13:12:16.315339  4455 leader_election.cc:336] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:16.318526  4634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1503964d57034b31b36eecc16f2c84a0" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:16.319859  5234 tablet_bootstrap.cc:492] T aa241e695dbb492a971f537d1f977f21 P 06ec58698d5444caaecea433c8419770: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:16.310551  5112 consensus_queue.cc:237] T b731fe02a6f4441e816628760bfdfb54 P 74758684df5649ccadd1e189eaff32dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:16.332890  5234 tablet_bootstrap.cc:492] T aa241e695dbb492a971f537d1f977f21 P 06ec58698d5444caaecea433c8419770: Bootstrap complete.
I20260709 13:12:16.333712  5234 ts_tablet_manager.cc:1403] T aa241e695dbb492a971f537d1f977f21 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.266s	user 0.021s	sys 0.000s
I20260709 13:12:16.332769  4563 raft_consensus.cc:1275] T 47d66fc2153d419082eccd7e30643d56 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Refusing update from remote peer aa0ff974118b465eaa785b8a86057e87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:16.317427  5308 raft_consensus.cc:2749] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:16.340139  5234 raft_consensus.cc:359] T aa241e695dbb492a971f537d1f977f21 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:16.340654  5234 raft_consensus.cc:740] T aa241e695dbb492a971f537d1f977f21 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:16.341240  5234 consensus_queue.cc:260] T aa241e695dbb492a971f537d1f977f21 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:16.343740  5308 consensus_queue.cc:1048] T 47d66fc2153d419082eccd7e30643d56 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:16.317703  5292 raft_consensus.cc:3060] T 1503964d57034b31b36eecc16f2c84a0 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.345428  5259 raft_consensus.cc:515] T 09294b866578436a827c27702d4b1d0b P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:16.357110  5234 ts_tablet_manager.cc:1434] T aa241e695dbb492a971f537d1f977f21 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:12:16.359090  5234 tablet_bootstrap.cc:492] T acbf3f88b4514948820691784cf9c189 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
W20260709 13:12:16.359081  4455 leader_election.cc:336] T 5b827ee48d56478398f009c3fa980016 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
W20260709 13:12:16.360445  4455 leader_election.cc:336] T 09294b866578436a827c27702d4b1d0b P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
W20260709 13:12:16.361053  4529 leader_election.cc:336] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
W20260709 13:12:16.361840  4529 leader_election.cc:336] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:16.347689  5259 leader_election.cc:290] T 09294b866578436a827c27702d4b1d0b P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 election: Requested vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:16.368578  4529 leader_election.cc:304] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 06ec58698d5444caaecea433c8419770
I20260709 13:12:16.372334  4529 leader_election.cc:304] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 06ec58698d5444caaecea433c8419770
I20260709 13:12:16.375386  5298 raft_consensus.cc:2804] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:16.375496  5096 raft_consensus.cc:2804] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:16.375979  5298 raft_consensus.cc:697] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [term 2 LEADER]: Becoming Leader. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Running, Role: LEADER
I20260709 13:12:16.376170  5096 raft_consensus.cc:697] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 420a61707e804ce5b3773a91cc2eb424 [term 2 LEADER]: Becoming Leader. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Running, Role: LEADER
I20260709 13:12:16.376945  5292 raft_consensus.cc:2749] T 1503964d57034b31b36eecc16f2c84a0 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:16.376689  5310 raft_consensus.cc:515] T 5b827ee48d56478398f009c3fa980016 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:16.383755  5310 leader_election.cc:290] T 5b827ee48d56478398f009c3fa980016 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 election: Requested vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:16.390020  4486 raft_consensus.cc:1275] T f7682a3f7f134c34a24488586461f6a4 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Refusing update from remote peer 420a61707e804ce5b3773a91cc2eb424: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:16.377135  5096 consensus_queue.cc:237] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
W20260709 13:12:16.406710  4455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.173.1:36439, user_credentials={real_user=slave}} blocked reactor thread for 46284.5us
I20260709 13:12:16.406952  5298 consensus_queue.cc:237] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
W20260709 13:12:16.407356  4455 leader_election.cc:336] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
W20260709 13:12:16.416306  4603 consensus_peers.cc:597] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:16.418872  4603 leader_election.cc:336] T b731fe02a6f4441e816628760bfdfb54 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
W20260709 13:12:16.421073  4529 consensus_peers.cc:597] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:16.417275  4308 catalog_manager.cc:5697] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 reported cstate change: term changed from 1 to 2, leader changed from 06ec58698d5444caaecea433c8419770 (127.28.173.1) to aa0ff974118b465eaa785b8a86057e87 (127.28.173.2). New cstate: current_term: 2 leader_uuid: "aa0ff974118b465eaa785b8a86057e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:16.427304  4631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09294b866578436a827c27702d4b1d0b" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:16.427948  4631 raft_consensus.cc:3060] T 09294b866578436a827c27702d4b1d0b P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.431787  4629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b827ee48d56478398f009c3fa980016" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:16.432658  4629 raft_consensus.cc:3060] T 5b827ee48d56478398f009c3fa980016 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.432030  4308 catalog_manager.cc:5697] T b6256e4aa07c45c78b2bbff56a852078 P aa0ff974118b465eaa785b8a86057e87 reported cstate change: term changed from 1 to 2, leader changed from 06ec58698d5444caaecea433c8419770 (127.28.173.1) to aa0ff974118b465eaa785b8a86057e87 (127.28.173.2). New cstate: current_term: 2 leader_uuid: "aa0ff974118b465eaa785b8a86057e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:16.397169  4634 raft_consensus.cc:2468] T 1503964d57034b31b36eecc16f2c84a0 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 2.
I20260709 13:12:16.458653  4308 catalog_manager.cc:5697] T 812a1b53a40e469c89b5f2aba8c59780 P 420a61707e804ce5b3773a91cc2eb424 reported cstate change: term changed from 1 to 2, leader changed from 06ec58698d5444caaecea433c8419770 (127.28.173.1) to 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3). New cstate: current_term: 2 leader_uuid: "420a61707e804ce5b3773a91cc2eb424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:16.459450  4634 raft_consensus.cc:1275] T d088694ef66442bdbf75cc7fc1942a83 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Refusing update from remote peer 420a61707e804ce5b3773a91cc2eb424: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:16.465116  4310 catalog_manager.cc:5697] T 604a93ed898f4ab9b771487bfe278b33 P 74758684df5649ccadd1e189eaff32dc reported cstate change: term changed from 1 to 2, leader changed from 06ec58698d5444caaecea433c8419770 (127.28.173.1) to 74758684df5649ccadd1e189eaff32dc (127.28.173.4). New cstate: current_term: 2 leader_uuid: "74758684df5649ccadd1e189eaff32dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:16.463855  4631 raft_consensus.cc:2468] T 09294b866578436a827c27702d4b1d0b P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 2.
I20260709 13:12:16.467098  4310 catalog_manager.cc:5697] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc reported cstate change: term changed from 1 to 2, leader changed from 06ec58698d5444caaecea433c8419770 (127.28.173.1) to 74758684df5649ccadd1e189eaff32dc (127.28.173.4). New cstate: current_term: 2 leader_uuid: "74758684df5649ccadd1e189eaff32dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:16.469398  4310 catalog_manager.cc:5697] T b731fe02a6f4441e816628760bfdfb54 P 74758684df5649ccadd1e189eaff32dc reported cstate change: term changed from 1 to 2, leader changed from 06ec58698d5444caaecea433c8419770 (127.28.173.1) to 74758684df5649ccadd1e189eaff32dc (127.28.173.4). New cstate: current_term: 2 leader_uuid: "74758684df5649ccadd1e189eaff32dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:16.474329  4629 raft_consensus.cc:2468] T 5b827ee48d56478398f009c3fa980016 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 2.
I20260709 13:12:16.478458  5096 consensus_queue.cc:1048] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:12:16.481277  4455 leader_election.cc:336] T 9d526ab043434bf0bcab814f9bbc3234 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:16.481225  5096 consensus_queue.cc:1048] T d088694ef66442bdbf75cc7fc1942a83 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:12:16.482146  4455 consensus_peers.cc:597] T 47d66fc2153d419082eccd7e30643d56 P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:16.483127  4529 consensus_peers.cc:597] T d088694ef66442bdbf75cc7fc1942a83 P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:16.483314  4558 raft_consensus.cc:1275] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Refusing update from remote peer 74758684df5649ccadd1e189eaff32dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:12:16.490111  4455 leader_election.cc:336] T 1503964d57034b31b36eecc16f2c84a0 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:16.491466  5314 consensus_queue.cc:1048] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:16.496677  4308 catalog_manager.cc:5697] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 reported cstate change: term changed from 1 to 2, leader changed from 06ec58698d5444caaecea433c8419770 (127.28.173.1) to 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3). New cstate: current_term: 2 leader_uuid: "420a61707e804ce5b3773a91cc2eb424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:16.501904  4308 catalog_manager.cc:5697] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 420a61707e804ce5b3773a91cc2eb424 reported cstate change: term changed from 1 to 2, leader changed from 06ec58698d5444caaecea433c8419770 (127.28.173.1) to 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3). New cstate: current_term: 2 leader_uuid: "420a61707e804ce5b3773a91cc2eb424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:16.518205  4558 raft_consensus.cc:1275] T 150545c47e0642229a92ede96db14fc9 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Refusing update from remote peer aa0ff974118b465eaa785b8a86057e87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:16.519723  5293 consensus_queue.cc:1048] T 150545c47e0642229a92ede96db14fc9 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:16.524402  4561 raft_consensus.cc:1275] T 604a93ed898f4ab9b771487bfe278b33 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Refusing update from remote peer 74758684df5649ccadd1e189eaff32dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:16.526129  5314 consensus_queue.cc:1048] T 604a93ed898f4ab9b771487bfe278b33 P 74758684df5649ccadd1e189eaff32dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:12:16.547715  4529 consensus_peers.cc:597] T 584f5934b7fa4c7ab4b0b43923621e70 P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:16.550323  5234 tablet_bootstrap.cc:492] T acbf3f88b4514948820691784cf9c189 P 06ec58698d5444caaecea433c8419770: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:16.551941  5234 tablet_bootstrap.cc:492] T acbf3f88b4514948820691784cf9c189 P 06ec58698d5444caaecea433c8419770: Bootstrap complete.
I20260709 13:12:16.551993  5240 raft_consensus.cc:493] T 49047cb7a56246288b9044f8ebec130f P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.554832  5234 ts_tablet_manager.cc:1403] T acbf3f88b4514948820691784cf9c189 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.196s	user 0.016s	sys 0.003s
I20260709 13:12:16.554665  5240 raft_consensus.cc:515] T 49047cb7a56246288b9044f8ebec130f P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:16.557687  5234 raft_consensus.cc:359] T acbf3f88b4514948820691784cf9c189 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:16.565253  4455 leader_election.cc:304] T 1503964d57034b31b36eecc16f2c84a0 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87; no voters: 06ec58698d5444caaecea433c8419770
I20260709 13:12:16.566090  5240 leader_election.cc:290] T 49047cb7a56246288b9044f8ebec130f P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:16.567476  5261 raft_consensus.cc:2804] T 1503964d57034b31b36eecc16f2c84a0 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:16.568060  5261 raft_consensus.cc:697] T 1503964d57034b31b36eecc16f2c84a0 P aa0ff974118b465eaa785b8a86057e87 [term 2 LEADER]: Becoming Leader. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Running, Role: LEADER
I20260709 13:12:16.568338  4455 leader_election.cc:304] T 09294b866578436a827c27702d4b1d0b P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:16.569106  5310 raft_consensus.cc:2804] T 09294b866578436a827c27702d4b1d0b P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:16.568958  5261 consensus_queue.cc:237] T 1503964d57034b31b36eecc16f2c84a0 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:16.569475  4455 leader_election.cc:304] T 5b827ee48d56478398f009c3fa980016 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:16.569621  5310 raft_consensus.cc:697] T 09294b866578436a827c27702d4b1d0b P aa0ff974118b465eaa785b8a86057e87 [term 2 LEADER]: Becoming Leader. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Running, Role: LEADER
I20260709 13:12:16.558360  5234 raft_consensus.cc:740] T acbf3f88b4514948820691784cf9c189 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:16.572348  5240 raft_consensus.cc:493] T d8033bfb7f5d423d90d60318c67df709 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.572600  5260 raft_consensus.cc:2804] T 5b827ee48d56478398f009c3fa980016 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:16.572638  5234 consensus_queue.cc:260] T acbf3f88b4514948820691784cf9c189 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
W20260709 13:12:16.585284  4455 consensus_peers.cc:597] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:16.585875  4455 leader_election.cc:336] T 09294b866578436a827c27702d4b1d0b P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
W20260709 13:12:16.588382  4455 leader_election.cc:336] T 5b827ee48d56478398f009c3fa980016 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:16.579478  5260 raft_consensus.cc:697] T 5b827ee48d56478398f009c3fa980016 P aa0ff974118b465eaa785b8a86057e87 [term 2 LEADER]: Becoming Leader. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Running, Role: LEADER
I20260709 13:12:16.594853  5260 consensus_queue.cc:237] T 5b827ee48d56478398f009c3fa980016 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:16.596160  5240 raft_consensus.cc:515] T d8033bfb7f5d423d90d60318c67df709 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:16.597668  4558 raft_consensus.cc:1275] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Refusing update from remote peer aa0ff974118b465eaa785b8a86057e87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:16.601261  5310 consensus_queue.cc:237] T 09294b866578436a827c27702d4b1d0b P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:16.608767  4563 raft_consensus.cc:1275] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Refusing update from remote peer aa0ff974118b465eaa785b8a86057e87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:16.618604  5259 consensus_queue.cc:1048] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:16.681046  4561 raft_consensus.cc:1275] T b6256e4aa07c45c78b2bbff56a852078 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Refusing update from remote peer aa0ff974118b465eaa785b8a86057e87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:12:16.679008  5350 log.cc:927] Time spent T 604a93ed898f4ab9b771487bfe278b33 P 420a61707e804ce5b3773a91cc2eb424: Append to log took a long time: real 0.052s	user 0.003s	sys 0.005s
W20260709 13:12:16.692658  4603 consensus_peers.cc:597] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:16.693230  4603 consensus_peers.cc:597] T e50b6f5a42a24867ab5f90ad6d97401e P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:16.692924  4308 catalog_manager.cc:5697] T 150545c47e0642229a92ede96db14fc9 P 420a61707e804ce5b3773a91cc2eb424 reported cstate change: term changed from 1 to 2, leader changed from 06ec58698d5444caaecea433c8419770 (127.28.173.1) to aa0ff974118b465eaa785b8a86057e87 (127.28.173.2). New cstate: current_term: 2 leader_uuid: "aa0ff974118b465eaa785b8a86057e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } }
I20260709 13:12:16.679061  5308 consensus_queue.cc:1048] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
W20260709 13:12:16.693658  4603 consensus_peers.cc:597] T 604a93ed898f4ab9b771487bfe278b33 P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:16.698523  4603 consensus_peers.cc:597] T acbf3f88b4514948820691784cf9c189 P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:16.684391  5234 ts_tablet_manager.cc:1434] T acbf3f88b4514948820691784cf9c189 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.129s	user 0.011s	sys 0.000s
I20260709 13:12:16.703996  5234 tablet_bootstrap.cc:492] T 5b827ee48d56478398f009c3fa980016 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:16.710500  5261 consensus_queue.cc:1048] T b6256e4aa07c45c78b2bbff56a852078 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:12:16.732357  5240 leader_election.cc:290] T d8033bfb7f5d423d90d60318c67df709 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:16.744897  4310 catalog_manager.cc:5697] T 9d526ab043434bf0bcab814f9bbc3234 P aa0ff974118b465eaa785b8a86057e87 reported cstate change: term changed from 1 to 2, leader changed from 06ec58698d5444caaecea433c8419770 (127.28.173.1) to aa0ff974118b465eaa785b8a86057e87 (127.28.173.2). New cstate: current_term: 2 leader_uuid: "aa0ff974118b465eaa785b8a86057e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:16.748956  4310 catalog_manager.cc:5697] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 reported cstate change: term changed from 1 to 2, leader changed from 06ec58698d5444caaecea433c8419770 (127.28.173.1) to aa0ff974118b465eaa785b8a86057e87 (127.28.173.2). New cstate: current_term: 2 leader_uuid: "aa0ff974118b465eaa785b8a86057e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:16.774569  4455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.4:42711, user_credentials={real_user=slave}} blocked reactor thread for 104693us
I20260709 13:12:16.774693  4563 raft_consensus.cc:1275] T 9d526ab043434bf0bcab814f9bbc3234 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Refusing update from remote peer aa0ff974118b465eaa785b8a86057e87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:16.776899  5310 consensus_queue.cc:1048] T 9d526ab043434bf0bcab814f9bbc3234 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:12:16.793998  4455 consensus_peers.cc:597] T 150545c47e0642229a92ede96db14fc9 P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:16.812613  4455 consensus_peers.cc:597] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:16.813012  4455 consensus_peers.cc:597] T b6256e4aa07c45c78b2bbff56a852078 P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:16.813355  4455 consensus_peers.cc:597] T 9d526ab043434bf0bcab814f9bbc3234 P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:16.821383  4634 raft_consensus.cc:1275] T 812a1b53a40e469c89b5f2aba8c59780 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Refusing update from remote peer 420a61707e804ce5b3773a91cc2eb424: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:16.822865  4485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49047cb7a56246288b9044f8ebec130f" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
W20260709 13:12:16.832801  4455 consensus_peers.cc:597] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:16.836990  4529 consensus_peers.cc:597] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:16.846544  4603 consensus_peers.cc:597] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:16.841178  5099 consensus_queue.cc:1048] T 812a1b53a40e469c89b5f2aba8c59780 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
W20260709 13:12:16.847285  4603 consensus_peers.cc:597] T 325a5a55a44a47ce97869216b084f89d P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:16.847745  4634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8033bfb7f5d423d90d60318c67df709" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
W20260709 13:12:16.847886  4603 consensus_peers.cc:597] T b731fe02a6f4441e816628760bfdfb54 P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:16.849284  4631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49047cb7a56246288b9044f8ebec130f" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:16.849959  4487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8033bfb7f5d423d90d60318c67df709" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:16.859097  5234 tablet_bootstrap.cc:492] T 5b827ee48d56478398f009c3fa980016 P 06ec58698d5444caaecea433c8419770: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:16.865464  5234 tablet_bootstrap.cc:492] T 5b827ee48d56478398f009c3fa980016 P 06ec58698d5444caaecea433c8419770: Bootstrap complete.
I20260709 13:12:16.866158  5231 leader_election.cc:304] T 49047cb7a56246288b9044f8ebec130f P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06ec58698d5444caaecea433c8419770; no voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:16.866822  5234 ts_tablet_manager.cc:1403] T 5b827ee48d56478398f009c3fa980016 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.163s	user 0.020s	sys 0.012s
I20260709 13:12:16.867571  5231 leader_election.cc:304] T d8033bfb7f5d423d90d60318c67df709 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06ec58698d5444caaecea433c8419770; no voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:16.868707  5240 raft_consensus.cc:2749] T d8033bfb7f5d423d90d60318c67df709 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:16.868760  5361 raft_consensus.cc:2749] T 49047cb7a56246288b9044f8ebec130f P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:16.869503  5234 raft_consensus.cc:359] T 5b827ee48d56478398f009c3fa980016 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:16.870222  5234 raft_consensus.cc:740] T 5b827ee48d56478398f009c3fa980016 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:16.870919  5234 consensus_queue.cc:260] T 5b827ee48d56478398f009c3fa980016 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:16.871373  4487 raft_consensus.cc:1275] T a16334f2dff74513ba7ca22ca8fb5afd P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Refusing update from remote peer 74758684df5649ccadd1e189eaff32dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:16.880735  5234 ts_tablet_manager.cc:1434] T 5b827ee48d56478398f009c3fa980016 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:12:16.881938  5318 consensus_queue.cc:1048] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:16.889093  4562 raft_consensus.cc:1275] T b731fe02a6f4441e816628760bfdfb54 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Refusing update from remote peer 74758684df5649ccadd1e189eaff32dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:16.898831  5234 tablet_bootstrap.cc:492] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
W20260709 13:12:16.900277  4529 consensus_peers.cc:597] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:16.914225  4603 consensus_peers.cc:597] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:16.915786  5314 consensus_queue.cc:1048] T b731fe02a6f4441e816628760bfdfb54 P 74758684df5649ccadd1e189eaff32dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:12:16.919287  4529 consensus_peers.cc:597] T 812a1b53a40e469c89b5f2aba8c59780 P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:16.919682  4529 consensus_peers.cc:597] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:16.926584  4455 consensus_peers.cc:597] T d8033bfb7f5d423d90d60318c67df709 P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:16.946720  5361 raft_consensus.cc:493] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.947254  5361 raft_consensus.cc:515] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:16.949569  5361 leader_election.cc:290] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
W20260709 13:12:16.951341  4603 consensus_peers.cc:597] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:16.953843  4629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812a1b53a40e469c89b5f2aba8c59780" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
W20260709 13:12:16.955503  4455 consensus_peers.cc:597] T 0dc4f903fb004dd2bce3c4934f078a5d P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:16.939213  4310 catalog_manager.cc:5697] T 09294b866578436a827c27702d4b1d0b P aa0ff974118b465eaa785b8a86057e87 reported cstate change: term changed from 1 to 2, leader changed from 06ec58698d5444caaecea433c8419770 (127.28.173.1) to aa0ff974118b465eaa785b8a86057e87 (127.28.173.2). New cstate: current_term: 2 leader_uuid: "aa0ff974118b465eaa785b8a86057e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:16.959350  4529 consensus_peers.cc:597] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:16.959414  4310 catalog_manager.cc:5697] T 5b827ee48d56478398f009c3fa980016 P aa0ff974118b465eaa785b8a86057e87 reported cstate change: term changed from 1 to 2, leader changed from 06ec58698d5444caaecea433c8419770 (127.28.173.1) to aa0ff974118b465eaa785b8a86057e87 (127.28.173.2). New cstate: current_term: 2 leader_uuid: "aa0ff974118b465eaa785b8a86057e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:16.962540  4310 catalog_manager.cc:5697] T 1503964d57034b31b36eecc16f2c84a0 P aa0ff974118b465eaa785b8a86057e87 reported cstate change: term changed from 1 to 2, leader changed from 06ec58698d5444caaecea433c8419770 (127.28.173.1) to aa0ff974118b465eaa785b8a86057e87 (127.28.173.2). New cstate: current_term: 2 leader_uuid: "aa0ff974118b465eaa785b8a86057e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:17.012406  4529 consensus_peers.cc:597] T d1119afee9d6413aa2cd229073ffbcf1 P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:17.013325  4529 consensus_peers.cc:597] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:17.014752  5361 raft_consensus.cc:493] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.015266  5361 raft_consensus.cc:515] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:17.016427  4487 raft_consensus.cc:1275] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Refusing update from remote peer 420a61707e804ce5b3773a91cc2eb424: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:17.017275  5361 leader_election.cc:290] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:17.022882  4487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d526ab043434bf0bcab814f9bbc3234" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:17.024452  5299 consensus_queue.cc:1048] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:12:17.036682  4529 consensus_peers.cc:597] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:17.040172  5361 raft_consensus.cc:493] T cb23991ab8504ee491f905a4346edee9 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.042654  5361 raft_consensus.cc:515] T cb23991ab8504ee491f905a4346edee9 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:17.046295  5361 leader_election.cc:290] T cb23991ab8504ee491f905a4346edee9 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:17.048689  4485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb23991ab8504ee491f905a4346edee9" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
W20260709 13:12:17.055670  4455 consensus_peers.cc:597] T 49047cb7a56246288b9044f8ebec130f P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:17.066222  4486 raft_consensus.cc:1275] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Refusing update from remote peer 420a61707e804ce5b3773a91cc2eb424: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:17.072213  5299 consensus_queue.cc:1048] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:12:17.077594  4529 consensus_peers.cc:597] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:17.088342  5361 raft_consensus.cc:493] T 0dc4f903fb004dd2bce3c4934f078a5d P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.088929  5361 raft_consensus.cc:515] T 0dc4f903fb004dd2bce3c4934f078a5d P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:17.091111  5361 leader_election.cc:290] T 0dc4f903fb004dd2bce3c4934f078a5d P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:17.091708  4631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc4f903fb004dd2bce3c4934f078a5d" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:17.092563  5361 raft_consensus.cc:493] T 3d38413c5dce44db8a755b48adacc3a8 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.093073  5361 raft_consensus.cc:515] T 3d38413c5dce44db8a755b48adacc3a8 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:17.095242  5361 leader_election.cc:290] T 3d38413c5dce44db8a755b48adacc3a8 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:17.102355  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d526ab043434bf0bcab814f9bbc3234" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:17.102988  4558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d38413c5dce44db8a755b48adacc3a8" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:17.103997  4556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb23991ab8504ee491f905a4346edee9" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:17.104480  4561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "812a1b53a40e469c89b5f2aba8c59780" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:17.106644  5230 leader_election.cc:304] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06ec58698d5444caaecea433c8419770; no voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:17.107452  5361 raft_consensus.cc:2749] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:17.108065  5230 leader_election.cc:304] T cb23991ab8504ee491f905a4346edee9 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06ec58698d5444caaecea433c8419770; no voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:17.108855  5361 raft_consensus.cc:2749] T cb23991ab8504ee491f905a4346edee9 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:17.109265  5230 leader_election.cc:304] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06ec58698d5444caaecea433c8419770; no voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc
I20260709 13:12:17.109994  5361 raft_consensus.cc:2749] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:17.114789  4486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d38413c5dce44db8a755b48adacc3a8" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:17.114466  4487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc4f903fb004dd2bce3c4934f078a5d" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:17.123250  5231 leader_election.cc:304] T 3d38413c5dce44db8a755b48adacc3a8 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06ec58698d5444caaecea433c8419770; no voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:17.124058  5361 raft_consensus.cc:2749] T 3d38413c5dce44db8a755b48adacc3a8 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:17.124516  5231 leader_election.cc:304] T 0dc4f903fb004dd2bce3c4934f078a5d P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06ec58698d5444caaecea433c8419770; no voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:17.125274  5361 raft_consensus.cc:2749] T 0dc4f903fb004dd2bce3c4934f078a5d P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:17.125844  5361 raft_consensus.cc:493] T 98342133e28b47d8a388f9321d5fd796 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.126904  5240 raft_consensus.cc:493] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.127388  5240 raft_consensus.cc:515] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:17.129719  5240 leader_election.cc:290] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:17.126533  5361 raft_consensus.cc:515] T 98342133e28b47d8a388f9321d5fd796 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
W20260709 13:12:17.131227  4455 consensus_peers.cc:597] T 1503964d57034b31b36eecc16f2c84a0 P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:17.132645  5361 leader_election.cc:290] T 98342133e28b47d8a388f9321d5fd796 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:17.132642  4482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dbb9c8f1ac4eca802b0c887a4d1c27" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:17.134374  4631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98342133e28b47d8a388f9321d5fd796" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:17.135581  5234 tablet_bootstrap.cc:492] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:17.136690  4629 raft_consensus.cc:1275] T 09294b866578436a827c27702d4b1d0b P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Refusing update from remote peer aa0ff974118b465eaa785b8a86057e87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:17.140758  5234 tablet_bootstrap.cc:492] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770: Bootstrap complete.
I20260709 13:12:17.138129  4558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35dbb9c8f1ac4eca802b0c887a4d1c27" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:17.141480  5234 ts_tablet_manager.cc:1403] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.243s	user 0.015s	sys 0.003s
I20260709 13:12:17.146813  5230 leader_election.cc:304] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06ec58698d5444caaecea433c8419770; no voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:17.147591  5308 consensus_queue.cc:1048] T 09294b866578436a827c27702d4b1d0b P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:12:17.148518  4529 consensus_peers.cc:597] T 3d38413c5dce44db8a755b48adacc3a8 P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:17.150142  4487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98342133e28b47d8a388f9321d5fd796" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:17.152038  5234 raft_consensus.cc:359] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:17.152529  4629 raft_consensus.cc:1275] T 1503964d57034b31b36eecc16f2c84a0 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Refusing update from remote peer aa0ff974118b465eaa785b8a86057e87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:17.152746  5234 raft_consensus.cc:740] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:17.153467  5234 consensus_queue.cc:260] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:17.155014  5030 consensus_queue.cc:1048] T 1503964d57034b31b36eecc16f2c84a0 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:17.155418  5234 ts_tablet_manager.cc:1434] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.004s
I20260709 13:12:17.156216  5234 tablet_bootstrap.cc:492] T a4736bb71dfa4f4b8b80e8a52895acf7 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:17.148100  5361 raft_consensus.cc:2749] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:17.161250  5231 leader_election.cc:304] T 98342133e28b47d8a388f9321d5fd796 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06ec58698d5444caaecea433c8419770; no voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:17.167022  5361 raft_consensus.cc:2749] T 98342133e28b47d8a388f9321d5fd796 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:17.199234  5390 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.173.1:36439 every 8 connection(s)
I20260709 13:12:17.203635 29364 rpc_server.cc:307] RPC server started. Bound to: 127.28.173.1:36439
I20260709 13:12:17.212663  5234 tablet_bootstrap.cc:492] T a4736bb71dfa4f4b8b80e8a52895acf7 P 06ec58698d5444caaecea433c8419770: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:17.213690  5234 tablet_bootstrap.cc:492] T a4736bb71dfa4f4b8b80e8a52895acf7 P 06ec58698d5444caaecea433c8419770: Bootstrap complete.
I20260709 13:12:17.214365  5234 ts_tablet_manager.cc:1403] T a4736bb71dfa4f4b8b80e8a52895acf7 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.058s	user 0.015s	sys 0.001s
I20260709 13:12:17.216825  5234 raft_consensus.cc:359] T a4736bb71dfa4f4b8b80e8a52895acf7 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:17.217734  5234 raft_consensus.cc:740] T a4736bb71dfa4f4b8b80e8a52895acf7 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:17.221832  5234 consensus_queue.cc:260] T a4736bb71dfa4f4b8b80e8a52895acf7 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:17.223994  5234 ts_tablet_manager.cc:1434] T a4736bb71dfa4f4b8b80e8a52895acf7 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:12:17.224771  4629 raft_consensus.cc:1275] T 5b827ee48d56478398f009c3fa980016 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Refusing update from remote peer aa0ff974118b465eaa785b8a86057e87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:17.227273  5234 tablet_bootstrap.cc:492] T b731fe02a6f4441e816628760bfdfb54 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:17.231366  5361 raft_consensus.cc:493] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.232000  5361 raft_consensus.cc:515] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:17.234055  5361 leader_election.cc:290] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:17.236065  5261 consensus_queue.cc:1048] T 5b827ee48d56478398f009c3fa980016 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:17.256450  4486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca87a1b3c8043529d7a9d61b0adfdbf" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:17.275727  5234 tablet_bootstrap.cc:492] T b731fe02a6f4441e816628760bfdfb54 P 06ec58698d5444caaecea433c8419770: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:17.276813  5234 tablet_bootstrap.cc:492] T b731fe02a6f4441e816628760bfdfb54 P 06ec58698d5444caaecea433c8419770: Bootstrap complete.
I20260709 13:12:17.277593  5234 ts_tablet_manager.cc:1403] T b731fe02a6f4441e816628760bfdfb54 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.051s	user 0.014s	sys 0.005s
I20260709 13:12:17.279979  5234 raft_consensus.cc:359] T b731fe02a6f4441e816628760bfdfb54 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:17.280687  5234 raft_consensus.cc:740] T b731fe02a6f4441e816628760bfdfb54 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:17.281674  5234 consensus_queue.cc:260] T b731fe02a6f4441e816628760bfdfb54 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:17.288630  5234 ts_tablet_manager.cc:1434] T b731fe02a6f4441e816628760bfdfb54 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:12:17.289590  5234 tablet_bootstrap.cc:492] T 980616077a8445ccbe984f63131e1b44 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:17.323954  5361 raft_consensus.cc:493] T d1119afee9d6413aa2cd229073ffbcf1 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.324529  5361 raft_consensus.cc:515] T d1119afee9d6413aa2cd229073ffbcf1 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:17.324884  4558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca87a1b3c8043529d7a9d61b0adfdbf" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:17.326624  5361 leader_election.cc:290] T d1119afee9d6413aa2cd229073ffbcf1 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:17.328344  4631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1119afee9d6413aa2cd229073ffbcf1" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:17.330876  5394 heartbeater.cc:344] Connected to a master server at 127.28.173.62:43215
I20260709 13:12:17.331326  5394 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:17.332898  5394 heartbeater.cc:507] Master 127.28.173.62:43215 requested a full tablet report, sending...
I20260709 13:12:17.337037  4558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1119afee9d6413aa2cd229073ffbcf1" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:17.343531  5332 raft_consensus.cc:3060] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.349205  5361 raft_consensus.cc:493] T 150545c47e0642229a92ede96db14fc9 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.349723  5361 raft_consensus.cc:515] T 150545c47e0642229a92ede96db14fc9 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:17.352885  4487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "150545c47e0642229a92ede96db14fc9" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:17.351729  5361 leader_election.cc:290] T 150545c47e0642229a92ede96db14fc9 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:17.360709  5230 leader_election.cc:304] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06ec58698d5444caaecea433c8419770; no voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:17.361310  5330 raft_consensus.cc:3060] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.366598  5234 tablet_bootstrap.cc:492] T 980616077a8445ccbe984f63131e1b44 P 06ec58698d5444caaecea433c8419770: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:17.367739  5234 tablet_bootstrap.cc:492] T 980616077a8445ccbe984f63131e1b44 P 06ec58698d5444caaecea433c8419770: Bootstrap complete.
I20260709 13:12:17.368400  5234 ts_tablet_manager.cc:1403] T 980616077a8445ccbe984f63131e1b44 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.079s	user 0.011s	sys 0.011s
I20260709 13:12:17.373391  5234 raft_consensus.cc:359] T 980616077a8445ccbe984f63131e1b44 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:17.374254  5234 raft_consensus.cc:740] T 980616077a8445ccbe984f63131e1b44 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:17.374995  5234 consensus_queue.cc:260] T 980616077a8445ccbe984f63131e1b44 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:17.379199  5361 raft_consensus.cc:2749] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:17.379659  5230 leader_election.cc:304] T d1119afee9d6413aa2cd229073ffbcf1 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06ec58698d5444caaecea433c8419770; no voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc
I20260709 13:12:17.383281  5361 raft_consensus.cc:2749] T d1119afee9d6413aa2cd229073ffbcf1 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:17.383903  5234 ts_tablet_manager.cc:1434] T 980616077a8445ccbe984f63131e1b44 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
W20260709 13:12:17.385125  4529 consensus_peers.cc:597] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:17.386540  5234 tablet_bootstrap.cc:492] T 604a93ed898f4ab9b771487bfe278b33 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:17.387346  4558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "150545c47e0642229a92ede96db14fc9" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:17.393532  5331 raft_consensus.cc:3060] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.402420  5320 raft_consensus.cc:3060] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.425454  5317 raft_consensus.cc:3060] T 5b827ee48d56478398f009c3fa980016 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.427793  5361 raft_consensus.cc:493] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.428414  5361 raft_consensus.cc:515] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:17.430660  5361 leader_election.cc:290] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:17.434039  4487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e466269360c4a538e16c342590490c0" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:17.458027  5317 raft_consensus.cc:1275] T 5b827ee48d56478398f009c3fa980016 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Refusing update from remote peer aa0ff974118b465eaa785b8a86057e87: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:17.460479  5330 raft_consensus.cc:3060] T b731fe02a6f4441e816628760bfdfb54 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.461133  5230 leader_election.cc:304] T 150545c47e0642229a92ede96db14fc9 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06ec58698d5444caaecea433c8419770; no voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87
W20260709 13:12:17.463056  4455 consensus_peers.cc:597] T 09294b866578436a827c27702d4b1d0b P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:17.464039  5361 raft_consensus.cc:2749] T 150545c47e0642229a92ede96db14fc9 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:17.463119  4603 consensus_peers.cc:597] T 69aed23cb12849fda6220c6c65580d59 P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:17.472474  5234 tablet_bootstrap.cc:492] T 604a93ed898f4ab9b771487bfe278b33 P 06ec58698d5444caaecea433c8419770: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:17.473402  5234 tablet_bootstrap.cc:492] T 604a93ed898f4ab9b771487bfe278b33 P 06ec58698d5444caaecea433c8419770: Bootstrap complete.
I20260709 13:12:17.474037  5234 ts_tablet_manager.cc:1403] T 604a93ed898f4ab9b771487bfe278b33 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.088s	user 0.019s	sys 0.006s
I20260709 13:12:17.474216  4308 ts_manager.cc:194] Re-registered known tserver with Master: 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:17.476578  4558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e466269360c4a538e16c342590490c0" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
W20260709 13:12:17.476902  4603 consensus_peers.cc:597] T 81197f2dcf424fbaaab746d5f8bf7c8c P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:17.477288  5320 raft_consensus.cc:3060] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:17.478395  4603 consensus_peers.cc:597] T d0147a5552154f26a88833f9210b1358 P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:17.483103  5260 consensus_queue.cc:1048] T 5b827ee48d56478398f009c3fa980016 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:17.476609  5234 raft_consensus.cc:359] T 604a93ed898f4ab9b771487bfe278b33 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:17.486927  5234 raft_consensus.cc:740] T 604a93ed898f4ab9b771487bfe278b33 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:17.488183  5234 consensus_queue.cc:260] T 604a93ed898f4ab9b771487bfe278b33 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:17.490638  5234 ts_tablet_manager.cc:1434] T 604a93ed898f4ab9b771487bfe278b33 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:12:17.491325  5234 tablet_bootstrap.cc:492] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:17.492015  5230 leader_election.cc:304] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06ec58698d5444caaecea433c8419770; no voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:17.500715  5331 raft_consensus.cc:3060] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.517258  5234 tablet_bootstrap.cc:492] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:17.517486  5408 raft_consensus.cc:2749] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:17.518325  5234 tablet_bootstrap.cc:492] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770: Bootstrap complete.
I20260709 13:12:17.518953  5234 ts_tablet_manager.cc:1403] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.000s
I20260709 13:12:17.521171  5234 raft_consensus.cc:359] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:17.521781  5234 raft_consensus.cc:740] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:17.522397  5234 consensus_queue.cc:260] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:17.524067  5234 ts_tablet_manager.cc:1434] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:12:17.524767  5234 tablet_bootstrap.cc:492] T 584f5934b7fa4c7ab4b0b43923621e70 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:17.538933  5234 tablet_bootstrap.cc:492] T 584f5934b7fa4c7ab4b0b43923621e70 P 06ec58698d5444caaecea433c8419770: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:17.540807  5234 tablet_bootstrap.cc:492] T 584f5934b7fa4c7ab4b0b43923621e70 P 06ec58698d5444caaecea433c8419770: Bootstrap complete.
I20260709 13:12:17.541463  5234 ts_tablet_manager.cc:1403] T 584f5934b7fa4c7ab4b0b43923621e70 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.008s
I20260709 13:12:17.544226  5234 raft_consensus.cc:359] T 584f5934b7fa4c7ab4b0b43923621e70 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:17.544965  5234 raft_consensus.cc:740] T 584f5934b7fa4c7ab4b0b43923621e70 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:17.545818  5234 consensus_queue.cc:260] T 584f5934b7fa4c7ab4b0b43923621e70 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:17.550330  5234 ts_tablet_manager.cc:1434] T 584f5934b7fa4c7ab4b0b43923621e70 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:12:17.553843  5234 tablet_bootstrap.cc:492] T 3f696298fcc049c08b47cd54f901be0c P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:17.564994  4308 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41054
I20260709 13:12:17.571326  5394 heartbeater.cc:499] Master 127.28.173.62:43215 was elected leader, sending a full tablet report...
I20260709 13:12:17.583446  5234 tablet_bootstrap.cc:492] T 3f696298fcc049c08b47cd54f901be0c P 06ec58698d5444caaecea433c8419770: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:17.584605  5234 tablet_bootstrap.cc:492] T 3f696298fcc049c08b47cd54f901be0c P 06ec58698d5444caaecea433c8419770: Bootstrap complete.
I20260709 13:12:17.585399  5234 ts_tablet_manager.cc:1403] T 3f696298fcc049c08b47cd54f901be0c P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.007s
I20260709 13:12:17.585444  5112 raft_consensus.cc:493] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.585991  5112 raft_consensus.cc:515] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:17.594049  5234 raft_consensus.cc:359] T 3f696298fcc049c08b47cd54f901be0c P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:17.594949  5234 raft_consensus.cc:740] T 3f696298fcc049c08b47cd54f901be0c P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:17.595973  5112 leader_election.cc:290] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:17.595886  5234 consensus_queue.cc:260] T 3f696298fcc049c08b47cd54f901be0c P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:17.597908  5234 ts_tablet_manager.cc:1434] T 3f696298fcc049c08b47cd54f901be0c P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:12:17.598711  5234 tablet_bootstrap.cc:492] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:17.608156  4558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f696298fcc049c08b47cd54f901be0c" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:17.608810  4558 raft_consensus.cc:2468] T 3f696298fcc049c08b47cd54f901be0c P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 2.
I20260709 13:12:17.611641  4602 leader_election.cc:304] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc; no voters: 
I20260709 13:12:17.613041  5112 raft_consensus.cc:2804] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:17.613382  5112 raft_consensus.cc:493] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.613659  5112 raft_consensus.cc:3060] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:17.618072  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f696298fcc049c08b47cd54f901be0c" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770" is_pre_election: true
I20260709 13:12:17.618367  5302 raft_consensus.cc:3060] T d088694ef66442bdbf75cc7fc1942a83 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.618767  5320 raft_consensus.cc:2468] T 3f696298fcc049c08b47cd54f901be0c P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 1.
I20260709 13:12:17.620886  5331 raft_consensus.cc:3060] T 150545c47e0642229a92ede96db14fc9 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.621424  5234 tablet_bootstrap.cc:492] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:17.622445  5234 tablet_bootstrap.cc:492] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770: Bootstrap complete.
I20260709 13:12:17.623180  5234 ts_tablet_manager.cc:1403] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.025s	user 0.021s	sys 0.000s
I20260709 13:12:17.625624  5234 raft_consensus.cc:359] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:17.626264  5234 raft_consensus.cc:740] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:17.639313  5234 consensus_queue.cc:260] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:17.641691  5234 ts_tablet_manager.cc:1434] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.011s
I20260709 13:12:17.642496  5234 tablet_bootstrap.cc:492] T 3501a75721d543d598af7857e368e08b P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:17.709996  5330 raft_consensus.cc:3060] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.667428  5112 raft_consensus.cc:515] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:17.728919  5112 leader_election.cc:290] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 3 election: Requested vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:17.749281  4558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f696298fcc049c08b47cd54f901be0c" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:17.749984  4558 raft_consensus.cc:3060] T 3f696298fcc049c08b47cd54f901be0c P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:17.790179  5302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f696298fcc049c08b47cd54f901be0c" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "06ec58698d5444caaecea433c8419770"
I20260709 13:12:17.790903  5302 raft_consensus.cc:3060] T 3f696298fcc049c08b47cd54f901be0c P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:12:17.794122  4558 raft_consensus.cc:2468] T 3f696298fcc049c08b47cd54f901be0c P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 3.
I20260709 13:12:17.798630  5234 tablet_bootstrap.cc:492] T 3501a75721d543d598af7857e368e08b P 06ec58698d5444caaecea433c8419770: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:17.802390  4602 leader_election.cc:304] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc; no voters: 
I20260709 13:12:17.803423  5422 raft_consensus.cc:2804] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:17.804971  5302 raft_consensus.cc:2468] T 3f696298fcc049c08b47cd54f901be0c P 06ec58698d5444caaecea433c8419770 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 3.
I20260709 13:12:17.802824  5234 tablet_bootstrap.cc:492] T 3501a75721d543d598af7857e368e08b P 06ec58698d5444caaecea433c8419770: Bootstrap complete.
I20260709 13:12:17.805462  5422 raft_consensus.cc:697] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc [term 3 LEADER]: Becoming Leader. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Running, Role: LEADER
I20260709 13:12:17.807034  5234 ts_tablet_manager.cc:1403] T 3501a75721d543d598af7857e368e08b P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.165s	user 0.030s	sys 0.043s
I20260709 13:12:17.807747  5422 consensus_queue.cc:237] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:17.809572  5234 raft_consensus.cc:359] T 3501a75721d543d598af7857e368e08b P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:17.810262  5234 raft_consensus.cc:740] T 3501a75721d543d598af7857e368e08b P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:17.810964  5234 consensus_queue.cc:260] T 3501a75721d543d598af7857e368e08b P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:17.817271  5234 ts_tablet_manager.cc:1434] T 3501a75721d543d598af7857e368e08b P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:12:17.818111  5234 tablet_bootstrap.cc:492] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:17.843918  5331 raft_consensus.cc:3060] T 604a93ed898f4ab9b771487bfe278b33 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.845366  4307 catalog_manager.cc:5697] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc reported cstate change: term changed from 1 to 3, leader changed from 06ec58698d5444caaecea433c8419770 (127.28.173.1) to 74758684df5649ccadd1e189eaff32dc (127.28.173.4). New cstate: current_term: 3 leader_uuid: "74758684df5649ccadd1e189eaff32dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:17.863437  5234 tablet_bootstrap.cc:492] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 06ec58698d5444caaecea433c8419770: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:17.864538  5234 tablet_bootstrap.cc:492] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 06ec58698d5444caaecea433c8419770: Bootstrap complete.
I20260709 13:12:17.865216  5234 ts_tablet_manager.cc:1403] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.017s
I20260709 13:12:17.886623  5234 raft_consensus.cc:359] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:17.887993  5234 raft_consensus.cc:740] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:17.888708  5234 consensus_queue.cc:260] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:17.891695  5234 ts_tablet_manager.cc:1434] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.001s
I20260709 13:12:17.892525  5234 tablet_bootstrap.cc:492] T 81197f2dcf424fbaaab746d5f8bf7c8c P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:17.935705  5330 raft_consensus.cc:3060] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.988812  5234 tablet_bootstrap.cc:492] T 81197f2dcf424fbaaab746d5f8bf7c8c P 06ec58698d5444caaecea433c8419770: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:17.989804  5234 tablet_bootstrap.cc:492] T 81197f2dcf424fbaaab746d5f8bf7c8c P 06ec58698d5444caaecea433c8419770: Bootstrap complete.
I20260709 13:12:17.990458  5234 ts_tablet_manager.cc:1403] T 81197f2dcf424fbaaab746d5f8bf7c8c P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.098s	user 0.012s	sys 0.012s
I20260709 13:12:17.993605  5234 raft_consensus.cc:359] T 81197f2dcf424fbaaab746d5f8bf7c8c P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:17.994994  5234 raft_consensus.cc:740] T 81197f2dcf424fbaaab746d5f8bf7c8c P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:17.996443  5234 consensus_queue.cc:260] T 81197f2dcf424fbaaab746d5f8bf7c8c P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:17.998291  5234 ts_tablet_manager.cc:1434] T 81197f2dcf424fbaaab746d5f8bf7c8c P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:17.998906  5234 tablet_bootstrap.cc:492] T 60d704077649426ab65d89dd9ff778d0 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:18.039459  5234 tablet_bootstrap.cc:492] T 60d704077649426ab65d89dd9ff778d0 P 06ec58698d5444caaecea433c8419770: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:18.040406  5234 tablet_bootstrap.cc:492] T 60d704077649426ab65d89dd9ff778d0 P 06ec58698d5444caaecea433c8419770: Bootstrap complete.
I20260709 13:12:18.041066  5234 ts_tablet_manager.cc:1403] T 60d704077649426ab65d89dd9ff778d0 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.042s	user 0.007s	sys 0.028s
I20260709 13:12:18.043462  5234 raft_consensus.cc:359] T 60d704077649426ab65d89dd9ff778d0 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:18.044137  5234 raft_consensus.cc:740] T 60d704077649426ab65d89dd9ff778d0 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:18.044840  5234 consensus_queue.cc:260] T 60d704077649426ab65d89dd9ff778d0 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:18.046834  5234 ts_tablet_manager.cc:1434] T 60d704077649426ab65d89dd9ff778d0 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:12:18.048200  5234 tablet_bootstrap.cc:492] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:18.072358  5234 tablet_bootstrap.cc:492] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 06ec58698d5444caaecea433c8419770: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:18.073334  5234 tablet_bootstrap.cc:492] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 06ec58698d5444caaecea433c8419770: Bootstrap complete.
I20260709 13:12:18.074015  5234 ts_tablet_manager.cc:1403] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.004s
I20260709 13:12:18.076448  5234 raft_consensus.cc:359] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:18.077131  5234 raft_consensus.cc:740] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:18.077778  5234 consensus_queue.cc:260] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:18.079916  5234 ts_tablet_manager.cc:1434] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:12:18.082617  5234 tablet_bootstrap.cc:492] T 47d66fc2153d419082eccd7e30643d56 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:18.109406  5234 tablet_bootstrap.cc:492] T 47d66fc2153d419082eccd7e30643d56 P 06ec58698d5444caaecea433c8419770: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:18.110148  5234 tablet_bootstrap.cc:492] T 47d66fc2153d419082eccd7e30643d56 P 06ec58698d5444caaecea433c8419770: Bootstrap complete.
I20260709 13:12:18.110790  5234 ts_tablet_manager.cc:1403] T 47d66fc2153d419082eccd7e30643d56 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.010s
I20260709 13:12:18.113097  5234 raft_consensus.cc:359] T 47d66fc2153d419082eccd7e30643d56 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:18.113729  5234 raft_consensus.cc:740] T 47d66fc2153d419082eccd7e30643d56 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:18.114322  5234 consensus_queue.cc:260] T 47d66fc2153d419082eccd7e30643d56 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:18.116581  5234 ts_tablet_manager.cc:1434] T 47d66fc2153d419082eccd7e30643d56 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:12:18.117455  5234 tablet_bootstrap.cc:492] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:18.132184  5234 tablet_bootstrap.cc:492] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:18.133069  5234 tablet_bootstrap.cc:492] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770: Bootstrap complete.
I20260709 13:12:18.133694  5234 ts_tablet_manager.cc:1403] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.003s
I20260709 13:12:18.135871  5234 raft_consensus.cc:359] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:18.136401  5234 raft_consensus.cc:740] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:18.136895  5234 consensus_queue.cc:260] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:18.138749  5234 ts_tablet_manager.cc:1434] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:12:18.140175  5234 tablet_bootstrap.cc:492] T ff7757f22fe3408f8745bc899f3c2e4e P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:18.162935  5234 tablet_bootstrap.cc:492] T ff7757f22fe3408f8745bc899f3c2e4e P 06ec58698d5444caaecea433c8419770: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:18.163846  5234 tablet_bootstrap.cc:492] T ff7757f22fe3408f8745bc899f3c2e4e P 06ec58698d5444caaecea433c8419770: Bootstrap complete.
I20260709 13:12:18.164472  5234 ts_tablet_manager.cc:1403] T ff7757f22fe3408f8745bc899f3c2e4e P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.000s
I20260709 13:12:18.166828  5234 raft_consensus.cc:359] T ff7757f22fe3408f8745bc899f3c2e4e P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:18.167493  5234 raft_consensus.cc:740] T ff7757f22fe3408f8745bc899f3c2e4e P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:18.168246  5234 consensus_queue.cc:260] T ff7757f22fe3408f8745bc899f3c2e4e P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:18.170315  5234 ts_tablet_manager.cc:1434] T ff7757f22fe3408f8745bc899f3c2e4e P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:12:18.171031  5234 tablet_bootstrap.cc:492] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:18.187913  5234 tablet_bootstrap.cc:492] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:18.188845  5234 tablet_bootstrap.cc:492] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770: Bootstrap complete.
I20260709 13:12:18.189471  5234 ts_tablet_manager.cc:1403] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.007s
I20260709 13:12:18.191800  5234 raft_consensus.cc:359] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:18.192234  5330 raft_consensus.cc:3060] T 47d66fc2153d419082eccd7e30643d56 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:18.192483  5234 raft_consensus.cc:740] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:18.193197  5234 consensus_queue.cc:260] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:18.197324  5234 ts_tablet_manager.cc:1434] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:18.198118  5234 tablet_bootstrap.cc:492] T d0147a5552154f26a88833f9210b1358 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:18.224260  5320 raft_consensus.cc:3060] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:18.238605  5331 raft_consensus.cc:3060] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:18.308569  5234 tablet_bootstrap.cc:492] T d0147a5552154f26a88833f9210b1358 P 06ec58698d5444caaecea433c8419770: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:18.309497  5234 tablet_bootstrap.cc:492] T d0147a5552154f26a88833f9210b1358 P 06ec58698d5444caaecea433c8419770: Bootstrap complete.
I20260709 13:12:18.310153  5234 ts_tablet_manager.cc:1403] T d0147a5552154f26a88833f9210b1358 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.112s	user 0.042s	sys 0.029s
I20260709 13:12:18.312618  5234 raft_consensus.cc:359] T d0147a5552154f26a88833f9210b1358 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:18.313269  5234 raft_consensus.cc:740] T d0147a5552154f26a88833f9210b1358 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:18.313908  5234 consensus_queue.cc:260] T d0147a5552154f26a88833f9210b1358 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:18.315986  5234 ts_tablet_manager.cc:1434] T d0147a5552154f26a88833f9210b1358 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:12:18.316799  5234 tablet_bootstrap.cc:492] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:18.446173  5330 raft_consensus.cc:1275] T 3f696298fcc049c08b47cd54f901be0c P 06ec58698d5444caaecea433c8419770 [term 3 FOLLOWER]: Refusing update from remote peer 74758684df5649ccadd1e189eaff32dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:18.451010  4561 raft_consensus.cc:1275] T 3f696298fcc049c08b47cd54f901be0c P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Refusing update from remote peer 74758684df5649ccadd1e189eaff32dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:18.453629  5430 consensus_queue.cc:1048] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:18.455118  5430 consensus_queue.cc:1048] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:18.469164  5234 tablet_bootstrap.cc:492] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 06ec58698d5444caaecea433c8419770: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:18.470465  5234 tablet_bootstrap.cc:492] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 06ec58698d5444caaecea433c8419770: Bootstrap complete.
I20260709 13:12:18.472532  5234 ts_tablet_manager.cc:1403] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.156s	user 0.047s	sys 0.030s
I20260709 13:12:18.476244  5234 raft_consensus.cc:359] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:18.485600  5234 raft_consensus.cc:740] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:18.486395  5234 consensus_queue.cc:260] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:18.488979  5234 ts_tablet_manager.cc:1434] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.016s	user 0.001s	sys 0.004s
I20260709 13:12:18.490139  5234 tablet_bootstrap.cc:492] T 09294b866578436a827c27702d4b1d0b P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:18.545570  5234 tablet_bootstrap.cc:492] T 09294b866578436a827c27702d4b1d0b P 06ec58698d5444caaecea433c8419770: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:18.546595  5234 tablet_bootstrap.cc:492] T 09294b866578436a827c27702d4b1d0b P 06ec58698d5444caaecea433c8419770: Bootstrap complete.
I20260709 13:12:18.547268  5234 ts_tablet_manager.cc:1403] T 09294b866578436a827c27702d4b1d0b P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.057s	user 0.010s	sys 0.007s
I20260709 13:12:18.550853  5234 raft_consensus.cc:359] T 09294b866578436a827c27702d4b1d0b P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:18.552515  5234 raft_consensus.cc:740] T 09294b866578436a827c27702d4b1d0b P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:18.554066  5234 consensus_queue.cc:260] T 09294b866578436a827c27702d4b1d0b P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:18.556780  5234 ts_tablet_manager.cc:1434] T 09294b866578436a827c27702d4b1d0b P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.003s
I20260709 13:12:18.558820  5234 tablet_bootstrap.cc:492] T b6256e4aa07c45c78b2bbff56a852078 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:18.641999  5234 tablet_bootstrap.cc:492] T b6256e4aa07c45c78b2bbff56a852078 P 06ec58698d5444caaecea433c8419770: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:18.642932  5234 tablet_bootstrap.cc:492] T b6256e4aa07c45c78b2bbff56a852078 P 06ec58698d5444caaecea433c8419770: Bootstrap complete.
I20260709 13:12:18.643929  5234 ts_tablet_manager.cc:1403] T b6256e4aa07c45c78b2bbff56a852078 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.085s	user 0.018s	sys 0.000s
I20260709 13:12:18.646294  5234 raft_consensus.cc:359] T b6256e4aa07c45c78b2bbff56a852078 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:18.646986  5234 raft_consensus.cc:740] T b6256e4aa07c45c78b2bbff56a852078 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:18.647951  5234 consensus_queue.cc:260] T b6256e4aa07c45c78b2bbff56a852078 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:18.649540  5234 ts_tablet_manager.cc:1434] T b6256e4aa07c45c78b2bbff56a852078 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:12:18.654186  5234 tablet_bootstrap.cc:492] T 325a5a55a44a47ce97869216b084f89d P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:18.673070  5234 tablet_bootstrap.cc:492] T 325a5a55a44a47ce97869216b084f89d P 06ec58698d5444caaecea433c8419770: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:18.673753  5234 tablet_bootstrap.cc:492] T 325a5a55a44a47ce97869216b084f89d P 06ec58698d5444caaecea433c8419770: Bootstrap complete.
I20260709 13:12:18.674320  5234 ts_tablet_manager.cc:1403] T 325a5a55a44a47ce97869216b084f89d P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.000s
I20260709 13:12:18.676199  5234 raft_consensus.cc:359] T 325a5a55a44a47ce97869216b084f89d P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:18.676682  5234 raft_consensus.cc:740] T 325a5a55a44a47ce97869216b084f89d P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:18.677379  5234 consensus_queue.cc:260] T 325a5a55a44a47ce97869216b084f89d P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:18.687788  5234 ts_tablet_manager.cc:1434] T 325a5a55a44a47ce97869216b084f89d P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:12:18.688606  5234 tablet_bootstrap.cc:492] T 1503964d57034b31b36eecc16f2c84a0 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:18.707499  5234 tablet_bootstrap.cc:492] T 1503964d57034b31b36eecc16f2c84a0 P 06ec58698d5444caaecea433c8419770: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:18.708261  5234 tablet_bootstrap.cc:492] T 1503964d57034b31b36eecc16f2c84a0 P 06ec58698d5444caaecea433c8419770: Bootstrap complete.
I20260709 13:12:18.708775  5234 ts_tablet_manager.cc:1403] T 1503964d57034b31b36eecc16f2c84a0 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.002s
I20260709 13:12:18.710476  5234 raft_consensus.cc:359] T 1503964d57034b31b36eecc16f2c84a0 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:18.710965  5234 raft_consensus.cc:740] T 1503964d57034b31b36eecc16f2c84a0 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:18.711596  5234 consensus_queue.cc:260] T 1503964d57034b31b36eecc16f2c84a0 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:18.713644  5234 ts_tablet_manager.cc:1434] T 1503964d57034b31b36eecc16f2c84a0 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:12:18.716990  5234 tablet_bootstrap.cc:492] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:18.732831  5234 tablet_bootstrap.cc:492] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:18.734723  5234 tablet_bootstrap.cc:492] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770: Bootstrap complete.
I20260709 13:12:18.735284  5234 ts_tablet_manager.cc:1403] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.008s
I20260709 13:12:18.737166  5234 raft_consensus.cc:359] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:18.737663  5234 raft_consensus.cc:740] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:18.738161  5234 consensus_queue.cc:260] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:18.739919  5234 ts_tablet_manager.cc:1434] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:12:18.740939  5234 tablet_bootstrap.cc:492] T e50b6f5a42a24867ab5f90ad6d97401e P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:18.754413  5331 raft_consensus.cc:3060] T 09294b866578436a827c27702d4b1d0b P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:18.762470  5234 tablet_bootstrap.cc:492] T e50b6f5a42a24867ab5f90ad6d97401e P 06ec58698d5444caaecea433c8419770: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:18.763266  5234 tablet_bootstrap.cc:492] T e50b6f5a42a24867ab5f90ad6d97401e P 06ec58698d5444caaecea433c8419770: Bootstrap complete.
I20260709 13:12:18.764019  5234 ts_tablet_manager.cc:1403] T e50b6f5a42a24867ab5f90ad6d97401e P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.003s
I20260709 13:12:18.765833  5234 raft_consensus.cc:359] T e50b6f5a42a24867ab5f90ad6d97401e P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:18.766332  5234 raft_consensus.cc:740] T e50b6f5a42a24867ab5f90ad6d97401e P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:18.766992  5234 consensus_queue.cc:260] T e50b6f5a42a24867ab5f90ad6d97401e P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:18.769006  5234 ts_tablet_manager.cc:1434] T e50b6f5a42a24867ab5f90ad6d97401e P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:12:18.769769  5234 tablet_bootstrap.cc:492] T 69aed23cb12849fda6220c6c65580d59 P 06ec58698d5444caaecea433c8419770: Bootstrap starting.
I20260709 13:12:18.794647  5234 tablet_bootstrap.cc:492] T 69aed23cb12849fda6220c6c65580d59 P 06ec58698d5444caaecea433c8419770: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:18.795715  5234 tablet_bootstrap.cc:492] T 69aed23cb12849fda6220c6c65580d59 P 06ec58698d5444caaecea433c8419770: Bootstrap complete.
I20260709 13:12:18.796917  5234 ts_tablet_manager.cc:1403] T 69aed23cb12849fda6220c6c65580d59 P 06ec58698d5444caaecea433c8419770: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.004s
I20260709 13:12:18.799468  5234 raft_consensus.cc:359] T 69aed23cb12849fda6220c6c65580d59 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:18.804678  5234 raft_consensus.cc:740] T 69aed23cb12849fda6220c6c65580d59 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06ec58698d5444caaecea433c8419770, State: Initialized, Role: FOLLOWER
I20260709 13:12:18.805930  5234 consensus_queue.cc:260] T 69aed23cb12849fda6220c6c65580d59 P 06ec58698d5444caaecea433c8419770 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:18.809623  5234 ts_tablet_manager.cc:1434] T 69aed23cb12849fda6220c6c65580d59 P 06ec58698d5444caaecea433c8419770: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:12:18.833262  5330 raft_consensus.cc:3060] T 1503964d57034b31b36eecc16f2c84a0 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:19.032606  5317 raft_consensus.cc:3060] T b6256e4aa07c45c78b2bbff56a852078 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.290751 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:27.348649  4561 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c7e5d871d1c44a58c65d3f76bce55b0"
dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
mode: GRACEFUL
new_leader_uuid: "06ec58698d5444caaecea433c8419770"
 from {username='slave'} at 127.0.0.1:57844
I20260709 13:12:27.349560  4561 raft_consensus.cc:606] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [term 1 LEADER]: Received request to transfer leadership to TS 06ec58698d5444caaecea433c8419770
I20260709 13:12:27.352083  4561 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60d704077649426ab65d89dd9ff778d0"
dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
mode: GRACEFUL
new_leader_uuid: "06ec58698d5444caaecea433c8419770"
 from {username='slave'} at 127.0.0.1:57844
I20260709 13:12:27.352692  4561 raft_consensus.cc:606] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [term 1 LEADER]: Received request to transfer leadership to TS 06ec58698d5444caaecea433c8419770
I20260709 13:12:27.369743  4487 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6fc1ff9a8e0d49d7b58940ccec6c0540"
dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
mode: GRACEFUL
new_leader_uuid: "420a61707e804ce5b3773a91cc2eb424"
 from {username='slave'} at 127.0.0.1:53536
I20260709 13:12:27.370249  4487 raft_consensus.cc:606] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P aa0ff974118b465eaa785b8a86057e87 [term 1 LEADER]: Received request to transfer leadership to TS 420a61707e804ce5b3773a91cc2eb424
I20260709 13:12:27.381925  4629 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa241e695dbb492a971f537d1f977f21"
dest_uuid: "74758684df5649ccadd1e189eaff32dc"
mode: GRACEFUL
new_leader_uuid: "06ec58698d5444caaecea433c8419770"
 from {username='slave'} at 127.0.0.1:38284
I20260709 13:12:27.382488  4629 raft_consensus.cc:606] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc [term 1 LEADER]: Received request to transfer leadership to TS 06ec58698d5444caaecea433c8419770
I20260709 13:12:27.385226  4561 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7682a3f7f134c34a24488586461f6a4"
dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
mode: GRACEFUL
new_leader_uuid: "06ec58698d5444caaecea433c8419770"
 from {username='slave'} at 127.0.0.1:57844
I20260709 13:12:27.385718  4561 raft_consensus.cc:606] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [term 2 LEADER]: Received request to transfer leadership to TS 06ec58698d5444caaecea433c8419770
I20260709 13:12:27.388916  4561 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff7757f22fe3408f8745bc899f3c2e4e"
dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
mode: GRACEFUL
new_leader_uuid: "06ec58698d5444caaecea433c8419770"
 from {username='slave'} at 127.0.0.1:57844
I20260709 13:12:27.389372  4561 raft_consensus.cc:606] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424 [term 1 LEADER]: Received request to transfer leadership to TS 06ec58698d5444caaecea433c8419770
I20260709 13:12:27.390379 29364 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:12:27.391570 29364 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:27.399205  5466 raft_consensus.cc:993] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P aa0ff974118b465eaa785b8a86057e87: : Instructing follower 420a61707e804ce5b3773a91cc2eb424 to start an election
I20260709 13:12:27.399894  5478 raft_consensus.cc:1081] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P aa0ff974118b465eaa785b8a86057e87 [term 1 LEADER]: Signalling peer 420a61707e804ce5b3773a91cc2eb424 to start an election
I20260709 13:12:27.401281  4561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6fc1ff9a8e0d49d7b58940ccec6c0540"
dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
 from {username='slave'} at 127.0.0.1:48330
I20260709 13:12:27.401739  4561 raft_consensus.cc:493] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:27.402053  4561 raft_consensus.cc:3060] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.408195  4561 raft_consensus.cc:515] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:27.410044  4561 leader_election.cc:290] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 election: Requested vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:27.410971  4487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1ff9a8e0d49d7b58940ccec6c0540" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:27.411209  4629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc1ff9a8e0d49d7b58940ccec6c0540" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:27.411742  4629 raft_consensus.cc:3060] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.411666  4487 raft_consensus.cc:3055] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P aa0ff974118b465eaa785b8a86057e87 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:27.412263  4487 raft_consensus.cc:740] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P aa0ff974118b465eaa785b8a86057e87 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Running, Role: LEADER
I20260709 13:12:27.412992  4487 consensus_queue.cc:260] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:27.414366  4487 raft_consensus.cc:3060] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.418316  4629 raft_consensus.cc:2468] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 2.
I20260709 13:12:27.420130  4529 leader_election.cc:304] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc; no voters: 
I20260709 13:12:27.421149  5096 raft_consensus.cc:2804] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:27.421605  5096 raft_consensus.cc:697] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 420a61707e804ce5b3773a91cc2eb424 [term 2 LEADER]: Becoming Leader. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Running, Role: LEADER
I20260709 13:12:27.422428  5096 consensus_queue.cc:237] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:27.423460  4487 raft_consensus.cc:2468] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 2.
I20260709 13:12:27.434217  4311 catalog_manager.cc:5697] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 420a61707e804ce5b3773a91cc2eb424 reported cstate change: term changed from 1 to 2, leader changed from aa0ff974118b465eaa785b8a86057e87 (127.28.173.2) to 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3). New cstate: current_term: 2 leader_uuid: "420a61707e804ce5b3773a91cc2eb424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:27.483323  5096 raft_consensus.cc:993] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424: : Instructing follower 06ec58698d5444caaecea433c8419770 to start an election
I20260709 13:12:27.483919  5472 raft_consensus.cc:1081] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [term 1 LEADER]: Signalling peer 06ec58698d5444caaecea433c8419770 to start an election
I20260709 13:12:27.485479  5330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60d704077649426ab65d89dd9ff778d0"
dest_uuid: "06ec58698d5444caaecea433c8419770"
 from {username='slave'} at 127.0.0.1:53138
I20260709 13:12:27.485965  5330 raft_consensus.cc:493] T 60d704077649426ab65d89dd9ff778d0 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:27.486207  5330 raft_consensus.cc:3060] T 60d704077649426ab65d89dd9ff778d0 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.491376  5330 raft_consensus.cc:515] T 60d704077649426ab65d89dd9ff778d0 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:27.492713  5096 raft_consensus.cc:993] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424: : Instructing follower 06ec58698d5444caaecea433c8419770 to start an election
I20260709 13:12:27.493250  5472 raft_consensus.cc:1081] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [term 1 LEADER]: Signalling peer 06ec58698d5444caaecea433c8419770 to start an election
I20260709 13:12:27.493315  5330 leader_election.cc:290] T 60d704077649426ab65d89dd9ff778d0 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 2 election: Requested vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:27.494180  4487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d704077649426ab65d89dd9ff778d0" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:27.494772  4487 raft_consensus.cc:3060] T 60d704077649426ab65d89dd9ff778d0 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.495078  4561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d704077649426ab65d89dd9ff778d0" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:27.495555  5317 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c7e5d871d1c44a58c65d3f76bce55b0"
dest_uuid: "06ec58698d5444caaecea433c8419770"
 from {username='slave'} at 127.0.0.1:53138
I20260709 13:12:27.495607  4561 raft_consensus.cc:3055] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:27.496122  5317 raft_consensus.cc:493] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:27.496246  4561 raft_consensus.cc:740] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Running, Role: LEADER
I20260709 13:12:27.496588  5317 raft_consensus.cc:3060] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.497198  4561 consensus_queue.cc:260] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:27.498497  4561 raft_consensus.cc:3060] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.501155  4487 raft_consensus.cc:2468] T 60d704077649426ab65d89dd9ff778d0 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 2.
I20260709 13:12:27.501807  5317 raft_consensus.cc:515] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:27.502461  5231 leader_election.cc:304] T 60d704077649426ab65d89dd9ff778d0 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:27.503677  5317 leader_election.cc:290] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 2 election: Requested vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:27.504827  4558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7e5d871d1c44a58c65d3f76bce55b0" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:27.505432  4558 raft_consensus.cc:3055] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:27.505826  4558 raft_consensus.cc:740] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Running, Role: LEADER
I20260709 13:12:27.506795  4558 consensus_queue.cc:260] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:27.507565  5489 raft_consensus.cc:2804] T 60d704077649426ab65d89dd9ff778d0 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:27.507829  4558 raft_consensus.cc:3060] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.509431  5489 raft_consensus.cc:697] T 60d704077649426ab65d89dd9ff778d0 P 06ec58698d5444caaecea433c8419770 [term 2 LEADER]: Becoming Leader. State: Replica: 06ec58698d5444caaecea433c8419770, State: Running, Role: LEADER
I20260709 13:12:27.511098  4486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7e5d871d1c44a58c65d3f76bce55b0" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:27.510886  5489 consensus_queue.cc:237] T 60d704077649426ab65d89dd9ff778d0 P 06ec58698d5444caaecea433c8419770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:27.511569  4486 raft_consensus.cc:3060] T 1c7e5d871d1c44a58c65d3f76bce55b0 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.519114  4486 raft_consensus.cc:2468] T 1c7e5d871d1c44a58c65d3f76bce55b0 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 2.
I20260709 13:12:27.521019  5231 leader_election.cc:304] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:27.522388  4311 catalog_manager.cc:5697] T 60d704077649426ab65d89dd9ff778d0 P 06ec58698d5444caaecea433c8419770 reported cstate change: term changed from 1 to 2, leader changed from 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3) to 06ec58698d5444caaecea433c8419770 (127.28.173.1). New cstate: current_term: 2 leader_uuid: "06ec58698d5444caaecea433c8419770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:27.524631  4558 raft_consensus.cc:2468] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 2.
I20260709 13:12:27.525345  4561 raft_consensus.cc:2468] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 2.
I20260709 13:12:27.527607  5489 raft_consensus.cc:2804] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:27.528188  5489 raft_consensus.cc:697] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 06ec58698d5444caaecea433c8419770 [term 2 LEADER]: Becoming Leader. State: Replica: 06ec58698d5444caaecea433c8419770, State: Running, Role: LEADER
I20260709 13:12:27.529110  5489 consensus_queue.cc:237] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 06ec58698d5444caaecea433c8419770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:27.540241  4311 catalog_manager.cc:5697] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 06ec58698d5444caaecea433c8419770 reported cstate change: term changed from 1 to 2, leader changed from 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3) to 06ec58698d5444caaecea433c8419770 (127.28.173.1). New cstate: current_term: 2 leader_uuid: "06ec58698d5444caaecea433c8419770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:27.582495  5472 raft_consensus.cc:993] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424: : Instructing follower 06ec58698d5444caaecea433c8419770 to start an election
I20260709 13:12:27.582958  5096 raft_consensus.cc:1081] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424 [term 1 LEADER]: Signalling peer 06ec58698d5444caaecea433c8419770 to start an election
I20260709 13:12:27.584431  5317 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff7757f22fe3408f8745bc899f3c2e4e"
dest_uuid: "06ec58698d5444caaecea433c8419770"
 from {username='slave'} at 127.0.0.1:53138
I20260709 13:12:27.584964  5317 raft_consensus.cc:493] T ff7757f22fe3408f8745bc899f3c2e4e P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:27.585280  5317 raft_consensus.cc:3060] T ff7757f22fe3408f8745bc899f3c2e4e P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.591379  5317 raft_consensus.cc:515] T ff7757f22fe3408f8745bc899f3c2e4e P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:27.593614  5317 leader_election.cc:290] T ff7757f22fe3408f8745bc899f3c2e4e P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 2 election: Requested vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:27.593832  4558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7757f22fe3408f8745bc899f3c2e4e" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:27.594413  4558 raft_consensus.cc:3055] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:27.594688  4558 raft_consensus.cc:740] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Running, Role: LEADER
I20260709 13:12:27.599429  4631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7757f22fe3408f8745bc899f3c2e4e" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:27.600051  4631 raft_consensus.cc:3060] T ff7757f22fe3408f8745bc899f3c2e4e P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.595414  4558 consensus_queue.cc:260] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:27.601050  4558 raft_consensus.cc:3060] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.606909  4631 raft_consensus.cc:2468] T ff7757f22fe3408f8745bc899f3c2e4e P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 2.
I20260709 13:12:27.607736  4558 raft_consensus.cc:2468] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 2.
I20260709 13:12:27.608075  5231 leader_election.cc:304] T ff7757f22fe3408f8745bc899f3c2e4e P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 74758684df5649ccadd1e189eaff32dc; no voters: 
I20260709 13:12:27.608986  5489 raft_consensus.cc:2804] T ff7757f22fe3408f8745bc899f3c2e4e P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:27.609474  5489 raft_consensus.cc:697] T ff7757f22fe3408f8745bc899f3c2e4e P 06ec58698d5444caaecea433c8419770 [term 2 LEADER]: Becoming Leader. State: Replica: 06ec58698d5444caaecea433c8419770, State: Running, Role: LEADER
I20260709 13:12:27.610337  5489 consensus_queue.cc:237] T ff7757f22fe3408f8745bc899f3c2e4e P 06ec58698d5444caaecea433c8419770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:27.620924  4311 catalog_manager.cc:5697] T ff7757f22fe3408f8745bc899f3c2e4e P 06ec58698d5444caaecea433c8419770 reported cstate change: term changed from 1 to 2, leader changed from 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3) to 06ec58698d5444caaecea433c8419770 (127.28.173.1). New cstate: current_term: 2 leader_uuid: "06ec58698d5444caaecea433c8419770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:27.656507  5469 raft_consensus.cc:993] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc: : Instructing follower 06ec58698d5444caaecea433c8419770 to start an election
I20260709 13:12:27.657203  5488 raft_consensus.cc:1081] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc [term 1 LEADER]: Signalling peer 06ec58698d5444caaecea433c8419770 to start an election
I20260709 13:12:27.658735  5317 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa241e695dbb492a971f537d1f977f21"
dest_uuid: "06ec58698d5444caaecea433c8419770"
 from {username='slave'} at 127.0.0.1:53146
I20260709 13:12:27.659119  5317 raft_consensus.cc:493] T aa241e695dbb492a971f537d1f977f21 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:27.659343  5317 raft_consensus.cc:3060] T aa241e695dbb492a971f537d1f977f21 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.664634  5317 raft_consensus.cc:515] T aa241e695dbb492a971f537d1f977f21 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:27.666355  5317 leader_election.cc:290] T aa241e695dbb492a971f537d1f977f21 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 2 election: Requested vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:27.667160  4631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa241e695dbb492a971f537d1f977f21" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:27.667308  4486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa241e695dbb492a971f537d1f977f21" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:27.667945  4486 raft_consensus.cc:3060] T aa241e695dbb492a971f537d1f977f21 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.667845  4631 raft_consensus.cc:3055] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:27.668623  4631 raft_consensus.cc:740] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Running, Role: LEADER
I20260709 13:12:27.669283  4631 consensus_queue.cc:260] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:27.670186  4631 raft_consensus.cc:3060] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.675415  4486 raft_consensus.cc:2468] T aa241e695dbb492a971f537d1f977f21 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 2.
I20260709 13:12:27.676213  4631 raft_consensus.cc:2468] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 2.
I20260709 13:12:27.676484  5231 leader_election.cc:304] T aa241e695dbb492a971f537d1f977f21 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:27.677386  5489 raft_consensus.cc:2804] T aa241e695dbb492a971f537d1f977f21 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:27.677824  5489 raft_consensus.cc:697] T aa241e695dbb492a971f537d1f977f21 P 06ec58698d5444caaecea433c8419770 [term 2 LEADER]: Becoming Leader. State: Replica: 06ec58698d5444caaecea433c8419770, State: Running, Role: LEADER
I20260709 13:12:27.678602  5489 consensus_queue.cc:237] T aa241e695dbb492a971f537d1f977f21 P 06ec58698d5444caaecea433c8419770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:27.687377  4311 catalog_manager.cc:5697] T aa241e695dbb492a971f537d1f977f21 P 06ec58698d5444caaecea433c8419770 reported cstate change: term changed from 1 to 2, leader changed from 74758684df5649ccadd1e189eaff32dc (127.28.173.4) to 06ec58698d5444caaecea433c8419770 (127.28.173.1). New cstate: current_term: 2 leader_uuid: "06ec58698d5444caaecea433c8419770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:27.696566  5472 raft_consensus.cc:993] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424: : Instructing follower 06ec58698d5444caaecea433c8419770 to start an election
I20260709 13:12:27.696969  5096 raft_consensus.cc:1081] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [term 2 LEADER]: Signalling peer 06ec58698d5444caaecea433c8419770 to start an election
I20260709 13:12:27.698190  5317 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7682a3f7f134c34a24488586461f6a4"
dest_uuid: "06ec58698d5444caaecea433c8419770"
 from {username='slave'} at 127.0.0.1:53138
I20260709 13:12:27.698637  5317 raft_consensus.cc:493] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:27.698860  5317 raft_consensus.cc:3060] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:27.703199  5317 raft_consensus.cc:515] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:27.704766  5317 leader_election.cc:290] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 3 election: Requested vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:27.705516  4486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7682a3f7f134c34a24488586461f6a4" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:27.705826  4558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7682a3f7f134c34a24488586461f6a4" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:27.706108  4486 raft_consensus.cc:3060] T f7682a3f7f134c34a24488586461f6a4 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:27.706382  4558 raft_consensus.cc:3055] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:27.706684  4558 raft_consensus.cc:740] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Running, Role: LEADER
I20260709 13:12:27.707430  4558 consensus_queue.cc:260] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:27.708635  4558 raft_consensus.cc:3060] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:27.712540  4486 raft_consensus.cc:2468] T f7682a3f7f134c34a24488586461f6a4 P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 3.
I20260709 13:12:27.713600  5231 leader_election.cc:304] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:27.714408  5489 raft_consensus.cc:2804] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:27.714861  5489 raft_consensus.cc:697] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770 [term 3 LEADER]: Becoming Leader. State: Replica: 06ec58698d5444caaecea433c8419770, State: Running, Role: LEADER
I20260709 13:12:27.714998  4558 raft_consensus.cc:2468] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 3.
I20260709 13:12:27.715708  5489 consensus_queue.cc:237] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:27.723960  4311 catalog_manager.cc:5697] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770 reported cstate change: term changed from 2 to 3, leader changed from 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3) to 06ec58698d5444caaecea433c8419770 (127.28.173.1). New cstate: current_term: 3 leader_uuid: "06ec58698d5444caaecea433c8419770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:27.893694  4629 raft_consensus.cc:1275] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Refusing update from remote peer 420a61707e804ce5b3773a91cc2eb424: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:27.895216  5096 consensus_queue.cc:1048] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:27.931492  4556 raft_consensus.cc:1275] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Refusing update from remote peer 06ec58698d5444caaecea433c8419770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:27.936450  5489 consensus_queue.cc:1048] T 60d704077649426ab65d89dd9ff778d0 P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:27.936743  4486 raft_consensus.cc:1275] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Refusing update from remote peer 420a61707e804ce5b3773a91cc2eb424: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:27.941581  5472 consensus_queue.cc:1048] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:27.965567  4487 raft_consensus.cc:1275] T 60d704077649426ab65d89dd9ff778d0 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Refusing update from remote peer 06ec58698d5444caaecea433c8419770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:27.966847  5489 consensus_queue.cc:1048] T 60d704077649426ab65d89dd9ff778d0 P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:27.992079  4629 raft_consensus.cc:1275] T ff7757f22fe3408f8745bc899f3c2e4e P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Refusing update from remote peer 06ec58698d5444caaecea433c8419770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:27.993248  5489 consensus_queue.cc:1048] T ff7757f22fe3408f8745bc899f3c2e4e P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:28.002692  4556 raft_consensus.cc:1275] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Refusing update from remote peer 06ec58698d5444caaecea433c8419770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:28.005309  5489 consensus_queue.cc:1048] T ff7757f22fe3408f8745bc899f3c2e4e P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:28.040009  4487 raft_consensus.cc:1275] T 1c7e5d871d1c44a58c65d3f76bce55b0 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Refusing update from remote peer 06ec58698d5444caaecea433c8419770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:28.041445  5507 consensus_queue.cc:1048] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:28.050945  4561 raft_consensus.cc:1275] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Refusing update from remote peer 06ec58698d5444caaecea433c8419770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:28.052356  5489 consensus_queue.cc:1048] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:28.087021  4487 raft_consensus.cc:1275] T aa241e695dbb492a971f537d1f977f21 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Refusing update from remote peer 06ec58698d5444caaecea433c8419770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:28.088413  5489 consensus_queue.cc:1048] T aa241e695dbb492a971f537d1f977f21 P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:28.105103  4629 raft_consensus.cc:1275] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Refusing update from remote peer 06ec58698d5444caaecea433c8419770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:28.108850  5507 consensus_queue.cc:1048] T aa241e695dbb492a971f537d1f977f21 P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:28.135087  4556 raft_consensus.cc:1275] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Refusing update from remote peer 06ec58698d5444caaecea433c8419770: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:28.136178  5507 consensus_queue.cc:1048] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:28.144755  4486 raft_consensus.cc:1275] T f7682a3f7f134c34a24488586461f6a4 P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Refusing update from remote peer 06ec58698d5444caaecea433c8419770: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:28.145929  5489 consensus_queue.cc:1048] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:28.392562 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:28.428972 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:28.464661  4486 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20be30df26724e7f98f3b36f24e4df3a"
dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
mode: GRACEFUL
new_leader_uuid: "06ec58698d5444caaecea433c8419770"
 from {username='slave'} at 127.0.0.1:53536
I20260709 13:12:28.465299  4486 raft_consensus.cc:606] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [term 2 LEADER]: Received request to transfer leadership to TS 06ec58698d5444caaecea433c8419770
I20260709 13:12:28.468015  4556 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e466269360c4a538e16c342590490c0"
dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
mode: GRACEFUL
new_leader_uuid: "06ec58698d5444caaecea433c8419770"
 from {username='slave'} at 127.0.0.1:57844
I20260709 13:12:28.468482  4556 raft_consensus.cc:606] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [term 2 LEADER]: Received request to transfer leadership to TS 06ec58698d5444caaecea433c8419770
I20260709 13:12:28.470892  4631 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a508f846d314fa0b7ec364af09bc427"
dest_uuid: "74758684df5649ccadd1e189eaff32dc"
mode: GRACEFUL
new_leader_uuid: "06ec58698d5444caaecea433c8419770"
 from {username='slave'} at 127.0.0.1:38284
I20260709 13:12:28.471324  4631 raft_consensus.cc:606] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc [term 2 LEADER]: Received request to transfer leadership to TS 06ec58698d5444caaecea433c8419770
I20260709 13:12:28.473634  4631 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a16334f2dff74513ba7ca22ca8fb5afd"
dest_uuid: "74758684df5649ccadd1e189eaff32dc"
mode: GRACEFUL
new_leader_uuid: "06ec58698d5444caaecea433c8419770"
 from {username='slave'} at 127.0.0.1:38284
I20260709 13:12:28.474027  4631 raft_consensus.cc:606] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [term 2 LEADER]: Received request to transfer leadership to TS 06ec58698d5444caaecea433c8419770
I20260709 13:12:28.476284  4629 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8fb0d1b4ae14754aa30516d12cdea3d"
dest_uuid: "74758684df5649ccadd1e189eaff32dc"
mode: GRACEFUL
new_leader_uuid: "06ec58698d5444caaecea433c8419770"
 from {username='slave'} at 127.0.0.1:38284
I20260709 13:12:28.476771  4629 raft_consensus.cc:606] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [term 2 LEADER]: Received request to transfer leadership to TS 06ec58698d5444caaecea433c8419770
I20260709 13:12:28.477895 29364 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:12:28.480929 29364 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:28.498358  5469 raft_consensus.cc:993] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc: : Instructing follower 06ec58698d5444caaecea433c8419770 to start an election
I20260709 13:12:28.498858  5469 raft_consensus.cc:1081] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [term 2 LEADER]: Signalling peer 06ec58698d5444caaecea433c8419770 to start an election
I20260709 13:12:28.500357  5317 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8fb0d1b4ae14754aa30516d12cdea3d"
dest_uuid: "06ec58698d5444caaecea433c8419770"
 from {username='slave'} at 127.0.0.1:53146
I20260709 13:12:28.500969  5317 raft_consensus.cc:493] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:28.501310  5317 raft_consensus.cc:3060] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:28.507704  5317 raft_consensus.cc:515] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:28.509541  5488 raft_consensus.cc:993] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc: : Instructing follower 06ec58698d5444caaecea433c8419770 to start an election
I20260709 13:12:28.510046  5469 raft_consensus.cc:1081] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc [term 2 LEADER]: Signalling peer 06ec58698d5444caaecea433c8419770 to start an election
I20260709 13:12:28.510977  4556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fb0d1b4ae14754aa30516d12cdea3d" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:28.511461  4629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fb0d1b4ae14754aa30516d12cdea3d" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:28.511576  4556 raft_consensus.cc:3060] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:28.511639  5317 leader_election.cc:290] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 3 election: Requested vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:28.512094  4629 raft_consensus.cc:3055] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:28.512403  4629 raft_consensus.cc:740] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Running, Role: LEADER
I20260709 13:12:28.513607  4629 consensus_queue.cc:260] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:28.513929  5317 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a508f846d314fa0b7ec364af09bc427"
dest_uuid: "06ec58698d5444caaecea433c8419770"
 from {username='slave'} at 127.0.0.1:53146
I20260709 13:12:28.514509  5317 raft_consensus.cc:493] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:28.514842  5317 raft_consensus.cc:3060] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:28.514886  4629 raft_consensus.cc:3060] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:28.518383  4556 raft_consensus.cc:2468] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 3.
I20260709 13:12:28.520293  5230 leader_election.cc:304] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: 
I20260709 13:12:28.521077  5489 raft_consensus.cc:2804] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:28.521116  5317 raft_consensus.cc:515] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:28.521695  5489 raft_consensus.cc:697] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770 [term 3 LEADER]: Becoming Leader. State: Replica: 06ec58698d5444caaecea433c8419770, State: Running, Role: LEADER
I20260709 13:12:28.523586  5489 consensus_queue.cc:237] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:28.526612  4629 raft_consensus.cc:2468] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 3.
I20260709 13:12:28.527580  4631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a508f846d314fa0b7ec364af09bc427" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:28.528216  4631 raft_consensus.cc:3055] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:28.528529  4631 raft_consensus.cc:740] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Running, Role: LEADER
I20260709 13:12:28.531227  5317 leader_election.cc:290] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 3 election: Requested vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:28.532199  4631 consensus_queue.cc:260] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:28.534937  4631 raft_consensus.cc:3060] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:28.535686  4310 catalog_manager.cc:5697] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770 reported cstate change: term changed from 2 to 3, leader changed from 74758684df5649ccadd1e189eaff32dc (127.28.173.4) to 06ec58698d5444caaecea433c8419770 (127.28.173.1). New cstate: current_term: 3 leader_uuid: "06ec58698d5444caaecea433c8419770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:28.536811  4486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a508f846d314fa0b7ec364af09bc427" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:28.537362  4486 raft_consensus.cc:3060] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:28.543710  4486 raft_consensus.cc:2468] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 3.
I20260709 13:12:28.547216  5231 leader_election.cc:304] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:28.548081  5489 raft_consensus.cc:2804] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:28.548614  5489 raft_consensus.cc:697] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770 [term 3 LEADER]: Becoming Leader. State: Replica: 06ec58698d5444caaecea433c8419770, State: Running, Role: LEADER
I20260709 13:12:28.549515  5489 consensus_queue.cc:237] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:28.562881  4631 raft_consensus.cc:2468] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 3.
I20260709 13:12:28.566612  5519 raft_consensus.cc:993] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc: : Instructing follower 06ec58698d5444caaecea433c8419770 to start an election
I20260709 13:12:28.567260  5519 raft_consensus.cc:1081] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [term 2 LEADER]: Signalling peer 06ec58698d5444caaecea433c8419770 to start an election
I20260709 13:12:28.569871  5331 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a16334f2dff74513ba7ca22ca8fb5afd"
dest_uuid: "06ec58698d5444caaecea433c8419770"
 from {username='slave'} at 127.0.0.1:53146
I20260709 13:12:28.570401  5331 raft_consensus.cc:493] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:28.570727  5331 raft_consensus.cc:3060] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:28.575440  5096 raft_consensus.cc:993] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424: : Instructing follower 06ec58698d5444caaecea433c8419770 to start an election
I20260709 13:12:28.575963  5096 raft_consensus.cc:1081] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [term 2 LEADER]: Signalling peer 06ec58698d5444caaecea433c8419770 to start an election
I20260709 13:12:28.577399  5330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e466269360c4a538e16c342590490c0"
dest_uuid: "06ec58698d5444caaecea433c8419770"
 from {username='slave'} at 127.0.0.1:53138
I20260709 13:12:28.577912  5330 raft_consensus.cc:493] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:28.578223  5330 raft_consensus.cc:3060] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:28.578121  5331 raft_consensus.cc:515] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:28.578622  4310 catalog_manager.cc:5697] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770 reported cstate change: term changed from 2 to 3, leader changed from 74758684df5649ccadd1e189eaff32dc (127.28.173.4) to 06ec58698d5444caaecea433c8419770 (127.28.173.1). New cstate: current_term: 3 leader_uuid: "06ec58698d5444caaecea433c8419770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:28.579732  5331 leader_election.cc:290] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 3 election: Requested vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:28.580905  4631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a16334f2dff74513ba7ca22ca8fb5afd" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:28.581453  4631 raft_consensus.cc:3055] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:28.581751  4631 raft_consensus.cc:740] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Running, Role: LEADER
I20260709 13:12:28.582494  4631 consensus_queue.cc:260] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:28.583664  4631 raft_consensus.cc:3060] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:28.584270  5330 raft_consensus.cc:515] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:28.585466  4486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a16334f2dff74513ba7ca22ca8fb5afd" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:28.585988  4486 raft_consensus.cc:3060] T a16334f2dff74513ba7ca22ca8fb5afd P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:28.588120  4487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e466269360c4a538e16c342590490c0" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:28.588455  5330 leader_election.cc:290] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 3 election: Requested vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:28.588676  4487 raft_consensus.cc:3060] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:28.590910  4556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e466269360c4a538e16c342590490c0" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:28.590992  4631 raft_consensus.cc:2468] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 3.
I20260709 13:12:28.591470  4556 raft_consensus.cc:3055] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:28.591790  4556 raft_consensus.cc:740] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Running, Role: LEADER
I20260709 13:12:28.592141  5231 leader_election.cc:304] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 74758684df5649ccadd1e189eaff32dc; no voters: 
I20260709 13:12:28.592540  4556 consensus_queue.cc:260] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:28.593047  5489 raft_consensus.cc:2804] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:28.593564  5489 raft_consensus.cc:697] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770 [term 3 LEADER]: Becoming Leader. State: Replica: 06ec58698d5444caaecea433c8419770, State: Running, Role: LEADER
I20260709 13:12:28.593639  4556 raft_consensus.cc:3060] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:28.594501  5489 consensus_queue.cc:237] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:28.604329  4486 raft_consensus.cc:2468] T a16334f2dff74513ba7ca22ca8fb5afd P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 3.
I20260709 13:12:28.605834  4487 raft_consensus.cc:2468] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 3.
I20260709 13:12:28.604367  4556 raft_consensus.cc:2468] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 3.
I20260709 13:12:28.610221  5231 leader_election.cc:304] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:28.611029  5489 raft_consensus.cc:2804] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:28.611488  5489 raft_consensus.cc:697] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 [term 3 LEADER]: Becoming Leader. State: Replica: 06ec58698d5444caaecea433c8419770, State: Running, Role: LEADER
I20260709 13:12:28.612317  5489 consensus_queue.cc:237] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:28.614228  4310 catalog_manager.cc:5697] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770 reported cstate change: term changed from 2 to 3, leader changed from 74758684df5649ccadd1e189eaff32dc (127.28.173.4) to 06ec58698d5444caaecea433c8419770 (127.28.173.1). New cstate: current_term: 3 leader_uuid: "06ec58698d5444caaecea433c8419770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:28.633006  4310 catalog_manager.cc:5697] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 reported cstate change: term changed from 2 to 3, leader changed from 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3) to 06ec58698d5444caaecea433c8419770 (127.28.173.1). New cstate: current_term: 3 leader_uuid: "06ec58698d5444caaecea433c8419770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:28.811281  5466 raft_consensus.cc:993] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87: : Instructing follower 06ec58698d5444caaecea433c8419770 to start an election
I20260709 13:12:28.811771  5466 raft_consensus.cc:1081] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [term 2 LEADER]: Signalling peer 06ec58698d5444caaecea433c8419770 to start an election
I20260709 13:12:28.813706  5330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "20be30df26724e7f98f3b36f24e4df3a"
dest_uuid: "06ec58698d5444caaecea433c8419770"
 from {username='slave'} at 127.0.0.1:53122
I20260709 13:12:28.814237  5330 raft_consensus.cc:493] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:28.814567  5330 raft_consensus.cc:3060] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:28.819871  5330 raft_consensus.cc:515] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:28.821322  5330 leader_election.cc:290] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 3 election: Requested vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:28.822058  4486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20be30df26724e7f98f3b36f24e4df3a" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:28.822127  4556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20be30df26724e7f98f3b36f24e4df3a" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:28.822645  4486 raft_consensus.cc:3055] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:28.822805  4556 raft_consensus.cc:3060] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:28.822957  4486 raft_consensus.cc:740] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Running, Role: LEADER
I20260709 13:12:28.823751  4486 consensus_queue.cc:260] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:28.824666  4486 raft_consensus.cc:3060] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:28.827157  4556 raft_consensus.cc:2468] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 3.
I20260709 13:12:28.828051  5230 leader_election.cc:304] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: 
I20260709 13:12:28.828770  5523 raft_consensus.cc:2804] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:28.829041  4486 raft_consensus.cc:2468] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 3.
I20260709 13:12:28.829160  5523 raft_consensus.cc:697] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770 [term 3 LEADER]: Becoming Leader. State: Replica: 06ec58698d5444caaecea433c8419770, State: Running, Role: LEADER
I20260709 13:12:28.830080  5523 consensus_queue.cc:237] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:28.838516  4310 catalog_manager.cc:5697] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770 reported cstate change: term changed from 2 to 3, leader changed from aa0ff974118b465eaa785b8a86057e87 (127.28.173.2) to 06ec58698d5444caaecea433c8419770 (127.28.173.1). New cstate: current_term: 3 leader_uuid: "06ec58698d5444caaecea433c8419770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:29.004413  4486 raft_consensus.cc:1275] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Refusing update from remote peer 06ec58698d5444caaecea433c8419770: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:29.005628  5523 consensus_queue.cc:1048] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:29.014343  4561 raft_consensus.cc:1275] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Refusing update from remote peer 06ec58698d5444caaecea433c8419770: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:29.018752  5507 consensus_queue.cc:1048] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:29.043566  4631 raft_consensus.cc:1275] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [term 3 FOLLOWER]: Refusing update from remote peer 06ec58698d5444caaecea433c8419770: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:29.044653  5523 consensus_queue.cc:1048] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:29.053583  4561 raft_consensus.cc:1275] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Refusing update from remote peer 06ec58698d5444caaecea433c8419770: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:29.054687  5490 consensus_queue.cc:1048] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:29.069002  4631 raft_consensus.cc:1275] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc [term 3 FOLLOWER]: Refusing update from remote peer 06ec58698d5444caaecea433c8419770: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:29.070308  5507 consensus_queue.cc:1048] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:29.088037  4486 raft_consensus.cc:1275] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Refusing update from remote peer 06ec58698d5444caaecea433c8419770: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:29.090850  5507 consensus_queue.cc:1048] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:29.173547  4631 raft_consensus.cc:1275] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [term 3 FOLLOWER]: Refusing update from remote peer 06ec58698d5444caaecea433c8419770: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:29.175103  5507 consensus_queue.cc:1048] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:29.194841  4486 raft_consensus.cc:1275] T a16334f2dff74513ba7ca22ca8fb5afd P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Refusing update from remote peer 06ec58698d5444caaecea433c8419770: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:29.196132  5507 consensus_queue.cc:1048] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:29.217492  4486 raft_consensus.cc:1275] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Refusing update from remote peer 06ec58698d5444caaecea433c8419770: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:29.219018  5507 consensus_queue.cc:1048] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:29.228964  4561 raft_consensus.cc:1275] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Refusing update from remote peer 06ec58698d5444caaecea433c8419770: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:29.230232  5523 consensus_queue.cc:1048] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:29.481735 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:29.522825 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:29.559464  4487 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82d5a41b86eb4457a114692137ced092"
dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
mode: GRACEFUL
new_leader_uuid: "420a61707e804ce5b3773a91cc2eb424"
 from {username='slave'} at 127.0.0.1:53536
I20260709 13:12:29.559940  4487 raft_consensus.cc:606] T 82d5a41b86eb4457a114692137ced092 P aa0ff974118b465eaa785b8a86057e87 [term 1 LEADER]: Received request to transfer leadership to TS 420a61707e804ce5b3773a91cc2eb424
I20260709 13:12:29.562201  4487 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ca87a1b3c8043529d7a9d61b0adfdbf"
dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
mode: GRACEFUL
new_leader_uuid: "06ec58698d5444caaecea433c8419770"
 from {username='slave'} at 127.0.0.1:53536
I20260709 13:12:29.562721  4487 raft_consensus.cc:606] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [term 2 LEADER]: Received request to transfer leadership to TS 06ec58698d5444caaecea433c8419770
I20260709 13:12:29.566237  4487 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0608a8abe6c4bd083d751020218957e"
dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
mode: GRACEFUL
new_leader_uuid: "06ec58698d5444caaecea433c8419770"
 from {username='slave'} at 127.0.0.1:53536
I20260709 13:12:29.566752  4487 raft_consensus.cc:606] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [term 2 LEADER]: Received request to transfer leadership to TS 06ec58698d5444caaecea433c8419770
I20260709 13:12:29.569017  4487 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1dfa63c8b78419c9ff6ffb624a861a7"
dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
mode: GRACEFUL
new_leader_uuid: "74758684df5649ccadd1e189eaff32dc"
 from {username='slave'} at 127.0.0.1:53536
I20260709 13:12:29.569572  4487 raft_consensus.cc:606] T f1dfa63c8b78419c9ff6ffb624a861a7 P aa0ff974118b465eaa785b8a86057e87 [term 1 LEADER]: Received request to transfer leadership to TS 74758684df5649ccadd1e189eaff32dc
I20260709 13:12:29.570601 29364 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:12:29.572256 29364 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:29.620803  5525 raft_consensus.cc:993] T f1dfa63c8b78419c9ff6ffb624a861a7 P aa0ff974118b465eaa785b8a86057e87: : Instructing follower 74758684df5649ccadd1e189eaff32dc to start an election
I20260709 13:12:29.621331  5478 raft_consensus.cc:1081] T f1dfa63c8b78419c9ff6ffb624a861a7 P aa0ff974118b465eaa785b8a86057e87 [term 1 LEADER]: Signalling peer 74758684df5649ccadd1e189eaff32dc to start an election
I20260709 13:12:29.622594  4631 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1dfa63c8b78419c9ff6ffb624a861a7"
dest_uuid: "74758684df5649ccadd1e189eaff32dc"
 from {username='slave'} at 127.0.0.1:54378
I20260709 13:12:29.623081  4631 raft_consensus.cc:493] T f1dfa63c8b78419c9ff6ffb624a861a7 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:29.623369  4631 raft_consensus.cc:3060] T f1dfa63c8b78419c9ff6ffb624a861a7 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:29.628314  4631 raft_consensus.cc:515] T f1dfa63c8b78419c9ff6ffb624a861a7 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:29.629983  4631 leader_election.cc:290] T f1dfa63c8b78419c9ff6ffb624a861a7 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 election: Requested vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:29.631044  4487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1dfa63c8b78419c9ff6ffb624a861a7" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:29.631531  4556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1dfa63c8b78419c9ff6ffb624a861a7" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:29.631711  4487 raft_consensus.cc:3055] T f1dfa63c8b78419c9ff6ffb624a861a7 P aa0ff974118b465eaa785b8a86057e87 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:29.632140  4556 raft_consensus.cc:3060] T f1dfa63c8b78419c9ff6ffb624a861a7 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:29.632143  4487 raft_consensus.cc:740] T f1dfa63c8b78419c9ff6ffb624a861a7 P aa0ff974118b465eaa785b8a86057e87 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Running, Role: LEADER
I20260709 13:12:29.633217  4487 consensus_queue.cc:260] T f1dfa63c8b78419c9ff6ffb624a861a7 P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:29.634414  4487 raft_consensus.cc:3060] T f1dfa63c8b78419c9ff6ffb624a861a7 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:29.638098  4556 raft_consensus.cc:2468] T f1dfa63c8b78419c9ff6ffb624a861a7 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 2.
I20260709 13:12:29.639411  4602 leader_election.cc:304] T f1dfa63c8b78419c9ff6ffb624a861a7 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc; no voters: 
I20260709 13:12:29.640236  5519 raft_consensus.cc:2804] T f1dfa63c8b78419c9ff6ffb624a861a7 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:29.640677  4487 raft_consensus.cc:2468] T f1dfa63c8b78419c9ff6ffb624a861a7 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 2.
I20260709 13:12:29.640753  5519 raft_consensus.cc:697] T f1dfa63c8b78419c9ff6ffb624a861a7 P 74758684df5649ccadd1e189eaff32dc [term 2 LEADER]: Becoming Leader. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Running, Role: LEADER
I20260709 13:12:29.641808  5519 consensus_queue.cc:237] T f1dfa63c8b78419c9ff6ffb624a861a7 P 74758684df5649ccadd1e189eaff32dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:29.651379  4308 catalog_manager.cc:5697] T f1dfa63c8b78419c9ff6ffb624a861a7 P 74758684df5649ccadd1e189eaff32dc reported cstate change: term changed from 1 to 2, leader changed from aa0ff974118b465eaa785b8a86057e87 (127.28.173.2) to 74758684df5649ccadd1e189eaff32dc (127.28.173.4). New cstate: current_term: 2 leader_uuid: "74758684df5649ccadd1e189eaff32dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:29.877717  5478 raft_consensus.cc:993] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87: : Instructing follower 06ec58698d5444caaecea433c8419770 to start an election
I20260709 13:12:29.878209  5525 raft_consensus.cc:1081] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [term 2 LEADER]: Signalling peer 06ec58698d5444caaecea433c8419770 to start an election
I20260709 13:12:29.879463  5330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ca87a1b3c8043529d7a9d61b0adfdbf"
dest_uuid: "06ec58698d5444caaecea433c8419770"
 from {username='slave'} at 127.0.0.1:53122
I20260709 13:12:29.879845  5330 raft_consensus.cc:493] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:29.880062  5330 raft_consensus.cc:3060] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:29.884583  5330 raft_consensus.cc:515] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:29.886111  5330 leader_election.cc:290] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 3 election: Requested vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:29.886830  4486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca87a1b3c8043529d7a9d61b0adfdbf" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:29.886966  4556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca87a1b3c8043529d7a9d61b0adfdbf" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:29.887398  4486 raft_consensus.cc:3055] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:29.887502  4556 raft_consensus.cc:3060] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:29.887787  4486 raft_consensus.cc:740] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Running, Role: LEADER
I20260709 13:12:29.888592  4486 consensus_queue.cc:260] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:29.889387  4486 raft_consensus.cc:3060] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:29.892175  4556 raft_consensus.cc:2468] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 3.
I20260709 13:12:29.893348  5230 leader_election.cc:304] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: 
I20260709 13:12:29.894126  5546 raft_consensus.cc:2804] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:29.894543  4486 raft_consensus.cc:2468] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 3.
I20260709 13:12:29.894655  5546 raft_consensus.cc:697] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770 [term 3 LEADER]: Becoming Leader. State: Replica: 06ec58698d5444caaecea433c8419770, State: Running, Role: LEADER
I20260709 13:12:29.896077  5546 consensus_queue.cc:237] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:29.907891  4308 catalog_manager.cc:5697] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770 reported cstate change: term changed from 2 to 3, leader changed from aa0ff974118b465eaa785b8a86057e87 (127.28.173.2) to 06ec58698d5444caaecea433c8419770 (127.28.173.1). New cstate: current_term: 3 leader_uuid: "06ec58698d5444caaecea433c8419770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:29.944011  5478 raft_consensus.cc:993] T 82d5a41b86eb4457a114692137ced092 P aa0ff974118b465eaa785b8a86057e87: : Instructing follower 420a61707e804ce5b3773a91cc2eb424 to start an election
I20260709 13:12:29.944499  5478 raft_consensus.cc:1081] T 82d5a41b86eb4457a114692137ced092 P aa0ff974118b465eaa785b8a86057e87 [term 1 LEADER]: Signalling peer 420a61707e804ce5b3773a91cc2eb424 to start an election
I20260709 13:12:29.945768  4556 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82d5a41b86eb4457a114692137ced092"
dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
 from {username='slave'} at 127.0.0.1:48330
I20260709 13:12:29.946328  4556 raft_consensus.cc:493] T 82d5a41b86eb4457a114692137ced092 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:29.946682  4556 raft_consensus.cc:3060] T 82d5a41b86eb4457a114692137ced092 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:29.952632  4556 raft_consensus.cc:515] T 82d5a41b86eb4457a114692137ced092 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:29.954209  4556 leader_election.cc:290] T 82d5a41b86eb4457a114692137ced092 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 election: Requested vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:29.954644  4486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d5a41b86eb4457a114692137ced092" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:29.955088  4629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d5a41b86eb4457a114692137ced092" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:29.955296  4486 raft_consensus.cc:3055] T 82d5a41b86eb4457a114692137ced092 P aa0ff974118b465eaa785b8a86057e87 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:29.955632  4486 raft_consensus.cc:740] T 82d5a41b86eb4457a114692137ced092 P aa0ff974118b465eaa785b8a86057e87 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Running, Role: LEADER
I20260709 13:12:29.955644  4629 raft_consensus.cc:3060] T 82d5a41b86eb4457a114692137ced092 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:29.956501  4486 consensus_queue.cc:260] T 82d5a41b86eb4457a114692137ced092 P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:29.957674  4486 raft_consensus.cc:3060] T 82d5a41b86eb4457a114692137ced092 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:29.962599  4629 raft_consensus.cc:2468] T 82d5a41b86eb4457a114692137ced092 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 2.
I20260709 13:12:29.963173  5525 raft_consensus.cc:993] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87: : Instructing follower 06ec58698d5444caaecea433c8419770 to start an election
I20260709 13:12:29.963629  5525 raft_consensus.cc:1081] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [term 2 LEADER]: Signalling peer 06ec58698d5444caaecea433c8419770 to start an election
I20260709 13:12:29.964022  4486 raft_consensus.cc:2468] T 82d5a41b86eb4457a114692137ced092 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 2.
I20260709 13:12:29.965420  5330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0608a8abe6c4bd083d751020218957e"
dest_uuid: "06ec58698d5444caaecea433c8419770"
 from {username='slave'} at 127.0.0.1:53122
I20260709 13:12:29.965827  5330 raft_consensus.cc:493] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:29.966100  5330 raft_consensus.cc:3060] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:29.970655  5330 raft_consensus.cc:515] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:29.964294  4529 leader_election.cc:304] T 82d5a41b86eb4457a114692137ced092 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc; no voters: 
I20260709 13:12:29.971668  5096 raft_consensus.cc:2804] T 82d5a41b86eb4457a114692137ced092 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:29.974761  5330 leader_election.cc:290] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 3 election: Requested vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:29.978680  4486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0608a8abe6c4bd083d751020218957e" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:29.979480  4561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0608a8abe6c4bd083d751020218957e" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:29.981495  4561 raft_consensus.cc:3060] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:29.983310  5096 raft_consensus.cc:697] T 82d5a41b86eb4457a114692137ced092 P 420a61707e804ce5b3773a91cc2eb424 [term 2 LEADER]: Becoming Leader. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Running, Role: LEADER
I20260709 13:12:29.984171  5096 consensus_queue.cc:237] T 82d5a41b86eb4457a114692137ced092 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:29.987694  4561 raft_consensus.cc:2468] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 3.
I20260709 13:12:29.990581  4486 raft_consensus.cc:3055] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:29.991568  4486 raft_consensus.cc:740] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Running, Role: LEADER
I20260709 13:12:29.991619  5230 leader_election.cc:304] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: 
I20260709 13:12:29.992499  4486 consensus_queue.cc:260] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:29.992722  5546 raft_consensus.cc:2804] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:29.993414  5546 raft_consensus.cc:697] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770 [term 3 LEADER]: Becoming Leader. State: Replica: 06ec58698d5444caaecea433c8419770, State: Running, Role: LEADER
I20260709 13:12:29.993546  4486 raft_consensus.cc:3060] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:29.994321  5546 consensus_queue.cc:237] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:29.999212  4486 raft_consensus.cc:2468] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 3.
I20260709 13:12:30.005693  4308 catalog_manager.cc:5697] T 82d5a41b86eb4457a114692137ced092 P 420a61707e804ce5b3773a91cc2eb424 reported cstate change: term changed from 1 to 2, leader changed from aa0ff974118b465eaa785b8a86057e87 (127.28.173.2) to 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3). New cstate: current_term: 2 leader_uuid: "420a61707e804ce5b3773a91cc2eb424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:30.009321  4310 catalog_manager.cc:5697] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770 reported cstate change: term changed from 2 to 3, leader changed from aa0ff974118b465eaa785b8a86057e87 (127.28.173.2) to 06ec58698d5444caaecea433c8419770 (127.28.173.1). New cstate: current_term: 3 leader_uuid: "06ec58698d5444caaecea433c8419770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:30.115384  4485 raft_consensus.cc:1275] T f1dfa63c8b78419c9ff6ffb624a861a7 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Refusing update from remote peer 74758684df5649ccadd1e189eaff32dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:30.116659  5545 consensus_queue.cc:1048] T f1dfa63c8b78419c9ff6ffb624a861a7 P 74758684df5649ccadd1e189eaff32dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:30.133358  4561 raft_consensus.cc:1275] T f1dfa63c8b78419c9ff6ffb624a861a7 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Refusing update from remote peer 74758684df5649ccadd1e189eaff32dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:30.134629  5469 consensus_queue.cc:1048] T f1dfa63c8b78419c9ff6ffb624a861a7 P 74758684df5649ccadd1e189eaff32dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:30.445917  4561 raft_consensus.cc:1275] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Refusing update from remote peer 06ec58698d5444caaecea433c8419770: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:30.447096  5490 consensus_queue.cc:1048] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:30.460275  4561 raft_consensus.cc:1275] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Refusing update from remote peer 06ec58698d5444caaecea433c8419770: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:30.461632  5490 consensus_queue.cc:1048] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:30.465693  4487 raft_consensus.cc:1275] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Refusing update from remote peer 06ec58698d5444caaecea433c8419770: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:30.467370  5490 consensus_queue.cc:1048] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:30.470682  4487 raft_consensus.cc:1275] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Refusing update from remote peer 06ec58698d5444caaecea433c8419770: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:30.476261  5546 consensus_queue.cc:1048] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:30.537068  4629 raft_consensus.cc:1275] T 82d5a41b86eb4457a114692137ced092 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Refusing update from remote peer 420a61707e804ce5b3773a91cc2eb424: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:30.538180  5096 consensus_queue.cc:1048] T 82d5a41b86eb4457a114692137ced092 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:30.552191  4485 raft_consensus.cc:1275] T 82d5a41b86eb4457a114692137ced092 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Refusing update from remote peer 420a61707e804ce5b3773a91cc2eb424: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:30.556207  5096 consensus_queue.cc:1048] T 82d5a41b86eb4457a114692137ced092 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:30.573078 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:30.615696 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:30.652262  4631 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1271bae393604d56b9e376c716eb2a9e"
dest_uuid: "74758684df5649ccadd1e189eaff32dc"
mode: GRACEFUL
new_leader_uuid: "420a61707e804ce5b3773a91cc2eb424"
 from {username='slave'} at 127.0.0.1:38284
I20260709 13:12:30.652901  4631 raft_consensus.cc:606] T 1271bae393604d56b9e376c716eb2a9e P 74758684df5649ccadd1e189eaff32dc [term 1 LEADER]: Received request to transfer leadership to TS 420a61707e804ce5b3773a91cc2eb424
I20260709 13:12:30.655598  4561 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3501a75721d543d598af7857e368e08b"
dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
mode: GRACEFUL
new_leader_uuid: "06ec58698d5444caaecea433c8419770"
 from {username='slave'} at 127.0.0.1:57844
I20260709 13:12:30.656167  4561 raft_consensus.cc:606] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [term 1 LEADER]: Received request to transfer leadership to TS 06ec58698d5444caaecea433c8419770
I20260709 13:12:30.657249 29364 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:12:30.658538 29364 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:31.392107  5576 raft_consensus.cc:993] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424: : Instructing follower 06ec58698d5444caaecea433c8419770 to start an election
I20260709 13:12:31.392684  5576 raft_consensus.cc:1081] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [term 1 LEADER]: Signalling peer 06ec58698d5444caaecea433c8419770 to start an election
I20260709 13:12:31.414178  5330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3501a75721d543d598af7857e368e08b"
dest_uuid: "06ec58698d5444caaecea433c8419770"
 from {username='slave'} at 127.0.0.1:53138
I20260709 13:12:31.414749  5330 raft_consensus.cc:493] T 3501a75721d543d598af7857e368e08b P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:31.415130  5330 raft_consensus.cc:3060] T 3501a75721d543d598af7857e368e08b P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:31.423194  4603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.2:45987, user_credentials={real_user=slave}} blocked reactor thread for 75360.8us
I20260709 13:12:31.434027  5330 raft_consensus.cc:515] T 3501a75721d543d598af7857e368e08b P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:31.440058  5330 leader_election.cc:290] T 3501a75721d543d598af7857e368e08b P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 2 election: Requested vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:31.442175  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3501a75721d543d598af7857e368e08b" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:31.442683  4563 raft_consensus.cc:3055] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:31.442857  4563 raft_consensus.cc:740] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Running, Role: LEADER
I20260709 13:12:31.443508  4563 consensus_queue.cc:260] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:31.444357  4563 raft_consensus.cc:3060] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:31.451661  4563 raft_consensus.cc:2468] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 2.
I20260709 13:12:31.452559  5230 leader_election.cc:304] T 3501a75721d543d598af7857e368e08b P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: 
I20260709 13:12:31.453209  5571 raft_consensus.cc:2804] T 3501a75721d543d598af7857e368e08b P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:31.453692  5571 raft_consensus.cc:697] T 3501a75721d543d598af7857e368e08b P 06ec58698d5444caaecea433c8419770 [term 2 LEADER]: Becoming Leader. State: Replica: 06ec58698d5444caaecea433c8419770, State: Running, Role: LEADER
I20260709 13:12:31.454528  5571 consensus_queue.cc:237] T 3501a75721d543d598af7857e368e08b P 06ec58698d5444caaecea433c8419770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:31.460387  4629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3501a75721d543d598af7857e368e08b" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:31.461079  4629 raft_consensus.cc:3060] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:31.467767  4629 raft_consensus.cc:2468] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 2.
I20260709 13:12:31.486021  4629 raft_consensus.cc:1240] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Rejecting Update request from peer 420a61707e804ce5b3773a91cc2eb424 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:31.516928  5582 raft_consensus.cc:993] T 1271bae393604d56b9e376c716eb2a9e P 74758684df5649ccadd1e189eaff32dc: : Instructing follower 420a61707e804ce5b3773a91cc2eb424 to start an election
I20260709 13:12:31.517449  5583 raft_consensus.cc:1081] T 1271bae393604d56b9e376c716eb2a9e P 74758684df5649ccadd1e189eaff32dc [term 1 LEADER]: Signalling peer 420a61707e804ce5b3773a91cc2eb424 to start an election
I20260709 13:12:31.518818  4563 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1271bae393604d56b9e376c716eb2a9e"
dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
 from {username='slave'} at 127.0.0.1:48338
I20260709 13:12:31.518654  4311 catalog_manager.cc:5697] T 3501a75721d543d598af7857e368e08b P 06ec58698d5444caaecea433c8419770 reported cstate change: term changed from 1 to 2, leader changed from 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3) to 06ec58698d5444caaecea433c8419770 (127.28.173.1). New cstate: current_term: 2 leader_uuid: "06ec58698d5444caaecea433c8419770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:31.519294  4563 raft_consensus.cc:493] T 1271bae393604d56b9e376c716eb2a9e P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:31.519719  4563 raft_consensus.cc:3060] T 1271bae393604d56b9e376c716eb2a9e P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:31.525893  4563 raft_consensus.cc:515] T 1271bae393604d56b9e376c716eb2a9e P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:31.528610  4487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1271bae393604d56b9e376c716eb2a9e" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:31.528904  4563 leader_election.cc:290] T 1271bae393604d56b9e376c716eb2a9e P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 election: Requested vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711)
I20260709 13:12:31.529179  4487 raft_consensus.cc:3060] T 1271bae393604d56b9e376c716eb2a9e P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:31.529968  4630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1271bae393604d56b9e376c716eb2a9e" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:31.530522  4630 raft_consensus.cc:3055] T 1271bae393604d56b9e376c716eb2a9e P 74758684df5649ccadd1e189eaff32dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:31.530723  4630 raft_consensus.cc:740] T 1271bae393604d56b9e376c716eb2a9e P 74758684df5649ccadd1e189eaff32dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Running, Role: LEADER
I20260709 13:12:31.531421  4630 consensus_queue.cc:260] T 1271bae393604d56b9e376c716eb2a9e P 74758684df5649ccadd1e189eaff32dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:31.532408  4630 raft_consensus.cc:3060] T 1271bae393604d56b9e376c716eb2a9e P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:31.534229  4487 raft_consensus.cc:2468] T 1271bae393604d56b9e376c716eb2a9e P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 2.
I20260709 13:12:31.535249  4529 leader_election.cc:304] T 1271bae393604d56b9e376c716eb2a9e P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:31.536060  5515 raft_consensus.cc:2804] T 1271bae393604d56b9e376c716eb2a9e P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:31.536484  5515 raft_consensus.cc:697] T 1271bae393604d56b9e376c716eb2a9e P 420a61707e804ce5b3773a91cc2eb424 [term 2 LEADER]: Becoming Leader. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Running, Role: LEADER
I20260709 13:12:31.537170  5515 consensus_queue.cc:237] T 1271bae393604d56b9e376c716eb2a9e P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } }
I20260709 13:12:31.538089  4630 raft_consensus.cc:2468] T 1271bae393604d56b9e376c716eb2a9e P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 2.
I20260709 13:12:31.546726  4311 catalog_manager.cc:5697] T 1271bae393604d56b9e376c716eb2a9e P 420a61707e804ce5b3773a91cc2eb424 reported cstate change: term changed from 1 to 2, leader changed from 74758684df5649ccadd1e189eaff32dc (127.28.173.4) to 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3). New cstate: current_term: 2 leader_uuid: "420a61707e804ce5b3773a91cc2eb424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:31.878212  4563 raft_consensus.cc:1275] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Refusing update from remote peer 06ec58698d5444caaecea433c8419770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:31.888525  5571 consensus_queue.cc:1048] T 3501a75721d543d598af7857e368e08b P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:31.986513  4634 raft_consensus.cc:1275] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Refusing update from remote peer 06ec58698d5444caaecea433c8419770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:31.989607  5585 consensus_queue.cc:1048] T 3501a75721d543d598af7857e368e08b P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:32.038935  4487 raft_consensus.cc:1275] T 1271bae393604d56b9e376c716eb2a9e P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Refusing update from remote peer 420a61707e804ce5b3773a91cc2eb424: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:32.040467  5515 consensus_queue.cc:1048] T 1271bae393604d56b9e376c716eb2a9e P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:32.052042  4634 raft_consensus.cc:1275] T 1271bae393604d56b9e376c716eb2a9e P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Refusing update from remote peer 420a61707e804ce5b3773a91cc2eb424: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:32.053720  5569 consensus_queue.cc:1048] T 1271bae393604d56b9e376c716eb2a9e P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:32.155404 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:32.209179 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:32.245404  4563 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb23991ab8504ee491f905a4346edee9"
dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
mode: GRACEFUL
new_leader_uuid: "06ec58698d5444caaecea433c8419770"
 from {username='slave'} at 127.0.0.1:57844
I20260709 13:12:32.246258  4563 raft_consensus.cc:606] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424 [term 1 LEADER]: Received request to transfer leadership to TS 06ec58698d5444caaecea433c8419770
I20260709 13:12:32.247488 29364 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:12:32.248775 29364 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:32.358183  5569 raft_consensus.cc:993] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424: : Instructing follower 06ec58698d5444caaecea433c8419770 to start an election
I20260709 13:12:32.358803  5576 raft_consensus.cc:1081] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424 [term 1 LEADER]: Signalling peer 06ec58698d5444caaecea433c8419770 to start an election
I20260709 13:12:32.361069  5331 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb23991ab8504ee491f905a4346edee9"
dest_uuid: "06ec58698d5444caaecea433c8419770"
 from {username='slave'} at 127.0.0.1:53138
I20260709 13:12:32.362046  5331 raft_consensus.cc:493] T cb23991ab8504ee491f905a4346edee9 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:32.362442  5331 raft_consensus.cc:3060] T cb23991ab8504ee491f905a4346edee9 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:32.369984  5331 raft_consensus.cc:515] T cb23991ab8504ee491f905a4346edee9 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
W20260709 13:12:32.371003  5382 debug-util.cc:398] Leaking SignalData structure 0x7b08003325a0 after lost signal to thread 29367
I20260709 13:12:32.371991  5331 leader_election.cc:290] T cb23991ab8504ee491f905a4346edee9 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 2 election: Requested vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
W20260709 13:12:32.372610  5382 debug-util.cc:398] Leaking SignalData structure 0x7b08001f8ac0 after lost signal to thread 4345
I20260709 13:12:32.374997  4482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb23991ab8504ee491f905a4346edee9" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:32.375671  4482 raft_consensus.cc:3060] T cb23991ab8504ee491f905a4346edee9 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:32.378891  5382 debug-util.cc:398] Leaking SignalData structure 0x7b08003248a0 after lost signal to thread 4513
W20260709 13:12:32.380366  5382 debug-util.cc:398] Leaking SignalData structure 0x7b0800314540 after lost signal to thread 4587
W20260709 13:12:32.381718  5382 debug-util.cc:398] Leaking SignalData structure 0x7b080017f5e0 after lost signal to thread 4661
I20260709 13:12:32.382304  4482 raft_consensus.cc:2468] T cb23991ab8504ee491f905a4346edee9 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 2.
W20260709 13:12:32.383231  5382 debug-util.cc:398] Leaking SignalData structure 0x7b08001968c0 after lost signal to thread 5390
I20260709 13:12:32.385542  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb23991ab8504ee491f905a4346edee9" candidate_uuid: "06ec58698d5444caaecea433c8419770" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:32.386133  4563 raft_consensus.cc:3055] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:32.386402  4563 raft_consensus.cc:740] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Running, Role: LEADER
I20260709 13:12:32.387396  4563 consensus_queue.cc:260] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:32.388523  4563 raft_consensus.cc:3060] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:32.394236  4563 raft_consensus.cc:2468] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06ec58698d5444caaecea433c8419770 in term 2.
I20260709 13:12:32.395182  5230 leader_election.cc:304] T cb23991ab8504ee491f905a4346edee9 P 06ec58698d5444caaecea433c8419770 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424; no voters: 
I20260709 13:12:32.395922  5571 raft_consensus.cc:2804] T cb23991ab8504ee491f905a4346edee9 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:32.400279  5571 raft_consensus.cc:697] T cb23991ab8504ee491f905a4346edee9 P 06ec58698d5444caaecea433c8419770 [term 2 LEADER]: Becoming Leader. State: Replica: 06ec58698d5444caaecea433c8419770, State: Running, Role: LEADER
I20260709 13:12:32.401150  5571 consensus_queue.cc:237] T cb23991ab8504ee491f905a4346edee9 P 06ec58698d5444caaecea433c8419770 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:32.424099  4310 catalog_manager.cc:5697] T cb23991ab8504ee491f905a4346edee9 P 06ec58698d5444caaecea433c8419770 reported cstate change: term changed from 1 to 2, leader changed from 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3) to 06ec58698d5444caaecea433c8419770 (127.28.173.1). New cstate: current_term: 2 leader_uuid: "06ec58698d5444caaecea433c8419770" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:32.926429  4563 raft_consensus.cc:1275] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Refusing update from remote peer 06ec58698d5444caaecea433c8419770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:32.927516  5604 consensus_queue.cc:1048] T cb23991ab8504ee491f905a4346edee9 P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:32.942080  4482 raft_consensus.cc:1275] T cb23991ab8504ee491f905a4346edee9 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Refusing update from remote peer 06ec58698d5444caaecea433c8419770: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:32.943526  5604 consensus_queue.cc:1048] T cb23991ab8504ee491f905a4346edee9 P 06ec58698d5444caaecea433c8419770 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:33.249593 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:33.305467 29364 tablet_server.cc:179] TabletServer@127.28.173.1:36439 shutting down...
W20260709 13:12:33.321622  4455 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 232 similar messages]
W20260709 13:12:33.346918  4603 consensus_peers.cc:597] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:33.359906  4455 consensus_peers.cc:597] T 9d526ab043434bf0bcab814f9bbc3234 P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:33.363019  4455 consensus_peers.cc:597] T 47d66fc2153d419082eccd7e30643d56 P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:33.389542  4529 consensus_peers.cc:597] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:33.401250  4455 consensus_peers.cc:597] T b6256e4aa07c45c78b2bbff56a852078 P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:33.401789 29364 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:12:33.405232  4603 consensus_peers.cc:597] T 325a5a55a44a47ce97869216b084f89d P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:33.408248 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:33.410274 29364 raft_consensus.cc:2243] T e50b6f5a42a24867ab5f90ad6d97401e P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:12:33.410725  4529 consensus_peers.cc:597] T 980616077a8445ccbe984f63131e1b44 P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:33.410928 29364 raft_consensus.cc:2272] T e50b6f5a42a24867ab5f90ad6d97401e P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.414865 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:33.415946 29364 raft_consensus.cc:2243] T 1503964d57034b31b36eecc16f2c84a0 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.416605 29364 raft_consensus.cc:2272] T 1503964d57034b31b36eecc16f2c84a0 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.420637 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:33.421531 29364 raft_consensus.cc:2243] T 325a5a55a44a47ce97869216b084f89d P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.422092 29364 raft_consensus.cc:2272] T 325a5a55a44a47ce97869216b084f89d P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.424675 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:33.425590 29364 raft_consensus.cc:2243] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.426074 29364 raft_consensus.cc:2272] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.429296 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:33.430153 29364 raft_consensus.cc:2243] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:33.431160 29364 raft_consensus.cc:2272] T a8fb0d1b4ae14754aa30516d12cdea3d P 06ec58698d5444caaecea433c8419770 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:33.432498  4603 consensus_peers.cc:597] T 81197f2dcf424fbaaab746d5f8bf7c8c P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:33.434625 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:33.435501 29364 raft_consensus.cc:2243] T ff7757f22fe3408f8745bc899f3c2e4e P 06ec58698d5444caaecea433c8419770 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:33.436529 29364 raft_consensus.cc:2272] T ff7757f22fe3408f8745bc899f3c2e4e P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.439245 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:33.440096 29364 raft_consensus.cc:2243] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:33.440884 29364 raft_consensus.cc:2272] T d0608a8abe6c4bd083d751020218957e P 06ec58698d5444caaecea433c8419770 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.444128 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:33.444947 29364 raft_consensus.cc:2243] T 47d66fc2153d419082eccd7e30643d56 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.445526 29364 raft_consensus.cc:2272] T 47d66fc2153d419082eccd7e30643d56 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.448284 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:33.448947 29364 raft_consensus.cc:2243] T 60d704077649426ab65d89dd9ff778d0 P 06ec58698d5444caaecea433c8419770 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:33.449776 29364 raft_consensus.cc:2272] T 60d704077649426ab65d89dd9ff778d0 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.452165 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:33.452694 29364 raft_consensus.cc:2243] T 81197f2dcf424fbaaab746d5f8bf7c8c P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.453097 29364 raft_consensus.cc:2272] T 81197f2dcf424fbaaab746d5f8bf7c8c P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.455878 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:33.456444 29364 raft_consensus.cc:2243] T 3501a75721d543d598af7857e368e08b P 06ec58698d5444caaecea433c8419770 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:33.457124 29364 raft_consensus.cc:2272] T 3501a75721d543d598af7857e368e08b P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.459699 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:33.460317 29364 raft_consensus.cc:2243] T 3f696298fcc049c08b47cd54f901be0c P 06ec58698d5444caaecea433c8419770 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.460816 29364 raft_consensus.cc:2272] T 3f696298fcc049c08b47cd54f901be0c P 06ec58698d5444caaecea433c8419770 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.463522 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:33.464296 29364 raft_consensus.cc:2243] T 584f5934b7fa4c7ab4b0b43923621e70 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.464944 29364 raft_consensus.cc:2272] T 584f5934b7fa4c7ab4b0b43923621e70 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.467989 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:33.468982 29364 raft_consensus.cc:2243] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:33.470031 29364 raft_consensus.cc:2272] T a16334f2dff74513ba7ca22ca8fb5afd P 06ec58698d5444caaecea433c8419770 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:33.472185  4455 consensus_peers.cc:597] T 98342133e28b47d8a388f9321d5fd796 P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:33.472733 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:33.473641 29364 raft_consensus.cc:2243] T 98342133e28b47d8a388f9321d5fd796 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.474233 29364 raft_consensus.cc:2272] T 98342133e28b47d8a388f9321d5fd796 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.477608 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:33.478856 29364 raft_consensus.cc:2243] T b731fe02a6f4441e816628760bfdfb54 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.479585 29364 raft_consensus.cc:2272] T b731fe02a6f4441e816628760bfdfb54 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.483266 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:33.484421 29364 raft_consensus.cc:2243] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:33.485684 29364 raft_consensus.cc:2272] T 9a508f846d314fa0b7ec364af09bc427 P 06ec58698d5444caaecea433c8419770 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.488824 29364 tablet_replica.cc:333] stopping tablet replica
W20260709 13:12:33.489104  4603 consensus_peers.cc:597] T 69aed23cb12849fda6220c6c65580d59 P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:33.489415 29364 raft_consensus.cc:2243] T 5b827ee48d56478398f009c3fa980016 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.490020 29364 raft_consensus.cc:2272] T 5b827ee48d56478398f009c3fa980016 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.492923 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:33.493655 29364 raft_consensus.cc:2243] T b6256e4aa07c45c78b2bbff56a852078 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.494238 29364 raft_consensus.cc:2272] T b6256e4aa07c45c78b2bbff56a852078 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:33.494465  4455 consensus_peers.cc:597] T 5b827ee48d56478398f009c3fa980016 P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:33.497076 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:33.497777 29364 raft_consensus.cc:2243] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.498373 29364 raft_consensus.cc:2272] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.500777 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:33.501349 29364 raft_consensus.cc:2243] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:33.502105 29364 raft_consensus.cc:2272] T f7682a3f7f134c34a24488586461f6a4 P 06ec58698d5444caaecea433c8419770 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.504712 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:33.505515 29364 raft_consensus.cc:2243] T d1119afee9d6413aa2cd229073ffbcf1 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.506054 29364 raft_consensus.cc:2272] T d1119afee9d6413aa2cd229073ffbcf1 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.508533 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:33.509107 29364 raft_consensus.cc:2243] T aa241e695dbb492a971f537d1f977f21 P 06ec58698d5444caaecea433c8419770 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:33.509897 29364 raft_consensus.cc:2272] T aa241e695dbb492a971f537d1f977f21 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.512781 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:33.513554 29364 raft_consensus.cc:2243] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.514093 29364 raft_consensus.cc:2272] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.517104 29364 tablet_replica.cc:333] stopping tablet replica
W20260709 13:12:33.519330  4529 consensus_peers.cc:597] T 812a1b53a40e469c89b5f2aba8c59780 P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:33.521944  4603 consensus_peers.cc:597] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:33.528103 29364 raft_consensus.cc:2243] T 150545c47e0642229a92ede96db14fc9 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.528776 29364 raft_consensus.cc:2272] T 150545c47e0642229a92ede96db14fc9 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.530885 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:33.531487 29364 raft_consensus.cc:2243] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:33.532295 29364 raft_consensus.cc:2272] T 2e466269360c4a538e16c342590490c0 P 06ec58698d5444caaecea433c8419770 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.534619 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:33.535341 29364 raft_consensus.cc:2243] T d8033bfb7f5d423d90d60318c67df709 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.535890 29364 raft_consensus.cc:2272] T d8033bfb7f5d423d90d60318c67df709 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.538549 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:33.539189 29364 raft_consensus.cc:2243] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:33.540004 29364 raft_consensus.cc:2272] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 06ec58698d5444caaecea433c8419770 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.541913 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:33.542456 29364 raft_consensus.cc:2243] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 06ec58698d5444caaecea433c8419770 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:33.543203 29364 raft_consensus.cc:2272] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.545753 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:33.546533 29364 raft_consensus.cc:2243] T 980616077a8445ccbe984f63131e1b44 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.547115 29364 raft_consensus.cc:2272] T 980616077a8445ccbe984f63131e1b44 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.549983 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:33.550674 29364 raft_consensus.cc:2243] T 3d38413c5dce44db8a755b48adacc3a8 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.552337 29364 raft_consensus.cc:2272] T 3d38413c5dce44db8a755b48adacc3a8 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:33.554390  4603 consensus_peers.cc:597] T e50b6f5a42a24867ab5f90ad6d97401e P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:33.555711 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:33.556589 29364 raft_consensus.cc:2243] T cb23991ab8504ee491f905a4346edee9 P 06ec58698d5444caaecea433c8419770 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:33.557492 29364 raft_consensus.cc:2272] T cb23991ab8504ee491f905a4346edee9 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:33.557587  4455 consensus_peers.cc:597] T 1503964d57034b31b36eecc16f2c84a0 P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:33.561118 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:33.562008 29364 raft_consensus.cc:2243] T 09294b866578436a827c27702d4b1d0b P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.562654 29364 raft_consensus.cc:2272] T 09294b866578436a827c27702d4b1d0b P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.565197 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:33.565900 29364 raft_consensus.cc:2243] T 0dc4f903fb004dd2bce3c4934f078a5d P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.566425 29364 raft_consensus.cc:2272] T 0dc4f903fb004dd2bce3c4934f078a5d P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:33.567605  4603 consensus_peers.cc:597] T d0147a5552154f26a88833f9210b1358 P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:33.569070 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:33.569674 29364 raft_consensus.cc:2243] T d0147a5552154f26a88833f9210b1358 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.570044 29364 raft_consensus.cc:2272] T d0147a5552154f26a88833f9210b1358 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.572737 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:33.573472 29364 raft_consensus.cc:2243] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.574163 29364 raft_consensus.cc:2272] T 9d526ab043434bf0bcab814f9bbc3234 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.576560 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:33.577109 29364 raft_consensus.cc:2243] T 604a93ed898f4ab9b771487bfe278b33 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.577651 29364 raft_consensus.cc:2272] T 604a93ed898f4ab9b771487bfe278b33 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.579737 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:33.580518 29364 raft_consensus.cc:2243] T 002595643d984c1c915975d4c4ace485 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.581020 29364 raft_consensus.cc:2272] T 002595643d984c1c915975d4c4ace485 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.583151 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:33.583668 29364 raft_consensus.cc:2243] T d088694ef66442bdbf75cc7fc1942a83 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.584167 29364 raft_consensus.cc:2272] T d088694ef66442bdbf75cc7fc1942a83 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.586537 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:33.587572 29364 raft_consensus.cc:2243] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.588255 29364 raft_consensus.cc:2272] T 812a1b53a40e469c89b5f2aba8c59780 P 06ec58698d5444caaecea433c8419770 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.591158 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:33.591884 29364 raft_consensus.cc:2243] T 69aed23cb12849fda6220c6c65580d59 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.592482 29364 raft_consensus.cc:2272] T 69aed23cb12849fda6220c6c65580d59 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.595402 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:33.596313 29364 raft_consensus.cc:2243] T a4736bb71dfa4f4b8b80e8a52895acf7 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.596781 29364 raft_consensus.cc:2272] T a4736bb71dfa4f4b8b80e8a52895acf7 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.599428 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:33.612938 29364 raft_consensus.cc:2243] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770 [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:12:33.612938  4455 consensus_peers.cc:597] T 09294b866578436a827c27702d4b1d0b P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:33.614174 29364 raft_consensus.cc:2272] T 20be30df26724e7f98f3b36f24e4df3a P 06ec58698d5444caaecea433c8419770 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.618062 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:33.618875 29364 raft_consensus.cc:2243] T acbf3f88b4514948820691784cf9c189 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.619401 29364 raft_consensus.cc:2272] T acbf3f88b4514948820691784cf9c189 P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:33.617975  4455 consensus_peers.cc:597] T a4736bb71dfa4f4b8b80e8a52895acf7 P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:33.622161 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:33.624959 29364 raft_consensus.cc:2243] T 49047cb7a56246288b9044f8ebec130f P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.625442 29364 raft_consensus.cc:2272] T 49047cb7a56246288b9044f8ebec130f P 06ec58698d5444caaecea433c8419770 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:33.627228  4603 consensus_peers.cc:597] T b731fe02a6f4441e816628760bfdfb54 P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:33.644017  4455 consensus_peers.cc:597] T 150545c47e0642229a92ede96db14fc9 P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:33.660735  4529 consensus_peers.cc:597] T d1119afee9d6413aa2cd229073ffbcf1 P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:33.670356  4603 consensus_peers.cc:597] T 604a93ed898f4ab9b771487bfe278b33 P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:33.674888  4529 consensus_peers.cc:597] T 584f5934b7fa4c7ab4b0b43923621e70 P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:33.684414  4529 consensus_peers.cc:597] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:33.698410  4529 consensus_peers.cc:597] T 3d38413c5dce44db8a755b48adacc3a8 P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:33.700418  4529 consensus_peers.cc:597] T d088694ef66442bdbf75cc7fc1942a83 P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:33.706290  4603 connection.cc:573] client connection to 127.28.173.1:36439 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:12:33.718962  4603 consensus_peers.cc:597] T acbf3f88b4514948820691784cf9c189 P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:33.727787  4455 consensus_peers.cc:597] T 49047cb7a56246288b9044f8ebec130f P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:33.741297  4455 consensus_peers.cc:597] T d8033bfb7f5d423d90d60318c67df709 P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:33.816936  4455 consensus_peers.cc:597] T 0dc4f903fb004dd2bce3c4934f078a5d P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:33.822367  4529 consensus_peers.cc:597] T 002595643d984c1c915975d4c4ace485 P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:34.371860  5618 raft_consensus.cc:493] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:34.372435  5618 raft_consensus.cc:515] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:34.374672  5618 leader_election.cc:290] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:34.375309  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fb0d1b4ae14754aa30516d12cdea3d" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
W20260709 13:12:34.379420  4603 leader_election.cc:336] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:34.379753  4603 leader_election.cc:304] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc; no voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424
I20260709 13:12:34.380362  5618 raft_consensus.cc:2749] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:34.419574  5576 raft_consensus.cc:493] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:34.420212  5576 raft_consensus.cc:515] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:34.422315  5576 leader_election.cc:290] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:34.423795  4636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7757f22fe3408f8745bc899f3c2e4e" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
W20260709 13:12:34.430374  4529 leader_election.cc:336] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:34.430716  4529 leader_election.cc:304] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424; no voters: 06ec58698d5444caaecea433c8419770, 74758684df5649ccadd1e189eaff32dc
I20260709 13:12:34.431457  5605 raft_consensus.cc:2749] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:34.433192  5605 raft_consensus.cc:493] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:34.433696  5605 raft_consensus.cc:515] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:34.435879  5605 leader_election.cc:290] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:34.437065  4482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7682a3f7f134c34a24488586461f6a4" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
W20260709 13:12:34.438841  4529 leader_election.cc:336] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:34.439289  4529 leader_election.cc:304] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424; no voters: 06ec58698d5444caaecea433c8419770, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:34.440012  5576 raft_consensus.cc:2749] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:34.486778  5576 raft_consensus.cc:493] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:34.487448  5576 raft_consensus.cc:515] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:34.490309  4636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fb0d1b4ae14754aa30516d12cdea3d" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:34.490999  4636 raft_consensus.cc:2468] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 3.
I20260709 13:12:34.489585  5576 leader_election.cc:290] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:34.492898  4529 leader_election.cc:304] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc; no voters: 
I20260709 13:12:34.493539  5576 raft_consensus.cc:2804] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:12:34.493764  4529 leader_election.cc:336] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:34.493896  5576 raft_consensus.cc:493] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:34.494324  5576 raft_consensus.cc:3060] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:34.499706  5576 raft_consensus.cc:515] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:34.501551  5576 leader_election.cc:290] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 4 election: Requested vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:34.502054  4636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fb0d1b4ae14754aa30516d12cdea3d" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:34.502604  4636 raft_consensus.cc:3060] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:34.507299  4529 leader_election.cc:336] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:34.510907  4636 raft_consensus.cc:2468] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 4.
I20260709 13:12:34.513682  4529 leader_election.cc:304] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc; no voters: 06ec58698d5444caaecea433c8419770
I20260709 13:12:34.514463  5576 raft_consensus.cc:2804] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:34.514997  5576 raft_consensus.cc:697] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 [term 4 LEADER]: Becoming Leader. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Running, Role: LEADER
I20260709 13:12:34.515955  5576 consensus_queue.cc:237] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:34.526211  4311 catalog_manager.cc:5697] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 reported cstate change: term changed from 3 to 4, leader changed from 06ec58698d5444caaecea433c8419770 (127.28.173.1) to 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3). New cstate: current_term: 4 leader_uuid: "420a61707e804ce5b3773a91cc2eb424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:34.572180  5577 raft_consensus.cc:493] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:34.572762  5577 raft_consensus.cc:515] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:34.575356  5577 leader_election.cc:290] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:34.577055  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20be30df26724e7f98f3b36f24e4df3a" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
W20260709 13:12:34.580461  4455 leader_election.cc:336] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:34.580914  4455 leader_election.cc:304] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa0ff974118b465eaa785b8a86057e87; no voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424
I20260709 13:12:34.581710  5577 raft_consensus.cc:2749] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:34.588990  5576 raft_consensus.cc:493] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:34.589488  5576 raft_consensus.cc:515] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:34.591321  5576 leader_election.cc:290] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:34.594877  4482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca87a1b3c8043529d7a9d61b0adfdbf" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
W20260709 13:12:34.596464  4529 leader_election.cc:336] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:34.597419  4529 leader_election.cc:304] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424; no voters: 06ec58698d5444caaecea433c8419770, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:34.598343  5576 raft_consensus.cc:2749] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:34.602156  5577 raft_consensus.cc:493] T 1c7e5d871d1c44a58c65d3f76bce55b0 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:34.602689  5577 raft_consensus.cc:515] T 1c7e5d871d1c44a58c65d3f76bce55b0 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:34.604647  5577 leader_election.cc:290] T 1c7e5d871d1c44a58c65d3f76bce55b0 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:34.605578  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7e5d871d1c44a58c65d3f76bce55b0" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
W20260709 13:12:34.608078  4455 leader_election.cc:336] T 1c7e5d871d1c44a58c65d3f76bce55b0 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:34.608485  4455 leader_election.cc:304] T 1c7e5d871d1c44a58c65d3f76bce55b0 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa0ff974118b465eaa785b8a86057e87; no voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424
I20260709 13:12:34.609030  5577 raft_consensus.cc:2749] T 1c7e5d871d1c44a58c65d3f76bce55b0 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:34.610540  5605 raft_consensus.cc:493] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:34.611078  5605 raft_consensus.cc:515] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:34.613016  5605 leader_election.cc:290] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:34.614811  4482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7e5d871d1c44a58c65d3f76bce55b0" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:34.615334  4482 raft_consensus.cc:2468] T 1c7e5d871d1c44a58c65d3f76bce55b0 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 2.
I20260709 13:12:34.617862  4529 leader_election.cc:304] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:34.618448  5605 raft_consensus.cc:2804] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:12:34.618584  4529 leader_election.cc:336] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:34.618830  5605 raft_consensus.cc:493] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:34.619225  5605 raft_consensus.cc:3060] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:34.627128  5605 raft_consensus.cc:515] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:34.631983  5605 leader_election.cc:290] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 3 election: Requested vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:34.634420  4482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c7e5d871d1c44a58c65d3f76bce55b0" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:34.634927  4482 raft_consensus.cc:3060] T 1c7e5d871d1c44a58c65d3f76bce55b0 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:34.636864  5622 raft_consensus.cc:493] T a16334f2dff74513ba7ca22ca8fb5afd P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:34.637456  5622 raft_consensus.cc:515] T a16334f2dff74513ba7ca22ca8fb5afd P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:34.640463  4636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a16334f2dff74513ba7ca22ca8fb5afd" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:34.640676  4482 raft_consensus.cc:2468] T 1c7e5d871d1c44a58c65d3f76bce55b0 P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 3.
I20260709 13:12:34.644686  5622 leader_election.cc:290] T a16334f2dff74513ba7ca22ca8fb5afd P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
W20260709 13:12:34.646183  4529 leader_election.cc:336] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:34.655381  4529 leader_election.cc:304] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 06ec58698d5444caaecea433c8419770
I20260709 13:12:34.656204  5576 raft_consensus.cc:2804] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:34.656728  5576 raft_consensus.cc:697] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [term 3 LEADER]: Becoming Leader. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Running, Role: LEADER
W20260709 13:12:34.656812  4455 leader_election.cc:336] T a16334f2dff74513ba7ca22ca8fb5afd P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:34.657435  4455 leader_election.cc:304] T a16334f2dff74513ba7ca22ca8fb5afd P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa0ff974118b465eaa785b8a86057e87; no voters: 06ec58698d5444caaecea433c8419770, 74758684df5649ccadd1e189eaff32dc
I20260709 13:12:34.658145  5577 raft_consensus.cc:2749] T a16334f2dff74513ba7ca22ca8fb5afd P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:34.657661  5576 consensus_queue.cc:237] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:34.666410  5618 raft_consensus.cc:493] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:34.666875  5618 raft_consensus.cc:515] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:34.668861  5618 leader_election.cc:290] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:34.674993  4489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a16334f2dff74513ba7ca22ca8fb5afd" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:34.675684  4489 raft_consensus.cc:2468] T a16334f2dff74513ba7ca22ca8fb5afd P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 3.
I20260709 13:12:34.676811  4603 leader_election.cc:304] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:34.677618  5618 raft_consensus.cc:2804] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:12:34.677767  4603 leader_election.cc:336] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:34.678038  5618 raft_consensus.cc:493] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:34.678426  5618 raft_consensus.cc:3060] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:34.686484  5618 raft_consensus.cc:515] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:34.689350  5582 raft_consensus.cc:493] T ff7757f22fe3408f8745bc899f3c2e4e P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:34.689908  5582 raft_consensus.cc:515] T ff7757f22fe3408f8745bc899f3c2e4e P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:34.694693  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7757f22fe3408f8745bc899f3c2e4e" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:34.695358  4563 raft_consensus.cc:2468] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 2.
I20260709 13:12:34.697609  5582 leader_election.cc:290] T ff7757f22fe3408f8745bc899f3c2e4e P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:34.699297  4602 leader_election.cc:304] T ff7757f22fe3408f8745bc899f3c2e4e P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc; no voters: 
I20260709 13:12:34.700133  5568 raft_consensus.cc:2804] T ff7757f22fe3408f8745bc899f3c2e4e P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:34.700276  5618 leader_election.cc:290] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 4 election: Requested vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:34.700572  5568 raft_consensus.cc:493] T ff7757f22fe3408f8745bc899f3c2e4e P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:34.701007  5568 raft_consensus.cc:3060] T ff7757f22fe3408f8745bc899f3c2e4e P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:34.709466  5568 raft_consensus.cc:515] T ff7757f22fe3408f8745bc899f3c2e4e P 74758684df5649ccadd1e189eaff32dc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
W20260709 13:12:34.710557 29364 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 5382)
I20260709 13:12:34.711254  4489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a16334f2dff74513ba7ca22ca8fb5afd" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:34.717518  4489 raft_consensus.cc:3060] T a16334f2dff74513ba7ca22ca8fb5afd P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:34.715756  4311 catalog_manager.cc:5697] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 reported cstate change: term changed from 2 to 3, leader changed from 06ec58698d5444caaecea433c8419770 (127.28.173.1) to 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3). New cstate: current_term: 3 leader_uuid: "420a61707e804ce5b3773a91cc2eb424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:34.728931  4603 leader_election.cc:336] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:34.732676  4489 raft_consensus.cc:2468] T a16334f2dff74513ba7ca22ca8fb5afd P aa0ff974118b465eaa785b8a86057e87 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 4.
I20260709 13:12:34.734648  4603 leader_election.cc:304] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87; no voters: 06ec58698d5444caaecea433c8419770
I20260709 13:12:34.736523  5582 raft_consensus.cc:2804] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:34.737027  5582 raft_consensus.cc:697] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [term 4 LEADER]: Becoming Leader. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Running, Role: LEADER
I20260709 13:12:34.737941  5582 consensus_queue.cc:237] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
W20260709 13:12:34.742738  4603 leader_election.cc:336] T ff7757f22fe3408f8745bc899f3c2e4e P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:34.749114  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7757f22fe3408f8745bc899f3c2e4e" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:34.749672  4563 raft_consensus.cc:3060] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:34.756611  4563 raft_consensus.cc:2468] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 3.
I20260709 13:12:34.757526  4602 leader_election.cc:304] T ff7757f22fe3408f8745bc899f3c2e4e P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc; no voters: 
I20260709 13:12:34.749662  5568 leader_election.cc:290] T ff7757f22fe3408f8745bc899f3c2e4e P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 3 election: Requested vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:34.758437  5582 raft_consensus.cc:2804] T ff7757f22fe3408f8745bc899f3c2e4e P 74758684df5649ccadd1e189eaff32dc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:34.759204  5582 raft_consensus.cc:697] T ff7757f22fe3408f8745bc899f3c2e4e P 74758684df5649ccadd1e189eaff32dc [term 3 LEADER]: Becoming Leader. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Running, Role: LEADER
I20260709 13:12:34.760517  5582 consensus_queue.cc:237] T ff7757f22fe3408f8745bc899f3c2e4e P 74758684df5649ccadd1e189eaff32dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
W20260709 13:12:34.762301  4603 leader_election.cc:336] T ff7757f22fe3408f8745bc899f3c2e4e P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:34.763275  4311 catalog_manager.cc:5697] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc reported cstate change: term changed from 3 to 4, leader changed from 06ec58698d5444caaecea433c8419770 (127.28.173.1) to 74758684df5649ccadd1e189eaff32dc (127.28.173.4). New cstate: current_term: 4 leader_uuid: "74758684df5649ccadd1e189eaff32dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:34.776297  5577 raft_consensus.cc:493] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:34.776778  5577 raft_consensus.cc:515] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:34.778620  5577 leader_election.cc:290] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:34.779628  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca87a1b3c8043529d7a9d61b0adfdbf" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:34.780334  4563 raft_consensus.cc:2468] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 3.
I20260709 13:12:34.780740  5576 raft_consensus.cc:493] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:34.781371  5576 raft_consensus.cc:515] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:34.781630  4454 leader_election.cc:304] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:34.783588  5576 leader_election.cc:290] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:34.786458  4489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e466269360c4a538e16c342590490c0" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:34.787766  5577 raft_consensus.cc:2804] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:34.788239  5577 raft_consensus.cc:493] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:34.788589  5577 raft_consensus.cc:3060] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:34.790922  4455 leader_election.cc:336] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
W20260709 13:12:34.794085  4529 leader_election.cc:336] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:34.795011  4529 leader_election.cc:304] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424; no voters: 06ec58698d5444caaecea433c8419770, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:34.795897  5623 raft_consensus.cc:2749] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:34.794562  5576 raft_consensus.cc:493] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:34.795990  5577 raft_consensus.cc:515] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:34.796571  5576 raft_consensus.cc:515] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:34.797948  5622 raft_consensus.cc:493] T f7682a3f7f134c34a24488586461f6a4 P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:34.798516  5622 raft_consensus.cc:515] T f7682a3f7f134c34a24488586461f6a4 P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:34.800966  5622 leader_election.cc:290] T f7682a3f7f134c34a24488586461f6a4 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:34.802228  4311 catalog_manager.cc:5697] T ff7757f22fe3408f8745bc899f3c2e4e P 74758684df5649ccadd1e189eaff32dc reported cstate change: term changed from 2 to 3, leader changed from 06ec58698d5444caaecea433c8419770 (127.28.173.1) to 74758684df5649ccadd1e189eaff32dc (127.28.173.4). New cstate: current_term: 3 leader_uuid: "74758684df5649ccadd1e189eaff32dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:34.807958  5577 leader_election.cc:290] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 4 election: Requested vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:34.810803  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ca87a1b3c8043529d7a9d61b0adfdbf" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:34.811359  4563 raft_consensus.cc:3060] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:34.813419  5576 leader_election.cc:290] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:34.817391  4560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7682a3f7f134c34a24488586461f6a4" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:34.818035  4560 raft_consensus.cc:2468] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 3.
I20260709 13:12:34.819128  4454 leader_election.cc:304] T f7682a3f7f134c34a24488586461f6a4 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:34.819832  5622 raft_consensus.cc:2804] T f7682a3f7f134c34a24488586461f6a4 P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:34.820206  5622 raft_consensus.cc:493] T f7682a3f7f134c34a24488586461f6a4 P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:34.820640  5622 raft_consensus.cc:3060] T f7682a3f7f134c34a24488586461f6a4 P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:34.821648  4563 raft_consensus.cc:2468] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 420a61707e804ce5b3773a91cc2eb424 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 4.
W20260709 13:12:34.822309  4455 leader_election.cc:336] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
W20260709 13:12:34.826839  4455 leader_election.cc:336] T f7682a3f7f134c34a24488586461f6a4 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:34.827889  5622 raft_consensus.cc:515] T f7682a3f7f134c34a24488586461f6a4 P aa0ff974118b465eaa785b8a86057e87 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:34.829993  5622 leader_election.cc:290] T f7682a3f7f134c34a24488586461f6a4 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 4 election: Requested vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
W20260709 13:12:34.831578  4529 leader_election.cc:336] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:34.832978  5576 raft_consensus.cc:493] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:34.833673  4454 leader_election.cc:304] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 06ec58698d5444caaecea433c8419770
I20260709 13:12:34.833498  5576 raft_consensus.cc:515] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:34.835603  4489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20be30df26724e7f98f3b36f24e4df3a" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:34.835791  5576 leader_election.cc:290] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:34.836272  4489 raft_consensus.cc:2468] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 3.
I20260709 13:12:34.840565  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7682a3f7f134c34a24488586461f6a4" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:34.841166  4563 raft_consensus.cc:3060] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:34.842626  4529 leader_election.cc:304] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 06ec58698d5444caaecea433c8419770
I20260709 13:12:34.843889  5623 raft_consensus.cc:2804] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:34.844328  5623 raft_consensus.cc:493] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:34.844753  5623 raft_consensus.cc:3060] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:34.845340  5632 raft_consensus.cc:2804] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:12:34.846546  4455 leader_election.cc:336] T f7682a3f7f134c34a24488586461f6a4 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:34.854022  4563 raft_consensus.cc:2468] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 4.
W20260709 13:12:34.855048  4529 leader_election.cc:336] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:34.855937  5577 raft_consensus.cc:493] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:34.857489  5577 raft_consensus.cc:515] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:34.858511  4489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0608a8abe6c4bd083d751020218957e" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:34.859298  5632 raft_consensus.cc:697] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [term 4 LEADER]: Becoming Leader. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Running, Role: LEADER
I20260709 13:12:34.859439  5577 leader_election.cc:290] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:34.859488  5622 raft_consensus.cc:493] T 60d704077649426ab65d89dd9ff778d0 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:34.859877  4454 leader_election.cc:304] T f7682a3f7f134c34a24488586461f6a4 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 06ec58698d5444caaecea433c8419770
I20260709 13:12:34.860347  5622 raft_consensus.cc:515] T 60d704077649426ab65d89dd9ff778d0 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:34.860999  5577 raft_consensus.cc:2804] T f7682a3f7f134c34a24488586461f6a4 P aa0ff974118b465eaa785b8a86057e87 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:34.861423  5577 raft_consensus.cc:697] T f7682a3f7f134c34a24488586461f6a4 P aa0ff974118b465eaa785b8a86057e87 [term 4 LEADER]: Becoming Leader. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Running, Role: LEADER
I20260709 13:12:34.861909  5623 raft_consensus.cc:515] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:34.862416  5622 leader_election.cc:290] T 60d704077649426ab65d89dd9ff778d0 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:34.863261  5622 raft_consensus.cc:493] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:34.862244  5577 consensus_queue.cc:237] T f7682a3f7f134c34a24488586461f6a4 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:34.863443  4560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d704077649426ab65d89dd9ff778d0" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:34.863822  5622 raft_consensus.cc:515] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:34.867214  5623 leader_election.cc:290] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 4 election: Requested vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:34.867792  5622 leader_election.cc:290] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:34.868805  4560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e466269360c4a538e16c342590490c0" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:34.869491  4560 raft_consensus.cc:2468] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 3.
I20260709 13:12:34.869071  5632 consensus_queue.cc:237] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:34.870621  4454 leader_election.cc:304] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:34.863965  5634 raft_consensus.cc:493] T aa241e695dbb492a971f537d1f977f21 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:34.871321  5634 raft_consensus.cc:515] T aa241e695dbb492a971f537d1f977f21 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:34.872018  5635 raft_consensus.cc:2804] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:34.875973  5635 raft_consensus.cc:493] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:34.874977  5582 raft_consensus.cc:493] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:34.877053  5635 raft_consensus.cc:3060] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:34.877254  5582 raft_consensus.cc:515] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:34.880513  5582 leader_election.cc:290] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
W20260709 13:12:34.884178  4603 leader_election.cc:336] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:34.885727  5635 raft_consensus.cc:515] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:34.887941  5635 leader_election.cc:290] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 4 election: Requested vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:34.891247  4636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a508f846d314fa0b7ec364af09bc427" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:34.874469  5634 leader_election.cc:290] T aa241e695dbb492a971f537d1f977f21 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:34.891954  4636 raft_consensus.cc:2468] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 3.
W20260709 13:12:34.876518  4529 leader_election.cc:336] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:34.894371  4489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20be30df26724e7f98f3b36f24e4df3a" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:34.894891  4489 raft_consensus.cc:3060] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:34.896329  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e466269360c4a538e16c342590490c0" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:34.896858  4563 raft_consensus.cc:3060] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:34.894835  4529 leader_election.cc:304] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424; no voters: 06ec58698d5444caaecea433c8419770, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:34.900169  4634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa241e695dbb492a971f537d1f977f21" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:34.900978  5576 raft_consensus.cc:2749] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:34.903039  4455 leader_election.cc:304] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:34.904883  4489 raft_consensus.cc:2468] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 4.
I20260709 13:12:34.905431  5622 raft_consensus.cc:2804] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:34.905827  5622 raft_consensus.cc:493] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:34.906154  5622 raft_consensus.cc:3060] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:34.906724  4563 raft_consensus.cc:2468] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 4.
I20260709 13:12:34.908375  4489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a508f846d314fa0b7ec364af09bc427" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:34.909873  5605 raft_consensus.cc:493] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:34.910429  5605 raft_consensus.cc:515] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:34.912586  5605 leader_election.cc:290] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
W20260709 13:12:34.914736  4455 leader_election.cc:336] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
W20260709 13:12:34.915441  4455 leader_election.cc:336] T 60d704077649426ab65d89dd9ff778d0 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:34.915827  4455 leader_election.cc:304] T 60d704077649426ab65d89dd9ff778d0 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa0ff974118b465eaa785b8a86057e87; no voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424
I20260709 13:12:34.918519  5622 raft_consensus.cc:515] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
W20260709 13:12:34.918934  4529 leader_election.cc:336] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:34.919711  4489 raft_consensus.cc:2393] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74758684df5649ccadd1e189eaff32dc in current term 4: Already voted for candidate aa0ff974118b465eaa785b8a86057e87 in this term.
I20260709 13:12:34.921713  5577 raft_consensus.cc:2749] T 60d704077649426ab65d89dd9ff778d0 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:34.925236  5622 leader_election.cc:290] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 4 election: Requested vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:34.925814  5632 raft_consensus.cc:493] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:34.926318  5632 raft_consensus.cc:515] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
W20260709 13:12:34.926666  4455 leader_election.cc:336] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
W20260709 13:12:34.927377  4455 leader_election.cc:336] T aa241e695dbb492a971f537d1f977f21 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:34.927740  4455 leader_election.cc:304] T aa241e695dbb492a971f537d1f977f21 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa0ff974118b465eaa785b8a86057e87; no voters: 06ec58698d5444caaecea433c8419770, 74758684df5649ccadd1e189eaff32dc
I20260709 13:12:34.928478  5577 raft_consensus.cc:2749] T aa241e695dbb492a971f537d1f977f21 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:12:34.928571  4455 leader_election.cc:336] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:34.929153  5632 leader_election.cc:290] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:34.932608  4634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a508f846d314fa0b7ec364af09bc427" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:34.933223  4634 raft_consensus.cc:3060] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:34.933535  4489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d704077649426ab65d89dd9ff778d0" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:34.934114  4489 raft_consensus.cc:2468] T 60d704077649426ab65d89dd9ff778d0 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 2.
I20260709 13:12:34.934230  4311 catalog_manager.cc:5697] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 reported cstate change: term changed from 3 to 4, leader changed from 06ec58698d5444caaecea433c8419770 (127.28.173.1) to aa0ff974118b465eaa785b8a86057e87 (127.28.173.2). New cstate: current_term: 4 leader_uuid: "aa0ff974118b465eaa785b8a86057e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:34.936144  5568 raft_consensus.cc:493] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:34.936687  5568 raft_consensus.cc:515] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:34.938788  5568 leader_election.cc:290] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
W20260709 13:12:34.941984  4455 leader_election.cc:336] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
W20260709 13:12:34.942508  4455 leader_election.cc:336] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:34.942674  4454 leader_election.cc:304] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 06ec58698d5444caaecea433c8419770
W20260709 13:12:34.943122  4603 leader_election.cc:336] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:34.943672  5633 raft_consensus.cc:2804] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:34.944175  5633 raft_consensus.cc:697] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87 [term 4 LEADER]: Becoming Leader. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Running, Role: LEADER
I20260709 13:12:34.944365  4603 leader_election.cc:304] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc; no voters: 06ec58698d5444caaecea433c8419770, aa0ff974118b465eaa785b8a86057e87
I20260709 13:12:34.945009  5633 consensus_queue.cc:237] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:34.945797  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0608a8abe6c4bd083d751020218957e" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:34.946390  4563 raft_consensus.cc:2468] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 3.
I20260709 13:12:34.947252  5568 raft_consensus.cc:493] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:34.947853  5568 raft_consensus.cc:515] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:34.949005  4634 raft_consensus.cc:2468] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 4.
I20260709 13:12:34.949661  5582 raft_consensus.cc:2749] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:34.950093  5568 leader_election.cc:290] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:34.951710  4529 leader_election.cc:304] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 06ec58698d5444caaecea433c8419770
I20260709 13:12:34.952540  5623 raft_consensus.cc:2804] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:34.952811  4529 leader_election.cc:304] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 06ec58698d5444caaecea433c8419770
I20260709 13:12:34.953183  5623 raft_consensus.cc:697] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424 [term 4 LEADER]: Becoming Leader. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Running, Role: LEADER
I20260709 13:12:34.954706  4455 leader_election.cc:304] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87; no voters: 06ec58698d5444caaecea433c8419770
I20260709 13:12:34.955943  5622 raft_consensus.cc:2804] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:34.956526  5622 raft_consensus.cc:697] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [term 4 LEADER]: Becoming Leader. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Running, Role: LEADER
I20260709 13:12:34.957505  5622 consensus_queue.cc:237] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:34.961617  4489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa241e695dbb492a971f537d1f977f21" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:34.962242  4489 raft_consensus.cc:2468] T aa241e695dbb492a971f537d1f977f21 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 2.
W20260709 13:12:34.962563  4603 leader_election.cc:336] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:34.955667  5576 raft_consensus.cc:2804] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:34.963842  4454 leader_election.cc:304] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 06ec58698d5444caaecea433c8419770
I20260709 13:12:34.964176  5576 raft_consensus.cc:493] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:34.972594  5576 raft_consensus.cc:3060] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:34.967939  5623 consensus_queue.cc:237] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:34.968423  5632 raft_consensus.cc:2804] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:34.976143  5632 raft_consensus.cc:493] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:34.976724  5632 raft_consensus.cc:3060] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:34.975186  4603 leader_election.cc:304] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87; no voters: 06ec58698d5444caaecea433c8419770
W20260709 13:12:34.984851  4529 consensus_peers.cc:597] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:34.986644  5639 raft_consensus.cc:493] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:34.991537  5639 raft_consensus.cc:515] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:34.993876  5639 leader_election.cc:290] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:34.985266  5582 raft_consensus.cc:2804] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:34.997802  5582 raft_consensus.cc:493] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:34.998219  5582 raft_consensus.cc:3060] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:35.001286  5576 raft_consensus.cc:515] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:35.003383  5576 leader_election.cc:290] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 3 election: Requested vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:35.009169  4311 catalog_manager.cc:5697] T f7682a3f7f134c34a24488586461f6a4 P aa0ff974118b465eaa785b8a86057e87 reported cstate change: term changed from 3 to 4, leader changed from 06ec58698d5444caaecea433c8419770 (127.28.173.1) to aa0ff974118b465eaa785b8a86057e87 (127.28.173.2). New cstate: current_term: 4 leader_uuid: "aa0ff974118b465eaa785b8a86057e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:35.010978  4311 catalog_manager.cc:5697] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87 reported cstate change: term changed from 3 to 4, leader changed from 06ec58698d5444caaecea433c8419770 (127.28.173.1) to aa0ff974118b465eaa785b8a86057e87 (127.28.173.2). New cstate: current_term: 4 leader_uuid: "aa0ff974118b465eaa785b8a86057e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:35.017361  5582 raft_consensus.cc:515] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
I20260709 13:12:35.020903  5582 leader_election.cc:290] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 3 election: Requested vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:35.020920  4489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa241e695dbb492a971f537d1f977f21" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:35.022089  4489 raft_consensus.cc:3060] T aa241e695dbb492a971f537d1f977f21 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:12:35.024641  4603 leader_election.cc:336] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:35.025533  5632 raft_consensus.cc:515] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:35.027516  5632 leader_election.cc:290] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 4 election: Requested vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:35.028765  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0608a8abe6c4bd083d751020218957e" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:35.028870  4489 raft_consensus.cc:2468] T aa241e695dbb492a971f537d1f977f21 P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 3.
I20260709 13:12:35.029368  4563 raft_consensus.cc:3060] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:35.030064  4603 leader_election.cc:304] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc, aa0ff974118b465eaa785b8a86057e87; no voters: 06ec58698d5444caaecea433c8419770
I20260709 13:12:35.030867  5618 raft_consensus.cc:2804] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:35.031349  5618 raft_consensus.cc:697] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc [term 3 LEADER]: Becoming Leader. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Running, Role: LEADER
I20260709 13:12:35.032289  5618 consensus_queue.cc:237] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } }
W20260709 13:12:35.033993  4455 leader_election.cc:336] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:35.036257  5632 raft_consensus.cc:493] T cb23991ab8504ee491f905a4346edee9 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:35.036994  4563 raft_consensus.cc:2468] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 4.
I20260709 13:12:35.038250  4454 leader_election.cc:304] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 06ec58698d5444caaecea433c8419770
I20260709 13:12:35.039213  5633 raft_consensus.cc:2804] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:35.039672  5633 raft_consensus.cc:697] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [term 4 LEADER]: Becoming Leader. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Running, Role: LEADER
I20260709 13:12:35.039765  4560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3501a75721d543d598af7857e368e08b" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:35.040539  4560 raft_consensus.cc:2468] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 2.
I20260709 13:12:35.040599  5633 consensus_queue.cc:237] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:35.041340  4311 catalog_manager.cc:5697] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 reported cstate change: term changed from 3 to 4, leader changed from 06ec58698d5444caaecea433c8419770 (127.28.173.1) to aa0ff974118b465eaa785b8a86057e87 (127.28.173.2). New cstate: current_term: 4 leader_uuid: "aa0ff974118b465eaa785b8a86057e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:35.043377  4634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3501a75721d543d598af7857e368e08b" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc" is_pre_election: true
I20260709 13:12:35.043951  4634 raft_consensus.cc:2468] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 2.
I20260709 13:12:35.044409  4489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60d704077649426ab65d89dd9ff778d0" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87"
I20260709 13:12:35.044920  4489 raft_consensus.cc:3060] T 60d704077649426ab65d89dd9ff778d0 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:35.047262  4310 catalog_manager.cc:5697] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424 reported cstate change: term changed from 3 to 4, leader changed from 06ec58698d5444caaecea433c8419770 (127.28.173.1) to 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3). New cstate: current_term: 4 leader_uuid: "420a61707e804ce5b3773a91cc2eb424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:35.048673  4602 leader_election.cc:304] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc; no voters: 06ec58698d5444caaecea433c8419770
I20260709 13:12:35.049580  5568 raft_consensus.cc:2804] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:35.049927  5568 raft_consensus.cc:493] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:35.049980  5642 raft_consensus.cc:493] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:35.050360  5568 raft_consensus.cc:3060] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:35.050626  5642 raft_consensus.cc:515] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:35.036842  5632 raft_consensus.cc:515] T cb23991ab8504ee491f905a4346edee9 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:35.052788  4489 raft_consensus.cc:2468] T 60d704077649426ab65d89dd9ff778d0 P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 3.
I20260709 13:12:35.054237  5642 leader_election.cc:290] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987)
I20260709 13:12:35.055331  5632 leader_election.cc:290] T cb23991ab8504ee491f905a4346edee9 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:35.057086  4556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb23991ab8504ee491f905a4346edee9" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:35.057685  4556 raft_consensus.cc:2468] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 2.
I20260709 13:12:35.060141  4454 leader_election.cc:304] T cb23991ab8504ee491f905a4346edee9 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 
W20260709 13:12:35.061604  4455 leader_election.cc:336] T cb23991ab8504ee491f905a4346edee9 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:35.063803  4489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb23991ab8504ee491f905a4346edee9" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aa0ff974118b465eaa785b8a86057e87" is_pre_election: true
I20260709 13:12:35.064105  4529 leader_election.cc:304] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:35.064381  4489 raft_consensus.cc:2468] T cb23991ab8504ee491f905a4346edee9 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420a61707e804ce5b3773a91cc2eb424 in term 2.
I20260709 13:12:35.064991  4529 leader_election.cc:304] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc; no voters: 
I20260709 13:12:35.065655  5623 raft_consensus.cc:2804] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:35.065939  5576 raft_consensus.cc:2804] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:35.066114  5623 raft_consensus.cc:697] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [term 3 LEADER]: Becoming Leader. State: Replica: 420a61707e804ce5b3773a91cc2eb424, State: Running, Role: LEADER
I20260709 13:12:35.066336  5576 raft_consensus.cc:493] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:35.066694  5576 raft_consensus.cc:3060] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:35.067065  5623 consensus_queue.cc:237] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:35.077527  5622 raft_consensus.cc:2804] T cb23991ab8504ee491f905a4346edee9 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:35.078022  5622 raft_consensus.cc:493] T cb23991ab8504ee491f905a4346edee9 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 06ec58698d5444caaecea433c8419770)
I20260709 13:12:35.078460  5622 raft_consensus.cc:3060] T cb23991ab8504ee491f905a4346edee9 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:12:35.080654  4529 leader_election.cc:336] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
W20260709 13:12:35.081453  4529 leader_election.cc:336] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:35.094187  4529 leader_election.cc:304] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 
I20260709 13:12:35.095072  5576 raft_consensus.cc:515] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:35.101111  5576 leader_election.cc:290] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 3 election: Requested vote from peers 74758684df5649ccadd1e189eaff32dc (127.28.173.4:42711), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:35.090365  5622 raft_consensus.cc:515] T cb23991ab8504ee491f905a4346edee9 P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:35.103804  4563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb23991ab8504ee491f905a4346edee9" candidate_uuid: "aa0ff974118b465eaa785b8a86057e87" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:35.104400  4563 raft_consensus.cc:3060] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:35.086213  5568 raft_consensus.cc:515] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
W20260709 13:12:35.108707  4455 leader_election.cc:336] T cb23991ab8504ee491f905a4346edee9 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:35.109339  5568 leader_election.cc:290] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 3 election: Requested vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
W20260709 13:12:35.113211  4529 leader_election.cc:336] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:35.116088  5622 leader_election.cc:290] T cb23991ab8504ee491f905a4346edee9 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 3 election: Requested vote from peers 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439), 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159)
I20260709 13:12:35.117128  4311 catalog_manager.cc:5697] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc reported cstate change: term changed from 2 to 3, leader changed from 06ec58698d5444caaecea433c8419770 (127.28.173.1) to 74758684df5649ccadd1e189eaff32dc (127.28.173.4). New cstate: current_term: 3 leader_uuid: "74758684df5649ccadd1e189eaff32dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:35.122225  4529 consensus_peers.cc:597] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:35.126274  4563 raft_consensus.cc:2468] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa0ff974118b465eaa785b8a86057e87 in term 3.
I20260709 13:12:35.127363  4454 leader_election.cc:304] T cb23991ab8504ee491f905a4346edee9 P aa0ff974118b465eaa785b8a86057e87 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, aa0ff974118b465eaa785b8a86057e87; no voters: 06ec58698d5444caaecea433c8419770
I20260709 13:12:35.127719  5642 raft_consensus.cc:2764] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:12:35.128540  5622 raft_consensus.cc:2804] T cb23991ab8504ee491f905a4346edee9 P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:35.129222  5622 raft_consensus.cc:697] T cb23991ab8504ee491f905a4346edee9 P aa0ff974118b465eaa785b8a86057e87 [term 3 LEADER]: Becoming Leader. State: Replica: aa0ff974118b465eaa785b8a86057e87, State: Running, Role: LEADER
I20260709 13:12:35.130959  5622 consensus_queue.cc:237] T cb23991ab8504ee491f905a4346edee9 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } }
I20260709 13:12:35.133961  4560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3501a75721d543d598af7857e368e08b" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:35.134864  4560 raft_consensus.cc:2393] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 74758684df5649ccadd1e189eaff32dc in current term 3: Already voted for candidate 420a61707e804ce5b3773a91cc2eb424 in this term.
I20260709 13:12:35.138372  4636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3501a75721d543d598af7857e368e08b" candidate_uuid: "420a61707e804ce5b3773a91cc2eb424" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74758684df5649ccadd1e189eaff32dc"
I20260709 13:12:35.139088  4636 raft_consensus.cc:2393] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 420a61707e804ce5b3773a91cc2eb424 in current term 3: Already voted for candidate 74758684df5649ccadd1e189eaff32dc in this term.
I20260709 13:12:35.142562  4630 raft_consensus.cc:1275] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [term 4 FOLLOWER]: Refusing update from remote peer 420a61707e804ce5b3773a91cc2eb424: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:12:35.146626  4529 leader_election.cc:336] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:35.130913  4310 catalog_manager.cc:5697] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 reported cstate change: term changed from 2 to 3, leader changed from 06ec58698d5444caaecea433c8419770 (127.28.173.1) to 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3). New cstate: current_term: 3 leader_uuid: "420a61707e804ce5b3773a91cc2eb424" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:35.147562  4529 leader_election.cc:304] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424; no voters: 06ec58698d5444caaecea433c8419770, 74758684df5649ccadd1e189eaff32dc
I20260709 13:12:35.148375  5576 raft_consensus.cc:2749] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:12:35.149816  5576 consensus_queue.cc:1048] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:12:35.163604  4603 leader_election.cc:336] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:35.164580  4603 leader_election.cc:304] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74758684df5649ccadd1e189eaff32dc; no voters: 06ec58698d5444caaecea433c8419770, 420a61707e804ce5b3773a91cc2eb424
I20260709 13:12:35.167981  4482 raft_consensus.cc:1275] T 1c7e5d871d1c44a58c65d3f76bce55b0 P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Refusing update from remote peer 420a61707e804ce5b3773a91cc2eb424: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:35.169446  5623 consensus_queue.cc:1048] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:35.169871  5568 raft_consensus.cc:2749] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:12:35.173705  4311 catalog_manager.cc:5697] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 reported cstate change: term changed from 3 to 4, leader changed from 06ec58698d5444caaecea433c8419770 (127.28.173.1) to aa0ff974118b465eaa785b8a86057e87 (127.28.173.2). New cstate: current_term: 4 leader_uuid: "aa0ff974118b465eaa785b8a86057e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:35.180969  4489 raft_consensus.cc:1275] T a16334f2dff74513ba7ca22ca8fb5afd P aa0ff974118b465eaa785b8a86057e87 [term 4 FOLLOWER]: Refusing update from remote peer 74758684df5649ccadd1e189eaff32dc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:35.182943  5618 consensus_queue.cc:1048] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:35.197465  4560 raft_consensus.cc:1275] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Refusing update from remote peer 74758684df5649ccadd1e189eaff32dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:35.199317  5618 consensus_queue.cc:1048] T ff7757f22fe3408f8745bc899f3c2e4e P 74758684df5649ccadd1e189eaff32dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:12:35.249038  4603 consensus_peers.cc:597] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:35.247220  4311 catalog_manager.cc:5697] T cb23991ab8504ee491f905a4346edee9 P aa0ff974118b465eaa785b8a86057e87 reported cstate change: term changed from 2 to 3, leader changed from 06ec58698d5444caaecea433c8419770 (127.28.173.1) to aa0ff974118b465eaa785b8a86057e87 (127.28.173.2). New cstate: current_term: 3 leader_uuid: "aa0ff974118b465eaa785b8a86057e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:35.250875  4603 consensus_peers.cc:597] T ff7757f22fe3408f8745bc899f3c2e4e P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:35.341020  4560 raft_consensus.cc:1275] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 420a61707e804ce5b3773a91cc2eb424 [term 4 FOLLOWER]: Refusing update from remote peer aa0ff974118b465eaa785b8a86057e87: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:35.342411  5633 consensus_queue.cc:1048] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:12:35.360404  4455 consensus_peers.cc:597] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:35.368917  4529 consensus_peers.cc:597] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:35.422253  4603 consensus_peers.cc:597] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:35.424664  4455 consensus_peers.cc:597] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:35.432612  4482 raft_consensus.cc:1275] T aa241e695dbb492a971f537d1f977f21 P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Refusing update from remote peer 74758684df5649ccadd1e189eaff32dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:35.433811  5618 consensus_queue.cc:1048] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:35.456734  4636 raft_consensus.cc:1275] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc [term 4 FOLLOWER]: Refusing update from remote peer aa0ff974118b465eaa785b8a86057e87: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:35.459414  5622 consensus_queue.cc:1048] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
W20260709 13:12:35.462824  4455 consensus_peers.cc:597] T f7682a3f7f134c34a24488586461f6a4 P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:35.484057  4560 raft_consensus.cc:1275] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [term 4 FOLLOWER]: Refusing update from remote peer aa0ff974118b465eaa785b8a86057e87: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:35.485466  5633 consensus_queue.cc:1048] T f7682a3f7f134c34a24488586461f6a4 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:12:35.495398  4455 consensus_peers.cc:597] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:35.533174  4563 raft_consensus.cc:1275] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424 [term 4 FOLLOWER]: Refusing update from remote peer aa0ff974118b465eaa785b8a86057e87: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:35.535210  4563 raft_consensus.cc:1275] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [term 4 FOLLOWER]: Refusing update from remote peer aa0ff974118b465eaa785b8a86057e87: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:35.535596  5633 consensus_queue.cc:1048] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:35.539734  4556 raft_consensus.cc:1275] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Refusing update from remote peer aa0ff974118b465eaa785b8a86057e87: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:35.542995  5633 consensus_queue.cc:1048] T cb23991ab8504ee491f905a4346edee9 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:35.543330  5622 consensus_queue.cc:1048] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:12:35.560712  4455 consensus_peers.cc:597] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:35.581230  4482 raft_consensus.cc:1275] T 60d704077649426ab65d89dd9ff778d0 P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Refusing update from remote peer 420a61707e804ce5b3773a91cc2eb424: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:35.584408  5576 consensus_queue.cc:1048] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:35.593055  4482 raft_consensus.cc:1275] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [term 4 FOLLOWER]: Refusing update from remote peer 420a61707e804ce5b3773a91cc2eb424: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:12:35.602499  4529 consensus_peers.cc:597] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:35.613754  4455 consensus_peers.cc:597] T 47d66fc2153d419082eccd7e30643d56 P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:35.615382  5605 consensus_queue.cc:1048] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa0ff974118b465eaa785b8a86057e87" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:12:35.636708  4455 consensus_peers.cc:597] T cb23991ab8504ee491f905a4346edee9 P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:35.712144  4603 consensus_peers.cc:597] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:35.716315  4455 consensus_peers.cc:597] T 98342133e28b47d8a388f9321d5fd796 P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:35.717429 29364 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 5382)
W20260709 13:12:35.797434  4455 consensus_peers.cc:597] T 09294b866578436a827c27702d4b1d0b P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:35.868008  4455 consensus_peers.cc:597] T 9d526ab043434bf0bcab814f9bbc3234 P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:35.880734  4603 consensus_peers.cc:597] T d0147a5552154f26a88833f9210b1358 P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:35.940434  4455 consensus_peers.cc:597] T b6256e4aa07c45c78b2bbff56a852078 P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:35.973218  4603 consensus_peers.cc:597] T 81197f2dcf424fbaaab746d5f8bf7c8c P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:35.986825  4529 consensus_peers.cc:597] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:36.002725  4603 consensus_peers.cc:597] T 325a5a55a44a47ce97869216b084f89d P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:36.017309  4455 consensus_peers.cc:597] T 5b827ee48d56478398f009c3fa980016 P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:36.017881  4455 consensus_peers.cc:597] T a4736bb71dfa4f4b8b80e8a52895acf7 P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:36.024962  4603 consensus_peers.cc:597] T 69aed23cb12849fda6220c6c65580d59 P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:36.040544  4603 consensus_peers.cc:597] T e50b6f5a42a24867ab5f90ad6d97401e P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:36.055003  4529 consensus_peers.cc:597] T 980616077a8445ccbe984f63131e1b44 P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:36.071990  4603 consensus_peers.cc:597] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:36.121204  4603 consensus_peers.cc:597] T b731fe02a6f4441e816628760bfdfb54 P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:36.153095  4455 consensus_peers.cc:597] T 1503964d57034b31b36eecc16f2c84a0 P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:36.166098  4455 consensus_peers.cc:597] T 49047cb7a56246288b9044f8ebec130f P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:36.174355  4529 consensus_peers.cc:597] T d1119afee9d6413aa2cd229073ffbcf1 P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:36.181217  4529 consensus_peers.cc:597] T 3d38413c5dce44db8a755b48adacc3a8 P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:36.215256  4603 consensus_peers.cc:597] T 604a93ed898f4ab9b771487bfe278b33 P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:36.220820  4529 consensus_peers.cc:597] T d088694ef66442bdbf75cc7fc1942a83 P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:36.227065  4455 consensus_peers.cc:597] T 150545c47e0642229a92ede96db14fc9 P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:36.239243  4529 consensus_peers.cc:597] T 584f5934b7fa4c7ab4b0b43923621e70 P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:36.239712  4603 consensus_peers.cc:597] T acbf3f88b4514948820691784cf9c189 P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:36.254077  4455 consensus_peers.cc:597] T 0dc4f903fb004dd2bce3c4934f078a5d P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:36.293066  4529 consensus_peers.cc:597] T 002595643d984c1c915975d4c4ace485 P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:36.316605  4529 consensus_peers.cc:597] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:36.347707  4455 consensus_peers.cc:597] T d8033bfb7f5d423d90d60318c67df709 P aa0ff974118b465eaa785b8a86057e87 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:36.368631  4529 consensus_peers.cc:597] T 812a1b53a40e469c89b5f2aba8c59780 P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:36.717933 29364 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 5382)
I20260709 13:12:36.844947  5618 raft_consensus.cc:493] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.845484  5618 raft_consensus.cc:515] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:36.847159  5618 leader_election.cc:290] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
I20260709 13:12:36.848012  4556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3501a75721d543d598af7857e368e08b" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424" is_pre_election: true
I20260709 13:12:36.848779  4556 raft_consensus.cc:2468] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 3.
I20260709 13:12:36.850072  4602 leader_election.cc:304] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc; no voters: 
I20260709 13:12:36.851191  5568 raft_consensus.cc:2804] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:36.851570  5568 raft_consensus.cc:493] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.852038  5568 raft_consensus.cc:3060] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:36.867974  5568 raft_consensus.cc:515] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:36.877954  4556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3501a75721d543d598af7857e368e08b" candidate_uuid: "74758684df5649ccadd1e189eaff32dc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "420a61707e804ce5b3773a91cc2eb424"
I20260709 13:12:36.878598  4556 raft_consensus.cc:3060] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:36.877821  5568 leader_election.cc:290] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 4 election: Requested vote from peers 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159), 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439)
W20260709 13:12:36.880940  4603 leader_election.cc:336] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
W20260709 13:12:36.887218  4603 leader_election.cc:336] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111)
I20260709 13:12:36.888031  4556 raft_consensus.cc:2468] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74758684df5649ccadd1e189eaff32dc in term 4.
I20260709 13:12:36.890378  4602 leader_election.cc:304] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420a61707e804ce5b3773a91cc2eb424, 74758684df5649ccadd1e189eaff32dc; no voters: 06ec58698d5444caaecea433c8419770
I20260709 13:12:36.892036  5568 raft_consensus.cc:2804] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:36.893864  5568 raft_consensus.cc:697] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc [term 4 LEADER]: Becoming Leader. State: Replica: 74758684df5649ccadd1e189eaff32dc, State: Running, Role: LEADER
I20260709 13:12:36.895593  5568 consensus_queue.cc:237] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } }
I20260709 13:12:36.912919  4310 catalog_manager.cc:5697] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc reported cstate change: term changed from 2 to 4, leader changed from 06ec58698d5444caaecea433c8419770 (127.28.173.1) to 74758684df5649ccadd1e189eaff32dc (127.28.173.4). New cstate: current_term: 4 leader_uuid: "74758684df5649ccadd1e189eaff32dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420a61707e804ce5b3773a91cc2eb424" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 33159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74758684df5649ccadd1e189eaff32dc" member_type: VOTER last_known_addr { host: "127.28.173.4" port: 42711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06ec58698d5444caaecea433c8419770" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 36439 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:36.999956 29364 tablet_server.cc:196] TabletServer@127.28.173.1:36439 shutdown complete.
I20260709 13:12:37.084775 29364 tablet_server.cc:179] TabletServer@127.28.173.2:0 shutting down...
W20260709 13:12:37.107661  4529 consensus_peers.cc:597] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424 -> Peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Couldn't send request to peer aa0ff974118b465eaa785b8a86057e87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:37.113560  4529 consensus_peers.cc:597] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 420a61707e804ce5b3773a91cc2eb424 -> Peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Couldn't send request to peer aa0ff974118b465eaa785b8a86057e87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:37.127003 29364 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:37.127852 29364 tablet_replica.cc:333] T 47d66fc2153d419082eccd7e30643d56 P aa0ff974118b465eaa785b8a86057e87: stopping tablet replica
I20260709 13:12:37.128616 29364 raft_consensus.cc:2243] T 47d66fc2153d419082eccd7e30643d56 P aa0ff974118b465eaa785b8a86057e87 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.129511 29364 raft_consensus.cc:2272] T 47d66fc2153d419082eccd7e30643d56 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.131637 29364 tablet_replica.cc:333] T 3d38413c5dce44db8a755b48adacc3a8 P aa0ff974118b465eaa785b8a86057e87: stopping tablet replica
I20260709 13:12:37.132519 29364 raft_consensus.cc:2243] T 3d38413c5dce44db8a755b48adacc3a8 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.133052 29364 raft_consensus.cc:2272] T 3d38413c5dce44db8a755b48adacc3a8 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.135924 29364 tablet_replica.cc:333] T 82d5a41b86eb4457a114692137ced092 P aa0ff974118b465eaa785b8a86057e87: stopping tablet replica
I20260709 13:12:37.136818 29364 raft_consensus.cc:2243] T 82d5a41b86eb4457a114692137ced092 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.137354 29364 raft_consensus.cc:2272] T 82d5a41b86eb4457a114692137ced092 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.139937 29364 tablet_replica.cc:333] T e50b6f5a42a24867ab5f90ad6d97401e P aa0ff974118b465eaa785b8a86057e87: stopping tablet replica
I20260709 13:12:37.140729 29364 raft_consensus.cc:2243] T e50b6f5a42a24867ab5f90ad6d97401e P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.141196 29364 raft_consensus.cc:2272] T e50b6f5a42a24867ab5f90ad6d97401e P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.142961 29364 tablet_replica.cc:333] T 541b1e6cfdca4f609467169f4caf64ef P aa0ff974118b465eaa785b8a86057e87: stopping tablet replica
I20260709 13:12:37.143463 29364 raft_consensus.cc:2243] T 541b1e6cfdca4f609467169f4caf64ef P aa0ff974118b465eaa785b8a86057e87 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.144201 29364 raft_consensus.cc:2272] T 541b1e6cfdca4f609467169f4caf64ef P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.146242 29364 tablet_replica.cc:333] T 60d704077649426ab65d89dd9ff778d0 P aa0ff974118b465eaa785b8a86057e87: stopping tablet replica
I20260709 13:12:37.146934 29364 raft_consensus.cc:2243] T 60d704077649426ab65d89dd9ff778d0 P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.147354 29364 raft_consensus.cc:2272] T 60d704077649426ab65d89dd9ff778d0 P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.149119 29364 tablet_replica.cc:333] T 98342133e28b47d8a388f9321d5fd796 P aa0ff974118b465eaa785b8a86057e87: stopping tablet replica
I20260709 13:12:37.149737 29364 raft_consensus.cc:2243] T 98342133e28b47d8a388f9321d5fd796 P aa0ff974118b465eaa785b8a86057e87 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.150513 29364 raft_consensus.cc:2272] T 98342133e28b47d8a388f9321d5fd796 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.152472 29364 tablet_replica.cc:333] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87: stopping tablet replica
W20260709 13:12:37.152752  4529 consensus_peers.cc:597] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 -> Peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Couldn't send request to peer aa0ff974118b465eaa785b8a86057e87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:37.153108 29364 raft_consensus.cc:2243] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.154042 29364 raft_consensus.cc:2272] T d0608a8abe6c4bd083d751020218957e P aa0ff974118b465eaa785b8a86057e87 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.156327 29364 tablet_replica.cc:333] T 1271bae393604d56b9e376c716eb2a9e P aa0ff974118b465eaa785b8a86057e87: stopping tablet replica
I20260709 13:12:37.157196 29364 raft_consensus.cc:2243] T 1271bae393604d56b9e376c716eb2a9e P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:12:37.157202  4603 consensus_peers.cc:597] T 325a5a55a44a47ce97869216b084f89d P 74758684df5649ccadd1e189eaff32dc -> Peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Couldn't send request to peer aa0ff974118b465eaa785b8a86057e87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:37.157754 29364 raft_consensus.cc:2272] T 1271bae393604d56b9e376c716eb2a9e P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.159909 29364 tablet_replica.cc:333] T a16334f2dff74513ba7ca22ca8fb5afd P aa0ff974118b465eaa785b8a86057e87: stopping tablet replica
I20260709 13:12:37.160652 29364 raft_consensus.cc:2243] T a16334f2dff74513ba7ca22ca8fb5afd P aa0ff974118b465eaa785b8a86057e87 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.161157 29364 raft_consensus.cc:2272] T a16334f2dff74513ba7ca22ca8fb5afd P aa0ff974118b465eaa785b8a86057e87 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:37.162461  4603 consensus_peers.cc:597] T f1dfa63c8b78419c9ff6ffb624a861a7 P 74758684df5649ccadd1e189eaff32dc -> Peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Couldn't send request to peer aa0ff974118b465eaa785b8a86057e87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:37.163553 29364 tablet_replica.cc:333] T aa241e695dbb492a971f537d1f977f21 P aa0ff974118b465eaa785b8a86057e87: stopping tablet replica
I20260709 13:12:37.164350 29364 raft_consensus.cc:2243] T aa241e695dbb492a971f537d1f977f21 P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.164894 29364 raft_consensus.cc:2272] T aa241e695dbb492a971f537d1f977f21 P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.167004 29364 tablet_replica.cc:333] T f7682a3f7f134c34a24488586461f6a4 P aa0ff974118b465eaa785b8a86057e87: stopping tablet replica
I20260709 13:12:37.167547 29364 raft_consensus.cc:2243] T f7682a3f7f134c34a24488586461f6a4 P aa0ff974118b465eaa785b8a86057e87 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.168337 29364 raft_consensus.cc:2272] T f7682a3f7f134c34a24488586461f6a4 P aa0ff974118b465eaa785b8a86057e87 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.170082 29364 tablet_replica.cc:333] T 325a5a55a44a47ce97869216b084f89d P aa0ff974118b465eaa785b8a86057e87: stopping tablet replica
I20260709 13:12:37.170722 29364 raft_consensus.cc:2243] T 325a5a55a44a47ce97869216b084f89d P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.171181 29364 raft_consensus.cc:2272] T 325a5a55a44a47ce97869216b084f89d P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.173792 29364 tablet_replica.cc:333] T 150545c47e0642229a92ede96db14fc9 P aa0ff974118b465eaa785b8a86057e87: stopping tablet replica
I20260709 13:12:37.174460 29364 raft_consensus.cc:2243] T 150545c47e0642229a92ede96db14fc9 P aa0ff974118b465eaa785b8a86057e87 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.175158 29364 raft_consensus.cc:2272] T 150545c47e0642229a92ede96db14fc9 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.176990 29364 tablet_replica.cc:333] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87: stopping tablet replica
I20260709 13:12:37.177486 29364 raft_consensus.cc:2243] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.178313 29364 raft_consensus.cc:2272] T 2e466269360c4a538e16c342590490c0 P aa0ff974118b465eaa785b8a86057e87 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.180794 29364 tablet_replica.cc:333] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P aa0ff974118b465eaa785b8a86057e87: stopping tablet replica
I20260709 13:12:37.181540 29364 raft_consensus.cc:2243] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.182060 29364 raft_consensus.cc:2272] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.184741 29364 tablet_replica.cc:333] T f63e5465acbf4283a97304441ba41968 P aa0ff974118b465eaa785b8a86057e87: stopping tablet replica
I20260709 13:12:37.185488 29364 raft_consensus.cc:2243] T f63e5465acbf4283a97304441ba41968 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.185935 29364 raft_consensus.cc:2272] T f63e5465acbf4283a97304441ba41968 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.188131 29364 tablet_replica.cc:333] T b6256e4aa07c45c78b2bbff56a852078 P aa0ff974118b465eaa785b8a86057e87: stopping tablet replica
I20260709 13:12:37.188789 29364 raft_consensus.cc:2243] T b6256e4aa07c45c78b2bbff56a852078 P aa0ff974118b465eaa785b8a86057e87 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.189738 29364 raft_consensus.cc:2272] T b6256e4aa07c45c78b2bbff56a852078 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.191556 29364 tablet_replica.cc:333] T b60a97e129dc4aa9a43f2c44ec5181a8 P aa0ff974118b465eaa785b8a86057e87: stopping tablet replica
I20260709 13:12:37.192155 29364 raft_consensus.cc:2243] T b60a97e129dc4aa9a43f2c44ec5181a8 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.192543 29364 raft_consensus.cc:2272] T b60a97e129dc4aa9a43f2c44ec5181a8 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.194252 29364 tablet_replica.cc:333] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P aa0ff974118b465eaa785b8a86057e87: stopping tablet replica
I20260709 13:12:37.194720 29364 raft_consensus.cc:2243] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.195097 29364 raft_consensus.cc:2272] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.196870 29364 tablet_replica.cc:333] T 39bf585adcc94606975982efe4640189 P aa0ff974118b465eaa785b8a86057e87: stopping tablet replica
I20260709 13:12:37.197327 29364 raft_consensus.cc:2243] T 39bf585adcc94606975982efe4640189 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.197669 29364 raft_consensus.cc:2272] T 39bf585adcc94606975982efe4640189 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.199472 29364 tablet_replica.cc:333] T 1503964d57034b31b36eecc16f2c84a0 P aa0ff974118b465eaa785b8a86057e87: stopping tablet replica
I20260709 13:12:37.200078 29364 raft_consensus.cc:2243] T 1503964d57034b31b36eecc16f2c84a0 P aa0ff974118b465eaa785b8a86057e87 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.200826 29364 raft_consensus.cc:2272] T 1503964d57034b31b36eecc16f2c84a0 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.202719 29364 tablet_replica.cc:333] T 3092a6c40d0d4610968fe09d4c7d16c0 P aa0ff974118b465eaa785b8a86057e87: stopping tablet replica
W20260709 13:12:37.203248  4529 consensus_peers.cc:597] T 3d38413c5dce44db8a755b48adacc3a8 P 420a61707e804ce5b3773a91cc2eb424 -> Peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Couldn't send request to peer aa0ff974118b465eaa785b8a86057e87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:37.203325 29364 raft_consensus.cc:2243] T 3092a6c40d0d4610968fe09d4c7d16c0 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.203943 29364 raft_consensus.cc:2272] T 3092a6c40d0d4610968fe09d4c7d16c0 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.205621 29364 tablet_replica.cc:333] T f1dfa63c8b78419c9ff6ffb624a861a7 P aa0ff974118b465eaa785b8a86057e87: stopping tablet replica
I20260709 13:12:37.206156 29364 raft_consensus.cc:2243] T f1dfa63c8b78419c9ff6ffb624a861a7 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.206542 29364 raft_consensus.cc:2272] T f1dfa63c8b78419c9ff6ffb624a861a7 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.208391 29364 tablet_replica.cc:333] T be5e478344f14439b78f1a9bf58f4451 P aa0ff974118b465eaa785b8a86057e87: stopping tablet replica
I20260709 13:12:37.208904 29364 raft_consensus.cc:2243] T be5e478344f14439b78f1a9bf58f4451 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.209291 29364 raft_consensus.cc:2272] T be5e478344f14439b78f1a9bf58f4451 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.211344 29364 tablet_replica.cc:333] T 9d526ab043434bf0bcab814f9bbc3234 P aa0ff974118b465eaa785b8a86057e87: stopping tablet replica
I20260709 13:12:37.212082 29364 raft_consensus.cc:2243] T 9d526ab043434bf0bcab814f9bbc3234 P aa0ff974118b465eaa785b8a86057e87 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.212807 29364 raft_consensus.cc:2272] T 9d526ab043434bf0bcab814f9bbc3234 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.214692 29364 tablet_replica.cc:333] T d0147a5552154f26a88833f9210b1358 P aa0ff974118b465eaa785b8a86057e87: stopping tablet replica
I20260709 13:12:37.215390 29364 raft_consensus.cc:2243] T d0147a5552154f26a88833f9210b1358 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.215857 29364 raft_consensus.cc:2272] T d0147a5552154f26a88833f9210b1358 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.218384 29364 tablet_replica.cc:333] T 1c7e5d871d1c44a58c65d3f76bce55b0 P aa0ff974118b465eaa785b8a86057e87: stopping tablet replica
I20260709 13:12:37.219019 29364 raft_consensus.cc:2243] T 1c7e5d871d1c44a58c65d3f76bce55b0 P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.219372 29364 raft_consensus.cc:2272] T 1c7e5d871d1c44a58c65d3f76bce55b0 P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.221060 29364 tablet_replica.cc:333] T 980616077a8445ccbe984f63131e1b44 P aa0ff974118b465eaa785b8a86057e87: stopping tablet replica
I20260709 13:12:37.221560 29364 raft_consensus.cc:2243] T 980616077a8445ccbe984f63131e1b44 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.221941 29364 raft_consensus.cc:2272] T 980616077a8445ccbe984f63131e1b44 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.223995 29364 tablet_replica.cc:333] T 5cd01d60553a435387e507f5d6240b58 P aa0ff974118b465eaa785b8a86057e87: stopping tablet replica
I20260709 13:12:37.224583 29364 raft_consensus.cc:2243] T 5cd01d60553a435387e507f5d6240b58 P aa0ff974118b465eaa785b8a86057e87 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.225574 29364 raft_consensus.cc:2272] T 5cd01d60553a435387e507f5d6240b58 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.227798 29364 tablet_replica.cc:333] T d8033bfb7f5d423d90d60318c67df709 P aa0ff974118b465eaa785b8a86057e87: stopping tablet replica
I20260709 13:12:37.228344 29364 raft_consensus.cc:2243] T d8033bfb7f5d423d90d60318c67df709 P aa0ff974118b465eaa785b8a86057e87 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.229076 29364 raft_consensus.cc:2272] T d8033bfb7f5d423d90d60318c67df709 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.231061 29364 tablet_replica.cc:333] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87: stopping tablet replica
I20260709 13:12:37.231701 29364 raft_consensus.cc:2243] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.232662 29364 raft_consensus.cc:2272] T 9ca87a1b3c8043529d7a9d61b0adfdbf P aa0ff974118b465eaa785b8a86057e87 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.234549 29364 tablet_replica.cc:333] T 5b827ee48d56478398f009c3fa980016 P aa0ff974118b465eaa785b8a86057e87: stopping tablet replica
I20260709 13:12:37.235199 29364 raft_consensus.cc:2243] T 5b827ee48d56478398f009c3fa980016 P aa0ff974118b465eaa785b8a86057e87 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.236078 29364 raft_consensus.cc:2272] T 5b827ee48d56478398f009c3fa980016 P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.238157 29364 tablet_replica.cc:333] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87: stopping tablet replica
W20260709 13:12:37.238341  4603 consensus_peers.cc:597] T d0147a5552154f26a88833f9210b1358 P 74758684df5649ccadd1e189eaff32dc -> Peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Couldn't send request to peer aa0ff974118b465eaa785b8a86057e87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:37.238641 29364 raft_consensus.cc:2243] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.239504 29364 raft_consensus.cc:2272] T 9a508f846d314fa0b7ec364af09bc427 P aa0ff974118b465eaa785b8a86057e87 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.241300 29364 tablet_replica.cc:333] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87: stopping tablet replica
I20260709 13:12:37.241806 29364 raft_consensus.cc:2243] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.242318 29364 raft_consensus.cc:2272] T 20be30df26724e7f98f3b36f24e4df3a P aa0ff974118b465eaa785b8a86057e87 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.244513 29364 tablet_replica.cc:333] T acbf3f88b4514948820691784cf9c189 P aa0ff974118b465eaa785b8a86057e87: stopping tablet replica
I20260709 13:12:37.245172 29364 raft_consensus.cc:2243] T acbf3f88b4514948820691784cf9c189 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.245697 29364 raft_consensus.cc:2272] T acbf3f88b4514948820691784cf9c189 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.248270 29364 tablet_replica.cc:333] T a4736bb71dfa4f4b8b80e8a52895acf7 P aa0ff974118b465eaa785b8a86057e87: stopping tablet replica
W20260709 13:12:37.247664  4529 consensus_peers.cc:597] T be5e478344f14439b78f1a9bf58f4451 P 420a61707e804ce5b3773a91cc2eb424 -> Peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Couldn't send request to peer aa0ff974118b465eaa785b8a86057e87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:37.249375 29364 raft_consensus.cc:2243] T a4736bb71dfa4f4b8b80e8a52895acf7 P aa0ff974118b465eaa785b8a86057e87 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.250402 29364 raft_consensus.cc:2272] T a4736bb71dfa4f4b8b80e8a52895acf7 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.252905 29364 tablet_replica.cc:333] T 49047cb7a56246288b9044f8ebec130f P aa0ff974118b465eaa785b8a86057e87: stopping tablet replica
I20260709 13:12:37.253546 29364 raft_consensus.cc:2243] T 49047cb7a56246288b9044f8ebec130f P aa0ff974118b465eaa785b8a86057e87 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.254383 29364 raft_consensus.cc:2272] T 49047cb7a56246288b9044f8ebec130f P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.256562 29364 tablet_replica.cc:333] T 93ff75cd7d2c433ca9aa8f6390884032 P aa0ff974118b465eaa785b8a86057e87: stopping tablet replica
I20260709 13:12:37.257038 29364 raft_consensus.cc:2243] T 93ff75cd7d2c433ca9aa8f6390884032 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.257370 29364 raft_consensus.cc:2272] T 93ff75cd7d2c433ca9aa8f6390884032 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.259183 29364 tablet_replica.cc:333] T cb23991ab8504ee491f905a4346edee9 P aa0ff974118b465eaa785b8a86057e87: stopping tablet replica
I20260709 13:12:37.259590 29364 raft_consensus.cc:2243] T cb23991ab8504ee491f905a4346edee9 P aa0ff974118b465eaa785b8a86057e87 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.260289 29364 raft_consensus.cc:2272] T cb23991ab8504ee491f905a4346edee9 P aa0ff974118b465eaa785b8a86057e87 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.261909 29364 tablet_replica.cc:333] T 0dc4f903fb004dd2bce3c4934f078a5d P aa0ff974118b465eaa785b8a86057e87: stopping tablet replica
I20260709 13:12:37.262365 29364 raft_consensus.cc:2243] T 0dc4f903fb004dd2bce3c4934f078a5d P aa0ff974118b465eaa785b8a86057e87 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.263074 29364 raft_consensus.cc:2272] T 0dc4f903fb004dd2bce3c4934f078a5d P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.265053 29364 tablet_replica.cc:333] T 09294b866578436a827c27702d4b1d0b P aa0ff974118b465eaa785b8a86057e87: stopping tablet replica
I20260709 13:12:37.265511 29364 raft_consensus.cc:2243] T 09294b866578436a827c27702d4b1d0b P aa0ff974118b465eaa785b8a86057e87 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.266185 29364 raft_consensus.cc:2272] T 09294b866578436a827c27702d4b1d0b P aa0ff974118b465eaa785b8a86057e87 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.267964 29364 tablet_replica.cc:333] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P aa0ff974118b465eaa785b8a86057e87: stopping tablet replica
I20260709 13:12:37.268397 29364 raft_consensus.cc:2243] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.268803 29364 raft_consensus.cc:2272] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.270665 29364 tablet_replica.cc:333] T ea0b275f64bf42cc88bbee81a24d3020 P aa0ff974118b465eaa785b8a86057e87: stopping tablet replica
I20260709 13:12:37.271081 29364 raft_consensus.cc:2243] T ea0b275f64bf42cc88bbee81a24d3020 P aa0ff974118b465eaa785b8a86057e87 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.271920 29364 raft_consensus.cc:2272] T ea0b275f64bf42cc88bbee81a24d3020 P aa0ff974118b465eaa785b8a86057e87 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:37.304733  4603 consensus_peers.cc:597] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 74758684df5649ccadd1e189eaff32dc -> Peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Couldn't send request to peer aa0ff974118b465eaa785b8a86057e87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:37.305276  4603 consensus_peers.cc:597] T 93ff75cd7d2c433ca9aa8f6390884032 P 74758684df5649ccadd1e189eaff32dc -> Peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Couldn't send request to peer aa0ff974118b465eaa785b8a86057e87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:37.305821  4603 consensus_peers.cc:597] T e50b6f5a42a24867ab5f90ad6d97401e P 74758684df5649ccadd1e189eaff32dc -> Peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Couldn't send request to peer aa0ff974118b465eaa785b8a86057e87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:37.307242  4603 consensus_peers.cc:597] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc -> Peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Couldn't send request to peer aa0ff974118b465eaa785b8a86057e87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:37.307359  4529 consensus_peers.cc:597] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:37.328771  4603 consensus_peers.cc:597] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc -> Peer 06ec58698d5444caaecea433c8419770 (127.28.173.1:36439): Couldn't send request to peer 06ec58698d5444caaecea433c8419770. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:36439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:37.330269  4529 consensus_peers.cc:597] T 82d5a41b86eb4457a114692137ced092 P 420a61707e804ce5b3773a91cc2eb424 -> Peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Couldn't send request to peer aa0ff974118b465eaa785b8a86057e87. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:37.335290  4529 consensus_peers.cc:597] T f63e5465acbf4283a97304441ba41968 P 420a61707e804ce5b3773a91cc2eb424 -> Peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Couldn't send request to peer aa0ff974118b465eaa785b8a86057e87. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.2:45987: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:37.337496  4529 consensus_peers.cc:597] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 -> Peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Couldn't send request to peer aa0ff974118b465eaa785b8a86057e87. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.2:45987: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:37.346441 29364 tablet_server.cc:196] TabletServer@127.28.173.2:0 shutdown complete.
W20260709 13:12:37.375653  4529 consensus_peers.cc:597] T 980616077a8445ccbe984f63131e1b44 P 420a61707e804ce5b3773a91cc2eb424 -> Peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Couldn't send request to peer aa0ff974118b465eaa785b8a86057e87. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.2:45987: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:37.420886 29364 tablet_server.cc:179] TabletServer@127.28.173.3:0 shutting down...
W20260709 13:12:37.426796  4602 consensus_peers.cc:597] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc -> Peer 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159): Couldn't send request to peer 420a61707e804ce5b3773a91cc2eb424. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:37.439970  4529 consensus_peers.cc:597] T b60a97e129dc4aa9a43f2c44ec5181a8 P 420a61707e804ce5b3773a91cc2eb424 -> Peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Couldn't send request to peer aa0ff974118b465eaa785b8a86057e87. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.2:45987: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:37.507045 29364 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:37.508154 29364 tablet_replica.cc:333] T 3f696298fcc049c08b47cd54f901be0c P 420a61707e804ce5b3773a91cc2eb424: stopping tablet replica
I20260709 13:12:37.511272 29364 raft_consensus.cc:2243] T 3f696298fcc049c08b47cd54f901be0c P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.511848 29364 raft_consensus.cc:2272] T 3f696298fcc049c08b47cd54f901be0c P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.514701 29364 tablet_replica.cc:333] T 47d66fc2153d419082eccd7e30643d56 P 420a61707e804ce5b3773a91cc2eb424: stopping tablet replica
I20260709 13:12:37.515457 29364 raft_consensus.cc:2243] T 47d66fc2153d419082eccd7e30643d56 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.516031 29364 raft_consensus.cc:2272] T 47d66fc2153d419082eccd7e30643d56 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:37.517606  4602 consensus_peers.cc:597] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc -> Peer 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159): Couldn't send request to peer 420a61707e804ce5b3773a91cc2eb424. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:37.518312  4602 consensus_peers.cc:597] T ff7757f22fe3408f8745bc899f3c2e4e P 74758684df5649ccadd1e189eaff32dc -> Peer 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159): Couldn't send request to peer 420a61707e804ce5b3773a91cc2eb424. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:37.518926 29364 tablet_replica.cc:333] T 3d38413c5dce44db8a755b48adacc3a8 P 420a61707e804ce5b3773a91cc2eb424: stopping tablet replica
W20260709 13:12:37.519716  4602 consensus_peers.cc:597] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 74758684df5649ccadd1e189eaff32dc -> Peer 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159): Couldn't send request to peer 420a61707e804ce5b3773a91cc2eb424. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:37.519794 29364 raft_consensus.cc:2243] T 3d38413c5dce44db8a755b48adacc3a8 P 420a61707e804ce5b3773a91cc2eb424 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.520835 29364 raft_consensus.cc:2272] T 3d38413c5dce44db8a755b48adacc3a8 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.522701 29364 tablet_replica.cc:333] T 82d5a41b86eb4457a114692137ced092 P 420a61707e804ce5b3773a91cc2eb424: stopping tablet replica
I20260709 13:12:37.523212 29364 raft_consensus.cc:2243] T 82d5a41b86eb4457a114692137ced092 P 420a61707e804ce5b3773a91cc2eb424 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.523972 29364 raft_consensus.cc:2272] T 82d5a41b86eb4457a114692137ced092 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.525748 29364 tablet_replica.cc:333] T 812a1b53a40e469c89b5f2aba8c59780 P 420a61707e804ce5b3773a91cc2eb424: stopping tablet replica
I20260709 13:12:37.526252 29364 raft_consensus.cc:2243] T 812a1b53a40e469c89b5f2aba8c59780 P 420a61707e804ce5b3773a91cc2eb424 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.526922 29364 raft_consensus.cc:2272] T 812a1b53a40e469c89b5f2aba8c59780 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.528905 29364 tablet_replica.cc:333] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424: stopping tablet replica
I20260709 13:12:37.529429 29364 raft_consensus.cc:2243] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.530390 29364 raft_consensus.cc:2272] T 60d704077649426ab65d89dd9ff778d0 P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.533005 29364 tablet_replica.cc:333] T 541b1e6cfdca4f609467169f4caf64ef P 420a61707e804ce5b3773a91cc2eb424: stopping tablet replica
W20260709 13:12:37.533691  4603 consensus_peers.cc:597] T 39bf585adcc94606975982efe4640189 P 74758684df5649ccadd1e189eaff32dc -> Peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Couldn't send request to peer aa0ff974118b465eaa785b8a86057e87. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.2:45987: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:37.533753 29364 raft_consensus.cc:2243] T 541b1e6cfdca4f609467169f4caf64ef P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.534408 29364 raft_consensus.cc:2272] T 541b1e6cfdca4f609467169f4caf64ef P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.536711 29364 tablet_replica.cc:333] T b731fe02a6f4441e816628760bfdfb54 P 420a61707e804ce5b3773a91cc2eb424: stopping tablet replica
I20260709 13:12:37.537297 29364 raft_consensus.cc:2243] T b731fe02a6f4441e816628760bfdfb54 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:12:37.537400  4529 consensus_peers.cc:597] T 1271bae393604d56b9e376c716eb2a9e P 420a61707e804ce5b3773a91cc2eb424 -> Peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Couldn't send request to peer aa0ff974118b465eaa785b8a86057e87. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.2:45987: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:37.537791 29364 raft_consensus.cc:2272] T b731fe02a6f4441e816628760bfdfb54 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.539589 29364 tablet_replica.cc:333] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424: stopping tablet replica
I20260709 13:12:37.540160 29364 raft_consensus.cc:2243] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.540539 29364 raft_consensus.cc:2272] T d0608a8abe6c4bd083d751020218957e P 420a61707e804ce5b3773a91cc2eb424 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.542249 29364 tablet_replica.cc:333] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424: stopping tablet replica
I20260709 13:12:37.542793 29364 raft_consensus.cc:2243] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.543195 29364 raft_consensus.cc:2272] T ff7757f22fe3408f8745bc899f3c2e4e P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.545257 29364 tablet_replica.cc:333] T f1dfa63c8b78419c9ff6ffb624a861a7 P 420a61707e804ce5b3773a91cc2eb424: stopping tablet replica
I20260709 13:12:37.545936 29364 raft_consensus.cc:2243] T f1dfa63c8b78419c9ff6ffb624a861a7 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.546425 29364 raft_consensus.cc:2272] T f1dfa63c8b78419c9ff6ffb624a861a7 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:37.547609  4603 consensus_peers.cc:597] T 3092a6c40d0d4610968fe09d4c7d16c0 P 74758684df5649ccadd1e189eaff32dc -> Peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Couldn't send request to peer aa0ff974118b465eaa785b8a86057e87. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.2:45987: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:37.548894 29364 tablet_replica.cc:333] T be5e478344f14439b78f1a9bf58f4451 P 420a61707e804ce5b3773a91cc2eb424: stopping tablet replica
I20260709 13:12:37.549597 29364 raft_consensus.cc:2243] T be5e478344f14439b78f1a9bf58f4451 P 420a61707e804ce5b3773a91cc2eb424 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:12:37.550459  4602 consensus_peers.cc:597] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 74758684df5649ccadd1e189eaff32dc -> Peer 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159): Couldn't send request to peer 420a61707e804ce5b3773a91cc2eb424. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:37.550591 29364 raft_consensus.cc:2272] T be5e478344f14439b78f1a9bf58f4451 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.552531 29364 tablet_replica.cc:333] T 9d526ab043434bf0bcab814f9bbc3234 P 420a61707e804ce5b3773a91cc2eb424: stopping tablet replica
I20260709 13:12:37.553035 29364 raft_consensus.cc:2243] T 9d526ab043434bf0bcab814f9bbc3234 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.553393 29364 raft_consensus.cc:2272] T 9d526ab043434bf0bcab814f9bbc3234 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.555359 29364 tablet_replica.cc:333] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424: stopping tablet replica
I20260709 13:12:37.556070 29364 raft_consensus.cc:2243] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.557026 29364 raft_consensus.cc:2272] T a8fb0d1b4ae14754aa30516d12cdea3d P 420a61707e804ce5b3773a91cc2eb424 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.559540 29364 tablet_replica.cc:333] T 584f5934b7fa4c7ab4b0b43923621e70 P 420a61707e804ce5b3773a91cc2eb424: stopping tablet replica
I20260709 13:12:37.560295 29364 raft_consensus.cc:2243] T 584f5934b7fa4c7ab4b0b43923621e70 P 420a61707e804ce5b3773a91cc2eb424 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.561282 29364 raft_consensus.cc:2272] T 584f5934b7fa4c7ab4b0b43923621e70 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:37.561517  4602 consensus_peers.cc:597] T 3092a6c40d0d4610968fe09d4c7d16c0 P 74758684df5649ccadd1e189eaff32dc -> Peer 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159): Couldn't send request to peer 420a61707e804ce5b3773a91cc2eb424. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:37.563234 29364 tablet_replica.cc:333] T d1119afee9d6413aa2cd229073ffbcf1 P 420a61707e804ce5b3773a91cc2eb424: stopping tablet replica
I20260709 13:12:37.563774 29364 raft_consensus.cc:2243] T d1119afee9d6413aa2cd229073ffbcf1 P 420a61707e804ce5b3773a91cc2eb424 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.564496 29364 raft_consensus.cc:2272] T d1119afee9d6413aa2cd229073ffbcf1 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.566231 29364 tablet_replica.cc:333] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424: stopping tablet replica
I20260709 13:12:37.566708 29364 raft_consensus.cc:2243] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.567066 29364 raft_consensus.cc:2272] T f7682a3f7f134c34a24488586461f6a4 P 420a61707e804ce5b3773a91cc2eb424 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.568758 29364 tablet_replica.cc:333] T f63e5465acbf4283a97304441ba41968 P 420a61707e804ce5b3773a91cc2eb424: stopping tablet replica
I20260709 13:12:37.569197 29364 raft_consensus.cc:2243] T f63e5465acbf4283a97304441ba41968 P 420a61707e804ce5b3773a91cc2eb424 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.569829 29364 raft_consensus.cc:2272] T f63e5465acbf4283a97304441ba41968 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.571491 29364 tablet_replica.cc:333] T b6256e4aa07c45c78b2bbff56a852078 P 420a61707e804ce5b3773a91cc2eb424: stopping tablet replica
I20260709 13:12:37.572027 29364 raft_consensus.cc:2243] T b6256e4aa07c45c78b2bbff56a852078 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.572367 29364 raft_consensus.cc:2272] T b6256e4aa07c45c78b2bbff56a852078 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.574096 29364 tablet_replica.cc:333] T b60a97e129dc4aa9a43f2c44ec5181a8 P 420a61707e804ce5b3773a91cc2eb424: stopping tablet replica
I20260709 13:12:37.574560 29364 raft_consensus.cc:2243] T b60a97e129dc4aa9a43f2c44ec5181a8 P 420a61707e804ce5b3773a91cc2eb424 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.575218 29364 raft_consensus.cc:2272] T b60a97e129dc4aa9a43f2c44ec5181a8 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.577353 29364 tablet_replica.cc:333] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 420a61707e804ce5b3773a91cc2eb424: stopping tablet replica
I20260709 13:12:37.577813 29364 raft_consensus.cc:2243] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 420a61707e804ce5b3773a91cc2eb424 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.578433 29364 raft_consensus.cc:2272] T 35dbb9c8f1ac4eca802b0c887a4d1c27 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.580682 29364 tablet_replica.cc:333] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 420a61707e804ce5b3773a91cc2eb424: stopping tablet replica
I20260709 13:12:37.581410 29364 raft_consensus.cc:2243] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 420a61707e804ce5b3773a91cc2eb424 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:12:37.582254  4602 consensus_peers.cc:597] T 93ff75cd7d2c433ca9aa8f6390884032 P 74758684df5649ccadd1e189eaff32dc -> Peer 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159): Couldn't send request to peer 420a61707e804ce5b3773a91cc2eb424. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:37.582295 29364 raft_consensus.cc:2272] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:37.584569  4603 consensus_peers.cc:597] T acbf3f88b4514948820691784cf9c189 P 74758684df5649ccadd1e189eaff32dc -> Peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Couldn't send request to peer aa0ff974118b465eaa785b8a86057e87. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.2:45987: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:37.584890 29364 tablet_replica.cc:333] T 150545c47e0642229a92ede96db14fc9 P 420a61707e804ce5b3773a91cc2eb424: stopping tablet replica
I20260709 13:12:37.585703 29364 raft_consensus.cc:2243] T 150545c47e0642229a92ede96db14fc9 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.586190 29364 raft_consensus.cc:2272] T 150545c47e0642229a92ede96db14fc9 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.588661 29364 tablet_replica.cc:333] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424: stopping tablet replica
I20260709 13:12:37.589416 29364 raft_consensus.cc:2243] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.589775 29364 raft_consensus.cc:2272] T 2e466269360c4a538e16c342590490c0 P 420a61707e804ce5b3773a91cc2eb424 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.591482 29364 tablet_replica.cc:333] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 420a61707e804ce5b3773a91cc2eb424: stopping tablet replica
I20260709 13:12:37.592015 29364 raft_consensus.cc:2243] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 420a61707e804ce5b3773a91cc2eb424 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.592669 29364 raft_consensus.cc:2272] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.594396 29364 tablet_replica.cc:333] T 604a93ed898f4ab9b771487bfe278b33 P 420a61707e804ce5b3773a91cc2eb424: stopping tablet replica
I20260709 13:12:37.594883 29364 raft_consensus.cc:2243] T 604a93ed898f4ab9b771487bfe278b33 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.595237 29364 raft_consensus.cc:2272] T 604a93ed898f4ab9b771487bfe278b33 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.596998 29364 tablet_replica.cc:333] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424: stopping tablet replica
I20260709 13:12:37.597466 29364 raft_consensus.cc:2243] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.598121 29364 raft_consensus.cc:2272] T 1c7e5d871d1c44a58c65d3f76bce55b0 P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.599661 29364 tablet_replica.cc:333] T 980616077a8445ccbe984f63131e1b44 P 420a61707e804ce5b3773a91cc2eb424: stopping tablet replica
I20260709 13:12:37.600152 29364 raft_consensus.cc:2243] T 980616077a8445ccbe984f63131e1b44 P 420a61707e804ce5b3773a91cc2eb424 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.600788 29364 raft_consensus.cc:2272] T 980616077a8445ccbe984f63131e1b44 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.602581 29364 tablet_replica.cc:333] T 5cd01d60553a435387e507f5d6240b58 P 420a61707e804ce5b3773a91cc2eb424: stopping tablet replica
I20260709 13:12:37.603029 29364 raft_consensus.cc:2243] T 5cd01d60553a435387e507f5d6240b58 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.603364 29364 raft_consensus.cc:2272] T 5cd01d60553a435387e507f5d6240b58 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.604949 29364 tablet_replica.cc:333] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 420a61707e804ce5b3773a91cc2eb424: stopping tablet replica
I20260709 13:12:37.605377 29364 raft_consensus.cc:2243] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 420a61707e804ce5b3773a91cc2eb424 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.605720 29364 raft_consensus.cc:2272] T 9ca87a1b3c8043529d7a9d61b0adfdbf P 420a61707e804ce5b3773a91cc2eb424 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.607869 29364 tablet_replica.cc:333] T 39bf585adcc94606975982efe4640189 P 420a61707e804ce5b3773a91cc2eb424: stopping tablet replica
I20260709 13:12:37.608530 29364 raft_consensus.cc:2243] T 39bf585adcc94606975982efe4640189 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.609046 29364 raft_consensus.cc:2272] T 39bf585adcc94606975982efe4640189 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.611199 29364 tablet_replica.cc:333] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 420a61707e804ce5b3773a91cc2eb424: stopping tablet replica
I20260709 13:12:37.611629 29364 raft_consensus.cc:2243] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.612046 29364 raft_consensus.cc:2272] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.613678 29364 tablet_replica.cc:333] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424: stopping tablet replica
I20260709 13:12:37.614131 29364 raft_consensus.cc:2243] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.614809 29364 raft_consensus.cc:2272] T 20be30df26724e7f98f3b36f24e4df3a P 420a61707e804ce5b3773a91cc2eb424 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.616586 29364 tablet_replica.cc:333] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 420a61707e804ce5b3773a91cc2eb424: stopping tablet replica
I20260709 13:12:37.617154 29364 raft_consensus.cc:2243] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.617636 29364 raft_consensus.cc:2272] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.619992 29364 tablet_replica.cc:333] T ea0b275f64bf42cc88bbee81a24d3020 P 420a61707e804ce5b3773a91cc2eb424: stopping tablet replica
I20260709 13:12:37.620568 29364 raft_consensus.cc:2243] T ea0b275f64bf42cc88bbee81a24d3020 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.620955 29364 raft_consensus.cc:2272] T ea0b275f64bf42cc88bbee81a24d3020 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.622923 29364 tablet_replica.cc:333] T 93ff75cd7d2c433ca9aa8f6390884032 P 420a61707e804ce5b3773a91cc2eb424: stopping tablet replica
I20260709 13:12:37.623538 29364 raft_consensus.cc:2243] T 93ff75cd7d2c433ca9aa8f6390884032 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.624019 29364 raft_consensus.cc:2272] T 93ff75cd7d2c433ca9aa8f6390884032 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.626488 29364 tablet_replica.cc:333] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424: stopping tablet replica
I20260709 13:12:37.627130 29364 raft_consensus.cc:2243] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.627660 29364 raft_consensus.cc:2272] T 3501a75721d543d598af7857e368e08b P 420a61707e804ce5b3773a91cc2eb424 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.629940 29364 tablet_replica.cc:333] T d088694ef66442bdbf75cc7fc1942a83 P 420a61707e804ce5b3773a91cc2eb424: stopping tablet replica
I20260709 13:12:37.630530 29364 raft_consensus.cc:2243] T d088694ef66442bdbf75cc7fc1942a83 P 420a61707e804ce5b3773a91cc2eb424 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.631556 29364 raft_consensus.cc:2272] T d088694ef66442bdbf75cc7fc1942a83 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:37.632215  4602 consensus_peers.cc:597] T f1dfa63c8b78419c9ff6ffb624a861a7 P 74758684df5649ccadd1e189eaff32dc -> Peer 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159): Couldn't send request to peer 420a61707e804ce5b3773a91cc2eb424. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:37.634068 29364 tablet_replica.cc:333] T 1271bae393604d56b9e376c716eb2a9e P 420a61707e804ce5b3773a91cc2eb424: stopping tablet replica
I20260709 13:12:37.634781 29364 raft_consensus.cc:2243] T 1271bae393604d56b9e376c716eb2a9e P 420a61707e804ce5b3773a91cc2eb424 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.635612 29364 raft_consensus.cc:2272] T 1271bae393604d56b9e376c716eb2a9e P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.637893 29364 tablet_replica.cc:333] T 002595643d984c1c915975d4c4ace485 P 420a61707e804ce5b3773a91cc2eb424: stopping tablet replica
I20260709 13:12:37.638317 29364 raft_consensus.cc:2243] T 002595643d984c1c915975d4c4ace485 P 420a61707e804ce5b3773a91cc2eb424 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.638929 29364 raft_consensus.cc:2272] T 002595643d984c1c915975d4c4ace485 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.640599 29364 tablet_replica.cc:333] T 69aed23cb12849fda6220c6c65580d59 P 420a61707e804ce5b3773a91cc2eb424: stopping tablet replica
I20260709 13:12:37.641028 29364 raft_consensus.cc:2243] T 69aed23cb12849fda6220c6c65580d59 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.641335 29364 raft_consensus.cc:2272] T 69aed23cb12849fda6220c6c65580d59 P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.643004 29364 tablet_replica.cc:333] T 3092a6c40d0d4610968fe09d4c7d16c0 P 420a61707e804ce5b3773a91cc2eb424: stopping tablet replica
I20260709 13:12:37.643407 29364 raft_consensus.cc:2243] T 3092a6c40d0d4610968fe09d4c7d16c0 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.643720 29364 raft_consensus.cc:2272] T 3092a6c40d0d4610968fe09d4c7d16c0 P 420a61707e804ce5b3773a91cc2eb424 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.645394 29364 tablet_replica.cc:333] T 81197f2dcf424fbaaab746d5f8bf7c8c P 420a61707e804ce5b3773a91cc2eb424: stopping tablet replica
I20260709 13:12:37.645787 29364 raft_consensus.cc:2243] T 81197f2dcf424fbaaab746d5f8bf7c8c P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.646124 29364 raft_consensus.cc:2272] T 81197f2dcf424fbaaab746d5f8bf7c8c P 420a61707e804ce5b3773a91cc2eb424 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.647686 29364 tablet_replica.cc:333] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424: stopping tablet replica
I20260709 13:12:37.648133 29364 raft_consensus.cc:2243] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.648521 29364 raft_consensus.cc:2272] T cb23991ab8504ee491f905a4346edee9 P 420a61707e804ce5b3773a91cc2eb424 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:37.655332  4603 consensus_peers.cc:597] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc -> Peer aa0ff974118b465eaa785b8a86057e87 (127.28.173.2:45987): Couldn't send request to peer aa0ff974118b465eaa785b8a86057e87. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.2:45987: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:37.704859  4602 consensus_peers.cc:597] T 69aed23cb12849fda6220c6c65580d59 P 74758684df5649ccadd1e189eaff32dc -> Peer 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159): Couldn't send request to peer 420a61707e804ce5b3773a91cc2eb424. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:37.722172  4602 consensus_peers.cc:597] T 39bf585adcc94606975982efe4640189 P 74758684df5649ccadd1e189eaff32dc -> Peer 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159): Couldn't send request to peer 420a61707e804ce5b3773a91cc2eb424. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.3:33159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:37.728297 29364 tablet_server.cc:196] TabletServer@127.28.173.3:0 shutdown complete.
W20260709 13:12:37.750376  4602 consensus_peers.cc:597] T b731fe02a6f4441e816628760bfdfb54 P 74758684df5649ccadd1e189eaff32dc -> Peer 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159): Couldn't send request to peer 420a61707e804ce5b3773a91cc2eb424. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.3:33159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:37.793200 29364 tablet_server.cc:179] TabletServer@127.28.173.4:0 shutting down...
W20260709 13:12:37.802975  4602 consensus_peers.cc:597] T 604a93ed898f4ab9b771487bfe278b33 P 74758684df5649ccadd1e189eaff32dc -> Peer 420a61707e804ce5b3773a91cc2eb424 (127.28.173.3:33159): Couldn't send request to peer 420a61707e804ce5b3773a91cc2eb424. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.3:33159: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:37.832430 29364 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:37.833202 29364 tablet_replica.cc:333] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc: stopping tablet replica
I20260709 13:12:37.833894 29364 raft_consensus.cc:2243] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.834707 29364 raft_consensus.cc:2272] T 3f696298fcc049c08b47cd54f901be0c P 74758684df5649ccadd1e189eaff32dc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.836771 29364 tablet_replica.cc:333] T d8033bfb7f5d423d90d60318c67df709 P 74758684df5649ccadd1e189eaff32dc: stopping tablet replica
I20260709 13:12:37.837314 29364 raft_consensus.cc:2243] T d8033bfb7f5d423d90d60318c67df709 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.837700 29364 raft_consensus.cc:2272] T d8033bfb7f5d423d90d60318c67df709 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.839506 29364 tablet_replica.cc:333] T 82d5a41b86eb4457a114692137ced092 P 74758684df5649ccadd1e189eaff32dc: stopping tablet replica
I20260709 13:12:37.840114 29364 raft_consensus.cc:2243] T 82d5a41b86eb4457a114692137ced092 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.840549 29364 raft_consensus.cc:2272] T 82d5a41b86eb4457a114692137ced092 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.842878 29364 tablet_replica.cc:333] T 812a1b53a40e469c89b5f2aba8c59780 P 74758684df5649ccadd1e189eaff32dc: stopping tablet replica
I20260709 13:12:37.843477 29364 raft_consensus.cc:2243] T 812a1b53a40e469c89b5f2aba8c59780 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.843987 29364 raft_consensus.cc:2272] T 812a1b53a40e469c89b5f2aba8c59780 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.846027 29364 tablet_replica.cc:333] T 541b1e6cfdca4f609467169f4caf64ef P 74758684df5649ccadd1e189eaff32dc: stopping tablet replica
I20260709 13:12:37.846566 29364 raft_consensus.cc:2243] T 541b1e6cfdca4f609467169f4caf64ef P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.846940 29364 raft_consensus.cc:2272] T 541b1e6cfdca4f609467169f4caf64ef P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.848768 29364 tablet_replica.cc:333] T e50b6f5a42a24867ab5f90ad6d97401e P 74758684df5649ccadd1e189eaff32dc: stopping tablet replica
I20260709 13:12:37.849268 29364 raft_consensus.cc:2243] T e50b6f5a42a24867ab5f90ad6d97401e P 74758684df5649ccadd1e189eaff32dc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.849956 29364 raft_consensus.cc:2272] T e50b6f5a42a24867ab5f90ad6d97401e P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.851711 29364 tablet_replica.cc:333] T 98342133e28b47d8a388f9321d5fd796 P 74758684df5649ccadd1e189eaff32dc: stopping tablet replica
I20260709 13:12:37.852272 29364 raft_consensus.cc:2243] T 98342133e28b47d8a388f9321d5fd796 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.852651 29364 raft_consensus.cc:2272] T 98342133e28b47d8a388f9321d5fd796 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.854415 29364 tablet_replica.cc:333] T b731fe02a6f4441e816628760bfdfb54 P 74758684df5649ccadd1e189eaff32dc: stopping tablet replica
I20260709 13:12:37.854928 29364 raft_consensus.cc:2243] T b731fe02a6f4441e816628760bfdfb54 P 74758684df5649ccadd1e189eaff32dc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.855583 29364 raft_consensus.cc:2272] T b731fe02a6f4441e816628760bfdfb54 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.857367 29364 tablet_replica.cc:333] T ff7757f22fe3408f8745bc899f3c2e4e P 74758684df5649ccadd1e189eaff32dc: stopping tablet replica
I20260709 13:12:37.857885 29364 raft_consensus.cc:2243] T ff7757f22fe3408f8745bc899f3c2e4e P 74758684df5649ccadd1e189eaff32dc [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.858599 29364 raft_consensus.cc:2272] T ff7757f22fe3408f8745bc899f3c2e4e P 74758684df5649ccadd1e189eaff32dc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.860219 29364 tablet_replica.cc:333] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc: stopping tablet replica
I20260709 13:12:37.860735 29364 raft_consensus.cc:2243] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.861495 29364 raft_consensus.cc:2272] T a16334f2dff74513ba7ca22ca8fb5afd P 74758684df5649ccadd1e189eaff32dc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.863119 29364 tablet_replica.cc:333] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc: stopping tablet replica
I20260709 13:12:37.863644 29364 raft_consensus.cc:2243] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.864068 29364 raft_consensus.cc:2272] T a8fb0d1b4ae14754aa30516d12cdea3d P 74758684df5649ccadd1e189eaff32dc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.865825 29364 tablet_replica.cc:333] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 74758684df5649ccadd1e189eaff32dc: stopping tablet replica
I20260709 13:12:37.866334 29364 raft_consensus.cc:2243] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.866714 29364 raft_consensus.cc:2272] T 9d2ef12cc13544f2960d7c1b8bef6eb7 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.868381 29364 tablet_replica.cc:333] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 74758684df5649ccadd1e189eaff32dc: stopping tablet replica
I20260709 13:12:37.868919 29364 raft_consensus.cc:2243] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.869321 29364 raft_consensus.cc:2272] T 6fc1ff9a8e0d49d7b58940ccec6c0540 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.870959 29364 tablet_replica.cc:333] T 584f5934b7fa4c7ab4b0b43923621e70 P 74758684df5649ccadd1e189eaff32dc: stopping tablet replica
I20260709 13:12:37.871464 29364 raft_consensus.cc:2243] T 584f5934b7fa4c7ab4b0b43923621e70 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.871883 29364 raft_consensus.cc:2272] T 584f5934b7fa4c7ab4b0b43923621e70 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.873510 29364 tablet_replica.cc:333] T 325a5a55a44a47ce97869216b084f89d P 74758684df5649ccadd1e189eaff32dc: stopping tablet replica
I20260709 13:12:37.874040 29364 raft_consensus.cc:2243] T 325a5a55a44a47ce97869216b084f89d P 74758684df5649ccadd1e189eaff32dc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.874713 29364 raft_consensus.cc:2272] T 325a5a55a44a47ce97869216b084f89d P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.876488 29364 tablet_replica.cc:333] T 604a93ed898f4ab9b771487bfe278b33 P 74758684df5649ccadd1e189eaff32dc: stopping tablet replica
I20260709 13:12:37.876981 29364 raft_consensus.cc:2243] T 604a93ed898f4ab9b771487bfe278b33 P 74758684df5649ccadd1e189eaff32dc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.877763 29364 raft_consensus.cc:2272] T 604a93ed898f4ab9b771487bfe278b33 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.879546 29364 tablet_replica.cc:333] T 5cd01d60553a435387e507f5d6240b58 P 74758684df5649ccadd1e189eaff32dc: stopping tablet replica
I20260709 13:12:37.880089 29364 raft_consensus.cc:2243] T 5cd01d60553a435387e507f5d6240b58 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.880467 29364 raft_consensus.cc:2272] T 5cd01d60553a435387e507f5d6240b58 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.882275 29364 tablet_replica.cc:333] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc: stopping tablet replica
I20260709 13:12:37.882784 29364 raft_consensus.cc:2243] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.883564 29364 raft_consensus.cc:2272] T aa241e695dbb492a971f537d1f977f21 P 74758684df5649ccadd1e189eaff32dc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.885461 29364 tablet_replica.cc:333] T d1119afee9d6413aa2cd229073ffbcf1 P 74758684df5649ccadd1e189eaff32dc: stopping tablet replica
I20260709 13:12:37.885995 29364 raft_consensus.cc:2243] T d1119afee9d6413aa2cd229073ffbcf1 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.886363 29364 raft_consensus.cc:2272] T d1119afee9d6413aa2cd229073ffbcf1 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.888259 29364 tablet_replica.cc:333] T f63e5465acbf4283a97304441ba41968 P 74758684df5649ccadd1e189eaff32dc: stopping tablet replica
I20260709 13:12:37.888826 29364 raft_consensus.cc:2243] T f63e5465acbf4283a97304441ba41968 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.889205 29364 raft_consensus.cc:2272] T f63e5465acbf4283a97304441ba41968 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.890880 29364 tablet_replica.cc:333] T b60a97e129dc4aa9a43f2c44ec5181a8 P 74758684df5649ccadd1e189eaff32dc: stopping tablet replica
I20260709 13:12:37.891372 29364 raft_consensus.cc:2243] T b60a97e129dc4aa9a43f2c44ec5181a8 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.891752 29364 raft_consensus.cc:2272] T b60a97e129dc4aa9a43f2c44ec5181a8 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.893656 29364 tablet_replica.cc:333] T 0dc4f903fb004dd2bce3c4934f078a5d P 74758684df5649ccadd1e189eaff32dc: stopping tablet replica
I20260709 13:12:37.894157 29364 raft_consensus.cc:2243] T 0dc4f903fb004dd2bce3c4934f078a5d P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.894536 29364 raft_consensus.cc:2272] T 0dc4f903fb004dd2bce3c4934f078a5d P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.896266 29364 tablet_replica.cc:333] T 09294b866578436a827c27702d4b1d0b P 74758684df5649ccadd1e189eaff32dc: stopping tablet replica
I20260709 13:12:37.896755 29364 raft_consensus.cc:2243] T 09294b866578436a827c27702d4b1d0b P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.897141 29364 raft_consensus.cc:2272] T 09294b866578436a827c27702d4b1d0b P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.898880 29364 tablet_replica.cc:333] T 1503964d57034b31b36eecc16f2c84a0 P 74758684df5649ccadd1e189eaff32dc: stopping tablet replica
I20260709 13:12:37.899369 29364 raft_consensus.cc:2243] T 1503964d57034b31b36eecc16f2c84a0 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.899757 29364 raft_consensus.cc:2272] T 1503964d57034b31b36eecc16f2c84a0 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.901484 29364 tablet_replica.cc:333] T 39bf585adcc94606975982efe4640189 P 74758684df5649ccadd1e189eaff32dc: stopping tablet replica
I20260709 13:12:37.901975 29364 raft_consensus.cc:2243] T 39bf585adcc94606975982efe4640189 P 74758684df5649ccadd1e189eaff32dc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.902685 29364 raft_consensus.cc:2272] T 39bf585adcc94606975982efe4640189 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.904675 29364 tablet_replica.cc:333] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 74758684df5649ccadd1e189eaff32dc: stopping tablet replica
I20260709 13:12:37.905159 29364 raft_consensus.cc:2243] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 74758684df5649ccadd1e189eaff32dc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.905864 29364 raft_consensus.cc:2272] T 04ba2c5f82234a0b8ca6cd31f26f6cfe P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.907555 29364 tablet_replica.cc:333] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 74758684df5649ccadd1e189eaff32dc: stopping tablet replica
I20260709 13:12:37.908108 29364 raft_consensus.cc:2243] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 74758684df5649ccadd1e189eaff32dc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.908838 29364 raft_consensus.cc:2272] T 6a5fe6d7057c412e8414f2a8eadf7f44 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.910704 29364 tablet_replica.cc:333] T ea0b275f64bf42cc88bbee81a24d3020 P 74758684df5649ccadd1e189eaff32dc: stopping tablet replica
I20260709 13:12:37.911223 29364 raft_consensus.cc:2243] T ea0b275f64bf42cc88bbee81a24d3020 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.911588 29364 raft_consensus.cc:2272] T ea0b275f64bf42cc88bbee81a24d3020 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.913337 29364 tablet_replica.cc:333] T d088694ef66442bdbf75cc7fc1942a83 P 74758684df5649ccadd1e189eaff32dc: stopping tablet replica
I20260709 13:12:37.913841 29364 raft_consensus.cc:2243] T d088694ef66442bdbf75cc7fc1942a83 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.914214 29364 raft_consensus.cc:2272] T d088694ef66442bdbf75cc7fc1942a83 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.915894 29364 tablet_replica.cc:333] T 1271bae393604d56b9e376c716eb2a9e P 74758684df5649ccadd1e189eaff32dc: stopping tablet replica
I20260709 13:12:37.916369 29364 raft_consensus.cc:2243] T 1271bae393604d56b9e376c716eb2a9e P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.916760 29364 raft_consensus.cc:2272] T 1271bae393604d56b9e376c716eb2a9e P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.918460 29364 tablet_replica.cc:333] T 002595643d984c1c915975d4c4ace485 P 74758684df5649ccadd1e189eaff32dc: stopping tablet replica
I20260709 13:12:37.919090 29364 raft_consensus.cc:2243] T 002595643d984c1c915975d4c4ace485 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.919552 29364 raft_consensus.cc:2272] T 002595643d984c1c915975d4c4ace485 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.921864 29364 tablet_replica.cc:333] T a4736bb71dfa4f4b8b80e8a52895acf7 P 74758684df5649ccadd1e189eaff32dc: stopping tablet replica
I20260709 13:12:37.922506 29364 raft_consensus.cc:2243] T a4736bb71dfa4f4b8b80e8a52895acf7 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.922933 29364 raft_consensus.cc:2272] T a4736bb71dfa4f4b8b80e8a52895acf7 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.924613 29364 tablet_replica.cc:333] T 69aed23cb12849fda6220c6c65580d59 P 74758684df5649ccadd1e189eaff32dc: stopping tablet replica
I20260709 13:12:37.925089 29364 raft_consensus.cc:2243] T 69aed23cb12849fda6220c6c65580d59 P 74758684df5649ccadd1e189eaff32dc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.925787 29364 raft_consensus.cc:2272] T 69aed23cb12849fda6220c6c65580d59 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.927511 29364 tablet_replica.cc:333] T f1dfa63c8b78419c9ff6ffb624a861a7 P 74758684df5649ccadd1e189eaff32dc: stopping tablet replica
I20260709 13:12:37.928056 29364 raft_consensus.cc:2243] T f1dfa63c8b78419c9ff6ffb624a861a7 P 74758684df5649ccadd1e189eaff32dc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.928757 29364 raft_consensus.cc:2272] T f1dfa63c8b78419c9ff6ffb624a861a7 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.930450 29364 tablet_replica.cc:333] T be5e478344f14439b78f1a9bf58f4451 P 74758684df5649ccadd1e189eaff32dc: stopping tablet replica
I20260709 13:12:37.931015 29364 raft_consensus.cc:2243] T be5e478344f14439b78f1a9bf58f4451 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.931443 29364 raft_consensus.cc:2272] T be5e478344f14439b78f1a9bf58f4451 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.933216 29364 tablet_replica.cc:333] T d0147a5552154f26a88833f9210b1358 P 74758684df5649ccadd1e189eaff32dc: stopping tablet replica
I20260709 13:12:37.933686 29364 raft_consensus.cc:2243] T d0147a5552154f26a88833f9210b1358 P 74758684df5649ccadd1e189eaff32dc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.934371 29364 raft_consensus.cc:2272] T d0147a5552154f26a88833f9210b1358 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.936259 29364 tablet_replica.cc:333] T 3092a6c40d0d4610968fe09d4c7d16c0 P 74758684df5649ccadd1e189eaff32dc: stopping tablet replica
I20260709 13:12:37.936721 29364 raft_consensus.cc:2243] T 3092a6c40d0d4610968fe09d4c7d16c0 P 74758684df5649ccadd1e189eaff32dc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.937469 29364 raft_consensus.cc:2272] T 3092a6c40d0d4610968fe09d4c7d16c0 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.939239 29364 tablet_replica.cc:333] T 81197f2dcf424fbaaab746d5f8bf7c8c P 74758684df5649ccadd1e189eaff32dc: stopping tablet replica
I20260709 13:12:37.939707 29364 raft_consensus.cc:2243] T 81197f2dcf424fbaaab746d5f8bf7c8c P 74758684df5649ccadd1e189eaff32dc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.940449 29364 raft_consensus.cc:2272] T 81197f2dcf424fbaaab746d5f8bf7c8c P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.942265 29364 tablet_replica.cc:333] T 5b827ee48d56478398f009c3fa980016 P 74758684df5649ccadd1e189eaff32dc: stopping tablet replica
I20260709 13:12:37.942731 29364 raft_consensus.cc:2243] T 5b827ee48d56478398f009c3fa980016 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.943090 29364 raft_consensus.cc:2272] T 5b827ee48d56478398f009c3fa980016 P 74758684df5649ccadd1e189eaff32dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.944949 29364 tablet_replica.cc:333] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc: stopping tablet replica
I20260709 13:12:37.945403 29364 raft_consensus.cc:2243] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.945801 29364 raft_consensus.cc:2272] T 9a508f846d314fa0b7ec364af09bc427 P 74758684df5649ccadd1e189eaff32dc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.947430 29364 tablet_replica.cc:333] T acbf3f88b4514948820691784cf9c189 P 74758684df5649ccadd1e189eaff32dc: stopping tablet replica
I20260709 13:12:37.947934 29364 raft_consensus.cc:2243] T acbf3f88b4514948820691784cf9c189 P 74758684df5649ccadd1e189eaff32dc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.948619 29364 raft_consensus.cc:2272] T acbf3f88b4514948820691784cf9c189 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.950423 29364 tablet_replica.cc:333] T 49047cb7a56246288b9044f8ebec130f P 74758684df5649ccadd1e189eaff32dc: stopping tablet replica
I20260709 13:12:37.950917 29364 raft_consensus.cc:2243] T 49047cb7a56246288b9044f8ebec130f P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:37.951363 29364 raft_consensus.cc:2272] T 49047cb7a56246288b9044f8ebec130f P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.953171 29364 tablet_replica.cc:333] T 93ff75cd7d2c433ca9aa8f6390884032 P 74758684df5649ccadd1e189eaff32dc: stopping tablet replica
I20260709 13:12:37.953622 29364 raft_consensus.cc:2243] T 93ff75cd7d2c433ca9aa8f6390884032 P 74758684df5649ccadd1e189eaff32dc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.954310 29364 raft_consensus.cc:2272] T 93ff75cd7d2c433ca9aa8f6390884032 P 74758684df5649ccadd1e189eaff32dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:37.957149 29364 tablet_replica.cc:333] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc: stopping tablet replica
I20260709 13:12:37.957546 29364 raft_consensus.cc:2243] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:12:37.958415 29364 pending_rounds.cc:70] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc: Trying to abort 1 pending ops.
I20260709 13:12:37.958595 29364 pending_rounds.cc:77] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc: Aborting op as it isn't in flight: id { term: 4 index: 3 } timestamp: 7305636892256296960 op_type: NO_OP noop_request { }
I20260709 13:12:37.958837 29364 raft_consensus.cc:2889] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc [term 4 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:12:37.959048 29364 raft_consensus.cc:2272] T 3501a75721d543d598af7857e368e08b P 74758684df5649ccadd1e189eaff32dc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:38.061609 29364 tablet_server.cc:196] TabletServer@127.28.173.4:0 shutdown complete.
I20260709 13:12:38.120525 29364 master.cc:562] Master@127.28.173.62:43215 shutting down...
I20260709 13:12:38.144618 29364 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a6b539c165f7423db62dde53667fcf75 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:38.145112 29364 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a6b539c165f7423db62dde53667fcf75 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:38.145385 29364 tablet_replica.cc:333] T 00000000000000000000000000000000 P a6b539c165f7423db62dde53667fcf75: stopping tablet replica
I20260709 13:12:38.167016 29364 master.cc:584] Master@127.28.173.62:43215 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (37131 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:12:38.255441 29364 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.28.173.62:39211
I20260709 13:12:38.256592 29364 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:38.262107  5677 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:38.262495  5676 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:38.262790  5679 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:38.264289 29364 server_base.cc:1061] running on GCE node
I20260709 13:12:38.265324 29364 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:38.265501 29364 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:38.265610 29364 hybrid_clock.cc:648] HybridClock initialized: now 1783602758265599 us; error 0 us; skew 500 ppm
I20260709 13:12:38.266047 29364 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:38.268366 29364 webserver.cc:533] Webserver started at http://127.28.173.62:37717/ using document root <none> and password file <none>
I20260709 13:12:38.268807 29364 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:38.268951 29364 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:38.269150 29364 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:38.270164 29364 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602443945700-29364-0/minicluster-data/master-0-root/instance:
uuid: "953c4ff5dd204fbbb88a1a5b1b2610c1"
format_stamp: "Formatted at 2026-07-09 13:12:38 on dist-test-slave-x62b"
I20260709 13:12:38.274511 29364 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 13:12:38.277617  5684 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:38.278339 29364 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:12:38.278626 29364 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602443945700-29364-0/minicluster-data/master-0-root
uuid: "953c4ff5dd204fbbb88a1a5b1b2610c1"
format_stamp: "Formatted at 2026-07-09 13:12:38 on dist-test-slave-x62b"
I20260709 13:12:38.278908 29364 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602443945700-29364-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602443945700-29364-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602443945700-29364-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:38.293983 29364 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:38.295146 29364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:38.331506 29364 rpc_server.cc:307] RPC server started. Bound to: 127.28.173.62:39211
I20260709 13:12:38.331610  5735 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.173.62:39211 every 8 connection(s)
I20260709 13:12:38.335211  5736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.345026  5736 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 953c4ff5dd204fbbb88a1a5b1b2610c1: Bootstrap starting.
I20260709 13:12:38.349526  5736 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 953c4ff5dd204fbbb88a1a5b1b2610c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.353360  5736 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 953c4ff5dd204fbbb88a1a5b1b2610c1: No bootstrap required, opened a new log
I20260709 13:12:38.355320  5736 raft_consensus.cc:359] T 00000000000000000000000000000000 P 953c4ff5dd204fbbb88a1a5b1b2610c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "953c4ff5dd204fbbb88a1a5b1b2610c1" member_type: VOTER }
I20260709 13:12:38.355674  5736 raft_consensus.cc:385] T 00000000000000000000000000000000 P 953c4ff5dd204fbbb88a1a5b1b2610c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.355866  5736 raft_consensus.cc:740] T 00000000000000000000000000000000 P 953c4ff5dd204fbbb88a1a5b1b2610c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 953c4ff5dd204fbbb88a1a5b1b2610c1, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.356416  5736 consensus_queue.cc:260] T 00000000000000000000000000000000 P 953c4ff5dd204fbbb88a1a5b1b2610c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "953c4ff5dd204fbbb88a1a5b1b2610c1" member_type: VOTER }
I20260709 13:12:38.356823  5736 raft_consensus.cc:399] T 00000000000000000000000000000000 P 953c4ff5dd204fbbb88a1a5b1b2610c1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:12:38.357014  5736 raft_consensus.cc:493] T 00000000000000000000000000000000 P 953c4ff5dd204fbbb88a1a5b1b2610c1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:12:38.357213  5736 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 953c4ff5dd204fbbb88a1a5b1b2610c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.361291  5736 raft_consensus.cc:515] T 00000000000000000000000000000000 P 953c4ff5dd204fbbb88a1a5b1b2610c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "953c4ff5dd204fbbb88a1a5b1b2610c1" member_type: VOTER }
I20260709 13:12:38.361725  5736 leader_election.cc:304] T 00000000000000000000000000000000 P 953c4ff5dd204fbbb88a1a5b1b2610c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 953c4ff5dd204fbbb88a1a5b1b2610c1; no voters: 
I20260709 13:12:38.362717  5736 leader_election.cc:290] T 00000000000000000000000000000000 P 953c4ff5dd204fbbb88a1a5b1b2610c1 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:12:38.363095  5739 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 953c4ff5dd204fbbb88a1a5b1b2610c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:38.364450  5739 raft_consensus.cc:697] T 00000000000000000000000000000000 P 953c4ff5dd204fbbb88a1a5b1b2610c1 [term 1 LEADER]: Becoming Leader. State: Replica: 953c4ff5dd204fbbb88a1a5b1b2610c1, State: Running, Role: LEADER
I20260709 13:12:38.365090  5739 consensus_queue.cc:237] T 00000000000000000000000000000000 P 953c4ff5dd204fbbb88a1a5b1b2610c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "953c4ff5dd204fbbb88a1a5b1b2610c1" member_type: VOTER }
I20260709 13:12:38.365651  5736 sys_catalog.cc:565] T 00000000000000000000000000000000 P 953c4ff5dd204fbbb88a1a5b1b2610c1 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:12:38.369313  5741 sys_catalog.cc:455] T 00000000000000000000000000000000 P 953c4ff5dd204fbbb88a1a5b1b2610c1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 953c4ff5dd204fbbb88a1a5b1b2610c1. Latest consensus state: current_term: 1 leader_uuid: "953c4ff5dd204fbbb88a1a5b1b2610c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "953c4ff5dd204fbbb88a1a5b1b2610c1" member_type: VOTER } }
I20260709 13:12:38.369906  5741 sys_catalog.cc:458] T 00000000000000000000000000000000 P 953c4ff5dd204fbbb88a1a5b1b2610c1 [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:38.370992  5740 sys_catalog.cc:455] T 00000000000000000000000000000000 P 953c4ff5dd204fbbb88a1a5b1b2610c1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "953c4ff5dd204fbbb88a1a5b1b2610c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "953c4ff5dd204fbbb88a1a5b1b2610c1" member_type: VOTER } }
I20260709 13:12:38.371738  5740 sys_catalog.cc:458] T 00000000000000000000000000000000 P 953c4ff5dd204fbbb88a1a5b1b2610c1 [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:38.371946  5746 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:12:38.379895  5746 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:12:38.380939 29364 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:12:38.388656  5746 catalog_manager.cc:1383] Generated new cluster ID: 0a5b34eebf8e4761b536ce3db90ecace
I20260709 13:12:38.388952  5746 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:12:38.410357  5746 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:12:38.411546  5746 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:12:38.432793  5746 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 953c4ff5dd204fbbb88a1a5b1b2610c1: Generated new TSK 0
I20260709 13:12:38.433328  5746 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:12:38.447300 29364 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:38.452926  5757 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:38.454550  5758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:38.458089 29364 server_base.cc:1061] running on GCE node
W20260709 13:12:38.458446  5760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:38.460008 29364 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:38.460196 29364 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:38.460325 29364 hybrid_clock.cc:648] HybridClock initialized: now 1783602758460314 us; error 0 us; skew 500 ppm
I20260709 13:12:38.460801 29364 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:38.463009 29364 webserver.cc:533] Webserver started at http://127.28.173.1:32973/ using document root <none> and password file <none>
I20260709 13:12:38.463441 29364 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:38.463590 29364 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:38.463788 29364 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:38.465018 29364 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602443945700-29364-0/minicluster-data/ts-0-root/instance:
uuid: "9e1828b5b7d244b8aa09a9b41d21fc29"
format_stamp: "Formatted at 2026-07-09 13:12:38 on dist-test-slave-x62b"
I20260709 13:12:38.469458 29364 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:12:38.472676  5765 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:38.473412 29364 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:12:38.473708 29364 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602443945700-29364-0/minicluster-data/ts-0-root
uuid: "9e1828b5b7d244b8aa09a9b41d21fc29"
format_stamp: "Formatted at 2026-07-09 13:12:38 on dist-test-slave-x62b"
I20260709 13:12:38.473974 29364 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602443945700-29364-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602443945700-29364-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602443945700-29364-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:38.501312 29364 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:38.502529 29364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:38.504161 29364 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:38.506345 29364 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:38.506559 29364 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:38.506784 29364 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:38.506956 29364 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:38.546429 29364 rpc_server.cc:307] RPC server started. Bound to: 127.28.173.1:44151
I20260709 13:12:38.546547  5827 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.173.1:44151 every 8 connection(s)
I20260709 13:12:38.551606 29364 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:38.557978  5832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:38.559084  5833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:38.561945  5835 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:38.562772 29364 server_base.cc:1061] running on GCE node
I20260709 13:12:38.564363 29364 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:38.564611 29364 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:38.564826 29364 hybrid_clock.cc:648] HybridClock initialized: now 1783602758564808 us; error 0 us; skew 500 ppm
I20260709 13:12:38.565532 29364 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:38.565871  5828 heartbeater.cc:344] Connected to a master server at 127.28.173.62:39211
I20260709 13:12:38.566294  5828 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:38.567286  5828 heartbeater.cc:507] Master 127.28.173.62:39211 requested a full tablet report, sending...
I20260709 13:12:38.568276 29364 webserver.cc:533] Webserver started at http://127.28.173.2:44879/ using document root <none> and password file <none>
I20260709 13:12:38.568845 29364 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:38.569039 29364 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:38.569335 29364 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:38.569645  5701 ts_manager.cc:194] Registered new tserver with Master: 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151)
I20260709 13:12:38.570756 29364 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602443945700-29364-0/minicluster-data/ts-1-root/instance:
uuid: "16cf2b6947b24cebb090e03e8dfeba02"
format_stamp: "Formatted at 2026-07-09 13:12:38 on dist-test-slave-x62b"
I20260709 13:12:38.572134  5701 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51774
I20260709 13:12:38.576144 29364 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.003s
I20260709 13:12:38.579561  5840 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:38.580459 29364 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:12:38.580763 29364 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602443945700-29364-0/minicluster-data/ts-1-root
uuid: "16cf2b6947b24cebb090e03e8dfeba02"
format_stamp: "Formatted at 2026-07-09 13:12:38 on dist-test-slave-x62b"
I20260709 13:12:38.581020 29364 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602443945700-29364-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602443945700-29364-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602443945700-29364-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:38.599413 29364 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:38.600569 29364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:38.601903 29364 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:38.604070 29364 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:38.604238 29364 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:38.604511 29364 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:38.604669 29364 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:38.643388 29364 rpc_server.cc:307] RPC server started. Bound to: 127.28.173.2:43579
I20260709 13:12:38.643563  5902 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.173.2:43579 every 8 connection(s)
I20260709 13:12:38.648332 29364 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:38.654686  5906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:38.657126  5907 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:38.658746 29364 server_base.cc:1061] running on GCE node
W20260709 13:12:38.658814  5909 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:38.660130 29364 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:38.660416 29364 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:38.660643 29364 hybrid_clock.cc:648] HybridClock initialized: now 1783602758660623 us; error 0 us; skew 500 ppm
I20260709 13:12:38.661201 29364 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:38.661198  5903 heartbeater.cc:344] Connected to a master server at 127.28.173.62:39211
I20260709 13:12:38.661931  5903 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:38.662905  5903 heartbeater.cc:507] Master 127.28.173.62:39211 requested a full tablet report, sending...
I20260709 13:12:38.664136 29364 webserver.cc:533] Webserver started at http://127.28.173.3:37771/ using document root <none> and password file <none>
I20260709 13:12:38.664711 29364 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:38.664917 29364 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:38.664991  5701 ts_manager.cc:194] Registered new tserver with Master: 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2:43579)
I20260709 13:12:38.665192 29364 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:38.666301  5701 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51782
I20260709 13:12:38.666430 29364 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602443945700-29364-0/minicluster-data/ts-2-root/instance:
uuid: "2e314036804542f7ab3e6550a903dceb"
format_stamp: "Formatted at 2026-07-09 13:12:38 on dist-test-slave-x62b"
I20260709 13:12:38.671200 29364 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.003s
I20260709 13:12:38.674998  5914 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:38.675799 29364 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:12:38.676115 29364 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602443945700-29364-0/minicluster-data/ts-2-root
uuid: "2e314036804542f7ab3e6550a903dceb"
format_stamp: "Formatted at 2026-07-09 13:12:38 on dist-test-slave-x62b"
I20260709 13:12:38.676355 29364 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602443945700-29364-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602443945700-29364-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602443945700-29364-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:38.707875 29364 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:38.708976 29364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:38.710331 29364 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:38.712468 29364 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:38.712679 29364 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:38.712908 29364 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:38.713073 29364 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:38.751718 29364 rpc_server.cc:307] RPC server started. Bound to: 127.28.173.3:32927
I20260709 13:12:38.751866  5976 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.173.3:32927 every 8 connection(s)
I20260709 13:12:38.764979  5977 heartbeater.cc:344] Connected to a master server at 127.28.173.62:39211
I20260709 13:12:38.765347  5977 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:38.766038  5977 heartbeater.cc:507] Master 127.28.173.62:39211 requested a full tablet report, sending...
I20260709 13:12:38.768121  5701 ts_manager.cc:194] Registered new tserver with Master: 2e314036804542f7ab3e6550a903dceb (127.28.173.3:32927)
I20260709 13:12:38.768267 29364 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013447437s
I20260709 13:12:38.769526  5701 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39282
I20260709 13:12:38.795385  5701 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39294:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:12:38.798472  5701 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:12:38.875311  5868 tablet_service.cc:1511] Processing CreateTablet for tablet 655c8f612f7c4806a849c5bf7fe918fe (DEFAULT_TABLE table=test-workload [id=8f784a04fa6c4c08b58d9733a0fd1f3f]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:12:38.875871  5867 tablet_service.cc:1511] Processing CreateTablet for tablet 5b2bd404001649699134812445fa01f7 (DEFAULT_TABLE table=test-workload [id=8f784a04fa6c4c08b58d9733a0fd1f3f]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:12:38.876895  5868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 655c8f612f7c4806a849c5bf7fe918fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.877530  5867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b2bd404001649699134812445fa01f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.880342  5793 tablet_service.cc:1511] Processing CreateTablet for tablet 655c8f612f7c4806a849c5bf7fe918fe (DEFAULT_TABLE table=test-workload [id=8f784a04fa6c4c08b58d9733a0fd1f3f]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:12:38.881868  5793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 655c8f612f7c4806a849c5bf7fe918fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.889365  5792 tablet_service.cc:1511] Processing CreateTablet for tablet 5b2bd404001649699134812445fa01f7 (DEFAULT_TABLE table=test-workload [id=8f784a04fa6c4c08b58d9733a0fd1f3f]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:12:38.890763  5792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b2bd404001649699134812445fa01f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.897565  5791 tablet_service.cc:1511] Processing CreateTablet for tablet 31ba0196ac9648b38f2f1a7eb8513dd5 (DEFAULT_TABLE table=test-workload [id=8f784a04fa6c4c08b58d9733a0fd1f3f]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:12:38.899091  5791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31ba0196ac9648b38f2f1a7eb8513dd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.909847  5790 tablet_service.cc:1511] Processing CreateTablet for tablet e087d3db165b428d9581b8782836ed0f (DEFAULT_TABLE table=test-workload [id=8f784a04fa6c4c08b58d9733a0fd1f3f]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:12:38.911324  5790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e087d3db165b428d9581b8782836ed0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.914261  5866 tablet_service.cc:1511] Processing CreateTablet for tablet 31ba0196ac9648b38f2f1a7eb8513dd5 (DEFAULT_TABLE table=test-workload [id=8f784a04fa6c4c08b58d9733a0fd1f3f]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:12:38.915661  5866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31ba0196ac9648b38f2f1a7eb8513dd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.918090  5865 tablet_service.cc:1511] Processing CreateTablet for tablet e087d3db165b428d9581b8782836ed0f (DEFAULT_TABLE table=test-workload [id=8f784a04fa6c4c08b58d9733a0fd1f3f]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:12:38.919404  5865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e087d3db165b428d9581b8782836ed0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.919045  5868 tablet_service.cc:1511] Processing CreateTablet for tablet 78f018edbabe49bc9ceafe6faf384bf0 (DEFAULT_TABLE table=test-workload [id=8f784a04fa6c4c08b58d9733a0fd1f3f]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:12:38.921729  5864 tablet_service.cc:1511] Processing CreateTablet for tablet 1136e55740054ca2a51e4b28d073087f (DEFAULT_TABLE table=test-workload [id=8f784a04fa6c4c08b58d9733a0fd1f3f]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:12:38.923797  5861 tablet_service.cc:1511] Processing CreateTablet for tablet 22576e8937fb4cd2bbff5a4dd7030308 (DEFAULT_TABLE table=test-workload [id=8f784a04fa6c4c08b58d9733a0fd1f3f]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:12:38.925627  5860 tablet_service.cc:1511] Processing CreateTablet for tablet cfdc7563ffb04da99d981061fdfd0507 (DEFAULT_TABLE table=test-workload [id=8f784a04fa6c4c08b58d9733a0fd1f3f]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:12:38.925690  5789 tablet_service.cc:1511] Processing CreateTablet for tablet 1136e55740054ca2a51e4b28d073087f (DEFAULT_TABLE table=test-workload [id=8f784a04fa6c4c08b58d9733a0fd1f3f]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:12:38.927156  5789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1136e55740054ca2a51e4b28d073087f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.927583  5942 tablet_service.cc:1511] Processing CreateTablet for tablet 655c8f612f7c4806a849c5bf7fe918fe (DEFAULT_TABLE table=test-workload [id=8f784a04fa6c4c08b58d9733a0fd1f3f]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:12:38.928897  5992 tablet_bootstrap.cc:492] T 5b2bd404001649699134812445fa01f7 P 16cf2b6947b24cebb090e03e8dfeba02: Bootstrap starting.
I20260709 13:12:38.929340  5935 tablet_service.cc:1511] Processing CreateTablet for tablet f0c6edfa14e84779a8dc712956946605 (DEFAULT_TABLE table=test-workload [id=8f784a04fa6c4c08b58d9733a0fd1f3f]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:12:38.930495  5941 tablet_service.cc:1511] Processing CreateTablet for tablet 5b2bd404001649699134812445fa01f7 (DEFAULT_TABLE table=test-workload [id=8f784a04fa6c4c08b58d9733a0fd1f3f]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:12:38.932294  5934 tablet_service.cc:1511] Processing CreateTablet for tablet 22576e8937fb4cd2bbff5a4dd7030308 (DEFAULT_TABLE table=test-workload [id=8f784a04fa6c4c08b58d9733a0fd1f3f]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:12:38.932997  5939 tablet_service.cc:1511] Processing CreateTablet for tablet e087d3db165b428d9581b8782836ed0f (DEFAULT_TABLE table=test-workload [id=8f784a04fa6c4c08b58d9733a0fd1f3f]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:12:38.935452  5992 tablet_bootstrap.cc:654] T 5b2bd404001649699134812445fa01f7 P 16cf2b6947b24cebb090e03e8dfeba02: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.935228  5933 tablet_service.cc:1511] Processing CreateTablet for tablet cfdc7563ffb04da99d981061fdfd0507 (DEFAULT_TABLE table=test-workload [id=8f784a04fa6c4c08b58d9733a0fd1f3f]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:12:38.936359  5937 tablet_service.cc:1511] Processing CreateTablet for tablet 3e25e11d63324b2a8fb52c85459d4c03 (DEFAULT_TABLE table=test-workload [id=8f784a04fa6c4c08b58d9733a0fd1f3f]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:12:38.938444  5863 tablet_service.cc:1511] Processing CreateTablet for tablet 3e25e11d63324b2a8fb52c85459d4c03 (DEFAULT_TABLE table=test-workload [id=8f784a04fa6c4c08b58d9733a0fd1f3f]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:12:38.940416  5862 tablet_service.cc:1511] Processing CreateTablet for tablet f0c6edfa14e84779a8dc712956946605 (DEFAULT_TABLE table=test-workload [id=8f784a04fa6c4c08b58d9733a0fd1f3f]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:12:38.940855  5940 tablet_service.cc:1511] Processing CreateTablet for tablet 31ba0196ac9648b38f2f1a7eb8513dd5 (DEFAULT_TABLE table=test-workload [id=8f784a04fa6c4c08b58d9733a0fd1f3f]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:12:38.942302  5993 tablet_bootstrap.cc:492] T 5b2bd404001649699134812445fa01f7 P 9e1828b5b7d244b8aa09a9b41d21fc29: Bootstrap starting.
I20260709 13:12:38.941936  5788 tablet_service.cc:1511] Processing CreateTablet for tablet 3e25e11d63324b2a8fb52c85459d4c03 (DEFAULT_TABLE table=test-workload [id=8f784a04fa6c4c08b58d9733a0fd1f3f]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:12:38.927615  5936 tablet_service.cc:1511] Processing CreateTablet for tablet 78f018edbabe49bc9ceafe6faf384bf0 (DEFAULT_TABLE table=test-workload [id=8f784a04fa6c4c08b58d9733a0fd1f3f]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:12:38.943328  5788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e25e11d63324b2a8fb52c85459d4c03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.935108  5938 tablet_service.cc:1511] Processing CreateTablet for tablet 1136e55740054ca2a51e4b28d073087f (DEFAULT_TABLE table=test-workload [id=8f784a04fa6c4c08b58d9733a0fd1f3f]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:12:38.946965  5787 tablet_service.cc:1511] Processing CreateTablet for tablet f0c6edfa14e84779a8dc712956946605 (DEFAULT_TABLE table=test-workload [id=8f784a04fa6c4c08b58d9733a0fd1f3f]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:12:38.947672  5786 tablet_service.cc:1511] Processing CreateTablet for tablet 22576e8937fb4cd2bbff5a4dd7030308 (DEFAULT_TABLE table=test-workload [id=8f784a04fa6c4c08b58d9733a0fd1f3f]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:12:38.948336  5787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0c6edfa14e84779a8dc712956946605. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.948832  5993 tablet_bootstrap.cc:654] T 5b2bd404001649699134812445fa01f7 P 9e1828b5b7d244b8aa09a9b41d21fc29: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.949014  5786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22576e8937fb4cd2bbff5a4dd7030308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.928966  5942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 655c8f612f7c4806a849c5bf7fe918fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.952350  5933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfdc7563ffb04da99d981061fdfd0507. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.956187  5936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78f018edbabe49bc9ceafe6faf384bf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.957737  5785 tablet_service.cc:1511] Processing CreateTablet for tablet cfdc7563ffb04da99d981061fdfd0507 (DEFAULT_TABLE table=test-workload [id=8f784a04fa6c4c08b58d9733a0fd1f3f]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:12:38.959010  5785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfdc7563ffb04da99d981061fdfd0507. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.960220  5938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1136e55740054ca2a51e4b28d073087f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.964193  5940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31ba0196ac9648b38f2f1a7eb8513dd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.969434  5937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e25e11d63324b2a8fb52c85459d4c03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.972226  5935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0c6edfa14e84779a8dc712956946605. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.973515  5792 tablet_service.cc:1511] Processing CreateTablet for tablet 78f018edbabe49bc9ceafe6faf384bf0 (DEFAULT_TABLE table=test-workload [id=8f784a04fa6c4c08b58d9733a0fd1f3f]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:12:38.976240  5941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b2bd404001649699134812445fa01f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.979990  5792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78f018edbabe49bc9ceafe6faf384bf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.980660  5939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e087d3db165b428d9581b8782836ed0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.981029  5861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22576e8937fb4cd2bbff5a4dd7030308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.984375  5864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1136e55740054ca2a51e4b28d073087f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.984925  5934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22576e8937fb4cd2bbff5a4dd7030308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.988463  5860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfdc7563ffb04da99d981061fdfd0507. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.992376  5863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e25e11d63324b2a8fb52c85459d4c03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:38.996407  5862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0c6edfa14e84779a8dc712956946605. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:39.007571  5995 tablet_bootstrap.cc:492] T e087d3db165b428d9581b8782836ed0f P 2e314036804542f7ab3e6550a903dceb: Bootstrap starting.
I20260709 13:12:39.014956  5995 tablet_bootstrap.cc:654] T e087d3db165b428d9581b8782836ed0f P 2e314036804542f7ab3e6550a903dceb: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.020395  5868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78f018edbabe49bc9ceafe6faf384bf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:39.037868  5992 tablet_bootstrap.cc:492] T 5b2bd404001649699134812445fa01f7 P 16cf2b6947b24cebb090e03e8dfeba02: No bootstrap required, opened a new log
I20260709 13:12:39.038491  5992 ts_tablet_manager.cc:1403] T 5b2bd404001649699134812445fa01f7 P 16cf2b6947b24cebb090e03e8dfeba02: Time spent bootstrapping tablet: real 0.110s	user 0.012s	sys 0.000s
I20260709 13:12:39.041471  5992 raft_consensus.cc:359] T 5b2bd404001649699134812445fa01f7 P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.042240  5992 raft_consensus.cc:385] T 5b2bd404001649699134812445fa01f7 P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.042577  5992 raft_consensus.cc:740] T 5b2bd404001649699134812445fa01f7 P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16cf2b6947b24cebb090e03e8dfeba02, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.043984  5992 consensus_queue.cc:260] T 5b2bd404001649699134812445fa01f7 P 16cf2b6947b24cebb090e03e8dfeba02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.048337  5903 heartbeater.cc:499] Master 127.28.173.62:39211 was elected leader, sending a full tablet report...
I20260709 13:12:39.053122  5992 ts_tablet_manager.cc:1434] T 5b2bd404001649699134812445fa01f7 P 16cf2b6947b24cebb090e03e8dfeba02: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:12:39.060161  5992 tablet_bootstrap.cc:492] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02: Bootstrap starting.
I20260709 13:12:39.081434  5992 tablet_bootstrap.cc:654] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.085682  5993 tablet_bootstrap.cc:492] T 5b2bd404001649699134812445fa01f7 P 9e1828b5b7d244b8aa09a9b41d21fc29: No bootstrap required, opened a new log
I20260709 13:12:39.086295  5993 ts_tablet_manager.cc:1403] T 5b2bd404001649699134812445fa01f7 P 9e1828b5b7d244b8aa09a9b41d21fc29: Time spent bootstrapping tablet: real 0.144s	user 0.003s	sys 0.010s
I20260709 13:12:39.090415  5993 raft_consensus.cc:359] T 5b2bd404001649699134812445fa01f7 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.091241  5995 tablet_bootstrap.cc:492] T e087d3db165b428d9581b8782836ed0f P 2e314036804542f7ab3e6550a903dceb: No bootstrap required, opened a new log
I20260709 13:12:39.091847  5995 ts_tablet_manager.cc:1403] T e087d3db165b428d9581b8782836ed0f P 2e314036804542f7ab3e6550a903dceb: Time spent bootstrapping tablet: real 0.085s	user 0.021s	sys 0.007s
I20260709 13:12:39.094812  5995 raft_consensus.cc:359] T e087d3db165b428d9581b8782836ed0f P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.095503  5995 raft_consensus.cc:385] T e087d3db165b428d9581b8782836ed0f P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.095779  5995 raft_consensus.cc:740] T e087d3db165b428d9581b8782836ed0f P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e314036804542f7ab3e6550a903dceb, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.091326  5993 raft_consensus.cc:385] T 5b2bd404001649699134812445fa01f7 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.096259  5993 raft_consensus.cc:740] T 5b2bd404001649699134812445fa01f7 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e1828b5b7d244b8aa09a9b41d21fc29, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.096724  5995 consensus_queue.cc:260] T e087d3db165b428d9581b8782836ed0f P 2e314036804542f7ab3e6550a903dceb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.097136  5993 consensus_queue.cc:260] T 5b2bd404001649699134812445fa01f7 P 9e1828b5b7d244b8aa09a9b41d21fc29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.102471  5977 heartbeater.cc:499] Master 127.28.173.62:39211 was elected leader, sending a full tablet report...
I20260709 13:12:39.103195  5995 ts_tablet_manager.cc:1434] T e087d3db165b428d9581b8782836ed0f P 2e314036804542f7ab3e6550a903dceb: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.004s
I20260709 13:12:39.104482  5995 tablet_bootstrap.cc:492] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb: Bootstrap starting.
I20260709 13:12:39.111694  5995 tablet_bootstrap.cc:654] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.113317  6002 raft_consensus.cc:493] T 5b2bd404001649699134812445fa01f7 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.113845  6002 raft_consensus.cc:515] T 5b2bd404001649699134812445fa01f7 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.117343  5993 ts_tablet_manager.cc:1434] T 5b2bd404001649699134812445fa01f7 P 9e1828b5b7d244b8aa09a9b41d21fc29: Time spent starting tablet: real 0.031s	user 0.002s	sys 0.010s
I20260709 13:12:39.120131  5828 heartbeater.cc:499] Master 127.28.173.62:39211 was elected leader, sending a full tablet report...
I20260709 13:12:39.137346  5993 tablet_bootstrap.cc:492] T f0c6edfa14e84779a8dc712956946605 P 9e1828b5b7d244b8aa09a9b41d21fc29: Bootstrap starting.
I20260709 13:12:39.138204  5992 tablet_bootstrap.cc:492] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02: No bootstrap required, opened a new log
I20260709 13:12:39.138808  5992 ts_tablet_manager.cc:1403] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02: Time spent bootstrapping tablet: real 0.079s	user 0.020s	sys 0.045s
I20260709 13:12:39.141842  5992 raft_consensus.cc:359] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.142633  5992 raft_consensus.cc:385] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.142998  5992 raft_consensus.cc:740] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16cf2b6947b24cebb090e03e8dfeba02, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.145001  6002 leader_election.cc:290] T 5b2bd404001649699134812445fa01f7 P 9e1828b5b7d244b8aa09a9b41d21fc29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2:43579), 2e314036804542f7ab3e6550a903dceb (127.28.173.3:32927)
W20260709 13:12:39.147506  5904 tablet.cc:2406] T 5b2bd404001649699134812445fa01f7 P 16cf2b6947b24cebb090e03e8dfeba02: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:12:39.148675  5995 tablet_bootstrap.cc:492] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb: No bootstrap required, opened a new log
I20260709 13:12:39.149346  5995 ts_tablet_manager.cc:1403] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb: Time spent bootstrapping tablet: real 0.045s	user 0.027s	sys 0.016s
I20260709 13:12:39.150507  5993 tablet_bootstrap.cc:654] T f0c6edfa14e84779a8dc712956946605 P 9e1828b5b7d244b8aa09a9b41d21fc29: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.143927  5992 consensus_queue.cc:260] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.152856  5992 ts_tablet_manager.cc:1434] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:12:39.152639  5995 raft_consensus.cc:359] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.153455  5995 raft_consensus.cc:385] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.153841  5995 raft_consensus.cc:740] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e314036804542f7ab3e6550a903dceb, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.154795  5995 consensus_queue.cc:260] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.156461  5992 tablet_bootstrap.cc:492] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 16cf2b6947b24cebb090e03e8dfeba02: Bootstrap starting.
I20260709 13:12:39.157437  5995 ts_tablet_manager.cc:1434] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:39.158439  5995 tablet_bootstrap.cc:492] T cfdc7563ffb04da99d981061fdfd0507 P 2e314036804542f7ab3e6550a903dceb: Bootstrap starting.
I20260709 13:12:39.168800  5992 tablet_bootstrap.cc:654] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 16cf2b6947b24cebb090e03e8dfeba02: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.172163  5995 tablet_bootstrap.cc:654] T cfdc7563ffb04da99d981061fdfd0507 P 2e314036804542f7ab3e6550a903dceb: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.182493  5993 tablet_bootstrap.cc:492] T f0c6edfa14e84779a8dc712956946605 P 9e1828b5b7d244b8aa09a9b41d21fc29: No bootstrap required, opened a new log
I20260709 13:12:39.183041  5993 ts_tablet_manager.cc:1403] T f0c6edfa14e84779a8dc712956946605 P 9e1828b5b7d244b8aa09a9b41d21fc29: Time spent bootstrapping tablet: real 0.046s	user 0.012s	sys 0.000s
I20260709 13:12:39.184742  5992 tablet_bootstrap.cc:492] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 16cf2b6947b24cebb090e03e8dfeba02: No bootstrap required, opened a new log
I20260709 13:12:39.185284  5992 ts_tablet_manager.cc:1403] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 16cf2b6947b24cebb090e03e8dfeba02: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.010s
I20260709 13:12:39.185894  5995 tablet_bootstrap.cc:492] T cfdc7563ffb04da99d981061fdfd0507 P 2e314036804542f7ab3e6550a903dceb: No bootstrap required, opened a new log
I20260709 13:12:39.185804  5993 raft_consensus.cc:359] T f0c6edfa14e84779a8dc712956946605 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.186445  5995 ts_tablet_manager.cc:1403] T cfdc7563ffb04da99d981061fdfd0507 P 2e314036804542f7ab3e6550a903dceb: Time spent bootstrapping tablet: real 0.028s	user 0.006s	sys 0.005s
I20260709 13:12:39.186513  5993 raft_consensus.cc:385] T f0c6edfa14e84779a8dc712956946605 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.186928  5993 raft_consensus.cc:740] T f0c6edfa14e84779a8dc712956946605 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e1828b5b7d244b8aa09a9b41d21fc29, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.187597  5993 consensus_queue.cc:260] T f0c6edfa14e84779a8dc712956946605 P 9e1828b5b7d244b8aa09a9b41d21fc29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.188197  5992 raft_consensus.cc:359] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.188926  5992 raft_consensus.cc:385] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.189208  5992 raft_consensus.cc:740] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16cf2b6947b24cebb090e03e8dfeba02, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.189558  5993 ts_tablet_manager.cc:1434] T f0c6edfa14e84779a8dc712956946605 P 9e1828b5b7d244b8aa09a9b41d21fc29: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:12:39.189459  5995 raft_consensus.cc:359] T cfdc7563ffb04da99d981061fdfd0507 P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.190022  5992 consensus_queue.cc:260] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 16cf2b6947b24cebb090e03e8dfeba02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.190755  6000 raft_consensus.cc:493] T e087d3db165b428d9581b8782836ed0f P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.190230  5995 raft_consensus.cc:385] T cfdc7563ffb04da99d981061fdfd0507 P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.191233  6000 raft_consensus.cc:515] T e087d3db165b428d9581b8782836ed0f P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.191838  5995 raft_consensus.cc:740] T cfdc7563ffb04da99d981061fdfd0507 P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e314036804542f7ab3e6550a903dceb, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.192726  5995 consensus_queue.cc:260] T cfdc7563ffb04da99d981061fdfd0507 P 2e314036804542f7ab3e6550a903dceb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.201354  5992 ts_tablet_manager.cc:1434] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 16cf2b6947b24cebb090e03e8dfeba02: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:12:39.203305  6000 leader_election.cc:290] T e087d3db165b428d9581b8782836ed0f P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151), 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2:43579)
I20260709 13:12:39.203480  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2bd404001649699134812445fa01f7" candidate_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e314036804542f7ab3e6550a903dceb" is_pre_election: true
W20260709 13:12:39.205209  5768 leader_election.cc:343] T 5b2bd404001649699134812445fa01f7 P 9e1828b5b7d244b8aa09a9b41d21fc29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e314036804542f7ab3e6550a903dceb (127.28.173.3:32927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.205852  5992 tablet_bootstrap.cc:492] T e087d3db165b428d9581b8782836ed0f P 16cf2b6947b24cebb090e03e8dfeba02: Bootstrap starting.
I20260709 13:12:39.214582  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2bd404001649699134812445fa01f7" candidate_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16cf2b6947b24cebb090e03e8dfeba02" is_pre_election: true
I20260709 13:12:39.215421  5878 raft_consensus.cc:2468] T 5b2bd404001649699134812445fa01f7 P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e1828b5b7d244b8aa09a9b41d21fc29 in term 0.
I20260709 13:12:39.217020  5768 leader_election.cc:304] T 5b2bd404001649699134812445fa01f7 P 9e1828b5b7d244b8aa09a9b41d21fc29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16cf2b6947b24cebb090e03e8dfeba02, 9e1828b5b7d244b8aa09a9b41d21fc29; no voters: 2e314036804542f7ab3e6550a903dceb
I20260709 13:12:39.218920  5993 tablet_bootstrap.cc:492] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29: Bootstrap starting.
I20260709 13:12:39.219050  6002 raft_consensus.cc:2804] T 5b2bd404001649699134812445fa01f7 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:39.219440  6002 raft_consensus.cc:493] T 5b2bd404001649699134812445fa01f7 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.219756  6002 raft_consensus.cc:3060] T 5b2bd404001649699134812445fa01f7 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.222710  5992 tablet_bootstrap.cc:654] T e087d3db165b428d9581b8782836ed0f P 16cf2b6947b24cebb090e03e8dfeba02: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.225675  5993 tablet_bootstrap.cc:654] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.234702  6002 raft_consensus.cc:515] T 5b2bd404001649699134812445fa01f7 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.240549  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2bd404001649699134812445fa01f7" candidate_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16cf2b6947b24cebb090e03e8dfeba02"
I20260709 13:12:39.241307  5878 raft_consensus.cc:3060] T 5b2bd404001649699134812445fa01f7 P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.247035  5803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e087d3db165b428d9581b8782836ed0f" candidate_uuid: "2e314036804542f7ab3e6550a903dceb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" is_pre_election: true
W20260709 13:12:39.248976  5916 leader_election.cc:343] T e087d3db165b428d9581b8782836ed0f P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.257863  5878 raft_consensus.cc:2468] T 5b2bd404001649699134812445fa01f7 P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e1828b5b7d244b8aa09a9b41d21fc29 in term 1.
I20260709 13:12:39.260926  5995 ts_tablet_manager.cc:1434] T cfdc7563ffb04da99d981061fdfd0507 P 2e314036804542f7ab3e6550a903dceb: Time spent starting tablet: real 0.074s	user 0.039s	sys 0.031s
I20260709 13:12:39.261484  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2bd404001649699134812445fa01f7" candidate_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e314036804542f7ab3e6550a903dceb"
I20260709 13:12:39.265055  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e087d3db165b428d9581b8782836ed0f" candidate_uuid: "2e314036804542f7ab3e6550a903dceb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16cf2b6947b24cebb090e03e8dfeba02" is_pre_election: true
W20260709 13:12:39.266390  5768 leader_election.cc:343] T 5b2bd404001649699134812445fa01f7 P 9e1828b5b7d244b8aa09a9b41d21fc29 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e314036804542f7ab3e6550a903dceb (127.28.173.3:32927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.267238  5768 leader_election.cc:304] T 5b2bd404001649699134812445fa01f7 P 9e1828b5b7d244b8aa09a9b41d21fc29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16cf2b6947b24cebb090e03e8dfeba02, 9e1828b5b7d244b8aa09a9b41d21fc29; no voters: 2e314036804542f7ab3e6550a903dceb
I20260709 13:12:39.266462  5995 tablet_bootstrap.cc:492] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb: Bootstrap starting.
W20260709 13:12:39.267830  5917 leader_election.cc:343] T e087d3db165b428d9581b8782836ed0f P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2:43579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.268282  6001 raft_consensus.cc:2804] T 5b2bd404001649699134812445fa01f7 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:39.268497  5917 leader_election.cc:304] T e087d3db165b428d9581b8782836ed0f P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e314036804542f7ab3e6550a903dceb; no voters: 16cf2b6947b24cebb090e03e8dfeba02, 9e1828b5b7d244b8aa09a9b41d21fc29
I20260709 13:12:39.270332  6009 raft_consensus.cc:2749] T e087d3db165b428d9581b8782836ed0f P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:39.262169  6002 leader_election.cc:290] T 5b2bd404001649699134812445fa01f7 P 9e1828b5b7d244b8aa09a9b41d21fc29 [CANDIDATE]: Term 1 election: Requested vote from peers 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2:43579), 2e314036804542f7ab3e6550a903dceb (127.28.173.3:32927)
I20260709 13:12:39.274462  5995 tablet_bootstrap.cc:654] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.274559  6001 raft_consensus.cc:697] T 5b2bd404001649699134812445fa01f7 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 LEADER]: Becoming Leader. State: Replica: 9e1828b5b7d244b8aa09a9b41d21fc29, State: Running, Role: LEADER
I20260709 13:12:39.275594  6001 consensus_queue.cc:237] T 5b2bd404001649699134812445fa01f7 P 9e1828b5b7d244b8aa09a9b41d21fc29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.276177  5992 tablet_bootstrap.cc:492] T e087d3db165b428d9581b8782836ed0f P 16cf2b6947b24cebb090e03e8dfeba02: No bootstrap required, opened a new log
I20260709 13:12:39.276832  5992 ts_tablet_manager.cc:1403] T e087d3db165b428d9581b8782836ed0f P 16cf2b6947b24cebb090e03e8dfeba02: Time spent bootstrapping tablet: real 0.071s	user 0.016s	sys 0.035s
I20260709 13:12:39.276918  5993 tablet_bootstrap.cc:492] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29: No bootstrap required, opened a new log
I20260709 13:12:39.277529  5993 ts_tablet_manager.cc:1403] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29: Time spent bootstrapping tablet: real 0.087s	user 0.010s	sys 0.037s
I20260709 13:12:39.280319  5992 raft_consensus.cc:359] T e087d3db165b428d9581b8782836ed0f P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.280535  5993 raft_consensus.cc:359] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.281201  5992 raft_consensus.cc:385] T e087d3db165b428d9581b8782836ed0f P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.281251  5993 raft_consensus.cc:385] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.281661  5992 raft_consensus.cc:740] T e087d3db165b428d9581b8782836ed0f P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16cf2b6947b24cebb090e03e8dfeba02, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.281749  5993 raft_consensus.cc:740] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e1828b5b7d244b8aa09a9b41d21fc29, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.282783  5993 consensus_queue.cc:260] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.282886  5992 consensus_queue.cc:260] T e087d3db165b428d9581b8782836ed0f P 16cf2b6947b24cebb090e03e8dfeba02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.285517  5993 ts_tablet_manager.cc:1434] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:12:39.286556  5993 tablet_bootstrap.cc:492] T 22576e8937fb4cd2bbff5a4dd7030308 P 9e1828b5b7d244b8aa09a9b41d21fc29: Bootstrap starting.
I20260709 13:12:39.288378  5992 ts_tablet_manager.cc:1434] T e087d3db165b428d9581b8782836ed0f P 16cf2b6947b24cebb090e03e8dfeba02: Time spent starting tablet: real 0.011s	user 0.001s	sys 0.006s
I20260709 13:12:39.289645  5992 tablet_bootstrap.cc:492] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02: Bootstrap starting.
I20260709 13:12:39.294144  5993 tablet_bootstrap.cc:654] T 22576e8937fb4cd2bbff5a4dd7030308 P 9e1828b5b7d244b8aa09a9b41d21fc29: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.294351  5995 tablet_bootstrap.cc:492] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb: No bootstrap required, opened a new log
I20260709 13:12:39.294890  5995 ts_tablet_manager.cc:1403] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb: Time spent bootstrapping tablet: real 0.029s	user 0.007s	sys 0.017s
I20260709 13:12:39.296213  5992 tablet_bootstrap.cc:654] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.296792  5998 raft_consensus.cc:493] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.297508  5998 raft_consensus.cc:515] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.297906  5995 raft_consensus.cc:359] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.298650  5995 raft_consensus.cc:385] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.298962  5995 raft_consensus.cc:740] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e314036804542f7ab3e6550a903dceb, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.299780  5995 consensus_queue.cc:260] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.302225  5998 leader_election.cc:290] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151), 2e314036804542f7ab3e6550a903dceb (127.28.173.3:32927)
I20260709 13:12:39.305332  5995 ts_tablet_manager.cc:1434] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:12:39.306353  5995 tablet_bootstrap.cc:492] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 2e314036804542f7ab3e6550a903dceb: Bootstrap starting.
I20260709 13:12:39.307592  5993 tablet_bootstrap.cc:492] T 22576e8937fb4cd2bbff5a4dd7030308 P 9e1828b5b7d244b8aa09a9b41d21fc29: No bootstrap required, opened a new log
I20260709 13:12:39.308197  5993 ts_tablet_manager.cc:1403] T 22576e8937fb4cd2bbff5a4dd7030308 P 9e1828b5b7d244b8aa09a9b41d21fc29: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.001s
I20260709 13:12:39.311503  5993 raft_consensus.cc:359] T 22576e8937fb4cd2bbff5a4dd7030308 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.312425  5993 raft_consensus.cc:385] T 22576e8937fb4cd2bbff5a4dd7030308 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.312788  5993 raft_consensus.cc:740] T 22576e8937fb4cd2bbff5a4dd7030308 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e1828b5b7d244b8aa09a9b41d21fc29, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.313786  5995 tablet_bootstrap.cc:654] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 2e314036804542f7ab3e6550a903dceb: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.313664  5993 consensus_queue.cc:260] T 22576e8937fb4cd2bbff5a4dd7030308 P 9e1828b5b7d244b8aa09a9b41d21fc29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.316478  5993 ts_tablet_manager.cc:1434] T 22576e8937fb4cd2bbff5a4dd7030308 P 9e1828b5b7d244b8aa09a9b41d21fc29: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:12:39.317507  5993 tablet_bootstrap.cc:492] T e087d3db165b428d9581b8782836ed0f P 9e1828b5b7d244b8aa09a9b41d21fc29: Bootstrap starting.
I20260709 13:12:39.323599  5993 tablet_bootstrap.cc:654] T e087d3db165b428d9581b8782836ed0f P 9e1828b5b7d244b8aa09a9b41d21fc29: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.325259  5992 tablet_bootstrap.cc:492] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02: No bootstrap required, opened a new log
I20260709 13:12:39.325711  5995 tablet_bootstrap.cc:492] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 2e314036804542f7ab3e6550a903dceb: No bootstrap required, opened a new log
I20260709 13:12:39.325865  5992 ts_tablet_manager.cc:1403] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.002s
I20260709 13:12:39.326421  5995 ts_tablet_manager.cc:1403] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 2e314036804542f7ab3e6550a903dceb: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 13:12:39.330360  5992 raft_consensus.cc:359] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.330756  5995 raft_consensus.cc:359] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.335546  5992 raft_consensus.cc:385] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.335635  5995 raft_consensus.cc:385] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.335997  5992 raft_consensus.cc:740] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16cf2b6947b24cebb090e03e8dfeba02, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.336127  5995 raft_consensus.cc:740] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e314036804542f7ab3e6550a903dceb, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.336054  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655c8f612f7c4806a849c5bf7fe918fe" candidate_uuid: "16cf2b6947b24cebb090e03e8dfeba02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e314036804542f7ab3e6550a903dceb" is_pre_election: true
I20260709 13:12:39.336975  5992 consensus_queue.cc:260] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.337129  5995 consensus_queue.cc:260] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 2e314036804542f7ab3e6550a903dceb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.334888  5993 tablet_bootstrap.cc:492] T e087d3db165b428d9581b8782836ed0f P 9e1828b5b7d244b8aa09a9b41d21fc29: No bootstrap required, opened a new log
W20260709 13:12:39.337980  5843 leader_election.cc:343] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e314036804542f7ab3e6550a903dceb (127.28.173.3:32927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.338428  5993 ts_tablet_manager.cc:1403] T e087d3db165b428d9581b8782836ed0f P 9e1828b5b7d244b8aa09a9b41d21fc29: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 13:12:39.339370  5992 ts_tablet_manager.cc:1434] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:12:39.340703  5995 ts_tablet_manager.cc:1434] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 2e314036804542f7ab3e6550a903dceb: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:12:39.341866  5995 tablet_bootstrap.cc:492] T 1136e55740054ca2a51e4b28d073087f P 2e314036804542f7ab3e6550a903dceb: Bootstrap starting.
I20260709 13:12:39.341498  5993 raft_consensus.cc:359] T e087d3db165b428d9581b8782836ed0f P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.342957  5993 raft_consensus.cc:385] T e087d3db165b428d9581b8782836ed0f P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.343271  5993 raft_consensus.cc:740] T e087d3db165b428d9581b8782836ed0f P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e1828b5b7d244b8aa09a9b41d21fc29, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.344349  6001 raft_consensus.cc:493] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.344444  5993 consensus_queue.cc:260] T e087d3db165b428d9581b8782836ed0f P 9e1828b5b7d244b8aa09a9b41d21fc29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.344973  6001 raft_consensus.cc:515] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.345419  5992 tablet_bootstrap.cc:492] T 1136e55740054ca2a51e4b28d073087f P 16cf2b6947b24cebb090e03e8dfeba02: Bootstrap starting.
I20260709 13:12:39.358115  5995 tablet_bootstrap.cc:654] T 1136e55740054ca2a51e4b28d073087f P 2e314036804542f7ab3e6550a903dceb: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.347633  6001 leader_election.cc:290] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2:43579), 2e314036804542f7ab3e6550a903dceb (127.28.173.3:32927)
I20260709 13:12:39.347045  5993 ts_tablet_manager.cc:1434] T e087d3db165b428d9581b8782836ed0f P 9e1828b5b7d244b8aa09a9b41d21fc29: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:12:39.350066  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e25e11d63324b2a8fb52c85459d4c03" candidate_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e314036804542f7ab3e6550a903dceb" is_pre_election: true
I20260709 13:12:39.348508  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e25e11d63324b2a8fb52c85459d4c03" candidate_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16cf2b6947b24cebb090e03e8dfeba02" is_pre_election: true
I20260709 13:12:39.368754  5993 tablet_bootstrap.cc:492] T cfdc7563ffb04da99d981061fdfd0507 P 9e1828b5b7d244b8aa09a9b41d21fc29: Bootstrap starting.
I20260709 13:12:39.369966  5803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655c8f612f7c4806a849c5bf7fe918fe" candidate_uuid: "16cf2b6947b24cebb090e03e8dfeba02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" is_pre_election: true
I20260709 13:12:39.351382  5700 catalog_manager.cc:5697] T 5b2bd404001649699134812445fa01f7 P 9e1828b5b7d244b8aa09a9b41d21fc29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:39.371536  5842 leader_election.cc:343] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.372081  5842 leader_election.cc:304] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16cf2b6947b24cebb090e03e8dfeba02; no voters: 2e314036804542f7ab3e6550a903dceb, 9e1828b5b7d244b8aa09a9b41d21fc29
I20260709 13:12:39.352347  6009 raft_consensus.cc:493] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.373378  5998 raft_consensus.cc:2749] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:39.372983  6009 raft_consensus.cc:515] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
W20260709 13:12:39.375828  5749 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:39.376641  5993 tablet_bootstrap.cc:654] T cfdc7563ffb04da99d981061fdfd0507 P 9e1828b5b7d244b8aa09a9b41d21fc29: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.369587  5878 raft_consensus.cc:2468] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e1828b5b7d244b8aa09a9b41d21fc29 in term 0.
I20260709 13:12:39.368717  5952 raft_consensus.cc:2468] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e1828b5b7d244b8aa09a9b41d21fc29 in term 0.
I20260709 13:12:39.377434  5803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22576e8937fb4cd2bbff5a4dd7030308" candidate_uuid: "2e314036804542f7ab3e6550a903dceb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" is_pre_election: true
I20260709 13:12:39.378345  5803 raft_consensus.cc:2468] T 22576e8937fb4cd2bbff5a4dd7030308 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e314036804542f7ab3e6550a903dceb in term 0.
I20260709 13:12:39.378723  5768 leader_election.cc:304] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16cf2b6947b24cebb090e03e8dfeba02, 9e1828b5b7d244b8aa09a9b41d21fc29; no voters: 
I20260709 13:12:39.380887  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22576e8937fb4cd2bbff5a4dd7030308" candidate_uuid: "2e314036804542f7ab3e6550a903dceb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16cf2b6947b24cebb090e03e8dfeba02" is_pre_election: true
I20260709 13:12:39.381064  5916 leader_election.cc:304] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e314036804542f7ab3e6550a903dceb, 9e1828b5b7d244b8aa09a9b41d21fc29; no voters: 
I20260709 13:12:39.382272  6000 raft_consensus.cc:2804] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:39.382733  6000 raft_consensus.cc:493] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:39.382951  5917 leader_election.cc:343] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2:43579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.383157  6000 raft_consensus.cc:3060] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.379799  6001 raft_consensus.cc:2804] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:39.384531  6001 raft_consensus.cc:493] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.385054  6001 raft_consensus.cc:3060] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.379703  6009 leader_election.cc:290] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151), 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2:43579)
I20260709 13:12:39.388316  5993 tablet_bootstrap.cc:492] T cfdc7563ffb04da99d981061fdfd0507 P 9e1828b5b7d244b8aa09a9b41d21fc29: No bootstrap required, opened a new log
I20260709 13:12:39.388870  5993 ts_tablet_manager.cc:1403] T cfdc7563ffb04da99d981061fdfd0507 P 9e1828b5b7d244b8aa09a9b41d21fc29: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.005s
I20260709 13:12:39.391872  5993 raft_consensus.cc:359] T cfdc7563ffb04da99d981061fdfd0507 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.392535  5993 raft_consensus.cc:385] T cfdc7563ffb04da99d981061fdfd0507 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.392817  5993 raft_consensus.cc:740] T cfdc7563ffb04da99d981061fdfd0507 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e1828b5b7d244b8aa09a9b41d21fc29, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.393440  6001 raft_consensus.cc:515] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.393821  5993 consensus_queue.cc:260] T cfdc7563ffb04da99d981061fdfd0507 P 9e1828b5b7d244b8aa09a9b41d21fc29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.395910  6000 raft_consensus.cc:515] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.397095  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e25e11d63324b2a8fb52c85459d4c03" candidate_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16cf2b6947b24cebb090e03e8dfeba02"
I20260709 13:12:39.397665  5878 raft_consensus.cc:3060] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.398726  5803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22576e8937fb4cd2bbff5a4dd7030308" candidate_uuid: "2e314036804542f7ab3e6550a903dceb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29"
I20260709 13:12:39.399362  5803 raft_consensus.cc:3060] T 22576e8937fb4cd2bbff5a4dd7030308 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.402084  5992 tablet_bootstrap.cc:654] T 1136e55740054ca2a51e4b28d073087f P 16cf2b6947b24cebb090e03e8dfeba02: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.407122  5878 raft_consensus.cc:2468] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e1828b5b7d244b8aa09a9b41d21fc29 in term 1.
I20260709 13:12:39.407526  5993 ts_tablet_manager.cc:1434] T cfdc7563ffb04da99d981061fdfd0507 P 9e1828b5b7d244b8aa09a9b41d21fc29: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:12:39.410369  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e25e11d63324b2a8fb52c85459d4c03" candidate_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e314036804542f7ab3e6550a903dceb"
I20260709 13:12:39.418427  5992 tablet_bootstrap.cc:492] T 1136e55740054ca2a51e4b28d073087f P 16cf2b6947b24cebb090e03e8dfeba02: No bootstrap required, opened a new log
I20260709 13:12:39.425523  5993 tablet_bootstrap.cc:492] T 655c8f612f7c4806a849c5bf7fe918fe P 9e1828b5b7d244b8aa09a9b41d21fc29: Bootstrap starting.
I20260709 13:12:39.415117  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22576e8937fb4cd2bbff5a4dd7030308" candidate_uuid: "2e314036804542f7ab3e6550a903dceb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16cf2b6947b24cebb090e03e8dfeba02"
I20260709 13:12:39.425781  5992 ts_tablet_manager.cc:1403] T 1136e55740054ca2a51e4b28d073087f P 16cf2b6947b24cebb090e03e8dfeba02: Time spent bootstrapping tablet: real 0.081s	user 0.008s	sys 0.012s
I20260709 13:12:39.425601  5768 leader_election.cc:304] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16cf2b6947b24cebb090e03e8dfeba02, 9e1828b5b7d244b8aa09a9b41d21fc29; no voters: 
I20260709 13:12:39.426005  6000 leader_election.cc:290] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 1 election: Requested vote from peers 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151), 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2:43579)
I20260709 13:12:39.407701  5803 raft_consensus.cc:2468] T 22576e8937fb4cd2bbff5a4dd7030308 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e314036804542f7ab3e6550a903dceb in term 1.
I20260709 13:12:39.429667  5998 raft_consensus.cc:493] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.429524  5992 raft_consensus.cc:359] T 1136e55740054ca2a51e4b28d073087f P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.408249  6009 raft_consensus.cc:493] T cfdc7563ffb04da99d981061fdfd0507 P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.430300  5992 raft_consensus.cc:385] T 1136e55740054ca2a51e4b28d073087f P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.430224  5998 raft_consensus.cc:515] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.430456  6009 raft_consensus.cc:515] T cfdc7563ffb04da99d981061fdfd0507 P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.426745  6014 raft_consensus.cc:2804] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:39.431470  6014 raft_consensus.cc:697] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 LEADER]: Becoming Leader. State: Replica: 9e1828b5b7d244b8aa09a9b41d21fc29, State: Running, Role: LEADER
I20260709 13:12:39.432693  5998 leader_election.cc:290] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 16cf2b6947b24cebb090e03e8dfeba02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151), 2e314036804542f7ab3e6550a903dceb (127.28.173.3:32927)
I20260709 13:12:39.432380  6014 consensus_queue.cc:237] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.433863  6009 leader_election.cc:290] T cfdc7563ffb04da99d981061fdfd0507 P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151), 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2:43579)
I20260709 13:12:39.416777  6001 leader_election.cc:290] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29 [CANDIDATE]: Term 1 election: Requested vote from peers 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2:43579), 2e314036804542f7ab3e6550a903dceb (127.28.173.3:32927)
I20260709 13:12:39.438215  5993 tablet_bootstrap.cc:654] T 655c8f612f7c4806a849c5bf7fe918fe P 9e1828b5b7d244b8aa09a9b41d21fc29: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:39.427512  5917 leader_election.cc:343] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2:43579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.427987  5952 raft_consensus.cc:3060] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.441532  5916 leader_election.cc:304] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e314036804542f7ab3e6550a903dceb, 9e1828b5b7d244b8aa09a9b41d21fc29; no voters: 16cf2b6947b24cebb090e03e8dfeba02
I20260709 13:12:39.443662  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ba0196ac9648b38f2f1a7eb8513dd5" candidate_uuid: "16cf2b6947b24cebb090e03e8dfeba02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e314036804542f7ab3e6550a903dceb" is_pre_election: true
I20260709 13:12:39.444039  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc7563ffb04da99d981061fdfd0507" candidate_uuid: "2e314036804542f7ab3e6550a903dceb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16cf2b6947b24cebb090e03e8dfeba02" is_pre_election: true
I20260709 13:12:39.444553  5951 raft_consensus.cc:2468] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16cf2b6947b24cebb090e03e8dfeba02 in term 0.
W20260709 13:12:39.445607  5917 leader_election.cc:343] T cfdc7563ffb04da99d981061fdfd0507 P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2:43579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.445719  6009 raft_consensus.cc:2804] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:39.446220  6009 raft_consensus.cc:697] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb [term 1 LEADER]: Becoming Leader. State: Replica: 2e314036804542f7ab3e6550a903dceb, State: Running, Role: LEADER
I20260709 13:12:39.447082  6009 consensus_queue.cc:237] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.411788  5995 tablet_bootstrap.cc:492] T 1136e55740054ca2a51e4b28d073087f P 2e314036804542f7ab3e6550a903dceb: No bootstrap required, opened a new log
I20260709 13:12:39.448143  5995 ts_tablet_manager.cc:1403] T 1136e55740054ca2a51e4b28d073087f P 2e314036804542f7ab3e6550a903dceb: Time spent bootstrapping tablet: real 0.107s	user 0.023s	sys 0.028s
I20260709 13:12:39.434789  5803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ba0196ac9648b38f2f1a7eb8513dd5" candidate_uuid: "16cf2b6947b24cebb090e03e8dfeba02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" is_pre_election: true
I20260709 13:12:39.448792  5843 leader_election.cc:304] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 16cf2b6947b24cebb090e03e8dfeba02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16cf2b6947b24cebb090e03e8dfeba02, 2e314036804542f7ab3e6550a903dceb; no voters: 
I20260709 13:12:39.447364  5952 raft_consensus.cc:2468] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e1828b5b7d244b8aa09a9b41d21fc29 in term 1.
I20260709 13:12:39.447165  5802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc7563ffb04da99d981061fdfd0507" candidate_uuid: "2e314036804542f7ab3e6550a903dceb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" is_pre_election: true
I20260709 13:12:39.449733  5998 raft_consensus.cc:2804] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:39.449757  5802 raft_consensus.cc:2468] T cfdc7563ffb04da99d981061fdfd0507 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e314036804542f7ab3e6550a903dceb in term 0.
I20260709 13:12:39.450276  5998 raft_consensus.cc:493] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.450624  5998 raft_consensus.cc:3060] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.451143  5995 raft_consensus.cc:359] T 1136e55740054ca2a51e4b28d073087f P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.451951  5995 raft_consensus.cc:385] T 1136e55740054ca2a51e4b28d073087f P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.452255  5995 raft_consensus.cc:740] T 1136e55740054ca2a51e4b28d073087f P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e314036804542f7ab3e6550a903dceb, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.451391  5699 catalog_manager.cc:5697] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:39.453181  5995 consensus_queue.cc:260] T 1136e55740054ca2a51e4b28d073087f P 2e314036804542f7ab3e6550a903dceb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.430848  5992 raft_consensus.cc:740] T 1136e55740054ca2a51e4b28d073087f P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16cf2b6947b24cebb090e03e8dfeba02, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.455240  5992 consensus_queue.cc:260] T 1136e55740054ca2a51e4b28d073087f P 16cf2b6947b24cebb090e03e8dfeba02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
W20260709 13:12:39.450639  5842 leader_election.cc:343] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 16cf2b6947b24cebb090e03e8dfeba02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.456020  5995 ts_tablet_manager.cc:1434] T 1136e55740054ca2a51e4b28d073087f P 2e314036804542f7ab3e6550a903dceb: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:12:39.457195  5995 tablet_bootstrap.cc:492] T 5b2bd404001649699134812445fa01f7 P 2e314036804542f7ab3e6550a903dceb: Bootstrap starting.
I20260709 13:12:39.457098  5916 leader_election.cc:304] T cfdc7563ffb04da99d981061fdfd0507 P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e314036804542f7ab3e6550a903dceb, 9e1828b5b7d244b8aa09a9b41d21fc29; no voters: 16cf2b6947b24cebb090e03e8dfeba02
I20260709 13:12:39.459059  6000 raft_consensus.cc:2804] T cfdc7563ffb04da99d981061fdfd0507 P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:39.459417  6000 raft_consensus.cc:493] T cfdc7563ffb04da99d981061fdfd0507 P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.459743  6000 raft_consensus.cc:3060] T cfdc7563ffb04da99d981061fdfd0507 P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.462848  6014 raft_consensus.cc:493] T e087d3db165b428d9581b8782836ed0f P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.463338  6014 raft_consensus.cc:515] T e087d3db165b428d9581b8782836ed0f P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.465320  6014 leader_election.cc:290] T e087d3db165b428d9581b8782836ed0f P 9e1828b5b7d244b8aa09a9b41d21fc29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2:43579), 2e314036804542f7ab3e6550a903dceb (127.28.173.3:32927)
I20260709 13:12:39.465554  5995 tablet_bootstrap.cc:654] T 5b2bd404001649699134812445fa01f7 P 2e314036804542f7ab3e6550a903dceb: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.467454  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e087d3db165b428d9581b8782836ed0f" candidate_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16cf2b6947b24cebb090e03e8dfeba02" is_pre_election: true
I20260709 13:12:39.468092  5998 raft_consensus.cc:515] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.468310  5878 raft_consensus.cc:2468] T e087d3db165b428d9581b8782836ed0f P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e1828b5b7d244b8aa09a9b41d21fc29 in term 0.
I20260709 13:12:39.470002  5993 tablet_bootstrap.cc:492] T 655c8f612f7c4806a849c5bf7fe918fe P 9e1828b5b7d244b8aa09a9b41d21fc29: No bootstrap required, opened a new log
I20260709 13:12:39.469733  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e087d3db165b428d9581b8782836ed0f" candidate_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e314036804542f7ab3e6550a903dceb" is_pre_election: true
I20260709 13:12:39.469763  5768 leader_election.cc:304] T e087d3db165b428d9581b8782836ed0f P 9e1828b5b7d244b8aa09a9b41d21fc29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16cf2b6947b24cebb090e03e8dfeba02, 9e1828b5b7d244b8aa09a9b41d21fc29; no voters: 
I20260709 13:12:39.470628  5993 ts_tablet_manager.cc:1403] T 655c8f612f7c4806a849c5bf7fe918fe P 9e1828b5b7d244b8aa09a9b41d21fc29: Time spent bootstrapping tablet: real 0.045s	user 0.007s	sys 0.011s
I20260709 13:12:39.470786  5952 raft_consensus.cc:2468] T e087d3db165b428d9581b8782836ed0f P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e1828b5b7d244b8aa09a9b41d21fc29 in term 0.
I20260709 13:12:39.470973  6014 raft_consensus.cc:2804] T e087d3db165b428d9581b8782836ed0f P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:39.472642  6014 raft_consensus.cc:493] T e087d3db165b428d9581b8782836ed0f P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.473043  6014 raft_consensus.cc:3060] T e087d3db165b428d9581b8782836ed0f P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.473855  5992 ts_tablet_manager.cc:1434] T 1136e55740054ca2a51e4b28d073087f P 16cf2b6947b24cebb090e03e8dfeba02: Time spent starting tablet: real 0.047s	user 0.009s	sys 0.009s
I20260709 13:12:39.477108  5992 tablet_bootstrap.cc:492] T cfdc7563ffb04da99d981061fdfd0507 P 16cf2b6947b24cebb090e03e8dfeba02: Bootstrap starting.
I20260709 13:12:39.479737  5993 raft_consensus.cc:359] T 655c8f612f7c4806a849c5bf7fe918fe P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.485494  5993 raft_consensus.cc:385] T 655c8f612f7c4806a849c5bf7fe918fe P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.486075  5993 raft_consensus.cc:740] T 655c8f612f7c4806a849c5bf7fe918fe P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e1828b5b7d244b8aa09a9b41d21fc29, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.485574  5699 catalog_manager.cc:5697] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e314036804542f7ab3e6550a903dceb (127.28.173.3). New cstate: current_term: 1 leader_uuid: "2e314036804542f7ab3e6550a903dceb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:39.487212  5993 consensus_queue.cc:260] T 655c8f612f7c4806a849c5bf7fe918fe P 9e1828b5b7d244b8aa09a9b41d21fc29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.490332  5993 ts_tablet_manager.cc:1434] T 655c8f612f7c4806a849c5bf7fe918fe P 9e1828b5b7d244b8aa09a9b41d21fc29: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:12:39.484498  6000 raft_consensus.cc:515] T cfdc7563ffb04da99d981061fdfd0507 P 2e314036804542f7ab3e6550a903dceb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.492699  6000 leader_election.cc:290] T cfdc7563ffb04da99d981061fdfd0507 P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 1 election: Requested vote from peers 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151), 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2:43579)
I20260709 13:12:39.483502  5992 tablet_bootstrap.cc:654] T cfdc7563ffb04da99d981061fdfd0507 P 16cf2b6947b24cebb090e03e8dfeba02: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.493818  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc7563ffb04da99d981061fdfd0507" candidate_uuid: "2e314036804542f7ab3e6550a903dceb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16cf2b6947b24cebb090e03e8dfeba02"
W20260709 13:12:39.495278  5917 leader_election.cc:343] T cfdc7563ffb04da99d981061fdfd0507 P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2:43579): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.497071  5993 tablet_bootstrap.cc:492] T 1136e55740054ca2a51e4b28d073087f P 9e1828b5b7d244b8aa09a9b41d21fc29: Bootstrap starting.
I20260709 13:12:39.499135  5803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc7563ffb04da99d981061fdfd0507" candidate_uuid: "2e314036804542f7ab3e6550a903dceb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29"
I20260709 13:12:39.497459  5802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ba0196ac9648b38f2f1a7eb8513dd5" candidate_uuid: "16cf2b6947b24cebb090e03e8dfeba02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29"
I20260709 13:12:39.499715  5803 raft_consensus.cc:3060] T cfdc7563ffb04da99d981061fdfd0507 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:39.500768  5842 leader_election.cc:343] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 16cf2b6947b24cebb090e03e8dfeba02 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.503266  6014 raft_consensus.cc:515] T e087d3db165b428d9581b8782836ed0f P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.507184  5803 raft_consensus.cc:2468] T cfdc7563ffb04da99d981061fdfd0507 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e314036804542f7ab3e6550a903dceb in term 1.
I20260709 13:12:39.508258  5916 leader_election.cc:304] T cfdc7563ffb04da99d981061fdfd0507 P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e314036804542f7ab3e6550a903dceb, 9e1828b5b7d244b8aa09a9b41d21fc29; no voters: 16cf2b6947b24cebb090e03e8dfeba02
I20260709 13:12:39.509332  5998 leader_election.cc:290] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 16cf2b6947b24cebb090e03e8dfeba02 [CANDIDATE]: Term 1 election: Requested vote from peers 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151), 2e314036804542f7ab3e6550a903dceb (127.28.173.3:32927)
I20260709 13:12:39.509742  6000 raft_consensus.cc:2804] T cfdc7563ffb04da99d981061fdfd0507 P 2e314036804542f7ab3e6550a903dceb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:39.510391  5952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ba0196ac9648b38f2f1a7eb8513dd5" candidate_uuid: "16cf2b6947b24cebb090e03e8dfeba02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e314036804542f7ab3e6550a903dceb"
I20260709 13:12:39.511104  5952 raft_consensus.cc:3060] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.511802  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e087d3db165b428d9581b8782836ed0f" candidate_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16cf2b6947b24cebb090e03e8dfeba02"
I20260709 13:12:39.512413  5878 raft_consensus.cc:3060] T e087d3db165b428d9581b8782836ed0f P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.512998  5993 tablet_bootstrap.cc:654] T 1136e55740054ca2a51e4b28d073087f P 9e1828b5b7d244b8aa09a9b41d21fc29: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.513844  6014 leader_election.cc:290] T e087d3db165b428d9581b8782836ed0f P 9e1828b5b7d244b8aa09a9b41d21fc29 [CANDIDATE]: Term 1 election: Requested vote from peers 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2:43579), 2e314036804542f7ab3e6550a903dceb (127.28.173.3:32927)
I20260709 13:12:39.516993  5992 tablet_bootstrap.cc:492] T cfdc7563ffb04da99d981061fdfd0507 P 16cf2b6947b24cebb090e03e8dfeba02: No bootstrap required, opened a new log
I20260709 13:12:39.517210  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e087d3db165b428d9581b8782836ed0f" candidate_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e314036804542f7ab3e6550a903dceb"
I20260709 13:12:39.517580  5992 ts_tablet_manager.cc:1403] T cfdc7563ffb04da99d981061fdfd0507 P 16cf2b6947b24cebb090e03e8dfeba02: Time spent bootstrapping tablet: real 0.041s	user 0.008s	sys 0.012s
I20260709 13:12:39.517848  5951 raft_consensus.cc:3060] T e087d3db165b428d9581b8782836ed0f P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.518540  5952 raft_consensus.cc:2468] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 2e314036804542f7ab3e6550a903dceb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16cf2b6947b24cebb090e03e8dfeba02 in term 1.
I20260709 13:12:39.510427  6000 raft_consensus.cc:697] T cfdc7563ffb04da99d981061fdfd0507 P 2e314036804542f7ab3e6550a903dceb [term 1 LEADER]: Becoming Leader. State: Replica: 2e314036804542f7ab3e6550a903dceb, State: Running, Role: LEADER
I20260709 13:12:39.519583  5843 leader_election.cc:304] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 16cf2b6947b24cebb090e03e8dfeba02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16cf2b6947b24cebb090e03e8dfeba02, 2e314036804542f7ab3e6550a903dceb; no voters: 9e1828b5b7d244b8aa09a9b41d21fc29
I20260709 13:12:39.520807  5998 raft_consensus.cc:2804] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:39.520431  6000 consensus_queue.cc:237] T cfdc7563ffb04da99d981061fdfd0507 P 2e314036804542f7ab3e6550a903dceb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.522430  5992 raft_consensus.cc:359] T cfdc7563ffb04da99d981061fdfd0507 P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.522970  5998 raft_consensus.cc:697] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 LEADER]: Becoming Leader. State: Replica: 16cf2b6947b24cebb090e03e8dfeba02, State: Running, Role: LEADER
I20260709 13:12:39.523223  5995 tablet_bootstrap.cc:492] T 5b2bd404001649699134812445fa01f7 P 2e314036804542f7ab3e6550a903dceb: No bootstrap required, opened a new log
I20260709 13:12:39.523222  5992 raft_consensus.cc:385] T cfdc7563ffb04da99d981061fdfd0507 P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.523886  5992 raft_consensus.cc:740] T cfdc7563ffb04da99d981061fdfd0507 P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16cf2b6947b24cebb090e03e8dfeba02, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.524035  5995 ts_tablet_manager.cc:1403] T 5b2bd404001649699134812445fa01f7 P 2e314036804542f7ab3e6550a903dceb: Time spent bootstrapping tablet: real 0.067s	user 0.023s	sys 0.020s
I20260709 13:12:39.524736  5951 raft_consensus.cc:2468] T e087d3db165b428d9581b8782836ed0f P 2e314036804542f7ab3e6550a903dceb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e1828b5b7d244b8aa09a9b41d21fc29 in term 1.
I20260709 13:12:39.525547  5992 consensus_queue.cc:260] T cfdc7563ffb04da99d981061fdfd0507 P 16cf2b6947b24cebb090e03e8dfeba02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.526047  5768 leader_election.cc:304] T e087d3db165b428d9581b8782836ed0f P 9e1828b5b7d244b8aa09a9b41d21fc29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e314036804542f7ab3e6550a903dceb, 9e1828b5b7d244b8aa09a9b41d21fc29; no voters: 
I20260709 13:12:39.528237  5993 tablet_bootstrap.cc:492] T 1136e55740054ca2a51e4b28d073087f P 9e1828b5b7d244b8aa09a9b41d21fc29: No bootstrap required, opened a new log
I20260709 13:12:39.528350  6014 raft_consensus.cc:2804] T e087d3db165b428d9581b8782836ed0f P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:39.528800  5993 ts_tablet_manager.cc:1403] T 1136e55740054ca2a51e4b28d073087f P 9e1828b5b7d244b8aa09a9b41d21fc29: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.006s
I20260709 13:12:39.529241  5995 raft_consensus.cc:359] T 5b2bd404001649699134812445fa01f7 P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.530051  5995 raft_consensus.cc:385] T 5b2bd404001649699134812445fa01f7 P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.529595  6014 raft_consensus.cc:697] T e087d3db165b428d9581b8782836ed0f P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 LEADER]: Becoming Leader. State: Replica: 9e1828b5b7d244b8aa09a9b41d21fc29, State: Running, Role: LEADER
I20260709 13:12:39.530980  6014 consensus_queue.cc:237] T e087d3db165b428d9581b8782836ed0f P 9e1828b5b7d244b8aa09a9b41d21fc29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.531621  5992 ts_tablet_manager.cc:1434] T cfdc7563ffb04da99d981061fdfd0507 P 16cf2b6947b24cebb090e03e8dfeba02: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:12:39.531972  5995 raft_consensus.cc:740] T 5b2bd404001649699134812445fa01f7 P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e314036804542f7ab3e6550a903dceb, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.532975  5992 tablet_bootstrap.cc:492] T 78f018edbabe49bc9ceafe6faf384bf0 P 16cf2b6947b24cebb090e03e8dfeba02: Bootstrap starting.
I20260709 13:12:39.532764  5995 consensus_queue.cc:260] T 5b2bd404001649699134812445fa01f7 P 2e314036804542f7ab3e6550a903dceb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.533905  5699 catalog_manager.cc:5697] T cfdc7563ffb04da99d981061fdfd0507 P 2e314036804542f7ab3e6550a903dceb reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e314036804542f7ab3e6550a903dceb (127.28.173.3). New cstate: current_term: 1 leader_uuid: "2e314036804542f7ab3e6550a903dceb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:39.525637  5998 consensus_queue.cc:237] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 16cf2b6947b24cebb090e03e8dfeba02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.531318  5993 raft_consensus.cc:359] T 1136e55740054ca2a51e4b28d073087f P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.535408  5993 raft_consensus.cc:385] T 1136e55740054ca2a51e4b28d073087f P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.535699  5993 raft_consensus.cc:740] T 1136e55740054ca2a51e4b28d073087f P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e1828b5b7d244b8aa09a9b41d21fc29, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.536391  5993 consensus_queue.cc:260] T 1136e55740054ca2a51e4b28d073087f P 9e1828b5b7d244b8aa09a9b41d21fc29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.524901  5878 raft_consensus.cc:2468] T e087d3db165b428d9581b8782836ed0f P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e1828b5b7d244b8aa09a9b41d21fc29 in term 1.
I20260709 13:12:39.538968  5993 ts_tablet_manager.cc:1434] T 1136e55740054ca2a51e4b28d073087f P 9e1828b5b7d244b8aa09a9b41d21fc29: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:12:39.539949  5993 tablet_bootstrap.cc:492] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 9e1828b5b7d244b8aa09a9b41d21fc29: Bootstrap starting.
I20260709 13:12:39.541885  5992 tablet_bootstrap.cc:654] T 78f018edbabe49bc9ceafe6faf384bf0 P 16cf2b6947b24cebb090e03e8dfeba02: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.534993  5995 ts_tablet_manager.cc:1434] T 5b2bd404001649699134812445fa01f7 P 2e314036804542f7ab3e6550a903dceb: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:12:39.543565  5995 tablet_bootstrap.cc:492] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb: Bootstrap starting.
I20260709 13:12:39.551075  5995 tablet_bootstrap.cc:654] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.554572  5993 tablet_bootstrap.cc:654] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 9e1828b5b7d244b8aa09a9b41d21fc29: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.558264  5699 catalog_manager.cc:5697] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 16cf2b6947b24cebb090e03e8dfeba02 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2). New cstate: current_term: 1 leader_uuid: "16cf2b6947b24cebb090e03e8dfeba02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:39.560835  5993 tablet_bootstrap.cc:492] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 9e1828b5b7d244b8aa09a9b41d21fc29: No bootstrap required, opened a new log
I20260709 13:12:39.561679  5992 tablet_bootstrap.cc:492] T 78f018edbabe49bc9ceafe6faf384bf0 P 16cf2b6947b24cebb090e03e8dfeba02: No bootstrap required, opened a new log
I20260709 13:12:39.562129  5993 ts_tablet_manager.cc:1403] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 9e1828b5b7d244b8aa09a9b41d21fc29: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.000s
I20260709 13:12:39.562942  5700 catalog_manager.cc:5697] T e087d3db165b428d9581b8782836ed0f P 9e1828b5b7d244b8aa09a9b41d21fc29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:39.564826  5993 raft_consensus.cc:359] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.565510  5993 raft_consensus.cc:385] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.565771  5993 raft_consensus.cc:740] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e1828b5b7d244b8aa09a9b41d21fc29, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.566421  5993 consensus_queue.cc:260] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 9e1828b5b7d244b8aa09a9b41d21fc29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.568655  5993 ts_tablet_manager.cc:1434] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 9e1828b5b7d244b8aa09a9b41d21fc29: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:12:39.569613  5993 tablet_bootstrap.cc:492] T 78f018edbabe49bc9ceafe6faf384bf0 P 9e1828b5b7d244b8aa09a9b41d21fc29: Bootstrap starting.
I20260709 13:12:39.575186  5993 tablet_bootstrap.cc:654] T 78f018edbabe49bc9ceafe6faf384bf0 P 9e1828b5b7d244b8aa09a9b41d21fc29: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.576913  5995 tablet_bootstrap.cc:492] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb: No bootstrap required, opened a new log
I20260709 13:12:39.577380  5995 ts_tablet_manager.cc:1403] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.007s
I20260709 13:12:39.562146  5992 ts_tablet_manager.cc:1403] T 78f018edbabe49bc9ceafe6faf384bf0 P 16cf2b6947b24cebb090e03e8dfeba02: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.010s
I20260709 13:12:39.580015  5995 raft_consensus.cc:359] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.580729  5995 raft_consensus.cc:385] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.580999  5995 raft_consensus.cc:740] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e314036804542f7ab3e6550a903dceb, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.581677  5992 raft_consensus.cc:359] T 78f018edbabe49bc9ceafe6faf384bf0 P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.581748  5995 consensus_queue.cc:260] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.584105  5995 ts_tablet_manager.cc:1434] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:12:39.585013  5995 tablet_bootstrap.cc:492] T f0c6edfa14e84779a8dc712956946605 P 2e314036804542f7ab3e6550a903dceb: Bootstrap starting.
I20260709 13:12:39.582495  5992 raft_consensus.cc:385] T 78f018edbabe49bc9ceafe6faf384bf0 P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.588883  5992 raft_consensus.cc:740] T 78f018edbabe49bc9ceafe6faf384bf0 P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16cf2b6947b24cebb090e03e8dfeba02, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.589701  5992 consensus_queue.cc:260] T 78f018edbabe49bc9ceafe6faf384bf0 P 16cf2b6947b24cebb090e03e8dfeba02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.591060  5995 tablet_bootstrap.cc:654] T f0c6edfa14e84779a8dc712956946605 P 2e314036804542f7ab3e6550a903dceb: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.598623  6014 raft_consensus.cc:493] T f0c6edfa14e84779a8dc712956946605 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.599330  6014 raft_consensus.cc:515] T f0c6edfa14e84779a8dc712956946605 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.601958  6014 leader_election.cc:290] T f0c6edfa14e84779a8dc712956946605 P 9e1828b5b7d244b8aa09a9b41d21fc29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2:43579), 2e314036804542f7ab3e6550a903dceb (127.28.173.3:32927)
I20260709 13:12:39.605232  5992 ts_tablet_manager.cc:1434] T 78f018edbabe49bc9ceafe6faf384bf0 P 16cf2b6947b24cebb090e03e8dfeba02: Time spent starting tablet: real 0.026s	user 0.003s	sys 0.002s
I20260709 13:12:39.605149  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c6edfa14e84779a8dc712956946605" candidate_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e314036804542f7ab3e6550a903dceb" is_pre_election: true
I20260709 13:12:39.605798  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c6edfa14e84779a8dc712956946605" candidate_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16cf2b6947b24cebb090e03e8dfeba02" is_pre_election: true
W20260709 13:12:39.607635  5768 leader_election.cc:343] T f0c6edfa14e84779a8dc712956946605 P 9e1828b5b7d244b8aa09a9b41d21fc29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2:43579): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:39.608546  5768 leader_election.cc:343] T f0c6edfa14e84779a8dc712956946605 P 9e1828b5b7d244b8aa09a9b41d21fc29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e314036804542f7ab3e6550a903dceb (127.28.173.3:32927): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.609012  5993 tablet_bootstrap.cc:492] T 78f018edbabe49bc9ceafe6faf384bf0 P 9e1828b5b7d244b8aa09a9b41d21fc29: No bootstrap required, opened a new log
I20260709 13:12:39.609100  5768 leader_election.cc:304] T f0c6edfa14e84779a8dc712956946605 P 9e1828b5b7d244b8aa09a9b41d21fc29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e1828b5b7d244b8aa09a9b41d21fc29; no voters: 16cf2b6947b24cebb090e03e8dfeba02, 2e314036804542f7ab3e6550a903dceb
I20260709 13:12:39.610428  6014 raft_consensus.cc:2749] T f0c6edfa14e84779a8dc712956946605 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:39.609620  5993 ts_tablet_manager.cc:1403] T 78f018edbabe49bc9ceafe6faf384bf0 P 9e1828b5b7d244b8aa09a9b41d21fc29: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.024s
I20260709 13:12:39.611915  5995 tablet_bootstrap.cc:492] T f0c6edfa14e84779a8dc712956946605 P 2e314036804542f7ab3e6550a903dceb: No bootstrap required, opened a new log
I20260709 13:12:39.612380  5992 tablet_bootstrap.cc:492] T 22576e8937fb4cd2bbff5a4dd7030308 P 16cf2b6947b24cebb090e03e8dfeba02: Bootstrap starting.
I20260709 13:12:39.612448  5995 ts_tablet_manager.cc:1403] T f0c6edfa14e84779a8dc712956946605 P 2e314036804542f7ab3e6550a903dceb: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.015s
I20260709 13:12:39.613309  5993 raft_consensus.cc:359] T 78f018edbabe49bc9ceafe6faf384bf0 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.613972  5993 raft_consensus.cc:385] T 78f018edbabe49bc9ceafe6faf384bf0 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.614229  5993 raft_consensus.cc:740] T 78f018edbabe49bc9ceafe6faf384bf0 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e1828b5b7d244b8aa09a9b41d21fc29, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.614814  5995 raft_consensus.cc:359] T f0c6edfa14e84779a8dc712956946605 P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.615381  5995 raft_consensus.cc:385] T f0c6edfa14e84779a8dc712956946605 P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.614886  5993 consensus_queue.cc:260] T 78f018edbabe49bc9ceafe6faf384bf0 P 9e1828b5b7d244b8aa09a9b41d21fc29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.615607  5995 raft_consensus.cc:740] T f0c6edfa14e84779a8dc712956946605 P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e314036804542f7ab3e6550a903dceb, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.616341  5995 consensus_queue.cc:260] T f0c6edfa14e84779a8dc712956946605 P 2e314036804542f7ab3e6550a903dceb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.617108  5993 ts_tablet_manager.cc:1434] T 78f018edbabe49bc9ceafe6faf384bf0 P 9e1828b5b7d244b8aa09a9b41d21fc29: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:12:39.618278  5992 tablet_bootstrap.cc:654] T 22576e8937fb4cd2bbff5a4dd7030308 P 16cf2b6947b24cebb090e03e8dfeba02: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.620569  5995 ts_tablet_manager.cc:1434] T f0c6edfa14e84779a8dc712956946605 P 2e314036804542f7ab3e6550a903dceb: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:12:39.621541  5995 tablet_bootstrap.cc:492] T 78f018edbabe49bc9ceafe6faf384bf0 P 2e314036804542f7ab3e6550a903dceb: Bootstrap starting.
I20260709 13:12:39.625190  5992 tablet_bootstrap.cc:492] T 22576e8937fb4cd2bbff5a4dd7030308 P 16cf2b6947b24cebb090e03e8dfeba02: No bootstrap required, opened a new log
I20260709 13:12:39.625594  5992 ts_tablet_manager.cc:1403] T 22576e8937fb4cd2bbff5a4dd7030308 P 16cf2b6947b24cebb090e03e8dfeba02: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:12:39.628144  5992 raft_consensus.cc:359] T 22576e8937fb4cd2bbff5a4dd7030308 P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.628826  5992 raft_consensus.cc:385] T 22576e8937fb4cd2bbff5a4dd7030308 P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.629096  5992 raft_consensus.cc:740] T 22576e8937fb4cd2bbff5a4dd7030308 P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16cf2b6947b24cebb090e03e8dfeba02, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.629506  5995 tablet_bootstrap.cc:654] T 78f018edbabe49bc9ceafe6faf384bf0 P 2e314036804542f7ab3e6550a903dceb: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.629730  5992 consensus_queue.cc:260] T 22576e8937fb4cd2bbff5a4dd7030308 P 16cf2b6947b24cebb090e03e8dfeba02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.631762  5992 ts_tablet_manager.cc:1434] T 22576e8937fb4cd2bbff5a4dd7030308 P 16cf2b6947b24cebb090e03e8dfeba02: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:12:39.632748  5992 tablet_bootstrap.cc:492] T f0c6edfa14e84779a8dc712956946605 P 16cf2b6947b24cebb090e03e8dfeba02: Bootstrap starting.
I20260709 13:12:39.635016  5995 tablet_bootstrap.cc:492] T 78f018edbabe49bc9ceafe6faf384bf0 P 2e314036804542f7ab3e6550a903dceb: No bootstrap required, opened a new log
I20260709 13:12:39.635509  5995 ts_tablet_manager.cc:1403] T 78f018edbabe49bc9ceafe6faf384bf0 P 2e314036804542f7ab3e6550a903dceb: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:12:39.636888  5998 raft_consensus.cc:493] T 78f018edbabe49bc9ceafe6faf384bf0 P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.637408  5998 raft_consensus.cc:515] T 78f018edbabe49bc9ceafe6faf384bf0 P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.638012  5995 raft_consensus.cc:359] T 78f018edbabe49bc9ceafe6faf384bf0 P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.638648  5995 raft_consensus.cc:385] T 78f018edbabe49bc9ceafe6faf384bf0 P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.638742  5992 tablet_bootstrap.cc:654] T f0c6edfa14e84779a8dc712956946605 P 16cf2b6947b24cebb090e03e8dfeba02: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.638942  5995 raft_consensus.cc:740] T 78f018edbabe49bc9ceafe6faf384bf0 P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e314036804542f7ab3e6550a903dceb, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.639493  5998 leader_election.cc:290] T 78f018edbabe49bc9ceafe6faf384bf0 P 16cf2b6947b24cebb090e03e8dfeba02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151), 2e314036804542f7ab3e6550a903dceb (127.28.173.3:32927)
I20260709 13:12:39.639627  5995 consensus_queue.cc:260] T 78f018edbabe49bc9ceafe6faf384bf0 P 2e314036804542f7ab3e6550a903dceb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.640614  5803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f018edbabe49bc9ceafe6faf384bf0" candidate_uuid: "16cf2b6947b24cebb090e03e8dfeba02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" is_pre_election: true
I20260709 13:12:39.641201  5803 raft_consensus.cc:2468] T 78f018edbabe49bc9ceafe6faf384bf0 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16cf2b6947b24cebb090e03e8dfeba02 in term 0.
I20260709 13:12:39.641845  5995 ts_tablet_manager.cc:1434] T 78f018edbabe49bc9ceafe6faf384bf0 P 2e314036804542f7ab3e6550a903dceb: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:12:39.641824  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f018edbabe49bc9ceafe6faf384bf0" candidate_uuid: "16cf2b6947b24cebb090e03e8dfeba02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e314036804542f7ab3e6550a903dceb" is_pre_election: true
I20260709 13:12:39.642570  5951 raft_consensus.cc:2468] T 78f018edbabe49bc9ceafe6faf384bf0 P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16cf2b6947b24cebb090e03e8dfeba02 in term 0.
I20260709 13:12:39.642481  5842 leader_election.cc:304] T 78f018edbabe49bc9ceafe6faf384bf0 P 16cf2b6947b24cebb090e03e8dfeba02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16cf2b6947b24cebb090e03e8dfeba02, 9e1828b5b7d244b8aa09a9b41d21fc29; no voters: 
I20260709 13:12:39.643420  5998 raft_consensus.cc:2804] T 78f018edbabe49bc9ceafe6faf384bf0 P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:39.643785  5998 raft_consensus.cc:493] T 78f018edbabe49bc9ceafe6faf384bf0 P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.644134  5998 raft_consensus.cc:3060] T 78f018edbabe49bc9ceafe6faf384bf0 P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.648614  5992 tablet_bootstrap.cc:492] T f0c6edfa14e84779a8dc712956946605 P 16cf2b6947b24cebb090e03e8dfeba02: No bootstrap required, opened a new log
I20260709 13:12:39.649088  5992 ts_tablet_manager.cc:1403] T f0c6edfa14e84779a8dc712956946605 P 16cf2b6947b24cebb090e03e8dfeba02: Time spent bootstrapping tablet: real 0.017s	user 0.001s	sys 0.008s
I20260709 13:12:39.649902  5998 raft_consensus.cc:515] T 78f018edbabe49bc9ceafe6faf384bf0 P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.651103  5992 raft_consensus.cc:359] T f0c6edfa14e84779a8dc712956946605 P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.651795  5992 raft_consensus.cc:385] T f0c6edfa14e84779a8dc712956946605 P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.652087  5992 raft_consensus.cc:740] T f0c6edfa14e84779a8dc712956946605 P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16cf2b6947b24cebb090e03e8dfeba02, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.652529  5803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f018edbabe49bc9ceafe6faf384bf0" candidate_uuid: "16cf2b6947b24cebb090e03e8dfeba02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29"
I20260709 13:12:39.653167  5803 raft_consensus.cc:3060] T 78f018edbabe49bc9ceafe6faf384bf0 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.652818  5992 consensus_queue.cc:260] T f0c6edfa14e84779a8dc712956946605 P 16cf2b6947b24cebb090e03e8dfeba02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.654683  5992 ts_tablet_manager.cc:1434] T f0c6edfa14e84779a8dc712956946605 P 16cf2b6947b24cebb090e03e8dfeba02: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:12:39.656474  5998 leader_election.cc:290] T 78f018edbabe49bc9ceafe6faf384bf0 P 16cf2b6947b24cebb090e03e8dfeba02 [CANDIDATE]: Term 1 election: Requested vote from peers 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151), 2e314036804542f7ab3e6550a903dceb (127.28.173.3:32927)
I20260709 13:12:39.657522  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f018edbabe49bc9ceafe6faf384bf0" candidate_uuid: "16cf2b6947b24cebb090e03e8dfeba02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e314036804542f7ab3e6550a903dceb"
I20260709 13:12:39.658118  5951 raft_consensus.cc:3060] T 78f018edbabe49bc9ceafe6faf384bf0 P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.659278  5803 raft_consensus.cc:2468] T 78f018edbabe49bc9ceafe6faf384bf0 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16cf2b6947b24cebb090e03e8dfeba02 in term 1.
I20260709 13:12:39.660187  5842 leader_election.cc:304] T 78f018edbabe49bc9ceafe6faf384bf0 P 16cf2b6947b24cebb090e03e8dfeba02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16cf2b6947b24cebb090e03e8dfeba02, 9e1828b5b7d244b8aa09a9b41d21fc29; no voters: 
I20260709 13:12:39.660815  5998 raft_consensus.cc:2804] T 78f018edbabe49bc9ceafe6faf384bf0 P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:39.661245  5998 raft_consensus.cc:697] T 78f018edbabe49bc9ceafe6faf384bf0 P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 LEADER]: Becoming Leader. State: Replica: 16cf2b6947b24cebb090e03e8dfeba02, State: Running, Role: LEADER
I20260709 13:12:39.662031  5998 consensus_queue.cc:237] T 78f018edbabe49bc9ceafe6faf384bf0 P 16cf2b6947b24cebb090e03e8dfeba02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.664244  5951 raft_consensus.cc:2468] T 78f018edbabe49bc9ceafe6faf384bf0 P 2e314036804542f7ab3e6550a903dceb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16cf2b6947b24cebb090e03e8dfeba02 in term 1.
I20260709 13:12:39.669003  5699 catalog_manager.cc:5697] T 78f018edbabe49bc9ceafe6faf384bf0 P 16cf2b6947b24cebb090e03e8dfeba02 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2). New cstate: current_term: 1 leader_uuid: "16cf2b6947b24cebb090e03e8dfeba02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:39.684427  6000 raft_consensus.cc:493] T 1136e55740054ca2a51e4b28d073087f P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.684909  6000 raft_consensus.cc:515] T 1136e55740054ca2a51e4b28d073087f P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.686501  6000 leader_election.cc:290] T 1136e55740054ca2a51e4b28d073087f P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151), 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2:43579)
I20260709 13:12:39.687179  5803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136e55740054ca2a51e4b28d073087f" candidate_uuid: "2e314036804542f7ab3e6550a903dceb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" is_pre_election: true
I20260709 13:12:39.687397  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136e55740054ca2a51e4b28d073087f" candidate_uuid: "2e314036804542f7ab3e6550a903dceb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16cf2b6947b24cebb090e03e8dfeba02" is_pre_election: true
I20260709 13:12:39.687772  5803 raft_consensus.cc:2468] T 1136e55740054ca2a51e4b28d073087f P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e314036804542f7ab3e6550a903dceb in term 0.
I20260709 13:12:39.688050  5878 raft_consensus.cc:2468] T 1136e55740054ca2a51e4b28d073087f P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e314036804542f7ab3e6550a903dceb in term 0.
I20260709 13:12:39.688792  5916 leader_election.cc:304] T 1136e55740054ca2a51e4b28d073087f P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e314036804542f7ab3e6550a903dceb, 9e1828b5b7d244b8aa09a9b41d21fc29; no voters: 
I20260709 13:12:39.689514  6000 raft_consensus.cc:2804] T 1136e55740054ca2a51e4b28d073087f P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:39.689767  6000 raft_consensus.cc:493] T 1136e55740054ca2a51e4b28d073087f P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.690062  6000 raft_consensus.cc:3060] T 1136e55740054ca2a51e4b28d073087f P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.694772  6000 raft_consensus.cc:515] T 1136e55740054ca2a51e4b28d073087f P 2e314036804542f7ab3e6550a903dceb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.696372  6000 leader_election.cc:290] T 1136e55740054ca2a51e4b28d073087f P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 1 election: Requested vote from peers 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151), 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2:43579)
I20260709 13:12:39.696924  5803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136e55740054ca2a51e4b28d073087f" candidate_uuid: "2e314036804542f7ab3e6550a903dceb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29"
I20260709 13:12:39.697480  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136e55740054ca2a51e4b28d073087f" candidate_uuid: "2e314036804542f7ab3e6550a903dceb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16cf2b6947b24cebb090e03e8dfeba02"
I20260709 13:12:39.697511  5803 raft_consensus.cc:3060] T 1136e55740054ca2a51e4b28d073087f P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.697997  5878 raft_consensus.cc:3060] T 1136e55740054ca2a51e4b28d073087f P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.702232  5803 raft_consensus.cc:2468] T 1136e55740054ca2a51e4b28d073087f P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e314036804542f7ab3e6550a903dceb in term 1.
I20260709 13:12:39.702459  5878 raft_consensus.cc:2468] T 1136e55740054ca2a51e4b28d073087f P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e314036804542f7ab3e6550a903dceb in term 1.
I20260709 13:12:39.703181  5916 leader_election.cc:304] T 1136e55740054ca2a51e4b28d073087f P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e314036804542f7ab3e6550a903dceb, 9e1828b5b7d244b8aa09a9b41d21fc29; no voters: 
I20260709 13:12:39.703868  6000 raft_consensus.cc:2804] T 1136e55740054ca2a51e4b28d073087f P 2e314036804542f7ab3e6550a903dceb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:39.704273  6000 raft_consensus.cc:697] T 1136e55740054ca2a51e4b28d073087f P 2e314036804542f7ab3e6550a903dceb [term 1 LEADER]: Becoming Leader. State: Replica: 2e314036804542f7ab3e6550a903dceb, State: Running, Role: LEADER
I20260709 13:12:39.704873  6000 consensus_queue.cc:237] T 1136e55740054ca2a51e4b28d073087f P 2e314036804542f7ab3e6550a903dceb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.711266  5699 catalog_manager.cc:5697] T 1136e55740054ca2a51e4b28d073087f P 2e314036804542f7ab3e6550a903dceb reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e314036804542f7ab3e6550a903dceb (127.28.173.3). New cstate: current_term: 1 leader_uuid: "2e314036804542f7ab3e6550a903dceb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:39.738157  5951 raft_consensus.cc:3060] T 5b2bd404001649699134812445fa01f7 P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.746099  6014 consensus_queue.cc:1048] T 5b2bd404001649699134812445fa01f7 P 9e1828b5b7d244b8aa09a9b41d21fc29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:39.761046  6002 raft_consensus.cc:493] T 655c8f612f7c4806a849c5bf7fe918fe P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.761101  6001 consensus_queue.cc:1048] T 5b2bd404001649699134812445fa01f7 P 9e1828b5b7d244b8aa09a9b41d21fc29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:39.761651  6002 raft_consensus.cc:515] T 655c8f612f7c4806a849c5bf7fe918fe P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.763732  6002 leader_election.cc:290] T 655c8f612f7c4806a849c5bf7fe918fe P 9e1828b5b7d244b8aa09a9b41d21fc29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2:43579), 2e314036804542f7ab3e6550a903dceb (127.28.173.3:32927)
I20260709 13:12:39.764411  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655c8f612f7c4806a849c5bf7fe918fe" candidate_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16cf2b6947b24cebb090e03e8dfeba02" is_pre_election: true
I20260709 13:12:39.765074  5877 raft_consensus.cc:2468] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e1828b5b7d244b8aa09a9b41d21fc29 in term 0.
I20260709 13:12:39.765597  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655c8f612f7c4806a849c5bf7fe918fe" candidate_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e314036804542f7ab3e6550a903dceb" is_pre_election: true
I20260709 13:12:39.766287  5951 raft_consensus.cc:2468] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e1828b5b7d244b8aa09a9b41d21fc29 in term 0.
I20260709 13:12:39.766458  5768 leader_election.cc:304] T 655c8f612f7c4806a849c5bf7fe918fe P 9e1828b5b7d244b8aa09a9b41d21fc29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16cf2b6947b24cebb090e03e8dfeba02, 9e1828b5b7d244b8aa09a9b41d21fc29; no voters: 
I20260709 13:12:39.767549  6002 raft_consensus.cc:2804] T 655c8f612f7c4806a849c5bf7fe918fe P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:39.767972  6002 raft_consensus.cc:493] T 655c8f612f7c4806a849c5bf7fe918fe P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.768324  6002 raft_consensus.cc:3060] T 655c8f612f7c4806a849c5bf7fe918fe P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.774585  6002 raft_consensus.cc:515] T 655c8f612f7c4806a849c5bf7fe918fe P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.777709  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655c8f612f7c4806a849c5bf7fe918fe" candidate_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16cf2b6947b24cebb090e03e8dfeba02"
I20260709 13:12:39.777860  6002 leader_election.cc:290] T 655c8f612f7c4806a849c5bf7fe918fe P 9e1828b5b7d244b8aa09a9b41d21fc29 [CANDIDATE]: Term 1 election: Requested vote from peers 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2:43579), 2e314036804542f7ab3e6550a903dceb (127.28.173.3:32927)
I20260709 13:12:39.778319  5877 raft_consensus.cc:3060] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.779122  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655c8f612f7c4806a849c5bf7fe918fe" candidate_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e314036804542f7ab3e6550a903dceb"
I20260709 13:12:39.779651  5951 raft_consensus.cc:3060] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.785140  5951 raft_consensus.cc:2468] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e1828b5b7d244b8aa09a9b41d21fc29 in term 1.
I20260709 13:12:39.785364  5877 raft_consensus.cc:2468] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e1828b5b7d244b8aa09a9b41d21fc29 in term 1.
I20260709 13:12:39.786267  5768 leader_election.cc:304] T 655c8f612f7c4806a849c5bf7fe918fe P 9e1828b5b7d244b8aa09a9b41d21fc29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e314036804542f7ab3e6550a903dceb, 9e1828b5b7d244b8aa09a9b41d21fc29; no voters: 
I20260709 13:12:39.787006  6002 raft_consensus.cc:2804] T 655c8f612f7c4806a849c5bf7fe918fe P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:39.787459  6002 raft_consensus.cc:697] T 655c8f612f7c4806a849c5bf7fe918fe P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 LEADER]: Becoming Leader. State: Replica: 9e1828b5b7d244b8aa09a9b41d21fc29, State: Running, Role: LEADER
I20260709 13:12:39.788160  6002 consensus_queue.cc:237] T 655c8f612f7c4806a849c5bf7fe918fe P 9e1828b5b7d244b8aa09a9b41d21fc29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.795400  5699 catalog_manager.cc:5697] T 655c8f612f7c4806a849c5bf7fe918fe P 9e1828b5b7d244b8aa09a9b41d21fc29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:39.802693  6002 raft_consensus.cc:493] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.803112  6002 raft_consensus.cc:515] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.804862  6002 leader_election.cc:290] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 9e1828b5b7d244b8aa09a9b41d21fc29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2:43579), 2e314036804542f7ab3e6550a903dceb (127.28.173.3:32927)
I20260709 13:12:39.805413  5877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ba0196ac9648b38f2f1a7eb8513dd5" candidate_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16cf2b6947b24cebb090e03e8dfeba02" is_pre_election: true
I20260709 13:12:39.805821  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31ba0196ac9648b38f2f1a7eb8513dd5" candidate_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e314036804542f7ab3e6550a903dceb" is_pre_election: true
I20260709 13:12:39.806483  5951 raft_consensus.cc:2393] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 2e314036804542f7ab3e6550a903dceb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e1828b5b7d244b8aa09a9b41d21fc29 in current term 1: Already voted for candidate 16cf2b6947b24cebb090e03e8dfeba02 in this term.
I20260709 13:12:39.807595  5768 leader_election.cc:304] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 9e1828b5b7d244b8aa09a9b41d21fc29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e1828b5b7d244b8aa09a9b41d21fc29; no voters: 16cf2b6947b24cebb090e03e8dfeba02, 2e314036804542f7ab3e6550a903dceb
I20260709 13:12:39.808352  6002 raft_consensus.cc:3060] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.813284  6002 raft_consensus.cc:2749] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:39.816787  6002 consensus_queue.cc:1048] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:39.826288  6002 consensus_queue.cc:1048] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:39.873883  5877 raft_consensus.cc:3060] T 22576e8937fb4cd2bbff5a4dd7030308 P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.880031  6000 consensus_queue.cc:1048] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb [LEADER]: Connected to new peer: Peer: permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:39.890792  6009 consensus_queue.cc:1048] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:39.899580  5998 raft_consensus.cc:493] T cfdc7563ffb04da99d981061fdfd0507 P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.900179  5998 raft_consensus.cc:515] T cfdc7563ffb04da99d981061fdfd0507 P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:39.901844  5998 leader_election.cc:290] T cfdc7563ffb04da99d981061fdfd0507 P 16cf2b6947b24cebb090e03e8dfeba02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151), 2e314036804542f7ab3e6550a903dceb (127.28.173.3:32927)
I20260709 13:12:39.902657  5803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc7563ffb04da99d981061fdfd0507" candidate_uuid: "16cf2b6947b24cebb090e03e8dfeba02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" is_pre_election: true
I20260709 13:12:39.902974  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfdc7563ffb04da99d981061fdfd0507" candidate_uuid: "16cf2b6947b24cebb090e03e8dfeba02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e314036804542f7ab3e6550a903dceb" is_pre_election: true
I20260709 13:12:39.903352  5803 raft_consensus.cc:2393] T cfdc7563ffb04da99d981061fdfd0507 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16cf2b6947b24cebb090e03e8dfeba02 in current term 1: Already voted for candidate 2e314036804542f7ab3e6550a903dceb in this term.
I20260709 13:12:39.904403  5842 leader_election.cc:304] T cfdc7563ffb04da99d981061fdfd0507 P 16cf2b6947b24cebb090e03e8dfeba02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16cf2b6947b24cebb090e03e8dfeba02; no voters: 2e314036804542f7ab3e6550a903dceb, 9e1828b5b7d244b8aa09a9b41d21fc29
I20260709 13:12:39.905023  5998 raft_consensus.cc:3060] T cfdc7563ffb04da99d981061fdfd0507 P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.911175  5998 raft_consensus.cc:2749] T cfdc7563ffb04da99d981061fdfd0507 P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:39.920233  6002 consensus_queue.cc:1048] T e087d3db165b428d9581b8782836ed0f P 9e1828b5b7d244b8aa09a9b41d21fc29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:39.928855  6009 consensus_queue.cc:1048] T cfdc7563ffb04da99d981061fdfd0507 P 2e314036804542f7ab3e6550a903dceb [LEADER]: Connected to new peer: Peer: permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:39.931551  6032 consensus_queue.cc:1048] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 16cf2b6947b24cebb090e03e8dfeba02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:39.932578  6002 consensus_queue.cc:1048] T e087d3db165b428d9581b8782836ed0f P 9e1828b5b7d244b8aa09a9b41d21fc29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:39.948983  6058 consensus_queue.cc:1048] T cfdc7563ffb04da99d981061fdfd0507 P 2e314036804542f7ab3e6550a903dceb [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:39.963940  5998 consensus_queue.cc:1048] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 16cf2b6947b24cebb090e03e8dfeba02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:40.029279  6066 raft_consensus.cc:493] T f0c6edfa14e84779a8dc712956946605 P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.029753  6066 raft_consensus.cc:515] T f0c6edfa14e84779a8dc712956946605 P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:40.031450  6066 leader_election.cc:290] T f0c6edfa14e84779a8dc712956946605 P 16cf2b6947b24cebb090e03e8dfeba02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151), 2e314036804542f7ab3e6550a903dceb (127.28.173.3:32927)
I20260709 13:12:40.032335  5803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c6edfa14e84779a8dc712956946605" candidate_uuid: "16cf2b6947b24cebb090e03e8dfeba02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" is_pre_election: true
I20260709 13:12:40.032521  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c6edfa14e84779a8dc712956946605" candidate_uuid: "16cf2b6947b24cebb090e03e8dfeba02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e314036804542f7ab3e6550a903dceb" is_pre_election: true
I20260709 13:12:40.032909  5803 raft_consensus.cc:2468] T f0c6edfa14e84779a8dc712956946605 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16cf2b6947b24cebb090e03e8dfeba02 in term 0.
I20260709 13:12:40.033139  5951 raft_consensus.cc:2468] T f0c6edfa14e84779a8dc712956946605 P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16cf2b6947b24cebb090e03e8dfeba02 in term 0.
I20260709 13:12:40.033885  5842 leader_election.cc:304] T f0c6edfa14e84779a8dc712956946605 P 16cf2b6947b24cebb090e03e8dfeba02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16cf2b6947b24cebb090e03e8dfeba02, 9e1828b5b7d244b8aa09a9b41d21fc29; no voters: 
I20260709 13:12:40.034675  6066 raft_consensus.cc:2804] T f0c6edfa14e84779a8dc712956946605 P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:40.034961  6066 raft_consensus.cc:493] T f0c6edfa14e84779a8dc712956946605 P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.035179  6066 raft_consensus.cc:3060] T f0c6edfa14e84779a8dc712956946605 P 16cf2b6947b24cebb090e03e8dfeba02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.040661  6066 raft_consensus.cc:515] T f0c6edfa14e84779a8dc712956946605 P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:40.042147  6066 leader_election.cc:290] T f0c6edfa14e84779a8dc712956946605 P 16cf2b6947b24cebb090e03e8dfeba02 [CANDIDATE]: Term 1 election: Requested vote from peers 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151), 2e314036804542f7ab3e6550a903dceb (127.28.173.3:32927)
I20260709 13:12:40.042868  5803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c6edfa14e84779a8dc712956946605" candidate_uuid: "16cf2b6947b24cebb090e03e8dfeba02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29"
I20260709 13:12:40.043052  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c6edfa14e84779a8dc712956946605" candidate_uuid: "16cf2b6947b24cebb090e03e8dfeba02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e314036804542f7ab3e6550a903dceb"
I20260709 13:12:40.043408  5803 raft_consensus.cc:3060] T f0c6edfa14e84779a8dc712956946605 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.043623  5951 raft_consensus.cc:3060] T f0c6edfa14e84779a8dc712956946605 P 2e314036804542f7ab3e6550a903dceb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.048293  5803 raft_consensus.cc:2468] T f0c6edfa14e84779a8dc712956946605 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16cf2b6947b24cebb090e03e8dfeba02 in term 1.
I20260709 13:12:40.048313  5951 raft_consensus.cc:2468] T f0c6edfa14e84779a8dc712956946605 P 2e314036804542f7ab3e6550a903dceb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16cf2b6947b24cebb090e03e8dfeba02 in term 1.
I20260709 13:12:40.049350  5842 leader_election.cc:304] T f0c6edfa14e84779a8dc712956946605 P 16cf2b6947b24cebb090e03e8dfeba02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16cf2b6947b24cebb090e03e8dfeba02, 9e1828b5b7d244b8aa09a9b41d21fc29; no voters: 
I20260709 13:12:40.049976  6066 raft_consensus.cc:2804] T f0c6edfa14e84779a8dc712956946605 P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:40.050419  6066 raft_consensus.cc:697] T f0c6edfa14e84779a8dc712956946605 P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 LEADER]: Becoming Leader. State: Replica: 16cf2b6947b24cebb090e03e8dfeba02, State: Running, Role: LEADER
I20260709 13:12:40.051043  6066 consensus_queue.cc:237] T f0c6edfa14e84779a8dc712956946605 P 16cf2b6947b24cebb090e03e8dfeba02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:40.057875  5701 catalog_manager.cc:5697] T f0c6edfa14e84779a8dc712956946605 P 16cf2b6947b24cebb090e03e8dfeba02 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2). New cstate: current_term: 1 leader_uuid: "16cf2b6947b24cebb090e03e8dfeba02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:40.092389  6066 consensus_queue.cc:1048] T 78f018edbabe49bc9ceafe6faf384bf0 P 16cf2b6947b24cebb090e03e8dfeba02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:40.102378  6066 consensus_queue.cc:1048] T 78f018edbabe49bc9ceafe6faf384bf0 P 16cf2b6947b24cebb090e03e8dfeba02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:40.140431  6009 consensus_queue.cc:1048] T 1136e55740054ca2a51e4b28d073087f P 2e314036804542f7ab3e6550a903dceb [LEADER]: Connected to new peer: Peer: permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:40.150992  6058 consensus_queue.cc:1048] T 1136e55740054ca2a51e4b28d073087f P 2e314036804542f7ab3e6550a903dceb [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:40.190724  6002 consensus_queue.cc:1048] T 655c8f612f7c4806a849c5bf7fe918fe P 9e1828b5b7d244b8aa09a9b41d21fc29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:40.200713  6001 consensus_queue.cc:1048] T 655c8f612f7c4806a849c5bf7fe918fe P 9e1828b5b7d244b8aa09a9b41d21fc29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:40.253445 29364 ts_manager.cc:295] Set tserver state for 9e1828b5b7d244b8aa09a9b41d21fc29 to MAINTENANCE_MODE
I20260709 13:12:40.254316 29364 tablet_server.cc:179] TabletServer@127.28.173.1:0 shutting down...
I20260709 13:12:40.277310 29364 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:40.278138 29364 tablet_replica.cc:333] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 9e1828b5b7d244b8aa09a9b41d21fc29: stopping tablet replica
I20260709 13:12:40.278744 29364 raft_consensus.cc:2243] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:40.279263 29364 raft_consensus.cc:2272] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:40.281937 29364 tablet_replica.cc:333] T 1136e55740054ca2a51e4b28d073087f P 9e1828b5b7d244b8aa09a9b41d21fc29: stopping tablet replica
I20260709 13:12:40.282569 29364 raft_consensus.cc:2243] T 1136e55740054ca2a51e4b28d073087f P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:40.282984 29364 raft_consensus.cc:2272] T 1136e55740054ca2a51e4b28d073087f P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:40.285450 29364 tablet_replica.cc:333] T 655c8f612f7c4806a849c5bf7fe918fe P 9e1828b5b7d244b8aa09a9b41d21fc29: stopping tablet replica
I20260709 13:12:40.285933 29364 raft_consensus.cc:2243] T 655c8f612f7c4806a849c5bf7fe918fe P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:40.286645 29364 raft_consensus.cc:2272] T 655c8f612f7c4806a849c5bf7fe918fe P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:40.288570 29364 tablet_replica.cc:333] T cfdc7563ffb04da99d981061fdfd0507 P 9e1828b5b7d244b8aa09a9b41d21fc29: stopping tablet replica
I20260709 13:12:40.289065 29364 raft_consensus.cc:2243] T cfdc7563ffb04da99d981061fdfd0507 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:40.289422 29364 raft_consensus.cc:2272] T cfdc7563ffb04da99d981061fdfd0507 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:40.291252 29364 tablet_replica.cc:333] T f0c6edfa14e84779a8dc712956946605 P 9e1828b5b7d244b8aa09a9b41d21fc29: stopping tablet replica
I20260709 13:12:40.291855 29364 raft_consensus.cc:2243] T f0c6edfa14e84779a8dc712956946605 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:40.292258 29364 raft_consensus.cc:2272] T f0c6edfa14e84779a8dc712956946605 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:40.293992 29364 tablet_replica.cc:333] T 22576e8937fb4cd2bbff5a4dd7030308 P 9e1828b5b7d244b8aa09a9b41d21fc29: stopping tablet replica
I20260709 13:12:40.294478 29364 raft_consensus.cc:2243] T 22576e8937fb4cd2bbff5a4dd7030308 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:40.294866 29364 raft_consensus.cc:2272] T 22576e8937fb4cd2bbff5a4dd7030308 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:40.297190 29364 tablet_replica.cc:333] T e087d3db165b428d9581b8782836ed0f P 9e1828b5b7d244b8aa09a9b41d21fc29: stopping tablet replica
I20260709 13:12:40.297706 29364 raft_consensus.cc:2243] T e087d3db165b428d9581b8782836ed0f P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:40.298468 29364 raft_consensus.cc:2272] T e087d3db165b428d9581b8782836ed0f P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:40.300436 29364 tablet_replica.cc:333] T 78f018edbabe49bc9ceafe6faf384bf0 P 9e1828b5b7d244b8aa09a9b41d21fc29: stopping tablet replica
I20260709 13:12:40.300943 29364 raft_consensus.cc:2243] T 78f018edbabe49bc9ceafe6faf384bf0 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:40.301327 29364 raft_consensus.cc:2272] T 78f018edbabe49bc9ceafe6faf384bf0 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:40.303467 29364 tablet_replica.cc:333] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29: stopping tablet replica
I20260709 13:12:40.304010 29364 raft_consensus.cc:2243] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:40.304714 29364 raft_consensus.cc:2272] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:40.306591 29364 tablet_replica.cc:333] T 5b2bd404001649699134812445fa01f7 P 9e1828b5b7d244b8aa09a9b41d21fc29: stopping tablet replica
I20260709 13:12:40.307224 29364 raft_consensus.cc:2243] T 5b2bd404001649699134812445fa01f7 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:40.308127 29364 raft_consensus.cc:2272] T 5b2bd404001649699134812445fa01f7 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:40.309391  5916 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 410 similar messages]
W20260709 13:12:40.313344  5916 consensus_peers.cc:597] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb -> Peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Couldn't send request to peer 9e1828b5b7d244b8aa09a9b41d21fc29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:40.338119 29364 tablet_server.cc:196] TabletServer@127.28.173.1:0 shutdown complete.
W20260709 13:12:40.376786  5749 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:12:40.418253  5916 consensus_peers.cc:597] T cfdc7563ffb04da99d981061fdfd0507 P 2e314036804542f7ab3e6550a903dceb -> Peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Couldn't send request to peer 9e1828b5b7d244b8aa09a9b41d21fc29. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:44151: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:40.464982  5842 consensus_peers.cc:597] T f0c6edfa14e84779a8dc712956946605 P 16cf2b6947b24cebb090e03e8dfeba02 -> Peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Couldn't send request to peer 9e1828b5b7d244b8aa09a9b41d21fc29. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:44151: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:40.536857  5842 consensus_peers.cc:597] T 78f018edbabe49bc9ceafe6faf384bf0 P 16cf2b6947b24cebb090e03e8dfeba02 -> Peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Couldn't send request to peer 9e1828b5b7d244b8aa09a9b41d21fc29. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:44151: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:40.538779  5842 consensus_peers.cc:597] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 16cf2b6947b24cebb090e03e8dfeba02 -> Peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Couldn't send request to peer 9e1828b5b7d244b8aa09a9b41d21fc29. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:44151: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:40.550419  5916 consensus_peers.cc:597] T 1136e55740054ca2a51e4b28d073087f P 2e314036804542f7ab3e6550a903dceb -> Peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Couldn't send request to peer 9e1828b5b7d244b8aa09a9b41d21fc29. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:44151: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:40.651189  6066 consensus_queue.cc:1048] T f0c6edfa14e84779a8dc712956946605 P 16cf2b6947b24cebb090e03e8dfeba02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:12:41.397400  5749 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:12:41.570736  6009 raft_consensus.cc:493] T e087d3db165b428d9581b8782836ed0f P 2e314036804542f7ab3e6550a903dceb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e1828b5b7d244b8aa09a9b41d21fc29)
I20260709 13:12:41.571457  6009 raft_consensus.cc:515] T e087d3db165b428d9581b8782836ed0f P 2e314036804542f7ab3e6550a903dceb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:41.573679  6009 leader_election.cc:290] T e087d3db165b428d9581b8782836ed0f P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151), 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2:43579)
I20260709 13:12:41.566808  6081 raft_consensus.cc:493] T e087d3db165b428d9581b8782836ed0f P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e1828b5b7d244b8aa09a9b41d21fc29)
I20260709 13:12:41.574573  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e087d3db165b428d9581b8782836ed0f" candidate_uuid: "2e314036804542f7ab3e6550a903dceb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "16cf2b6947b24cebb090e03e8dfeba02" is_pre_election: true
I20260709 13:12:41.575090  6081 raft_consensus.cc:515] T e087d3db165b428d9581b8782836ed0f P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:41.576099  5878 raft_consensus.cc:2468] T e087d3db165b428d9581b8782836ed0f P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e314036804542f7ab3e6550a903dceb in term 1.
I20260709 13:12:41.577484  5917 leader_election.cc:304] T e087d3db165b428d9581b8782836ed0f P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16cf2b6947b24cebb090e03e8dfeba02, 2e314036804542f7ab3e6550a903dceb; no voters: 
I20260709 13:12:41.577558  6081 leader_election.cc:290] T e087d3db165b428d9581b8782836ed0f P 16cf2b6947b24cebb090e03e8dfeba02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151), 2e314036804542f7ab3e6550a903dceb (127.28.173.3:32927)
I20260709 13:12:41.578334  6009 raft_consensus.cc:2804] T e087d3db165b428d9581b8782836ed0f P 2e314036804542f7ab3e6550a903dceb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:41.592412  6009 raft_consensus.cc:493] T e087d3db165b428d9581b8782836ed0f P 2e314036804542f7ab3e6550a903dceb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e1828b5b7d244b8aa09a9b41d21fc29)
I20260709 13:12:41.592833  6009 raft_consensus.cc:3060] T e087d3db165b428d9581b8782836ed0f P 2e314036804542f7ab3e6550a903dceb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.588106  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e087d3db165b428d9581b8782836ed0f" candidate_uuid: "16cf2b6947b24cebb090e03e8dfeba02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e314036804542f7ab3e6550a903dceb" is_pre_election: true
W20260709 13:12:41.590152  5916 leader_election.cc:336] T e087d3db165b428d9581b8782836ed0f P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Network error: Client connection negotiation failed: client connection to 127.28.173.1:44151: connect: Connection refused (error 111)
W20260709 13:12:41.599361  5842 leader_election.cc:336] T e087d3db165b428d9581b8782836ed0f P 16cf2b6947b24cebb090e03e8dfeba02 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Network error: Client connection negotiation failed: client connection to 127.28.173.1:44151: connect: Connection refused (error 111)
I20260709 13:12:41.599437  6009 raft_consensus.cc:515] T e087d3db165b428d9581b8782836ed0f P 2e314036804542f7ab3e6550a903dceb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:41.600584  5950 raft_consensus.cc:2393] T e087d3db165b428d9581b8782836ed0f P 2e314036804542f7ab3e6550a903dceb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16cf2b6947b24cebb090e03e8dfeba02 in current term 2: Already voted for candidate 2e314036804542f7ab3e6550a903dceb in this term.
I20260709 13:12:41.601418  6009 leader_election.cc:290] T e087d3db165b428d9581b8782836ed0f P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 2 election: Requested vote from peers 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151), 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2:43579)
I20260709 13:12:41.602437  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e087d3db165b428d9581b8782836ed0f" candidate_uuid: "2e314036804542f7ab3e6550a903dceb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "16cf2b6947b24cebb090e03e8dfeba02"
I20260709 13:12:41.603065  5878 raft_consensus.cc:3060] T e087d3db165b428d9581b8782836ed0f P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.604561  5843 leader_election.cc:304] T e087d3db165b428d9581b8782836ed0f P 16cf2b6947b24cebb090e03e8dfeba02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16cf2b6947b24cebb090e03e8dfeba02; no voters: 2e314036804542f7ab3e6550a903dceb, 9e1828b5b7d244b8aa09a9b41d21fc29
W20260709 13:12:41.604885  5916 leader_election.cc:336] T e087d3db165b428d9581b8782836ed0f P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Network error: Client connection negotiation failed: client connection to 127.28.173.1:44151: connect: Connection refused (error 111)
I20260709 13:12:41.608500  5878 raft_consensus.cc:2468] T e087d3db165b428d9581b8782836ed0f P 16cf2b6947b24cebb090e03e8dfeba02 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e314036804542f7ab3e6550a903dceb in term 2.
I20260709 13:12:41.608956  6064 raft_consensus.cc:2749] T e087d3db165b428d9581b8782836ed0f P 16cf2b6947b24cebb090e03e8dfeba02 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:41.609479  5917 leader_election.cc:304] T e087d3db165b428d9581b8782836ed0f P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16cf2b6947b24cebb090e03e8dfeba02, 2e314036804542f7ab3e6550a903dceb; no voters: 9e1828b5b7d244b8aa09a9b41d21fc29
I20260709 13:12:41.610281  6009 raft_consensus.cc:2804] T e087d3db165b428d9581b8782836ed0f P 2e314036804542f7ab3e6550a903dceb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:41.610682  6009 raft_consensus.cc:697] T e087d3db165b428d9581b8782836ed0f P 2e314036804542f7ab3e6550a903dceb [term 2 LEADER]: Becoming Leader. State: Replica: 2e314036804542f7ab3e6550a903dceb, State: Running, Role: LEADER
I20260709 13:12:41.611374  6009 consensus_queue.cc:237] T e087d3db165b428d9581b8782836ed0f P 2e314036804542f7ab3e6550a903dceb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:41.619501  5701 catalog_manager.cc:5697] T e087d3db165b428d9581b8782836ed0f P 2e314036804542f7ab3e6550a903dceb reported cstate change: term changed from 1 to 2, leader changed from 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1) to 2e314036804542f7ab3e6550a903dceb (127.28.173.3). New cstate: current_term: 2 leader_uuid: "2e314036804542f7ab3e6550a903dceb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:41.699519  6009 raft_consensus.cc:493] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e1828b5b7d244b8aa09a9b41d21fc29)
I20260709 13:12:41.700225  6009 raft_consensus.cc:515] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:41.702126  6009 leader_election.cc:290] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2:43579), 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151)
I20260709 13:12:41.702890  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655c8f612f7c4806a849c5bf7fe918fe" candidate_uuid: "2e314036804542f7ab3e6550a903dceb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "16cf2b6947b24cebb090e03e8dfeba02" is_pre_election: true
I20260709 13:12:41.703533  5878 raft_consensus.cc:2468] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e314036804542f7ab3e6550a903dceb in term 1.
I20260709 13:12:41.704449  5917 leader_election.cc:304] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16cf2b6947b24cebb090e03e8dfeba02, 2e314036804542f7ab3e6550a903dceb; no voters: 
I20260709 13:12:41.705056  6009 raft_consensus.cc:2804] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:41.705406  6009 raft_consensus.cc:493] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e1828b5b7d244b8aa09a9b41d21fc29)
I20260709 13:12:41.705755  6009 raft_consensus.cc:3060] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:41.706336  5916 leader_election.cc:336] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Network error: Client connection negotiation failed: client connection to 127.28.173.1:44151: connect: Connection refused (error 111)
I20260709 13:12:41.710976  6009 raft_consensus.cc:515] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:41.712577  6009 leader_election.cc:290] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 2 election: Requested vote from peers 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2:43579), 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151)
I20260709 13:12:41.713367  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655c8f612f7c4806a849c5bf7fe918fe" candidate_uuid: "2e314036804542f7ab3e6550a903dceb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "16cf2b6947b24cebb090e03e8dfeba02"
I20260709 13:12:41.713891  5878 raft_consensus.cc:3060] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:41.715997  5916 leader_election.cc:336] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Network error: Client connection negotiation failed: client connection to 127.28.173.1:44151: connect: Connection refused (error 111)
I20260709 13:12:41.719184  5878 raft_consensus.cc:2468] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e314036804542f7ab3e6550a903dceb in term 2.
I20260709 13:12:41.720162  5917 leader_election.cc:304] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16cf2b6947b24cebb090e03e8dfeba02, 2e314036804542f7ab3e6550a903dceb; no voters: 9e1828b5b7d244b8aa09a9b41d21fc29
I20260709 13:12:41.720855  6009 raft_consensus.cc:2804] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:41.721282  6009 raft_consensus.cc:697] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb [term 2 LEADER]: Becoming Leader. State: Replica: 2e314036804542f7ab3e6550a903dceb, State: Running, Role: LEADER
I20260709 13:12:41.721992  6009 consensus_queue.cc:237] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:41.728749  5701 catalog_manager.cc:5697] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb reported cstate change: term changed from 1 to 2, leader changed from 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1) to 2e314036804542f7ab3e6550a903dceb (127.28.173.3). New cstate: current_term: 2 leader_uuid: "2e314036804542f7ab3e6550a903dceb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:41.749993  6009 raft_consensus.cc:493] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e1828b5b7d244b8aa09a9b41d21fc29)
I20260709 13:12:41.750480  6009 raft_consensus.cc:515] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:41.752221  6009 leader_election.cc:290] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151), 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2:43579)
I20260709 13:12:41.753474  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e25e11d63324b2a8fb52c85459d4c03" candidate_uuid: "2e314036804542f7ab3e6550a903dceb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "16cf2b6947b24cebb090e03e8dfeba02" is_pre_election: true
W20260709 13:12:41.755618  5916 leader_election.cc:336] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Network error: Client connection negotiation failed: client connection to 127.28.173.1:44151: connect: Connection refused (error 111)
I20260709 13:12:41.756033  5916 leader_election.cc:304] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e314036804542f7ab3e6550a903dceb; no voters: 16cf2b6947b24cebb090e03e8dfeba02, 9e1828b5b7d244b8aa09a9b41d21fc29
I20260709 13:12:41.756609  6009 raft_consensus.cc:2749] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:41.782351  6009 raft_consensus.cc:493] T 5b2bd404001649699134812445fa01f7 P 2e314036804542f7ab3e6550a903dceb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e1828b5b7d244b8aa09a9b41d21fc29)
I20260709 13:12:41.782863  6009 raft_consensus.cc:515] T 5b2bd404001649699134812445fa01f7 P 2e314036804542f7ab3e6550a903dceb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:41.784550  6009 leader_election.cc:290] T 5b2bd404001649699134812445fa01f7 P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151), 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2:43579)
I20260709 13:12:41.785748  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2bd404001649699134812445fa01f7" candidate_uuid: "2e314036804542f7ab3e6550a903dceb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "16cf2b6947b24cebb090e03e8dfeba02" is_pre_election: true
W20260709 13:12:41.788200  5916 leader_election.cc:336] T 5b2bd404001649699134812445fa01f7 P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Network error: Client connection negotiation failed: client connection to 127.28.173.1:44151: connect: Connection refused (error 111)
I20260709 13:12:41.788516  5916 leader_election.cc:304] T 5b2bd404001649699134812445fa01f7 P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e314036804542f7ab3e6550a903dceb; no voters: 16cf2b6947b24cebb090e03e8dfeba02, 9e1828b5b7d244b8aa09a9b41d21fc29
I20260709 13:12:41.789175  6009 raft_consensus.cc:2749] T 5b2bd404001649699134812445fa01f7 P 2e314036804542f7ab3e6550a903dceb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:41.793485  6064 raft_consensus.cc:493] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e1828b5b7d244b8aa09a9b41d21fc29)
I20260709 13:12:41.793965  6064 raft_consensus.cc:515] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:41.795555  6064 leader_election.cc:290] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151), 2e314036804542f7ab3e6550a903dceb (127.28.173.3:32927)
I20260709 13:12:41.796653  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e25e11d63324b2a8fb52c85459d4c03" candidate_uuid: "16cf2b6947b24cebb090e03e8dfeba02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e314036804542f7ab3e6550a903dceb" is_pre_election: true
I20260709 13:12:41.797274  5950 raft_consensus.cc:2468] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16cf2b6947b24cebb090e03e8dfeba02 in term 1.
I20260709 13:12:41.798277  5843 leader_election.cc:304] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16cf2b6947b24cebb090e03e8dfeba02, 2e314036804542f7ab3e6550a903dceb; no voters: 
I20260709 13:12:41.799119  6064 raft_consensus.cc:2804] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:12:41.799140  5842 leader_election.cc:336] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Network error: Client connection negotiation failed: client connection to 127.28.173.1:44151: connect: Connection refused (error 111)
I20260709 13:12:41.799592  6064 raft_consensus.cc:493] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e1828b5b7d244b8aa09a9b41d21fc29)
I20260709 13:12:41.800010  6064 raft_consensus.cc:3060] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.804934  6064 raft_consensus.cc:515] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:41.806515  6064 leader_election.cc:290] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [CANDIDATE]: Term 2 election: Requested vote from peers 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151), 2e314036804542f7ab3e6550a903dceb (127.28.173.3:32927)
I20260709 13:12:41.807621  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e25e11d63324b2a8fb52c85459d4c03" candidate_uuid: "16cf2b6947b24cebb090e03e8dfeba02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e314036804542f7ab3e6550a903dceb"
I20260709 13:12:41.808250  5950 raft_consensus.cc:3060] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:41.809852  5842 leader_election.cc:336] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Network error: Client connection negotiation failed: client connection to 127.28.173.1:44151: connect: Connection refused (error 111)
I20260709 13:12:41.810165  6064 raft_consensus.cc:493] T 5b2bd404001649699134812445fa01f7 P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9e1828b5b7d244b8aa09a9b41d21fc29)
I20260709 13:12:41.810703  6064 raft_consensus.cc:515] T 5b2bd404001649699134812445fa01f7 P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:41.812677  6064 leader_election.cc:290] T 5b2bd404001649699134812445fa01f7 P 16cf2b6947b24cebb090e03e8dfeba02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151), 2e314036804542f7ab3e6550a903dceb (127.28.173.3:32927)
I20260709 13:12:41.814221  5950 raft_consensus.cc:2468] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16cf2b6947b24cebb090e03e8dfeba02 in term 2.
I20260709 13:12:41.814195  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2bd404001649699134812445fa01f7" candidate_uuid: "16cf2b6947b24cebb090e03e8dfeba02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e314036804542f7ab3e6550a903dceb" is_pre_election: true
I20260709 13:12:41.815047  5951 raft_consensus.cc:2468] T 5b2bd404001649699134812445fa01f7 P 2e314036804542f7ab3e6550a903dceb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16cf2b6947b24cebb090e03e8dfeba02 in term 1.
I20260709 13:12:41.815469  5843 leader_election.cc:304] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16cf2b6947b24cebb090e03e8dfeba02, 2e314036804542f7ab3e6550a903dceb; no voters: 9e1828b5b7d244b8aa09a9b41d21fc29
I20260709 13:12:41.816177  6064 raft_consensus.cc:2804] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:12:41.816357  5842 leader_election.cc:336] T 5b2bd404001649699134812445fa01f7 P 16cf2b6947b24cebb090e03e8dfeba02 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Network error: Client connection negotiation failed: client connection to 127.28.173.1:44151: connect: Connection refused (error 111)
I20260709 13:12:41.816648  6064 raft_consensus.cc:697] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [term 2 LEADER]: Becoming Leader. State: Replica: 16cf2b6947b24cebb090e03e8dfeba02, State: Running, Role: LEADER
I20260709 13:12:41.816998  5843 leader_election.cc:304] T 5b2bd404001649699134812445fa01f7 P 16cf2b6947b24cebb090e03e8dfeba02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16cf2b6947b24cebb090e03e8dfeba02, 2e314036804542f7ab3e6550a903dceb; no voters: 9e1828b5b7d244b8aa09a9b41d21fc29
I20260709 13:12:41.817732  6081 raft_consensus.cc:2804] T 5b2bd404001649699134812445fa01f7 P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:41.817526  6064 consensus_queue.cc:237] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:41.818107  6081 raft_consensus.cc:493] T 5b2bd404001649699134812445fa01f7 P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9e1828b5b7d244b8aa09a9b41d21fc29)
I20260709 13:12:41.818486  6081 raft_consensus.cc:3060] T 5b2bd404001649699134812445fa01f7 P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:41.824270  6081 raft_consensus.cc:515] T 5b2bd404001649699134812445fa01f7 P 16cf2b6947b24cebb090e03e8dfeba02 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:41.824419  5701 catalog_manager.cc:5697] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 reported cstate change: term changed from 1 to 2, leader changed from 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1) to 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2). New cstate: current_term: 2 leader_uuid: "16cf2b6947b24cebb090e03e8dfeba02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:41.825930  6081 leader_election.cc:290] T 5b2bd404001649699134812445fa01f7 P 16cf2b6947b24cebb090e03e8dfeba02 [CANDIDATE]: Term 2 election: Requested vote from peers 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151), 2e314036804542f7ab3e6550a903dceb (127.28.173.3:32927)
I20260709 13:12:41.826894  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b2bd404001649699134812445fa01f7" candidate_uuid: "16cf2b6947b24cebb090e03e8dfeba02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2e314036804542f7ab3e6550a903dceb"
I20260709 13:12:41.827544  5951 raft_consensus.cc:3060] T 5b2bd404001649699134812445fa01f7 P 2e314036804542f7ab3e6550a903dceb [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:41.830753  5842 leader_election.cc:336] T 5b2bd404001649699134812445fa01f7 P 16cf2b6947b24cebb090e03e8dfeba02 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Network error: Client connection negotiation failed: client connection to 127.28.173.1:44151: connect: Connection refused (error 111)
I20260709 13:12:41.834599  5951 raft_consensus.cc:2468] T 5b2bd404001649699134812445fa01f7 P 2e314036804542f7ab3e6550a903dceb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16cf2b6947b24cebb090e03e8dfeba02 in term 2.
I20260709 13:12:41.873980  5843 leader_election.cc:304] T 5b2bd404001649699134812445fa01f7 P 16cf2b6947b24cebb090e03e8dfeba02 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16cf2b6947b24cebb090e03e8dfeba02, 2e314036804542f7ab3e6550a903dceb; no voters: 9e1828b5b7d244b8aa09a9b41d21fc29
I20260709 13:12:41.877957  6081 raft_consensus.cc:2804] T 5b2bd404001649699134812445fa01f7 P 16cf2b6947b24cebb090e03e8dfeba02 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:41.879231  6081 raft_consensus.cc:697] T 5b2bd404001649699134812445fa01f7 P 16cf2b6947b24cebb090e03e8dfeba02 [term 2 LEADER]: Becoming Leader. State: Replica: 16cf2b6947b24cebb090e03e8dfeba02, State: Running, Role: LEADER
I20260709 13:12:41.881671  6081 consensus_queue.cc:237] T 5b2bd404001649699134812445fa01f7 P 16cf2b6947b24cebb090e03e8dfeba02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:41.894471  5701 catalog_manager.cc:5697] T 5b2bd404001649699134812445fa01f7 P 16cf2b6947b24cebb090e03e8dfeba02 reported cstate change: term changed from 1 to 2, leader changed from 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1) to 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2). New cstate: current_term: 2 leader_uuid: "16cf2b6947b24cebb090e03e8dfeba02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:42.013123  5878 raft_consensus.cc:1275] T e087d3db165b428d9581b8782836ed0f P 16cf2b6947b24cebb090e03e8dfeba02 [term 2 FOLLOWER]: Refusing update from remote peer 2e314036804542f7ab3e6550a903dceb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:42.014403  6009 consensus_queue.cc:1048] T e087d3db165b428d9581b8782836ed0f P 2e314036804542f7ab3e6550a903dceb [LEADER]: Connected to new peer: Peer: permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:12:42.032586  5916 consensus_peers.cc:597] T e087d3db165b428d9581b8782836ed0f P 2e314036804542f7ab3e6550a903dceb -> Peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Couldn't send request to peer 9e1828b5b7d244b8aa09a9b41d21fc29. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:44151: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:42.278934  5878 raft_consensus.cc:1275] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02 [term 2 FOLLOWER]: Refusing update from remote peer 2e314036804542f7ab3e6550a903dceb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:42.280434  6000 consensus_queue.cc:1048] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb [LEADER]: Connected to new peer: Peer: permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:42.284685  5951 raft_consensus.cc:1275] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [term 2 FOLLOWER]: Refusing update from remote peer 16cf2b6947b24cebb090e03e8dfeba02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:12:42.285848  5899 debug-util.cc:398] Leaking SignalData structure 0x7b0800213cc0 after lost signal to thread 29367
I20260709 13:12:42.286520  6081 consensus_queue.cc:1048] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:12:42.287920  5899 debug-util.cc:398] Leaking SignalData structure 0x7b08000ac1e0 after lost signal to thread 5735
W20260709 13:12:42.290627  5899 debug-util.cc:398] Leaking SignalData structure 0x7b080003ec60 after lost signal to thread 5902
W20260709 13:12:42.292984  5899 debug-util.cc:398] Leaking SignalData structure 0x7b080006f400 after lost signal to thread 5976
W20260709 13:12:42.297787  5916 consensus_peers.cc:597] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb -> Peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Couldn't send request to peer 9e1828b5b7d244b8aa09a9b41d21fc29. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:44151: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:42.302655  5842 consensus_peers.cc:597] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 -> Peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Couldn't send request to peer 9e1828b5b7d244b8aa09a9b41d21fc29. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:44151: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:42.330716  5842 consensus_peers.cc:597] T 5b2bd404001649699134812445fa01f7 P 16cf2b6947b24cebb090e03e8dfeba02 -> Peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Couldn't send request to peer 9e1828b5b7d244b8aa09a9b41d21fc29. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:44151: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:42.393859  5951 raft_consensus.cc:1275] T 5b2bd404001649699134812445fa01f7 P 2e314036804542f7ab3e6550a903dceb [term 2 FOLLOWER]: Refusing update from remote peer 16cf2b6947b24cebb090e03e8dfeba02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:42.395296  6081 consensus_queue.cc:1048] T 5b2bd404001649699134812445fa01f7 P 16cf2b6947b24cebb090e03e8dfeba02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:12:42.398876  5749 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:12:42.742976  5842 consensus_peers.cc:597] T 78f018edbabe49bc9ceafe6faf384bf0 P 16cf2b6947b24cebb090e03e8dfeba02 -> Peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Couldn't send request to peer 9e1828b5b7d244b8aa09a9b41d21fc29. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:44151: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:42.880723  5842 consensus_peers.cc:597] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 16cf2b6947b24cebb090e03e8dfeba02 -> Peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Couldn't send request to peer 9e1828b5b7d244b8aa09a9b41d21fc29. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:44151: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:42.956517  5916 consensus_peers.cc:597] T 1136e55740054ca2a51e4b28d073087f P 2e314036804542f7ab3e6550a903dceb -> Peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Couldn't send request to peer 9e1828b5b7d244b8aa09a9b41d21fc29. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:44151: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:42.984040  5916 consensus_peers.cc:597] T cfdc7563ffb04da99d981061fdfd0507 P 2e314036804542f7ab3e6550a903dceb -> Peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Couldn't send request to peer 9e1828b5b7d244b8aa09a9b41d21fc29. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:44151: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:42.998482  5842 consensus_peers.cc:597] T f0c6edfa14e84779a8dc712956946605 P 16cf2b6947b24cebb090e03e8dfeba02 -> Peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Couldn't send request to peer 9e1828b5b7d244b8aa09a9b41d21fc29. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:44151: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:43.064977  5916 consensus_peers.cc:597] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb -> Peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Couldn't send request to peer 9e1828b5b7d244b8aa09a9b41d21fc29. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:44151: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:43.400158  5749 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:12:44.307250  5916 consensus_peers.cc:597] T e087d3db165b428d9581b8782836ed0f P 2e314036804542f7ab3e6550a903dceb -> Peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Couldn't send request to peer 9e1828b5b7d244b8aa09a9b41d21fc29. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:44151: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:44.401196  5749 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:12:44.815774  5842 consensus_peers.cc:597] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 -> Peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Couldn't send request to peer 9e1828b5b7d244b8aa09a9b41d21fc29. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:44151: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:44.869400  5916 consensus_peers.cc:597] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb -> Peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Couldn't send request to peer 9e1828b5b7d244b8aa09a9b41d21fc29. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:44151: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:45.138855  5842 consensus_peers.cc:597] T 5b2bd404001649699134812445fa01f7 P 16cf2b6947b24cebb090e03e8dfeba02 -> Peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Couldn't send request to peer 9e1828b5b7d244b8aa09a9b41d21fc29. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:44151: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:45.299113  5842 consensus_peers.cc:597] T 78f018edbabe49bc9ceafe6faf384bf0 P 16cf2b6947b24cebb090e03e8dfeba02 -> Peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Couldn't send request to peer 9e1828b5b7d244b8aa09a9b41d21fc29. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:44151: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:45.367105  5916 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.173.1:44151: connect: Connection refused (error 111) [suppressed 98 similar messages]
W20260709 13:12:45.369390  5916 consensus_peers.cc:597] T 1136e55740054ca2a51e4b28d073087f P 2e314036804542f7ab3e6550a903dceb -> Peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Couldn't send request to peer 9e1828b5b7d244b8aa09a9b41d21fc29. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:44151: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:45.374845  5916 consensus_peers.cc:597] T cfdc7563ffb04da99d981061fdfd0507 P 2e314036804542f7ab3e6550a903dceb -> Peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Couldn't send request to peer 9e1828b5b7d244b8aa09a9b41d21fc29. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:44151: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:45.402153  5749 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:12:45.445093 29364 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:45.453809  6108 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:45.455507  6109 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:45.458014  6111 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:45.458889 29364 server_base.cc:1061] running on GCE node
I20260709 13:12:45.460541 29364 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:45.460793 29364 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:45.460986 29364 hybrid_clock.cc:648] HybridClock initialized: now 1783602765460964 us; error 0 us; skew 500 ppm
I20260709 13:12:45.461575 29364 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:45.464510 29364 webserver.cc:533] Webserver started at http://127.28.173.1:32973/ using document root <none> and password file <none>
I20260709 13:12:45.465054 29364 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:45.465265 29364 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:12:45.469658 29364 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260709 13:12:45.474057  6116 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:45.474910 29364 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.001s
I20260709 13:12:45.475293 29364 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602443945700-29364-0/minicluster-data/ts-0-root
uuid: "9e1828b5b7d244b8aa09a9b41d21fc29"
format_stamp: "Formatted at 2026-07-09 13:12:38 on dist-test-slave-x62b"
I20260709 13:12:45.476164 29364 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602443945700-29364-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602443945700-29364-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602443945700-29364-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:45.494081 29364 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:45.495281 29364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:45.496817 29364 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:45.500722  6123 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:12:45.543344  5842 consensus_peers.cc:597] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 16cf2b6947b24cebb090e03e8dfeba02 -> Peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Couldn't send request to peer 9e1828b5b7d244b8aa09a9b41d21fc29. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:44151: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:45.550477 29364 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:12:45.550859 29364 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.051s	user 0.003s	sys 0.000s
I20260709 13:12:45.551193 29364 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:12:45.557469  6123 tablet_bootstrap.cc:492] T 78f018edbabe49bc9ceafe6faf384bf0 P 9e1828b5b7d244b8aa09a9b41d21fc29: Bootstrap starting.
I20260709 13:12:45.571583  6123 tablet_bootstrap.cc:492] T 78f018edbabe49bc9ceafe6faf384bf0 P 9e1828b5b7d244b8aa09a9b41d21fc29: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:45.572348  6123 tablet_bootstrap.cc:492] T 78f018edbabe49bc9ceafe6faf384bf0 P 9e1828b5b7d244b8aa09a9b41d21fc29: Bootstrap complete.
I20260709 13:12:45.572888  6123 ts_tablet_manager.cc:1403] T 78f018edbabe49bc9ceafe6faf384bf0 P 9e1828b5b7d244b8aa09a9b41d21fc29: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 13:12:45.575029  6123 raft_consensus.cc:359] T 78f018edbabe49bc9ceafe6faf384bf0 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:45.575766  6123 raft_consensus.cc:740] T 78f018edbabe49bc9ceafe6faf384bf0 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e1828b5b7d244b8aa09a9b41d21fc29, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.576390  6123 consensus_queue.cc:260] T 78f018edbabe49bc9ceafe6faf384bf0 P 9e1828b5b7d244b8aa09a9b41d21fc29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:45.578837  6123 ts_tablet_manager.cc:1434] T 78f018edbabe49bc9ceafe6faf384bf0 P 9e1828b5b7d244b8aa09a9b41d21fc29: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:12:45.579594  6123 tablet_bootstrap.cc:492] T e087d3db165b428d9581b8782836ed0f P 9e1828b5b7d244b8aa09a9b41d21fc29: Bootstrap starting.
I20260709 13:12:45.592207 29364 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:12:45.592335  6123 tablet_bootstrap.cc:492] T e087d3db165b428d9581b8782836ed0f P 9e1828b5b7d244b8aa09a9b41d21fc29: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:45.592504 29364 ts_tablet_manager.cc:595] Time spent register tablets: real 0.041s	user 0.038s	sys 0.003s
I20260709 13:12:45.593233  6123 tablet_bootstrap.cc:492] T e087d3db165b428d9581b8782836ed0f P 9e1828b5b7d244b8aa09a9b41d21fc29: Bootstrap complete.
I20260709 13:12:45.594030  6123 ts_tablet_manager.cc:1403] T e087d3db165b428d9581b8782836ed0f P 9e1828b5b7d244b8aa09a9b41d21fc29: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.004s
I20260709 13:12:45.596189  6123 raft_consensus.cc:359] T e087d3db165b428d9581b8782836ed0f P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:45.596701  6123 raft_consensus.cc:740] T e087d3db165b428d9581b8782836ed0f P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e1828b5b7d244b8aa09a9b41d21fc29, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.597324  6123 consensus_queue.cc:260] T e087d3db165b428d9581b8782836ed0f P 9e1828b5b7d244b8aa09a9b41d21fc29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:45.598827  6123 ts_tablet_manager.cc:1434] T e087d3db165b428d9581b8782836ed0f P 9e1828b5b7d244b8aa09a9b41d21fc29: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:12:45.599499  6123 tablet_bootstrap.cc:492] T 5b2bd404001649699134812445fa01f7 P 9e1828b5b7d244b8aa09a9b41d21fc29: Bootstrap starting.
I20260709 13:12:45.614192  6123 tablet_bootstrap.cc:492] T 5b2bd404001649699134812445fa01f7 P 9e1828b5b7d244b8aa09a9b41d21fc29: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:45.615001  6123 tablet_bootstrap.cc:492] T 5b2bd404001649699134812445fa01f7 P 9e1828b5b7d244b8aa09a9b41d21fc29: Bootstrap complete.
I20260709 13:12:45.615567  6123 ts_tablet_manager.cc:1403] T 5b2bd404001649699134812445fa01f7 P 9e1828b5b7d244b8aa09a9b41d21fc29: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.004s
I20260709 13:12:45.618194  6123 raft_consensus.cc:359] T 5b2bd404001649699134812445fa01f7 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:45.618803  6123 raft_consensus.cc:740] T 5b2bd404001649699134812445fa01f7 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e1828b5b7d244b8aa09a9b41d21fc29, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.619537  6123 consensus_queue.cc:260] T 5b2bd404001649699134812445fa01f7 P 9e1828b5b7d244b8aa09a9b41d21fc29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:45.621320  6123 ts_tablet_manager.cc:1434] T 5b2bd404001649699134812445fa01f7 P 9e1828b5b7d244b8aa09a9b41d21fc29: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.003s
I20260709 13:12:45.621976  6123 tablet_bootstrap.cc:492] T 1136e55740054ca2a51e4b28d073087f P 9e1828b5b7d244b8aa09a9b41d21fc29: Bootstrap starting.
I20260709 13:12:45.634992  6123 tablet_bootstrap.cc:492] T 1136e55740054ca2a51e4b28d073087f P 9e1828b5b7d244b8aa09a9b41d21fc29: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:45.635727  6123 tablet_bootstrap.cc:492] T 1136e55740054ca2a51e4b28d073087f P 9e1828b5b7d244b8aa09a9b41d21fc29: Bootstrap complete.
I20260709 13:12:45.636369  6123 ts_tablet_manager.cc:1403] T 1136e55740054ca2a51e4b28d073087f P 9e1828b5b7d244b8aa09a9b41d21fc29: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:12:45.639005  6123 raft_consensus.cc:359] T 1136e55740054ca2a51e4b28d073087f P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:45.640306  6123 raft_consensus.cc:740] T 1136e55740054ca2a51e4b28d073087f P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e1828b5b7d244b8aa09a9b41d21fc29, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.641096  6123 consensus_queue.cc:260] T 1136e55740054ca2a51e4b28d073087f P 9e1828b5b7d244b8aa09a9b41d21fc29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
W20260709 13:12:45.641705  5916 consensus_peers.cc:597] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb -> Peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Couldn't send request to peer 9e1828b5b7d244b8aa09a9b41d21fc29. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:44151: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:45.642787  6123 ts_tablet_manager.cc:1434] T 1136e55740054ca2a51e4b28d073087f P 9e1828b5b7d244b8aa09a9b41d21fc29: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 13:12:45.643476  6123 tablet_bootstrap.cc:492] T 22576e8937fb4cd2bbff5a4dd7030308 P 9e1828b5b7d244b8aa09a9b41d21fc29: Bootstrap starting.
W20260709 13:12:45.648789  5842 consensus_peers.cc:597] T f0c6edfa14e84779a8dc712956946605 P 16cf2b6947b24cebb090e03e8dfeba02 -> Peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Couldn't send request to peer 9e1828b5b7d244b8aa09a9b41d21fc29. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:44151: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:45.656505  6123 tablet_bootstrap.cc:492] T 22576e8937fb4cd2bbff5a4dd7030308 P 9e1828b5b7d244b8aa09a9b41d21fc29: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:45.657601  6123 tablet_bootstrap.cc:492] T 22576e8937fb4cd2bbff5a4dd7030308 P 9e1828b5b7d244b8aa09a9b41d21fc29: Bootstrap complete.
I20260709 13:12:45.658200  6123 ts_tablet_manager.cc:1403] T 22576e8937fb4cd2bbff5a4dd7030308 P 9e1828b5b7d244b8aa09a9b41d21fc29: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:12:45.660302  6123 raft_consensus.cc:359] T 22576e8937fb4cd2bbff5a4dd7030308 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:45.661019  6123 raft_consensus.cc:740] T 22576e8937fb4cd2bbff5a4dd7030308 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e1828b5b7d244b8aa09a9b41d21fc29, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.661772  6123 consensus_queue.cc:260] T 22576e8937fb4cd2bbff5a4dd7030308 P 9e1828b5b7d244b8aa09a9b41d21fc29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:45.662717 29364 rpc_server.cc:307] RPC server started. Bound to: 127.28.173.1:44151
I20260709 13:12:45.662858  6185 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.173.1:44151 every 8 connection(s)
I20260709 13:12:45.663575  6123 ts_tablet_manager.cc:1434] T 22576e8937fb4cd2bbff5a4dd7030308 P 9e1828b5b7d244b8aa09a9b41d21fc29: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:12:45.664340  6123 tablet_bootstrap.cc:492] T 655c8f612f7c4806a849c5bf7fe918fe P 9e1828b5b7d244b8aa09a9b41d21fc29: Bootstrap starting.
I20260709 13:12:45.668766 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:45.695722  6123 tablet_bootstrap.cc:492] T 655c8f612f7c4806a849c5bf7fe918fe P 9e1828b5b7d244b8aa09a9b41d21fc29: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:45.696787  6123 tablet_bootstrap.cc:492] T 655c8f612f7c4806a849c5bf7fe918fe P 9e1828b5b7d244b8aa09a9b41d21fc29: Bootstrap complete.
I20260709 13:12:45.697417  6123 ts_tablet_manager.cc:1403] T 655c8f612f7c4806a849c5bf7fe918fe P 9e1828b5b7d244b8aa09a9b41d21fc29: Time spent bootstrapping tablet: real 0.033s	user 0.018s	sys 0.008s
I20260709 13:12:45.701119  6123 raft_consensus.cc:359] T 655c8f612f7c4806a849c5bf7fe918fe P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:45.701700  6123 raft_consensus.cc:740] T 655c8f612f7c4806a849c5bf7fe918fe P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e1828b5b7d244b8aa09a9b41d21fc29, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.702271  6123 consensus_queue.cc:260] T 655c8f612f7c4806a849c5bf7fe918fe P 9e1828b5b7d244b8aa09a9b41d21fc29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:45.704253  6123 ts_tablet_manager.cc:1434] T 655c8f612f7c4806a849c5bf7fe918fe P 9e1828b5b7d244b8aa09a9b41d21fc29: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:12:45.704886  6123 tablet_bootstrap.cc:492] T f0c6edfa14e84779a8dc712956946605 P 9e1828b5b7d244b8aa09a9b41d21fc29: Bootstrap starting.
I20260709 13:12:45.709789  6186 heartbeater.cc:344] Connected to a master server at 127.28.173.62:39211
I20260709 13:12:45.710289  6186 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:45.711359  6186 heartbeater.cc:507] Master 127.28.173.62:39211 requested a full tablet report, sending...
I20260709 13:12:45.713083  5951 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "655c8f612f7c4806a849c5bf7fe918fe"
dest_uuid: "2e314036804542f7ab3e6550a903dceb"
mode: GRACEFUL
new_leader_uuid: "16cf2b6947b24cebb090e03e8dfeba02"
 from {username='slave'} at 127.0.0.1:42016
I20260709 13:12:45.713825  5951 raft_consensus.cc:606] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb [term 2 LEADER]: Received request to transfer leadership to TS 16cf2b6947b24cebb090e03e8dfeba02
I20260709 13:12:45.717336  6159 raft_consensus.cc:3060] T 5b2bd404001649699134812445fa01f7 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:45.722044  6123 tablet_bootstrap.cc:492] T f0c6edfa14e84779a8dc712956946605 P 9e1828b5b7d244b8aa09a9b41d21fc29: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:45.724225  6123 tablet_bootstrap.cc:492] T f0c6edfa14e84779a8dc712956946605 P 9e1828b5b7d244b8aa09a9b41d21fc29: Bootstrap complete.
I20260709 13:12:45.724618  5701 ts_manager.cc:194] Re-registered known tserver with Master: 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151)
I20260709 13:12:45.724943  6123 ts_tablet_manager.cc:1403] T f0c6edfa14e84779a8dc712956946605 P 9e1828b5b7d244b8aa09a9b41d21fc29: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 13:12:45.727675  6123 raft_consensus.cc:359] T f0c6edfa14e84779a8dc712956946605 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:45.728386  6123 raft_consensus.cc:740] T f0c6edfa14e84779a8dc712956946605 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e1828b5b7d244b8aa09a9b41d21fc29, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.729179  6123 consensus_queue.cc:260] T f0c6edfa14e84779a8dc712956946605 P 9e1828b5b7d244b8aa09a9b41d21fc29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:45.730525  5878 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78f018edbabe49bc9ceafe6faf384bf0"
dest_uuid: "16cf2b6947b24cebb090e03e8dfeba02"
mode: GRACEFUL
new_leader_uuid: "2e314036804542f7ab3e6550a903dceb"
 from {username='slave'} at 127.0.0.1:44224
I20260709 13:12:45.731096  5878 raft_consensus.cc:606] T 78f018edbabe49bc9ceafe6faf384bf0 P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 LEADER]: Received request to transfer leadership to TS 2e314036804542f7ab3e6550a903dceb
I20260709 13:12:45.731704  6123 ts_tablet_manager.cc:1434] T f0c6edfa14e84779a8dc712956946605 P 9e1828b5b7d244b8aa09a9b41d21fc29: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:12:45.732507 29364 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:12:45.732857  6123 tablet_bootstrap.cc:492] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 9e1828b5b7d244b8aa09a9b41d21fc29: Bootstrap starting.
I20260709 13:12:45.733203 29364 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:45.734020 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:45.739262  5701 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39310
I20260709 13:12:45.746878  6186 heartbeater.cc:499] Master 127.28.173.62:39211 was elected leader, sending a full tablet report...
I20260709 13:12:45.752676  6123 tablet_bootstrap.cc:492] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 9e1828b5b7d244b8aa09a9b41d21fc29: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:45.753429  6123 tablet_bootstrap.cc:492] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 9e1828b5b7d244b8aa09a9b41d21fc29: Bootstrap complete.
I20260709 13:12:45.754014  6123 ts_tablet_manager.cc:1403] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 9e1828b5b7d244b8aa09a9b41d21fc29: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.000s
I20260709 13:12:45.756409  6123 raft_consensus.cc:359] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:45.757071  6123 raft_consensus.cc:740] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e1828b5b7d244b8aa09a9b41d21fc29, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.757736  6123 consensus_queue.cc:260] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 9e1828b5b7d244b8aa09a9b41d21fc29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:45.759657  6123 ts_tablet_manager.cc:1434] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 9e1828b5b7d244b8aa09a9b41d21fc29: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:12:45.760429  6123 tablet_bootstrap.cc:492] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29: Bootstrap starting.
I20260709 13:12:45.774303  6123 tablet_bootstrap.cc:492] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:45.775040  6123 tablet_bootstrap.cc:492] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29: Bootstrap complete.
I20260709 13:12:45.775544  6123 ts_tablet_manager.cc:1403] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 13:12:45.777315  6123 raft_consensus.cc:359] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:45.777806  6123 raft_consensus.cc:740] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e1828b5b7d244b8aa09a9b41d21fc29, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.778389  6123 consensus_queue.cc:260] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:45.779922  6123 ts_tablet_manager.cc:1434] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29: Time spent starting tablet: real 0.004s	user 0.008s	sys 0.000s
I20260709 13:12:45.780541  6123 tablet_bootstrap.cc:492] T cfdc7563ffb04da99d981061fdfd0507 P 9e1828b5b7d244b8aa09a9b41d21fc29: Bootstrap starting.
I20260709 13:12:45.791805  6123 tablet_bootstrap.cc:492] T cfdc7563ffb04da99d981061fdfd0507 P 9e1828b5b7d244b8aa09a9b41d21fc29: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:45.792532  6123 tablet_bootstrap.cc:492] T cfdc7563ffb04da99d981061fdfd0507 P 9e1828b5b7d244b8aa09a9b41d21fc29: Bootstrap complete.
I20260709 13:12:45.793040  6123 ts_tablet_manager.cc:1403] T cfdc7563ffb04da99d981061fdfd0507 P 9e1828b5b7d244b8aa09a9b41d21fc29: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:12:45.794742  6123 raft_consensus.cc:359] T cfdc7563ffb04da99d981061fdfd0507 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:45.795203  6123 raft_consensus.cc:740] T cfdc7563ffb04da99d981061fdfd0507 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e1828b5b7d244b8aa09a9b41d21fc29, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.795977  6123 consensus_queue.cc:260] T cfdc7563ffb04da99d981061fdfd0507 P 9e1828b5b7d244b8aa09a9b41d21fc29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:45.797355  6123 ts_tablet_manager.cc:1434] T cfdc7563ffb04da99d981061fdfd0507 P 9e1828b5b7d244b8aa09a9b41d21fc29: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:12:45.811611  6159 raft_consensus.cc:3060] T e087d3db165b428d9581b8782836ed0f P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:45.824337  6202 raft_consensus.cc:993] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb: : Instructing follower 16cf2b6947b24cebb090e03e8dfeba02 to start an election
I20260709 13:12:45.824985  6107 raft_consensus.cc:1081] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb [term 2 LEADER]: Signalling peer 16cf2b6947b24cebb090e03e8dfeba02 to start an election
I20260709 13:12:45.826611  5878 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "655c8f612f7c4806a849c5bf7fe918fe"
dest_uuid: "16cf2b6947b24cebb090e03e8dfeba02"
 from {username='slave'} at 127.0.0.1:44216
I20260709 13:12:45.827126  5878 raft_consensus.cc:493] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:45.827421  5878 raft_consensus.cc:3060] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:45.834347  5878 raft_consensus.cc:515] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:45.836018  5878 leader_election.cc:290] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02 [CANDIDATE]: Term 3 election: Requested vote from peers 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151), 2e314036804542f7ab3e6550a903dceb (127.28.173.3:32927)
I20260709 13:12:45.836644  6159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655c8f612f7c4806a849c5bf7fe918fe" candidate_uuid: "16cf2b6947b24cebb090e03e8dfeba02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29"
I20260709 13:12:45.837110  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655c8f612f7c4806a849c5bf7fe918fe" candidate_uuid: "16cf2b6947b24cebb090e03e8dfeba02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2e314036804542f7ab3e6550a903dceb"
I20260709 13:12:45.837410  6159 raft_consensus.cc:3060] T 655c8f612f7c4806a849c5bf7fe918fe P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:12:45.837733  5951 raft_consensus.cc:3055] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:45.838022  5951 raft_consensus.cc:740] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2e314036804542f7ab3e6550a903dceb, State: Running, Role: LEADER
I20260709 13:12:45.838722  5951 consensus_queue.cc:260] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:45.839661  5951 raft_consensus.cc:3060] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:45.842437  6159 raft_consensus.cc:2468] T 655c8f612f7c4806a849c5bf7fe918fe P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16cf2b6947b24cebb090e03e8dfeba02 in term 3.
I20260709 13:12:45.843535  5842 leader_election.cc:304] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16cf2b6947b24cebb090e03e8dfeba02, 9e1828b5b7d244b8aa09a9b41d21fc29; no voters: 
I20260709 13:12:45.844404  6106 raft_consensus.cc:2804] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:45.845606  5951 raft_consensus.cc:2468] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16cf2b6947b24cebb090e03e8dfeba02 in term 3.
I20260709 13:12:45.845670  6106 raft_consensus.cc:697] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02 [term 3 LEADER]: Becoming Leader. State: Replica: 16cf2b6947b24cebb090e03e8dfeba02, State: Running, Role: LEADER
I20260709 13:12:45.846946  6106 consensus_queue.cc:237] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:45.854205  5701 catalog_manager.cc:5697] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02 reported cstate change: term changed from 2 to 3, leader changed from 2e314036804542f7ab3e6550a903dceb (127.28.173.3) to 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2). New cstate: current_term: 3 leader_uuid: "16cf2b6947b24cebb090e03e8dfeba02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:45.890324  6159 raft_consensus.cc:3060] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:46.093727  6203 raft_consensus.cc:993] T 78f018edbabe49bc9ceafe6faf384bf0 P 16cf2b6947b24cebb090e03e8dfeba02: : Instructing follower 2e314036804542f7ab3e6550a903dceb to start an election
I20260709 13:12:46.094189  6106 raft_consensus.cc:1081] T 78f018edbabe49bc9ceafe6faf384bf0 P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 LEADER]: Signalling peer 2e314036804542f7ab3e6550a903dceb to start an election
I20260709 13:12:46.095624  5951 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78f018edbabe49bc9ceafe6faf384bf0"
dest_uuid: "2e314036804542f7ab3e6550a903dceb"
 from {username='slave'} at 127.0.0.1:42008
I20260709 13:12:46.096175  5951 raft_consensus.cc:493] T 78f018edbabe49bc9ceafe6faf384bf0 P 2e314036804542f7ab3e6550a903dceb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:46.096472  5951 raft_consensus.cc:3060] T 78f018edbabe49bc9ceafe6faf384bf0 P 2e314036804542f7ab3e6550a903dceb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:46.101181  5951 raft_consensus.cc:515] T 78f018edbabe49bc9ceafe6faf384bf0 P 2e314036804542f7ab3e6550a903dceb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:46.102600  5951 leader_election.cc:290] T 78f018edbabe49bc9ceafe6faf384bf0 P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 2 election: Requested vote from peers 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151), 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2:43579)
I20260709 13:12:46.103574  6159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f018edbabe49bc9ceafe6faf384bf0" candidate_uuid: "2e314036804542f7ab3e6550a903dceb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29"
I20260709 13:12:46.103574  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f018edbabe49bc9ceafe6faf384bf0" candidate_uuid: "2e314036804542f7ab3e6550a903dceb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "16cf2b6947b24cebb090e03e8dfeba02"
I20260709 13:12:46.104486  6159 raft_consensus.cc:3060] T 78f018edbabe49bc9ceafe6faf384bf0 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:46.104542  5878 raft_consensus.cc:3055] T 78f018edbabe49bc9ceafe6faf384bf0 P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:46.104947  5878 raft_consensus.cc:740] T 78f018edbabe49bc9ceafe6faf384bf0 P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 16cf2b6947b24cebb090e03e8dfeba02, State: Running, Role: LEADER
I20260709 13:12:46.105786  5878 consensus_queue.cc:260] T 78f018edbabe49bc9ceafe6faf384bf0 P 16cf2b6947b24cebb090e03e8dfeba02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:46.107004  5878 raft_consensus.cc:3060] T 78f018edbabe49bc9ceafe6faf384bf0 P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:46.111449  6159 raft_consensus.cc:2468] T 78f018edbabe49bc9ceafe6faf384bf0 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e314036804542f7ab3e6550a903dceb in term 2.
I20260709 13:12:46.112576  5916 leader_election.cc:304] T 78f018edbabe49bc9ceafe6faf384bf0 P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e314036804542f7ab3e6550a903dceb, 9e1828b5b7d244b8aa09a9b41d21fc29; no voters: 
I20260709 13:12:46.113124  5878 raft_consensus.cc:2468] T 78f018edbabe49bc9ceafe6faf384bf0 P 16cf2b6947b24cebb090e03e8dfeba02 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e314036804542f7ab3e6550a903dceb in term 2.
I20260709 13:12:46.113240  6107 raft_consensus.cc:2804] T 78f018edbabe49bc9ceafe6faf384bf0 P 2e314036804542f7ab3e6550a903dceb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:46.113947  6107 raft_consensus.cc:697] T 78f018edbabe49bc9ceafe6faf384bf0 P 2e314036804542f7ab3e6550a903dceb [term 2 LEADER]: Becoming Leader. State: Replica: 2e314036804542f7ab3e6550a903dceb, State: Running, Role: LEADER
I20260709 13:12:46.114881  6107 consensus_queue.cc:237] T 78f018edbabe49bc9ceafe6faf384bf0 P 2e314036804542f7ab3e6550a903dceb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:46.121263  5701 catalog_manager.cc:5697] T 78f018edbabe49bc9ceafe6faf384bf0 P 2e314036804542f7ab3e6550a903dceb reported cstate change: term changed from 1 to 2, leader changed from 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2) to 2e314036804542f7ab3e6550a903dceb (127.28.173.3). New cstate: current_term: 2 leader_uuid: "2e314036804542f7ab3e6550a903dceb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:46.340586  6159 raft_consensus.cc:1275] T 655c8f612f7c4806a849c5bf7fe918fe P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 3 FOLLOWER]: Refusing update from remote peer 16cf2b6947b24cebb090e03e8dfeba02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:46.341938  6106 consensus_queue.cc:1048] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:46.351857  5951 raft_consensus.cc:1275] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb [term 3 FOLLOWER]: Refusing update from remote peer 16cf2b6947b24cebb090e03e8dfeba02: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:46.353183  6211 consensus_queue.cc:1048] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:12:46.403162  5749 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:12:46.643558  6159 raft_consensus.cc:1275] T 78f018edbabe49bc9ceafe6faf384bf0 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 2 FOLLOWER]: Refusing update from remote peer 2e314036804542f7ab3e6550a903dceb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:46.644855  6202 consensus_queue.cc:1048] T 78f018edbabe49bc9ceafe6faf384bf0 P 2e314036804542f7ab3e6550a903dceb [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:46.655334  5878 raft_consensus.cc:1275] T 78f018edbabe49bc9ceafe6faf384bf0 P 16cf2b6947b24cebb090e03e8dfeba02 [term 2 FOLLOWER]: Refusing update from remote peer 2e314036804542f7ab3e6550a903dceb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:46.658738  6107 consensus_queue.cc:1048] T 78f018edbabe49bc9ceafe6faf384bf0 P 2e314036804542f7ab3e6550a903dceb [LEADER]: Connected to new peer: Peer: permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:46.744415 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:46.751739  5951 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1136e55740054ca2a51e4b28d073087f"
dest_uuid: "2e314036804542f7ab3e6550a903dceb"
mode: GRACEFUL
new_leader_uuid: "16cf2b6947b24cebb090e03e8dfeba02"
 from {username='slave'} at 127.0.0.1:42016
I20260709 13:12:46.752205  5951 raft_consensus.cc:606] T 1136e55740054ca2a51e4b28d073087f P 2e314036804542f7ab3e6550a903dceb [term 1 LEADER]: Received request to transfer leadership to TS 16cf2b6947b24cebb090e03e8dfeba02
I20260709 13:12:46.754426  5878 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e25e11d63324b2a8fb52c85459d4c03"
dest_uuid: "16cf2b6947b24cebb090e03e8dfeba02"
mode: GRACEFUL
new_leader_uuid: "2e314036804542f7ab3e6550a903dceb"
 from {username='slave'} at 127.0.0.1:44224
I20260709 13:12:46.754832  5878 raft_consensus.cc:606] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [term 2 LEADER]: Received request to transfer leadership to TS 2e314036804542f7ab3e6550a903dceb
I20260709 13:12:46.755944 29364 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:12:46.756443 29364 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:46.757022 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:46.941701  6213 raft_consensus.cc:993] T 1136e55740054ca2a51e4b28d073087f P 2e314036804542f7ab3e6550a903dceb: : Instructing follower 16cf2b6947b24cebb090e03e8dfeba02 to start an election
I20260709 13:12:46.942261  6202 raft_consensus.cc:1081] T 1136e55740054ca2a51e4b28d073087f P 2e314036804542f7ab3e6550a903dceb [term 1 LEADER]: Signalling peer 16cf2b6947b24cebb090e03e8dfeba02 to start an election
I20260709 13:12:46.943595  5878 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1136e55740054ca2a51e4b28d073087f"
dest_uuid: "16cf2b6947b24cebb090e03e8dfeba02"
 from {username='slave'} at 127.0.0.1:44216
I20260709 13:12:46.944094  5878 raft_consensus.cc:493] T 1136e55740054ca2a51e4b28d073087f P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:46.944367  5878 raft_consensus.cc:3060] T 1136e55740054ca2a51e4b28d073087f P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:46.948603  5878 raft_consensus.cc:515] T 1136e55740054ca2a51e4b28d073087f P 16cf2b6947b24cebb090e03e8dfeba02 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:46.950641  5878 leader_election.cc:290] T 1136e55740054ca2a51e4b28d073087f P 16cf2b6947b24cebb090e03e8dfeba02 [CANDIDATE]: Term 2 election: Requested vote from peers 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151), 2e314036804542f7ab3e6550a903dceb (127.28.173.3:32927)
I20260709 13:12:46.951282  6159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136e55740054ca2a51e4b28d073087f" candidate_uuid: "16cf2b6947b24cebb090e03e8dfeba02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29"
I20260709 13:12:46.951691  5951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136e55740054ca2a51e4b28d073087f" candidate_uuid: "16cf2b6947b24cebb090e03e8dfeba02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e314036804542f7ab3e6550a903dceb"
I20260709 13:12:46.951927  6159 raft_consensus.cc:3060] T 1136e55740054ca2a51e4b28d073087f P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:46.952280  5951 raft_consensus.cc:3055] T 1136e55740054ca2a51e4b28d073087f P 2e314036804542f7ab3e6550a903dceb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:46.952585  5951 raft_consensus.cc:740] T 1136e55740054ca2a51e4b28d073087f P 2e314036804542f7ab3e6550a903dceb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e314036804542f7ab3e6550a903dceb, State: Running, Role: LEADER
I20260709 13:12:46.953248  6106 raft_consensus.cc:993] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02: : Instructing follower 2e314036804542f7ab3e6550a903dceb to start an election
I20260709 13:12:46.953289  5951 consensus_queue.cc:260] T 1136e55740054ca2a51e4b28d073087f P 2e314036804542f7ab3e6550a903dceb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:46.953899  6211 raft_consensus.cc:1081] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [term 2 LEADER]: Signalling peer 2e314036804542f7ab3e6550a903dceb to start an election
I20260709 13:12:46.954738  5951 raft_consensus.cc:3060] T 1136e55740054ca2a51e4b28d073087f P 2e314036804542f7ab3e6550a903dceb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:46.955730  5950 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e25e11d63324b2a8fb52c85459d4c03"
dest_uuid: "2e314036804542f7ab3e6550a903dceb"
 from {username='slave'} at 127.0.0.1:42008
I20260709 13:12:46.956372  5950 raft_consensus.cc:493] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:46.956740  5950 raft_consensus.cc:3060] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:46.958956  6159 raft_consensus.cc:2468] T 1136e55740054ca2a51e4b28d073087f P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16cf2b6947b24cebb090e03e8dfeba02 in term 2.
I20260709 13:12:46.960451  5842 leader_election.cc:304] T 1136e55740054ca2a51e4b28d073087f P 16cf2b6947b24cebb090e03e8dfeba02 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16cf2b6947b24cebb090e03e8dfeba02, 9e1828b5b7d244b8aa09a9b41d21fc29; no voters: 
I20260709 13:12:46.960562  5951 raft_consensus.cc:2468] T 1136e55740054ca2a51e4b28d073087f P 2e314036804542f7ab3e6550a903dceb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16cf2b6947b24cebb090e03e8dfeba02 in term 2.
I20260709 13:12:46.961378  6211 raft_consensus.cc:2804] T 1136e55740054ca2a51e4b28d073087f P 16cf2b6947b24cebb090e03e8dfeba02 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:46.961922  6211 raft_consensus.cc:697] T 1136e55740054ca2a51e4b28d073087f P 16cf2b6947b24cebb090e03e8dfeba02 [term 2 LEADER]: Becoming Leader. State: Replica: 16cf2b6947b24cebb090e03e8dfeba02, State: Running, Role: LEADER
I20260709 13:12:46.963358  6211 consensus_queue.cc:237] T 1136e55740054ca2a51e4b28d073087f P 16cf2b6947b24cebb090e03e8dfeba02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:46.964689  5950 raft_consensus.cc:515] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:46.967537  6159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e25e11d63324b2a8fb52c85459d4c03" candidate_uuid: "2e314036804542f7ab3e6550a903dceb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29"
I20260709 13:12:46.968113  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e25e11d63324b2a8fb52c85459d4c03" candidate_uuid: "2e314036804542f7ab3e6550a903dceb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "16cf2b6947b24cebb090e03e8dfeba02"
I20260709 13:12:46.968231  6159 raft_consensus.cc:3060] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:46.968703  5878 raft_consensus.cc:3055] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:46.969036  5878 raft_consensus.cc:740] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 16cf2b6947b24cebb090e03e8dfeba02, State: Running, Role: LEADER
I20260709 13:12:46.969480  5950 leader_election.cc:290] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 3 election: Requested vote from peers 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151), 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2:43579)
I20260709 13:12:46.969777  5878 consensus_queue.cc:260] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:46.970820  5878 raft_consensus.cc:3060] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:46.971451  5699 catalog_manager.cc:5697] T 1136e55740054ca2a51e4b28d073087f P 16cf2b6947b24cebb090e03e8dfeba02 reported cstate change: term changed from 1 to 2, leader changed from 2e314036804542f7ab3e6550a903dceb (127.28.173.3) to 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2). New cstate: current_term: 2 leader_uuid: "16cf2b6947b24cebb090e03e8dfeba02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:46.976040  6159 raft_consensus.cc:2468] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e314036804542f7ab3e6550a903dceb in term 3.
I20260709 13:12:46.977097  5916 leader_election.cc:304] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e314036804542f7ab3e6550a903dceb, 9e1828b5b7d244b8aa09a9b41d21fc29; no voters: 
I20260709 13:12:46.977972  6202 raft_consensus.cc:2804] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:46.978543  6202 raft_consensus.cc:697] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [term 3 LEADER]: Becoming Leader. State: Replica: 2e314036804542f7ab3e6550a903dceb, State: Running, Role: LEADER
I20260709 13:12:46.977551  5878 raft_consensus.cc:2468] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e314036804542f7ab3e6550a903dceb in term 3.
I20260709 13:12:46.979578  6202 consensus_queue.cc:237] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:46.987084  5699 catalog_manager.cc:5697] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb reported cstate change: term changed from 2 to 3, leader changed from 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2) to 2e314036804542f7ab3e6550a903dceb (127.28.173.3). New cstate: current_term: 3 leader_uuid: "2e314036804542f7ab3e6550a903dceb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:47.404127  5749 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:12:47.422221  5950 raft_consensus.cc:1275] T 1136e55740054ca2a51e4b28d073087f P 2e314036804542f7ab3e6550a903dceb [term 2 FOLLOWER]: Refusing update from remote peer 16cf2b6947b24cebb090e03e8dfeba02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:47.423483  6211 consensus_queue.cc:1048] T 1136e55740054ca2a51e4b28d073087f P 16cf2b6947b24cebb090e03e8dfeba02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:47.432865  6158 raft_consensus.cc:1275] T 1136e55740054ca2a51e4b28d073087f P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 2 FOLLOWER]: Refusing update from remote peer 16cf2b6947b24cebb090e03e8dfeba02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:47.434934  6227 consensus_queue.cc:1048] T 1136e55740054ca2a51e4b28d073087f P 16cf2b6947b24cebb090e03e8dfeba02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:47.465214  6158 raft_consensus.cc:1275] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 3 FOLLOWER]: Refusing update from remote peer 2e314036804542f7ab3e6550a903dceb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:47.466488  6202 consensus_queue.cc:1048] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:47.473789  5878 raft_consensus.cc:1275] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [term 3 FOLLOWER]: Refusing update from remote peer 2e314036804542f7ab3e6550a903dceb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:47.475283  6202 consensus_queue.cc:1048] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [LEADER]: Connected to new peer: Peer: permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:47.763655 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:47.770888  5950 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e25e11d63324b2a8fb52c85459d4c03"
dest_uuid: "2e314036804542f7ab3e6550a903dceb"
mode: GRACEFUL
new_leader_uuid: "16cf2b6947b24cebb090e03e8dfeba02"
 from {username='slave'} at 127.0.0.1:42016
I20260709 13:12:47.771407  5950 raft_consensus.cc:606] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [term 3 LEADER]: Received request to transfer leadership to TS 16cf2b6947b24cebb090e03e8dfeba02
I20260709 13:12:47.774048  5876 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "655c8f612f7c4806a849c5bf7fe918fe"
dest_uuid: "16cf2b6947b24cebb090e03e8dfeba02"
mode: GRACEFUL
new_leader_uuid: "2e314036804542f7ab3e6550a903dceb"
 from {username='slave'} at 127.0.0.1:44224
I20260709 13:12:47.774502  5876 raft_consensus.cc:606] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02 [term 3 LEADER]: Received request to transfer leadership to TS 2e314036804542f7ab3e6550a903dceb
I20260709 13:12:47.775661 29364 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:12:47.776132 29364 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:47.776607 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:47.816556  6106 raft_consensus.cc:993] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02: : Instructing follower 2e314036804542f7ab3e6550a903dceb to start an election
I20260709 13:12:47.817162  6227 raft_consensus.cc:1081] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02 [term 3 LEADER]: Signalling peer 2e314036804542f7ab3e6550a903dceb to start an election
I20260709 13:12:47.818691  5950 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "655c8f612f7c4806a849c5bf7fe918fe"
dest_uuid: "2e314036804542f7ab3e6550a903dceb"
 from {username='slave'} at 127.0.0.1:42008
I20260709 13:12:47.819226  5950 raft_consensus.cc:493] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:47.819564  5950 raft_consensus.cc:3060] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:47.824828  5950 raft_consensus.cc:515] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:47.826491  5950 leader_election.cc:290] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 4 election: Requested vote from peers 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2:43579), 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151)
I20260709 13:12:47.827302  5876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655c8f612f7c4806a849c5bf7fe918fe" candidate_uuid: "2e314036804542f7ab3e6550a903dceb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "16cf2b6947b24cebb090e03e8dfeba02"
I20260709 13:12:47.827431  6159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "655c8f612f7c4806a849c5bf7fe918fe" candidate_uuid: "2e314036804542f7ab3e6550a903dceb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29"
I20260709 13:12:47.827960  5876 raft_consensus.cc:3055] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:47.828063  6159 raft_consensus.cc:3060] T 655c8f612f7c4806a849c5bf7fe918fe P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:47.828380  5876 raft_consensus.cc:740] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 16cf2b6947b24cebb090e03e8dfeba02, State: Running, Role: LEADER
I20260709 13:12:47.829159  5876 consensus_queue.cc:260] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:47.830331  5876 raft_consensus.cc:3060] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:47.834332  6159 raft_consensus.cc:2468] T 655c8f612f7c4806a849c5bf7fe918fe P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e314036804542f7ab3e6550a903dceb in term 4.
I20260709 13:12:47.836385  5916 leader_election.cc:304] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e314036804542f7ab3e6550a903dceb, 9e1828b5b7d244b8aa09a9b41d21fc29; no voters: 
I20260709 13:12:47.837330  6107 raft_consensus.cc:2804] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:47.837520  5876 raft_consensus.cc:2468] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e314036804542f7ab3e6550a903dceb in term 4.
I20260709 13:12:47.837730  6107 raft_consensus.cc:697] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb [term 4 LEADER]: Becoming Leader. State: Replica: 2e314036804542f7ab3e6550a903dceb, State: Running, Role: LEADER
I20260709 13:12:47.838632  6107 consensus_queue.cc:237] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:47.845016  5700 catalog_manager.cc:5697] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb reported cstate change: term changed from 3 to 4, leader changed from 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2) to 2e314036804542f7ab3e6550a903dceb (127.28.173.3). New cstate: current_term: 4 leader_uuid: "2e314036804542f7ab3e6550a903dceb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:47.899309  6213 raft_consensus.cc:993] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb: : Instructing follower 16cf2b6947b24cebb090e03e8dfeba02 to start an election
I20260709 13:12:47.899834  6213 raft_consensus.cc:1081] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [term 3 LEADER]: Signalling peer 16cf2b6947b24cebb090e03e8dfeba02 to start an election
I20260709 13:12:47.901923  5876 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e25e11d63324b2a8fb52c85459d4c03"
dest_uuid: "16cf2b6947b24cebb090e03e8dfeba02"
 from {username='slave'} at 127.0.0.1:44216
I20260709 13:12:47.902479  5876 raft_consensus.cc:493] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:47.902819  5876 raft_consensus.cc:3060] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:47.908023  5876 raft_consensus.cc:515] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:47.909508  5876 leader_election.cc:290] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [CANDIDATE]: Term 4 election: Requested vote from peers 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151), 2e314036804542f7ab3e6550a903dceb (127.28.173.3:32927)
I20260709 13:12:47.910317  6159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e25e11d63324b2a8fb52c85459d4c03" candidate_uuid: "16cf2b6947b24cebb090e03e8dfeba02" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29"
I20260709 13:12:47.910576  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e25e11d63324b2a8fb52c85459d4c03" candidate_uuid: "16cf2b6947b24cebb090e03e8dfeba02" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2e314036804542f7ab3e6550a903dceb"
I20260709 13:12:47.910974  6159 raft_consensus.cc:3060] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:47.911151  5950 raft_consensus.cc:3055] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:47.911538  5950 raft_consensus.cc:740] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2e314036804542f7ab3e6550a903dceb, State: Running, Role: LEADER
I20260709 13:12:47.912374  5950 consensus_queue.cc:260] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:47.913640  5950 raft_consensus.cc:3060] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:47.917886  6159 raft_consensus.cc:2468] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16cf2b6947b24cebb090e03e8dfeba02 in term 4.
I20260709 13:12:47.918977  5842 leader_election.cc:304] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16cf2b6947b24cebb090e03e8dfeba02, 9e1828b5b7d244b8aa09a9b41d21fc29; no voters: 
I20260709 13:12:47.919726  6227 raft_consensus.cc:2804] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:47.920238  6227 raft_consensus.cc:697] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [term 4 LEADER]: Becoming Leader. State: Replica: 16cf2b6947b24cebb090e03e8dfeba02, State: Running, Role: LEADER
I20260709 13:12:47.921083  5950 raft_consensus.cc:2468] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16cf2b6947b24cebb090e03e8dfeba02 in term 4.
I20260709 13:12:47.920929  6227 consensus_queue.cc:237] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:47.926954  5700 catalog_manager.cc:5697] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 reported cstate change: term changed from 3 to 4, leader changed from 2e314036804542f7ab3e6550a903dceb (127.28.173.3) to 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2). New cstate: current_term: 4 leader_uuid: "16cf2b6947b24cebb090e03e8dfeba02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:48.268834  6159 raft_consensus.cc:1275] T 655c8f612f7c4806a849c5bf7fe918fe P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 4 FOLLOWER]: Refusing update from remote peer 2e314036804542f7ab3e6550a903dceb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:48.270071  6107 consensus_queue.cc:1048] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:48.279425  5876 raft_consensus.cc:1275] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02 [term 4 FOLLOWER]: Refusing update from remote peer 2e314036804542f7ab3e6550a903dceb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:48.280979  6213 consensus_queue.cc:1048] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb [LEADER]: Connected to new peer: Peer: permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:48.334925  5950 raft_consensus.cc:1275] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [term 4 FOLLOWER]: Refusing update from remote peer 16cf2b6947b24cebb090e03e8dfeba02: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:48.336130  6227 consensus_queue.cc:1048] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:48.343621  6159 raft_consensus.cc:1275] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 4 FOLLOWER]: Refusing update from remote peer 16cf2b6947b24cebb090e03e8dfeba02: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:48.345772  6211 consensus_queue.cc:1048] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:12:48.404990  5749 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:12:48.783288 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:48.790405  5950 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22576e8937fb4cd2bbff5a4dd7030308"
dest_uuid: "2e314036804542f7ab3e6550a903dceb"
mode: GRACEFUL
new_leader_uuid: "16cf2b6947b24cebb090e03e8dfeba02"
 from {username='slave'} at 127.0.0.1:42016
I20260709 13:12:48.790954  5950 raft_consensus.cc:606] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb [term 1 LEADER]: Received request to transfer leadership to TS 16cf2b6947b24cebb090e03e8dfeba02
I20260709 13:12:48.793671  5878 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e25e11d63324b2a8fb52c85459d4c03"
dest_uuid: "16cf2b6947b24cebb090e03e8dfeba02"
mode: GRACEFUL
new_leader_uuid: "2e314036804542f7ab3e6550a903dceb"
 from {username='slave'} at 127.0.0.1:44224
I20260709 13:12:48.794130  5878 raft_consensus.cc:606] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [term 4 LEADER]: Received request to transfer leadership to TS 2e314036804542f7ab3e6550a903dceb
I20260709 13:12:48.795154 29364 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:12:48.795750 29364 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:48.796340 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:48.927664  6227 raft_consensus.cc:993] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02: : Instructing follower 2e314036804542f7ab3e6550a903dceb to start an election
I20260709 13:12:48.928162  6211 raft_consensus.cc:1081] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [term 4 LEADER]: Signalling peer 2e314036804542f7ab3e6550a903dceb to start an election
I20260709 13:12:48.929512  5950 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e25e11d63324b2a8fb52c85459d4c03"
dest_uuid: "2e314036804542f7ab3e6550a903dceb"
 from {username='slave'} at 127.0.0.1:42008
I20260709 13:12:48.929982  5950 raft_consensus.cc:493] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:48.930290  5950 raft_consensus.cc:3060] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:48.935539  5950 raft_consensus.cc:515] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:48.937075  5950 leader_election.cc:290] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 5 election: Requested vote from peers 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151), 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2:43579)
I20260709 13:12:48.937986  6159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e25e11d63324b2a8fb52c85459d4c03" candidate_uuid: "2e314036804542f7ab3e6550a903dceb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29"
I20260709 13:12:48.938246  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e25e11d63324b2a8fb52c85459d4c03" candidate_uuid: "2e314036804542f7ab3e6550a903dceb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "16cf2b6947b24cebb090e03e8dfeba02"
I20260709 13:12:48.938537  6159 raft_consensus.cc:3060] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:48.938798  5878 raft_consensus.cc:3055] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:48.939116  5878 raft_consensus.cc:740] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 16cf2b6947b24cebb090e03e8dfeba02, State: Running, Role: LEADER
I20260709 13:12:48.939736  5878 consensus_queue.cc:260] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:48.940609  5878 raft_consensus.cc:3060] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:48.943454  6159 raft_consensus.cc:2468] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e314036804542f7ab3e6550a903dceb in term 5.
I20260709 13:12:48.944533  5916 leader_election.cc:304] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e314036804542f7ab3e6550a903dceb, 9e1828b5b7d244b8aa09a9b41d21fc29; no voters: 
I20260709 13:12:48.945246  6213 raft_consensus.cc:2804] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:48.945333  5878 raft_consensus.cc:2468] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e314036804542f7ab3e6550a903dceb in term 5.
I20260709 13:12:48.946045  6213 raft_consensus.cc:697] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [term 5 LEADER]: Becoming Leader. State: Replica: 2e314036804542f7ab3e6550a903dceb, State: Running, Role: LEADER
I20260709 13:12:48.946872  6213 consensus_queue.cc:237] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:48.952446  5700 catalog_manager.cc:5697] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb reported cstate change: term changed from 4 to 5, leader changed from 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2) to 2e314036804542f7ab3e6550a903dceb (127.28.173.3). New cstate: current_term: 5 leader_uuid: "2e314036804542f7ab3e6550a903dceb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:49.338415  6202 raft_consensus.cc:993] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb: : Instructing follower 16cf2b6947b24cebb090e03e8dfeba02 to start an election
I20260709 13:12:49.338910  6213 raft_consensus.cc:1081] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb [term 1 LEADER]: Signalling peer 16cf2b6947b24cebb090e03e8dfeba02 to start an election
I20260709 13:12:49.340445  5878 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22576e8937fb4cd2bbff5a4dd7030308"
dest_uuid: "16cf2b6947b24cebb090e03e8dfeba02"
 from {username='slave'} at 127.0.0.1:44216
I20260709 13:12:49.340868  5878 raft_consensus.cc:493] T 22576e8937fb4cd2bbff5a4dd7030308 P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:49.341180  5878 raft_consensus.cc:3060] T 22576e8937fb4cd2bbff5a4dd7030308 P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:49.345993  5878 raft_consensus.cc:515] T 22576e8937fb4cd2bbff5a4dd7030308 P 16cf2b6947b24cebb090e03e8dfeba02 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:49.347368  5878 leader_election.cc:290] T 22576e8937fb4cd2bbff5a4dd7030308 P 16cf2b6947b24cebb090e03e8dfeba02 [CANDIDATE]: Term 2 election: Requested vote from peers 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151), 2e314036804542f7ab3e6550a903dceb (127.28.173.3:32927)
I20260709 13:12:49.348110  6159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22576e8937fb4cd2bbff5a4dd7030308" candidate_uuid: "16cf2b6947b24cebb090e03e8dfeba02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29"
I20260709 13:12:49.348382  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22576e8937fb4cd2bbff5a4dd7030308" candidate_uuid: "16cf2b6947b24cebb090e03e8dfeba02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e314036804542f7ab3e6550a903dceb"
I20260709 13:12:49.348660  6159 raft_consensus.cc:3060] T 22576e8937fb4cd2bbff5a4dd7030308 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:49.349021  5950 raft_consensus.cc:3055] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:49.349315  5950 raft_consensus.cc:740] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e314036804542f7ab3e6550a903dceb, State: Running, Role: LEADER
I20260709 13:12:49.349975  5950 consensus_queue.cc:260] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:49.350997  5950 raft_consensus.cc:3060] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:49.353477  6159 raft_consensus.cc:2468] T 22576e8937fb4cd2bbff5a4dd7030308 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16cf2b6947b24cebb090e03e8dfeba02 in term 2.
I20260709 13:12:49.354398  5842 leader_election.cc:304] T 22576e8937fb4cd2bbff5a4dd7030308 P 16cf2b6947b24cebb090e03e8dfeba02 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16cf2b6947b24cebb090e03e8dfeba02, 9e1828b5b7d244b8aa09a9b41d21fc29; no voters: 
I20260709 13:12:49.355137  6211 raft_consensus.cc:2804] T 22576e8937fb4cd2bbff5a4dd7030308 P 16cf2b6947b24cebb090e03e8dfeba02 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:49.355556  6211 raft_consensus.cc:697] T 22576e8937fb4cd2bbff5a4dd7030308 P 16cf2b6947b24cebb090e03e8dfeba02 [term 2 LEADER]: Becoming Leader. State: Replica: 16cf2b6947b24cebb090e03e8dfeba02, State: Running, Role: LEADER
I20260709 13:12:49.356281  5950 raft_consensus.cc:2468] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16cf2b6947b24cebb090e03e8dfeba02 in term 2.
I20260709 13:12:49.356382  6211 consensus_queue.cc:237] T 22576e8937fb4cd2bbff5a4dd7030308 P 16cf2b6947b24cebb090e03e8dfeba02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:49.363503  5699 catalog_manager.cc:5697] T 22576e8937fb4cd2bbff5a4dd7030308 P 16cf2b6947b24cebb090e03e8dfeba02 reported cstate change: term changed from 1 to 2, leader changed from 2e314036804542f7ab3e6550a903dceb (127.28.173.3) to 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2). New cstate: current_term: 2 leader_uuid: "16cf2b6947b24cebb090e03e8dfeba02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:49.405930  5749 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:12:49.430981  5878 raft_consensus.cc:1275] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [term 5 FOLLOWER]: Refusing update from remote peer 2e314036804542f7ab3e6550a903dceb: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:12:49.432395  6213 consensus_queue.cc:1048] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [LEADER]: Connected to new peer: Peer: permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:49.442060  6159 raft_consensus.cc:1275] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 5 FOLLOWER]: Refusing update from remote peer 2e314036804542f7ab3e6550a903dceb: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:12:49.444100  6202 consensus_queue.cc:1048] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:12:49.802238 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:49.809257  5878 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22576e8937fb4cd2bbff5a4dd7030308"
dest_uuid: "16cf2b6947b24cebb090e03e8dfeba02"
mode: GRACEFUL
new_leader_uuid: "2e314036804542f7ab3e6550a903dceb"
 from {username='slave'} at 127.0.0.1:44224
I20260709 13:12:49.809772  5878 raft_consensus.cc:606] T 22576e8937fb4cd2bbff5a4dd7030308 P 16cf2b6947b24cebb090e03e8dfeba02 [term 2 LEADER]: Received request to transfer leadership to TS 2e314036804542f7ab3e6550a903dceb
I20260709 13:12:49.812521  5950 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e25e11d63324b2a8fb52c85459d4c03"
dest_uuid: "2e314036804542f7ab3e6550a903dceb"
mode: GRACEFUL
new_leader_uuid: "16cf2b6947b24cebb090e03e8dfeba02"
 from {username='slave'} at 127.0.0.1:42016
I20260709 13:12:49.812994  5950 raft_consensus.cc:606] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [term 5 LEADER]: Received request to transfer leadership to TS 16cf2b6947b24cebb090e03e8dfeba02
I20260709 13:12:49.814018 29364 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:12:49.814433 29364 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:49.814903 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:49.838706  6159 raft_consensus.cc:1275] T 22576e8937fb4cd2bbff5a4dd7030308 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 2 FOLLOWER]: Refusing update from remote peer 16cf2b6947b24cebb090e03e8dfeba02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:49.840059  6211 consensus_queue.cc:1048] T 22576e8937fb4cd2bbff5a4dd7030308 P 16cf2b6947b24cebb090e03e8dfeba02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:49.849664  5950 raft_consensus.cc:1275] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb [term 2 FOLLOWER]: Refusing update from remote peer 16cf2b6947b24cebb090e03e8dfeba02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:49.851091  6211 consensus_queue.cc:1048] T 22576e8937fb4cd2bbff5a4dd7030308 P 16cf2b6947b24cebb090e03e8dfeba02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:49.859798  6259 raft_consensus.cc:993] T 22576e8937fb4cd2bbff5a4dd7030308 P 16cf2b6947b24cebb090e03e8dfeba02: : Instructing follower 2e314036804542f7ab3e6550a903dceb to start an election
I20260709 13:12:49.860301  6211 raft_consensus.cc:1081] T 22576e8937fb4cd2bbff5a4dd7030308 P 16cf2b6947b24cebb090e03e8dfeba02 [term 2 LEADER]: Signalling peer 2e314036804542f7ab3e6550a903dceb to start an election
I20260709 13:12:49.861637  5950 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22576e8937fb4cd2bbff5a4dd7030308"
dest_uuid: "2e314036804542f7ab3e6550a903dceb"
 from {username='slave'} at 127.0.0.1:42008
I20260709 13:12:49.862183  5950 raft_consensus.cc:493] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:49.862576  5950 raft_consensus.cc:3060] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:49.868045  5950 raft_consensus.cc:515] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:49.871418  5950 leader_election.cc:290] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 3 election: Requested vote from peers 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151), 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2:43579)
I20260709 13:12:49.872141  6159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22576e8937fb4cd2bbff5a4dd7030308" candidate_uuid: "2e314036804542f7ab3e6550a903dceb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29"
I20260709 13:12:49.872457  5878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22576e8937fb4cd2bbff5a4dd7030308" candidate_uuid: "2e314036804542f7ab3e6550a903dceb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "16cf2b6947b24cebb090e03e8dfeba02"
I20260709 13:12:49.872819  6159 raft_consensus.cc:3060] T 22576e8937fb4cd2bbff5a4dd7030308 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:49.872984  5878 raft_consensus.cc:3055] T 22576e8937fb4cd2bbff5a4dd7030308 P 16cf2b6947b24cebb090e03e8dfeba02 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:49.873338  5878 raft_consensus.cc:740] T 22576e8937fb4cd2bbff5a4dd7030308 P 16cf2b6947b24cebb090e03e8dfeba02 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 16cf2b6947b24cebb090e03e8dfeba02, State: Running, Role: LEADER
I20260709 13:12:49.874035  5878 consensus_queue.cc:260] T 22576e8937fb4cd2bbff5a4dd7030308 P 16cf2b6947b24cebb090e03e8dfeba02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:49.874981  5878 raft_consensus.cc:3060] T 22576e8937fb4cd2bbff5a4dd7030308 P 16cf2b6947b24cebb090e03e8dfeba02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:49.879366  6159 raft_consensus.cc:2468] T 22576e8937fb4cd2bbff5a4dd7030308 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e314036804542f7ab3e6550a903dceb in term 3.
I20260709 13:12:49.880383  5916 leader_election.cc:304] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e314036804542f7ab3e6550a903dceb, 9e1828b5b7d244b8aa09a9b41d21fc29; no voters: 
I20260709 13:12:49.881067  6202 raft_consensus.cc:2804] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:49.881541  6202 raft_consensus.cc:697] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb [term 3 LEADER]: Becoming Leader. State: Replica: 2e314036804542f7ab3e6550a903dceb, State: Running, Role: LEADER
I20260709 13:12:49.881791  5878 raft_consensus.cc:2468] T 22576e8937fb4cd2bbff5a4dd7030308 P 16cf2b6947b24cebb090e03e8dfeba02 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e314036804542f7ab3e6550a903dceb in term 3.
I20260709 13:12:49.882332  6202 consensus_queue.cc:237] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:49.888253  5700 catalog_manager.cc:5697] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb reported cstate change: term changed from 2 to 3, leader changed from 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2) to 2e314036804542f7ab3e6550a903dceb (127.28.173.3). New cstate: current_term: 3 leader_uuid: "2e314036804542f7ab3e6550a903dceb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:49.929474  6213 raft_consensus.cc:993] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb: : Instructing follower 16cf2b6947b24cebb090e03e8dfeba02 to start an election
I20260709 13:12:49.929874  6202 raft_consensus.cc:1081] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [term 5 LEADER]: Signalling peer 16cf2b6947b24cebb090e03e8dfeba02 to start an election
I20260709 13:12:49.931147  5878 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e25e11d63324b2a8fb52c85459d4c03"
dest_uuid: "16cf2b6947b24cebb090e03e8dfeba02"
 from {username='slave'} at 127.0.0.1:44216
I20260709 13:12:49.931576  5878 raft_consensus.cc:493] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:49.931864  5878 raft_consensus.cc:3060] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:49.936599  5878 raft_consensus.cc:515] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:49.937932  5878 leader_election.cc:290] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [CANDIDATE]: Term 6 election: Requested vote from peers 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151), 2e314036804542f7ab3e6550a903dceb (127.28.173.3:32927)
I20260709 13:12:49.938608  6159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e25e11d63324b2a8fb52c85459d4c03" candidate_uuid: "16cf2b6947b24cebb090e03e8dfeba02" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29"
I20260709 13:12:49.938855  5950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e25e11d63324b2a8fb52c85459d4c03" candidate_uuid: "16cf2b6947b24cebb090e03e8dfeba02" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "2e314036804542f7ab3e6550a903dceb"
I20260709 13:12:49.939175  6159 raft_consensus.cc:3060] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:49.939397  5950 raft_consensus.cc:3055] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:49.939740  5950 raft_consensus.cc:740] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2e314036804542f7ab3e6550a903dceb, State: Running, Role: LEADER
I20260709 13:12:49.940385  5950 consensus_queue.cc:260] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:49.941289  5950 raft_consensus.cc:3060] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:49.944094  6159 raft_consensus.cc:2468] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16cf2b6947b24cebb090e03e8dfeba02 in term 6.
I20260709 13:12:49.945045  5842 leader_election.cc:304] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16cf2b6947b24cebb090e03e8dfeba02, 9e1828b5b7d244b8aa09a9b41d21fc29; no voters: 
I20260709 13:12:49.945644  6211 raft_consensus.cc:2804] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:49.946041  6211 raft_consensus.cc:697] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [term 6 LEADER]: Becoming Leader. State: Replica: 16cf2b6947b24cebb090e03e8dfeba02, State: Running, Role: LEADER
I20260709 13:12:49.946115  5950 raft_consensus.cc:2468] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16cf2b6947b24cebb090e03e8dfeba02 in term 6.
I20260709 13:12:49.946897  6211 consensus_queue.cc:237] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } }
I20260709 13:12:49.952544  5700 catalog_manager.cc:5697] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 reported cstate change: term changed from 5 to 6, leader changed from 2e314036804542f7ab3e6550a903dceb (127.28.173.3) to 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2). New cstate: current_term: 6 leader_uuid: "16cf2b6947b24cebb090e03e8dfeba02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:50.330039  5878 raft_consensus.cc:1275] T 22576e8937fb4cd2bbff5a4dd7030308 P 16cf2b6947b24cebb090e03e8dfeba02 [term 3 FOLLOWER]: Refusing update from remote peer 2e314036804542f7ab3e6550a903dceb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:50.331302  6202 consensus_queue.cc:1048] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb [LEADER]: Connected to new peer: Peer: permanent_uuid: "16cf2b6947b24cebb090e03e8dfeba02" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 43579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:50.338563  6159 raft_consensus.cc:1275] T 22576e8937fb4cd2bbff5a4dd7030308 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 3 FOLLOWER]: Refusing update from remote peer 2e314036804542f7ab3e6550a903dceb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:50.340348  6213 consensus_queue.cc:1048] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:12:50.407032  5749 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:12:50.455559  5950 raft_consensus.cc:1275] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [term 6 FOLLOWER]: Refusing update from remote peer 16cf2b6947b24cebb090e03e8dfeba02: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:12:50.457245  6211 consensus_queue.cc:1048] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e314036804542f7ab3e6550a903dceb" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 32927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:50.469319  6159 raft_consensus.cc:1275] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 6 FOLLOWER]: Refusing update from remote peer 16cf2b6947b24cebb090e03e8dfeba02: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:12:50.470507  6211 consensus_queue.cc:1048] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e1828b5b7d244b8aa09a9b41d21fc29" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 44151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:50.820621 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:50.848838 29364 tablet_server.cc:179] TabletServer@127.28.173.1:44151 shutting down...
W20260709 13:12:50.860383  5916 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
W20260709 13:12:50.865628  5916 consensus_peers.cc:597] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb -> Peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Couldn't send request to peer 9e1828b5b7d244b8aa09a9b41d21fc29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:50.873287 29364 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:50.874068 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:50.874799 29364 raft_consensus.cc:2243] T cfdc7563ffb04da99d981061fdfd0507 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:50.875262 29364 raft_consensus.cc:2272] T cfdc7563ffb04da99d981061fdfd0507 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:50.877112 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:50.877660 29364 raft_consensus.cc:2243] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:50.878114 29364 raft_consensus.cc:2272] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:50.879878 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:50.880450 29364 raft_consensus.cc:2243] T f0c6edfa14e84779a8dc712956946605 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:50.880856 29364 raft_consensus.cc:2272] T f0c6edfa14e84779a8dc712956946605 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:50.882516 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:50.883025 29364 raft_consensus.cc:2243] T e087d3db165b428d9581b8782836ed0f P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:50.883467 29364 raft_consensus.cc:2272] T e087d3db165b428d9581b8782836ed0f P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:50.885285 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:50.885761 29364 raft_consensus.cc:2243] T 22576e8937fb4cd2bbff5a4dd7030308 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:50.886143 29364 raft_consensus.cc:2272] T 22576e8937fb4cd2bbff5a4dd7030308 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:50.888196 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:50.888710 29364 raft_consensus.cc:2243] T 655c8f612f7c4806a849c5bf7fe918fe P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:50.889110 29364 raft_consensus.cc:2272] T 655c8f612f7c4806a849c5bf7fe918fe P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:50.890717 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:50.891211 29364 raft_consensus.cc:2243] T 1136e55740054ca2a51e4b28d073087f P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:50.891623 29364 raft_consensus.cc:2272] T 1136e55740054ca2a51e4b28d073087f P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:50.893404 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:50.893882 29364 raft_consensus.cc:2243] T 5b2bd404001649699134812445fa01f7 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:50.894308 29364 raft_consensus.cc:2272] T 5b2bd404001649699134812445fa01f7 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:50.895994 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:50.896453 29364 raft_consensus.cc:2243] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:50.896874 29364 raft_consensus.cc:2272] T 3e25e11d63324b2a8fb52c85459d4c03 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:50.901252 29364 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:50.901860 29364 raft_consensus.cc:2243] T 78f018edbabe49bc9ceafe6faf384bf0 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:12:50.901873  5842 consensus_peers.cc:597] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 -> Peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Couldn't send request to peer 9e1828b5b7d244b8aa09a9b41d21fc29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:50.902427 29364 raft_consensus.cc:2272] T 78f018edbabe49bc9ceafe6faf384bf0 P 9e1828b5b7d244b8aa09a9b41d21fc29 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:50.930624 29364 tablet_server.cc:196] TabletServer@127.28.173.1:44151 shutdown complete.
I20260709 13:12:50.948087 29364 tablet_server.cc:179] TabletServer@127.28.173.2:0 shutting down...
W20260709 13:12:50.966444  5916 consensus_peers.cc:597] T 78f018edbabe49bc9ceafe6faf384bf0 P 2e314036804542f7ab3e6550a903dceb -> Peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Couldn't send request to peer 9e1828b5b7d244b8aa09a9b41d21fc29. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:44151: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:50.973440 29364 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:50.974233 29364 tablet_replica.cc:333] T cfdc7563ffb04da99d981061fdfd0507 P 16cf2b6947b24cebb090e03e8dfeba02: stopping tablet replica
I20260709 13:12:50.974970 29364 raft_consensus.cc:2243] T cfdc7563ffb04da99d981061fdfd0507 P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:50.975603 29364 raft_consensus.cc:2272] T cfdc7563ffb04da99d981061fdfd0507 P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:50.977924 29364 tablet_replica.cc:333] T 78f018edbabe49bc9ceafe6faf384bf0 P 16cf2b6947b24cebb090e03e8dfeba02: stopping tablet replica
I20260709 13:12:50.978853 29364 raft_consensus.cc:2243] T 78f018edbabe49bc9ceafe6faf384bf0 P 16cf2b6947b24cebb090e03e8dfeba02 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:50.979208 29364 raft_consensus.cc:2272] T 78f018edbabe49bc9ceafe6faf384bf0 P 16cf2b6947b24cebb090e03e8dfeba02 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:50.981036 29364 tablet_replica.cc:333] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02: stopping tablet replica
I20260709 13:12:50.981530 29364 raft_consensus.cc:2243] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [term 6 LEADER]: Raft consensus shutting down.
I20260709 13:12:50.982234 29364 raft_consensus.cc:2272] T 3e25e11d63324b2a8fb52c85459d4c03 P 16cf2b6947b24cebb090e03e8dfeba02 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:50.985291 29364 tablet_replica.cc:333] T f0c6edfa14e84779a8dc712956946605 P 16cf2b6947b24cebb090e03e8dfeba02: stopping tablet replica
I20260709 13:12:50.985823 29364 raft_consensus.cc:2243] T f0c6edfa14e84779a8dc712956946605 P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:50.986490 29364 raft_consensus.cc:2272] T f0c6edfa14e84779a8dc712956946605 P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:50.988646 29364 tablet_replica.cc:333] T 22576e8937fb4cd2bbff5a4dd7030308 P 16cf2b6947b24cebb090e03e8dfeba02: stopping tablet replica
I20260709 13:12:50.989082 29364 raft_consensus.cc:2243] T 22576e8937fb4cd2bbff5a4dd7030308 P 16cf2b6947b24cebb090e03e8dfeba02 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:50.989421 29364 raft_consensus.cc:2272] T 22576e8937fb4cd2bbff5a4dd7030308 P 16cf2b6947b24cebb090e03e8dfeba02 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:50.991462 29364 tablet_replica.cc:333] T e087d3db165b428d9581b8782836ed0f P 16cf2b6947b24cebb090e03e8dfeba02: stopping tablet replica
I20260709 13:12:50.991979 29364 raft_consensus.cc:2243] T e087d3db165b428d9581b8782836ed0f P 16cf2b6947b24cebb090e03e8dfeba02 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:50.992370 29364 raft_consensus.cc:2272] T e087d3db165b428d9581b8782836ed0f P 16cf2b6947b24cebb090e03e8dfeba02 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:50.994207 29364 tablet_replica.cc:333] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 16cf2b6947b24cebb090e03e8dfeba02: stopping tablet replica
I20260709 13:12:50.994645 29364 raft_consensus.cc:2243] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:50.995316 29364 raft_consensus.cc:2272] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 16cf2b6947b24cebb090e03e8dfeba02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:50.997910 29364 tablet_replica.cc:333] T 1136e55740054ca2a51e4b28d073087f P 16cf2b6947b24cebb090e03e8dfeba02: stopping tablet replica
I20260709 13:12:50.998705 29364 raft_consensus.cc:2243] T 1136e55740054ca2a51e4b28d073087f P 16cf2b6947b24cebb090e03e8dfeba02 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:50.999769 29364 raft_consensus.cc:2272] T 1136e55740054ca2a51e4b28d073087f P 16cf2b6947b24cebb090e03e8dfeba02 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:51.002493 29364 tablet_replica.cc:333] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02: stopping tablet replica
I20260709 13:12:51.003163 29364 raft_consensus.cc:2243] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:51.003645 29364 raft_consensus.cc:2272] T 655c8f612f7c4806a849c5bf7fe918fe P 16cf2b6947b24cebb090e03e8dfeba02 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:51.006048 29364 tablet_replica.cc:333] T 5b2bd404001649699134812445fa01f7 P 16cf2b6947b24cebb090e03e8dfeba02: stopping tablet replica
I20260709 13:12:51.006678 29364 raft_consensus.cc:2243] T 5b2bd404001649699134812445fa01f7 P 16cf2b6947b24cebb090e03e8dfeba02 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:51.007830 29364 raft_consensus.cc:2272] T 5b2bd404001649699134812445fa01f7 P 16cf2b6947b24cebb090e03e8dfeba02 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:51.061676 29364 tablet_server.cc:196] TabletServer@127.28.173.2:0 shutdown complete.
W20260709 13:12:51.078166  5916 consensus_peers.cc:597] T cfdc7563ffb04da99d981061fdfd0507 P 2e314036804542f7ab3e6550a903dceb -> Peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Couldn't send request to peer 9e1828b5b7d244b8aa09a9b41d21fc29. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:44151: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:51.087852 29364 tablet_server.cc:179] TabletServer@127.28.173.3:0 shutting down...
W20260709 13:12:51.094157  5916 consensus_peers.cc:597] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb -> Peer 9e1828b5b7d244b8aa09a9b41d21fc29 (127.28.173.1:44151): Couldn't send request to peer 9e1828b5b7d244b8aa09a9b41d21fc29. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:44151: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:51.116591 29364 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:51.117285 29364 tablet_replica.cc:333] T 5b2bd404001649699134812445fa01f7 P 2e314036804542f7ab3e6550a903dceb: stopping tablet replica
I20260709 13:12:51.117991 29364 raft_consensus.cc:2243] T 5b2bd404001649699134812445fa01f7 P 2e314036804542f7ab3e6550a903dceb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:51.118460 29364 raft_consensus.cc:2272] T 5b2bd404001649699134812445fa01f7 P 2e314036804542f7ab3e6550a903dceb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:51.120517 29364 tablet_replica.cc:333] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb: stopping tablet replica
I20260709 13:12:51.121071 29364 raft_consensus.cc:2243] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:12:51.121836 29364 raft_consensus.cc:2272] T 655c8f612f7c4806a849c5bf7fe918fe P 2e314036804542f7ab3e6550a903dceb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:51.123952 29364 tablet_replica.cc:333] T 1136e55740054ca2a51e4b28d073087f P 2e314036804542f7ab3e6550a903dceb: stopping tablet replica
I20260709 13:12:51.124513 29364 raft_consensus.cc:2243] T 1136e55740054ca2a51e4b28d073087f P 2e314036804542f7ab3e6550a903dceb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:51.124917 29364 raft_consensus.cc:2272] T 1136e55740054ca2a51e4b28d073087f P 2e314036804542f7ab3e6550a903dceb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:51.127336 29364 tablet_replica.cc:333] T cfdc7563ffb04da99d981061fdfd0507 P 2e314036804542f7ab3e6550a903dceb: stopping tablet replica
I20260709 13:12:51.127933 29364 raft_consensus.cc:2243] T cfdc7563ffb04da99d981061fdfd0507 P 2e314036804542f7ab3e6550a903dceb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:51.128708 29364 raft_consensus.cc:2272] T cfdc7563ffb04da99d981061fdfd0507 P 2e314036804542f7ab3e6550a903dceb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:51.130455  5917 consensus_peers.cc:597] T e087d3db165b428d9581b8782836ed0f P 2e314036804542f7ab3e6550a903dceb -> Peer 16cf2b6947b24cebb090e03e8dfeba02 (127.28.173.2:43579): Couldn't send request to peer 16cf2b6947b24cebb090e03e8dfeba02. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.2:43579: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:51.130971 29364 tablet_replica.cc:333] T f0c6edfa14e84779a8dc712956946605 P 2e314036804542f7ab3e6550a903dceb: stopping tablet replica
I20260709 13:12:51.131547 29364 raft_consensus.cc:2243] T f0c6edfa14e84779a8dc712956946605 P 2e314036804542f7ab3e6550a903dceb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:51.132010 29364 raft_consensus.cc:2272] T f0c6edfa14e84779a8dc712956946605 P 2e314036804542f7ab3e6550a903dceb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:51.134004 29364 tablet_replica.cc:333] T e087d3db165b428d9581b8782836ed0f P 2e314036804542f7ab3e6550a903dceb: stopping tablet replica
I20260709 13:12:51.134511 29364 raft_consensus.cc:2243] T e087d3db165b428d9581b8782836ed0f P 2e314036804542f7ab3e6550a903dceb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:51.135255 29364 raft_consensus.cc:2272] T e087d3db165b428d9581b8782836ed0f P 2e314036804542f7ab3e6550a903dceb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:51.137357 29364 tablet_replica.cc:333] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb: stopping tablet replica
I20260709 13:12:51.137892 29364 raft_consensus.cc:2243] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:51.138586 29364 raft_consensus.cc:2272] T 22576e8937fb4cd2bbff5a4dd7030308 P 2e314036804542f7ab3e6550a903dceb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:51.141691 29364 tablet_replica.cc:333] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 2e314036804542f7ab3e6550a903dceb: stopping tablet replica
I20260709 13:12:51.142185 29364 raft_consensus.cc:2243] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 2e314036804542f7ab3e6550a903dceb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:51.142577 29364 raft_consensus.cc:2272] T 31ba0196ac9648b38f2f1a7eb8513dd5 P 2e314036804542f7ab3e6550a903dceb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:51.144440 29364 tablet_replica.cc:333] T 78f018edbabe49bc9ceafe6faf384bf0 P 2e314036804542f7ab3e6550a903dceb: stopping tablet replica
I20260709 13:12:51.144908 29364 raft_consensus.cc:2243] T 78f018edbabe49bc9ceafe6faf384bf0 P 2e314036804542f7ab3e6550a903dceb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:51.145643 29364 raft_consensus.cc:2272] T 78f018edbabe49bc9ceafe6faf384bf0 P 2e314036804542f7ab3e6550a903dceb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:51.147558 29364 tablet_replica.cc:333] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb: stopping tablet replica
I20260709 13:12:51.148198 29364 raft_consensus.cc:2243] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:51.148715 29364 raft_consensus.cc:2272] T 3e25e11d63324b2a8fb52c85459d4c03 P 2e314036804542f7ab3e6550a903dceb [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:51.180240 29364 tablet_server.cc:196] TabletServer@127.28.173.3:0 shutdown complete.
I20260709 13:12:51.202428 29364 master.cc:562] Master@127.28.173.62:39211 shutting down...
I20260709 13:12:51.231211 29364 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 953c4ff5dd204fbbb88a1a5b1b2610c1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:51.231776 29364 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 953c4ff5dd204fbbb88a1a5b1b2610c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:51.232185 29364 tablet_replica.cc:333] T 00000000000000000000000000000000 P 953c4ff5dd204fbbb88a1a5b1b2610c1: stopping tablet replica
I20260709 13:12:51.251621 29364 master.cc:584] Master@127.28.173.62:39211 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13043 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:12:51.299085 29364 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.28.173.62:45867
I20260709 13:12:51.300302 29364 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:51.305369  6275 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:51.305435  6276 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:51.306694  6278 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:51.307868 29364 server_base.cc:1061] running on GCE node
I20260709 13:12:51.308919 29364 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:51.309088 29364 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:51.309196 29364 hybrid_clock.cc:648] HybridClock initialized: now 1783602771309186 us; error 0 us; skew 500 ppm
I20260709 13:12:51.309643 29364 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:51.311987 29364 webserver.cc:533] Webserver started at http://127.28.173.62:43505/ using document root <none> and password file <none>
I20260709 13:12:51.312407 29364 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:51.312547 29364 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:51.312764 29364 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:51.313758 29364 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602443945700-29364-0/minicluster-data/master-0-root/instance:
uuid: "e8b61dddc08d4d8bb5da53603348e89e"
format_stamp: "Formatted at 2026-07-09 13:12:51 on dist-test-slave-x62b"
I20260709 13:12:51.318465 29364 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:12:51.321817  6283 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:51.322571 29364 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:12:51.322862 29364 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602443945700-29364-0/minicluster-data/master-0-root
uuid: "e8b61dddc08d4d8bb5da53603348e89e"
format_stamp: "Formatted at 2026-07-09 13:12:51 on dist-test-slave-x62b"
I20260709 13:12:51.323127 29364 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602443945700-29364-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602443945700-29364-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602443945700-29364-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:51.340544 29364 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:51.341636 29364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:51.377998 29364 rpc_server.cc:307] RPC server started. Bound to: 127.28.173.62:45867
I20260709 13:12:51.378160  6334 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.173.62:45867 every 8 connection(s)
I20260709 13:12:51.381996  6335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:51.394711  6335 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8b61dddc08d4d8bb5da53603348e89e: Bootstrap starting.
I20260709 13:12:51.399325  6335 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e8b61dddc08d4d8bb5da53603348e89e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:51.403544  6335 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8b61dddc08d4d8bb5da53603348e89e: No bootstrap required, opened a new log
I20260709 13:12:51.405611  6335 raft_consensus.cc:359] T 00000000000000000000000000000000 P e8b61dddc08d4d8bb5da53603348e89e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8b61dddc08d4d8bb5da53603348e89e" member_type: VOTER }
I20260709 13:12:51.406004  6335 raft_consensus.cc:385] T 00000000000000000000000000000000 P e8b61dddc08d4d8bb5da53603348e89e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:51.406237  6335 raft_consensus.cc:740] T 00000000000000000000000000000000 P e8b61dddc08d4d8bb5da53603348e89e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8b61dddc08d4d8bb5da53603348e89e, State: Initialized, Role: FOLLOWER
I20260709 13:12:51.406872  6335 consensus_queue.cc:260] T 00000000000000000000000000000000 P e8b61dddc08d4d8bb5da53603348e89e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8b61dddc08d4d8bb5da53603348e89e" member_type: VOTER }
I20260709 13:12:51.407428  6335 raft_consensus.cc:399] T 00000000000000000000000000000000 P e8b61dddc08d4d8bb5da53603348e89e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:12:51.407742  6335 raft_consensus.cc:493] T 00000000000000000000000000000000 P e8b61dddc08d4d8bb5da53603348e89e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:12:51.408079  6335 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e8b61dddc08d4d8bb5da53603348e89e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:51.412911  6335 raft_consensus.cc:515] T 00000000000000000000000000000000 P e8b61dddc08d4d8bb5da53603348e89e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8b61dddc08d4d8bb5da53603348e89e" member_type: VOTER }
I20260709 13:12:51.413414  6335 leader_election.cc:304] T 00000000000000000000000000000000 P e8b61dddc08d4d8bb5da53603348e89e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e8b61dddc08d4d8bb5da53603348e89e; no voters: 
I20260709 13:12:51.414525  6335 leader_election.cc:290] T 00000000000000000000000000000000 P e8b61dddc08d4d8bb5da53603348e89e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:12:51.414886  6338 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e8b61dddc08d4d8bb5da53603348e89e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:51.416482  6338 raft_consensus.cc:697] T 00000000000000000000000000000000 P e8b61dddc08d4d8bb5da53603348e89e [term 1 LEADER]: Becoming Leader. State: Replica: e8b61dddc08d4d8bb5da53603348e89e, State: Running, Role: LEADER
I20260709 13:12:51.417151  6338 consensus_queue.cc:237] T 00000000000000000000000000000000 P e8b61dddc08d4d8bb5da53603348e89e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8b61dddc08d4d8bb5da53603348e89e" member_type: VOTER }
I20260709 13:12:51.417526  6335 sys_catalog.cc:565] T 00000000000000000000000000000000 P e8b61dddc08d4d8bb5da53603348e89e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:12:51.421947  6340 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8b61dddc08d4d8bb5da53603348e89e [sys.catalog]: SysCatalogTable state changed. Reason: New leader e8b61dddc08d4d8bb5da53603348e89e. Latest consensus state: current_term: 1 leader_uuid: "e8b61dddc08d4d8bb5da53603348e89e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8b61dddc08d4d8bb5da53603348e89e" member_type: VOTER } }
I20260709 13:12:51.422700  6340 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8b61dddc08d4d8bb5da53603348e89e [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:51.423707  6339 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8b61dddc08d4d8bb5da53603348e89e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e8b61dddc08d4d8bb5da53603348e89e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8b61dddc08d4d8bb5da53603348e89e" member_type: VOTER } }
I20260709 13:12:51.424346  6339 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8b61dddc08d4d8bb5da53603348e89e [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:51.424510  6346 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:12:51.429738  6346 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:12:51.432778 29364 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:12:51.438002  6346 catalog_manager.cc:1383] Generated new cluster ID: aa13f4b73e9d4e839bdb82013a5f86c8
I20260709 13:12:51.438294  6346 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:12:51.478322  6346 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:12:51.479480  6346 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:12:51.492120  6346 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e8b61dddc08d4d8bb5da53603348e89e: Generated new TSK 0
I20260709 13:12:51.492646  6346 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:12:51.499094 29364 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:51.504822  6356 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:51.505764  6357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:51.507390  6359 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:51.508023 29364 server_base.cc:1061] running on GCE node
I20260709 13:12:51.508993 29364 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:51.509189 29364 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:51.509369 29364 hybrid_clock.cc:648] HybridClock initialized: now 1783602771509350 us; error 0 us; skew 500 ppm
I20260709 13:12:51.509936 29364 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:51.512198 29364 webserver.cc:533] Webserver started at http://127.28.173.1:43341/ using document root <none> and password file <none>
I20260709 13:12:51.512671 29364 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:51.512863 29364 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:51.513135 29364 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:51.514202 29364 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602443945700-29364-0/minicluster-data/ts-0-root/instance:
uuid: "565427c1ddb74ce49aa2b910f0ce0f3f"
format_stamp: "Formatted at 2026-07-09 13:12:51 on dist-test-slave-x62b"
I20260709 13:12:51.518821 29364 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.006s
I20260709 13:12:51.522145  6364 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:51.522938 29364 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:12:51.523262 29364 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602443945700-29364-0/minicluster-data/ts-0-root
uuid: "565427c1ddb74ce49aa2b910f0ce0f3f"
format_stamp: "Formatted at 2026-07-09 13:12:51 on dist-test-slave-x62b"
I20260709 13:12:51.523547 29364 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602443945700-29364-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602443945700-29364-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602443945700-29364-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:51.538197 29364 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:51.539347 29364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:51.541042 29364 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:51.543193 29364 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:51.543411 29364 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:51.543659 29364 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:51.543861 29364 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:51.582976 29364 rpc_server.cc:307] RPC server started. Bound to: 127.28.173.1:43981
I20260709 13:12:51.583067  6426 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.173.1:43981 every 8 connection(s)
I20260709 13:12:51.588054 29364 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:51.594776  6431 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:51.596342  6432 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:51.599206  6434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:51.599713 29364 server_base.cc:1061] running on GCE node
I20260709 13:12:51.600922 29364 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:12:51.601194  6427 heartbeater.cc:344] Connected to a master server at 127.28.173.62:45867
W20260709 13:12:51.601202 29364 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:51.601655 29364 hybrid_clock.cc:648] HybridClock initialized: now 1783602771601630 us; error 0 us; skew 500 ppm
I20260709 13:12:51.601683  6427 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:51.602324 29364 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:51.602602  6427 heartbeater.cc:507] Master 127.28.173.62:45867 requested a full tablet report, sending...
I20260709 13:12:51.605073 29364 webserver.cc:533] Webserver started at http://127.28.173.2:39375/ using document root <none> and password file <none>
I20260709 13:12:51.605137  6300 ts_manager.cc:194] Registered new tserver with Master: 565427c1ddb74ce49aa2b910f0ce0f3f (127.28.173.1:43981)
I20260709 13:12:51.605911 29364 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:51.606187 29364 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:51.606500 29364 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:51.607745  6300 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39962
I20260709 13:12:51.607951 29364 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602443945700-29364-0/minicluster-data/ts-1-root/instance:
uuid: "2e3fd9a56720494e83801990c9a73079"
format_stamp: "Formatted at 2026-07-09 13:12:51 on dist-test-slave-x62b"
I20260709 13:12:51.612558 29364 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:12:51.615891  6439 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:51.616686 29364 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:12:51.616987 29364 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602443945700-29364-0/minicluster-data/ts-1-root
uuid: "2e3fd9a56720494e83801990c9a73079"
format_stamp: "Formatted at 2026-07-09 13:12:51 on dist-test-slave-x62b"
I20260709 13:12:51.617262 29364 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602443945700-29364-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602443945700-29364-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602443945700-29364-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:51.671198 29364 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:51.672480 29364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:51.673959 29364 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:51.676124 29364 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:51.676343 29364 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:51.676606 29364 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:51.676746 29364 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:51.716615 29364 rpc_server.cc:307] RPC server started. Bound to: 127.28.173.2:39255
I20260709 13:12:51.716724  6501 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.173.2:39255 every 8 connection(s)
I20260709 13:12:51.721498 29364 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:51.728801  6505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:51.731401  6506 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:51.734465  6508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:51.735039  6502 heartbeater.cc:344] Connected to a master server at 127.28.173.62:45867
I20260709 13:12:51.735477  6502 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:51.735564 29364 server_base.cc:1061] running on GCE node
I20260709 13:12:51.736403  6502 heartbeater.cc:507] Master 127.28.173.62:45867 requested a full tablet report, sending...
I20260709 13:12:51.736608 29364 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:51.736907 29364 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:51.737130 29364 hybrid_clock.cc:648] HybridClock initialized: now 1783602771737110 us; error 0 us; skew 500 ppm
I20260709 13:12:51.737812 29364 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:51.738462  6300 ts_manager.cc:194] Registered new tserver with Master: 2e3fd9a56720494e83801990c9a73079 (127.28.173.2:39255)
I20260709 13:12:51.740128  6300 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39966
I20260709 13:12:51.740203 29364 webserver.cc:533] Webserver started at http://127.28.173.3:43789/ using document root <none> and password file <none>
I20260709 13:12:51.740800 29364 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:51.741007 29364 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:51.741312 29364 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:51.742487 29364 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602443945700-29364-0/minicluster-data/ts-2-root/instance:
uuid: "39e0358c9c10431bba61c406bd8e3f0d"
format_stamp: "Formatted at 2026-07-09 13:12:51 on dist-test-slave-x62b"
I20260709 13:12:51.746770 29364 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:12:51.749897  6513 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:51.750725 29364 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:12:51.750990 29364 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602443945700-29364-0/minicluster-data/ts-2-root
uuid: "39e0358c9c10431bba61c406bd8e3f0d"
format_stamp: "Formatted at 2026-07-09 13:12:51 on dist-test-slave-x62b"
I20260709 13:12:51.751214 29364 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602443945700-29364-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602443945700-29364-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602443945700-29364-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:51.799796 29364 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:51.801029 29364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:51.802455 29364 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:51.804639 29364 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:51.804840 29364 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:51.805080 29364 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:51.805244 29364 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:51.853478 29364 rpc_server.cc:307] RPC server started. Bound to: 127.28.173.3:46591
I20260709 13:12:51.853580  6575 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.173.3:46591 every 8 connection(s)
I20260709 13:12:51.866896  6576 heartbeater.cc:344] Connected to a master server at 127.28.173.62:45867
I20260709 13:12:51.867326  6576 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:51.868080  6576 heartbeater.cc:507] Master 127.28.173.62:45867 requested a full tablet report, sending...
I20260709 13:12:51.869921  6300 ts_manager.cc:194] Registered new tserver with Master: 39e0358c9c10431bba61c406bd8e3f0d (127.28.173.3:46591)
I20260709 13:12:51.870321 29364 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01364767s
I20260709 13:12:51.871623  6300 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39970
I20260709 13:12:51.935787  6300 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39976:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:12:51.938495  6300 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:12:51.991214  6392 tablet_service.cc:1511] Processing CreateTablet for tablet ab54bb428d1044dea3614a20b66f0d40 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=e07c192b251f468d89bea13b67596ca2]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:12:51.991478  6391 tablet_service.cc:1511] Processing CreateTablet for tablet db3d865b7cf544e189c439b096e1c738 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=e07c192b251f468d89bea13b67596ca2]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:12:51.993168  6392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab54bb428d1044dea3614a20b66f0d40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:51.993858  6391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db3d865b7cf544e189c439b096e1c738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:52.003343  6467 tablet_service.cc:1511] Processing CreateTablet for tablet ab54bb428d1044dea3614a20b66f0d40 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=e07c192b251f468d89bea13b67596ca2]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:12:52.003554  6466 tablet_service.cc:1511] Processing CreateTablet for tablet db3d865b7cf544e189c439b096e1c738 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=e07c192b251f468d89bea13b67596ca2]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:12:52.005205  6467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab54bb428d1044dea3614a20b66f0d40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:52.005937  6466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db3d865b7cf544e189c439b096e1c738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:52.013028  6541 tablet_service.cc:1511] Processing CreateTablet for tablet ab54bb428d1044dea3614a20b66f0d40 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=e07c192b251f468d89bea13b67596ca2]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:12:52.014559  6541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab54bb428d1044dea3614a20b66f0d40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:52.020395  6540 tablet_service.cc:1511] Processing CreateTablet for tablet db3d865b7cf544e189c439b096e1c738 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=e07c192b251f468d89bea13b67596ca2]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:12:52.021891  6540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db3d865b7cf544e189c439b096e1c738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:52.022164  6592 tablet_bootstrap.cc:492] T db3d865b7cf544e189c439b096e1c738 P 565427c1ddb74ce49aa2b910f0ce0f3f: Bootstrap starting.
I20260709 13:12:52.030720  6592 tablet_bootstrap.cc:654] T db3d865b7cf544e189c439b096e1c738 P 565427c1ddb74ce49aa2b910f0ce0f3f: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:52.043850  6593 tablet_bootstrap.cc:492] T ab54bb428d1044dea3614a20b66f0d40 P 2e3fd9a56720494e83801990c9a73079: Bootstrap starting.
I20260709 13:12:52.045079  6595 tablet_bootstrap.cc:492] T ab54bb428d1044dea3614a20b66f0d40 P 39e0358c9c10431bba61c406bd8e3f0d: Bootstrap starting.
I20260709 13:12:52.046756  6592 tablet_bootstrap.cc:492] T db3d865b7cf544e189c439b096e1c738 P 565427c1ddb74ce49aa2b910f0ce0f3f: No bootstrap required, opened a new log
I20260709 13:12:52.047303  6592 ts_tablet_manager.cc:1403] T db3d865b7cf544e189c439b096e1c738 P 565427c1ddb74ce49aa2b910f0ce0f3f: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.000s
I20260709 13:12:52.050624  6592 raft_consensus.cc:359] T db3d865b7cf544e189c439b096e1c738 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } }
I20260709 13:12:52.051548  6592 raft_consensus.cc:385] T db3d865b7cf544e189c439b096e1c738 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.051839  6592 raft_consensus.cc:740] T db3d865b7cf544e189c439b096e1c738 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 565427c1ddb74ce49aa2b910f0ce0f3f, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.052399  6593 tablet_bootstrap.cc:654] T ab54bb428d1044dea3614a20b66f0d40 P 2e3fd9a56720494e83801990c9a73079: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:52.052932  6592 consensus_queue.cc:260] T db3d865b7cf544e189c439b096e1c738 P 565427c1ddb74ce49aa2b910f0ce0f3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } }
I20260709 13:12:52.054497  6595 tablet_bootstrap.cc:654] T ab54bb428d1044dea3614a20b66f0d40 P 39e0358c9c10431bba61c406bd8e3f0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:52.056231  6427 heartbeater.cc:499] Master 127.28.173.62:45867 was elected leader, sending a full tablet report...
I20260709 13:12:52.056457  6592 ts_tablet_manager.cc:1434] T db3d865b7cf544e189c439b096e1c738 P 565427c1ddb74ce49aa2b910f0ce0f3f: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.001s
I20260709 13:12:52.057976  6592 tablet_bootstrap.cc:492] T ab54bb428d1044dea3614a20b66f0d40 P 565427c1ddb74ce49aa2b910f0ce0f3f: Bootstrap starting.
I20260709 13:12:52.063112  6595 tablet_bootstrap.cc:492] T ab54bb428d1044dea3614a20b66f0d40 P 39e0358c9c10431bba61c406bd8e3f0d: No bootstrap required, opened a new log
I20260709 13:12:52.063162  6593 tablet_bootstrap.cc:492] T ab54bb428d1044dea3614a20b66f0d40 P 2e3fd9a56720494e83801990c9a73079: No bootstrap required, opened a new log
I20260709 13:12:52.063742  6595 ts_tablet_manager.cc:1403] T ab54bb428d1044dea3614a20b66f0d40 P 39e0358c9c10431bba61c406bd8e3f0d: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.005s
I20260709 13:12:52.063872  6593 ts_tablet_manager.cc:1403] T ab54bb428d1044dea3614a20b66f0d40 P 2e3fd9a56720494e83801990c9a73079: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.004s
I20260709 13:12:52.066210  6592 tablet_bootstrap.cc:654] T ab54bb428d1044dea3614a20b66f0d40 P 565427c1ddb74ce49aa2b910f0ce0f3f: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:52.067541  6593 raft_consensus.cc:359] T ab54bb428d1044dea3614a20b66f0d40 P 2e3fd9a56720494e83801990c9a73079 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } }
I20260709 13:12:52.068485  6593 raft_consensus.cc:385] T ab54bb428d1044dea3614a20b66f0d40 P 2e3fd9a56720494e83801990c9a73079 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.068822  6593 raft_consensus.cc:740] T ab54bb428d1044dea3614a20b66f0d40 P 2e3fd9a56720494e83801990c9a73079 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e3fd9a56720494e83801990c9a73079, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.067123  6595 raft_consensus.cc:359] T ab54bb428d1044dea3614a20b66f0d40 P 39e0358c9c10431bba61c406bd8e3f0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } }
I20260709 13:12:52.070029  6593 consensus_queue.cc:260] T ab54bb428d1044dea3614a20b66f0d40 P 2e3fd9a56720494e83801990c9a73079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } }
I20260709 13:12:52.070546  6595 raft_consensus.cc:385] T ab54bb428d1044dea3614a20b66f0d40 P 39e0358c9c10431bba61c406bd8e3f0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.070917  6595 raft_consensus.cc:740] T ab54bb428d1044dea3614a20b66f0d40 P 39e0358c9c10431bba61c406bd8e3f0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39e0358c9c10431bba61c406bd8e3f0d, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.071805  6595 consensus_queue.cc:260] T ab54bb428d1044dea3614a20b66f0d40 P 39e0358c9c10431bba61c406bd8e3f0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } }
I20260709 13:12:52.074007  6593 ts_tablet_manager.cc:1434] T ab54bb428d1044dea3614a20b66f0d40 P 2e3fd9a56720494e83801990c9a73079: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.005s
I20260709 13:12:52.075196  6593 tablet_bootstrap.cc:492] T db3d865b7cf544e189c439b096e1c738 P 2e3fd9a56720494e83801990c9a73079: Bootstrap starting.
I20260709 13:12:52.075055  6502 heartbeater.cc:499] Master 127.28.173.62:45867 was elected leader, sending a full tablet report...
I20260709 13:12:52.077037  6576 heartbeater.cc:499] Master 127.28.173.62:45867 was elected leader, sending a full tablet report...
I20260709 13:12:52.077512  6595 ts_tablet_manager.cc:1434] T ab54bb428d1044dea3614a20b66f0d40 P 39e0358c9c10431bba61c406bd8e3f0d: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:12:52.078651  6595 tablet_bootstrap.cc:492] T db3d865b7cf544e189c439b096e1c738 P 39e0358c9c10431bba61c406bd8e3f0d: Bootstrap starting.
I20260709 13:12:52.082448  6592 tablet_bootstrap.cc:492] T ab54bb428d1044dea3614a20b66f0d40 P 565427c1ddb74ce49aa2b910f0ce0f3f: No bootstrap required, opened a new log
I20260709 13:12:52.083043  6592 ts_tablet_manager.cc:1403] T ab54bb428d1044dea3614a20b66f0d40 P 565427c1ddb74ce49aa2b910f0ce0f3f: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.004s
I20260709 13:12:52.084296  6593 tablet_bootstrap.cc:654] T db3d865b7cf544e189c439b096e1c738 P 2e3fd9a56720494e83801990c9a73079: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:52.088497  6592 raft_consensus.cc:359] T ab54bb428d1044dea3614a20b66f0d40 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } }
I20260709 13:12:52.089387  6592 raft_consensus.cc:385] T ab54bb428d1044dea3614a20b66f0d40 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.089684  6592 raft_consensus.cc:740] T ab54bb428d1044dea3614a20b66f0d40 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 565427c1ddb74ce49aa2b910f0ce0f3f, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.090624  6592 consensus_queue.cc:260] T ab54bb428d1044dea3614a20b66f0d40 P 565427c1ddb74ce49aa2b910f0ce0f3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } }
I20260709 13:12:52.092895  6592 ts_tablet_manager.cc:1434] T ab54bb428d1044dea3614a20b66f0d40 P 565427c1ddb74ce49aa2b910f0ce0f3f: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.005s
I20260709 13:12:52.095413  6595 tablet_bootstrap.cc:654] T db3d865b7cf544e189c439b096e1c738 P 39e0358c9c10431bba61c406bd8e3f0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:52.099192  6593 tablet_bootstrap.cc:492] T db3d865b7cf544e189c439b096e1c738 P 2e3fd9a56720494e83801990c9a73079: No bootstrap required, opened a new log
I20260709 13:12:52.099794  6593 ts_tablet_manager.cc:1403] T db3d865b7cf544e189c439b096e1c738 P 2e3fd9a56720494e83801990c9a73079: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.003s
I20260709 13:12:52.101341  6595 tablet_bootstrap.cc:492] T db3d865b7cf544e189c439b096e1c738 P 39e0358c9c10431bba61c406bd8e3f0d: No bootstrap required, opened a new log
I20260709 13:12:52.101806  6595 ts_tablet_manager.cc:1403] T db3d865b7cf544e189c439b096e1c738 P 39e0358c9c10431bba61c406bd8e3f0d: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.000s
I20260709 13:12:52.102607  6593 raft_consensus.cc:359] T db3d865b7cf544e189c439b096e1c738 P 2e3fd9a56720494e83801990c9a73079 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } }
I20260709 13:12:52.103397  6593 raft_consensus.cc:385] T db3d865b7cf544e189c439b096e1c738 P 2e3fd9a56720494e83801990c9a73079 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.103727  6593 raft_consensus.cc:740] T db3d865b7cf544e189c439b096e1c738 P 2e3fd9a56720494e83801990c9a73079 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e3fd9a56720494e83801990c9a73079, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.104239  6595 raft_consensus.cc:359] T db3d865b7cf544e189c439b096e1c738 P 39e0358c9c10431bba61c406bd8e3f0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } }
I20260709 13:12:52.104517  6593 consensus_queue.cc:260] T db3d865b7cf544e189c439b096e1c738 P 2e3fd9a56720494e83801990c9a73079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } }
I20260709 13:12:52.105033  6595 raft_consensus.cc:385] T db3d865b7cf544e189c439b096e1c738 P 39e0358c9c10431bba61c406bd8e3f0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.105381  6595 raft_consensus.cc:740] T db3d865b7cf544e189c439b096e1c738 P 39e0358c9c10431bba61c406bd8e3f0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39e0358c9c10431bba61c406bd8e3f0d, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.106549  6593 ts_tablet_manager.cc:1434] T db3d865b7cf544e189c439b096e1c738 P 2e3fd9a56720494e83801990c9a73079: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:12:52.106181  6595 consensus_queue.cc:260] T db3d865b7cf544e189c439b096e1c738 P 39e0358c9c10431bba61c406bd8e3f0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } }
I20260709 13:12:52.108080  6595 ts_tablet_manager.cc:1434] T db3d865b7cf544e189c439b096e1c738 P 39e0358c9c10431bba61c406bd8e3f0d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:12:52.168200  6596 raft_consensus.cc:493] T db3d865b7cf544e189c439b096e1c738 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.168844  6596 raft_consensus.cc:515] T db3d865b7cf544e189c439b096e1c738 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } }
I20260709 13:12:52.171281  6596 leader_election.cc:290] T db3d865b7cf544e189c439b096e1c738 P 565427c1ddb74ce49aa2b910f0ce0f3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e3fd9a56720494e83801990c9a73079 (127.28.173.2:39255), 39e0358c9c10431bba61c406bd8e3f0d (127.28.173.3:46591)
I20260709 13:12:52.183117  6477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db3d865b7cf544e189c439b096e1c738" candidate_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e3fd9a56720494e83801990c9a73079" is_pre_election: true
I20260709 13:12:52.183948  6551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db3d865b7cf544e189c439b096e1c738" candidate_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39e0358c9c10431bba61c406bd8e3f0d" is_pre_election: true
I20260709 13:12:52.184130  6477 raft_consensus.cc:2468] T db3d865b7cf544e189c439b096e1c738 P 2e3fd9a56720494e83801990c9a73079 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 565427c1ddb74ce49aa2b910f0ce0f3f in term 0.
I20260709 13:12:52.184696  6551 raft_consensus.cc:2468] T db3d865b7cf544e189c439b096e1c738 P 39e0358c9c10431bba61c406bd8e3f0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 565427c1ddb74ce49aa2b910f0ce0f3f in term 0.
I20260709 13:12:52.185534  6365 leader_election.cc:304] T db3d865b7cf544e189c439b096e1c738 P 565427c1ddb74ce49aa2b910f0ce0f3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e3fd9a56720494e83801990c9a73079, 565427c1ddb74ce49aa2b910f0ce0f3f; no voters: 
I20260709 13:12:52.186395  6596 raft_consensus.cc:2804] T db3d865b7cf544e189c439b096e1c738 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:52.186762  6596 raft_consensus.cc:493] T db3d865b7cf544e189c439b096e1c738 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:52.187093  6596 raft_consensus.cc:3060] T db3d865b7cf544e189c439b096e1c738 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.193177  6596 raft_consensus.cc:515] T db3d865b7cf544e189c439b096e1c738 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } }
I20260709 13:12:52.194716  6596 leader_election.cc:290] T db3d865b7cf544e189c439b096e1c738 P 565427c1ddb74ce49aa2b910f0ce0f3f [CANDIDATE]: Term 1 election: Requested vote from peers 2e3fd9a56720494e83801990c9a73079 (127.28.173.2:39255), 39e0358c9c10431bba61c406bd8e3f0d (127.28.173.3:46591)
I20260709 13:12:52.195498  6477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db3d865b7cf544e189c439b096e1c738" candidate_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e3fd9a56720494e83801990c9a73079"
I20260709 13:12:52.195744  6551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db3d865b7cf544e189c439b096e1c738" candidate_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39e0358c9c10431bba61c406bd8e3f0d"
I20260709 13:12:52.196110  6477 raft_consensus.cc:3060] T db3d865b7cf544e189c439b096e1c738 P 2e3fd9a56720494e83801990c9a73079 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.196353  6551 raft_consensus.cc:3060] T db3d865b7cf544e189c439b096e1c738 P 39e0358c9c10431bba61c406bd8e3f0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.202081  6551 raft_consensus.cc:2468] T db3d865b7cf544e189c439b096e1c738 P 39e0358c9c10431bba61c406bd8e3f0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 565427c1ddb74ce49aa2b910f0ce0f3f in term 1.
I20260709 13:12:52.202106  6477 raft_consensus.cc:2468] T db3d865b7cf544e189c439b096e1c738 P 2e3fd9a56720494e83801990c9a73079 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 565427c1ddb74ce49aa2b910f0ce0f3f in term 1.
I20260709 13:12:52.203095  6365 leader_election.cc:304] T db3d865b7cf544e189c439b096e1c738 P 565427c1ddb74ce49aa2b910f0ce0f3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39e0358c9c10431bba61c406bd8e3f0d, 565427c1ddb74ce49aa2b910f0ce0f3f; no voters: 
I20260709 13:12:52.203719  6596 raft_consensus.cc:2804] T db3d865b7cf544e189c439b096e1c738 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:52.205068  6596 raft_consensus.cc:697] T db3d865b7cf544e189c439b096e1c738 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 1 LEADER]: Becoming Leader. State: Replica: 565427c1ddb74ce49aa2b910f0ce0f3f, State: Running, Role: LEADER
I20260709 13:12:52.205907  6596 consensus_queue.cc:237] T db3d865b7cf544e189c439b096e1c738 P 565427c1ddb74ce49aa2b910f0ce0f3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } }
I20260709 13:12:52.213074  6298 catalog_manager.cc:5697] T db3d865b7cf544e189c439b096e1c738 P 565427c1ddb74ce49aa2b910f0ce0f3f reported cstate change: term changed from 0 to 1, leader changed from <none> to 565427c1ddb74ce49aa2b910f0ce0f3f (127.28.173.1). New cstate: current_term: 1 leader_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:52.251391  6601 raft_consensus.cc:493] T ab54bb428d1044dea3614a20b66f0d40 P 39e0358c9c10431bba61c406bd8e3f0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.251976  6601 raft_consensus.cc:515] T ab54bb428d1044dea3614a20b66f0d40 P 39e0358c9c10431bba61c406bd8e3f0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } }
I20260709 13:12:52.254297  6601 leader_election.cc:290] T ab54bb428d1044dea3614a20b66f0d40 P 39e0358c9c10431bba61c406bd8e3f0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 565427c1ddb74ce49aa2b910f0ce0f3f (127.28.173.1:43981), 2e3fd9a56720494e83801990c9a73079 (127.28.173.2:39255)
I20260709 13:12:52.263865  6477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab54bb428d1044dea3614a20b66f0d40" candidate_uuid: "39e0358c9c10431bba61c406bd8e3f0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e3fd9a56720494e83801990c9a73079" is_pre_election: true
I20260709 13:12:52.263926  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab54bb428d1044dea3614a20b66f0d40" candidate_uuid: "39e0358c9c10431bba61c406bd8e3f0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" is_pre_election: true
I20260709 13:12:52.264511  6477 raft_consensus.cc:2468] T ab54bb428d1044dea3614a20b66f0d40 P 2e3fd9a56720494e83801990c9a73079 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39e0358c9c10431bba61c406bd8e3f0d in term 0.
I20260709 13:12:52.264707  6402 raft_consensus.cc:2468] T ab54bb428d1044dea3614a20b66f0d40 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39e0358c9c10431bba61c406bd8e3f0d in term 0.
I20260709 13:12:52.265568  6514 leader_election.cc:304] T ab54bb428d1044dea3614a20b66f0d40 P 39e0358c9c10431bba61c406bd8e3f0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e3fd9a56720494e83801990c9a73079, 39e0358c9c10431bba61c406bd8e3f0d; no voters: 
I20260709 13:12:52.266312  6601 raft_consensus.cc:2804] T ab54bb428d1044dea3614a20b66f0d40 P 39e0358c9c10431bba61c406bd8e3f0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:52.266681  6601 raft_consensus.cc:493] T ab54bb428d1044dea3614a20b66f0d40 P 39e0358c9c10431bba61c406bd8e3f0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:52.266952  6601 raft_consensus.cc:3060] T ab54bb428d1044dea3614a20b66f0d40 P 39e0358c9c10431bba61c406bd8e3f0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.272527  6601 raft_consensus.cc:515] T ab54bb428d1044dea3614a20b66f0d40 P 39e0358c9c10431bba61c406bd8e3f0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } }
I20260709 13:12:52.274015  6601 leader_election.cc:290] T ab54bb428d1044dea3614a20b66f0d40 P 39e0358c9c10431bba61c406bd8e3f0d [CANDIDATE]: Term 1 election: Requested vote from peers 565427c1ddb74ce49aa2b910f0ce0f3f (127.28.173.1:43981), 2e3fd9a56720494e83801990c9a73079 (127.28.173.2:39255)
I20260709 13:12:52.274727  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab54bb428d1044dea3614a20b66f0d40" candidate_uuid: "39e0358c9c10431bba61c406bd8e3f0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f"
I20260709 13:12:52.274978  6477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab54bb428d1044dea3614a20b66f0d40" candidate_uuid: "39e0358c9c10431bba61c406bd8e3f0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e3fd9a56720494e83801990c9a73079"
I20260709 13:12:52.275287  6402 raft_consensus.cc:3060] T ab54bb428d1044dea3614a20b66f0d40 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.275537  6477 raft_consensus.cc:3060] T ab54bb428d1044dea3614a20b66f0d40 P 2e3fd9a56720494e83801990c9a73079 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.280329  6477 raft_consensus.cc:2468] T ab54bb428d1044dea3614a20b66f0d40 P 2e3fd9a56720494e83801990c9a73079 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39e0358c9c10431bba61c406bd8e3f0d in term 1.
I20260709 13:12:52.280815  6402 raft_consensus.cc:2468] T ab54bb428d1044dea3614a20b66f0d40 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39e0358c9c10431bba61c406bd8e3f0d in term 1.
I20260709 13:12:52.281222  6514 leader_election.cc:304] T ab54bb428d1044dea3614a20b66f0d40 P 39e0358c9c10431bba61c406bd8e3f0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e3fd9a56720494e83801990c9a73079, 39e0358c9c10431bba61c406bd8e3f0d; no voters: 
I20260709 13:12:52.281917  6601 raft_consensus.cc:2804] T ab54bb428d1044dea3614a20b66f0d40 P 39e0358c9c10431bba61c406bd8e3f0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:52.282737  6601 raft_consensus.cc:697] T ab54bb428d1044dea3614a20b66f0d40 P 39e0358c9c10431bba61c406bd8e3f0d [term 1 LEADER]: Becoming Leader. State: Replica: 39e0358c9c10431bba61c406bd8e3f0d, State: Running, Role: LEADER
I20260709 13:12:52.283505  6601 consensus_queue.cc:237] T ab54bb428d1044dea3614a20b66f0d40 P 39e0358c9c10431bba61c406bd8e3f0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } }
I20260709 13:12:52.289927  6298 catalog_manager.cc:5697] T ab54bb428d1044dea3614a20b66f0d40 P 39e0358c9c10431bba61c406bd8e3f0d reported cstate change: term changed from 0 to 1, leader changed from <none> to 39e0358c9c10431bba61c406bd8e3f0d (127.28.173.3). New cstate: current_term: 1 leader_uuid: "39e0358c9c10431bba61c406bd8e3f0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:52.389204  6298 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39986:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:12:52.391392  6298 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:12:52.415252  6391 tablet_service.cc:1511] Processing CreateTablet for tablet 64ff957a9b6c455d9040a8964b939943 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=599f0252836d4d71bc09ee2fe10b77d2]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:12:52.416586  6391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64ff957a9b6c455d9040a8964b939943. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:52.416496  6466 tablet_service.cc:1511] Processing CreateTablet for tablet 64ff957a9b6c455d9040a8964b939943 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=599f0252836d4d71bc09ee2fe10b77d2]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:12:52.417819  6466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64ff957a9b6c455d9040a8964b939943. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:52.418427  6541 tablet_service.cc:1511] Processing CreateTablet for tablet 64ff957a9b6c455d9040a8964b939943 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=599f0252836d4d71bc09ee2fe10b77d2]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:12:52.419682  6541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64ff957a9b6c455d9040a8964b939943. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:52.422537  6467 tablet_service.cc:1511] Processing CreateTablet for tablet fbd8f1db7f444de1a5dea34eec9cfbd0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=599f0252836d4d71bc09ee2fe10b77d2]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:12:52.423763  6467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbd8f1db7f444de1a5dea34eec9cfbd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:52.423480  6392 tablet_service.cc:1511] Processing CreateTablet for tablet fbd8f1db7f444de1a5dea34eec9cfbd0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=599f0252836d4d71bc09ee2fe10b77d2]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:12:52.424753  6392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbd8f1db7f444de1a5dea34eec9cfbd0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:52.427855  6348 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:52.427917  6540 tablet_service.cc:1511] Processing CreateTablet for tablet fbd8f1db7f444de1a5dea34eec9cfbd0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=599f0252836d4d71bc09ee2fe10b77d2]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:12:52.429369  6540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbd8f1db7f444de1a5dea34eec9cfbd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:52.434235  6592 tablet_bootstrap.cc:492] T 64ff957a9b6c455d9040a8964b939943 P 565427c1ddb74ce49aa2b910f0ce0f3f: Bootstrap starting.
I20260709 13:12:52.441001  6592 tablet_bootstrap.cc:654] T 64ff957a9b6c455d9040a8964b939943 P 565427c1ddb74ce49aa2b910f0ce0f3f: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:52.447446  6593 tablet_bootstrap.cc:492] T 64ff957a9b6c455d9040a8964b939943 P 2e3fd9a56720494e83801990c9a73079: Bootstrap starting.
I20260709 13:12:52.452597  6592 tablet_bootstrap.cc:492] T 64ff957a9b6c455d9040a8964b939943 P 565427c1ddb74ce49aa2b910f0ce0f3f: No bootstrap required, opened a new log
I20260709 13:12:52.453401  6592 ts_tablet_manager.cc:1403] T 64ff957a9b6c455d9040a8964b939943 P 565427c1ddb74ce49aa2b910f0ce0f3f: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.006s
I20260709 13:12:52.454864  6593 tablet_bootstrap.cc:654] T 64ff957a9b6c455d9040a8964b939943 P 2e3fd9a56720494e83801990c9a73079: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:52.456656  6592 raft_consensus.cc:359] T 64ff957a9b6c455d9040a8964b939943 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } }
I20260709 13:12:52.457293  6595 tablet_bootstrap.cc:492] T 64ff957a9b6c455d9040a8964b939943 P 39e0358c9c10431bba61c406bd8e3f0d: Bootstrap starting.
I20260709 13:12:52.457484  6592 raft_consensus.cc:385] T 64ff957a9b6c455d9040a8964b939943 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.457937  6592 raft_consensus.cc:740] T 64ff957a9b6c455d9040a8964b939943 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 565427c1ddb74ce49aa2b910f0ce0f3f, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.458861  6592 consensus_queue.cc:260] T 64ff957a9b6c455d9040a8964b939943 P 565427c1ddb74ce49aa2b910f0ce0f3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } }
I20260709 13:12:52.465278  6592 ts_tablet_manager.cc:1434] T 64ff957a9b6c455d9040a8964b939943 P 565427c1ddb74ce49aa2b910f0ce0f3f: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.002s
I20260709 13:12:52.466320  6592 tablet_bootstrap.cc:492] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 565427c1ddb74ce49aa2b910f0ce0f3f: Bootstrap starting.
I20260709 13:12:52.467378  6595 tablet_bootstrap.cc:654] T 64ff957a9b6c455d9040a8964b939943 P 39e0358c9c10431bba61c406bd8e3f0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:52.472965  6592 tablet_bootstrap.cc:654] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 565427c1ddb74ce49aa2b910f0ce0f3f: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:52.475716  6593 tablet_bootstrap.cc:492] T 64ff957a9b6c455d9040a8964b939943 P 2e3fd9a56720494e83801990c9a73079: No bootstrap required, opened a new log
I20260709 13:12:52.476300  6593 ts_tablet_manager.cc:1403] T 64ff957a9b6c455d9040a8964b939943 P 2e3fd9a56720494e83801990c9a73079: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.018s
I20260709 13:12:52.480253  6593 raft_consensus.cc:359] T 64ff957a9b6c455d9040a8964b939943 P 2e3fd9a56720494e83801990c9a73079 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } }
I20260709 13:12:52.481020  6593 raft_consensus.cc:385] T 64ff957a9b6c455d9040a8964b939943 P 2e3fd9a56720494e83801990c9a73079 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.481292  6593 raft_consensus.cc:740] T 64ff957a9b6c455d9040a8964b939943 P 2e3fd9a56720494e83801990c9a73079 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e3fd9a56720494e83801990c9a73079, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.482139  6592 tablet_bootstrap.cc:492] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 565427c1ddb74ce49aa2b910f0ce0f3f: No bootstrap required, opened a new log
I20260709 13:12:52.481971  6593 consensus_queue.cc:260] T 64ff957a9b6c455d9040a8964b939943 P 2e3fd9a56720494e83801990c9a73079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } }
I20260709 13:12:52.482458  6595 tablet_bootstrap.cc:492] T 64ff957a9b6c455d9040a8964b939943 P 39e0358c9c10431bba61c406bd8e3f0d: No bootstrap required, opened a new log
I20260709 13:12:52.482645  6592 ts_tablet_manager.cc:1403] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 565427c1ddb74ce49aa2b910f0ce0f3f: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 13:12:52.484443  6593 ts_tablet_manager.cc:1434] T 64ff957a9b6c455d9040a8964b939943 P 2e3fd9a56720494e83801990c9a73079: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:12:52.483202  6595 ts_tablet_manager.cc:1403] T 64ff957a9b6c455d9040a8964b939943 P 39e0358c9c10431bba61c406bd8e3f0d: Time spent bootstrapping tablet: real 0.026s	user 0.005s	sys 0.013s
I20260709 13:12:52.485643  6593 tablet_bootstrap.cc:492] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 2e3fd9a56720494e83801990c9a73079: Bootstrap starting.
I20260709 13:12:52.486824  6592 raft_consensus.cc:359] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } }
I20260709 13:12:52.487565  6592 raft_consensus.cc:385] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.487888  6592 raft_consensus.cc:740] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 565427c1ddb74ce49aa2b910f0ce0f3f, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.487636  6595 raft_consensus.cc:359] T 64ff957a9b6c455d9040a8964b939943 P 39e0358c9c10431bba61c406bd8e3f0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } }
I20260709 13:12:52.488482  6595 raft_consensus.cc:385] T 64ff957a9b6c455d9040a8964b939943 P 39e0358c9c10431bba61c406bd8e3f0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.488806  6592 consensus_queue.cc:260] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 565427c1ddb74ce49aa2b910f0ce0f3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } }
I20260709 13:12:52.488819  6595 raft_consensus.cc:740] T 64ff957a9b6c455d9040a8964b939943 P 39e0358c9c10431bba61c406bd8e3f0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39e0358c9c10431bba61c406bd8e3f0d, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.490379  6595 consensus_queue.cc:260] T 64ff957a9b6c455d9040a8964b939943 P 39e0358c9c10431bba61c406bd8e3f0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } }
I20260709 13:12:52.491014  6592 ts_tablet_manager.cc:1434] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 565427c1ddb74ce49aa2b910f0ce0f3f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:52.493141  6595 ts_tablet_manager.cc:1434] T 64ff957a9b6c455d9040a8964b939943 P 39e0358c9c10431bba61c406bd8e3f0d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:52.494205  6595 tablet_bootstrap.cc:492] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 39e0358c9c10431bba61c406bd8e3f0d: Bootstrap starting.
I20260709 13:12:52.496104  6593 tablet_bootstrap.cc:654] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 2e3fd9a56720494e83801990c9a73079: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:52.501183  6595 tablet_bootstrap.cc:654] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 39e0358c9c10431bba61c406bd8e3f0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:52.506709  6593 tablet_bootstrap.cc:492] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 2e3fd9a56720494e83801990c9a73079: No bootstrap required, opened a new log
I20260709 13:12:52.507138  6593 ts_tablet_manager.cc:1403] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 2e3fd9a56720494e83801990c9a73079: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.007s
I20260709 13:12:52.507556  6595 tablet_bootstrap.cc:492] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 39e0358c9c10431bba61c406bd8e3f0d: No bootstrap required, opened a new log
I20260709 13:12:52.507989  6595 ts_tablet_manager.cc:1403] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 39e0358c9c10431bba61c406bd8e3f0d: Time spent bootstrapping tablet: real 0.014s	user 0.005s	sys 0.008s
I20260709 13:12:52.509378  6593 raft_consensus.cc:359] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 2e3fd9a56720494e83801990c9a73079 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } }
I20260709 13:12:52.509946  6593 raft_consensus.cc:385] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 2e3fd9a56720494e83801990c9a73079 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.510198  6593 raft_consensus.cc:740] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 2e3fd9a56720494e83801990c9a73079 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e3fd9a56720494e83801990c9a73079, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.510035  6595 raft_consensus.cc:359] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 39e0358c9c10431bba61c406bd8e3f0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } }
I20260709 13:12:52.510739  6595 raft_consensus.cc:385] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 39e0358c9c10431bba61c406bd8e3f0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:52.510975  6595 raft_consensus.cc:740] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 39e0358c9c10431bba61c406bd8e3f0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39e0358c9c10431bba61c406bd8e3f0d, State: Initialized, Role: FOLLOWER
I20260709 13:12:52.510891  6593 consensus_queue.cc:260] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 2e3fd9a56720494e83801990c9a73079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } }
I20260709 13:12:52.511960  6595 consensus_queue.cc:260] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 39e0358c9c10431bba61c406bd8e3f0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } }
I20260709 13:12:52.513000  6593 ts_tablet_manager.cc:1434] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 2e3fd9a56720494e83801990c9a73079: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:12:52.514129  6595 ts_tablet_manager.cc:1434] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 39e0358c9c10431bba61c406bd8e3f0d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:12:52.571421  6599 raft_consensus.cc:493] T 64ff957a9b6c455d9040a8964b939943 P 2e3fd9a56720494e83801990c9a73079 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.572010  6599 raft_consensus.cc:515] T 64ff957a9b6c455d9040a8964b939943 P 2e3fd9a56720494e83801990c9a73079 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } }
I20260709 13:12:52.574008  6599 leader_election.cc:290] T 64ff957a9b6c455d9040a8964b939943 P 2e3fd9a56720494e83801990c9a73079 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 565427c1ddb74ce49aa2b910f0ce0f3f (127.28.173.1:43981), 39e0358c9c10431bba61c406bd8e3f0d (127.28.173.3:46591)
I20260709 13:12:52.584265  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ff957a9b6c455d9040a8964b939943" candidate_uuid: "2e3fd9a56720494e83801990c9a73079" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" is_pre_election: true
I20260709 13:12:52.584829  6551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ff957a9b6c455d9040a8964b939943" candidate_uuid: "2e3fd9a56720494e83801990c9a73079" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39e0358c9c10431bba61c406bd8e3f0d" is_pre_election: true
I20260709 13:12:52.584964  6402 raft_consensus.cc:2468] T 64ff957a9b6c455d9040a8964b939943 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e3fd9a56720494e83801990c9a73079 in term 0.
I20260709 13:12:52.585430  6551 raft_consensus.cc:2468] T 64ff957a9b6c455d9040a8964b939943 P 39e0358c9c10431bba61c406bd8e3f0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e3fd9a56720494e83801990c9a73079 in term 0.
I20260709 13:12:52.586119  6441 leader_election.cc:304] T 64ff957a9b6c455d9040a8964b939943 P 2e3fd9a56720494e83801990c9a73079 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e3fd9a56720494e83801990c9a73079, 565427c1ddb74ce49aa2b910f0ce0f3f; no voters: 
I20260709 13:12:52.586977  6599 raft_consensus.cc:2804] T 64ff957a9b6c455d9040a8964b939943 P 2e3fd9a56720494e83801990c9a73079 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:52.587302  6599 raft_consensus.cc:493] T 64ff957a9b6c455d9040a8964b939943 P 2e3fd9a56720494e83801990c9a73079 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:52.587564  6599 raft_consensus.cc:3060] T 64ff957a9b6c455d9040a8964b939943 P 2e3fd9a56720494e83801990c9a73079 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.592823  6599 raft_consensus.cc:515] T 64ff957a9b6c455d9040a8964b939943 P 2e3fd9a56720494e83801990c9a73079 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } }
I20260709 13:12:52.594275  6599 leader_election.cc:290] T 64ff957a9b6c455d9040a8964b939943 P 2e3fd9a56720494e83801990c9a73079 [CANDIDATE]: Term 1 election: Requested vote from peers 565427c1ddb74ce49aa2b910f0ce0f3f (127.28.173.1:43981), 39e0358c9c10431bba61c406bd8e3f0d (127.28.173.3:46591)
I20260709 13:12:52.595068  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ff957a9b6c455d9040a8964b939943" candidate_uuid: "2e3fd9a56720494e83801990c9a73079" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f"
I20260709 13:12:52.595197  6551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ff957a9b6c455d9040a8964b939943" candidate_uuid: "2e3fd9a56720494e83801990c9a73079" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39e0358c9c10431bba61c406bd8e3f0d"
I20260709 13:12:52.595584  6402 raft_consensus.cc:3060] T 64ff957a9b6c455d9040a8964b939943 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.595749  6551 raft_consensus.cc:3060] T 64ff957a9b6c455d9040a8964b939943 P 39e0358c9c10431bba61c406bd8e3f0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.601665  6551 raft_consensus.cc:2468] T 64ff957a9b6c455d9040a8964b939943 P 39e0358c9c10431bba61c406bd8e3f0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e3fd9a56720494e83801990c9a73079 in term 1.
I20260709 13:12:52.601752  6402 raft_consensus.cc:2468] T 64ff957a9b6c455d9040a8964b939943 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e3fd9a56720494e83801990c9a73079 in term 1.
I20260709 13:12:52.602823  6440 leader_election.cc:304] T 64ff957a9b6c455d9040a8964b939943 P 2e3fd9a56720494e83801990c9a73079 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e3fd9a56720494e83801990c9a73079, 39e0358c9c10431bba61c406bd8e3f0d; no voters: 
I20260709 13:12:52.603502  6599 raft_consensus.cc:2804] T 64ff957a9b6c455d9040a8964b939943 P 2e3fd9a56720494e83801990c9a73079 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:52.604424  6599 raft_consensus.cc:697] T 64ff957a9b6c455d9040a8964b939943 P 2e3fd9a56720494e83801990c9a73079 [term 1 LEADER]: Becoming Leader. State: Replica: 2e3fd9a56720494e83801990c9a73079, State: Running, Role: LEADER
I20260709 13:12:52.605176  6599 consensus_queue.cc:237] T 64ff957a9b6c455d9040a8964b939943 P 2e3fd9a56720494e83801990c9a73079 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } }
I20260709 13:12:52.609428  6596 consensus_queue.cc:1048] T db3d865b7cf544e189c439b096e1c738 P 565427c1ddb74ce49aa2b910f0ce0f3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:52.614552  6299 catalog_manager.cc:5697] T 64ff957a9b6c455d9040a8964b939943 P 2e3fd9a56720494e83801990c9a73079 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e3fd9a56720494e83801990c9a73079 (127.28.173.2). New cstate: current_term: 1 leader_uuid: "2e3fd9a56720494e83801990c9a73079" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:52.629101  6606 consensus_queue.cc:1048] T db3d865b7cf544e189c439b096e1c738 P 565427c1ddb74ce49aa2b910f0ce0f3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:52.667202  6601 consensus_queue.cc:1048] T ab54bb428d1044dea3614a20b66f0d40 P 39e0358c9c10431bba61c406bd8e3f0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:52.678833  6609 consensus_queue.cc:1048] T ab54bb428d1044dea3614a20b66f0d40 P 39e0358c9c10431bba61c406bd8e3f0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:52.875483  6599 raft_consensus.cc:493] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 2e3fd9a56720494e83801990c9a73079 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:52.876044  6599 raft_consensus.cc:515] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 2e3fd9a56720494e83801990c9a73079 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } }
I20260709 13:12:52.877919  6599 leader_election.cc:290] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 2e3fd9a56720494e83801990c9a73079 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 565427c1ddb74ce49aa2b910f0ce0f3f (127.28.173.1:43981), 39e0358c9c10431bba61c406bd8e3f0d (127.28.173.3:46591)
I20260709 13:12:52.878937  6551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd8f1db7f444de1a5dea34eec9cfbd0" candidate_uuid: "2e3fd9a56720494e83801990c9a73079" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39e0358c9c10431bba61c406bd8e3f0d" is_pre_election: true
I20260709 13:12:52.878813  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd8f1db7f444de1a5dea34eec9cfbd0" candidate_uuid: "2e3fd9a56720494e83801990c9a73079" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" is_pre_election: true
I20260709 13:12:52.879706  6551 raft_consensus.cc:2468] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 39e0358c9c10431bba61c406bd8e3f0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e3fd9a56720494e83801990c9a73079 in term 0.
I20260709 13:12:52.879796  6402 raft_consensus.cc:2468] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e3fd9a56720494e83801990c9a73079 in term 0.
I20260709 13:12:52.880893  6441 leader_election.cc:304] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 2e3fd9a56720494e83801990c9a73079 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e3fd9a56720494e83801990c9a73079, 565427c1ddb74ce49aa2b910f0ce0f3f; no voters: 
I20260709 13:12:52.881749  6599 raft_consensus.cc:2804] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 2e3fd9a56720494e83801990c9a73079 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:52.882304  6599 raft_consensus.cc:493] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 2e3fd9a56720494e83801990c9a73079 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:52.882530  6599 raft_consensus.cc:3060] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 2e3fd9a56720494e83801990c9a73079 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.887547  6599 raft_consensus.cc:515] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 2e3fd9a56720494e83801990c9a73079 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } }
I20260709 13:12:52.889109  6599 leader_election.cc:290] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 2e3fd9a56720494e83801990c9a73079 [CANDIDATE]: Term 1 election: Requested vote from peers 565427c1ddb74ce49aa2b910f0ce0f3f (127.28.173.1:43981), 39e0358c9c10431bba61c406bd8e3f0d (127.28.173.3:46591)
I20260709 13:12:52.889989  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd8f1db7f444de1a5dea34eec9cfbd0" candidate_uuid: "2e3fd9a56720494e83801990c9a73079" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f"
I20260709 13:12:52.890174  6551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd8f1db7f444de1a5dea34eec9cfbd0" candidate_uuid: "2e3fd9a56720494e83801990c9a73079" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39e0358c9c10431bba61c406bd8e3f0d"
I20260709 13:12:52.890573  6402 raft_consensus.cc:3060] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.890751  6551 raft_consensus.cc:3060] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 39e0358c9c10431bba61c406bd8e3f0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:52.895509  6402 raft_consensus.cc:2468] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e3fd9a56720494e83801990c9a73079 in term 1.
I20260709 13:12:52.895509  6551 raft_consensus.cc:2468] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 39e0358c9c10431bba61c406bd8e3f0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e3fd9a56720494e83801990c9a73079 in term 1.
I20260709 13:12:52.896704  6441 leader_election.cc:304] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 2e3fd9a56720494e83801990c9a73079 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e3fd9a56720494e83801990c9a73079, 565427c1ddb74ce49aa2b910f0ce0f3f; no voters: 
I20260709 13:12:52.897464  6599 raft_consensus.cc:2804] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 2e3fd9a56720494e83801990c9a73079 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:52.897889  6599 raft_consensus.cc:697] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 2e3fd9a56720494e83801990c9a73079 [term 1 LEADER]: Becoming Leader. State: Replica: 2e3fd9a56720494e83801990c9a73079, State: Running, Role: LEADER
I20260709 13:12:52.898500  6599 consensus_queue.cc:237] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 2e3fd9a56720494e83801990c9a73079 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } }
I20260709 13:12:52.906090  6298 catalog_manager.cc:5697] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 2e3fd9a56720494e83801990c9a73079 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e3fd9a56720494e83801990c9a73079 (127.28.173.2). New cstate: current_term: 1 leader_uuid: "2e3fd9a56720494e83801990c9a73079" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:53.010198  6599 consensus_queue.cc:1048] T 64ff957a9b6c455d9040a8964b939943 P 2e3fd9a56720494e83801990c9a73079 [LEADER]: Connected to new peer: Peer: permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:53.025105  6637 consensus_queue.cc:1048] T 64ff957a9b6c455d9040a8964b939943 P 2e3fd9a56720494e83801990c9a73079 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:53.035151  6551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab54bb428d1044dea3614a20b66f0d40"
dest_uuid: "39e0358c9c10431bba61c406bd8e3f0d"
mode: GRACEFUL
new_leader_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f"
 from {username='slave'} at 127.0.0.1:53620
I20260709 13:12:53.035722  6551 raft_consensus.cc:606] T ab54bb428d1044dea3614a20b66f0d40 P 39e0358c9c10431bba61c406bd8e3f0d [term 1 LEADER]: Received request to transfer leadership to TS 565427c1ddb74ce49aa2b910f0ce0f3f
I20260709 13:12:53.048964  6402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db3d865b7cf544e189c439b096e1c738"
dest_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f"
mode: GRACEFUL
new_leader_uuid: "2e3fd9a56720494e83801990c9a73079"
 from {username='slave'} at 127.0.0.1:50286
I20260709 13:12:53.049480  6402 raft_consensus.cc:606] T db3d865b7cf544e189c439b096e1c738 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 1 LEADER]: Received request to transfer leadership to TS 2e3fd9a56720494e83801990c9a73079
I20260709 13:12:53.063117  6477 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64ff957a9b6c455d9040a8964b939943"
dest_uuid: "2e3fd9a56720494e83801990c9a73079"
mode: GRACEFUL
new_leader_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f"
 from {username='slave'} at 127.0.0.1:33266
I20260709 13:12:53.063629  6477 raft_consensus.cc:606] T 64ff957a9b6c455d9040a8964b939943 P 2e3fd9a56720494e83801990c9a73079 [term 1 LEADER]: Received request to transfer leadership to TS 565427c1ddb74ce49aa2b910f0ce0f3f
I20260709 13:12:53.068540  6477 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbd8f1db7f444de1a5dea34eec9cfbd0"
dest_uuid: "2e3fd9a56720494e83801990c9a73079"
mode: GRACEFUL
new_leader_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f"
 from {username='slave'} at 127.0.0.1:33266
I20260709 13:12:53.069017  6477 raft_consensus.cc:606] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 2e3fd9a56720494e83801990c9a73079 [term 1 LEADER]: Received request to transfer leadership to TS 565427c1ddb74ce49aa2b910f0ce0f3f
I20260709 13:12:53.073217  6633 raft_consensus.cc:993] T ab54bb428d1044dea3614a20b66f0d40 P 39e0358c9c10431bba61c406bd8e3f0d: : Instructing follower 565427c1ddb74ce49aa2b910f0ce0f3f to start an election
I20260709 13:12:53.073621  6609 raft_consensus.cc:1081] T ab54bb428d1044dea3614a20b66f0d40 P 39e0358c9c10431bba61c406bd8e3f0d [term 1 LEADER]: Signalling peer 565427c1ddb74ce49aa2b910f0ce0f3f to start an election
I20260709 13:12:53.075143  6402 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab54bb428d1044dea3614a20b66f0d40"
dest_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f"
 from {username='slave'} at 127.0.0.1:50280
I20260709 13:12:53.075704  6402 raft_consensus.cc:493] T ab54bb428d1044dea3614a20b66f0d40 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:53.076087  6402 raft_consensus.cc:3060] T ab54bb428d1044dea3614a20b66f0d40 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:53.081876  6402 raft_consensus.cc:515] T ab54bb428d1044dea3614a20b66f0d40 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } }
I20260709 13:12:53.083951  6402 leader_election.cc:290] T ab54bb428d1044dea3614a20b66f0d40 P 565427c1ddb74ce49aa2b910f0ce0f3f [CANDIDATE]: Term 2 election: Requested vote from peers 39e0358c9c10431bba61c406bd8e3f0d (127.28.173.3:46591), 2e3fd9a56720494e83801990c9a73079 (127.28.173.2:39255)
I20260709 13:12:53.085011  6477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab54bb428d1044dea3614a20b66f0d40" candidate_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e3fd9a56720494e83801990c9a73079"
I20260709 13:12:53.085414  6551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab54bb428d1044dea3614a20b66f0d40" candidate_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "39e0358c9c10431bba61c406bd8e3f0d"
I20260709 13:12:53.085644  6477 raft_consensus.cc:3060] T ab54bb428d1044dea3614a20b66f0d40 P 2e3fd9a56720494e83801990c9a73079 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:53.086153  6551 raft_consensus.cc:3055] T ab54bb428d1044dea3614a20b66f0d40 P 39e0358c9c10431bba61c406bd8e3f0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:53.086522  6551 raft_consensus.cc:740] T ab54bb428d1044dea3614a20b66f0d40 P 39e0358c9c10431bba61c406bd8e3f0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 39e0358c9c10431bba61c406bd8e3f0d, State: Running, Role: LEADER
I20260709 13:12:53.087451  6551 consensus_queue.cc:260] T ab54bb428d1044dea3614a20b66f0d40 P 39e0358c9c10431bba61c406bd8e3f0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } }
I20260709 13:12:53.088703  6551 raft_consensus.cc:3060] T ab54bb428d1044dea3614a20b66f0d40 P 39e0358c9c10431bba61c406bd8e3f0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:53.091884  6477 raft_consensus.cc:2468] T ab54bb428d1044dea3614a20b66f0d40 P 2e3fd9a56720494e83801990c9a73079 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 565427c1ddb74ce49aa2b910f0ce0f3f in term 2.
I20260709 13:12:53.093057  6365 leader_election.cc:304] T ab54bb428d1044dea3614a20b66f0d40 P 565427c1ddb74ce49aa2b910f0ce0f3f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e3fd9a56720494e83801990c9a73079, 565427c1ddb74ce49aa2b910f0ce0f3f; no voters: 
I20260709 13:12:53.093935  6606 raft_consensus.cc:2804] T ab54bb428d1044dea3614a20b66f0d40 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:53.094411  6606 raft_consensus.cc:697] T ab54bb428d1044dea3614a20b66f0d40 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 2 LEADER]: Becoming Leader. State: Replica: 565427c1ddb74ce49aa2b910f0ce0f3f, State: Running, Role: LEADER
I20260709 13:12:53.095139  6606 consensus_queue.cc:237] T ab54bb428d1044dea3614a20b66f0d40 P 565427c1ddb74ce49aa2b910f0ce0f3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } }
I20260709 13:12:53.097082  6551 raft_consensus.cc:2468] T ab54bb428d1044dea3614a20b66f0d40 P 39e0358c9c10431bba61c406bd8e3f0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 565427c1ddb74ce49aa2b910f0ce0f3f in term 2.
I20260709 13:12:53.101967  6299 catalog_manager.cc:5697] T ab54bb428d1044dea3614a20b66f0d40 P 565427c1ddb74ce49aa2b910f0ce0f3f reported cstate change: term changed from 1 to 2, leader changed from 39e0358c9c10431bba61c406bd8e3f0d (127.28.173.3) to 565427c1ddb74ce49aa2b910f0ce0f3f (127.28.173.1). New cstate: current_term: 2 leader_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:53.215837  6628 raft_consensus.cc:993] T db3d865b7cf544e189c439b096e1c738 P 565427c1ddb74ce49aa2b910f0ce0f3f: : Instructing follower 2e3fd9a56720494e83801990c9a73079 to start an election
I20260709 13:12:53.216348  6641 raft_consensus.cc:1081] T db3d865b7cf544e189c439b096e1c738 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 1 LEADER]: Signalling peer 2e3fd9a56720494e83801990c9a73079 to start an election
I20260709 13:12:53.218103  6477 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db3d865b7cf544e189c439b096e1c738"
dest_uuid: "2e3fd9a56720494e83801990c9a73079"
 from {username='slave'} at 127.0.0.1:33248
I20260709 13:12:53.218767  6477 raft_consensus.cc:493] T db3d865b7cf544e189c439b096e1c738 P 2e3fd9a56720494e83801990c9a73079 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:53.219203  6477 raft_consensus.cc:3060] T db3d865b7cf544e189c439b096e1c738 P 2e3fd9a56720494e83801990c9a73079 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:53.226089  6477 raft_consensus.cc:515] T db3d865b7cf544e189c439b096e1c738 P 2e3fd9a56720494e83801990c9a73079 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } }
I20260709 13:12:53.227970  6477 leader_election.cc:290] T db3d865b7cf544e189c439b096e1c738 P 2e3fd9a56720494e83801990c9a73079 [CANDIDATE]: Term 2 election: Requested vote from peers 565427c1ddb74ce49aa2b910f0ce0f3f (127.28.173.1:43981), 39e0358c9c10431bba61c406bd8e3f0d (127.28.173.3:46591)
I20260709 13:12:53.228607  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db3d865b7cf544e189c439b096e1c738" candidate_uuid: "2e3fd9a56720494e83801990c9a73079" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f"
I20260709 13:12:53.228865  6551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db3d865b7cf544e189c439b096e1c738" candidate_uuid: "2e3fd9a56720494e83801990c9a73079" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "39e0358c9c10431bba61c406bd8e3f0d"
I20260709 13:12:53.229270  6402 raft_consensus.cc:3055] T db3d865b7cf544e189c439b096e1c738 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:53.229504  6551 raft_consensus.cc:3060] T db3d865b7cf544e189c439b096e1c738 P 39e0358c9c10431bba61c406bd8e3f0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:53.229631  6402 raft_consensus.cc:740] T db3d865b7cf544e189c439b096e1c738 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 565427c1ddb74ce49aa2b910f0ce0f3f, State: Running, Role: LEADER
I20260709 13:12:53.230525  6402 consensus_queue.cc:260] T db3d865b7cf544e189c439b096e1c738 P 565427c1ddb74ce49aa2b910f0ce0f3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } }
I20260709 13:12:53.231743  6402 raft_consensus.cc:3060] T db3d865b7cf544e189c439b096e1c738 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:53.236795  6551 raft_consensus.cc:2468] T db3d865b7cf544e189c439b096e1c738 P 39e0358c9c10431bba61c406bd8e3f0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e3fd9a56720494e83801990c9a73079 in term 2.
I20260709 13:12:53.238193  6440 leader_election.cc:304] T db3d865b7cf544e189c439b096e1c738 P 2e3fd9a56720494e83801990c9a73079 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e3fd9a56720494e83801990c9a73079, 39e0358c9c10431bba61c406bd8e3f0d; no voters: 
I20260709 13:12:53.238471  6402 raft_consensus.cc:2468] T db3d865b7cf544e189c439b096e1c738 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e3fd9a56720494e83801990c9a73079 in term 2.
I20260709 13:12:53.238927  6637 raft_consensus.cc:2804] T db3d865b7cf544e189c439b096e1c738 P 2e3fd9a56720494e83801990c9a73079 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:53.239391  6637 raft_consensus.cc:697] T db3d865b7cf544e189c439b096e1c738 P 2e3fd9a56720494e83801990c9a73079 [term 2 LEADER]: Becoming Leader. State: Replica: 2e3fd9a56720494e83801990c9a73079, State: Running, Role: LEADER
I20260709 13:12:53.240190  6637 consensus_queue.cc:237] T db3d865b7cf544e189c439b096e1c738 P 2e3fd9a56720494e83801990c9a73079 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } }
I20260709 13:12:53.246222  6299 catalog_manager.cc:5697] T db3d865b7cf544e189c439b096e1c738 P 2e3fd9a56720494e83801990c9a73079 reported cstate change: term changed from 1 to 2, leader changed from 565427c1ddb74ce49aa2b910f0ce0f3f (127.28.173.1) to 2e3fd9a56720494e83801990c9a73079 (127.28.173.2). New cstate: current_term: 2 leader_uuid: "2e3fd9a56720494e83801990c9a73079" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:53.447747  6637 consensus_queue.cc:1048] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 2e3fd9a56720494e83801990c9a73079 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:53.457672  6599 consensus_queue.cc:1048] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 2e3fd9a56720494e83801990c9a73079 [LEADER]: Connected to new peer: Peer: permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:53.464701  6624 raft_consensus.cc:993] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 2e3fd9a56720494e83801990c9a73079: : Instructing follower 565427c1ddb74ce49aa2b910f0ce0f3f to start an election
I20260709 13:12:53.465143  6599 raft_consensus.cc:1081] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 2e3fd9a56720494e83801990c9a73079 [term 1 LEADER]: Signalling peer 565427c1ddb74ce49aa2b910f0ce0f3f to start an election
I20260709 13:12:53.466564  6402 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fbd8f1db7f444de1a5dea34eec9cfbd0"
dest_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f"
 from {username='slave'} at 127.0.0.1:50282
I20260709 13:12:53.467052  6402 raft_consensus.cc:493] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:53.467342  6402 raft_consensus.cc:3060] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:53.472240  6402 raft_consensus.cc:515] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } }
I20260709 13:12:53.473654  6402 leader_election.cc:290] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 565427c1ddb74ce49aa2b910f0ce0f3f [CANDIDATE]: Term 2 election: Requested vote from peers 2e3fd9a56720494e83801990c9a73079 (127.28.173.2:39255), 39e0358c9c10431bba61c406bd8e3f0d (127.28.173.3:46591)
I20260709 13:12:53.474522  6477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd8f1db7f444de1a5dea34eec9cfbd0" candidate_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e3fd9a56720494e83801990c9a73079"
I20260709 13:12:53.475154  6477 raft_consensus.cc:3055] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 2e3fd9a56720494e83801990c9a73079 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:53.475436  6477 raft_consensus.cc:740] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 2e3fd9a56720494e83801990c9a73079 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e3fd9a56720494e83801990c9a73079, State: Running, Role: LEADER
I20260709 13:12:53.475661  6551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbd8f1db7f444de1a5dea34eec9cfbd0" candidate_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "39e0358c9c10431bba61c406bd8e3f0d"
I20260709 13:12:53.476301  6551 raft_consensus.cc:3060] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 39e0358c9c10431bba61c406bd8e3f0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:53.476212  6477 consensus_queue.cc:260] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 2e3fd9a56720494e83801990c9a73079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } }
I20260709 13:12:53.477296  6477 raft_consensus.cc:3060] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 2e3fd9a56720494e83801990c9a73079 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:53.482067  6551 raft_consensus.cc:2468] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 39e0358c9c10431bba61c406bd8e3f0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 565427c1ddb74ce49aa2b910f0ce0f3f in term 2.
I20260709 13:12:53.482499  6477 raft_consensus.cc:2468] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 2e3fd9a56720494e83801990c9a73079 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 565427c1ddb74ce49aa2b910f0ce0f3f in term 2.
I20260709 13:12:53.483145  6365 leader_election.cc:304] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 565427c1ddb74ce49aa2b910f0ce0f3f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39e0358c9c10431bba61c406bd8e3f0d, 565427c1ddb74ce49aa2b910f0ce0f3f; no voters: 
I20260709 13:12:53.484032  6641 raft_consensus.cc:2804] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:53.484472  6641 raft_consensus.cc:697] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 2 LEADER]: Becoming Leader. State: Replica: 565427c1ddb74ce49aa2b910f0ce0f3f, State: Running, Role: LEADER
I20260709 13:12:53.485157  6641 consensus_queue.cc:237] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 565427c1ddb74ce49aa2b910f0ce0f3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } }
I20260709 13:12:53.491457  6298 catalog_manager.cc:5697] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 565427c1ddb74ce49aa2b910f0ce0f3f reported cstate change: term changed from 1 to 2, leader changed from 2e3fd9a56720494e83801990c9a73079 (127.28.173.2) to 565427c1ddb74ce49aa2b910f0ce0f3f (127.28.173.1). New cstate: current_term: 2 leader_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:53.493968  6477 raft_consensus.cc:1275] T ab54bb428d1044dea3614a20b66f0d40 P 2e3fd9a56720494e83801990c9a73079 [term 2 FOLLOWER]: Refusing update from remote peer 565427c1ddb74ce49aa2b910f0ce0f3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:53.495296  6641 consensus_queue.cc:1048] T ab54bb428d1044dea3614a20b66f0d40 P 565427c1ddb74ce49aa2b910f0ce0f3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:53.505409  6551 raft_consensus.cc:1275] T ab54bb428d1044dea3614a20b66f0d40 P 39e0358c9c10431bba61c406bd8e3f0d [term 2 FOLLOWER]: Refusing update from remote peer 565427c1ddb74ce49aa2b910f0ce0f3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:53.506970  6606 consensus_queue.cc:1048] T ab54bb428d1044dea3614a20b66f0d40 P 565427c1ddb74ce49aa2b910f0ce0f3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:53.537352  6624 raft_consensus.cc:993] T 64ff957a9b6c455d9040a8964b939943 P 2e3fd9a56720494e83801990c9a73079: : Instructing follower 565427c1ddb74ce49aa2b910f0ce0f3f to start an election
I20260709 13:12:53.537811  6599 raft_consensus.cc:1081] T 64ff957a9b6c455d9040a8964b939943 P 2e3fd9a56720494e83801990c9a73079 [term 1 LEADER]: Signalling peer 565427c1ddb74ce49aa2b910f0ce0f3f to start an election
I20260709 13:12:53.539198  6402 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64ff957a9b6c455d9040a8964b939943"
dest_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f"
 from {username='slave'} at 127.0.0.1:50282
I20260709 13:12:53.539669  6402 raft_consensus.cc:493] T 64ff957a9b6c455d9040a8964b939943 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:53.540045  6402 raft_consensus.cc:3060] T 64ff957a9b6c455d9040a8964b939943 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:53.546255  6402 raft_consensus.cc:515] T 64ff957a9b6c455d9040a8964b939943 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } }
I20260709 13:12:53.547974  6402 leader_election.cc:290] T 64ff957a9b6c455d9040a8964b939943 P 565427c1ddb74ce49aa2b910f0ce0f3f [CANDIDATE]: Term 2 election: Requested vote from peers 2e3fd9a56720494e83801990c9a73079 (127.28.173.2:39255), 39e0358c9c10431bba61c406bd8e3f0d (127.28.173.3:46591)
I20260709 13:12:53.548545  6477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ff957a9b6c455d9040a8964b939943" candidate_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e3fd9a56720494e83801990c9a73079"
I20260709 13:12:53.549289  6477 raft_consensus.cc:3055] T 64ff957a9b6c455d9040a8964b939943 P 2e3fd9a56720494e83801990c9a73079 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:53.549444  6551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ff957a9b6c455d9040a8964b939943" candidate_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "39e0358c9c10431bba61c406bd8e3f0d"
I20260709 13:12:53.549651  6477 raft_consensus.cc:740] T 64ff957a9b6c455d9040a8964b939943 P 2e3fd9a56720494e83801990c9a73079 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e3fd9a56720494e83801990c9a73079, State: Running, Role: LEADER
I20260709 13:12:53.550076  6551 raft_consensus.cc:3060] T 64ff957a9b6c455d9040a8964b939943 P 39e0358c9c10431bba61c406bd8e3f0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:53.550674  6477 consensus_queue.cc:260] T 64ff957a9b6c455d9040a8964b939943 P 2e3fd9a56720494e83801990c9a73079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } }
I20260709 13:12:53.552029  6477 raft_consensus.cc:3060] T 64ff957a9b6c455d9040a8964b939943 P 2e3fd9a56720494e83801990c9a73079 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:53.557083  6551 raft_consensus.cc:2468] T 64ff957a9b6c455d9040a8964b939943 P 39e0358c9c10431bba61c406bd8e3f0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 565427c1ddb74ce49aa2b910f0ce0f3f in term 2.
I20260709 13:12:53.558166  6365 leader_election.cc:304] T 64ff957a9b6c455d9040a8964b939943 P 565427c1ddb74ce49aa2b910f0ce0f3f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39e0358c9c10431bba61c406bd8e3f0d, 565427c1ddb74ce49aa2b910f0ce0f3f; no voters: 
I20260709 13:12:53.558655  6477 raft_consensus.cc:2468] T 64ff957a9b6c455d9040a8964b939943 P 2e3fd9a56720494e83801990c9a73079 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 565427c1ddb74ce49aa2b910f0ce0f3f in term 2.
I20260709 13:12:53.558832  6606 raft_consensus.cc:2804] T 64ff957a9b6c455d9040a8964b939943 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:53.559394  6606 raft_consensus.cc:697] T 64ff957a9b6c455d9040a8964b939943 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 2 LEADER]: Becoming Leader. State: Replica: 565427c1ddb74ce49aa2b910f0ce0f3f, State: Running, Role: LEADER
I20260709 13:12:53.560213  6606 consensus_queue.cc:237] T 64ff957a9b6c455d9040a8964b939943 P 565427c1ddb74ce49aa2b910f0ce0f3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } }
I20260709 13:12:53.566053  6299 catalog_manager.cc:5697] T 64ff957a9b6c455d9040a8964b939943 P 565427c1ddb74ce49aa2b910f0ce0f3f reported cstate change: term changed from 1 to 2, leader changed from 2e3fd9a56720494e83801990c9a73079 (127.28.173.2) to 565427c1ddb74ce49aa2b910f0ce0f3f (127.28.173.1). New cstate: current_term: 2 leader_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:53.705365  6402 raft_consensus.cc:1275] T db3d865b7cf544e189c439b096e1c738 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 2 FOLLOWER]: Refusing update from remote peer 2e3fd9a56720494e83801990c9a73079: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:53.706732  6599 consensus_queue.cc:1048] T db3d865b7cf544e189c439b096e1c738 P 2e3fd9a56720494e83801990c9a73079 [LEADER]: Connected to new peer: Peer: permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:53.715382  6551 raft_consensus.cc:1275] T db3d865b7cf544e189c439b096e1c738 P 39e0358c9c10431bba61c406bd8e3f0d [term 2 FOLLOWER]: Refusing update from remote peer 2e3fd9a56720494e83801990c9a73079: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:53.718499  6599 consensus_queue.cc:1048] T db3d865b7cf544e189c439b096e1c738 P 2e3fd9a56720494e83801990c9a73079 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:53.780848 29364 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:12:53.782315 29364 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:12:53.782637 29364 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:12:53.794027  6402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64ff957a9b6c455d9040a8964b939943"
dest_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f"
mode: GRACEFUL
new_leader_uuid: "39e0358c9c10431bba61c406bd8e3f0d"
 from {username='slave'} at 127.0.0.1:50288
I20260709 13:12:53.794572  6402 raft_consensus.cc:606] T 64ff957a9b6c455d9040a8964b939943 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 2 LEADER]: Received request to transfer leadership to TS 39e0358c9c10431bba61c406bd8e3f0d
I20260709 13:12:53.795667 29364 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:12:53.892120  6551 raft_consensus.cc:1275] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 39e0358c9c10431bba61c406bd8e3f0d [term 2 FOLLOWER]: Refusing update from remote peer 565427c1ddb74ce49aa2b910f0ce0f3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:53.893393  6606 consensus_queue.cc:1048] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 565427c1ddb74ce49aa2b910f0ce0f3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:53.900904  6477 raft_consensus.cc:1275] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 2e3fd9a56720494e83801990c9a73079 [term 2 FOLLOWER]: Refusing update from remote peer 565427c1ddb74ce49aa2b910f0ce0f3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:53.902976  6606 consensus_queue.cc:1048] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 565427c1ddb74ce49aa2b910f0ce0f3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:53.985056  6477 raft_consensus.cc:1275] T 64ff957a9b6c455d9040a8964b939943 P 2e3fd9a56720494e83801990c9a73079 [term 2 FOLLOWER]: Refusing update from remote peer 565427c1ddb74ce49aa2b910f0ce0f3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:53.986670  6641 consensus_queue.cc:1048] T 64ff957a9b6c455d9040a8964b939943 P 565427c1ddb74ce49aa2b910f0ce0f3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:53.991250  6551 raft_consensus.cc:1275] T 64ff957a9b6c455d9040a8964b939943 P 39e0358c9c10431bba61c406bd8e3f0d [term 2 FOLLOWER]: Refusing update from remote peer 565427c1ddb74ce49aa2b910f0ce0f3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:53.992739  6628 consensus_queue.cc:1048] T 64ff957a9b6c455d9040a8964b939943 P 565427c1ddb74ce49aa2b910f0ce0f3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:54.001773  6628 raft_consensus.cc:993] T 64ff957a9b6c455d9040a8964b939943 P 565427c1ddb74ce49aa2b910f0ce0f3f: : Instructing follower 39e0358c9c10431bba61c406bd8e3f0d to start an election
I20260709 13:12:54.002200  6628 raft_consensus.cc:1081] T 64ff957a9b6c455d9040a8964b939943 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 2 LEADER]: Signalling peer 39e0358c9c10431bba61c406bd8e3f0d to start an election
I20260709 13:12:54.003731  6551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64ff957a9b6c455d9040a8964b939943"
dest_uuid: "39e0358c9c10431bba61c406bd8e3f0d"
 from {username='slave'} at 127.0.0.1:53590
I20260709 13:12:54.004256  6551 raft_consensus.cc:493] T 64ff957a9b6c455d9040a8964b939943 P 39e0358c9c10431bba61c406bd8e3f0d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:54.004633  6551 raft_consensus.cc:3060] T 64ff957a9b6c455d9040a8964b939943 P 39e0358c9c10431bba61c406bd8e3f0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:54.009732  6551 raft_consensus.cc:515] T 64ff957a9b6c455d9040a8964b939943 P 39e0358c9c10431bba61c406bd8e3f0d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } }
I20260709 13:12:54.011752  6551 leader_election.cc:290] T 64ff957a9b6c455d9040a8964b939943 P 39e0358c9c10431bba61c406bd8e3f0d [CANDIDATE]: Term 3 election: Requested vote from peers 565427c1ddb74ce49aa2b910f0ce0f3f (127.28.173.1:43981), 2e3fd9a56720494e83801990c9a73079 (127.28.173.2:39255)
I20260709 13:12:54.012080  6402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ff957a9b6c455d9040a8964b939943" candidate_uuid: "39e0358c9c10431bba61c406bd8e3f0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f"
I20260709 13:12:54.012722  6402 raft_consensus.cc:3055] T 64ff957a9b6c455d9040a8964b939943 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:54.012985  6476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ff957a9b6c455d9040a8964b939943" candidate_uuid: "39e0358c9c10431bba61c406bd8e3f0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2e3fd9a56720494e83801990c9a73079"
I20260709 13:12:54.013042  6402 raft_consensus.cc:740] T 64ff957a9b6c455d9040a8964b939943 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 565427c1ddb74ce49aa2b910f0ce0f3f, State: Running, Role: LEADER
I20260709 13:12:54.013685  6476 raft_consensus.cc:3060] T 64ff957a9b6c455d9040a8964b939943 P 2e3fd9a56720494e83801990c9a73079 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:54.014139  6402 consensus_queue.cc:260] T 64ff957a9b6c455d9040a8964b939943 P 565427c1ddb74ce49aa2b910f0ce0f3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } }
I20260709 13:12:54.015547  6402 raft_consensus.cc:3060] T 64ff957a9b6c455d9040a8964b939943 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:54.018815  6476 raft_consensus.cc:2468] T 64ff957a9b6c455d9040a8964b939943 P 2e3fd9a56720494e83801990c9a73079 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39e0358c9c10431bba61c406bd8e3f0d in term 3.
I20260709 13:12:54.019857  6514 leader_election.cc:304] T 64ff957a9b6c455d9040a8964b939943 P 39e0358c9c10431bba61c406bd8e3f0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e3fd9a56720494e83801990c9a73079, 39e0358c9c10431bba61c406bd8e3f0d; no voters: 
I20260709 13:12:54.020510  6609 raft_consensus.cc:2804] T 64ff957a9b6c455d9040a8964b939943 P 39e0358c9c10431bba61c406bd8e3f0d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:54.020848  6402 raft_consensus.cc:2468] T 64ff957a9b6c455d9040a8964b939943 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39e0358c9c10431bba61c406bd8e3f0d in term 3.
I20260709 13:12:54.021706  6609 raft_consensus.cc:697] T 64ff957a9b6c455d9040a8964b939943 P 39e0358c9c10431bba61c406bd8e3f0d [term 3 LEADER]: Becoming Leader. State: Replica: 39e0358c9c10431bba61c406bd8e3f0d, State: Running, Role: LEADER
I20260709 13:12:54.022591  6609 consensus_queue.cc:237] T 64ff957a9b6c455d9040a8964b939943 P 39e0358c9c10431bba61c406bd8e3f0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } }
I20260709 13:12:54.028008  6299 catalog_manager.cc:5697] T 64ff957a9b6c455d9040a8964b939943 P 39e0358c9c10431bba61c406bd8e3f0d reported cstate change: term changed from 2 to 3, leader changed from 565427c1ddb74ce49aa2b910f0ce0f3f (127.28.173.1) to 39e0358c9c10431bba61c406bd8e3f0d (127.28.173.3). New cstate: current_term: 3 leader_uuid: "39e0358c9c10431bba61c406bd8e3f0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "565427c1ddb74ce49aa2b910f0ce0f3f" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 43981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e3fd9a56720494e83801990c9a73079" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 39255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39e0358c9c10431bba61c406bd8e3f0d" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 46591 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:54.140631 29364 tablet_server.cc:179] TabletServer@127.28.173.1:0 shutting down...
I20260709 13:12:54.165277 29364 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:54.165903 29364 tablet_replica.cc:333] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 565427c1ddb74ce49aa2b910f0ce0f3f: stopping tablet replica
I20260709 13:12:54.166409 29364 raft_consensus.cc:2243] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:54.167171 29364 raft_consensus.cc:2272] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:54.169387 29364 tablet_replica.cc:333] T ab54bb428d1044dea3614a20b66f0d40 P 565427c1ddb74ce49aa2b910f0ce0f3f: stopping tablet replica
I20260709 13:12:54.169867 29364 raft_consensus.cc:2243] T ab54bb428d1044dea3614a20b66f0d40 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:54.170512 29364 raft_consensus.cc:2272] T ab54bb428d1044dea3614a20b66f0d40 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:54.172600 29364 tablet_replica.cc:333] T 64ff957a9b6c455d9040a8964b939943 P 565427c1ddb74ce49aa2b910f0ce0f3f: stopping tablet replica
I20260709 13:12:54.173041 29364 raft_consensus.cc:2243] T 64ff957a9b6c455d9040a8964b939943 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:54.173372 29364 raft_consensus.cc:2272] T 64ff957a9b6c455d9040a8964b939943 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:54.175257 29364 tablet_replica.cc:333] T db3d865b7cf544e189c439b096e1c738 P 565427c1ddb74ce49aa2b910f0ce0f3f: stopping tablet replica
I20260709 13:12:54.175683 29364 raft_consensus.cc:2243] T db3d865b7cf544e189c439b096e1c738 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:54.176158 29364 raft_consensus.cc:2272] T db3d865b7cf544e189c439b096e1c738 P 565427c1ddb74ce49aa2b910f0ce0f3f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:54.198889 29364 tablet_server.cc:196] TabletServer@127.28.173.1:0 shutdown complete.
I20260709 13:12:54.212019 29364 tablet_server.cc:179] TabletServer@127.28.173.2:0 shutting down...
I20260709 13:12:54.233681 29364 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:54.234570 29364 tablet_replica.cc:333] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 2e3fd9a56720494e83801990c9a73079: stopping tablet replica
I20260709 13:12:54.235347 29364 raft_consensus.cc:2243] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 2e3fd9a56720494e83801990c9a73079 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:54.235915 29364 raft_consensus.cc:2272] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 2e3fd9a56720494e83801990c9a73079 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:54.238175 29364 tablet_replica.cc:333] T 64ff957a9b6c455d9040a8964b939943 P 2e3fd9a56720494e83801990c9a73079: stopping tablet replica
I20260709 13:12:54.238710 29364 raft_consensus.cc:2243] T 64ff957a9b6c455d9040a8964b939943 P 2e3fd9a56720494e83801990c9a73079 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:54.239143 29364 raft_consensus.cc:2272] T 64ff957a9b6c455d9040a8964b939943 P 2e3fd9a56720494e83801990c9a73079 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:54.241325 29364 tablet_replica.cc:333] T db3d865b7cf544e189c439b096e1c738 P 2e3fd9a56720494e83801990c9a73079: stopping tablet replica
I20260709 13:12:54.241822 29364 raft_consensus.cc:2243] T db3d865b7cf544e189c439b096e1c738 P 2e3fd9a56720494e83801990c9a73079 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:54.242611 29364 raft_consensus.cc:2272] T db3d865b7cf544e189c439b096e1c738 P 2e3fd9a56720494e83801990c9a73079 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:54.245265 29364 tablet_replica.cc:333] T ab54bb428d1044dea3614a20b66f0d40 P 2e3fd9a56720494e83801990c9a73079: stopping tablet replica
I20260709 13:12:54.245767 29364 raft_consensus.cc:2243] T ab54bb428d1044dea3614a20b66f0d40 P 2e3fd9a56720494e83801990c9a73079 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:54.246232 29364 raft_consensus.cc:2272] T ab54bb428d1044dea3614a20b66f0d40 P 2e3fd9a56720494e83801990c9a73079 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:54.269459 29364 tablet_server.cc:196] TabletServer@127.28.173.2:0 shutdown complete.
I20260709 13:12:54.283022 29364 tablet_server.cc:179] TabletServer@127.28.173.3:0 shutting down...
I20260709 13:12:54.304222 29364 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:54.304987 29364 tablet_replica.cc:333] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 39e0358c9c10431bba61c406bd8e3f0d: stopping tablet replica
I20260709 13:12:54.305599 29364 raft_consensus.cc:2243] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 39e0358c9c10431bba61c406bd8e3f0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:54.306072 29364 raft_consensus.cc:2272] T fbd8f1db7f444de1a5dea34eec9cfbd0 P 39e0358c9c10431bba61c406bd8e3f0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:54.308246 29364 tablet_replica.cc:333] T 64ff957a9b6c455d9040a8964b939943 P 39e0358c9c10431bba61c406bd8e3f0d: stopping tablet replica
I20260709 13:12:54.308768 29364 raft_consensus.cc:2243] T 64ff957a9b6c455d9040a8964b939943 P 39e0358c9c10431bba61c406bd8e3f0d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:54.309350 29364 pending_rounds.cc:70] T 64ff957a9b6c455d9040a8964b939943 P 39e0358c9c10431bba61c406bd8e3f0d: Trying to abort 1 pending ops.
I20260709 13:12:54.309540 29364 pending_rounds.cc:77] T 64ff957a9b6c455d9040a8964b939943 P 39e0358c9c10431bba61c406bd8e3f0d: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305636962403602432 op_type: NO_OP noop_request { }
I20260709 13:12:54.309834 29364 raft_consensus.cc:2889] T 64ff957a9b6c455d9040a8964b939943 P 39e0358c9c10431bba61c406bd8e3f0d [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:12:54.310106 29364 raft_consensus.cc:2272] T 64ff957a9b6c455d9040a8964b939943 P 39e0358c9c10431bba61c406bd8e3f0d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:54.312196 29364 tablet_replica.cc:333] T db3d865b7cf544e189c439b096e1c738 P 39e0358c9c10431bba61c406bd8e3f0d: stopping tablet replica
I20260709 13:12:54.312676 29364 raft_consensus.cc:2243] T db3d865b7cf544e189c439b096e1c738 P 39e0358c9c10431bba61c406bd8e3f0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:54.313086 29364 raft_consensus.cc:2272] T db3d865b7cf544e189c439b096e1c738 P 39e0358c9c10431bba61c406bd8e3f0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:54.315270 29364 tablet_replica.cc:333] T ab54bb428d1044dea3614a20b66f0d40 P 39e0358c9c10431bba61c406bd8e3f0d: stopping tablet replica
I20260709 13:12:54.315738 29364 raft_consensus.cc:2243] T ab54bb428d1044dea3614a20b66f0d40 P 39e0358c9c10431bba61c406bd8e3f0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:54.316211 29364 raft_consensus.cc:2272] T ab54bb428d1044dea3614a20b66f0d40 P 39e0358c9c10431bba61c406bd8e3f0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:54.339963 29364 tablet_server.cc:196] TabletServer@127.28.173.3:0 shutdown complete.
I20260709 13:12:54.352833 29364 master.cc:562] Master@127.28.173.62:45867 shutting down...
I20260709 13:12:54.371075 29364 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e8b61dddc08d4d8bb5da53603348e89e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:54.371610 29364 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e8b61dddc08d4d8bb5da53603348e89e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:54.371973 29364 tablet_replica.cc:333] T 00000000000000000000000000000000 P e8b61dddc08d4d8bb5da53603348e89e: stopping tablet replica
I20260709 13:12:54.390295 29364 master.cc:584] Master@127.28.173.62:45867 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (3126 ms)
[----------] 6 tests from LeaderRebalancerTest (330318 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:12:54.425475 29364 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.28.173.62:36439
I20260709 13:12:54.426589 29364 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:54.431970  6649 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:54.431979  6650 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:54.433423  6652 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:54.434494 29364 server_base.cc:1061] running on GCE node
I20260709 13:12:54.435246 29364 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:54.435442 29364 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:54.435596 29364 hybrid_clock.cc:648] HybridClock initialized: now 1783602774435565 us; error 0 us; skew 500 ppm
I20260709 13:12:54.436209 29364 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:54.438447 29364 webserver.cc:533] Webserver started at http://127.28.173.62:40389/ using document root <none> and password file <none>
I20260709 13:12:54.438910 29364 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:54.439095 29364 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:54.439363 29364 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:54.440465 29364 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602443945700-29364-0/minicluster-data/master-0-root/instance:
uuid: "db920ac05b3e46d6a9cb9539bad22704"
format_stamp: "Formatted at 2026-07-09 13:12:54 on dist-test-slave-x62b"
I20260709 13:12:54.444715 29364 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:12:54.447911  6657 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:54.448638 29364 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:12:54.448939 29364 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602443945700-29364-0/minicluster-data/master-0-root
uuid: "db920ac05b3e46d6a9cb9539bad22704"
format_stamp: "Formatted at 2026-07-09 13:12:54 on dist-test-slave-x62b"
I20260709 13:12:54.449247 29364 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602443945700-29364-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602443945700-29364-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602443945700-29364-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:54.461824 29364 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:54.462970 29364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:54.499781 29364 rpc_server.cc:307] RPC server started. Bound to: 127.28.173.62:36439
I20260709 13:12:54.499991  6708 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.173.62:36439 every 8 connection(s)
I20260709 13:12:54.503597  6709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:54.513927  6709 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db920ac05b3e46d6a9cb9539bad22704: Bootstrap starting.
I20260709 13:12:54.518363  6709 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P db920ac05b3e46d6a9cb9539bad22704: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.522289  6709 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db920ac05b3e46d6a9cb9539bad22704: No bootstrap required, opened a new log
I20260709 13:12:54.524302  6709 raft_consensus.cc:359] T 00000000000000000000000000000000 P db920ac05b3e46d6a9cb9539bad22704 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db920ac05b3e46d6a9cb9539bad22704" member_type: VOTER }
I20260709 13:12:54.524677  6709 raft_consensus.cc:385] T 00000000000000000000000000000000 P db920ac05b3e46d6a9cb9539bad22704 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.524904  6709 raft_consensus.cc:740] T 00000000000000000000000000000000 P db920ac05b3e46d6a9cb9539bad22704 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db920ac05b3e46d6a9cb9539bad22704, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.525528  6709 consensus_queue.cc:260] T 00000000000000000000000000000000 P db920ac05b3e46d6a9cb9539bad22704 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db920ac05b3e46d6a9cb9539bad22704" member_type: VOTER }
I20260709 13:12:54.525983  6709 raft_consensus.cc:399] T 00000000000000000000000000000000 P db920ac05b3e46d6a9cb9539bad22704 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:12:54.526199  6709 raft_consensus.cc:493] T 00000000000000000000000000000000 P db920ac05b3e46d6a9cb9539bad22704 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:12:54.526490  6709 raft_consensus.cc:3060] T 00000000000000000000000000000000 P db920ac05b3e46d6a9cb9539bad22704 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.530690  6709 raft_consensus.cc:515] T 00000000000000000000000000000000 P db920ac05b3e46d6a9cb9539bad22704 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db920ac05b3e46d6a9cb9539bad22704" member_type: VOTER }
I20260709 13:12:54.531200  6709 leader_election.cc:304] T 00000000000000000000000000000000 P db920ac05b3e46d6a9cb9539bad22704 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: db920ac05b3e46d6a9cb9539bad22704; no voters: 
I20260709 13:12:54.532298  6709 leader_election.cc:290] T 00000000000000000000000000000000 P db920ac05b3e46d6a9cb9539bad22704 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:12:54.532570  6712 raft_consensus.cc:2804] T 00000000000000000000000000000000 P db920ac05b3e46d6a9cb9539bad22704 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:54.534216  6712 raft_consensus.cc:697] T 00000000000000000000000000000000 P db920ac05b3e46d6a9cb9539bad22704 [term 1 LEADER]: Becoming Leader. State: Replica: db920ac05b3e46d6a9cb9539bad22704, State: Running, Role: LEADER
I20260709 13:12:54.534811  6712 consensus_queue.cc:237] T 00000000000000000000000000000000 P db920ac05b3e46d6a9cb9539bad22704 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db920ac05b3e46d6a9cb9539bad22704" member_type: VOTER }
I20260709 13:12:54.535302  6709 sys_catalog.cc:565] T 00000000000000000000000000000000 P db920ac05b3e46d6a9cb9539bad22704 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:12:54.537746  6713 sys_catalog.cc:455] T 00000000000000000000000000000000 P db920ac05b3e46d6a9cb9539bad22704 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "db920ac05b3e46d6a9cb9539bad22704" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db920ac05b3e46d6a9cb9539bad22704" member_type: VOTER } }
I20260709 13:12:54.537670  6714 sys_catalog.cc:455] T 00000000000000000000000000000000 P db920ac05b3e46d6a9cb9539bad22704 [sys.catalog]: SysCatalogTable state changed. Reason: New leader db920ac05b3e46d6a9cb9539bad22704. Latest consensus state: current_term: 1 leader_uuid: "db920ac05b3e46d6a9cb9539bad22704" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db920ac05b3e46d6a9cb9539bad22704" member_type: VOTER } }
I20260709 13:12:54.538543  6713 sys_catalog.cc:458] T 00000000000000000000000000000000 P db920ac05b3e46d6a9cb9539bad22704 [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:54.538697  6714 sys_catalog.cc:458] T 00000000000000000000000000000000 P db920ac05b3e46d6a9cb9539bad22704 [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:54.550804  6718 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:12:54.555495  6718 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:12:54.556607 29364 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:12:54.563694  6718 catalog_manager.cc:1383] Generated new cluster ID: 31d02f428302448ba25553a7e6497592
I20260709 13:12:54.564011  6718 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:12:54.575522  6718 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:12:54.576804  6718 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:12:54.594340  6718 catalog_manager.cc:6070] T 00000000000000000000000000000000 P db920ac05b3e46d6a9cb9539bad22704: Generated new TSK 0
I20260709 13:12:54.594954  6718 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:12:54.623294 29364 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:54.629148  6730 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:54.630412  6731 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:54.633416  6733 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:54.634173 29364 server_base.cc:1061] running on GCE node
I20260709 13:12:54.634994 29364 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:54.635197 29364 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:54.635351 29364 hybrid_clock.cc:648] HybridClock initialized: now 1783602774635338 us; error 0 us; skew 500 ppm
I20260709 13:12:54.635994 29364 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:54.638420 29364 webserver.cc:533] Webserver started at http://127.28.173.1:39089/ using document root <none> and password file <none>
I20260709 13:12:54.638912 29364 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:54.639089 29364 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:54.639371 29364 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:54.640475 29364 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602443945700-29364-0/minicluster-data/ts-0-root/instance:
uuid: "c694ff83326940089c4a5de4f701da85"
format_stamp: "Formatted at 2026-07-09 13:12:54 on dist-test-slave-x62b"
I20260709 13:12:54.644927 29364 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:12:54.648276  6738 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:54.649096 29364 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:12:54.649406 29364 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602443945700-29364-0/minicluster-data/ts-0-root
uuid: "c694ff83326940089c4a5de4f701da85"
format_stamp: "Formatted at 2026-07-09 13:12:54 on dist-test-slave-x62b"
I20260709 13:12:54.649729 29364 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602443945700-29364-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602443945700-29364-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602443945700-29364-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:54.659129 29364 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:54.660364 29364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:54.661818 29364 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:54.664114 29364 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:54.664326 29364 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:54.664570 29364 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:54.664763 29364 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:54.704699 29364 rpc_server.cc:307] RPC server started. Bound to: 127.28.173.1:41303
I20260709 13:12:54.704833  6800 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.173.1:41303 every 8 connection(s)
I20260709 13:12:54.709688 29364 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:54.716209  6805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:54.717344  6806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:54.720238 29364 server_base.cc:1061] running on GCE node
W20260709 13:12:54.721295  6808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:54.722388 29364 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:54.722605 29364 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:54.723246 29364 hybrid_clock.cc:648] HybridClock initialized: now 1783602774723228 us; error 0 us; skew 500 ppm
I20260709 13:12:54.723598  6801 heartbeater.cc:344] Connected to a master server at 127.28.173.62:36439
I20260709 13:12:54.723798 29364 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:54.724020  6801 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:54.724828  6801 heartbeater.cc:507] Master 127.28.173.62:36439 requested a full tablet report, sending...
I20260709 13:12:54.726658 29364 webserver.cc:533] Webserver started at http://127.28.173.2:46781/ using document root <none> and password file <none>
I20260709 13:12:54.726996  6674 ts_manager.cc:194] Registered new tserver with Master: c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303)
I20260709 13:12:54.727196 29364 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:54.727521 29364 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:54.727782 29364 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:54.728904 29364 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602443945700-29364-0/minicluster-data/ts-1-root/instance:
uuid: "3cfe532df476417a9a0b7d9c23aa32ea"
format_stamp: "Formatted at 2026-07-09 13:12:54 on dist-test-slave-x62b"
I20260709 13:12:54.728986  6674 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:32810
I20260709 13:12:54.733399 29364 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:12:54.736789  6813 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:54.737556 29364 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:12:54.737807 29364 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602443945700-29364-0/minicluster-data/ts-1-root
uuid: "3cfe532df476417a9a0b7d9c23aa32ea"
format_stamp: "Formatted at 2026-07-09 13:12:54 on dist-test-slave-x62b"
I20260709 13:12:54.738194 29364 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602443945700-29364-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602443945700-29364-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602443945700-29364-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:54.761044 29364 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:54.762034 29364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:54.763329 29364 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:54.765514 29364 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:54.765683 29364 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:54.765981 29364 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:54.766121 29364 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:54.806612 29364 rpc_server.cc:307] RPC server started. Bound to: 127.28.173.2:40907
I20260709 13:12:54.806716  6875 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.173.2:40907 every 8 connection(s)
I20260709 13:12:54.811905 29364 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:54.818347  6879 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:54.819705  6880 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:54.821862 29364 server_base.cc:1061] running on GCE node
I20260709 13:12:54.824028  6876 heartbeater.cc:344] Connected to a master server at 127.28.173.62:36439
I20260709 13:12:54.824496  6876 heartbeater.cc:461] Registering TS with master...
W20260709 13:12:54.824425  6882 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:54.825536  6876 heartbeater.cc:507] Master 127.28.173.62:36439 requested a full tablet report, sending...
I20260709 13:12:54.825542 29364 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:54.825985 29364 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:54.826172 29364 hybrid_clock.cc:648] HybridClock initialized: now 1783602774826150 us; error 0 us; skew 500 ppm
I20260709 13:12:54.826944 29364 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:54.828002  6674 ts_manager.cc:194] Registered new tserver with Master: 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907)
I20260709 13:12:54.829768 29364 webserver.cc:533] Webserver started at http://127.28.173.3:43621/ using document root <none> and password file <none>
I20260709 13:12:54.829946  6674 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:32820
I20260709 13:12:54.830472 29364 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:54.830736 29364 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:54.831074 29364 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:54.832342 29364 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602443945700-29364-0/minicluster-data/ts-2-root/instance:
uuid: "ac71a527733d4e97b26b7b7a7903045a"
format_stamp: "Formatted at 2026-07-09 13:12:54 on dist-test-slave-x62b"
I20260709 13:12:54.836700 29364 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:12:54.840092  6887 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:54.840835 29364 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:12:54.841120 29364 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602443945700-29364-0/minicluster-data/ts-2-root
uuid: "ac71a527733d4e97b26b7b7a7903045a"
format_stamp: "Formatted at 2026-07-09 13:12:54 on dist-test-slave-x62b"
I20260709 13:12:54.841408 29364 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602443945700-29364-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602443945700-29364-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602443945700-29364-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:54.858697 29364 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:54.859737 29364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:54.861182 29364 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:54.863481 29364 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:54.863706 29364 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:54.863978 29364 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:54.864151 29364 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:54.902911 29364 rpc_server.cc:307] RPC server started. Bound to: 127.28.173.3:35281
I20260709 13:12:54.903013  6949 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.173.3:35281 every 8 connection(s)
I20260709 13:12:54.916834  6950 heartbeater.cc:344] Connected to a master server at 127.28.173.62:36439
I20260709 13:12:54.917310  6950 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:54.918059  6950 heartbeater.cc:507] Master 127.28.173.62:36439 requested a full tablet report, sending...
I20260709 13:12:54.920131  6674 ts_manager.cc:194] Registered new tserver with Master: ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:12:54.920921 29364 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014831692s
I20260709 13:12:54.921890  6674 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:32826
I20260709 13:12:54.945567  6674 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:32842:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:12:54.948290  6674 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:12:55.022163  6763 tablet_service.cc:1511] Processing CreateTablet for tablet e1d810c81d024c829b673c74b3cf6434 (DEFAULT_TABLE table=test-workload [id=e33a205c3ee841de8771247166cba61d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:55.024272  6763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1d810c81d024c829b673c74b3cf6434. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.028995  6765 tablet_service.cc:1511] Processing CreateTablet for tablet 130cd9c0c9ae40db9d46446c69b7d38a (DEFAULT_TABLE table=test-workload [id=e33a205c3ee841de8771247166cba61d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:55.030386  6765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 130cd9c0c9ae40db9d46446c69b7d38a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.032114  6841 tablet_service.cc:1511] Processing CreateTablet for tablet 5e798f66b3ee4250808a11df90a378da (DEFAULT_TABLE table=test-workload [id=e33a205c3ee841de8771247166cba61d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:55.032953  6837 tablet_service.cc:1511] Processing CreateTablet for tablet 3e2cddf49d494674a2af001bacdd466f (DEFAULT_TABLE table=test-workload [id=e33a205c3ee841de8771247166cba61d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:55.033493  6841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e798f66b3ee4250808a11df90a378da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.034309  6837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e2cddf49d494674a2af001bacdd466f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.035477  6840 tablet_service.cc:1511] Processing CreateTablet for tablet 130cd9c0c9ae40db9d46446c69b7d38a (DEFAULT_TABLE table=test-workload [id=e33a205c3ee841de8771247166cba61d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:55.036870  6840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 130cd9c0c9ae40db9d46446c69b7d38a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.038779  6836 tablet_service.cc:1511] Processing CreateTablet for tablet a33a71a76c3446bc81028e6088bb456f (DEFAULT_TABLE table=test-workload [id=e33a205c3ee841de8771247166cba61d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:55.040242  6836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a33a71a76c3446bc81028e6088bb456f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.040884  6838 tablet_service.cc:1511] Processing CreateTablet for tablet e1d810c81d024c829b673c74b3cf6434 (DEFAULT_TABLE table=test-workload [id=e33a205c3ee841de8771247166cba61d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:55.042227  6838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1d810c81d024c829b673c74b3cf6434. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.044862  6835 tablet_service.cc:1511] Processing CreateTablet for tablet 66e24fd8f1554aa9aaaa0b2459ca1461 (DEFAULT_TABLE table=test-workload [id=e33a205c3ee841de8771247166cba61d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:55.046016  6766 tablet_service.cc:1511] Processing CreateTablet for tablet 5e798f66b3ee4250808a11df90a378da (DEFAULT_TABLE table=test-workload [id=e33a205c3ee841de8771247166cba61d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:55.044862  6764 tablet_service.cc:1511] Processing CreateTablet for tablet 9fe8c15a65104cceaa416248b1f41a8f (DEFAULT_TABLE table=test-workload [id=e33a205c3ee841de8771247166cba61d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:55.047348  6766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e798f66b3ee4250808a11df90a378da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.036875  6839 tablet_service.cc:1511] Processing CreateTablet for tablet 9fe8c15a65104cceaa416248b1f41a8f (DEFAULT_TABLE table=test-workload [id=e33a205c3ee841de8771247166cba61d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:55.046399  6835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66e24fd8f1554aa9aaaa0b2459ca1461. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.049734  6764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fe8c15a65104cceaa416248b1f41a8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.051712  6760 tablet_service.cc:1511] Processing CreateTablet for tablet 66e24fd8f1554aa9aaaa0b2459ca1461 (DEFAULT_TABLE table=test-workload [id=e33a205c3ee841de8771247166cba61d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:55.052135  6759 tablet_service.cc:1511] Processing CreateTablet for tablet 7b83e790f03848a880d9e09194fb5384 (DEFAULT_TABLE table=test-workload [id=e33a205c3ee841de8771247166cba61d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:55.053120  6760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66e24fd8f1554aa9aaaa0b2459ca1461. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.052896  6762 tablet_service.cc:1511] Processing CreateTablet for tablet 3e2cddf49d494674a2af001bacdd466f (DEFAULT_TABLE table=test-workload [id=e33a205c3ee841de8771247166cba61d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:55.054072  6759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b83e790f03848a880d9e09194fb5384. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.054478  6761 tablet_service.cc:1511] Processing CreateTablet for tablet a33a71a76c3446bc81028e6088bb456f (DEFAULT_TABLE table=test-workload [id=e33a205c3ee841de8771247166cba61d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:55.055171  6839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fe8c15a65104cceaa416248b1f41a8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.055903  6761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a33a71a76c3446bc81028e6088bb456f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.056589  6762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e2cddf49d494674a2af001bacdd466f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.060905  6834 tablet_service.cc:1511] Processing CreateTablet for tablet 7b83e790f03848a880d9e09194fb5384 (DEFAULT_TABLE table=test-workload [id=e33a205c3ee841de8771247166cba61d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:55.061070  6758 tablet_service.cc:1511] Processing CreateTablet for tablet 7cfc24257c5a4819b7d004d3ba696c3f (DEFAULT_TABLE table=test-workload [id=e33a205c3ee841de8771247166cba61d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:55.062211  6834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b83e790f03848a880d9e09194fb5384. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.062431  6758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cfc24257c5a4819b7d004d3ba696c3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.069278  6833 tablet_service.cc:1511] Processing CreateTablet for tablet 7cfc24257c5a4819b7d004d3ba696c3f (DEFAULT_TABLE table=test-workload [id=e33a205c3ee841de8771247166cba61d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:55.070657  6833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cfc24257c5a4819b7d004d3ba696c3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.093727  6915 tablet_service.cc:1511] Processing CreateTablet for tablet 5e798f66b3ee4250808a11df90a378da (DEFAULT_TABLE table=test-workload [id=e33a205c3ee841de8771247166cba61d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:55.095774  6915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e798f66b3ee4250808a11df90a378da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.106498  6911 tablet_service.cc:1511] Processing CreateTablet for tablet 3e2cddf49d494674a2af001bacdd466f (DEFAULT_TABLE table=test-workload [id=e33a205c3ee841de8771247166cba61d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:55.129012  6911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e2cddf49d494674a2af001bacdd466f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.101857  6910 tablet_service.cc:1511] Processing CreateTablet for tablet a33a71a76c3446bc81028e6088bb456f (DEFAULT_TABLE table=test-workload [id=e33a205c3ee841de8771247166cba61d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:55.109131  6909 tablet_service.cc:1511] Processing CreateTablet for tablet 66e24fd8f1554aa9aaaa0b2459ca1461 (DEFAULT_TABLE table=test-workload [id=e33a205c3ee841de8771247166cba61d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:55.132975  6909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66e24fd8f1554aa9aaaa0b2459ca1461. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.113121  6912 tablet_service.cc:1511] Processing CreateTablet for tablet e1d810c81d024c829b673c74b3cf6434 (DEFAULT_TABLE table=test-workload [id=e33a205c3ee841de8771247166cba61d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:55.138142  6912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1d810c81d024c829b673c74b3cf6434. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.097323  6914 tablet_service.cc:1511] Processing CreateTablet for tablet 130cd9c0c9ae40db9d46446c69b7d38a (DEFAULT_TABLE table=test-workload [id=e33a205c3ee841de8771247166cba61d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:55.140960  6914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 130cd9c0c9ae40db9d46446c69b7d38a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.144505  6910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a33a71a76c3446bc81028e6088bb456f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.121299  6908 tablet_service.cc:1511] Processing CreateTablet for tablet 7b83e790f03848a880d9e09194fb5384 (DEFAULT_TABLE table=test-workload [id=e33a205c3ee841de8771247166cba61d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:55.121317  6907 tablet_service.cc:1511] Processing CreateTablet for tablet 7cfc24257c5a4819b7d004d3ba696c3f (DEFAULT_TABLE table=test-workload [id=e33a205c3ee841de8771247166cba61d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:55.122941  6913 tablet_service.cc:1511] Processing CreateTablet for tablet 9fe8c15a65104cceaa416248b1f41a8f (DEFAULT_TABLE table=test-workload [id=e33a205c3ee841de8771247166cba61d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:55.160651  6907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cfc24257c5a4819b7d004d3ba696c3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.172464  6908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b83e790f03848a880d9e09194fb5384. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.212441  6913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fe8c15a65104cceaa416248b1f41a8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.230908  6965 tablet_bootstrap.cc:492] T 130cd9c0c9ae40db9d46446c69b7d38a P c694ff83326940089c4a5de4f701da85: Bootstrap starting.
I20260709 13:12:55.231483  6966 tablet_bootstrap.cc:492] T 7b83e790f03848a880d9e09194fb5384 P 3cfe532df476417a9a0b7d9c23aa32ea: Bootstrap starting.
I20260709 13:12:55.247362  6965 tablet_bootstrap.cc:654] T 130cd9c0c9ae40db9d46446c69b7d38a P c694ff83326940089c4a5de4f701da85: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.256595  6967 tablet_bootstrap.cc:492] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a: Bootstrap starting.
I20260709 13:12:55.262648  6967 tablet_bootstrap.cc:654] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.282106  6965 tablet_bootstrap.cc:492] T 130cd9c0c9ae40db9d46446c69b7d38a P c694ff83326940089c4a5de4f701da85: No bootstrap required, opened a new log
I20260709 13:12:55.288146  6965 ts_tablet_manager.cc:1403] T 130cd9c0c9ae40db9d46446c69b7d38a P c694ff83326940089c4a5de4f701da85: Time spent bootstrapping tablet: real 0.058s	user 0.012s	sys 0.018s
I20260709 13:12:55.284906  6966 tablet_bootstrap.cc:654] T 7b83e790f03848a880d9e09194fb5384 P 3cfe532df476417a9a0b7d9c23aa32ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.295882  6965 raft_consensus.cc:359] T 130cd9c0c9ae40db9d46446c69b7d38a P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.296613  6965 raft_consensus.cc:385] T 130cd9c0c9ae40db9d46446c69b7d38a P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.296917  6965 raft_consensus.cc:740] T 130cd9c0c9ae40db9d46446c69b7d38a P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694ff83326940089c4a5de4f701da85, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.297667  6965 consensus_queue.cc:260] T 130cd9c0c9ae40db9d46446c69b7d38a P c694ff83326940089c4a5de4f701da85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.299664  6967 tablet_bootstrap.cc:492] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a: No bootstrap required, opened a new log
I20260709 13:12:55.300274  6967 ts_tablet_manager.cc:1403] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a: Time spent bootstrapping tablet: real 0.044s	user 0.006s	sys 0.006s
I20260709 13:12:55.303282  6801 heartbeater.cc:499] Master 127.28.173.62:36439 was elected leader, sending a full tablet report...
I20260709 13:12:55.303789  6965 ts_tablet_manager.cc:1434] T 130cd9c0c9ae40db9d46446c69b7d38a P c694ff83326940089c4a5de4f701da85: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.003s
I20260709 13:12:55.303303  6967 raft_consensus.cc:359] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.304272  6967 raft_consensus.cc:385] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.304591  6967 raft_consensus.cc:740] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac71a527733d4e97b26b7b7a7903045a, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.305517  6965 tablet_bootstrap.cc:492] T 5e798f66b3ee4250808a11df90a378da P c694ff83326940089c4a5de4f701da85: Bootstrap starting.
I20260709 13:12:55.306358  6966 tablet_bootstrap.cc:492] T 7b83e790f03848a880d9e09194fb5384 P 3cfe532df476417a9a0b7d9c23aa32ea: No bootstrap required, opened a new log
I20260709 13:12:55.306841  6966 ts_tablet_manager.cc:1403] T 7b83e790f03848a880d9e09194fb5384 P 3cfe532df476417a9a0b7d9c23aa32ea: Time spent bootstrapping tablet: real 0.076s	user 0.010s	sys 0.000s
I20260709 13:12:55.307579  6967 consensus_queue.cc:260] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.309999  6966 raft_consensus.cc:359] T 7b83e790f03848a880d9e09194fb5384 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.310981  6966 raft_consensus.cc:385] T 7b83e790f03848a880d9e09194fb5384 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.311342  6966 raft_consensus.cc:740] T 7b83e790f03848a880d9e09194fb5384 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cfe532df476417a9a0b7d9c23aa32ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.311800  6965 tablet_bootstrap.cc:654] T 5e798f66b3ee4250808a11df90a378da P c694ff83326940089c4a5de4f701da85: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.312335  6966 consensus_queue.cc:260] T 7b83e790f03848a880d9e09194fb5384 P 3cfe532df476417a9a0b7d9c23aa32ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.316958  6950 heartbeater.cc:499] Master 127.28.173.62:36439 was elected leader, sending a full tablet report...
I20260709 13:12:55.320081  6965 tablet_bootstrap.cc:492] T 5e798f66b3ee4250808a11df90a378da P c694ff83326940089c4a5de4f701da85: No bootstrap required, opened a new log
I20260709 13:12:55.320602  6965 ts_tablet_manager.cc:1403] T 5e798f66b3ee4250808a11df90a378da P c694ff83326940089c4a5de4f701da85: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.002s
I20260709 13:12:55.323401  6967 ts_tablet_manager.cc:1434] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a: Time spent starting tablet: real 0.023s	user 0.010s	sys 0.004s
I20260709 13:12:55.324075  6965 raft_consensus.cc:359] T 5e798f66b3ee4250808a11df90a378da P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } } peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } }
I20260709 13:12:55.324841  6965 raft_consensus.cc:385] T 5e798f66b3ee4250808a11df90a378da P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.324982  6967 tablet_bootstrap.cc:492] T e1d810c81d024c829b673c74b3cf6434 P ac71a527733d4e97b26b7b7a7903045a: Bootstrap starting.
I20260709 13:12:55.325156  6965 raft_consensus.cc:740] T 5e798f66b3ee4250808a11df90a378da P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694ff83326940089c4a5de4f701da85, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.327106  6966 ts_tablet_manager.cc:1434] T 7b83e790f03848a880d9e09194fb5384 P 3cfe532df476417a9a0b7d9c23aa32ea: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.016s
I20260709 13:12:55.327229  6876 heartbeater.cc:499] Master 127.28.173.62:36439 was elected leader, sending a full tablet report...
I20260709 13:12:55.328263  6966 tablet_bootstrap.cc:492] T 66e24fd8f1554aa9aaaa0b2459ca1461 P 3cfe532df476417a9a0b7d9c23aa32ea: Bootstrap starting.
I20260709 13:12:55.331499  6965 consensus_queue.cc:260] T 5e798f66b3ee4250808a11df90a378da P c694ff83326940089c4a5de4f701da85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } } peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } }
I20260709 13:12:55.332733  6967 tablet_bootstrap.cc:654] T e1d810c81d024c829b673c74b3cf6434 P ac71a527733d4e97b26b7b7a7903045a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.334060  6965 ts_tablet_manager.cc:1434] T 5e798f66b3ee4250808a11df90a378da P c694ff83326940089c4a5de4f701da85: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:12:55.335079  6965 tablet_bootstrap.cc:492] T 3e2cddf49d494674a2af001bacdd466f P c694ff83326940089c4a5de4f701da85: Bootstrap starting.
I20260709 13:12:55.336668  6972 raft_consensus.cc:493] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.337145  6972 raft_consensus.cc:515] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.342687  6965 tablet_bootstrap.cc:654] T 3e2cddf49d494674a2af001bacdd466f P c694ff83326940089c4a5de4f701da85: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.343954  6972 leader_election.cc:290] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303), 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907)
I20260709 13:12:55.353581  6851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130cd9c0c9ae40db9d46446c69b7d38a" candidate_uuid: "ac71a527733d4e97b26b7b7a7903045a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" is_pre_election: true
W20260709 13:12:55.355239  6890 leader_election.cc:343] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:55.372622  6967 tablet_bootstrap.cc:492] T e1d810c81d024c829b673c74b3cf6434 P ac71a527733d4e97b26b7b7a7903045a: No bootstrap required, opened a new log
I20260709 13:12:55.373466  6967 ts_tablet_manager.cc:1403] T e1d810c81d024c829b673c74b3cf6434 P ac71a527733d4e97b26b7b7a7903045a: Time spent bootstrapping tablet: real 0.049s	user 0.026s	sys 0.018s
I20260709 13:12:55.373471  6776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130cd9c0c9ae40db9d46446c69b7d38a" candidate_uuid: "ac71a527733d4e97b26b7b7a7903045a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694ff83326940089c4a5de4f701da85" is_pre_election: true
I20260709 13:12:55.374497  6776 raft_consensus.cc:2468] T 130cd9c0c9ae40db9d46446c69b7d38a P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac71a527733d4e97b26b7b7a7903045a in term 0.
I20260709 13:12:55.371688  6966 tablet_bootstrap.cc:654] T 66e24fd8f1554aa9aaaa0b2459ca1461 P 3cfe532df476417a9a0b7d9c23aa32ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.377851  6967 raft_consensus.cc:359] T e1d810c81d024c829b673c74b3cf6434 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.379194  6967 raft_consensus.cc:385] T e1d810c81d024c829b673c74b3cf6434 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.379652  6967 raft_consensus.cc:740] T e1d810c81d024c829b673c74b3cf6434 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac71a527733d4e97b26b7b7a7903045a, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.380443  6891 leader_election.cc:304] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac71a527733d4e97b26b7b7a7903045a, c694ff83326940089c4a5de4f701da85; no voters: 3cfe532df476417a9a0b7d9c23aa32ea
I20260709 13:12:55.381424  6972 raft_consensus.cc:2804] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:55.381966  6972 raft_consensus.cc:493] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.382345  6972 raft_consensus.cc:3060] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.380826  6967 consensus_queue.cc:260] T e1d810c81d024c829b673c74b3cf6434 P ac71a527733d4e97b26b7b7a7903045a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.384445  6965 tablet_bootstrap.cc:492] T 3e2cddf49d494674a2af001bacdd466f P c694ff83326940089c4a5de4f701da85: No bootstrap required, opened a new log
I20260709 13:12:55.384573  6966 tablet_bootstrap.cc:492] T 66e24fd8f1554aa9aaaa0b2459ca1461 P 3cfe532df476417a9a0b7d9c23aa32ea: No bootstrap required, opened a new log
I20260709 13:12:55.385121  6965 ts_tablet_manager.cc:1403] T 3e2cddf49d494674a2af001bacdd466f P c694ff83326940089c4a5de4f701da85: Time spent bootstrapping tablet: real 0.050s	user 0.035s	sys 0.014s
I20260709 13:12:55.385126  6966 ts_tablet_manager.cc:1403] T 66e24fd8f1554aa9aaaa0b2459ca1461 P 3cfe532df476417a9a0b7d9c23aa32ea: Time spent bootstrapping tablet: real 0.057s	user 0.011s	sys 0.000s
I20260709 13:12:55.388275  6966 raft_consensus.cc:359] T 66e24fd8f1554aa9aaaa0b2459ca1461 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.388499  6965 raft_consensus.cc:359] T 3e2cddf49d494674a2af001bacdd466f P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.389317  6965 raft_consensus.cc:385] T 3e2cddf49d494674a2af001bacdd466f P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.389668  6965 raft_consensus.cc:740] T 3e2cddf49d494674a2af001bacdd466f P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694ff83326940089c4a5de4f701da85, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.390542  6965 consensus_queue.cc:260] T 3e2cddf49d494674a2af001bacdd466f P c694ff83326940089c4a5de4f701da85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.388999  6966 raft_consensus.cc:385] T 66e24fd8f1554aa9aaaa0b2459ca1461 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.392333  6966 raft_consensus.cc:740] T 66e24fd8f1554aa9aaaa0b2459ca1461 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cfe532df476417a9a0b7d9c23aa32ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.392269  6972 raft_consensus.cc:515] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.392938  6965 ts_tablet_manager.cc:1434] T 3e2cddf49d494674a2af001bacdd466f P c694ff83326940089c4a5de4f701da85: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:12:55.393406  6966 consensus_queue.cc:260] T 66e24fd8f1554aa9aaaa0b2459ca1461 P 3cfe532df476417a9a0b7d9c23aa32ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.394158  6965 tablet_bootstrap.cc:492] T a33a71a76c3446bc81028e6088bb456f P c694ff83326940089c4a5de4f701da85: Bootstrap starting.
I20260709 13:12:55.395092  6776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130cd9c0c9ae40db9d46446c69b7d38a" candidate_uuid: "ac71a527733d4e97b26b7b7a7903045a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694ff83326940089c4a5de4f701da85"
I20260709 13:12:55.395699  6776 raft_consensus.cc:3060] T 130cd9c0c9ae40db9d46446c69b7d38a P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.400671  6965 tablet_bootstrap.cc:654] T a33a71a76c3446bc81028e6088bb456f P c694ff83326940089c4a5de4f701da85: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.404469  6776 raft_consensus.cc:2468] T 130cd9c0c9ae40db9d46446c69b7d38a P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac71a527733d4e97b26b7b7a7903045a in term 1.
I20260709 13:12:55.406175  6966 ts_tablet_manager.cc:1434] T 66e24fd8f1554aa9aaaa0b2459ca1461 P 3cfe532df476417a9a0b7d9c23aa32ea: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:12:55.406072  6891 leader_election.cc:304] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac71a527733d4e97b26b7b7a7903045a, c694ff83326940089c4a5de4f701da85; no voters: 
I20260709 13:12:55.412034  6965 tablet_bootstrap.cc:492] T a33a71a76c3446bc81028e6088bb456f P c694ff83326940089c4a5de4f701da85: No bootstrap required, opened a new log
I20260709 13:12:55.412586  6965 ts_tablet_manager.cc:1403] T a33a71a76c3446bc81028e6088bb456f P c694ff83326940089c4a5de4f701da85: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.003s
I20260709 13:12:55.413450  6966 tablet_bootstrap.cc:492] T 9fe8c15a65104cceaa416248b1f41a8f P 3cfe532df476417a9a0b7d9c23aa32ea: Bootstrap starting.
I20260709 13:12:55.413722  6851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130cd9c0c9ae40db9d46446c69b7d38a" candidate_uuid: "ac71a527733d4e97b26b7b7a7903045a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea"
W20260709 13:12:55.415565  6890 leader_election.cc:343] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:55.415547  6965 raft_consensus.cc:359] T a33a71a76c3446bc81028e6088bb456f P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.416693  6972 leader_election.cc:290] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a [CANDIDATE]: Term 1 election: Requested vote from peers c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303), 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907)
I20260709 13:12:55.417187  6965 raft_consensus.cc:385] T a33a71a76c3446bc81028e6088bb456f P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.417613  6965 raft_consensus.cc:740] T a33a71a76c3446bc81028e6088bb456f P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694ff83326940089c4a5de4f701da85, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.418579  6965 consensus_queue.cc:260] T a33a71a76c3446bc81028e6088bb456f P c694ff83326940089c4a5de4f701da85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.420332  6966 tablet_bootstrap.cc:654] T 9fe8c15a65104cceaa416248b1f41a8f P 3cfe532df476417a9a0b7d9c23aa32ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.424149  6965 ts_tablet_manager.cc:1434] T a33a71a76c3446bc81028e6088bb456f P c694ff83326940089c4a5de4f701da85: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:12:55.425149  6972 raft_consensus.cc:2804] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:55.425805  6965 tablet_bootstrap.cc:492] T 7b83e790f03848a880d9e09194fb5384 P c694ff83326940089c4a5de4f701da85: Bootstrap starting.
I20260709 13:12:55.426920  6972 raft_consensus.cc:697] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a [term 1 LEADER]: Becoming Leader. State: Replica: ac71a527733d4e97b26b7b7a7903045a, State: Running, Role: LEADER
I20260709 13:12:55.428162  6972 consensus_queue.cc:237] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.440582  6967 ts_tablet_manager.cc:1434] T e1d810c81d024c829b673c74b3cf6434 P ac71a527733d4e97b26b7b7a7903045a: Time spent starting tablet: real 0.066s	user 0.018s	sys 0.032s
I20260709 13:12:55.441768  6967 tablet_bootstrap.cc:492] T 7b83e790f03848a880d9e09194fb5384 P ac71a527733d4e97b26b7b7a7903045a: Bootstrap starting.
I20260709 13:12:55.442433  6966 tablet_bootstrap.cc:492] T 9fe8c15a65104cceaa416248b1f41a8f P 3cfe532df476417a9a0b7d9c23aa32ea: No bootstrap required, opened a new log
I20260709 13:12:55.442994  6966 ts_tablet_manager.cc:1403] T 9fe8c15a65104cceaa416248b1f41a8f P 3cfe532df476417a9a0b7d9c23aa32ea: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.005s
I20260709 13:12:55.445914  6966 raft_consensus.cc:359] T 9fe8c15a65104cceaa416248b1f41a8f P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.446641  6966 raft_consensus.cc:385] T 9fe8c15a65104cceaa416248b1f41a8f P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.446947  6966 raft_consensus.cc:740] T 9fe8c15a65104cceaa416248b1f41a8f P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cfe532df476417a9a0b7d9c23aa32ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.447927  6973 raft_consensus.cc:493] T 7b83e790f03848a880d9e09194fb5384 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.447748  6966 consensus_queue.cc:260] T 9fe8c15a65104cceaa416248b1f41a8f P 3cfe532df476417a9a0b7d9c23aa32ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.448397  6965 tablet_bootstrap.cc:654] T 7b83e790f03848a880d9e09194fb5384 P c694ff83326940089c4a5de4f701da85: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.449079  6967 tablet_bootstrap.cc:654] T 7b83e790f03848a880d9e09194fb5384 P ac71a527733d4e97b26b7b7a7903045a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.448462  6973 raft_consensus.cc:515] T 7b83e790f03848a880d9e09194fb5384 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.458789  6966 ts_tablet_manager.cc:1434] T 9fe8c15a65104cceaa416248b1f41a8f P 3cfe532df476417a9a0b7d9c23aa32ea: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.007s
I20260709 13:12:55.462584  6981 raft_consensus.cc:493] T e1d810c81d024c829b673c74b3cf6434 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.463302  6981 raft_consensus.cc:515] T e1d810c81d024c829b673c74b3cf6434 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.467005  6776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d810c81d024c829b673c74b3cf6434" candidate_uuid: "ac71a527733d4e97b26b7b7a7903045a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694ff83326940089c4a5de4f701da85" is_pre_election: true
W20260709 13:12:55.469019  6891 leader_election.cc:343] T e1d810c81d024c829b673c74b3cf6434 P ac71a527733d4e97b26b7b7a7903045a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:55.472733  6851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d810c81d024c829b673c74b3cf6434" candidate_uuid: "ac71a527733d4e97b26b7b7a7903045a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" is_pre_election: true
I20260709 13:12:55.474581  6966 tablet_bootstrap.cc:492] T 3e2cddf49d494674a2af001bacdd466f P 3cfe532df476417a9a0b7d9c23aa32ea: Bootstrap starting.
W20260709 13:12:55.474709  6890 leader_election.cc:343] T e1d810c81d024c829b673c74b3cf6434 P ac71a527733d4e97b26b7b7a7903045a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:55.475481  6890 leader_election.cc:304] T e1d810c81d024c829b673c74b3cf6434 P ac71a527733d4e97b26b7b7a7903045a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac71a527733d4e97b26b7b7a7903045a; no voters: 3cfe532df476417a9a0b7d9c23aa32ea, c694ff83326940089c4a5de4f701da85
I20260709 13:12:55.476745  6979 raft_consensus.cc:2749] T e1d810c81d024c829b673c74b3cf6434 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:55.478699  6981 leader_election.cc:290] T e1d810c81d024c829b673c74b3cf6434 P ac71a527733d4e97b26b7b7a7903045a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303), 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907)
I20260709 13:12:55.480189  6973 leader_election.cc:290] T 7b83e790f03848a880d9e09194fb5384 P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:12:55.485709  6965 tablet_bootstrap.cc:492] T 7b83e790f03848a880d9e09194fb5384 P c694ff83326940089c4a5de4f701da85: No bootstrap required, opened a new log
I20260709 13:12:55.486974  6965 ts_tablet_manager.cc:1403] T 7b83e790f03848a880d9e09194fb5384 P c694ff83326940089c4a5de4f701da85: Time spent bootstrapping tablet: real 0.062s	user 0.021s	sys 0.022s
I20260709 13:12:55.487843  6966 tablet_bootstrap.cc:654] T 3e2cddf49d494674a2af001bacdd466f P 3cfe532df476417a9a0b7d9c23aa32ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.490782  6965 raft_consensus.cc:359] T 7b83e790f03848a880d9e09194fb5384 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.491757  6965 raft_consensus.cc:385] T 7b83e790f03848a880d9e09194fb5384 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.492142  6965 raft_consensus.cc:740] T 7b83e790f03848a880d9e09194fb5384 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694ff83326940089c4a5de4f701da85, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.493053  6965 consensus_queue.cc:260] T 7b83e790f03848a880d9e09194fb5384 P c694ff83326940089c4a5de4f701da85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.495484  6965 ts_tablet_manager.cc:1434] T 7b83e790f03848a880d9e09194fb5384 P c694ff83326940089c4a5de4f701da85: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:12:55.496507  6965 tablet_bootstrap.cc:492] T 66e24fd8f1554aa9aaaa0b2459ca1461 P c694ff83326940089c4a5de4f701da85: Bootstrap starting.
I20260709 13:12:55.502777  6965 tablet_bootstrap.cc:654] T 66e24fd8f1554aa9aaaa0b2459ca1461 P c694ff83326940089c4a5de4f701da85: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.513762  6674 catalog_manager.cc:5697] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a reported cstate change: term changed from 0 to 1, leader changed from <none> to ac71a527733d4e97b26b7b7a7903045a (127.28.173.3). New cstate: current_term: 1 leader_uuid: "ac71a527733d4e97b26b7b7a7903045a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:55.526445  6966 tablet_bootstrap.cc:492] T 3e2cddf49d494674a2af001bacdd466f P 3cfe532df476417a9a0b7d9c23aa32ea: No bootstrap required, opened a new log
I20260709 13:12:55.527308  6966 ts_tablet_manager.cc:1403] T 3e2cddf49d494674a2af001bacdd466f P 3cfe532df476417a9a0b7d9c23aa32ea: Time spent bootstrapping tablet: real 0.053s	user 0.018s	sys 0.002s
I20260709 13:12:55.534761  6965 tablet_bootstrap.cc:492] T 66e24fd8f1554aa9aaaa0b2459ca1461 P c694ff83326940089c4a5de4f701da85: No bootstrap required, opened a new log
I20260709 13:12:55.535326  6965 ts_tablet_manager.cc:1403] T 66e24fd8f1554aa9aaaa0b2459ca1461 P c694ff83326940089c4a5de4f701da85: Time spent bootstrapping tablet: real 0.039s	user 0.021s	sys 0.015s
I20260709 13:12:55.537241  6925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b83e790f03848a880d9e09194fb5384" candidate_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac71a527733d4e97b26b7b7a7903045a" is_pre_election: true
I20260709 13:12:55.538432  6776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b83e790f03848a880d9e09194fb5384" candidate_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694ff83326940089c4a5de4f701da85" is_pre_election: true
I20260709 13:12:55.538722  6965 raft_consensus.cc:359] T 66e24fd8f1554aa9aaaa0b2459ca1461 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.539108  6776 raft_consensus.cc:2468] T 7b83e790f03848a880d9e09194fb5384 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cfe532df476417a9a0b7d9c23aa32ea in term 0.
I20260709 13:12:55.539436  6965 raft_consensus.cc:385] T 66e24fd8f1554aa9aaaa0b2459ca1461 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.539743  6967 tablet_bootstrap.cc:492] T 7b83e790f03848a880d9e09194fb5384 P ac71a527733d4e97b26b7b7a7903045a: No bootstrap required, opened a new log
W20260709 13:12:55.540122  6815 leader_election.cc:343] T 7b83e790f03848a880d9e09194fb5384 P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:55.540360  6967 ts_tablet_manager.cc:1403] T 7b83e790f03848a880d9e09194fb5384 P ac71a527733d4e97b26b7b7a7903045a: Time spent bootstrapping tablet: real 0.099s	user 0.030s	sys 0.064s
I20260709 13:12:55.540961  6817 leader_election.cc:304] T 7b83e790f03848a880d9e09194fb5384 P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cfe532df476417a9a0b7d9c23aa32ea, c694ff83326940089c4a5de4f701da85; no voters: ac71a527733d4e97b26b7b7a7903045a
I20260709 13:12:55.542193  6984 raft_consensus.cc:2804] T 7b83e790f03848a880d9e09194fb5384 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:55.542586  6984 raft_consensus.cc:493] T 7b83e790f03848a880d9e09194fb5384 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.539794  6965 raft_consensus.cc:740] T 66e24fd8f1554aa9aaaa0b2459ca1461 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694ff83326940089c4a5de4f701da85, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.542963  6967 raft_consensus.cc:359] T 7b83e790f03848a880d9e09194fb5384 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.542917  6984 raft_consensus.cc:3060] T 7b83e790f03848a880d9e09194fb5384 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.543910  6967 raft_consensus.cc:385] T 7b83e790f03848a880d9e09194fb5384 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.544291  6967 raft_consensus.cc:740] T 7b83e790f03848a880d9e09194fb5384 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac71a527733d4e97b26b7b7a7903045a, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.545099  6967 consensus_queue.cc:260] T 7b83e790f03848a880d9e09194fb5384 P ac71a527733d4e97b26b7b7a7903045a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.531409  6966 raft_consensus.cc:359] T 3e2cddf49d494674a2af001bacdd466f P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.546386  6966 raft_consensus.cc:385] T 3e2cddf49d494674a2af001bacdd466f P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.546653  6966 raft_consensus.cc:740] T 3e2cddf49d494674a2af001bacdd466f P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cfe532df476417a9a0b7d9c23aa32ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.547207  6967 ts_tablet_manager.cc:1434] T 7b83e790f03848a880d9e09194fb5384 P ac71a527733d4e97b26b7b7a7903045a: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:12:55.547240  6966 consensus_queue.cc:260] T 3e2cddf49d494674a2af001bacdd466f P 3cfe532df476417a9a0b7d9c23aa32ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.548875  6967 tablet_bootstrap.cc:492] T 9fe8c15a65104cceaa416248b1f41a8f P ac71a527733d4e97b26b7b7a7903045a: Bootstrap starting.
I20260709 13:12:55.543974  6965 consensus_queue.cc:260] T 66e24fd8f1554aa9aaaa0b2459ca1461 P c694ff83326940089c4a5de4f701da85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.553691  6965 ts_tablet_manager.cc:1434] T 66e24fd8f1554aa9aaaa0b2459ca1461 P c694ff83326940089c4a5de4f701da85: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:12:55.554754  6965 tablet_bootstrap.cc:492] T 7cfc24257c5a4819b7d004d3ba696c3f P c694ff83326940089c4a5de4f701da85: Bootstrap starting.
W20260709 13:12:55.557093  6722 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:55.561398  6984 raft_consensus.cc:515] T 7b83e790f03848a880d9e09194fb5384 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.555315  6967 tablet_bootstrap.cc:654] T 9fe8c15a65104cceaa416248b1f41a8f P ac71a527733d4e97b26b7b7a7903045a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.556535  6966 ts_tablet_manager.cc:1434] T 3e2cddf49d494674a2af001bacdd466f P 3cfe532df476417a9a0b7d9c23aa32ea: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:12:55.566357  6966 tablet_bootstrap.cc:492] T 5e798f66b3ee4250808a11df90a378da P 3cfe532df476417a9a0b7d9c23aa32ea: Bootstrap starting.
I20260709 13:12:55.567080  6776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b83e790f03848a880d9e09194fb5384" candidate_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694ff83326940089c4a5de4f701da85"
I20260709 13:12:55.567893  6776 raft_consensus.cc:3060] T 7b83e790f03848a880d9e09194fb5384 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.571925  6984 leader_election.cc:290] T 7b83e790f03848a880d9e09194fb5384 P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 1 election: Requested vote from peers c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:12:55.574538  6966 tablet_bootstrap.cc:654] T 5e798f66b3ee4250808a11df90a378da P 3cfe532df476417a9a0b7d9c23aa32ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.577207  6965 tablet_bootstrap.cc:654] T 7cfc24257c5a4819b7d004d3ba696c3f P c694ff83326940089c4a5de4f701da85: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.580284  6925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b83e790f03848a880d9e09194fb5384" candidate_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac71a527733d4e97b26b7b7a7903045a"
I20260709 13:12:55.581115  6925 raft_consensus.cc:3060] T 7b83e790f03848a880d9e09194fb5384 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.582029  6776 raft_consensus.cc:2468] T 7b83e790f03848a880d9e09194fb5384 P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cfe532df476417a9a0b7d9c23aa32ea in term 1.
I20260709 13:12:55.583644  6817 leader_election.cc:304] T 7b83e790f03848a880d9e09194fb5384 P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cfe532df476417a9a0b7d9c23aa32ea, c694ff83326940089c4a5de4f701da85; no voters: 
I20260709 13:12:55.584826  6984 raft_consensus.cc:2804] T 7b83e790f03848a880d9e09194fb5384 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:55.585413  6984 raft_consensus.cc:697] T 7b83e790f03848a880d9e09194fb5384 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 LEADER]: Becoming Leader. State: Replica: 3cfe532df476417a9a0b7d9c23aa32ea, State: Running, Role: LEADER
I20260709 13:12:55.586498  6984 consensus_queue.cc:237] T 7b83e790f03848a880d9e09194fb5384 P 3cfe532df476417a9a0b7d9c23aa32ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.595172  6925 raft_consensus.cc:2468] T 7b83e790f03848a880d9e09194fb5384 P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cfe532df476417a9a0b7d9c23aa32ea in term 1.
I20260709 13:12:55.598562  6966 tablet_bootstrap.cc:492] T 5e798f66b3ee4250808a11df90a378da P 3cfe532df476417a9a0b7d9c23aa32ea: No bootstrap required, opened a new log
I20260709 13:12:55.599042  6966 ts_tablet_manager.cc:1403] T 5e798f66b3ee4250808a11df90a378da P 3cfe532df476417a9a0b7d9c23aa32ea: Time spent bootstrapping tablet: real 0.033s	user 0.025s	sys 0.005s
I20260709 13:12:55.602046  6966 raft_consensus.cc:359] T 5e798f66b3ee4250808a11df90a378da P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } } peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } }
I20260709 13:12:55.602787  6966 raft_consensus.cc:385] T 5e798f66b3ee4250808a11df90a378da P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.603084  6966 raft_consensus.cc:740] T 5e798f66b3ee4250808a11df90a378da P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cfe532df476417a9a0b7d9c23aa32ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.603785  6965 tablet_bootstrap.cc:492] T 7cfc24257c5a4819b7d004d3ba696c3f P c694ff83326940089c4a5de4f701da85: No bootstrap required, opened a new log
I20260709 13:12:55.604316  6965 ts_tablet_manager.cc:1403] T 7cfc24257c5a4819b7d004d3ba696c3f P c694ff83326940089c4a5de4f701da85: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.010s
I20260709 13:12:55.603426  6673 catalog_manager.cc:5697] T 7b83e790f03848a880d9e09194fb5384 P 3cfe532df476417a9a0b7d9c23aa32ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2). New cstate: current_term: 1 leader_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:55.604058  6966 consensus_queue.cc:260] T 5e798f66b3ee4250808a11df90a378da P 3cfe532df476417a9a0b7d9c23aa32ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } } peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } }
I20260709 13:12:55.606252  6966 ts_tablet_manager.cc:1434] T 5e798f66b3ee4250808a11df90a378da P 3cfe532df476417a9a0b7d9c23aa32ea: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:12:55.607026  6966 tablet_bootstrap.cc:492] T a33a71a76c3446bc81028e6088bb456f P 3cfe532df476417a9a0b7d9c23aa32ea: Bootstrap starting.
I20260709 13:12:55.607371  6965 raft_consensus.cc:359] T 7cfc24257c5a4819b7d004d3ba696c3f P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.608111  6965 raft_consensus.cc:385] T 7cfc24257c5a4819b7d004d3ba696c3f P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.608409  6965 raft_consensus.cc:740] T 7cfc24257c5a4819b7d004d3ba696c3f P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694ff83326940089c4a5de4f701da85, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.609184  6965 consensus_queue.cc:260] T 7cfc24257c5a4819b7d004d3ba696c3f P c694ff83326940089c4a5de4f701da85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.612468  6967 tablet_bootstrap.cc:492] T 9fe8c15a65104cceaa416248b1f41a8f P ac71a527733d4e97b26b7b7a7903045a: No bootstrap required, opened a new log
I20260709 13:12:55.612443  6965 ts_tablet_manager.cc:1434] T 7cfc24257c5a4819b7d004d3ba696c3f P c694ff83326940089c4a5de4f701da85: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:55.613114  6967 ts_tablet_manager.cc:1403] T 9fe8c15a65104cceaa416248b1f41a8f P ac71a527733d4e97b26b7b7a7903045a: Time spent bootstrapping tablet: real 0.065s	user 0.011s	sys 0.002s
I20260709 13:12:55.613696  6965 tablet_bootstrap.cc:492] T e1d810c81d024c829b673c74b3cf6434 P c694ff83326940089c4a5de4f701da85: Bootstrap starting.
I20260709 13:12:55.616297  6967 raft_consensus.cc:359] T 9fe8c15a65104cceaa416248b1f41a8f P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.616995  6967 raft_consensus.cc:385] T 9fe8c15a65104cceaa416248b1f41a8f P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.617283  6967 raft_consensus.cc:740] T 9fe8c15a65104cceaa416248b1f41a8f P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac71a527733d4e97b26b7b7a7903045a, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.617972  6967 consensus_queue.cc:260] T 9fe8c15a65104cceaa416248b1f41a8f P ac71a527733d4e97b26b7b7a7903045a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.620280  6967 ts_tablet_manager.cc:1434] T 9fe8c15a65104cceaa416248b1f41a8f P ac71a527733d4e97b26b7b7a7903045a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:12:55.621259  6967 tablet_bootstrap.cc:492] T 66e24fd8f1554aa9aaaa0b2459ca1461 P ac71a527733d4e97b26b7b7a7903045a: Bootstrap starting.
I20260709 13:12:55.622664  6965 tablet_bootstrap.cc:654] T e1d810c81d024c829b673c74b3cf6434 P c694ff83326940089c4a5de4f701da85: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.624473  6966 tablet_bootstrap.cc:654] T a33a71a76c3446bc81028e6088bb456f P 3cfe532df476417a9a0b7d9c23aa32ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.628350  6965 tablet_bootstrap.cc:492] T e1d810c81d024c829b673c74b3cf6434 P c694ff83326940089c4a5de4f701da85: No bootstrap required, opened a new log
I20260709 13:12:55.628837  6965 ts_tablet_manager.cc:1403] T e1d810c81d024c829b673c74b3cf6434 P c694ff83326940089c4a5de4f701da85: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 13:12:55.630416  6967 tablet_bootstrap.cc:654] T 66e24fd8f1554aa9aaaa0b2459ca1461 P ac71a527733d4e97b26b7b7a7903045a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.630676  6965 raft_consensus.cc:359] T e1d810c81d024c829b673c74b3cf6434 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.631250  6965 raft_consensus.cc:385] T e1d810c81d024c829b673c74b3cf6434 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.631466  6965 raft_consensus.cc:740] T e1d810c81d024c829b673c74b3cf6434 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694ff83326940089c4a5de4f701da85, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.632092  6965 consensus_queue.cc:260] T e1d810c81d024c829b673c74b3cf6434 P c694ff83326940089c4a5de4f701da85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.634050  6965 ts_tablet_manager.cc:1434] T e1d810c81d024c829b673c74b3cf6434 P c694ff83326940089c4a5de4f701da85: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:12:55.636658  6965 tablet_bootstrap.cc:492] T 9fe8c15a65104cceaa416248b1f41a8f P c694ff83326940089c4a5de4f701da85: Bootstrap starting.
I20260709 13:12:55.637228  6966 tablet_bootstrap.cc:492] T a33a71a76c3446bc81028e6088bb456f P 3cfe532df476417a9a0b7d9c23aa32ea: No bootstrap required, opened a new log
I20260709 13:12:55.637794  6966 ts_tablet_manager.cc:1403] T a33a71a76c3446bc81028e6088bb456f P 3cfe532df476417a9a0b7d9c23aa32ea: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.002s
I20260709 13:12:55.640895  6966 raft_consensus.cc:359] T a33a71a76c3446bc81028e6088bb456f P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.641645  6966 raft_consensus.cc:385] T a33a71a76c3446bc81028e6088bb456f P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.641986  6966 raft_consensus.cc:740] T a33a71a76c3446bc81028e6088bb456f P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cfe532df476417a9a0b7d9c23aa32ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.642483  6967 tablet_bootstrap.cc:492] T 66e24fd8f1554aa9aaaa0b2459ca1461 P ac71a527733d4e97b26b7b7a7903045a: No bootstrap required, opened a new log
I20260709 13:12:55.642988  6967 ts_tablet_manager.cc:1403] T 66e24fd8f1554aa9aaaa0b2459ca1461 P ac71a527733d4e97b26b7b7a7903045a: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.010s
I20260709 13:12:55.642876  6966 consensus_queue.cc:260] T a33a71a76c3446bc81028e6088bb456f P 3cfe532df476417a9a0b7d9c23aa32ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.643596  6965 tablet_bootstrap.cc:654] T 9fe8c15a65104cceaa416248b1f41a8f P c694ff83326940089c4a5de4f701da85: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.646130  6967 raft_consensus.cc:359] T 66e24fd8f1554aa9aaaa0b2459ca1461 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.647017  6967 raft_consensus.cc:385] T 66e24fd8f1554aa9aaaa0b2459ca1461 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.647409  6967 raft_consensus.cc:740] T 66e24fd8f1554aa9aaaa0b2459ca1461 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac71a527733d4e97b26b7b7a7903045a, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.648396  6967 consensus_queue.cc:260] T 66e24fd8f1554aa9aaaa0b2459ca1461 P ac71a527733d4e97b26b7b7a7903045a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.650552  6966 ts_tablet_manager.cc:1434] T a33a71a76c3446bc81028e6088bb456f P 3cfe532df476417a9a0b7d9c23aa32ea: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.002s
I20260709 13:12:55.651770  6966 tablet_bootstrap.cc:492] T 7cfc24257c5a4819b7d004d3ba696c3f P 3cfe532df476417a9a0b7d9c23aa32ea: Bootstrap starting.
I20260709 13:12:55.656775  6967 ts_tablet_manager.cc:1434] T 66e24fd8f1554aa9aaaa0b2459ca1461 P ac71a527733d4e97b26b7b7a7903045a: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 13:12:55.658260  6966 tablet_bootstrap.cc:654] T 7cfc24257c5a4819b7d004d3ba696c3f P 3cfe532df476417a9a0b7d9c23aa32ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.661371  6967 tablet_bootstrap.cc:492] T 5e798f66b3ee4250808a11df90a378da P ac71a527733d4e97b26b7b7a7903045a: Bootstrap starting.
I20260709 13:12:55.670307  6965 tablet_bootstrap.cc:492] T 9fe8c15a65104cceaa416248b1f41a8f P c694ff83326940089c4a5de4f701da85: No bootstrap required, opened a new log
I20260709 13:12:55.670589  6967 tablet_bootstrap.cc:654] T 5e798f66b3ee4250808a11df90a378da P ac71a527733d4e97b26b7b7a7903045a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.670863  6965 ts_tablet_manager.cc:1403] T 9fe8c15a65104cceaa416248b1f41a8f P c694ff83326940089c4a5de4f701da85: Time spent bootstrapping tablet: real 0.034s	user 0.025s	sys 0.007s
I20260709 13:12:55.672237  6984 raft_consensus.cc:493] T 66e24fd8f1554aa9aaaa0b2459ca1461 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.672775  6984 raft_consensus.cc:515] T 66e24fd8f1554aa9aaaa0b2459ca1461 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.674095  6966 tablet_bootstrap.cc:492] T 7cfc24257c5a4819b7d004d3ba696c3f P 3cfe532df476417a9a0b7d9c23aa32ea: No bootstrap required, opened a new log
I20260709 13:12:55.673803  6965 raft_consensus.cc:359] T 9fe8c15a65104cceaa416248b1f41a8f P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.674528  6965 raft_consensus.cc:385] T 9fe8c15a65104cceaa416248b1f41a8f P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.674638  6966 ts_tablet_manager.cc:1403] T 7cfc24257c5a4819b7d004d3ba696c3f P 3cfe532df476417a9a0b7d9c23aa32ea: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.012s
I20260709 13:12:55.674845  6965 raft_consensus.cc:740] T 9fe8c15a65104cceaa416248b1f41a8f P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694ff83326940089c4a5de4f701da85, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.674870  6984 leader_election.cc:290] T 66e24fd8f1554aa9aaaa0b2459ca1461 P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:12:55.675639  6776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e24fd8f1554aa9aaaa0b2459ca1461" candidate_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694ff83326940089c4a5de4f701da85" is_pre_election: true
I20260709 13:12:55.675915  6965 consensus_queue.cc:260] T 9fe8c15a65104cceaa416248b1f41a8f P c694ff83326940089c4a5de4f701da85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.676352  6776 raft_consensus.cc:2468] T 66e24fd8f1554aa9aaaa0b2459ca1461 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cfe532df476417a9a0b7d9c23aa32ea in term 0.
I20260709 13:12:55.676674  6925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e24fd8f1554aa9aaaa0b2459ca1461" candidate_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac71a527733d4e97b26b7b7a7903045a" is_pre_election: true
I20260709 13:12:55.677382  6925 raft_consensus.cc:2468] T 66e24fd8f1554aa9aaaa0b2459ca1461 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cfe532df476417a9a0b7d9c23aa32ea in term 0.
I20260709 13:12:55.677767  6817 leader_election.cc:304] T 66e24fd8f1554aa9aaaa0b2459ca1461 P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cfe532df476417a9a0b7d9c23aa32ea, c694ff83326940089c4a5de4f701da85; no voters: 
I20260709 13:12:55.677848  6966 raft_consensus.cc:359] T 7cfc24257c5a4819b7d004d3ba696c3f P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.678668  6966 raft_consensus.cc:385] T 7cfc24257c5a4819b7d004d3ba696c3f P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.678870  6984 raft_consensus.cc:2804] T 66e24fd8f1554aa9aaaa0b2459ca1461 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:55.679448  6984 raft_consensus.cc:493] T 66e24fd8f1554aa9aaaa0b2459ca1461 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.679744  6984 raft_consensus.cc:3060] T 66e24fd8f1554aa9aaaa0b2459ca1461 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.679926  6966 raft_consensus.cc:740] T 7cfc24257c5a4819b7d004d3ba696c3f P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cfe532df476417a9a0b7d9c23aa32ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.678644  6971 raft_consensus.cc:493] T 66e24fd8f1554aa9aaaa0b2459ca1461 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.680886  6971 raft_consensus.cc:515] T 66e24fd8f1554aa9aaaa0b2459ca1461 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.686108  6971 leader_election.cc:290] T 66e24fd8f1554aa9aaaa0b2459ca1461 P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:12:55.686893  6971 raft_consensus.cc:493] T a33a71a76c3446bc81028e6088bb456f P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.687386  6971 raft_consensus.cc:515] T a33a71a76c3446bc81028e6088bb456f P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.690687  6984 raft_consensus.cc:515] T 66e24fd8f1554aa9aaaa0b2459ca1461 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.691931  6971 leader_election.cc:290] T a33a71a76c3446bc81028e6088bb456f P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:12:55.693799  6776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e24fd8f1554aa9aaaa0b2459ca1461" candidate_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694ff83326940089c4a5de4f701da85"
I20260709 13:12:55.694425  6776 raft_consensus.cc:3060] T 66e24fd8f1554aa9aaaa0b2459ca1461 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.681000  6966 consensus_queue.cc:260] T 7cfc24257c5a4819b7d004d3ba696c3f P 3cfe532df476417a9a0b7d9c23aa32ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.698164  6966 ts_tablet_manager.cc:1434] T 7cfc24257c5a4819b7d004d3ba696c3f P 3cfe532df476417a9a0b7d9c23aa32ea: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 13:12:55.699424  6966 tablet_bootstrap.cc:492] T 130cd9c0c9ae40db9d46446c69b7d38a P 3cfe532df476417a9a0b7d9c23aa32ea: Bootstrap starting.
I20260709 13:12:55.702059  6776 raft_consensus.cc:2468] T 66e24fd8f1554aa9aaaa0b2459ca1461 P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cfe532df476417a9a0b7d9c23aa32ea in term 1.
I20260709 13:12:55.702694  6973 raft_consensus.cc:493] T 9fe8c15a65104cceaa416248b1f41a8f P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.704062  6973 raft_consensus.cc:515] T 9fe8c15a65104cceaa416248b1f41a8f P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.704510  6925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e24fd8f1554aa9aaaa0b2459ca1461" candidate_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac71a527733d4e97b26b7b7a7903045a"
I20260709 13:12:55.705133  6925 raft_consensus.cc:3060] T 66e24fd8f1554aa9aaaa0b2459ca1461 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.706249  6973 leader_election.cc:290] T 9fe8c15a65104cceaa416248b1f41a8f P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:12:55.706522  6967 tablet_bootstrap.cc:492] T 5e798f66b3ee4250808a11df90a378da P ac71a527733d4e97b26b7b7a7903045a: No bootstrap required, opened a new log
I20260709 13:12:55.707082  6967 ts_tablet_manager.cc:1403] T 5e798f66b3ee4250808a11df90a378da P ac71a527733d4e97b26b7b7a7903045a: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.002s
I20260709 13:12:55.708122  6817 leader_election.cc:304] T 66e24fd8f1554aa9aaaa0b2459ca1461 P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cfe532df476417a9a0b7d9c23aa32ea, c694ff83326940089c4a5de4f701da85; no voters: 
I20260709 13:12:55.710289  6967 raft_consensus.cc:359] T 5e798f66b3ee4250808a11df90a378da P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } } peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } }
I20260709 13:12:55.710542  6924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fe8c15a65104cceaa416248b1f41a8f" candidate_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac71a527733d4e97b26b7b7a7903045a" is_pre_election: true
I20260709 13:12:55.711320  6924 raft_consensus.cc:2468] T 9fe8c15a65104cceaa416248b1f41a8f P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cfe532df476417a9a0b7d9c23aa32ea in term 0.
I20260709 13:12:55.711098  6967 raft_consensus.cc:385] T 5e798f66b3ee4250808a11df90a378da P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.711793  6966 tablet_bootstrap.cc:654] T 130cd9c0c9ae40db9d46446c69b7d38a P 3cfe532df476417a9a0b7d9c23aa32ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.715566  6984 leader_election.cc:290] T 66e24fd8f1554aa9aaaa0b2459ca1461 P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 1 election: Requested vote from peers c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:12:55.715480  6925 raft_consensus.cc:2468] T 66e24fd8f1554aa9aaaa0b2459ca1461 P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cfe532df476417a9a0b7d9c23aa32ea in term 1.
I20260709 13:12:55.724159  6973 raft_consensus.cc:2804] T 66e24fd8f1554aa9aaaa0b2459ca1461 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:55.712618  6815 leader_election.cc:304] T 9fe8c15a65104cceaa416248b1f41a8f P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cfe532df476417a9a0b7d9c23aa32ea, ac71a527733d4e97b26b7b7a7903045a; no voters: 
I20260709 13:12:55.725939  6776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fe8c15a65104cceaa416248b1f41a8f" candidate_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694ff83326940089c4a5de4f701da85" is_pre_election: true
I20260709 13:12:55.729354  6984 raft_consensus.cc:2804] T 9fe8c15a65104cceaa416248b1f41a8f P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:55.729760  6984 raft_consensus.cc:493] T 9fe8c15a65104cceaa416248b1f41a8f P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.729534  6776 raft_consensus.cc:2468] T 9fe8c15a65104cceaa416248b1f41a8f P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cfe532df476417a9a0b7d9c23aa32ea in term 0.
I20260709 13:12:55.730185  6984 raft_consensus.cc:3060] T 9fe8c15a65104cceaa416248b1f41a8f P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.726075  6971 raft_consensus.cc:493] T 7cfc24257c5a4819b7d004d3ba696c3f P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.731065  6971 raft_consensus.cc:515] T 7cfc24257c5a4819b7d004d3ba696c3f P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.736246  6971 leader_election.cc:290] T 7cfc24257c5a4819b7d004d3ba696c3f P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:12:55.737069  6973 raft_consensus.cc:697] T 66e24fd8f1554aa9aaaa0b2459ca1461 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 LEADER]: Becoming Leader. State: Replica: 3cfe532df476417a9a0b7d9c23aa32ea, State: Running, Role: LEADER
I20260709 13:12:55.738343  6973 consensus_queue.cc:237] T 66e24fd8f1554aa9aaaa0b2459ca1461 P 3cfe532df476417a9a0b7d9c23aa32ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.724444  6967 raft_consensus.cc:740] T 5e798f66b3ee4250808a11df90a378da P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac71a527733d4e97b26b7b7a7903045a, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.746536  6925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e24fd8f1554aa9aaaa0b2459ca1461" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac71a527733d4e97b26b7b7a7903045a" is_pre_election: true
I20260709 13:12:55.747890  6925 raft_consensus.cc:2393] T 66e24fd8f1554aa9aaaa0b2459ca1461 P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c694ff83326940089c4a5de4f701da85 in current term 1: Already voted for candidate 3cfe532df476417a9a0b7d9c23aa32ea in this term.
I20260709 13:12:55.747888  6923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cfc24257c5a4819b7d004d3ba696c3f" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac71a527733d4e97b26b7b7a7903045a" is_pre_election: true
I20260709 13:12:55.748368  6965 ts_tablet_manager.cc:1434] T 9fe8c15a65104cceaa416248b1f41a8f P c694ff83326940089c4a5de4f701da85: Time spent starting tablet: real 0.077s	user 0.024s	sys 0.023s
I20260709 13:12:55.748111  6924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a33a71a76c3446bc81028e6088bb456f" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac71a527733d4e97b26b7b7a7903045a" is_pre_election: true
I20260709 13:12:55.744985  6967 consensus_queue.cc:260] T 5e798f66b3ee4250808a11df90a378da P ac71a527733d4e97b26b7b7a7903045a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } } peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } }
W20260709 13:12:55.750233  6740 leader_election.cc:343] T 7cfc24257c5a4819b7d004d3ba696c3f P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:55.750895  6740 leader_election.cc:343] T a33a71a76c3446bc81028e6088bb456f P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:55.751191  6967 ts_tablet_manager.cc:1434] T 5e798f66b3ee4250808a11df90a378da P ac71a527733d4e97b26b7b7a7903045a: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.003s
I20260709 13:12:55.747148  6984 raft_consensus.cc:515] T 9fe8c15a65104cceaa416248b1f41a8f P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.752254  6967 tablet_bootstrap.cc:492] T a33a71a76c3446bc81028e6088bb456f P ac71a527733d4e97b26b7b7a7903045a: Bootstrap starting.
I20260709 13:12:55.754307  6776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fe8c15a65104cceaa416248b1f41a8f" candidate_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694ff83326940089c4a5de4f701da85"
I20260709 13:12:55.754676  6984 leader_election.cc:290] T 9fe8c15a65104cceaa416248b1f41a8f P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 1 election: Requested vote from peers c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:12:55.754904  6776 raft_consensus.cc:3060] T 9fe8c15a65104cceaa416248b1f41a8f P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.757678  6924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fe8c15a65104cceaa416248b1f41a8f" candidate_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac71a527733d4e97b26b7b7a7903045a"
I20260709 13:12:55.758735  6924 raft_consensus.cc:3060] T 9fe8c15a65104cceaa416248b1f41a8f P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.759423  6973 raft_consensus.cc:493] T 3e2cddf49d494674a2af001bacdd466f P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.759932  6973 raft_consensus.cc:515] T 3e2cddf49d494674a2af001bacdd466f P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.762804  6775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2cddf49d494674a2af001bacdd466f" candidate_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694ff83326940089c4a5de4f701da85" is_pre_election: true
I20260709 13:12:55.763419  6775 raft_consensus.cc:2468] T 3e2cddf49d494674a2af001bacdd466f P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cfe532df476417a9a0b7d9c23aa32ea in term 0.
I20260709 13:12:55.763666  6776 raft_consensus.cc:2468] T 9fe8c15a65104cceaa416248b1f41a8f P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cfe532df476417a9a0b7d9c23aa32ea in term 1.
I20260709 13:12:55.764902  7003 raft_consensus.cc:493] T 5e798f66b3ee4250808a11df90a378da P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.765380  7003 raft_consensus.cc:515] T 5e798f66b3ee4250808a11df90a378da P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } } peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } }
I20260709 13:12:55.767556  7003 leader_election.cc:290] T 5e798f66b3ee4250808a11df90a378da P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281), 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907)
I20260709 13:12:55.764947  6817 leader_election.cc:304] T 3e2cddf49d494674a2af001bacdd466f P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cfe532df476417a9a0b7d9c23aa32ea, c694ff83326940089c4a5de4f701da85; no voters: 
I20260709 13:12:55.768296  6923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e798f66b3ee4250808a11df90a378da" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac71a527733d4e97b26b7b7a7903045a" is_pre_election: true
I20260709 13:12:55.768932  6923 raft_consensus.cc:2468] T 5e798f66b3ee4250808a11df90a378da P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694ff83326940089c4a5de4f701da85 in term 0.
I20260709 13:12:55.769196  7008 raft_consensus.cc:2804] T 3e2cddf49d494674a2af001bacdd466f P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:55.769757  7008 raft_consensus.cc:493] T 3e2cddf49d494674a2af001bacdd466f P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.770149  6740 leader_election.cc:304] T 5e798f66b3ee4250808a11df90a378da P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac71a527733d4e97b26b7b7a7903045a, c694ff83326940089c4a5de4f701da85; no voters: 
I20260709 13:12:55.768949  6817 leader_election.cc:304] T 9fe8c15a65104cceaa416248b1f41a8f P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cfe532df476417a9a0b7d9c23aa32ea, c694ff83326940089c4a5de4f701da85; no voters: 
I20260709 13:12:55.774274  6973 leader_election.cc:290] T 3e2cddf49d494674a2af001bacdd466f P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:12:55.774336  6848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e798f66b3ee4250808a11df90a378da" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" is_pre_election: true
I20260709 13:12:55.774561  6849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cfc24257c5a4819b7d004d3ba696c3f" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" is_pre_election: true
I20260709 13:12:55.775121  6848 raft_consensus.cc:2468] T 5e798f66b3ee4250808a11df90a378da P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694ff83326940089c4a5de4f701da85 in term 0.
I20260709 13:12:55.776891  6923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2cddf49d494674a2af001bacdd466f" candidate_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac71a527733d4e97b26b7b7a7903045a" is_pre_election: true
I20260709 13:12:55.776991  6850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a33a71a76c3446bc81028e6088bb456f" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" is_pre_election: true
W20260709 13:12:55.778033  6815 leader_election.cc:343] T 3e2cddf49d494674a2af001bacdd466f P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:55.777922  6850 raft_consensus.cc:2468] T a33a71a76c3446bc81028e6088bb456f P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694ff83326940089c4a5de4f701da85 in term 0.
I20260709 13:12:55.779242  6851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e24fd8f1554aa9aaaa0b2459ca1461" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" is_pre_election: true
I20260709 13:12:55.770161  7008 raft_consensus.cc:3060] T 3e2cddf49d494674a2af001bacdd466f P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.775506  6849 raft_consensus.cc:2468] T 7cfc24257c5a4819b7d004d3ba696c3f P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694ff83326940089c4a5de4f701da85 in term 0.
I20260709 13:12:55.779366  6741 leader_election.cc:304] T a33a71a76c3446bc81028e6088bb456f P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cfe532df476417a9a0b7d9c23aa32ea, c694ff83326940089c4a5de4f701da85; no voters: ac71a527733d4e97b26b7b7a7903045a
I20260709 13:12:55.770993  7003 raft_consensus.cc:2804] T 5e798f66b3ee4250808a11df90a378da P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:55.784965  7003 raft_consensus.cc:493] T 5e798f66b3ee4250808a11df90a378da P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.785462  7003 raft_consensus.cc:3060] T 5e798f66b3ee4250808a11df90a378da P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.786055  7008 raft_consensus.cc:515] T 3e2cddf49d494674a2af001bacdd466f P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.789521  6776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2cddf49d494674a2af001bacdd466f" candidate_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694ff83326940089c4a5de4f701da85"
I20260709 13:12:55.792317  6971 raft_consensus.cc:2804] T a33a71a76c3446bc81028e6088bb456f P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:55.792811  6971 raft_consensus.cc:493] T a33a71a76c3446bc81028e6088bb456f P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.790777  6776 raft_consensus.cc:3060] T 3e2cddf49d494674a2af001bacdd466f P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.793150  6971 raft_consensus.cc:3060] T a33a71a76c3446bc81028e6088bb456f P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.794629  6741 leader_election.cc:304] T 66e24fd8f1554aa9aaaa0b2459ca1461 P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c694ff83326940089c4a5de4f701da85; no voters: 3cfe532df476417a9a0b7d9c23aa32ea, ac71a527733d4e97b26b7b7a7903045a
I20260709 13:12:55.795562  7004 raft_consensus.cc:2749] T 66e24fd8f1554aa9aaaa0b2459ca1461 P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:55.797257  6966 tablet_bootstrap.cc:492] T 130cd9c0c9ae40db9d46446c69b7d38a P 3cfe532df476417a9a0b7d9c23aa32ea: No bootstrap required, opened a new log
I20260709 13:12:55.797183  6924 raft_consensus.cc:2468] T 9fe8c15a65104cceaa416248b1f41a8f P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cfe532df476417a9a0b7d9c23aa32ea in term 1.
I20260709 13:12:55.797861  6966 ts_tablet_manager.cc:1403] T 130cd9c0c9ae40db9d46446c69b7d38a P 3cfe532df476417a9a0b7d9c23aa32ea: Time spent bootstrapping tablet: real 0.099s	user 0.034s	sys 0.015s
I20260709 13:12:55.797528  6674 catalog_manager.cc:5697] T 66e24fd8f1554aa9aaaa0b2459ca1461 P 3cfe532df476417a9a0b7d9c23aa32ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2). New cstate: current_term: 1 leader_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:55.790328  6984 raft_consensus.cc:2804] T 9fe8c15a65104cceaa416248b1f41a8f P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:55.800596  6984 raft_consensus.cc:697] T 9fe8c15a65104cceaa416248b1f41a8f P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 LEADER]: Becoming Leader. State: Replica: 3cfe532df476417a9a0b7d9c23aa32ea, State: Running, Role: LEADER
I20260709 13:12:55.801479  6984 consensus_queue.cc:237] T 9fe8c15a65104cceaa416248b1f41a8f P 3cfe532df476417a9a0b7d9c23aa32ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.802376  7008 leader_election.cc:290] T 3e2cddf49d494674a2af001bacdd466f P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 1 election: Requested vote from peers c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:12:55.803109  6741 leader_election.cc:304] T 7cfc24257c5a4819b7d004d3ba696c3f P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cfe532df476417a9a0b7d9c23aa32ea, c694ff83326940089c4a5de4f701da85; no voters: ac71a527733d4e97b26b7b7a7903045a
I20260709 13:12:55.804040  7004 raft_consensus.cc:2804] T 7cfc24257c5a4819b7d004d3ba696c3f P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:55.804492  7004 raft_consensus.cc:493] T 7cfc24257c5a4819b7d004d3ba696c3f P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:55.804852  7004 raft_consensus.cc:3060] T 7cfc24257c5a4819b7d004d3ba696c3f P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.804605  7003 raft_consensus.cc:515] T 5e798f66b3ee4250808a11df90a378da P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } } peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } }
I20260709 13:12:55.805509  6967 tablet_bootstrap.cc:654] T a33a71a76c3446bc81028e6088bb456f P ac71a527733d4e97b26b7b7a7903045a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.807600  6923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e798f66b3ee4250808a11df90a378da" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac71a527733d4e97b26b7b7a7903045a"
I20260709 13:12:55.807875  7003 leader_election.cc:290] T 5e798f66b3ee4250808a11df90a378da P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 election: Requested vote from peers ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281), 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907)
I20260709 13:12:55.808219  6923 raft_consensus.cc:3060] T 5e798f66b3ee4250808a11df90a378da P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.808633  6966 raft_consensus.cc:359] T 130cd9c0c9ae40db9d46446c69b7d38a P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.809300  6966 raft_consensus.cc:385] T 130cd9c0c9ae40db9d46446c69b7d38a P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.809548  6966 raft_consensus.cc:740] T 130cd9c0c9ae40db9d46446c69b7d38a P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cfe532df476417a9a0b7d9c23aa32ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.810199  6966 consensus_queue.cc:260] T 130cd9c0c9ae40db9d46446c69b7d38a P 3cfe532df476417a9a0b7d9c23aa32ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.803797  6971 raft_consensus.cc:515] T a33a71a76c3446bc81028e6088bb456f P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.813169  6966 ts_tablet_manager.cc:1434] T 130cd9c0c9ae40db9d46446c69b7d38a P 3cfe532df476417a9a0b7d9c23aa32ea: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 13:12:55.803797  6924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2cddf49d494674a2af001bacdd466f" candidate_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac71a527733d4e97b26b7b7a7903045a"
I20260709 13:12:55.815500  6923 raft_consensus.cc:2468] T 5e798f66b3ee4250808a11df90a378da P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694ff83326940089c4a5de4f701da85 in term 1.
I20260709 13:12:55.815758  6925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a33a71a76c3446bc81028e6088bb456f" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac71a527733d4e97b26b7b7a7903045a"
I20260709 13:12:55.815969  6849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e798f66b3ee4250808a11df90a378da" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea"
W20260709 13:12:55.816102  6815 leader_election.cc:343] T 3e2cddf49d494674a2af001bacdd466f P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:55.816617  6849 raft_consensus.cc:3060] T 5e798f66b3ee4250808a11df90a378da P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.816907  6740 leader_election.cc:304] T 5e798f66b3ee4250808a11df90a378da P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac71a527733d4e97b26b7b7a7903045a, c694ff83326940089c4a5de4f701da85; no voters: 
W20260709 13:12:55.817849  6740 leader_election.cc:343] T a33a71a76c3446bc81028e6088bb456f P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:55.818099  6971 leader_election.cc:290] T a33a71a76c3446bc81028e6088bb456f P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 election: Requested vote from peers 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:12:55.818480  7003 raft_consensus.cc:2804] T 5e798f66b3ee4250808a11df90a378da P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:55.819052  6851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a33a71a76c3446bc81028e6088bb456f" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea"
I20260709 13:12:55.819202  7003 raft_consensus.cc:697] T 5e798f66b3ee4250808a11df90a378da P c694ff83326940089c4a5de4f701da85 [term 1 LEADER]: Becoming Leader. State: Replica: c694ff83326940089c4a5de4f701da85, State: Running, Role: LEADER
I20260709 13:12:55.819689  6851 raft_consensus.cc:3060] T a33a71a76c3446bc81028e6088bb456f P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.820350  7003 consensus_queue.cc:237] T 5e798f66b3ee4250808a11df90a378da P c694ff83326940089c4a5de4f701da85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } } peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } }
I20260709 13:12:55.822794  6849 raft_consensus.cc:2468] T 5e798f66b3ee4250808a11df90a378da P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694ff83326940089c4a5de4f701da85 in term 1.
I20260709 13:12:55.827922  6851 raft_consensus.cc:2468] T a33a71a76c3446bc81028e6088bb456f P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694ff83326940089c4a5de4f701da85 in term 1.
I20260709 13:12:55.829680  7004 raft_consensus.cc:515] T 7cfc24257c5a4819b7d004d3ba696c3f P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.831401  6966 tablet_bootstrap.cc:492] T e1d810c81d024c829b673c74b3cf6434 P 3cfe532df476417a9a0b7d9c23aa32ea: Bootstrap starting.
I20260709 13:12:55.832922  6924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cfc24257c5a4819b7d004d3ba696c3f" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac71a527733d4e97b26b7b7a7903045a"
W20260709 13:12:55.834317  6740 leader_election.cc:343] T 7cfc24257c5a4819b7d004d3ba696c3f P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:55.835638  6741 leader_election.cc:304] T a33a71a76c3446bc81028e6088bb456f P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cfe532df476417a9a0b7d9c23aa32ea, c694ff83326940089c4a5de4f701da85; no voters: ac71a527733d4e97b26b7b7a7903045a
I20260709 13:12:55.837568  6971 raft_consensus.cc:2804] T a33a71a76c3446bc81028e6088bb456f P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:55.837782  6851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cfc24257c5a4819b7d004d3ba696c3f" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea"
I20260709 13:12:55.838384  6851 raft_consensus.cc:3060] T 7cfc24257c5a4819b7d004d3ba696c3f P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.845732  7004 leader_election.cc:290] T 7cfc24257c5a4819b7d004d3ba696c3f P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 election: Requested vote from peers 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:12:55.846102  6851 raft_consensus.cc:2468] T 7cfc24257c5a4819b7d004d3ba696c3f P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694ff83326940089c4a5de4f701da85 in term 1.
I20260709 13:12:55.847435  6741 leader_election.cc:304] T 7cfc24257c5a4819b7d004d3ba696c3f P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cfe532df476417a9a0b7d9c23aa32ea, c694ff83326940089c4a5de4f701da85; no voters: ac71a527733d4e97b26b7b7a7903045a
I20260709 13:12:55.848374  7004 raft_consensus.cc:2804] T 7cfc24257c5a4819b7d004d3ba696c3f P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:55.848824  7004 raft_consensus.cc:697] T 7cfc24257c5a4819b7d004d3ba696c3f P c694ff83326940089c4a5de4f701da85 [term 1 LEADER]: Becoming Leader. State: Replica: c694ff83326940089c4a5de4f701da85, State: Running, Role: LEADER
I20260709 13:12:55.849409  6966 tablet_bootstrap.cc:654] T e1d810c81d024c829b673c74b3cf6434 P 3cfe532df476417a9a0b7d9c23aa32ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.849624  7004 consensus_queue.cc:237] T 7cfc24257c5a4819b7d004d3ba696c3f P c694ff83326940089c4a5de4f701da85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.852471  6776 raft_consensus.cc:2468] T 3e2cddf49d494674a2af001bacdd466f P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cfe532df476417a9a0b7d9c23aa32ea in term 1.
I20260709 13:12:55.857002  6817 leader_election.cc:304] T 3e2cddf49d494674a2af001bacdd466f P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cfe532df476417a9a0b7d9c23aa32ea, c694ff83326940089c4a5de4f701da85; no voters: ac71a527733d4e97b26b7b7a7903045a
I20260709 13:12:55.858049  7008 raft_consensus.cc:2804] T 3e2cddf49d494674a2af001bacdd466f P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:55.858668  7008 raft_consensus.cc:697] T 3e2cddf49d494674a2af001bacdd466f P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 LEADER]: Becoming Leader. State: Replica: 3cfe532df476417a9a0b7d9c23aa32ea, State: Running, Role: LEADER
I20260709 13:12:55.859434  7008 consensus_queue.cc:237] T 3e2cddf49d494674a2af001bacdd466f P 3cfe532df476417a9a0b7d9c23aa32ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.864625  6967 tablet_bootstrap.cc:492] T a33a71a76c3446bc81028e6088bb456f P ac71a527733d4e97b26b7b7a7903045a: No bootstrap required, opened a new log
I20260709 13:12:55.867966  6967 ts_tablet_manager.cc:1403] T a33a71a76c3446bc81028e6088bb456f P ac71a527733d4e97b26b7b7a7903045a: Time spent bootstrapping tablet: real 0.116s	user 0.018s	sys 0.031s
I20260709 13:12:55.868608  6674 catalog_manager.cc:5697] T 5e798f66b3ee4250808a11df90a378da P c694ff83326940089c4a5de4f701da85 reported cstate change: term changed from 0 to 1, leader changed from <none> to c694ff83326940089c4a5de4f701da85 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "c694ff83326940089c4a5de4f701da85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:55.871268  6967 raft_consensus.cc:359] T a33a71a76c3446bc81028e6088bb456f P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.872635  6967 raft_consensus.cc:385] T a33a71a76c3446bc81028e6088bb456f P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.872939  6967 raft_consensus.cc:740] T a33a71a76c3446bc81028e6088bb456f P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac71a527733d4e97b26b7b7a7903045a, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.873761  6967 consensus_queue.cc:260] T a33a71a76c3446bc81028e6088bb456f P ac71a527733d4e97b26b7b7a7903045a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.875298  6971 raft_consensus.cc:697] T a33a71a76c3446bc81028e6088bb456f P c694ff83326940089c4a5de4f701da85 [term 1 LEADER]: Becoming Leader. State: Replica: c694ff83326940089c4a5de4f701da85, State: Running, Role: LEADER
I20260709 13:12:55.879849  6971 consensus_queue.cc:237] T a33a71a76c3446bc81028e6088bb456f P c694ff83326940089c4a5de4f701da85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.883491  6967 ts_tablet_manager.cc:1434] T a33a71a76c3446bc81028e6088bb456f P ac71a527733d4e97b26b7b7a7903045a: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:12:55.884573  6967 tablet_bootstrap.cc:492] T 3e2cddf49d494674a2af001bacdd466f P ac71a527733d4e97b26b7b7a7903045a: Bootstrap starting.
I20260709 13:12:55.884953  6966 tablet_bootstrap.cc:492] T e1d810c81d024c829b673c74b3cf6434 P 3cfe532df476417a9a0b7d9c23aa32ea: No bootstrap required, opened a new log
I20260709 13:12:55.883291  6671 catalog_manager.cc:5697] T 9fe8c15a65104cceaa416248b1f41a8f P 3cfe532df476417a9a0b7d9c23aa32ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2). New cstate: current_term: 1 leader_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:55.885540  6966 ts_tablet_manager.cc:1403] T e1d810c81d024c829b673c74b3cf6434 P 3cfe532df476417a9a0b7d9c23aa32ea: Time spent bootstrapping tablet: real 0.055s	user 0.007s	sys 0.004s
I20260709 13:12:55.894129  6966 raft_consensus.cc:359] T e1d810c81d024c829b673c74b3cf6434 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.894785  6966 raft_consensus.cc:385] T e1d810c81d024c829b673c74b3cf6434 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.895040  6966 raft_consensus.cc:740] T e1d810c81d024c829b673c74b3cf6434 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cfe532df476417a9a0b7d9c23aa32ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.895648  6966 consensus_queue.cc:260] T e1d810c81d024c829b673c74b3cf6434 P 3cfe532df476417a9a0b7d9c23aa32ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.896649  6851 raft_consensus.cc:3060] T 130cd9c0c9ae40db9d46446c69b7d38a P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.897644  6966 ts_tablet_manager.cc:1434] T e1d810c81d024c829b673c74b3cf6434 P 3cfe532df476417a9a0b7d9c23aa32ea: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:12:55.890970  6967 tablet_bootstrap.cc:654] T 3e2cddf49d494674a2af001bacdd466f P ac71a527733d4e97b26b7b7a7903045a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.903625  6672 catalog_manager.cc:5697] T a33a71a76c3446bc81028e6088bb456f P c694ff83326940089c4a5de4f701da85 reported cstate change: term changed from 0 to 1, leader changed from <none> to c694ff83326940089c4a5de4f701da85 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "c694ff83326940089c4a5de4f701da85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:55.906814  6672 catalog_manager.cc:5697] T 7cfc24257c5a4819b7d004d3ba696c3f P c694ff83326940089c4a5de4f701da85 reported cstate change: term changed from 0 to 1, leader changed from <none> to c694ff83326940089c4a5de4f701da85 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "c694ff83326940089c4a5de4f701da85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:55.907478  7008 raft_consensus.cc:493] T 130cd9c0c9ae40db9d46446c69b7d38a P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:55.908115  7008 raft_consensus.cc:515] T 130cd9c0c9ae40db9d46446c69b7d38a P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.913894  6972 consensus_queue.cc:1048] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:55.914849  6967 tablet_bootstrap.cc:492] T 3e2cddf49d494674a2af001bacdd466f P ac71a527733d4e97b26b7b7a7903045a: No bootstrap required, opened a new log
I20260709 13:12:55.915325  6967 ts_tablet_manager.cc:1403] T 3e2cddf49d494674a2af001bacdd466f P ac71a527733d4e97b26b7b7a7903045a: Time spent bootstrapping tablet: real 0.031s	user 0.006s	sys 0.016s
I20260709 13:12:55.918278  6967 raft_consensus.cc:359] T 3e2cddf49d494674a2af001bacdd466f P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.918951  6967 raft_consensus.cc:385] T 3e2cddf49d494674a2af001bacdd466f P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.919240  6967 raft_consensus.cc:740] T 3e2cddf49d494674a2af001bacdd466f P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac71a527733d4e97b26b7b7a7903045a, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.919919  6776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130cd9c0c9ae40db9d46446c69b7d38a" candidate_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694ff83326940089c4a5de4f701da85" is_pre_election: true
I20260709 13:12:55.920032  6967 consensus_queue.cc:260] T 3e2cddf49d494674a2af001bacdd466f P ac71a527733d4e97b26b7b7a7903045a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.919857  6671 catalog_manager.cc:5697] T 3e2cddf49d494674a2af001bacdd466f P 3cfe532df476417a9a0b7d9c23aa32ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2). New cstate: current_term: 1 leader_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:55.920976  6776 raft_consensus.cc:2468] T 130cd9c0c9ae40db9d46446c69b7d38a P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cfe532df476417a9a0b7d9c23aa32ea in term 1.
I20260709 13:12:55.922212  7008 leader_election.cc:290] T 130cd9c0c9ae40db9d46446c69b7d38a P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:12:55.922855  6924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130cd9c0c9ae40db9d46446c69b7d38a" candidate_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac71a527733d4e97b26b7b7a7903045a" is_pre_election: true
I20260709 13:12:55.925609  6967 ts_tablet_manager.cc:1434] T 3e2cddf49d494674a2af001bacdd466f P ac71a527733d4e97b26b7b7a7903045a: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:12:55.926918  6967 tablet_bootstrap.cc:492] T 7cfc24257c5a4819b7d004d3ba696c3f P ac71a527733d4e97b26b7b7a7903045a: Bootstrap starting.
I20260709 13:12:55.928180  6817 leader_election.cc:304] T 130cd9c0c9ae40db9d46446c69b7d38a P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cfe532df476417a9a0b7d9c23aa32ea, c694ff83326940089c4a5de4f701da85; no voters: ac71a527733d4e97b26b7b7a7903045a
I20260709 13:12:55.934798  6967 tablet_bootstrap.cc:654] T 7cfc24257c5a4819b7d004d3ba696c3f P ac71a527733d4e97b26b7b7a7903045a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.943719  6972 consensus_queue.cc:1048] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:55.945039  7008 raft_consensus.cc:2804] T 130cd9c0c9ae40db9d46446c69b7d38a P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:55.946375  6967 tablet_bootstrap.cc:492] T 7cfc24257c5a4819b7d004d3ba696c3f P ac71a527733d4e97b26b7b7a7903045a: No bootstrap required, opened a new log
I20260709 13:12:55.946889  6967 ts_tablet_manager.cc:1403] T 7cfc24257c5a4819b7d004d3ba696c3f P ac71a527733d4e97b26b7b7a7903045a: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.000s
I20260709 13:12:55.946811  7008 raft_consensus.cc:493] T 130cd9c0c9ae40db9d46446c69b7d38a P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac71a527733d4e97b26b7b7a7903045a)
I20260709 13:12:55.947396  7008 raft_consensus.cc:3060] T 130cd9c0c9ae40db9d46446c69b7d38a P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:55.950544  6967 raft_consensus.cc:359] T 7cfc24257c5a4819b7d004d3ba696c3f P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.951339  6967 raft_consensus.cc:385] T 7cfc24257c5a4819b7d004d3ba696c3f P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.951709  6967 raft_consensus.cc:740] T 7cfc24257c5a4819b7d004d3ba696c3f P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac71a527733d4e97b26b7b7a7903045a, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.952386  6967 consensus_queue.cc:260] T 7cfc24257c5a4819b7d004d3ba696c3f P ac71a527733d4e97b26b7b7a7903045a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.954618  6967 ts_tablet_manager.cc:1434] T 7cfc24257c5a4819b7d004d3ba696c3f P ac71a527733d4e97b26b7b7a7903045a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:12:55.958793  7008 raft_consensus.cc:515] T 130cd9c0c9ae40db9d46446c69b7d38a P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:55.960925  7008 leader_election.cc:290] T 130cd9c0c9ae40db9d46446c69b7d38a P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 2 election: Requested vote from peers c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:12:55.962872  6775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130cd9c0c9ae40db9d46446c69b7d38a" candidate_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c694ff83326940089c4a5de4f701da85"
I20260709 13:12:55.964043  6924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130cd9c0c9ae40db9d46446c69b7d38a" candidate_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac71a527733d4e97b26b7b7a7903045a"
I20260709 13:12:55.968641  6815 leader_election.cc:304] T 130cd9c0c9ae40db9d46446c69b7d38a P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cfe532df476417a9a0b7d9c23aa32ea; no voters: ac71a527733d4e97b26b7b7a7903045a, c694ff83326940089c4a5de4f701da85
I20260709 13:12:55.969771  7008 raft_consensus.cc:2749] T 130cd9c0c9ae40db9d46446c69b7d38a P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:56.055987  7004 raft_consensus.cc:493] T e1d810c81d024c829b673c74b3cf6434 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.056617  7004 raft_consensus.cc:515] T e1d810c81d024c829b673c74b3cf6434 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:56.058349  7004 leader_election.cc:290] T e1d810c81d024c829b673c74b3cf6434 P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:12:56.059113  6851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d810c81d024c829b673c74b3cf6434" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" is_pre_election: true
I20260709 13:12:56.059413  6924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d810c81d024c829b673c74b3cf6434" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac71a527733d4e97b26b7b7a7903045a" is_pre_election: true
I20260709 13:12:56.059857  6851 raft_consensus.cc:2468] T e1d810c81d024c829b673c74b3cf6434 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694ff83326940089c4a5de4f701da85 in term 0.
I20260709 13:12:56.060045  6924 raft_consensus.cc:2468] T e1d810c81d024c829b673c74b3cf6434 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694ff83326940089c4a5de4f701da85 in term 0.
I20260709 13:12:56.060957  6741 leader_election.cc:304] T e1d810c81d024c829b673c74b3cf6434 P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cfe532df476417a9a0b7d9c23aa32ea, c694ff83326940089c4a5de4f701da85; no voters: 
I20260709 13:12:56.061642  7004 raft_consensus.cc:2804] T e1d810c81d024c829b673c74b3cf6434 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:56.061975  7004 raft_consensus.cc:493] T e1d810c81d024c829b673c74b3cf6434 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.062194  7004 raft_consensus.cc:3060] T e1d810c81d024c829b673c74b3cf6434 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.066780  7004 raft_consensus.cc:515] T e1d810c81d024c829b673c74b3cf6434 P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:56.068432  7004 leader_election.cc:290] T e1d810c81d024c829b673c74b3cf6434 P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 election: Requested vote from peers 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:12:56.069067  6851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d810c81d024c829b673c74b3cf6434" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea"
I20260709 13:12:56.069660  6851 raft_consensus.cc:3060] T e1d810c81d024c829b673c74b3cf6434 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.069537  6924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1d810c81d024c829b673c74b3cf6434" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac71a527733d4e97b26b7b7a7903045a"
I20260709 13:12:56.070246  6924 raft_consensus.cc:3060] T e1d810c81d024c829b673c74b3cf6434 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.076762  6851 raft_consensus.cc:2468] T e1d810c81d024c829b673c74b3cf6434 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694ff83326940089c4a5de4f701da85 in term 1.
I20260709 13:12:56.076924  6924 raft_consensus.cc:2468] T e1d810c81d024c829b673c74b3cf6434 P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694ff83326940089c4a5de4f701da85 in term 1.
I20260709 13:12:56.078039  6741 leader_election.cc:304] T e1d810c81d024c829b673c74b3cf6434 P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cfe532df476417a9a0b7d9c23aa32ea, c694ff83326940089c4a5de4f701da85; no voters: 
I20260709 13:12:56.078725  7004 raft_consensus.cc:2804] T e1d810c81d024c829b673c74b3cf6434 P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:56.079128  7004 raft_consensus.cc:697] T e1d810c81d024c829b673c74b3cf6434 P c694ff83326940089c4a5de4f701da85 [term 1 LEADER]: Becoming Leader. State: Replica: c694ff83326940089c4a5de4f701da85, State: Running, Role: LEADER
I20260709 13:12:56.079772  7004 consensus_queue.cc:237] T e1d810c81d024c829b673c74b3cf6434 P c694ff83326940089c4a5de4f701da85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:56.087095  6672 catalog_manager.cc:5697] T e1d810c81d024c829b673c74b3cf6434 P c694ff83326940089c4a5de4f701da85 reported cstate change: term changed from 0 to 1, leader changed from <none> to c694ff83326940089c4a5de4f701da85 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "c694ff83326940089c4a5de4f701da85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:56.106365  6972 raft_consensus.cc:493] T 7cfc24257c5a4819b7d004d3ba696c3f P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.106933  6972 raft_consensus.cc:515] T 7cfc24257c5a4819b7d004d3ba696c3f P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:56.108709  6972 leader_election.cc:290] T 7cfc24257c5a4819b7d004d3ba696c3f P ac71a527733d4e97b26b7b7a7903045a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303), 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907)
I20260709 13:12:56.109510  6776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cfc24257c5a4819b7d004d3ba696c3f" candidate_uuid: "ac71a527733d4e97b26b7b7a7903045a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694ff83326940089c4a5de4f701da85" is_pre_election: true
I20260709 13:12:56.109570  6851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cfc24257c5a4819b7d004d3ba696c3f" candidate_uuid: "ac71a527733d4e97b26b7b7a7903045a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" is_pre_election: true
I20260709 13:12:56.110355  6851 raft_consensus.cc:2393] T 7cfc24257c5a4819b7d004d3ba696c3f P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac71a527733d4e97b26b7b7a7903045a in current term 1: Already voted for candidate c694ff83326940089c4a5de4f701da85 in this term.
I20260709 13:12:56.111322  6890 leader_election.cc:304] T 7cfc24257c5a4819b7d004d3ba696c3f P ac71a527733d4e97b26b7b7a7903045a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac71a527733d4e97b26b7b7a7903045a; no voters: 3cfe532df476417a9a0b7d9c23aa32ea, c694ff83326940089c4a5de4f701da85
I20260709 13:12:56.112085  6972 raft_consensus.cc:3060] T 7cfc24257c5a4819b7d004d3ba696c3f P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.113627  6979 raft_consensus.cc:493] T 3e2cddf49d494674a2af001bacdd466f P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.114063  6979 raft_consensus.cc:515] T 3e2cddf49d494674a2af001bacdd466f P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:56.115784  6979 leader_election.cc:290] T 3e2cddf49d494674a2af001bacdd466f P ac71a527733d4e97b26b7b7a7903045a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303), 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907)
I20260709 13:12:56.116470  6776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2cddf49d494674a2af001bacdd466f" candidate_uuid: "ac71a527733d4e97b26b7b7a7903045a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694ff83326940089c4a5de4f701da85" is_pre_election: true
I20260709 13:12:56.116847  6851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e2cddf49d494674a2af001bacdd466f" candidate_uuid: "ac71a527733d4e97b26b7b7a7903045a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" is_pre_election: true
I20260709 13:12:56.117283  6776 raft_consensus.cc:2393] T 3e2cddf49d494674a2af001bacdd466f P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac71a527733d4e97b26b7b7a7903045a in current term 1: Already voted for candidate 3cfe532df476417a9a0b7d9c23aa32ea in this term.
I20260709 13:12:56.117857  6972 raft_consensus.cc:2749] T 7cfc24257c5a4819b7d004d3ba696c3f P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:56.118407  6891 leader_election.cc:304] T 3e2cddf49d494674a2af001bacdd466f P ac71a527733d4e97b26b7b7a7903045a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac71a527733d4e97b26b7b7a7903045a; no voters: 3cfe532df476417a9a0b7d9c23aa32ea, c694ff83326940089c4a5de4f701da85
I20260709 13:12:56.119107  6972 raft_consensus.cc:3060] T 3e2cddf49d494674a2af001bacdd466f P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.123346  6972 raft_consensus.cc:2749] T 3e2cddf49d494674a2af001bacdd466f P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:56.146317  6924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "130cd9c0c9ae40db9d46446c69b7d38a"
dest_uuid: "ac71a527733d4e97b26b7b7a7903045a"
mode: GRACEFUL
new_leader_uuid: "c694ff83326940089c4a5de4f701da85"
 from {username='slave'} at 127.0.0.1:33648
I20260709 13:12:56.146888  6924 raft_consensus.cc:606] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a [term 1 LEADER]: Received request to transfer leadership to TS c694ff83326940089c4a5de4f701da85
I20260709 13:12:56.158592  6851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9fe8c15a65104cceaa416248b1f41a8f"
dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea"
mode: GRACEFUL
new_leader_uuid: "c694ff83326940089c4a5de4f701da85"
 from {username='slave'} at 127.0.0.1:33802
I20260709 13:12:56.159123  6851 raft_consensus.cc:606] T 9fe8c15a65104cceaa416248b1f41a8f P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 LEADER]: Received request to transfer leadership to TS c694ff83326940089c4a5de4f701da85
I20260709 13:12:56.168854  7008 consensus_queue.cc:1048] T 7b83e790f03848a880d9e09194fb5384 P 3cfe532df476417a9a0b7d9c23aa32ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:56.182576  6984 consensus_queue.cc:1048] T 7b83e790f03848a880d9e09194fb5384 P 3cfe532df476417a9a0b7d9c23aa32ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:56.182706  6776 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a33a71a76c3446bc81028e6088bb456f"
dest_uuid: "c694ff83326940089c4a5de4f701da85"
mode: GRACEFUL
new_leader_uuid: "3cfe532df476417a9a0b7d9c23aa32ea"
 from {username='slave'} at 127.0.0.1:45134
I20260709 13:12:56.183384  6776 raft_consensus.cc:606] T a33a71a76c3446bc81028e6088bb456f P c694ff83326940089c4a5de4f701da85 [term 1 LEADER]: Received request to transfer leadership to TS 3cfe532df476417a9a0b7d9c23aa32ea
I20260709 13:12:56.197184  6776 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7cfc24257c5a4819b7d004d3ba696c3f"
dest_uuid: "c694ff83326940089c4a5de4f701da85"
mode: GRACEFUL
new_leader_uuid: "ac71a527733d4e97b26b7b7a7903045a"
 from {username='slave'} at 127.0.0.1:45134
I20260709 13:12:56.197860  6776 raft_consensus.cc:606] T 7cfc24257c5a4819b7d004d3ba696c3f P c694ff83326940089c4a5de4f701da85 [term 1 LEADER]: Received request to transfer leadership to TS ac71a527733d4e97b26b7b7a7903045a
I20260709 13:12:56.203012  7004 consensus_queue.cc:1048] T 5e798f66b3ee4250808a11df90a378da P c694ff83326940089c4a5de4f701da85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:56.214717  7003 consensus_queue.cc:1048] T 5e798f66b3ee4250808a11df90a378da P c694ff83326940089c4a5de4f701da85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:56.249217  6973 consensus_queue.cc:1048] T 66e24fd8f1554aa9aaaa0b2459ca1461 P 3cfe532df476417a9a0b7d9c23aa32ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:56.259778  6984 consensus_queue.cc:1048] T 66e24fd8f1554aa9aaaa0b2459ca1461 P 3cfe532df476417a9a0b7d9c23aa32ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:56.269793  6972 raft_consensus.cc:493] T a33a71a76c3446bc81028e6088bb456f P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.270292  6972 raft_consensus.cc:515] T a33a71a76c3446bc81028e6088bb456f P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:56.272418  6972 leader_election.cc:290] T a33a71a76c3446bc81028e6088bb456f P ac71a527733d4e97b26b7b7a7903045a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303), 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907)
I20260709 13:12:56.273164  6776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a33a71a76c3446bc81028e6088bb456f" candidate_uuid: "ac71a527733d4e97b26b7b7a7903045a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694ff83326940089c4a5de4f701da85" is_pre_election: true
I20260709 13:12:56.273397  6851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a33a71a76c3446bc81028e6088bb456f" candidate_uuid: "ac71a527733d4e97b26b7b7a7903045a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" is_pre_election: true
I20260709 13:12:56.274181  6851 raft_consensus.cc:2393] T a33a71a76c3446bc81028e6088bb456f P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac71a527733d4e97b26b7b7a7903045a in current term 1: Already voted for candidate c694ff83326940089c4a5de4f701da85 in this term.
I20260709 13:12:56.275133  6890 leader_election.cc:304] T a33a71a76c3446bc81028e6088bb456f P ac71a527733d4e97b26b7b7a7903045a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac71a527733d4e97b26b7b7a7903045a; no voters: 3cfe532df476417a9a0b7d9c23aa32ea, c694ff83326940089c4a5de4f701da85
I20260709 13:12:56.275863  6972 raft_consensus.cc:3060] T a33a71a76c3446bc81028e6088bb456f P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.280508  6972 raft_consensus.cc:2749] T a33a71a76c3446bc81028e6088bb456f P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:56.334420  7003 consensus_queue.cc:1048] T 7cfc24257c5a4819b7d004d3ba696c3f P c694ff83326940089c4a5de4f701da85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:56.340011  7003 consensus_queue.cc:1048] T a33a71a76c3446bc81028e6088bb456f P c694ff83326940089c4a5de4f701da85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:56.348978  7003 consensus_queue.cc:1048] T 7cfc24257c5a4819b7d004d3ba696c3f P c694ff83326940089c4a5de4f701da85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:56.353299  6984 consensus_queue.cc:1048] T 9fe8c15a65104cceaa416248b1f41a8f P 3cfe532df476417a9a0b7d9c23aa32ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:56.362910  7003 consensus_queue.cc:1048] T a33a71a76c3446bc81028e6088bb456f P c694ff83326940089c4a5de4f701da85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:56.369797  7008 consensus_queue.cc:1048] T 9fe8c15a65104cceaa416248b1f41a8f P 3cfe532df476417a9a0b7d9c23aa32ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:56.375705  7013 raft_consensus.cc:993] T 7cfc24257c5a4819b7d004d3ba696c3f P c694ff83326940089c4a5de4f701da85: : Instructing follower ac71a527733d4e97b26b7b7a7903045a to start an election
I20260709 13:12:56.376186  7013 raft_consensus.cc:1081] T 7cfc24257c5a4819b7d004d3ba696c3f P c694ff83326940089c4a5de4f701da85 [term 1 LEADER]: Signalling peer ac71a527733d4e97b26b7b7a7903045a to start an election
I20260709 13:12:56.380331  6924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7cfc24257c5a4819b7d004d3ba696c3f"
dest_uuid: "ac71a527733d4e97b26b7b7a7903045a"
 from {username='slave'} at 127.0.0.1:33636
I20260709 13:12:56.381062  6924 raft_consensus.cc:493] T 7cfc24257c5a4819b7d004d3ba696c3f P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:56.381557  6924 raft_consensus.cc:3060] T 7cfc24257c5a4819b7d004d3ba696c3f P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:56.392109  6973 consensus_queue.cc:1048] T 3e2cddf49d494674a2af001bacdd466f P 3cfe532df476417a9a0b7d9c23aa32ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:56.392942  6984 consensus_queue.cc:1048] T 3e2cddf49d494674a2af001bacdd466f P 3cfe532df476417a9a0b7d9c23aa32ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:56.396534  7004 raft_consensus.cc:993] T a33a71a76c3446bc81028e6088bb456f P c694ff83326940089c4a5de4f701da85: : Instructing follower 3cfe532df476417a9a0b7d9c23aa32ea to start an election
I20260709 13:12:56.397032  7004 raft_consensus.cc:1081] T a33a71a76c3446bc81028e6088bb456f P c694ff83326940089c4a5de4f701da85 [term 1 LEADER]: Signalling peer 3cfe532df476417a9a0b7d9c23aa32ea to start an election
I20260709 13:12:56.399209  6851 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a33a71a76c3446bc81028e6088bb456f"
dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea"
 from {username='slave'} at 127.0.0.1:33790
I20260709 13:12:56.399751  6851 raft_consensus.cc:493] T a33a71a76c3446bc81028e6088bb456f P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:56.400128  6851 raft_consensus.cc:3060] T a33a71a76c3446bc81028e6088bb456f P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:56.400143  6924 raft_consensus.cc:515] T 7cfc24257c5a4819b7d004d3ba696c3f P ac71a527733d4e97b26b7b7a7903045a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:56.403860  6924 leader_election.cc:290] T 7cfc24257c5a4819b7d004d3ba696c3f P ac71a527733d4e97b26b7b7a7903045a [CANDIDATE]: Term 2 election: Requested vote from peers c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303), 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907)
I20260709 13:12:56.405315  7008 raft_consensus.cc:993] T 9fe8c15a65104cceaa416248b1f41a8f P 3cfe532df476417a9a0b7d9c23aa32ea: : Instructing follower c694ff83326940089c4a5de4f701da85 to start an election
I20260709 13:12:56.405330  6849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cfc24257c5a4819b7d004d3ba696c3f" candidate_uuid: "ac71a527733d4e97b26b7b7a7903045a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea"
I20260709 13:12:56.406271  6849 raft_consensus.cc:3060] T 7cfc24257c5a4819b7d004d3ba696c3f P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:56.408034  7008 raft_consensus.cc:1081] T 9fe8c15a65104cceaa416248b1f41a8f P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 LEADER]: Signalling peer c694ff83326940089c4a5de4f701da85 to start an election
I20260709 13:12:56.408442  6851 raft_consensus.cc:515] T a33a71a76c3446bc81028e6088bb456f P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:56.404939  6776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cfc24257c5a4819b7d004d3ba696c3f" candidate_uuid: "ac71a527733d4e97b26b7b7a7903045a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c694ff83326940089c4a5de4f701da85"
I20260709 13:12:56.411878  6776 raft_consensus.cc:3055] T 7cfc24257c5a4819b7d004d3ba696c3f P c694ff83326940089c4a5de4f701da85 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:56.412202  6776 raft_consensus.cc:740] T 7cfc24257c5a4819b7d004d3ba696c3f P c694ff83326940089c4a5de4f701da85 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c694ff83326940089c4a5de4f701da85, State: Running, Role: LEADER
I20260709 13:12:56.413012  6776 consensus_queue.cc:260] T 7cfc24257c5a4819b7d004d3ba696c3f P c694ff83326940089c4a5de4f701da85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:56.414296  6776 raft_consensus.cc:3060] T 7cfc24257c5a4819b7d004d3ba696c3f P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:56.416421  6924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a33a71a76c3446bc81028e6088bb456f" candidate_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ac71a527733d4e97b26b7b7a7903045a"
I20260709 13:12:56.416927  6849 raft_consensus.cc:2468] T 7cfc24257c5a4819b7d004d3ba696c3f P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac71a527733d4e97b26b7b7a7903045a in term 2.
I20260709 13:12:56.417124  6924 raft_consensus.cc:3060] T a33a71a76c3446bc81028e6088bb456f P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:56.418123  6890 leader_election.cc:304] T 7cfc24257c5a4819b7d004d3ba696c3f P ac71a527733d4e97b26b7b7a7903045a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cfe532df476417a9a0b7d9c23aa32ea, ac71a527733d4e97b26b7b7a7903045a; no voters: 
I20260709 13:12:56.419019  6972 raft_consensus.cc:2804] T 7cfc24257c5a4819b7d004d3ba696c3f P ac71a527733d4e97b26b7b7a7903045a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:56.419505  6972 raft_consensus.cc:697] T 7cfc24257c5a4819b7d004d3ba696c3f P ac71a527733d4e97b26b7b7a7903045a [term 2 LEADER]: Becoming Leader. State: Replica: ac71a527733d4e97b26b7b7a7903045a, State: Running, Role: LEADER
I20260709 13:12:56.419904  6851 leader_election.cc:290] T a33a71a76c3446bc81028e6088bb456f P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 2 election: Requested vote from peers c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:12:56.420333  6972 consensus_queue.cc:237] T 7cfc24257c5a4819b7d004d3ba696c3f P ac71a527733d4e97b26b7b7a7903045a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:56.421074  6776 raft_consensus.cc:2468] T 7cfc24257c5a4819b7d004d3ba696c3f P c694ff83326940089c4a5de4f701da85 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac71a527733d4e97b26b7b7a7903045a in term 2.
I20260709 13:12:56.433172  6851 raft_consensus.cc:1240] T 130cd9c0c9ae40db9d46446c69b7d38a P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 FOLLOWER]: Rejecting Update request from peer ac71a527733d4e97b26b7b7a7903045a for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:56.434900  6972 consensus_queue.cc:1059] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:56.435894  6979 raft_consensus.cc:3055] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:56.436239  6979 raft_consensus.cc:740] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac71a527733d4e97b26b7b7a7903045a, State: Running, Role: LEADER
I20260709 13:12:56.437067  6776 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9fe8c15a65104cceaa416248b1f41a8f"
dest_uuid: "c694ff83326940089c4a5de4f701da85"
 from {username='slave'} at 127.0.0.1:45132
I20260709 13:12:56.437000  6979 consensus_queue.cc:260] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:56.437635  6776 raft_consensus.cc:493] T 9fe8c15a65104cceaa416248b1f41a8f P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:56.438021  6776 raft_consensus.cc:3060] T 9fe8c15a65104cceaa416248b1f41a8f P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:56.438153  6979 raft_consensus.cc:3060] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:56.440027  6774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a33a71a76c3446bc81028e6088bb456f" candidate_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c694ff83326940089c4a5de4f701da85"
I20260709 13:12:56.440630  6774 raft_consensus.cc:3055] T a33a71a76c3446bc81028e6088bb456f P c694ff83326940089c4a5de4f701da85 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:56.440904  6774 raft_consensus.cc:740] T a33a71a76c3446bc81028e6088bb456f P c694ff83326940089c4a5de4f701da85 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c694ff83326940089c4a5de4f701da85, State: Running, Role: LEADER
I20260709 13:12:56.441777  6774 consensus_queue.cc:260] T a33a71a76c3446bc81028e6088bb456f P c694ff83326940089c4a5de4f701da85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:56.442178  6671 catalog_manager.cc:5697] T 7cfc24257c5a4819b7d004d3ba696c3f P ac71a527733d4e97b26b7b7a7903045a reported cstate change: term changed from 1 to 2, leader changed from c694ff83326940089c4a5de4f701da85 (127.28.173.1) to ac71a527733d4e97b26b7b7a7903045a (127.28.173.3). New cstate: current_term: 2 leader_uuid: "ac71a527733d4e97b26b7b7a7903045a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:56.443969  6924 raft_consensus.cc:2468] T a33a71a76c3446bc81028e6088bb456f P ac71a527733d4e97b26b7b7a7903045a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cfe532df476417a9a0b7d9c23aa32ea in term 2.
I20260709 13:12:56.445366  6776 raft_consensus.cc:515] T 9fe8c15a65104cceaa416248b1f41a8f P c694ff83326940089c4a5de4f701da85 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:56.446750  6815 leader_election.cc:304] T a33a71a76c3446bc81028e6088bb456f P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cfe532df476417a9a0b7d9c23aa32ea, ac71a527733d4e97b26b7b7a7903045a; no voters: 
I20260709 13:12:56.447460  6776 leader_election.cc:290] T 9fe8c15a65104cceaa416248b1f41a8f P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 2 election: Requested vote from peers 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:12:56.448026  6973 raft_consensus.cc:2804] T a33a71a76c3446bc81028e6088bb456f P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:56.448556  6973 raft_consensus.cc:697] T a33a71a76c3446bc81028e6088bb456f P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 LEADER]: Becoming Leader. State: Replica: 3cfe532df476417a9a0b7d9c23aa32ea, State: Running, Role: LEADER
I20260709 13:12:56.449586  6851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fe8c15a65104cceaa416248b1f41a8f" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea"
I20260709 13:12:56.450174  6851 raft_consensus.cc:3055] T 9fe8c15a65104cceaa416248b1f41a8f P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:56.451900  6851 raft_consensus.cc:740] T 9fe8c15a65104cceaa416248b1f41a8f P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3cfe532df476417a9a0b7d9c23aa32ea, State: Running, Role: LEADER
I20260709 13:12:56.452319  6774 raft_consensus.cc:3060] T a33a71a76c3446bc81028e6088bb456f P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:56.450438  6973 consensus_queue.cc:237] T a33a71a76c3446bc81028e6088bb456f P 3cfe532df476417a9a0b7d9c23aa32ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:56.454501  6923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fe8c15a65104cceaa416248b1f41a8f" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ac71a527733d4e97b26b7b7a7903045a"
I20260709 13:12:56.461978  6923 raft_consensus.cc:3060] T 9fe8c15a65104cceaa416248b1f41a8f P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:56.463961  6774 raft_consensus.cc:2468] T a33a71a76c3446bc81028e6088bb456f P c694ff83326940089c4a5de4f701da85 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cfe532df476417a9a0b7d9c23aa32ea in term 2.
I20260709 13:12:56.465767  6851 consensus_queue.cc:260] T 9fe8c15a65104cceaa416248b1f41a8f P 3cfe532df476417a9a0b7d9c23aa32ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:56.467072  6851 raft_consensus.cc:3060] T 9fe8c15a65104cceaa416248b1f41a8f P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:56.468147  6923 raft_consensus.cc:2468] T 9fe8c15a65104cceaa416248b1f41a8f P ac71a527733d4e97b26b7b7a7903045a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694ff83326940089c4a5de4f701da85 in term 2.
I20260709 13:12:56.469161  6740 leader_election.cc:304] T 9fe8c15a65104cceaa416248b1f41a8f P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac71a527733d4e97b26b7b7a7903045a, c694ff83326940089c4a5de4f701da85; no voters: 
I20260709 13:12:56.469831  7004 raft_consensus.cc:2804] T 9fe8c15a65104cceaa416248b1f41a8f P c694ff83326940089c4a5de4f701da85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:56.470324  7004 raft_consensus.cc:697] T 9fe8c15a65104cceaa416248b1f41a8f P c694ff83326940089c4a5de4f701da85 [term 2 LEADER]: Becoming Leader. State: Replica: c694ff83326940089c4a5de4f701da85, State: Running, Role: LEADER
I20260709 13:12:56.469655  6673 catalog_manager.cc:5697] T a33a71a76c3446bc81028e6088bb456f P 3cfe532df476417a9a0b7d9c23aa32ea reported cstate change: term changed from 1 to 2, leader changed from c694ff83326940089c4a5de4f701da85 (127.28.173.1) to 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2). New cstate: current_term: 2 leader_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:56.471088  7004 consensus_queue.cc:237] T 9fe8c15a65104cceaa416248b1f41a8f P c694ff83326940089c4a5de4f701da85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:56.476219  6851 raft_consensus.cc:2468] T 9fe8c15a65104cceaa416248b1f41a8f P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694ff83326940089c4a5de4f701da85 in term 2.
I20260709 13:12:56.478678  6672 catalog_manager.cc:5697] T 9fe8c15a65104cceaa416248b1f41a8f P c694ff83326940089c4a5de4f701da85 reported cstate change: term changed from 1 to 2, leader changed from 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2) to c694ff83326940089c4a5de4f701da85 (127.28.173.1). New cstate: current_term: 2 leader_uuid: "c694ff83326940089c4a5de4f701da85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:56.629221  7004 consensus_queue.cc:1048] T e1d810c81d024c829b673c74b3cf6434 P c694ff83326940089c4a5de4f701da85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:56.639598  7013 consensus_queue.cc:1048] T e1d810c81d024c829b673c74b3cf6434 P c694ff83326940089c4a5de4f701da85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:56.877861  6851 raft_consensus.cc:1275] T 7cfc24257c5a4819b7d004d3ba696c3f P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 FOLLOWER]: Refusing update from remote peer ac71a527733d4e97b26b7b7a7903045a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:56.879102  6979 consensus_queue.cc:1048] T 7cfc24257c5a4819b7d004d3ba696c3f P ac71a527733d4e97b26b7b7a7903045a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:56.886587  6774 raft_consensus.cc:1275] T 7cfc24257c5a4819b7d004d3ba696c3f P c694ff83326940089c4a5de4f701da85 [term 2 FOLLOWER]: Refusing update from remote peer ac71a527733d4e97b26b7b7a7903045a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:56.888167  6979 consensus_queue.cc:1048] T 7cfc24257c5a4819b7d004d3ba696c3f P ac71a527733d4e97b26b7b7a7903045a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:56.932452  6923 raft_consensus.cc:1275] T a33a71a76c3446bc81028e6088bb456f P ac71a527733d4e97b26b7b7a7903045a [term 2 FOLLOWER]: Refusing update from remote peer 3cfe532df476417a9a0b7d9c23aa32ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:56.933662  6973 consensus_queue.cc:1048] T a33a71a76c3446bc81028e6088bb456f P 3cfe532df476417a9a0b7d9c23aa32ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:56.941237  6774 raft_consensus.cc:1275] T a33a71a76c3446bc81028e6088bb456f P c694ff83326940089c4a5de4f701da85 [term 2 FOLLOWER]: Refusing update from remote peer 3cfe532df476417a9a0b7d9c23aa32ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:56.942981  7008 consensus_queue.cc:1048] T a33a71a76c3446bc81028e6088bb456f P 3cfe532df476417a9a0b7d9c23aa32ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:57.081298  6851 raft_consensus.cc:1275] T 9fe8c15a65104cceaa416248b1f41a8f P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 FOLLOWER]: Refusing update from remote peer c694ff83326940089c4a5de4f701da85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:57.082598  7003 consensus_queue.cc:1048] T 9fe8c15a65104cceaa416248b1f41a8f P c694ff83326940089c4a5de4f701da85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:57.082799  6923 raft_consensus.cc:1275] T 9fe8c15a65104cceaa416248b1f41a8f P ac71a527733d4e97b26b7b7a7903045a [term 2 FOLLOWER]: Refusing update from remote peer c694ff83326940089c4a5de4f701da85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:57.084180  7003 consensus_queue.cc:1048] T 9fe8c15a65104cceaa416248b1f41a8f P c694ff83326940089c4a5de4f701da85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:57.451961  7004 raft_consensus.cc:493] T 130cd9c0c9ae40db9d46446c69b7d38a P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ac71a527733d4e97b26b7b7a7903045a)
I20260709 13:12:57.452492  7004 raft_consensus.cc:515] T 130cd9c0c9ae40db9d46446c69b7d38a P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:57.454149  7004 leader_election.cc:290] T 130cd9c0c9ae40db9d46446c69b7d38a P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:12:57.454939  6851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130cd9c0c9ae40db9d46446c69b7d38a" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" is_pre_election: true
I20260709 13:12:57.455145  6923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130cd9c0c9ae40db9d46446c69b7d38a" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac71a527733d4e97b26b7b7a7903045a" is_pre_election: true
I20260709 13:12:57.455700  6851 raft_consensus.cc:2393] T 130cd9c0c9ae40db9d46446c69b7d38a P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c694ff83326940089c4a5de4f701da85 in current term 2: Already voted for candidate 3cfe532df476417a9a0b7d9c23aa32ea in this term.
I20260709 13:12:57.455793  6923 raft_consensus.cc:2468] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694ff83326940089c4a5de4f701da85 in term 2.
I20260709 13:12:57.457015  6740 leader_election.cc:304] T 130cd9c0c9ae40db9d46446c69b7d38a P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac71a527733d4e97b26b7b7a7903045a, c694ff83326940089c4a5de4f701da85; no voters: 3cfe532df476417a9a0b7d9c23aa32ea
I20260709 13:12:57.457825  7004 raft_consensus.cc:2804] T 130cd9c0c9ae40db9d46446c69b7d38a P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:57.458185  7004 raft_consensus.cc:493] T 130cd9c0c9ae40db9d46446c69b7d38a P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ac71a527733d4e97b26b7b7a7903045a)
I20260709 13:12:57.458463  7004 raft_consensus.cc:3060] T 130cd9c0c9ae40db9d46446c69b7d38a P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:57.463229  7004 raft_consensus.cc:515] T 130cd9c0c9ae40db9d46446c69b7d38a P c694ff83326940089c4a5de4f701da85 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:57.464728  7004 leader_election.cc:290] T 130cd9c0c9ae40db9d46446c69b7d38a P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 2 election: Requested vote from peers 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:12:57.465605  6851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130cd9c0c9ae40db9d46446c69b7d38a" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea"
I20260709 13:12:57.465692  6923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130cd9c0c9ae40db9d46446c69b7d38a" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac71a527733d4e97b26b7b7a7903045a"
I20260709 13:12:57.466359  6851 raft_consensus.cc:2393] T 130cd9c0c9ae40db9d46446c69b7d38a P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c694ff83326940089c4a5de4f701da85 in current term 2: Already voted for candidate 3cfe532df476417a9a0b7d9c23aa32ea in this term.
I20260709 13:12:57.470777  6923 raft_consensus.cc:2468] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694ff83326940089c4a5de4f701da85 in term 2.
I20260709 13:12:57.471871  6740 leader_election.cc:304] T 130cd9c0c9ae40db9d46446c69b7d38a P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ac71a527733d4e97b26b7b7a7903045a, c694ff83326940089c4a5de4f701da85; no voters: 3cfe532df476417a9a0b7d9c23aa32ea
I20260709 13:12:57.472519  7004 raft_consensus.cc:2804] T 130cd9c0c9ae40db9d46446c69b7d38a P c694ff83326940089c4a5de4f701da85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:57.472927  7004 raft_consensus.cc:697] T 130cd9c0c9ae40db9d46446c69b7d38a P c694ff83326940089c4a5de4f701da85 [term 2 LEADER]: Becoming Leader. State: Replica: c694ff83326940089c4a5de4f701da85, State: Running, Role: LEADER
I20260709 13:12:57.473716  7004 consensus_queue.cc:237] T 130cd9c0c9ae40db9d46446c69b7d38a P c694ff83326940089c4a5de4f701da85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:57.480327  6671 catalog_manager.cc:5697] T 130cd9c0c9ae40db9d46446c69b7d38a P c694ff83326940089c4a5de4f701da85 reported cstate change: term changed from 1 to 2, leader changed from ac71a527733d4e97b26b7b7a7903045a (127.28.173.3) to c694ff83326940089c4a5de4f701da85 (127.28.173.1). New cstate: current_term: 2 leader_uuid: "c694ff83326940089c4a5de4f701da85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:57.912632  6923 raft_consensus.cc:1275] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a [term 2 FOLLOWER]: Refusing update from remote peer c694ff83326940089c4a5de4f701da85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:57.913837  7004 consensus_queue.cc:1048] T 130cd9c0c9ae40db9d46446c69b7d38a P c694ff83326940089c4a5de4f701da85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:57.925782  6851 raft_consensus.cc:1275] T 130cd9c0c9ae40db9d46446c69b7d38a P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 FOLLOWER]: Refusing update from remote peer c694ff83326940089c4a5de4f701da85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:57.927119  7004 consensus_queue.cc:1048] T 130cd9c0c9ae40db9d46446c69b7d38a P c694ff83326940089c4a5de4f701da85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:59.223690  6671 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51722:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:12:59.226540  6671 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:12:59.278003  6764 tablet_service.cc:1511] Processing CreateTablet for tablet 85b78641da93463f839211c9ecf098c1 (DEFAULT_TABLE table=soft_deleted_table [id=d21485e249a1421a96082e775276b6bd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:59.279330  6764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85b78641da93463f839211c9ecf098c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:59.279206  6841 tablet_service.cc:1511] Processing CreateTablet for tablet 85b78641da93463f839211c9ecf098c1 (DEFAULT_TABLE table=soft_deleted_table [id=d21485e249a1421a96082e775276b6bd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:59.280563  6907 tablet_service.cc:1511] Processing CreateTablet for tablet 85b78641da93463f839211c9ecf098c1 (DEFAULT_TABLE table=soft_deleted_table [id=d21485e249a1421a96082e775276b6bd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:59.281795  6907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85b78641da93463f839211c9ecf098c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:59.282702  6838 tablet_service.cc:1511] Processing CreateTablet for tablet bcdbcbb86a864c6eaab608b0e18a55b0 (DEFAULT_TABLE table=soft_deleted_table [id=d21485e249a1421a96082e775276b6bd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:59.280604  6841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85b78641da93463f839211c9ecf098c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:59.292740  6840 tablet_service.cc:1511] Processing CreateTablet for tablet 94f9e4eb8fc245078a0e84fff4103dd5 (DEFAULT_TABLE table=soft_deleted_table [id=d21485e249a1421a96082e775276b6bd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:59.293978  6840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94f9e4eb8fc245078a0e84fff4103dd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:59.294790  6915 tablet_service.cc:1511] Processing CreateTablet for tablet 6fa4c8b2aef94cc6afb369b911954a95 (DEFAULT_TABLE table=soft_deleted_table [id=d21485e249a1421a96082e775276b6bd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:59.296756  6913 tablet_service.cc:1511] Processing CreateTablet for tablet cb84490998a54a1dbf874dd9a275078a (DEFAULT_TABLE table=soft_deleted_table [id=d21485e249a1421a96082e775276b6bd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:59.297716  6911 tablet_service.cc:1511] Processing CreateTablet for tablet 94f9e4eb8fc245078a0e84fff4103dd5 (DEFAULT_TABLE table=soft_deleted_table [id=d21485e249a1421a96082e775276b6bd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:59.298770  6909 tablet_service.cc:1511] Processing CreateTablet for tablet e0b1ea02768e411bb2b6341025336fa8 (DEFAULT_TABLE table=soft_deleted_table [id=d21485e249a1421a96082e775276b6bd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:59.300173  6915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fa4c8b2aef94cc6afb369b911954a95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:59.296756  6910 tablet_service.cc:1511] Processing CreateTablet for tablet bcdbcbb86a864c6eaab608b0e18a55b0 (DEFAULT_TABLE table=soft_deleted_table [id=d21485e249a1421a96082e775276b6bd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:59.301345  6909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0b1ea02768e411bb2b6341025336fa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:59.302526  6910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcdbcbb86a864c6eaab608b0e18a55b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:59.303794  6908 tablet_service.cc:1511] Processing CreateTablet for tablet 42af7e00d58646a6b3a58a6fe0a4d155 (DEFAULT_TABLE table=soft_deleted_table [id=d21485e249a1421a96082e775276b6bd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:59.305013  6908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42af7e00d58646a6b3a58a6fe0a4d155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:59.307276  6838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcdbcbb86a864c6eaab608b0e18a55b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:59.308045  6914 tablet_service.cc:1511] Processing CreateTablet for tablet 4846b2cfc1c944acb68ffc05393ce201 (DEFAULT_TABLE table=soft_deleted_table [id=d21485e249a1421a96082e775276b6bd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:59.308853  6912 tablet_service.cc:1511] Processing CreateTablet for tablet 4bba86af07534b5db67f5c4c214a7dd3 (DEFAULT_TABLE table=soft_deleted_table [id=d21485e249a1421a96082e775276b6bd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:59.309252  6914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4846b2cfc1c944acb68ffc05393ce201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:59.310050  6912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bba86af07534b5db67f5c4c214a7dd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:59.312081  6911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94f9e4eb8fc245078a0e84fff4103dd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:59.316227  6913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb84490998a54a1dbf874dd9a275078a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:59.317893  6835 tablet_service.cc:1511] Processing CreateTablet for tablet e0b1ea02768e411bb2b6341025336fa8 (DEFAULT_TABLE table=soft_deleted_table [id=d21485e249a1421a96082e775276b6bd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:59.318812  6837 tablet_service.cc:1511] Processing CreateTablet for tablet 42af7e00d58646a6b3a58a6fe0a4d155 (DEFAULT_TABLE table=soft_deleted_table [id=d21485e249a1421a96082e775276b6bd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:59.319226  6835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0b1ea02768e411bb2b6341025336fa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:59.320405  6759 tablet_service.cc:1511] Processing CreateTablet for tablet cb84490998a54a1dbf874dd9a275078a (DEFAULT_TABLE table=soft_deleted_table [id=d21485e249a1421a96082e775276b6bd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:59.320734  6836 tablet_service.cc:1511] Processing CreateTablet for tablet cb84490998a54a1dbf874dd9a275078a (DEFAULT_TABLE table=soft_deleted_table [id=d21485e249a1421a96082e775276b6bd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:59.321705  6759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb84490998a54a1dbf874dd9a275078a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:59.321961  6836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb84490998a54a1dbf874dd9a275078a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:59.324800  6758 tablet_service.cc:1511] Processing CreateTablet for tablet bcdbcbb86a864c6eaab608b0e18a55b0 (DEFAULT_TABLE table=soft_deleted_table [id=d21485e249a1421a96082e775276b6bd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:59.325314  6761 tablet_service.cc:1511] Processing CreateTablet for tablet e0b1ea02768e411bb2b6341025336fa8 (DEFAULT_TABLE table=soft_deleted_table [id=d21485e249a1421a96082e775276b6bd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:59.326016  6758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcdbcbb86a864c6eaab608b0e18a55b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:59.326663  6761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0b1ea02768e411bb2b6341025336fa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:59.327152  6762 tablet_service.cc:1511] Processing CreateTablet for tablet 4bba86af07534b5db67f5c4c214a7dd3 (DEFAULT_TABLE table=soft_deleted_table [id=d21485e249a1421a96082e775276b6bd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:59.327904  6763 tablet_service.cc:1511] Processing CreateTablet for tablet 94f9e4eb8fc245078a0e84fff4103dd5 (DEFAULT_TABLE table=soft_deleted_table [id=d21485e249a1421a96082e775276b6bd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:59.328392  6762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bba86af07534b5db67f5c4c214a7dd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:59.329123  6763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94f9e4eb8fc245078a0e84fff4103dd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:59.330560  6834 tablet_service.cc:1511] Processing CreateTablet for tablet 4846b2cfc1c944acb68ffc05393ce201 (DEFAULT_TABLE table=soft_deleted_table [id=d21485e249a1421a96082e775276b6bd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:59.331698  6834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4846b2cfc1c944acb68ffc05393ce201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:59.332773  6766 tablet_service.cc:1511] Processing CreateTablet for tablet 4846b2cfc1c944acb68ffc05393ce201 (DEFAULT_TABLE table=soft_deleted_table [id=d21485e249a1421a96082e775276b6bd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:59.320413  6760 tablet_service.cc:1511] Processing CreateTablet for tablet 6fa4c8b2aef94cc6afb369b911954a95 (DEFAULT_TABLE table=soft_deleted_table [id=d21485e249a1421a96082e775276b6bd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:59.325616  6765 tablet_service.cc:1511] Processing CreateTablet for tablet 42af7e00d58646a6b3a58a6fe0a4d155 (DEFAULT_TABLE table=soft_deleted_table [id=d21485e249a1421a96082e775276b6bd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:59.333961  6766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4846b2cfc1c944acb68ffc05393ce201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:59.334584  6760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fa4c8b2aef94cc6afb369b911954a95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:59.335801  6839 tablet_service.cc:1511] Processing CreateTablet for tablet 4bba86af07534b5db67f5c4c214a7dd3 (DEFAULT_TABLE table=soft_deleted_table [id=d21485e249a1421a96082e775276b6bd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:59.336560  6765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42af7e00d58646a6b3a58a6fe0a4d155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:59.337034  6839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bba86af07534b5db67f5c4c214a7dd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:59.339107  6833 tablet_service.cc:1511] Processing CreateTablet for tablet 6fa4c8b2aef94cc6afb369b911954a95 (DEFAULT_TABLE table=soft_deleted_table [id=d21485e249a1421a96082e775276b6bd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:59.341212  6833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fa4c8b2aef94cc6afb369b911954a95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:59.342823  6837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42af7e00d58646a6b3a58a6fe0a4d155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:59.440137  7071 tablet_bootstrap.cc:492] T cb84490998a54a1dbf874dd9a275078a P c694ff83326940089c4a5de4f701da85: Bootstrap starting.
I20260709 13:12:59.446762  7071 tablet_bootstrap.cc:654] T cb84490998a54a1dbf874dd9a275078a P c694ff83326940089c4a5de4f701da85: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.448509  7070 tablet_bootstrap.cc:492] T 85b78641da93463f839211c9ecf098c1 P ac71a527733d4e97b26b7b7a7903045a: Bootstrap starting.
I20260709 13:12:59.462399  7071 tablet_bootstrap.cc:492] T cb84490998a54a1dbf874dd9a275078a P c694ff83326940089c4a5de4f701da85: No bootstrap required, opened a new log
I20260709 13:12:59.467327  7071 ts_tablet_manager.cc:1403] T cb84490998a54a1dbf874dd9a275078a P c694ff83326940089c4a5de4f701da85: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.007s
I20260709 13:12:59.458791  7072 tablet_bootstrap.cc:492] T 94f9e4eb8fc245078a0e84fff4103dd5 P 3cfe532df476417a9a0b7d9c23aa32ea: Bootstrap starting.
I20260709 13:12:59.468025  7070 tablet_bootstrap.cc:654] T 85b78641da93463f839211c9ecf098c1 P ac71a527733d4e97b26b7b7a7903045a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.470839  7071 raft_consensus.cc:359] T cb84490998a54a1dbf874dd9a275078a P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.471760  7071 raft_consensus.cc:385] T cb84490998a54a1dbf874dd9a275078a P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.472139  7071 raft_consensus.cc:740] T cb84490998a54a1dbf874dd9a275078a P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694ff83326940089c4a5de4f701da85, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.472915  7071 consensus_queue.cc:260] T cb84490998a54a1dbf874dd9a275078a P c694ff83326940089c4a5de4f701da85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.475315  7071 ts_tablet_manager.cc:1434] T cb84490998a54a1dbf874dd9a275078a P c694ff83326940089c4a5de4f701da85: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:59.475675  7072 tablet_bootstrap.cc:654] T 94f9e4eb8fc245078a0e84fff4103dd5 P 3cfe532df476417a9a0b7d9c23aa32ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.476155  7057 raft_consensus.cc:493] T cb84490998a54a1dbf874dd9a275078a P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.476622  7057 raft_consensus.cc:515] T cb84490998a54a1dbf874dd9a275078a P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.477525  7070 tablet_bootstrap.cc:492] T 85b78641da93463f839211c9ecf098c1 P ac71a527733d4e97b26b7b7a7903045a: No bootstrap required, opened a new log
I20260709 13:12:59.478035  7070 ts_tablet_manager.cc:1403] T 85b78641da93463f839211c9ecf098c1 P ac71a527733d4e97b26b7b7a7903045a: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.005s
I20260709 13:12:59.478791  7057 leader_election.cc:290] T cb84490998a54a1dbf874dd9a275078a P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:12:59.480367  6851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb84490998a54a1dbf874dd9a275078a" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" is_pre_election: true
I20260709 13:12:59.480904  6923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb84490998a54a1dbf874dd9a275078a" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac71a527733d4e97b26b7b7a7903045a" is_pre_election: true
W20260709 13:12:59.481645  6741 leader_election.cc:343] T cb84490998a54a1dbf874dd9a275078a P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:59.481868  7072 tablet_bootstrap.cc:492] T 94f9e4eb8fc245078a0e84fff4103dd5 P 3cfe532df476417a9a0b7d9c23aa32ea: No bootstrap required, opened a new log
I20260709 13:12:59.481843  7070 raft_consensus.cc:359] T 85b78641da93463f839211c9ecf098c1 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.482503  7072 ts_tablet_manager.cc:1403] T 94f9e4eb8fc245078a0e84fff4103dd5 P 3cfe532df476417a9a0b7d9c23aa32ea: Time spent bootstrapping tablet: real 0.032s	user 0.006s	sys 0.007s
I20260709 13:12:59.482765  7070 raft_consensus.cc:385] T 85b78641da93463f839211c9ecf098c1 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:12:59.483013  6740 leader_election.cc:343] T cb84490998a54a1dbf874dd9a275078a P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:59.483105  7070 raft_consensus.cc:740] T 85b78641da93463f839211c9ecf098c1 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac71a527733d4e97b26b7b7a7903045a, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.483381  7071 tablet_bootstrap.cc:492] T e0b1ea02768e411bb2b6341025336fa8 P c694ff83326940089c4a5de4f701da85: Bootstrap starting.
I20260709 13:12:59.483533  6740 leader_election.cc:304] T cb84490998a54a1dbf874dd9a275078a P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c694ff83326940089c4a5de4f701da85; no voters: 3cfe532df476417a9a0b7d9c23aa32ea, ac71a527733d4e97b26b7b7a7903045a
I20260709 13:12:59.484087  7070 consensus_queue.cc:260] T 85b78641da93463f839211c9ecf098c1 P ac71a527733d4e97b26b7b7a7903045a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.485597  7072 raft_consensus.cc:359] T 94f9e4eb8fc245078a0e84fff4103dd5 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.486337  7072 raft_consensus.cc:385] T 94f9e4eb8fc245078a0e84fff4103dd5 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.486449  7070 ts_tablet_manager.cc:1434] T 85b78641da93463f839211c9ecf098c1 P ac71a527733d4e97b26b7b7a7903045a: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:12:59.486649  7072 raft_consensus.cc:740] T 94f9e4eb8fc245078a0e84fff4103dd5 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cfe532df476417a9a0b7d9c23aa32ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.487623  7070 tablet_bootstrap.cc:492] T bcdbcbb86a864c6eaab608b0e18a55b0 P ac71a527733d4e97b26b7b7a7903045a: Bootstrap starting.
I20260709 13:12:59.487643  7072 consensus_queue.cc:260] T 94f9e4eb8fc245078a0e84fff4103dd5 P 3cfe532df476417a9a0b7d9c23aa32ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.490617  7071 tablet_bootstrap.cc:654] T e0b1ea02768e411bb2b6341025336fa8 P c694ff83326940089c4a5de4f701da85: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.495303  7057 raft_consensus.cc:2749] T cb84490998a54a1dbf874dd9a275078a P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:59.498214  7072 ts_tablet_manager.cc:1434] T 94f9e4eb8fc245078a0e84fff4103dd5 P 3cfe532df476417a9a0b7d9c23aa32ea: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:12:59.498708  7071 tablet_bootstrap.cc:492] T e0b1ea02768e411bb2b6341025336fa8 P c694ff83326940089c4a5de4f701da85: No bootstrap required, opened a new log
I20260709 13:12:59.499295  7071 ts_tablet_manager.cc:1403] T e0b1ea02768e411bb2b6341025336fa8 P c694ff83326940089c4a5de4f701da85: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.008s
I20260709 13:12:59.502604  7071 raft_consensus.cc:359] T e0b1ea02768e411bb2b6341025336fa8 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.499305  7072 tablet_bootstrap.cc:492] T 6fa4c8b2aef94cc6afb369b911954a95 P 3cfe532df476417a9a0b7d9c23aa32ea: Bootstrap starting.
I20260709 13:12:59.503387  7071 raft_consensus.cc:385] T e0b1ea02768e411bb2b6341025336fa8 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.504020  7071 raft_consensus.cc:740] T e0b1ea02768e411bb2b6341025336fa8 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694ff83326940089c4a5de4f701da85, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.504820  7071 consensus_queue.cc:260] T e0b1ea02768e411bb2b6341025336fa8 P c694ff83326940089c4a5de4f701da85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.510205  7072 tablet_bootstrap.cc:654] T 6fa4c8b2aef94cc6afb369b911954a95 P 3cfe532df476417a9a0b7d9c23aa32ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.513365  7071 ts_tablet_manager.cc:1434] T e0b1ea02768e411bb2b6341025336fa8 P c694ff83326940089c4a5de4f701da85: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.003s
I20260709 13:12:59.514412  7071 tablet_bootstrap.cc:492] T 94f9e4eb8fc245078a0e84fff4103dd5 P c694ff83326940089c4a5de4f701da85: Bootstrap starting.
I20260709 13:12:59.517750  7072 tablet_bootstrap.cc:492] T 6fa4c8b2aef94cc6afb369b911954a95 P 3cfe532df476417a9a0b7d9c23aa32ea: No bootstrap required, opened a new log
I20260709 13:12:59.518321  7072 ts_tablet_manager.cc:1403] T 6fa4c8b2aef94cc6afb369b911954a95 P 3cfe532df476417a9a0b7d9c23aa32ea: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.000s
I20260709 13:12:59.520120  7070 tablet_bootstrap.cc:654] T bcdbcbb86a864c6eaab608b0e18a55b0 P ac71a527733d4e97b26b7b7a7903045a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.521013  7071 tablet_bootstrap.cc:654] T 94f9e4eb8fc245078a0e84fff4103dd5 P c694ff83326940089c4a5de4f701da85: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.521504  7072 raft_consensus.cc:359] T 6fa4c8b2aef94cc6afb369b911954a95 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.522305  7072 raft_consensus.cc:385] T 6fa4c8b2aef94cc6afb369b911954a95 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.522598  7072 raft_consensus.cc:740] T 6fa4c8b2aef94cc6afb369b911954a95 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cfe532df476417a9a0b7d9c23aa32ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.523430  7072 consensus_queue.cc:260] T 6fa4c8b2aef94cc6afb369b911954a95 P 3cfe532df476417a9a0b7d9c23aa32ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.528170  7072 ts_tablet_manager.cc:1434] T 6fa4c8b2aef94cc6afb369b911954a95 P 3cfe532df476417a9a0b7d9c23aa32ea: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:12:59.529163  7072 tablet_bootstrap.cc:492] T 85b78641da93463f839211c9ecf098c1 P 3cfe532df476417a9a0b7d9c23aa32ea: Bootstrap starting.
I20260709 13:12:59.532645  7071 tablet_bootstrap.cc:492] T 94f9e4eb8fc245078a0e84fff4103dd5 P c694ff83326940089c4a5de4f701da85: No bootstrap required, opened a new log
I20260709 13:12:59.533221  7071 ts_tablet_manager.cc:1403] T 94f9e4eb8fc245078a0e84fff4103dd5 P c694ff83326940089c4a5de4f701da85: Time spent bootstrapping tablet: real 0.019s	user 0.005s	sys 0.012s
I20260709 13:12:59.533682  7070 tablet_bootstrap.cc:492] T bcdbcbb86a864c6eaab608b0e18a55b0 P ac71a527733d4e97b26b7b7a7903045a: No bootstrap required, opened a new log
I20260709 13:12:59.534305  7070 ts_tablet_manager.cc:1403] T bcdbcbb86a864c6eaab608b0e18a55b0 P ac71a527733d4e97b26b7b7a7903045a: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.000s
I20260709 13:12:59.535681  7072 tablet_bootstrap.cc:654] T 85b78641da93463f839211c9ecf098c1 P 3cfe532df476417a9a0b7d9c23aa32ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.536399  7071 raft_consensus.cc:359] T 94f9e4eb8fc245078a0e84fff4103dd5 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.537237  7071 raft_consensus.cc:385] T 94f9e4eb8fc245078a0e84fff4103dd5 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.537533  7071 raft_consensus.cc:740] T 94f9e4eb8fc245078a0e84fff4103dd5 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694ff83326940089c4a5de4f701da85, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.537576  7070 raft_consensus.cc:359] T bcdbcbb86a864c6eaab608b0e18a55b0 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.538458  7070 raft_consensus.cc:385] T bcdbcbb86a864c6eaab608b0e18a55b0 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.538911  7070 raft_consensus.cc:740] T bcdbcbb86a864c6eaab608b0e18a55b0 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac71a527733d4e97b26b7b7a7903045a, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.538472  7071 consensus_queue.cc:260] T 94f9e4eb8fc245078a0e84fff4103dd5 P c694ff83326940089c4a5de4f701da85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.539919  7070 consensus_queue.cc:260] T bcdbcbb86a864c6eaab608b0e18a55b0 P ac71a527733d4e97b26b7b7a7903045a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.541460  7071 ts_tablet_manager.cc:1434] T 94f9e4eb8fc245078a0e84fff4103dd5 P c694ff83326940089c4a5de4f701da85: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:12:59.542339  7072 tablet_bootstrap.cc:492] T 85b78641da93463f839211c9ecf098c1 P 3cfe532df476417a9a0b7d9c23aa32ea: No bootstrap required, opened a new log
I20260709 13:12:59.542528  7071 tablet_bootstrap.cc:492] T 85b78641da93463f839211c9ecf098c1 P c694ff83326940089c4a5de4f701da85: Bootstrap starting.
I20260709 13:12:59.542827  7072 ts_tablet_manager.cc:1403] T 85b78641da93463f839211c9ecf098c1 P 3cfe532df476417a9a0b7d9c23aa32ea: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:12:59.546123  7072 raft_consensus.cc:359] T 85b78641da93463f839211c9ecf098c1 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.546793  7072 raft_consensus.cc:385] T 85b78641da93463f839211c9ecf098c1 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.547070  7072 raft_consensus.cc:740] T 85b78641da93463f839211c9ecf098c1 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cfe532df476417a9a0b7d9c23aa32ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.547748  7072 consensus_queue.cc:260] T 85b78641da93463f839211c9ecf098c1 P 3cfe532df476417a9a0b7d9c23aa32ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.549791  7071 tablet_bootstrap.cc:654] T 85b78641da93463f839211c9ecf098c1 P c694ff83326940089c4a5de4f701da85: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.550067  7072 ts_tablet_manager.cc:1434] T 85b78641da93463f839211c9ecf098c1 P 3cfe532df476417a9a0b7d9c23aa32ea: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:12:59.550455  7070 ts_tablet_manager.cc:1434] T bcdbcbb86a864c6eaab608b0e18a55b0 P ac71a527733d4e97b26b7b7a7903045a: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:12:59.554118  7072 tablet_bootstrap.cc:492] T 4846b2cfc1c944acb68ffc05393ce201 P 3cfe532df476417a9a0b7d9c23aa32ea: Bootstrap starting.
I20260709 13:12:59.558483  7070 tablet_bootstrap.cc:492] T 94f9e4eb8fc245078a0e84fff4103dd5 P ac71a527733d4e97b26b7b7a7903045a: Bootstrap starting.
I20260709 13:12:59.562505  7072 tablet_bootstrap.cc:654] T 4846b2cfc1c944acb68ffc05393ce201 P 3cfe532df476417a9a0b7d9c23aa32ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.566283  7071 tablet_bootstrap.cc:492] T 85b78641da93463f839211c9ecf098c1 P c694ff83326940089c4a5de4f701da85: No bootstrap required, opened a new log
I20260709 13:12:59.566756  7071 ts_tablet_manager.cc:1403] T 85b78641da93463f839211c9ecf098c1 P c694ff83326940089c4a5de4f701da85: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.004s
I20260709 13:12:59.569869  7070 tablet_bootstrap.cc:654] T 94f9e4eb8fc245078a0e84fff4103dd5 P ac71a527733d4e97b26b7b7a7903045a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.570289  7071 raft_consensus.cc:359] T 85b78641da93463f839211c9ecf098c1 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.571276  7071 raft_consensus.cc:385] T 85b78641da93463f839211c9ecf098c1 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.571640  7071 raft_consensus.cc:740] T 85b78641da93463f839211c9ecf098c1 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694ff83326940089c4a5de4f701da85, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.572567  7071 consensus_queue.cc:260] T 85b78641da93463f839211c9ecf098c1 P c694ff83326940089c4a5de4f701da85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.575716  7071 ts_tablet_manager.cc:1434] T 85b78641da93463f839211c9ecf098c1 P c694ff83326940089c4a5de4f701da85: Time spent starting tablet: real 0.009s	user 0.000s	sys 0.007s
I20260709 13:12:59.578429  7071 tablet_bootstrap.cc:492] T 42af7e00d58646a6b3a58a6fe0a4d155 P c694ff83326940089c4a5de4f701da85: Bootstrap starting.
I20260709 13:12:59.581116  7072 tablet_bootstrap.cc:492] T 4846b2cfc1c944acb68ffc05393ce201 P 3cfe532df476417a9a0b7d9c23aa32ea: No bootstrap required, opened a new log
I20260709 13:12:59.581450  7070 tablet_bootstrap.cc:492] T 94f9e4eb8fc245078a0e84fff4103dd5 P ac71a527733d4e97b26b7b7a7903045a: No bootstrap required, opened a new log
I20260709 13:12:59.581640  7072 ts_tablet_manager.cc:1403] T 4846b2cfc1c944acb68ffc05393ce201 P 3cfe532df476417a9a0b7d9c23aa32ea: Time spent bootstrapping tablet: real 0.028s	user 0.003s	sys 0.009s
I20260709 13:12:59.582139  7070 ts_tablet_manager.cc:1403] T 94f9e4eb8fc245078a0e84fff4103dd5 P ac71a527733d4e97b26b7b7a7903045a: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.004s
I20260709 13:12:59.585000  7071 tablet_bootstrap.cc:654] T 42af7e00d58646a6b3a58a6fe0a4d155 P c694ff83326940089c4a5de4f701da85: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.585585  7070 raft_consensus.cc:359] T 94f9e4eb8fc245078a0e84fff4103dd5 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.585235  7072 raft_consensus.cc:359] T 4846b2cfc1c944acb68ffc05393ce201 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.586551  7070 raft_consensus.cc:385] T 94f9e4eb8fc245078a0e84fff4103dd5 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.586613  7072 raft_consensus.cc:385] T 4846b2cfc1c944acb68ffc05393ce201 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.587105  7070 raft_consensus.cc:740] T 94f9e4eb8fc245078a0e84fff4103dd5 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac71a527733d4e97b26b7b7a7903045a, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.587154  7072 raft_consensus.cc:740] T 4846b2cfc1c944acb68ffc05393ce201 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cfe532df476417a9a0b7d9c23aa32ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.588285  7070 consensus_queue.cc:260] T 94f9e4eb8fc245078a0e84fff4103dd5 P ac71a527733d4e97b26b7b7a7903045a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.588259  7072 consensus_queue.cc:260] T 4846b2cfc1c944acb68ffc05393ce201 P 3cfe532df476417a9a0b7d9c23aa32ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.592187  7070 ts_tablet_manager.cc:1434] T 94f9e4eb8fc245078a0e84fff4103dd5 P ac71a527733d4e97b26b7b7a7903045a: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
W20260709 13:12:59.592468  6722 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:59.593164  7072 ts_tablet_manager.cc:1434] T 4846b2cfc1c944acb68ffc05393ce201 P 3cfe532df476417a9a0b7d9c23aa32ea: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:12:59.593478  7070 tablet_bootstrap.cc:492] T 4846b2cfc1c944acb68ffc05393ce201 P ac71a527733d4e97b26b7b7a7903045a: Bootstrap starting.
I20260709 13:12:59.594401  7072 tablet_bootstrap.cc:492] T 42af7e00d58646a6b3a58a6fe0a4d155 P 3cfe532df476417a9a0b7d9c23aa32ea: Bootstrap starting.
I20260709 13:12:59.596561  7071 tablet_bootstrap.cc:492] T 42af7e00d58646a6b3a58a6fe0a4d155 P c694ff83326940089c4a5de4f701da85: No bootstrap required, opened a new log
I20260709 13:12:59.597085  7071 ts_tablet_manager.cc:1403] T 42af7e00d58646a6b3a58a6fe0a4d155 P c694ff83326940089c4a5de4f701da85: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 13:12:59.600744  7070 tablet_bootstrap.cc:654] T 4846b2cfc1c944acb68ffc05393ce201 P ac71a527733d4e97b26b7b7a7903045a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.600354  7071 raft_consensus.cc:359] T 42af7e00d58646a6b3a58a6fe0a4d155 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.601150  7071 raft_consensus.cc:385] T 42af7e00d58646a6b3a58a6fe0a4d155 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.601456  7071 raft_consensus.cc:740] T 42af7e00d58646a6b3a58a6fe0a4d155 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694ff83326940089c4a5de4f701da85, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.602283  7072 tablet_bootstrap.cc:654] T 42af7e00d58646a6b3a58a6fe0a4d155 P 3cfe532df476417a9a0b7d9c23aa32ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.602360  7071 consensus_queue.cc:260] T 42af7e00d58646a6b3a58a6fe0a4d155 P c694ff83326940089c4a5de4f701da85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.605249  7071 ts_tablet_manager.cc:1434] T 42af7e00d58646a6b3a58a6fe0a4d155 P c694ff83326940089c4a5de4f701da85: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:12:59.606531  7071 tablet_bootstrap.cc:492] T 6fa4c8b2aef94cc6afb369b911954a95 P c694ff83326940089c4a5de4f701da85: Bootstrap starting.
I20260709 13:12:59.615206  7071 tablet_bootstrap.cc:654] T 6fa4c8b2aef94cc6afb369b911954a95 P c694ff83326940089c4a5de4f701da85: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.625569  7070 tablet_bootstrap.cc:492] T 4846b2cfc1c944acb68ffc05393ce201 P ac71a527733d4e97b26b7b7a7903045a: No bootstrap required, opened a new log
I20260709 13:12:59.626246  7070 ts_tablet_manager.cc:1403] T 4846b2cfc1c944acb68ffc05393ce201 P ac71a527733d4e97b26b7b7a7903045a: Time spent bootstrapping tablet: real 0.033s	user 0.023s	sys 0.000s
I20260709 13:12:59.630136  7070 raft_consensus.cc:359] T 4846b2cfc1c944acb68ffc05393ce201 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.631153  7070 raft_consensus.cc:385] T 4846b2cfc1c944acb68ffc05393ce201 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.631541  7070 raft_consensus.cc:740] T 4846b2cfc1c944acb68ffc05393ce201 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac71a527733d4e97b26b7b7a7903045a, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.632359  7070 consensus_queue.cc:260] T 4846b2cfc1c944acb68ffc05393ce201 P ac71a527733d4e97b26b7b7a7903045a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.633108  7072 tablet_bootstrap.cc:492] T 42af7e00d58646a6b3a58a6fe0a4d155 P 3cfe532df476417a9a0b7d9c23aa32ea: No bootstrap required, opened a new log
I20260709 13:12:59.633837  7072 ts_tablet_manager.cc:1403] T 42af7e00d58646a6b3a58a6fe0a4d155 P 3cfe532df476417a9a0b7d9c23aa32ea: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.019s
I20260709 13:12:59.633983  7071 tablet_bootstrap.cc:492] T 6fa4c8b2aef94cc6afb369b911954a95 P c694ff83326940089c4a5de4f701da85: No bootstrap required, opened a new log
I20260709 13:12:59.634511  7071 ts_tablet_manager.cc:1403] T 6fa4c8b2aef94cc6afb369b911954a95 P c694ff83326940089c4a5de4f701da85: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.016s
I20260709 13:12:59.634665  7070 ts_tablet_manager.cc:1434] T 4846b2cfc1c944acb68ffc05393ce201 P ac71a527733d4e97b26b7b7a7903045a: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:12:59.635766  7070 tablet_bootstrap.cc:492] T 42af7e00d58646a6b3a58a6fe0a4d155 P ac71a527733d4e97b26b7b7a7903045a: Bootstrap starting.
I20260709 13:12:59.637040  7072 raft_consensus.cc:359] T 42af7e00d58646a6b3a58a6fe0a4d155 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.637830  7072 raft_consensus.cc:385] T 42af7e00d58646a6b3a58a6fe0a4d155 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.637406  7071 raft_consensus.cc:359] T 6fa4c8b2aef94cc6afb369b911954a95 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.638157  7072 raft_consensus.cc:740] T 42af7e00d58646a6b3a58a6fe0a4d155 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cfe532df476417a9a0b7d9c23aa32ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.638274  7071 raft_consensus.cc:385] T 6fa4c8b2aef94cc6afb369b911954a95 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.638743  7071 raft_consensus.cc:740] T 6fa4c8b2aef94cc6afb369b911954a95 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694ff83326940089c4a5de4f701da85, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.639055  7072 consensus_queue.cc:260] T 42af7e00d58646a6b3a58a6fe0a4d155 P 3cfe532df476417a9a0b7d9c23aa32ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.641836  7072 ts_tablet_manager.cc:1434] T 42af7e00d58646a6b3a58a6fe0a4d155 P 3cfe532df476417a9a0b7d9c23aa32ea: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:12:59.643241  7070 tablet_bootstrap.cc:654] T 42af7e00d58646a6b3a58a6fe0a4d155 P ac71a527733d4e97b26b7b7a7903045a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.643266  7072 tablet_bootstrap.cc:492] T 4bba86af07534b5db67f5c4c214a7dd3 P 3cfe532df476417a9a0b7d9c23aa32ea: Bootstrap starting.
I20260709 13:12:59.639482  7071 consensus_queue.cc:260] T 6fa4c8b2aef94cc6afb369b911954a95 P c694ff83326940089c4a5de4f701da85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.645766  7071 ts_tablet_manager.cc:1434] T 6fa4c8b2aef94cc6afb369b911954a95 P c694ff83326940089c4a5de4f701da85: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:12:59.647017  7071 tablet_bootstrap.cc:492] T 4846b2cfc1c944acb68ffc05393ce201 P c694ff83326940089c4a5de4f701da85: Bootstrap starting.
I20260709 13:12:59.650580  7072 tablet_bootstrap.cc:654] T 4bba86af07534b5db67f5c4c214a7dd3 P 3cfe532df476417a9a0b7d9c23aa32ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.655653  7071 tablet_bootstrap.cc:654] T 4846b2cfc1c944acb68ffc05393ce201 P c694ff83326940089c4a5de4f701da85: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.662406  7072 tablet_bootstrap.cc:492] T 4bba86af07534b5db67f5c4c214a7dd3 P 3cfe532df476417a9a0b7d9c23aa32ea: No bootstrap required, opened a new log
I20260709 13:12:59.662707  7057 raft_consensus.cc:493] T 6fa4c8b2aef94cc6afb369b911954a95 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.662868  7072 ts_tablet_manager.cc:1403] T 4bba86af07534b5db67f5c4c214a7dd3 P 3cfe532df476417a9a0b7d9c23aa32ea: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 13:12:59.663216  7057 raft_consensus.cc:515] T 6fa4c8b2aef94cc6afb369b911954a95 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.665835  7057 leader_election.cc:290] T 6fa4c8b2aef94cc6afb369b911954a95 P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:12:59.665913  7072 raft_consensus.cc:359] T 4bba86af07534b5db67f5c4c214a7dd3 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.666704  7072 raft_consensus.cc:385] T 4bba86af07534b5db67f5c4c214a7dd3 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.666987  7072 raft_consensus.cc:740] T 4bba86af07534b5db67f5c4c214a7dd3 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cfe532df476417a9a0b7d9c23aa32ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.667423  6923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa4c8b2aef94cc6afb369b911954a95" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac71a527733d4e97b26b7b7a7903045a" is_pre_election: true
I20260709 13:12:59.667910  7072 consensus_queue.cc:260] T 4bba86af07534b5db67f5c4c214a7dd3 P 3cfe532df476417a9a0b7d9c23aa32ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.669464  6851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa4c8b2aef94cc6afb369b911954a95" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" is_pre_election: true
I20260709 13:12:59.670094  6851 raft_consensus.cc:2468] T 6fa4c8b2aef94cc6afb369b911954a95 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694ff83326940089c4a5de4f701da85 in term 0.
W20260709 13:12:59.671475  6740 leader_election.cc:343] T 6fa4c8b2aef94cc6afb369b911954a95 P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:59.672698  7072 ts_tablet_manager.cc:1434] T 4bba86af07534b5db67f5c4c214a7dd3 P 3cfe532df476417a9a0b7d9c23aa32ea: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:12:59.672704  6741 leader_election.cc:304] T 6fa4c8b2aef94cc6afb369b911954a95 P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cfe532df476417a9a0b7d9c23aa32ea, c694ff83326940089c4a5de4f701da85; no voters: ac71a527733d4e97b26b7b7a7903045a
I20260709 13:12:59.673900  7072 tablet_bootstrap.cc:492] T bcdbcbb86a864c6eaab608b0e18a55b0 P 3cfe532df476417a9a0b7d9c23aa32ea: Bootstrap starting.
I20260709 13:12:59.674630  7071 tablet_bootstrap.cc:492] T 4846b2cfc1c944acb68ffc05393ce201 P c694ff83326940089c4a5de4f701da85: No bootstrap required, opened a new log
I20260709 13:12:59.675319  7071 ts_tablet_manager.cc:1403] T 4846b2cfc1c944acb68ffc05393ce201 P c694ff83326940089c4a5de4f701da85: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.005s
I20260709 13:12:59.679495  7057 raft_consensus.cc:2804] T 6fa4c8b2aef94cc6afb369b911954a95 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:59.679360  7071 raft_consensus.cc:359] T 4846b2cfc1c944acb68ffc05393ce201 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.680936  7057 raft_consensus.cc:493] T 6fa4c8b2aef94cc6afb369b911954a95 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.681502  7057 raft_consensus.cc:3060] T 6fa4c8b2aef94cc6afb369b911954a95 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.685500  7072 tablet_bootstrap.cc:654] T bcdbcbb86a864c6eaab608b0e18a55b0 P 3cfe532df476417a9a0b7d9c23aa32ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.680908  7071 raft_consensus.cc:385] T 4846b2cfc1c944acb68ffc05393ce201 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.688288  7071 raft_consensus.cc:740] T 4846b2cfc1c944acb68ffc05393ce201 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694ff83326940089c4a5de4f701da85, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.689272  7071 consensus_queue.cc:260] T 4846b2cfc1c944acb68ffc05393ce201 P c694ff83326940089c4a5de4f701da85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.696633  7072 tablet_bootstrap.cc:492] T bcdbcbb86a864c6eaab608b0e18a55b0 P 3cfe532df476417a9a0b7d9c23aa32ea: No bootstrap required, opened a new log
I20260709 13:12:59.697255  7072 ts_tablet_manager.cc:1403] T bcdbcbb86a864c6eaab608b0e18a55b0 P 3cfe532df476417a9a0b7d9c23aa32ea: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.003s
I20260709 13:12:59.697896  7071 ts_tablet_manager.cc:1434] T 4846b2cfc1c944acb68ffc05393ce201 P c694ff83326940089c4a5de4f701da85: Time spent starting tablet: real 0.022s	user 0.010s	sys 0.001s
I20260709 13:12:59.699259  7071 tablet_bootstrap.cc:492] T bcdbcbb86a864c6eaab608b0e18a55b0 P c694ff83326940089c4a5de4f701da85: Bootstrap starting.
I20260709 13:12:59.700280  7072 raft_consensus.cc:359] T bcdbcbb86a864c6eaab608b0e18a55b0 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.701030  7072 raft_consensus.cc:385] T bcdbcbb86a864c6eaab608b0e18a55b0 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.695118  7057 raft_consensus.cc:515] T 6fa4c8b2aef94cc6afb369b911954a95 P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.701334  7072 raft_consensus.cc:740] T bcdbcbb86a864c6eaab608b0e18a55b0 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cfe532df476417a9a0b7d9c23aa32ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.702455  7072 consensus_queue.cc:260] T bcdbcbb86a864c6eaab608b0e18a55b0 P 3cfe532df476417a9a0b7d9c23aa32ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.704907  7072 ts_tablet_manager.cc:1434] T bcdbcbb86a864c6eaab608b0e18a55b0 P 3cfe532df476417a9a0b7d9c23aa32ea: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:59.705134  6851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa4c8b2aef94cc6afb369b911954a95" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea"
I20260709 13:12:59.705938  6851 raft_consensus.cc:3060] T 6fa4c8b2aef94cc6afb369b911954a95 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.706223  7072 tablet_bootstrap.cc:492] T e0b1ea02768e411bb2b6341025336fa8 P 3cfe532df476417a9a0b7d9c23aa32ea: Bootstrap starting.
I20260709 13:12:59.702419  7008 raft_consensus.cc:493] T 42af7e00d58646a6b3a58a6fe0a4d155 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.707317  7008 raft_consensus.cc:515] T 42af7e00d58646a6b3a58a6fe0a4d155 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.709410  7008 leader_election.cc:290] T 42af7e00d58646a6b3a58a6fe0a4d155 P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:12:59.711438  6923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42af7e00d58646a6b3a58a6fe0a4d155" candidate_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac71a527733d4e97b26b7b7a7903045a" is_pre_election: true
W20260709 13:12:59.712913  6815 leader_election.cc:343] T 42af7e00d58646a6b3a58a6fe0a4d155 P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:59.713639  7072 tablet_bootstrap.cc:654] T e0b1ea02768e411bb2b6341025336fa8 P 3cfe532df476417a9a0b7d9c23aa32ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.714133  6774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42af7e00d58646a6b3a58a6fe0a4d155" candidate_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694ff83326940089c4a5de4f701da85" is_pre_election: true
I20260709 13:12:59.714818  6774 raft_consensus.cc:2468] T 42af7e00d58646a6b3a58a6fe0a4d155 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cfe532df476417a9a0b7d9c23aa32ea in term 0.
I20260709 13:12:59.716270  6817 leader_election.cc:304] T 42af7e00d58646a6b3a58a6fe0a4d155 P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cfe532df476417a9a0b7d9c23aa32ea, c694ff83326940089c4a5de4f701da85; no voters: ac71a527733d4e97b26b7b7a7903045a
I20260709 13:12:59.716737  7057 leader_election.cc:290] T 6fa4c8b2aef94cc6afb369b911954a95 P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 election: Requested vote from peers 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:12:59.718428  6923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa4c8b2aef94cc6afb369b911954a95" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac71a527733d4e97b26b7b7a7903045a"
W20260709 13:12:59.719787  6740 leader_election.cc:343] T 6fa4c8b2aef94cc6afb369b911954a95 P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:59.720273  7081 raft_consensus.cc:2804] T 42af7e00d58646a6b3a58a6fe0a4d155 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:59.720825  7081 raft_consensus.cc:493] T 42af7e00d58646a6b3a58a6fe0a4d155 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.721239  7081 raft_consensus.cc:3060] T 42af7e00d58646a6b3a58a6fe0a4d155 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.721575  7008 raft_consensus.cc:493] T 4bba86af07534b5db67f5c4c214a7dd3 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.722220  7008 raft_consensus.cc:515] T 4bba86af07534b5db67f5c4c214a7dd3 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.727720  7094 raft_consensus.cc:493] T 85b78641da93463f839211c9ecf098c1 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.728251  7094 raft_consensus.cc:515] T 85b78641da93463f839211c9ecf098c1 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.730783  7094 leader_election.cc:290] T 85b78641da93463f839211c9ecf098c1 P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:12:59.731745  6849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85b78641da93463f839211c9ecf098c1" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" is_pre_election: true
I20260709 13:12:59.732319  6923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85b78641da93463f839211c9ecf098c1" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac71a527733d4e97b26b7b7a7903045a" is_pre_election: true
I20260709 13:12:59.732402  6849 raft_consensus.cc:2468] T 85b78641da93463f839211c9ecf098c1 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694ff83326940089c4a5de4f701da85 in term 0.
I20260709 13:12:59.733057  6923 raft_consensus.cc:2468] T 85b78641da93463f839211c9ecf098c1 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694ff83326940089c4a5de4f701da85 in term 0.
I20260709 13:12:59.733561  7081 raft_consensus.cc:515] T 42af7e00d58646a6b3a58a6fe0a4d155 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.733884  6741 leader_election.cc:304] T 85b78641da93463f839211c9ecf098c1 P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cfe532df476417a9a0b7d9c23aa32ea, c694ff83326940089c4a5de4f701da85; no voters: 
I20260709 13:12:59.734880  6924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bba86af07534b5db67f5c4c214a7dd3" candidate_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac71a527733d4e97b26b7b7a7903045a" is_pre_election: true
I20260709 13:12:59.735195  7094 raft_consensus.cc:2804] T 85b78641da93463f839211c9ecf098c1 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:59.735635  7081 leader_election.cc:290] T 42af7e00d58646a6b3a58a6fe0a4d155 P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 1 election: Requested vote from peers c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:12:59.735709  7094 raft_consensus.cc:493] T 85b78641da93463f839211c9ecf098c1 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.736426  7094 raft_consensus.cc:3060] T 85b78641da93463f839211c9ecf098c1 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.737681  6924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42af7e00d58646a6b3a58a6fe0a4d155" candidate_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac71a527733d4e97b26b7b7a7903045a"
W20260709 13:12:59.736462  6815 leader_election.cc:343] T 4bba86af07534b5db67f5c4c214a7dd3 P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:59.739323  6815 leader_election.cc:343] T 42af7e00d58646a6b3a58a6fe0a4d155 P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:59.740203  7008 leader_election.cc:290] T 4bba86af07534b5db67f5c4c214a7dd3 P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:12:59.741087  7071 tablet_bootstrap.cc:654] T bcdbcbb86a864c6eaab608b0e18a55b0 P c694ff83326940089c4a5de4f701da85: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.744719  7094 raft_consensus.cc:515] T 85b78641da93463f839211c9ecf098c1 P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.745201  6851 raft_consensus.cc:2468] T 6fa4c8b2aef94cc6afb369b911954a95 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694ff83326940089c4a5de4f701da85 in term 1.
I20260709 13:12:59.747538  7072 tablet_bootstrap.cc:492] T e0b1ea02768e411bb2b6341025336fa8 P 3cfe532df476417a9a0b7d9c23aa32ea: No bootstrap required, opened a new log
I20260709 13:12:59.747720  6741 leader_election.cc:304] T 6fa4c8b2aef94cc6afb369b911954a95 P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cfe532df476417a9a0b7d9c23aa32ea, c694ff83326940089c4a5de4f701da85; no voters: ac71a527733d4e97b26b7b7a7903045a
I20260709 13:12:59.748101  7072 ts_tablet_manager.cc:1403] T e0b1ea02768e411bb2b6341025336fa8 P 3cfe532df476417a9a0b7d9c23aa32ea: Time spent bootstrapping tablet: real 0.042s	user 0.018s	sys 0.000s
I20260709 13:12:59.748947  7057 raft_consensus.cc:2804] T 6fa4c8b2aef94cc6afb369b911954a95 P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:59.749447  7057 raft_consensus.cc:697] T 6fa4c8b2aef94cc6afb369b911954a95 P c694ff83326940089c4a5de4f701da85 [term 1 LEADER]: Becoming Leader. State: Replica: c694ff83326940089c4a5de4f701da85, State: Running, Role: LEADER
I20260709 13:12:59.750519  7057 consensus_queue.cc:237] T 6fa4c8b2aef94cc6afb369b911954a95 P c694ff83326940089c4a5de4f701da85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.751387  7072 raft_consensus.cc:359] T e0b1ea02768e411bb2b6341025336fa8 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.752224  7072 raft_consensus.cc:385] T e0b1ea02768e411bb2b6341025336fa8 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.752534  7072 raft_consensus.cc:740] T e0b1ea02768e411bb2b6341025336fa8 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cfe532df476417a9a0b7d9c23aa32ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.753679  7092 raft_consensus.cc:493] T e0b1ea02768e411bb2b6341025336fa8 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.754171  7092 raft_consensus.cc:515] T e0b1ea02768e411bb2b6341025336fa8 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.754494  7072 consensus_queue.cc:260] T e0b1ea02768e411bb2b6341025336fa8 P 3cfe532df476417a9a0b7d9c23aa32ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.757429  6851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85b78641da93463f839211c9ecf098c1" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea"
I20260709 13:12:59.757838  6849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b1ea02768e411bb2b6341025336fa8" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" is_pre_election: true
I20260709 13:12:59.756170  7094 leader_election.cc:290] T 85b78641da93463f839211c9ecf098c1 P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 election: Requested vote from peers 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:12:59.758282  6923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b1ea02768e411bb2b6341025336fa8" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac71a527733d4e97b26b7b7a7903045a" is_pre_election: true
I20260709 13:12:59.758667  7072 ts_tablet_manager.cc:1434] T e0b1ea02768e411bb2b6341025336fa8 P 3cfe532df476417a9a0b7d9c23aa32ea: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:12:59.758054  6851 raft_consensus.cc:3060] T 85b78641da93463f839211c9ecf098c1 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.759748  7072 tablet_bootstrap.cc:492] T cb84490998a54a1dbf874dd9a275078a P 3cfe532df476417a9a0b7d9c23aa32ea: Bootstrap starting.
I20260709 13:12:59.760382  6924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85b78641da93463f839211c9ecf098c1" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac71a527733d4e97b26b7b7a7903045a"
I20260709 13:12:59.760968  6924 raft_consensus.cc:3060] T 85b78641da93463f839211c9ecf098c1 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:59.759662  6740 leader_election.cc:343] T e0b1ea02768e411bb2b6341025336fa8 P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:59.758512  6849 raft_consensus.cc:2468] T e0b1ea02768e411bb2b6341025336fa8 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694ff83326940089c4a5de4f701da85 in term 0.
I20260709 13:12:59.765106  6741 leader_election.cc:304] T e0b1ea02768e411bb2b6341025336fa8 P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cfe532df476417a9a0b7d9c23aa32ea, c694ff83326940089c4a5de4f701da85; no voters: ac71a527733d4e97b26b7b7a7903045a
I20260709 13:12:59.765887  7094 raft_consensus.cc:2804] T e0b1ea02768e411bb2b6341025336fa8 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:59.766242  7094 raft_consensus.cc:493] T e0b1ea02768e411bb2b6341025336fa8 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.756246  7092 leader_election.cc:290] T e0b1ea02768e411bb2b6341025336fa8 P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:12:59.766217  6851 raft_consensus.cc:2468] T 85b78641da93463f839211c9ecf098c1 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694ff83326940089c4a5de4f701da85 in term 1.
I20260709 13:12:59.767577  7094 raft_consensus.cc:3060] T e0b1ea02768e411bb2b6341025336fa8 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.768311  6741 leader_election.cc:304] T 85b78641da93463f839211c9ecf098c1 P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cfe532df476417a9a0b7d9c23aa32ea, c694ff83326940089c4a5de4f701da85; no voters: 
I20260709 13:12:59.769447  7092 raft_consensus.cc:2804] T 85b78641da93463f839211c9ecf098c1 P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:59.770011  7092 raft_consensus.cc:697] T 85b78641da93463f839211c9ecf098c1 P c694ff83326940089c4a5de4f701da85 [term 1 LEADER]: Becoming Leader. State: Replica: c694ff83326940089c4a5de4f701da85, State: Running, Role: LEADER
I20260709 13:12:59.776868  7072 tablet_bootstrap.cc:654] T cb84490998a54a1dbf874dd9a275078a P 3cfe532df476417a9a0b7d9c23aa32ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.771070  7092 consensus_queue.cc:237] T 85b78641da93463f839211c9ecf098c1 P c694ff83326940089c4a5de4f701da85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.784145  7095 raft_consensus.cc:493] T 4846b2cfc1c944acb68ffc05393ce201 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.784657  7095 raft_consensus.cc:515] T 4846b2cfc1c944acb68ffc05393ce201 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.785518  7070 tablet_bootstrap.cc:492] T 42af7e00d58646a6b3a58a6fe0a4d155 P ac71a527733d4e97b26b7b7a7903045a: No bootstrap required, opened a new log
I20260709 13:12:59.786046  7070 ts_tablet_manager.cc:1403] T 42af7e00d58646a6b3a58a6fe0a4d155 P ac71a527733d4e97b26b7b7a7903045a: Time spent bootstrapping tablet: real 0.150s	user 0.029s	sys 0.082s
I20260709 13:12:59.789104  7095 leader_election.cc:290] T 4846b2cfc1c944acb68ffc05393ce201 P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:12:59.792184  7070 raft_consensus.cc:359] T 42af7e00d58646a6b3a58a6fe0a4d155 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.792393  6923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4846b2cfc1c944acb68ffc05393ce201" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac71a527733d4e97b26b7b7a7903045a" is_pre_election: true
I20260709 13:12:59.789583  6851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4846b2cfc1c944acb68ffc05393ce201" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" is_pre_election: true
I20260709 13:12:59.793150  6923 raft_consensus.cc:2468] T 4846b2cfc1c944acb68ffc05393ce201 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694ff83326940089c4a5de4f701da85 in term 0.
I20260709 13:12:59.793571  6851 raft_consensus.cc:2468] T 4846b2cfc1c944acb68ffc05393ce201 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694ff83326940089c4a5de4f701da85 in term 0.
I20260709 13:12:59.793910  7070 raft_consensus.cc:385] T 42af7e00d58646a6b3a58a6fe0a4d155 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.794256  7070 raft_consensus.cc:740] T 42af7e00d58646a6b3a58a6fe0a4d155 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac71a527733d4e97b26b7b7a7903045a, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.798225  7071 tablet_bootstrap.cc:492] T bcdbcbb86a864c6eaab608b0e18a55b0 P c694ff83326940089c4a5de4f701da85: No bootstrap required, opened a new log
I20260709 13:12:59.798906  7071 ts_tablet_manager.cc:1403] T bcdbcbb86a864c6eaab608b0e18a55b0 P c694ff83326940089c4a5de4f701da85: Time spent bootstrapping tablet: real 0.100s	user 0.022s	sys 0.003s
I20260709 13:12:59.794374  7094 raft_consensus.cc:515] T e0b1ea02768e411bb2b6341025336fa8 P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.794389  6740 leader_election.cc:304] T 4846b2cfc1c944acb68ffc05393ce201 P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac71a527733d4e97b26b7b7a7903045a, c694ff83326940089c4a5de4f701da85; no voters: 
I20260709 13:12:59.801440  7095 raft_consensus.cc:2804] T 4846b2cfc1c944acb68ffc05393ce201 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:59.801896  7095 raft_consensus.cc:493] T 4846b2cfc1c944acb68ffc05393ce201 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.802321  7095 raft_consensus.cc:3060] T 4846b2cfc1c944acb68ffc05393ce201 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.803174  7094 leader_election.cc:290] T e0b1ea02768e411bb2b6341025336fa8 P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 election: Requested vote from peers 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:12:59.805233  6923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b1ea02768e411bb2b6341025336fa8" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac71a527733d4e97b26b7b7a7903045a"
I20260709 13:12:59.806679  6851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b1ea02768e411bb2b6341025336fa8" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea"
I20260709 13:12:59.807261  6851 raft_consensus.cc:3060] T e0b1ea02768e411bb2b6341025336fa8 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.810415  7095 raft_consensus.cc:515] T 4846b2cfc1c944acb68ffc05393ce201 P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
W20260709 13:12:59.811434  6740 leader_election.cc:343] T e0b1ea02768e411bb2b6341025336fa8 P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:59.813791  6924 raft_consensus.cc:2468] T 85b78641da93463f839211c9ecf098c1 P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694ff83326940089c4a5de4f701da85 in term 1.
I20260709 13:12:59.813982  7071 raft_consensus.cc:359] T bcdbcbb86a864c6eaab608b0e18a55b0 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.814711  7071 raft_consensus.cc:385] T bcdbcbb86a864c6eaab608b0e18a55b0 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.814996  7071 raft_consensus.cc:740] T bcdbcbb86a864c6eaab608b0e18a55b0 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694ff83326940089c4a5de4f701da85, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.815260  6851 raft_consensus.cc:2468] T e0b1ea02768e411bb2b6341025336fa8 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694ff83326940089c4a5de4f701da85 in term 1.
I20260709 13:12:59.819118  7071 consensus_queue.cc:260] T bcdbcbb86a864c6eaab608b0e18a55b0 P c694ff83326940089c4a5de4f701da85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.820888  7071 ts_tablet_manager.cc:1434] T bcdbcbb86a864c6eaab608b0e18a55b0 P c694ff83326940089c4a5de4f701da85: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:12:59.821589  7071 tablet_bootstrap.cc:492] T 4bba86af07534b5db67f5c4c214a7dd3 P c694ff83326940089c4a5de4f701da85: Bootstrap starting.
I20260709 13:12:59.823342  7096 raft_consensus.cc:493] T 94f9e4eb8fc245078a0e84fff4103dd5 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.823586  7095 leader_election.cc:290] T 4846b2cfc1c944acb68ffc05393ce201 P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 election: Requested vote from peers 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:12:59.823693  6775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bba86af07534b5db67f5c4c214a7dd3" candidate_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694ff83326940089c4a5de4f701da85" is_pre_election: true
I20260709 13:12:59.823854  7096 raft_consensus.cc:515] T 94f9e4eb8fc245078a0e84fff4103dd5 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.825485  6776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42af7e00d58646a6b3a58a6fe0a4d155" candidate_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694ff83326940089c4a5de4f701da85"
I20260709 13:12:59.826241  6776 raft_consensus.cc:3060] T 42af7e00d58646a6b3a58a6fe0a4d155 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.827564  6923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f9e4eb8fc245078a0e84fff4103dd5" candidate_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac71a527733d4e97b26b7b7a7903045a" is_pre_election: true
I20260709 13:12:59.828418  6923 raft_consensus.cc:2468] T 94f9e4eb8fc245078a0e84fff4103dd5 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cfe532df476417a9a0b7d9c23aa32ea in term 0.
I20260709 13:12:59.829581  6815 leader_election.cc:304] T 94f9e4eb8fc245078a0e84fff4103dd5 P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cfe532df476417a9a0b7d9c23aa32ea, ac71a527733d4e97b26b7b7a7903045a; no voters: 
I20260709 13:12:59.830317  7096 leader_election.cc:290] T 94f9e4eb8fc245078a0e84fff4103dd5 P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:12:59.830374  7008 raft_consensus.cc:2804] T 94f9e4eb8fc245078a0e84fff4103dd5 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:59.830966  7008 raft_consensus.cc:493] T 94f9e4eb8fc245078a0e84fff4103dd5 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.831329  7008 raft_consensus.cc:3060] T 94f9e4eb8fc245078a0e84fff4103dd5 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:59.831508  6817 leader_election.cc:343] T 4bba86af07534b5db67f5c4c214a7dd3 P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:59.819654  6741 leader_election.cc:304] T e0b1ea02768e411bb2b6341025336fa8 P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cfe532df476417a9a0b7d9c23aa32ea, c694ff83326940089c4a5de4f701da85; no voters: ac71a527733d4e97b26b7b7a7903045a
I20260709 13:12:59.831923  6773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f9e4eb8fc245078a0e84fff4103dd5" candidate_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694ff83326940089c4a5de4f701da85" is_pre_election: true
I20260709 13:12:59.832034  6817 leader_election.cc:304] T 4bba86af07534b5db67f5c4c214a7dd3 P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3cfe532df476417a9a0b7d9c23aa32ea; no voters: ac71a527733d4e97b26b7b7a7903045a, c694ff83326940089c4a5de4f701da85
I20260709 13:12:59.834534  6773 raft_consensus.cc:2468] T 94f9e4eb8fc245078a0e84fff4103dd5 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cfe532df476417a9a0b7d9c23aa32ea in term 0.
I20260709 13:12:59.836966  7070 consensus_queue.cc:260] T 42af7e00d58646a6b3a58a6fe0a4d155 P ac71a527733d4e97b26b7b7a7903045a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.841120  7070 ts_tablet_manager.cc:1434] T 42af7e00d58646a6b3a58a6fe0a4d155 P ac71a527733d4e97b26b7b7a7903045a: Time spent starting tablet: real 0.055s	user 0.000s	sys 0.009s
I20260709 13:12:59.842298  7070 tablet_bootstrap.cc:492] T e0b1ea02768e411bb2b6341025336fa8 P ac71a527733d4e97b26b7b7a7903045a: Bootstrap starting.
I20260709 13:12:59.842200  7008 raft_consensus.cc:515] T 94f9e4eb8fc245078a0e84fff4103dd5 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.838486  7072 tablet_bootstrap.cc:492] T cb84490998a54a1dbf874dd9a275078a P 3cfe532df476417a9a0b7d9c23aa32ea: No bootstrap required, opened a new log
I20260709 13:12:59.843291  7072 ts_tablet_manager.cc:1403] T cb84490998a54a1dbf874dd9a275078a P 3cfe532df476417a9a0b7d9c23aa32ea: Time spent bootstrapping tablet: real 0.084s	user 0.023s	sys 0.013s
I20260709 13:12:59.846069  7071 tablet_bootstrap.cc:654] T 4bba86af07534b5db67f5c4c214a7dd3 P c694ff83326940089c4a5de4f701da85: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.843475  6851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4846b2cfc1c944acb68ffc05393ce201" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea"
I20260709 13:12:59.846074  6923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f9e4eb8fc245078a0e84fff4103dd5" candidate_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac71a527733d4e97b26b7b7a7903045a"
I20260709 13:12:59.848268  6923 raft_consensus.cc:3060] T 94f9e4eb8fc245078a0e84fff4103dd5 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.846297  7072 raft_consensus.cc:359] T cb84490998a54a1dbf874dd9a275078a P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.849050  7072 raft_consensus.cc:385] T cb84490998a54a1dbf874dd9a275078a P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.851125  7072 raft_consensus.cc:740] T cb84490998a54a1dbf874dd9a275078a P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cfe532df476417a9a0b7d9c23aa32ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.852020  6851 raft_consensus.cc:3060] T 4846b2cfc1c944acb68ffc05393ce201 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.851918  7072 consensus_queue.cc:260] T cb84490998a54a1dbf874dd9a275078a P 3cfe532df476417a9a0b7d9c23aa32ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.854149  7072 ts_tablet_manager.cc:1434] T cb84490998a54a1dbf874dd9a275078a P 3cfe532df476417a9a0b7d9c23aa32ea: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:12:59.856266  6924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4846b2cfc1c944acb68ffc05393ce201" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac71a527733d4e97b26b7b7a7903045a"
I20260709 13:12:59.856825  7096 raft_consensus.cc:2749] T 4bba86af07534b5db67f5c4c214a7dd3 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:59.858850  6924 raft_consensus.cc:3060] T 4846b2cfc1c944acb68ffc05393ce201 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.858996  7008 leader_election.cc:290] T 94f9e4eb8fc245078a0e84fff4103dd5 P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 1 election: Requested vote from peers c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:12:59.834352  7057 raft_consensus.cc:2804] T e0b1ea02768e411bb2b6341025336fa8 P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:59.857527  7070 tablet_bootstrap.cc:654] T e0b1ea02768e411bb2b6341025336fa8 P ac71a527733d4e97b26b7b7a7903045a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.856853  6776 raft_consensus.cc:2468] T 42af7e00d58646a6b3a58a6fe0a4d155 P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cfe532df476417a9a0b7d9c23aa32ea in term 1.
I20260709 13:12:59.861501  7057 raft_consensus.cc:697] T e0b1ea02768e411bb2b6341025336fa8 P c694ff83326940089c4a5de4f701da85 [term 1 LEADER]: Becoming Leader. State: Replica: c694ff83326940089c4a5de4f701da85, State: Running, Role: LEADER
I20260709 13:12:59.862447  7057 consensus_queue.cc:237] T e0b1ea02768e411bb2b6341025336fa8 P c694ff83326940089c4a5de4f701da85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.869088  7008 raft_consensus.cc:493] T bcdbcbb86a864c6eaab608b0e18a55b0 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.869756  7008 raft_consensus.cc:515] T bcdbcbb86a864c6eaab608b0e18a55b0 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.870425  6924 raft_consensus.cc:2468] T 4846b2cfc1c944acb68ffc05393ce201 P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694ff83326940089c4a5de4f701da85 in term 1.
I20260709 13:12:59.872381  7008 leader_election.cc:290] T bcdbcbb86a864c6eaab608b0e18a55b0 P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:12:59.872864  6740 leader_election.cc:304] T 4846b2cfc1c944acb68ffc05393ce201 P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac71a527733d4e97b26b7b7a7903045a, c694ff83326940089c4a5de4f701da85; no voters: 
I20260709 13:12:59.873745  7092 raft_consensus.cc:2804] T 4846b2cfc1c944acb68ffc05393ce201 P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:59.874228  7092 raft_consensus.cc:697] T 4846b2cfc1c944acb68ffc05393ce201 P c694ff83326940089c4a5de4f701da85 [term 1 LEADER]: Becoming Leader. State: Replica: c694ff83326940089c4a5de4f701da85, State: Running, Role: LEADER
I20260709 13:12:59.875033  7092 consensus_queue.cc:237] T 4846b2cfc1c944acb68ffc05393ce201 P c694ff83326940089c4a5de4f701da85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.875327  6817 leader_election.cc:304] T 42af7e00d58646a6b3a58a6fe0a4d155 P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3cfe532df476417a9a0b7d9c23aa32ea, c694ff83326940089c4a5de4f701da85; no voters: ac71a527733d4e97b26b7b7a7903045a
I20260709 13:12:59.875741  6924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdbcbb86a864c6eaab608b0e18a55b0" candidate_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac71a527733d4e97b26b7b7a7903045a" is_pre_election: true
I20260709 13:12:59.876801  6924 raft_consensus.cc:2468] T bcdbcbb86a864c6eaab608b0e18a55b0 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cfe532df476417a9a0b7d9c23aa32ea in term 0.
I20260709 13:12:59.875383  7070 tablet_bootstrap.cc:492] T e0b1ea02768e411bb2b6341025336fa8 P ac71a527733d4e97b26b7b7a7903045a: No bootstrap required, opened a new log
I20260709 13:12:59.877619  7070 ts_tablet_manager.cc:1403] T e0b1ea02768e411bb2b6341025336fa8 P ac71a527733d4e97b26b7b7a7903045a: Time spent bootstrapping tablet: real 0.036s	user 0.008s	sys 0.005s
I20260709 13:12:59.879902  7070 raft_consensus.cc:359] T e0b1ea02768e411bb2b6341025336fa8 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.880460  7096 raft_consensus.cc:2804] T 42af7e00d58646a6b3a58a6fe0a4d155 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:59.881299  6815 leader_election.cc:304] T bcdbcbb86a864c6eaab608b0e18a55b0 P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cfe532df476417a9a0b7d9c23aa32ea, ac71a527733d4e97b26b7b7a7903045a; no voters: 
I20260709 13:12:59.883363  7081 raft_consensus.cc:2804] T bcdbcbb86a864c6eaab608b0e18a55b0 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:59.883831  7081 raft_consensus.cc:493] T bcdbcbb86a864c6eaab608b0e18a55b0 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.884135  7070 raft_consensus.cc:385] T e0b1ea02768e411bb2b6341025336fa8 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.884289  7081 raft_consensus.cc:3060] T bcdbcbb86a864c6eaab608b0e18a55b0 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.885496  7070 raft_consensus.cc:740] T e0b1ea02768e411bb2b6341025336fa8 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac71a527733d4e97b26b7b7a7903045a, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.886677  7070 consensus_queue.cc:260] T e0b1ea02768e411bb2b6341025336fa8 P ac71a527733d4e97b26b7b7a7903045a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.888165  6773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdbcbb86a864c6eaab608b0e18a55b0" candidate_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694ff83326940089c4a5de4f701da85" is_pre_election: true
I20260709 13:12:59.888953  6773 raft_consensus.cc:2468] T bcdbcbb86a864c6eaab608b0e18a55b0 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3cfe532df476417a9a0b7d9c23aa32ea in term 0.
I20260709 13:12:59.891009  7070 ts_tablet_manager.cc:1434] T e0b1ea02768e411bb2b6341025336fa8 P ac71a527733d4e97b26b7b7a7903045a: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:12:59.893630  7070 tablet_bootstrap.cc:492] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a: Bootstrap starting.
I20260709 13:12:59.894169  7081 raft_consensus.cc:515] T bcdbcbb86a864c6eaab608b0e18a55b0 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.898402  6924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdbcbb86a864c6eaab608b0e18a55b0" candidate_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac71a527733d4e97b26b7b7a7903045a"
I20260709 13:12:59.899158  6924 raft_consensus.cc:3060] T bcdbcbb86a864c6eaab608b0e18a55b0 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.909157  6774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdbcbb86a864c6eaab608b0e18a55b0" candidate_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694ff83326940089c4a5de4f701da85"
I20260709 13:12:59.909875  6774 raft_consensus.cc:3060] T bcdbcbb86a864c6eaab608b0e18a55b0 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.912174  6776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f9e4eb8fc245078a0e84fff4103dd5" candidate_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694ff83326940089c4a5de4f701da85"
I20260709 13:12:59.912807  6776 raft_consensus.cc:3060] T 94f9e4eb8fc245078a0e84fff4103dd5 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.879921  6923 raft_consensus.cc:2468] T 94f9e4eb8fc245078a0e84fff4103dd5 P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cfe532df476417a9a0b7d9c23aa32ea in term 1.
I20260709 13:12:59.914505  6815 leader_election.cc:304] T 94f9e4eb8fc245078a0e84fff4103dd5 P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cfe532df476417a9a0b7d9c23aa32ea, ac71a527733d4e97b26b7b7a7903045a; no voters: 
I20260709 13:12:59.917838  7106 raft_consensus.cc:2804] T 94f9e4eb8fc245078a0e84fff4103dd5 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:59.918484  6774 raft_consensus.cc:2468] T bcdbcbb86a864c6eaab608b0e18a55b0 P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cfe532df476417a9a0b7d9c23aa32ea in term 1.
I20260709 13:12:59.919893  7096 raft_consensus.cc:697] T 42af7e00d58646a6b3a58a6fe0a4d155 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 LEADER]: Becoming Leader. State: Replica: 3cfe532df476417a9a0b7d9c23aa32ea, State: Running, Role: LEADER
I20260709 13:12:59.919909  6817 leader_election.cc:304] T bcdbcbb86a864c6eaab608b0e18a55b0 P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cfe532df476417a9a0b7d9c23aa32ea, c694ff83326940089c4a5de4f701da85; no voters: 
I20260709 13:12:59.920889  7096 consensus_queue.cc:237] T 42af7e00d58646a6b3a58a6fe0a4d155 P 3cfe532df476417a9a0b7d9c23aa32ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.921911  7008 raft_consensus.cc:2804] T bcdbcbb86a864c6eaab608b0e18a55b0 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:59.922349  7071 tablet_bootstrap.cc:492] T 4bba86af07534b5db67f5c4c214a7dd3 P c694ff83326940089c4a5de4f701da85: No bootstrap required, opened a new log
I20260709 13:12:59.919163  7081 leader_election.cc:290] T bcdbcbb86a864c6eaab608b0e18a55b0 P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 1 election: Requested vote from peers c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:12:59.922868  7071 ts_tablet_manager.cc:1403] T 4bba86af07534b5db67f5c4c214a7dd3 P c694ff83326940089c4a5de4f701da85: Time spent bootstrapping tablet: real 0.101s	user 0.037s	sys 0.025s
I20260709 13:12:59.916026  6851 raft_consensus.cc:2468] T 4846b2cfc1c944acb68ffc05393ce201 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694ff83326940089c4a5de4f701da85 in term 1.
I20260709 13:12:59.925094  7070 tablet_bootstrap.cc:654] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.925292  6776 raft_consensus.cc:2468] T 94f9e4eb8fc245078a0e84fff4103dd5 P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cfe532df476417a9a0b7d9c23aa32ea in term 1.
I20260709 13:12:59.925544  7071 raft_consensus.cc:359] T 4bba86af07534b5db67f5c4c214a7dd3 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.926245  7071 raft_consensus.cc:385] T 4bba86af07534b5db67f5c4c214a7dd3 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.926497  7071 raft_consensus.cc:740] T 4bba86af07534b5db67f5c4c214a7dd3 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c694ff83326940089c4a5de4f701da85, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.927136  7071 consensus_queue.cc:260] T 4bba86af07534b5db67f5c4c214a7dd3 P c694ff83326940089c4a5de4f701da85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.927740  7008 raft_consensus.cc:697] T bcdbcbb86a864c6eaab608b0e18a55b0 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 LEADER]: Becoming Leader. State: Replica: 3cfe532df476417a9a0b7d9c23aa32ea, State: Running, Role: LEADER
I20260709 13:12:59.928648  7008 consensus_queue.cc:237] T bcdbcbb86a864c6eaab608b0e18a55b0 P 3cfe532df476417a9a0b7d9c23aa32ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.929388  7071 ts_tablet_manager.cc:1434] T 4bba86af07534b5db67f5c4c214a7dd3 P c694ff83326940089c4a5de4f701da85: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:12:59.934645  6924 raft_consensus.cc:2468] T bcdbcbb86a864c6eaab608b0e18a55b0 P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cfe532df476417a9a0b7d9c23aa32ea in term 1.
I20260709 13:12:59.934738  7070 tablet_bootstrap.cc:492] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a: No bootstrap required, opened a new log
I20260709 13:12:59.934386  6672 catalog_manager.cc:5697] T 6fa4c8b2aef94cc6afb369b911954a95 P c694ff83326940089c4a5de4f701da85 reported cstate change: term changed from 0 to 1, leader changed from <none> to c694ff83326940089c4a5de4f701da85 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "c694ff83326940089c4a5de4f701da85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:59.918553  7106 raft_consensus.cc:697] T 94f9e4eb8fc245078a0e84fff4103dd5 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 LEADER]: Becoming Leader. State: Replica: 3cfe532df476417a9a0b7d9c23aa32ea, State: Running, Role: LEADER
I20260709 13:12:59.935353  7070 ts_tablet_manager.cc:1403] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.001s
I20260709 13:12:59.935976  6672 catalog_manager.cc:5697] T 85b78641da93463f839211c9ecf098c1 P c694ff83326940089c4a5de4f701da85 reported cstate change: term changed from 0 to 1, leader changed from <none> to c694ff83326940089c4a5de4f701da85 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "c694ff83326940089c4a5de4f701da85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:59.936106  7106 consensus_queue.cc:237] T 94f9e4eb8fc245078a0e84fff4103dd5 P 3cfe532df476417a9a0b7d9c23aa32ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.937960  6672 catalog_manager.cc:5697] T 4846b2cfc1c944acb68ffc05393ce201 P c694ff83326940089c4a5de4f701da85 reported cstate change: term changed from 0 to 1, leader changed from <none> to c694ff83326940089c4a5de4f701da85 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "c694ff83326940089c4a5de4f701da85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:59.938470  7070 raft_consensus.cc:359] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.939364  7070 raft_consensus.cc:385] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.939052  6672 catalog_manager.cc:5697] T e0b1ea02768e411bb2b6341025336fa8 P c694ff83326940089c4a5de4f701da85 reported cstate change: term changed from 0 to 1, leader changed from <none> to c694ff83326940089c4a5de4f701da85 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "c694ff83326940089c4a5de4f701da85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:59.939713  7070 raft_consensus.cc:740] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac71a527733d4e97b26b7b7a7903045a, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.940686  7070 consensus_queue.cc:260] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.943310  7070 ts_tablet_manager.cc:1434] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:59.944423  7070 tablet_bootstrap.cc:492] T 4bba86af07534b5db67f5c4c214a7dd3 P ac71a527733d4e97b26b7b7a7903045a: Bootstrap starting.
I20260709 13:12:59.948700  7070 tablet_bootstrap.cc:654] T 4bba86af07534b5db67f5c4c214a7dd3 P ac71a527733d4e97b26b7b7a7903045a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.960384  7070 tablet_bootstrap.cc:492] T 4bba86af07534b5db67f5c4c214a7dd3 P ac71a527733d4e97b26b7b7a7903045a: No bootstrap required, opened a new log
I20260709 13:12:59.960809  7070 ts_tablet_manager.cc:1403] T 4bba86af07534b5db67f5c4c214a7dd3 P ac71a527733d4e97b26b7b7a7903045a: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.003s
I20260709 13:12:59.963271  7070 raft_consensus.cc:359] T 4bba86af07534b5db67f5c4c214a7dd3 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.963903  7070 raft_consensus.cc:385] T 4bba86af07534b5db67f5c4c214a7dd3 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.964154  7070 raft_consensus.cc:740] T 4bba86af07534b5db67f5c4c214a7dd3 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac71a527733d4e97b26b7b7a7903045a, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.964795  7070 consensus_queue.cc:260] T 4bba86af07534b5db67f5c4c214a7dd3 P ac71a527733d4e97b26b7b7a7903045a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.965741  6671 catalog_manager.cc:5697] T 42af7e00d58646a6b3a58a6fe0a4d155 P 3cfe532df476417a9a0b7d9c23aa32ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2). New cstate: current_term: 1 leader_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:59.967890  7070 ts_tablet_manager.cc:1434] T 4bba86af07534b5db67f5c4c214a7dd3 P ac71a527733d4e97b26b7b7a7903045a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:12:59.968487  6671 catalog_manager.cc:5697] T bcdbcbb86a864c6eaab608b0e18a55b0 P 3cfe532df476417a9a0b7d9c23aa32ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2). New cstate: current_term: 1 leader_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:59.969743  7070 tablet_bootstrap.cc:492] T 6fa4c8b2aef94cc6afb369b911954a95 P ac71a527733d4e97b26b7b7a7903045a: Bootstrap starting.
I20260709 13:12:59.969732  6671 catalog_manager.cc:5697] T 94f9e4eb8fc245078a0e84fff4103dd5 P 3cfe532df476417a9a0b7d9c23aa32ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2). New cstate: current_term: 1 leader_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:59.979375  7070 tablet_bootstrap.cc:654] T 6fa4c8b2aef94cc6afb369b911954a95 P ac71a527733d4e97b26b7b7a7903045a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.984278  7070 tablet_bootstrap.cc:492] T 6fa4c8b2aef94cc6afb369b911954a95 P ac71a527733d4e97b26b7b7a7903045a: No bootstrap required, opened a new log
I20260709 13:12:59.984727  7070 ts_tablet_manager.cc:1403] T 6fa4c8b2aef94cc6afb369b911954a95 P ac71a527733d4e97b26b7b7a7903045a: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:12:59.987263  7070 raft_consensus.cc:359] T 6fa4c8b2aef94cc6afb369b911954a95 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.987921  7070 raft_consensus.cc:385] T 6fa4c8b2aef94cc6afb369b911954a95 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.988090  7070 raft_consensus.cc:740] T 6fa4c8b2aef94cc6afb369b911954a95 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac71a527733d4e97b26b7b7a7903045a, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.988610  7070 consensus_queue.cc:260] T 6fa4c8b2aef94cc6afb369b911954a95 P ac71a527733d4e97b26b7b7a7903045a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:12:59.991429  7070 ts_tablet_manager.cc:1434] T 6fa4c8b2aef94cc6afb369b911954a95 P ac71a527733d4e97b26b7b7a7903045a: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:13:00.015520  7117 raft_consensus.cc:493] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.016027  7117 raft_consensus.cc:515] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:13:00.018052  7117 leader_election.cc:290] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303), 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907)
I20260709 13:13:00.018913  6776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb84490998a54a1dbf874dd9a275078a" candidate_uuid: "ac71a527733d4e97b26b7b7a7903045a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694ff83326940089c4a5de4f701da85" is_pre_election: true
I20260709 13:13:00.019141  6851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb84490998a54a1dbf874dd9a275078a" candidate_uuid: "ac71a527733d4e97b26b7b7a7903045a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" is_pre_election: true
I20260709 13:13:00.019527  6776 raft_consensus.cc:2468] T cb84490998a54a1dbf874dd9a275078a P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac71a527733d4e97b26b7b7a7903045a in term 0.
I20260709 13:13:00.019858  6851 raft_consensus.cc:2468] T cb84490998a54a1dbf874dd9a275078a P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac71a527733d4e97b26b7b7a7903045a in term 0.
I20260709 13:13:00.020673  6891 leader_election.cc:304] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac71a527733d4e97b26b7b7a7903045a, c694ff83326940089c4a5de4f701da85; no voters: 
I20260709 13:13:00.021458  7117 raft_consensus.cc:2804] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:00.021821  7117 raft_consensus.cc:493] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:00.022146  7117 raft_consensus.cc:3060] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:00.027168  7117 raft_consensus.cc:515] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:13:00.028805  7117 leader_election.cc:290] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a [CANDIDATE]: Term 1 election: Requested vote from peers c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303), 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907)
I20260709 13:13:00.029350  6776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb84490998a54a1dbf874dd9a275078a" candidate_uuid: "ac71a527733d4e97b26b7b7a7903045a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694ff83326940089c4a5de4f701da85"
I20260709 13:13:00.029824  6851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb84490998a54a1dbf874dd9a275078a" candidate_uuid: "ac71a527733d4e97b26b7b7a7903045a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea"
I20260709 13:13:00.029917  6776 raft_consensus.cc:3060] T cb84490998a54a1dbf874dd9a275078a P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:00.030367  6851 raft_consensus.cc:3060] T cb84490998a54a1dbf874dd9a275078a P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:00.035300  6851 raft_consensus.cc:2468] T cb84490998a54a1dbf874dd9a275078a P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac71a527733d4e97b26b7b7a7903045a in term 1.
I20260709 13:13:00.036078  6776 raft_consensus.cc:2468] T cb84490998a54a1dbf874dd9a275078a P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac71a527733d4e97b26b7b7a7903045a in term 1.
I20260709 13:13:00.036252  6890 leader_election.cc:304] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cfe532df476417a9a0b7d9c23aa32ea, ac71a527733d4e97b26b7b7a7903045a; no voters: 
I20260709 13:13:00.037119  7117 raft_consensus.cc:2804] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:00.037518  7117 raft_consensus.cc:697] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a [term 1 LEADER]: Becoming Leader. State: Replica: ac71a527733d4e97b26b7b7a7903045a, State: Running, Role: LEADER
I20260709 13:13:00.038166  7117 consensus_queue.cc:237] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:13:00.046587  6670 catalog_manager.cc:5697] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a reported cstate change: term changed from 0 to 1, leader changed from <none> to ac71a527733d4e97b26b7b7a7903045a (127.28.173.3). New cstate: current_term: 1 leader_uuid: "ac71a527733d4e97b26b7b7a7903045a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:00.127100  7117 raft_consensus.cc:493] T 42af7e00d58646a6b3a58a6fe0a4d155 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.127683  7117 raft_consensus.cc:515] T 42af7e00d58646a6b3a58a6fe0a4d155 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:13:00.129573  7117 leader_election.cc:290] T 42af7e00d58646a6b3a58a6fe0a4d155 P ac71a527733d4e97b26b7b7a7903045a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303), 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907)
I20260709 13:13:00.130254  6776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42af7e00d58646a6b3a58a6fe0a4d155" candidate_uuid: "ac71a527733d4e97b26b7b7a7903045a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694ff83326940089c4a5de4f701da85" is_pre_election: true
I20260709 13:13:00.130455  6851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42af7e00d58646a6b3a58a6fe0a4d155" candidate_uuid: "ac71a527733d4e97b26b7b7a7903045a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" is_pre_election: true
I20260709 13:13:00.131008  6776 raft_consensus.cc:2393] T 42af7e00d58646a6b3a58a6fe0a4d155 P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac71a527733d4e97b26b7b7a7903045a in current term 1: Already voted for candidate 3cfe532df476417a9a0b7d9c23aa32ea in this term.
I20260709 13:13:00.132155  6891 leader_election.cc:304] T 42af7e00d58646a6b3a58a6fe0a4d155 P ac71a527733d4e97b26b7b7a7903045a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac71a527733d4e97b26b7b7a7903045a; no voters: 3cfe532df476417a9a0b7d9c23aa32ea, c694ff83326940089c4a5de4f701da85
I20260709 13:13:00.132817  7117 raft_consensus.cc:3060] T 42af7e00d58646a6b3a58a6fe0a4d155 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:00.137962  7117 raft_consensus.cc:2749] T 42af7e00d58646a6b3a58a6fe0a4d155 P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:00.167013  7117 raft_consensus.cc:493] T e0b1ea02768e411bb2b6341025336fa8 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.167531  7117 raft_consensus.cc:515] T e0b1ea02768e411bb2b6341025336fa8 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:13:00.169540  7117 leader_election.cc:290] T e0b1ea02768e411bb2b6341025336fa8 P ac71a527733d4e97b26b7b7a7903045a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303), 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907)
I20260709 13:13:00.170337  6776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b1ea02768e411bb2b6341025336fa8" candidate_uuid: "ac71a527733d4e97b26b7b7a7903045a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c694ff83326940089c4a5de4f701da85" is_pre_election: true
I20260709 13:13:00.171087  6851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b1ea02768e411bb2b6341025336fa8" candidate_uuid: "ac71a527733d4e97b26b7b7a7903045a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" is_pre_election: true
I20260709 13:13:00.171868  6851 raft_consensus.cc:2393] T e0b1ea02768e411bb2b6341025336fa8 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ac71a527733d4e97b26b7b7a7903045a in current term 1: Already voted for candidate c694ff83326940089c4a5de4f701da85 in this term.
I20260709 13:13:00.172845  6890 leader_election.cc:304] T e0b1ea02768e411bb2b6341025336fa8 P ac71a527733d4e97b26b7b7a7903045a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac71a527733d4e97b26b7b7a7903045a; no voters: 3cfe532df476417a9a0b7d9c23aa32ea, c694ff83326940089c4a5de4f701da85
I20260709 13:13:00.173596  7117 raft_consensus.cc:3060] T e0b1ea02768e411bb2b6341025336fa8 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:00.178519  7117 raft_consensus.cc:2749] T e0b1ea02768e411bb2b6341025336fa8 P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:00.225113  7092 consensus_queue.cc:1048] T 6fa4c8b2aef94cc6afb369b911954a95 P c694ff83326940089c4a5de4f701da85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:00.235052  6924 raft_consensus.cc:3060] T 6fa4c8b2aef94cc6afb369b911954a95 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:00.245514  7095 consensus_queue.cc:1048] T 6fa4c8b2aef94cc6afb369b911954a95 P c694ff83326940089c4a5de4f701da85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:00.258752  7095 raft_consensus.cc:493] T 4bba86af07534b5db67f5c4c214a7dd3 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.259171  7095 raft_consensus.cc:515] T 4bba86af07534b5db67f5c4c214a7dd3 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:13:00.260917  7095 leader_election.cc:290] T 4bba86af07534b5db67f5c4c214a7dd3 P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:13:00.261507  6851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bba86af07534b5db67f5c4c214a7dd3" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" is_pre_election: true
I20260709 13:13:00.261781  6924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bba86af07534b5db67f5c4c214a7dd3" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac71a527733d4e97b26b7b7a7903045a" is_pre_election: true
I20260709 13:13:00.262049  6851 raft_consensus.cc:2468] T 4bba86af07534b5db67f5c4c214a7dd3 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694ff83326940089c4a5de4f701da85 in term 0.
I20260709 13:13:00.262428  6924 raft_consensus.cc:2468] T 4bba86af07534b5db67f5c4c214a7dd3 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c694ff83326940089c4a5de4f701da85 in term 0.
I20260709 13:13:00.262970  6741 leader_election.cc:304] T 4bba86af07534b5db67f5c4c214a7dd3 P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cfe532df476417a9a0b7d9c23aa32ea, c694ff83326940089c4a5de4f701da85; no voters: 
I20260709 13:13:00.263656  7095 raft_consensus.cc:2804] T 4bba86af07534b5db67f5c4c214a7dd3 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:00.264070  7095 raft_consensus.cc:493] T 4bba86af07534b5db67f5c4c214a7dd3 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:00.264345  7095 raft_consensus.cc:3060] T 4bba86af07534b5db67f5c4c214a7dd3 P c694ff83326940089c4a5de4f701da85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:00.269358  7095 raft_consensus.cc:515] T 4bba86af07534b5db67f5c4c214a7dd3 P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:13:00.270913  7095 leader_election.cc:290] T 4bba86af07534b5db67f5c4c214a7dd3 P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 election: Requested vote from peers 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:13:00.271466  6851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bba86af07534b5db67f5c4c214a7dd3" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea"
I20260709 13:13:00.271951  6851 raft_consensus.cc:3060] T 4bba86af07534b5db67f5c4c214a7dd3 P 3cfe532df476417a9a0b7d9c23aa32ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:00.271878  6924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bba86af07534b5db67f5c4c214a7dd3" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac71a527733d4e97b26b7b7a7903045a"
I20260709 13:13:00.272483  6924 raft_consensus.cc:3060] T 4bba86af07534b5db67f5c4c214a7dd3 P ac71a527733d4e97b26b7b7a7903045a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:00.276187  6851 raft_consensus.cc:2468] T 4bba86af07534b5db67f5c4c214a7dd3 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694ff83326940089c4a5de4f701da85 in term 1.
I20260709 13:13:00.277174  6741 leader_election.cc:304] T 4bba86af07534b5db67f5c4c214a7dd3 P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cfe532df476417a9a0b7d9c23aa32ea, c694ff83326940089c4a5de4f701da85; no voters: 
I20260709 13:13:00.278021  7095 raft_consensus.cc:2804] T 4bba86af07534b5db67f5c4c214a7dd3 P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:00.279130  6924 raft_consensus.cc:2468] T 4bba86af07534b5db67f5c4c214a7dd3 P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694ff83326940089c4a5de4f701da85 in term 1.
I20260709 13:13:00.278765  7095 raft_consensus.cc:697] T 4bba86af07534b5db67f5c4c214a7dd3 P c694ff83326940089c4a5de4f701da85 [term 1 LEADER]: Becoming Leader. State: Replica: c694ff83326940089c4a5de4f701da85, State: Running, Role: LEADER
I20260709 13:13:00.280766  7095 consensus_queue.cc:237] T 4bba86af07534b5db67f5c4c214a7dd3 P c694ff83326940089c4a5de4f701da85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:13:00.281741  7092 consensus_queue.cc:1048] T 85b78641da93463f839211c9ecf098c1 P c694ff83326940089c4a5de4f701da85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:00.290628  6671 catalog_manager.cc:5697] T 4bba86af07534b5db67f5c4c214a7dd3 P c694ff83326940089c4a5de4f701da85 reported cstate change: term changed from 0 to 1, leader changed from <none> to c694ff83326940089c4a5de4f701da85 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "c694ff83326940089c4a5de4f701da85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:00.295228  7095 consensus_queue.cc:1048] T 85b78641da93463f839211c9ecf098c1 P c694ff83326940089c4a5de4f701da85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:00.312482  7106 consensus_queue.cc:1048] T 42af7e00d58646a6b3a58a6fe0a4d155 P 3cfe532df476417a9a0b7d9c23aa32ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:00.322604  7008 consensus_queue.cc:1048] T 42af7e00d58646a6b3a58a6fe0a4d155 P 3cfe532df476417a9a0b7d9c23aa32ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:00.394807  7095 consensus_queue.cc:1048] T 4846b2cfc1c944acb68ffc05393ce201 P c694ff83326940089c4a5de4f701da85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:00.406243  7094 consensus_queue.cc:1048] T e0b1ea02768e411bb2b6341025336fa8 P c694ff83326940089c4a5de4f701da85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:00.406706  7095 consensus_queue.cc:1048] T 4846b2cfc1c944acb68ffc05393ce201 P c694ff83326940089c4a5de4f701da85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:00.406773  7008 consensus_queue.cc:1048] T bcdbcbb86a864c6eaab608b0e18a55b0 P 3cfe532df476417a9a0b7d9c23aa32ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:00.413647  7095 consensus_queue.cc:1048] T e0b1ea02768e411bb2b6341025336fa8 P c694ff83326940089c4a5de4f701da85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:00.441805  7008 consensus_queue.cc:1048] T bcdbcbb86a864c6eaab608b0e18a55b0 P 3cfe532df476417a9a0b7d9c23aa32ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:00.495352  7117 consensus_queue.cc:1048] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:00.502269  6851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bcdbcbb86a864c6eaab608b0e18a55b0"
dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea"
mode: GRACEFUL
new_leader_uuid: "c694ff83326940089c4a5de4f701da85"
 from {username='slave'} at 127.0.0.1:33802
I20260709 13:13:00.507834  6851 raft_consensus.cc:606] T bcdbcbb86a864c6eaab608b0e18a55b0 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 LEADER]: Received request to transfer leadership to TS c694ff83326940089c4a5de4f701da85
I20260709 13:13:00.509291  7059 consensus_queue.cc:1048] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:00.513898  6851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94f9e4eb8fc245078a0e84fff4103dd5"
dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea"
mode: GRACEFUL
new_leader_uuid: "c694ff83326940089c4a5de4f701da85"
 from {username='slave'} at 127.0.0.1:33802
I20260709 13:13:00.514545  6851 raft_consensus.cc:606] T 94f9e4eb8fc245078a0e84fff4103dd5 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 LEADER]: Received request to transfer leadership to TS c694ff83326940089c4a5de4f701da85
I20260709 13:13:00.525417  6924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb84490998a54a1dbf874dd9a275078a"
dest_uuid: "ac71a527733d4e97b26b7b7a7903045a"
mode: GRACEFUL
new_leader_uuid: "3cfe532df476417a9a0b7d9c23aa32ea"
 from {username='slave'} at 127.0.0.1:33648
I20260709 13:13:00.526000  6924 raft_consensus.cc:606] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a [term 1 LEADER]: Received request to transfer leadership to TS 3cfe532df476417a9a0b7d9c23aa32ea
I20260709 13:13:00.535622  6776 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0b1ea02768e411bb2b6341025336fa8"
dest_uuid: "c694ff83326940089c4a5de4f701da85"
mode: GRACEFUL
new_leader_uuid: "3cfe532df476417a9a0b7d9c23aa32ea"
 from {username='slave'} at 127.0.0.1:45134
I20260709 13:13:00.536279  6776 raft_consensus.cc:606] T e0b1ea02768e411bb2b6341025336fa8 P c694ff83326940089c4a5de4f701da85 [term 1 LEADER]: Received request to transfer leadership to TS 3cfe532df476417a9a0b7d9c23aa32ea
I20260709 13:13:00.538486  7008 consensus_queue.cc:1048] T 94f9e4eb8fc245078a0e84fff4103dd5 P 3cfe532df476417a9a0b7d9c23aa32ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:00.544916  6776 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4bba86af07534b5db67f5c4c214a7dd3"
dest_uuid: "c694ff83326940089c4a5de4f701da85"
mode: GRACEFUL
new_leader_uuid: "3cfe532df476417a9a0b7d9c23aa32ea"
 from {username='slave'} at 127.0.0.1:45134
I20260709 13:13:00.545485  6776 raft_consensus.cc:606] T 4bba86af07534b5db67f5c4c214a7dd3 P c694ff83326940089c4a5de4f701da85 [term 1 LEADER]: Received request to transfer leadership to TS 3cfe532df476417a9a0b7d9c23aa32ea
I20260709 13:13:00.553843  7139 consensus_queue.cc:1048] T 94f9e4eb8fc245078a0e84fff4103dd5 P 3cfe532df476417a9a0b7d9c23aa32ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:00.555529  6776 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4846b2cfc1c944acb68ffc05393ce201"
dest_uuid: "c694ff83326940089c4a5de4f701da85"
mode: GRACEFUL
new_leader_uuid: "ac71a527733d4e97b26b7b7a7903045a"
 from {username='slave'} at 127.0.0.1:45134
I20260709 13:13:00.556196  6776 raft_consensus.cc:606] T 4846b2cfc1c944acb68ffc05393ce201 P c694ff83326940089c4a5de4f701da85 [term 1 LEADER]: Received request to transfer leadership to TS ac71a527733d4e97b26b7b7a7903045a
I20260709 13:13:00.561193  7096 raft_consensus.cc:993] T 94f9e4eb8fc245078a0e84fff4103dd5 P 3cfe532df476417a9a0b7d9c23aa32ea: : Instructing follower c694ff83326940089c4a5de4f701da85 to start an election
I20260709 13:13:00.561652  7139 raft_consensus.cc:1081] T 94f9e4eb8fc245078a0e84fff4103dd5 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 LEADER]: Signalling peer c694ff83326940089c4a5de4f701da85 to start an election
I20260709 13:13:00.563302  6774 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "94f9e4eb8fc245078a0e84fff4103dd5"
dest_uuid: "c694ff83326940089c4a5de4f701da85"
 from {username='slave'} at 127.0.0.1:45132
I20260709 13:13:00.563746  6774 raft_consensus.cc:493] T 94f9e4eb8fc245078a0e84fff4103dd5 P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:00.564083  6774 raft_consensus.cc:3060] T 94f9e4eb8fc245078a0e84fff4103dd5 P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.569584  6774 raft_consensus.cc:515] T 94f9e4eb8fc245078a0e84fff4103dd5 P c694ff83326940089c4a5de4f701da85 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:13:00.571789  6774 leader_election.cc:290] T 94f9e4eb8fc245078a0e84fff4103dd5 P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 2 election: Requested vote from peers 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:13:00.572059  6851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f9e4eb8fc245078a0e84fff4103dd5" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea"
I20260709 13:13:00.572373  6924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94f9e4eb8fc245078a0e84fff4103dd5" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ac71a527733d4e97b26b7b7a7903045a"
I20260709 13:13:00.572691  6851 raft_consensus.cc:3055] T 94f9e4eb8fc245078a0e84fff4103dd5 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:00.572940  6924 raft_consensus.cc:3060] T 94f9e4eb8fc245078a0e84fff4103dd5 P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.573015  6851 raft_consensus.cc:740] T 94f9e4eb8fc245078a0e84fff4103dd5 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3cfe532df476417a9a0b7d9c23aa32ea, State: Running, Role: LEADER
I20260709 13:13:00.573844  6851 consensus_queue.cc:260] T 94f9e4eb8fc245078a0e84fff4103dd5 P 3cfe532df476417a9a0b7d9c23aa32ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:13:00.574980  6851 raft_consensus.cc:3060] T 94f9e4eb8fc245078a0e84fff4103dd5 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.579846  6924 raft_consensus.cc:2468] T 94f9e4eb8fc245078a0e84fff4103dd5 P ac71a527733d4e97b26b7b7a7903045a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694ff83326940089c4a5de4f701da85 in term 2.
I20260709 13:13:00.581034  6740 leader_election.cc:304] T 94f9e4eb8fc245078a0e84fff4103dd5 P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac71a527733d4e97b26b7b7a7903045a, c694ff83326940089c4a5de4f701da85; no voters: 
I20260709 13:13:00.581359  6851 raft_consensus.cc:2468] T 94f9e4eb8fc245078a0e84fff4103dd5 P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694ff83326940089c4a5de4f701da85 in term 2.
I20260709 13:13:00.581718  7094 raft_consensus.cc:2804] T 94f9e4eb8fc245078a0e84fff4103dd5 P c694ff83326940089c4a5de4f701da85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:00.582226  7094 raft_consensus.cc:697] T 94f9e4eb8fc245078a0e84fff4103dd5 P c694ff83326940089c4a5de4f701da85 [term 2 LEADER]: Becoming Leader. State: Replica: c694ff83326940089c4a5de4f701da85, State: Running, Role: LEADER
I20260709 13:13:00.583016  7094 consensus_queue.cc:237] T 94f9e4eb8fc245078a0e84fff4103dd5 P c694ff83326940089c4a5de4f701da85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:13:00.589459  6670 catalog_manager.cc:5697] T 94f9e4eb8fc245078a0e84fff4103dd5 P c694ff83326940089c4a5de4f701da85 reported cstate change: term changed from 1 to 2, leader changed from 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2) to c694ff83326940089c4a5de4f701da85 (127.28.173.1). New cstate: current_term: 2 leader_uuid: "c694ff83326940089c4a5de4f701da85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:00.681524  7094 consensus_queue.cc:1048] T 4bba86af07534b5db67f5c4c214a7dd3 P c694ff83326940089c4a5de4f701da85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:00.692098  7095 consensus_queue.cc:1048] T 4bba86af07534b5db67f5c4c214a7dd3 P c694ff83326940089c4a5de4f701da85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:00.701086  7095 raft_consensus.cc:993] T 4bba86af07534b5db67f5c4c214a7dd3 P c694ff83326940089c4a5de4f701da85: : Instructing follower 3cfe532df476417a9a0b7d9c23aa32ea to start an election
I20260709 13:13:00.701558  7095 raft_consensus.cc:1081] T 4bba86af07534b5db67f5c4c214a7dd3 P c694ff83326940089c4a5de4f701da85 [term 1 LEADER]: Signalling peer 3cfe532df476417a9a0b7d9c23aa32ea to start an election
I20260709 13:13:00.703138  6851 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4bba86af07534b5db67f5c4c214a7dd3"
dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea"
 from {username='slave'} at 127.0.0.1:33790
I20260709 13:13:00.703657  6851 raft_consensus.cc:493] T 4bba86af07534b5db67f5c4c214a7dd3 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:00.704007  6851 raft_consensus.cc:3060] T 4bba86af07534b5db67f5c4c214a7dd3 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.708947  6851 raft_consensus.cc:515] T 4bba86af07534b5db67f5c4c214a7dd3 P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:13:00.711019  6851 leader_election.cc:290] T 4bba86af07534b5db67f5c4c214a7dd3 P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 2 election: Requested vote from peers c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:13:00.711640  6924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bba86af07534b5db67f5c4c214a7dd3" candidate_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ac71a527733d4e97b26b7b7a7903045a"
I20260709 13:13:00.711410  6774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bba86af07534b5db67f5c4c214a7dd3" candidate_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c694ff83326940089c4a5de4f701da85"
I20260709 13:13:00.712261  6924 raft_consensus.cc:3060] T 4bba86af07534b5db67f5c4c214a7dd3 P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.712375  6774 raft_consensus.cc:3055] T 4bba86af07534b5db67f5c4c214a7dd3 P c694ff83326940089c4a5de4f701da85 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:00.712795  6774 raft_consensus.cc:740] T 4bba86af07534b5db67f5c4c214a7dd3 P c694ff83326940089c4a5de4f701da85 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c694ff83326940089c4a5de4f701da85, State: Running, Role: LEADER
I20260709 13:13:00.713586  6774 consensus_queue.cc:260] T 4bba86af07534b5db67f5c4c214a7dd3 P c694ff83326940089c4a5de4f701da85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:13:00.714819  6774 raft_consensus.cc:3060] T 4bba86af07534b5db67f5c4c214a7dd3 P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.719182  6924 raft_consensus.cc:2468] T 4bba86af07534b5db67f5c4c214a7dd3 P ac71a527733d4e97b26b7b7a7903045a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cfe532df476417a9a0b7d9c23aa32ea in term 2.
I20260709 13:13:00.720238  6815 leader_election.cc:304] T 4bba86af07534b5db67f5c4c214a7dd3 P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cfe532df476417a9a0b7d9c23aa32ea, ac71a527733d4e97b26b7b7a7903045a; no voters: 
I20260709 13:13:00.720947  7139 raft_consensus.cc:2804] T 4bba86af07534b5db67f5c4c214a7dd3 P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:00.721419  7139 raft_consensus.cc:697] T 4bba86af07534b5db67f5c4c214a7dd3 P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 LEADER]: Becoming Leader. State: Replica: 3cfe532df476417a9a0b7d9c23aa32ea, State: Running, Role: LEADER
I20260709 13:13:00.721812  6774 raft_consensus.cc:2468] T 4bba86af07534b5db67f5c4c214a7dd3 P c694ff83326940089c4a5de4f701da85 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cfe532df476417a9a0b7d9c23aa32ea in term 2.
I20260709 13:13:00.722267  7139 consensus_queue.cc:237] T 4bba86af07534b5db67f5c4c214a7dd3 P 3cfe532df476417a9a0b7d9c23aa32ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:13:00.728878  6670 catalog_manager.cc:5697] T 4bba86af07534b5db67f5c4c214a7dd3 P 3cfe532df476417a9a0b7d9c23aa32ea reported cstate change: term changed from 1 to 2, leader changed from c694ff83326940089c4a5de4f701da85 (127.28.173.1) to 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2). New cstate: current_term: 2 leader_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:00.825518  7096 raft_consensus.cc:993] T bcdbcbb86a864c6eaab608b0e18a55b0 P 3cfe532df476417a9a0b7d9c23aa32ea: : Instructing follower c694ff83326940089c4a5de4f701da85 to start an election
I20260709 13:13:00.825981  7096 raft_consensus.cc:1081] T bcdbcbb86a864c6eaab608b0e18a55b0 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 LEADER]: Signalling peer c694ff83326940089c4a5de4f701da85 to start an election
I20260709 13:13:00.827510  6774 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bcdbcbb86a864c6eaab608b0e18a55b0"
dest_uuid: "c694ff83326940089c4a5de4f701da85"
 from {username='slave'} at 127.0.0.1:45132
I20260709 13:13:00.828092  6774 raft_consensus.cc:493] T bcdbcbb86a864c6eaab608b0e18a55b0 P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:00.828413  6774 raft_consensus.cc:3060] T bcdbcbb86a864c6eaab608b0e18a55b0 P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.833772  6774 raft_consensus.cc:515] T bcdbcbb86a864c6eaab608b0e18a55b0 P c694ff83326940089c4a5de4f701da85 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:13:00.835393  6774 leader_election.cc:290] T bcdbcbb86a864c6eaab608b0e18a55b0 P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 2 election: Requested vote from peers 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:13:00.836229  6851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdbcbb86a864c6eaab608b0e18a55b0" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea"
I20260709 13:13:00.836582  6924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcdbcbb86a864c6eaab608b0e18a55b0" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ac71a527733d4e97b26b7b7a7903045a"
I20260709 13:13:00.836794  6851 raft_consensus.cc:3055] T bcdbcbb86a864c6eaab608b0e18a55b0 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:00.837186  6851 raft_consensus.cc:740] T bcdbcbb86a864c6eaab608b0e18a55b0 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3cfe532df476417a9a0b7d9c23aa32ea, State: Running, Role: LEADER
I20260709 13:13:00.837190  6924 raft_consensus.cc:3060] T bcdbcbb86a864c6eaab608b0e18a55b0 P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.837864  6851 consensus_queue.cc:260] T bcdbcbb86a864c6eaab608b0e18a55b0 P 3cfe532df476417a9a0b7d9c23aa32ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:13:00.838711  6851 raft_consensus.cc:3060] T bcdbcbb86a864c6eaab608b0e18a55b0 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.842113  6924 raft_consensus.cc:2468] T bcdbcbb86a864c6eaab608b0e18a55b0 P ac71a527733d4e97b26b7b7a7903045a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694ff83326940089c4a5de4f701da85 in term 2.
I20260709 13:13:00.842999  6851 raft_consensus.cc:2468] T bcdbcbb86a864c6eaab608b0e18a55b0 P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c694ff83326940089c4a5de4f701da85 in term 2.
I20260709 13:13:00.843220  6740 leader_election.cc:304] T bcdbcbb86a864c6eaab608b0e18a55b0 P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac71a527733d4e97b26b7b7a7903045a, c694ff83326940089c4a5de4f701da85; no voters: 
I20260709 13:13:00.844157  7094 raft_consensus.cc:2804] T bcdbcbb86a864c6eaab608b0e18a55b0 P c694ff83326940089c4a5de4f701da85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:00.844604  7094 raft_consensus.cc:697] T bcdbcbb86a864c6eaab608b0e18a55b0 P c694ff83326940089c4a5de4f701da85 [term 2 LEADER]: Becoming Leader. State: Replica: c694ff83326940089c4a5de4f701da85, State: Running, Role: LEADER
I20260709 13:13:00.845237  7094 consensus_queue.cc:237] T bcdbcbb86a864c6eaab608b0e18a55b0 P c694ff83326940089c4a5de4f701da85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:13:00.852285  6670 catalog_manager.cc:5697] T bcdbcbb86a864c6eaab608b0e18a55b0 P c694ff83326940089c4a5de4f701da85 reported cstate change: term changed from 1 to 2, leader changed from 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2) to c694ff83326940089c4a5de4f701da85 (127.28.173.1). New cstate: current_term: 2 leader_uuid: "c694ff83326940089c4a5de4f701da85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:00.977087  6851 raft_consensus.cc:1275] T 94f9e4eb8fc245078a0e84fff4103dd5 P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 FOLLOWER]: Refusing update from remote peer c694ff83326940089c4a5de4f701da85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:00.978253  7094 consensus_queue.cc:1048] T 94f9e4eb8fc245078a0e84fff4103dd5 P c694ff83326940089c4a5de4f701da85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:00.985486  6925 raft_consensus.cc:1275] T 94f9e4eb8fc245078a0e84fff4103dd5 P ac71a527733d4e97b26b7b7a7903045a [term 2 FOLLOWER]: Refusing update from remote peer c694ff83326940089c4a5de4f701da85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:00.987054  7092 consensus_queue.cc:1048] T 94f9e4eb8fc245078a0e84fff4103dd5 P c694ff83326940089c4a5de4f701da85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:01.013155  7057 raft_consensus.cc:993] T 4846b2cfc1c944acb68ffc05393ce201 P c694ff83326940089c4a5de4f701da85: : Instructing follower ac71a527733d4e97b26b7b7a7903045a to start an election
I20260709 13:13:01.013672  7095 raft_consensus.cc:1081] T 4846b2cfc1c944acb68ffc05393ce201 P c694ff83326940089c4a5de4f701da85 [term 1 LEADER]: Signalling peer ac71a527733d4e97b26b7b7a7903045a to start an election
I20260709 13:13:01.015158  6924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4846b2cfc1c944acb68ffc05393ce201"
dest_uuid: "ac71a527733d4e97b26b7b7a7903045a"
 from {username='slave'} at 127.0.0.1:33636
I20260709 13:13:01.015605  6924 raft_consensus.cc:493] T 4846b2cfc1c944acb68ffc05393ce201 P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:01.016001  6924 raft_consensus.cc:3060] T 4846b2cfc1c944acb68ffc05393ce201 P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.020313  6924 raft_consensus.cc:515] T 4846b2cfc1c944acb68ffc05393ce201 P ac71a527733d4e97b26b7b7a7903045a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:13:01.021579  6924 leader_election.cc:290] T 4846b2cfc1c944acb68ffc05393ce201 P ac71a527733d4e97b26b7b7a7903045a [CANDIDATE]: Term 2 election: Requested vote from peers c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303), 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907)
I20260709 13:13:01.022487  6774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4846b2cfc1c944acb68ffc05393ce201" candidate_uuid: "ac71a527733d4e97b26b7b7a7903045a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c694ff83326940089c4a5de4f701da85"
I20260709 13:13:01.022668  6851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4846b2cfc1c944acb68ffc05393ce201" candidate_uuid: "ac71a527733d4e97b26b7b7a7903045a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea"
I20260709 13:13:01.023310  6774 raft_consensus.cc:3055] T 4846b2cfc1c944acb68ffc05393ce201 P c694ff83326940089c4a5de4f701da85 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:01.023362  6851 raft_consensus.cc:3060] T 4846b2cfc1c944acb68ffc05393ce201 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.023624  6774 raft_consensus.cc:740] T 4846b2cfc1c944acb68ffc05393ce201 P c694ff83326940089c4a5de4f701da85 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c694ff83326940089c4a5de4f701da85, State: Running, Role: LEADER
I20260709 13:13:01.024474  6774 consensus_queue.cc:260] T 4846b2cfc1c944acb68ffc05393ce201 P c694ff83326940089c4a5de4f701da85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:13:01.025382  6774 raft_consensus.cc:3060] T 4846b2cfc1c944acb68ffc05393ce201 P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.027879  6851 raft_consensus.cc:2468] T 4846b2cfc1c944acb68ffc05393ce201 P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac71a527733d4e97b26b7b7a7903045a in term 2.
I20260709 13:13:01.028873  6890 leader_election.cc:304] T 4846b2cfc1c944acb68ffc05393ce201 P ac71a527733d4e97b26b7b7a7903045a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cfe532df476417a9a0b7d9c23aa32ea, ac71a527733d4e97b26b7b7a7903045a; no voters: 
I20260709 13:13:01.029582  7117 raft_consensus.cc:2804] T 4846b2cfc1c944acb68ffc05393ce201 P ac71a527733d4e97b26b7b7a7903045a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:01.030526  7117 raft_consensus.cc:697] T 4846b2cfc1c944acb68ffc05393ce201 P ac71a527733d4e97b26b7b7a7903045a [term 2 LEADER]: Becoming Leader. State: Replica: ac71a527733d4e97b26b7b7a7903045a, State: Running, Role: LEADER
I20260709 13:13:01.030758  6774 raft_consensus.cc:2468] T 4846b2cfc1c944acb68ffc05393ce201 P c694ff83326940089c4a5de4f701da85 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac71a527733d4e97b26b7b7a7903045a in term 2.
I20260709 13:13:01.031396  7117 consensus_queue.cc:237] T 4846b2cfc1c944acb68ffc05393ce201 P ac71a527733d4e97b26b7b7a7903045a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:13:01.037783  6671 catalog_manager.cc:5697] T 4846b2cfc1c944acb68ffc05393ce201 P ac71a527733d4e97b26b7b7a7903045a reported cstate change: term changed from 1 to 2, leader changed from c694ff83326940089c4a5de4f701da85 (127.28.173.1) to ac71a527733d4e97b26b7b7a7903045a (127.28.173.3). New cstate: current_term: 2 leader_uuid: "ac71a527733d4e97b26b7b7a7903045a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:01.051158  7057 raft_consensus.cc:993] T e0b1ea02768e411bb2b6341025336fa8 P c694ff83326940089c4a5de4f701da85: : Instructing follower 3cfe532df476417a9a0b7d9c23aa32ea to start an election
I20260709 13:13:01.051656  7095 raft_consensus.cc:1081] T e0b1ea02768e411bb2b6341025336fa8 P c694ff83326940089c4a5de4f701da85 [term 1 LEADER]: Signalling peer 3cfe532df476417a9a0b7d9c23aa32ea to start an election
I20260709 13:13:01.054320  6851 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0b1ea02768e411bb2b6341025336fa8"
dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea"
 from {username='slave'} at 127.0.0.1:33790
I20260709 13:13:01.054811  6851 raft_consensus.cc:493] T e0b1ea02768e411bb2b6341025336fa8 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:01.055140  6851 raft_consensus.cc:3060] T e0b1ea02768e411bb2b6341025336fa8 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.068069  6851 raft_consensus.cc:515] T e0b1ea02768e411bb2b6341025336fa8 P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:13:01.075794  6851 leader_election.cc:290] T e0b1ea02768e411bb2b6341025336fa8 P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 2 election: Requested vote from peers c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:13:01.075678  6774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b1ea02768e411bb2b6341025336fa8" candidate_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c694ff83326940089c4a5de4f701da85"
I20260709 13:13:01.077574  6774 raft_consensus.cc:3055] T e0b1ea02768e411bb2b6341025336fa8 P c694ff83326940089c4a5de4f701da85 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:01.077790  6925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b1ea02768e411bb2b6341025336fa8" candidate_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ac71a527733d4e97b26b7b7a7903045a"
I20260709 13:13:01.077975  6774 raft_consensus.cc:740] T e0b1ea02768e411bb2b6341025336fa8 P c694ff83326940089c4a5de4f701da85 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c694ff83326940089c4a5de4f701da85, State: Running, Role: LEADER
I20260709 13:13:01.078459  6925 raft_consensus.cc:3060] T e0b1ea02768e411bb2b6341025336fa8 P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.078531  7143 raft_consensus.cc:993] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a: : Instructing follower 3cfe532df476417a9a0b7d9c23aa32ea to start an election
I20260709 13:13:01.079205  7143 raft_consensus.cc:1081] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a [term 1 LEADER]: Signalling peer 3cfe532df476417a9a0b7d9c23aa32ea to start an election
I20260709 13:13:01.079411  6774 consensus_queue.cc:260] T e0b1ea02768e411bb2b6341025336fa8 P c694ff83326940089c4a5de4f701da85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:13:01.080994  6774 raft_consensus.cc:3060] T e0b1ea02768e411bb2b6341025336fa8 P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.085011  6849 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb84490998a54a1dbf874dd9a275078a"
dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea"
 from {username='slave'} at 127.0.0.1:33778
I20260709 13:13:01.085629  6849 raft_consensus.cc:493] T cb84490998a54a1dbf874dd9a275078a P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:01.086011  6849 raft_consensus.cc:3060] T cb84490998a54a1dbf874dd9a275078a P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.086519  6925 raft_consensus.cc:2468] T e0b1ea02768e411bb2b6341025336fa8 P ac71a527733d4e97b26b7b7a7903045a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cfe532df476417a9a0b7d9c23aa32ea in term 2.
I20260709 13:13:01.087781  6815 leader_election.cc:304] T e0b1ea02768e411bb2b6341025336fa8 P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cfe532df476417a9a0b7d9c23aa32ea, ac71a527733d4e97b26b7b7a7903045a; no voters: 
I20260709 13:13:01.088627  7139 raft_consensus.cc:2804] T e0b1ea02768e411bb2b6341025336fa8 P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:01.089097  7139 raft_consensus.cc:697] T e0b1ea02768e411bb2b6341025336fa8 P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 LEADER]: Becoming Leader. State: Replica: 3cfe532df476417a9a0b7d9c23aa32ea, State: Running, Role: LEADER
I20260709 13:13:01.089905  7139 consensus_queue.cc:237] T e0b1ea02768e411bb2b6341025336fa8 P 3cfe532df476417a9a0b7d9c23aa32ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:13:01.090392  6774 raft_consensus.cc:2468] T e0b1ea02768e411bb2b6341025336fa8 P c694ff83326940089c4a5de4f701da85 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cfe532df476417a9a0b7d9c23aa32ea in term 2.
I20260709 13:13:01.098937  6849 raft_consensus.cc:515] T cb84490998a54a1dbf874dd9a275078a P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:13:01.102712  6924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb84490998a54a1dbf874dd9a275078a" candidate_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ac71a527733d4e97b26b7b7a7903045a"
I20260709 13:13:01.103283  6924 raft_consensus.cc:3055] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:01.103595  6924 raft_consensus.cc:740] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ac71a527733d4e97b26b7b7a7903045a, State: Running, Role: LEADER
I20260709 13:13:01.104283  6924 consensus_queue.cc:260] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:13:01.106838  6774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb84490998a54a1dbf874dd9a275078a" candidate_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c694ff83326940089c4a5de4f701da85"
I20260709 13:13:01.107209  6924 raft_consensus.cc:3060] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.107546  6774 raft_consensus.cc:3060] T cb84490998a54a1dbf874dd9a275078a P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.125579  6924 raft_consensus.cc:2468] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cfe532df476417a9a0b7d9c23aa32ea in term 2.
I20260709 13:13:01.126552  6849 leader_election.cc:290] T cb84490998a54a1dbf874dd9a275078a P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 2 election: Requested vote from peers c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:13:01.127028  6815 leader_election.cc:304] T cb84490998a54a1dbf874dd9a275078a P 3cfe532df476417a9a0b7d9c23aa32ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cfe532df476417a9a0b7d9c23aa32ea, ac71a527733d4e97b26b7b7a7903045a; no voters: 
I20260709 13:13:01.128492  7139 raft_consensus.cc:2804] T cb84490998a54a1dbf874dd9a275078a P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:01.129249  7139 raft_consensus.cc:697] T cb84490998a54a1dbf874dd9a275078a P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 LEADER]: Becoming Leader. State: Replica: 3cfe532df476417a9a0b7d9c23aa32ea, State: Running, Role: LEADER
I20260709 13:13:01.131321  6774 raft_consensus.cc:2468] T cb84490998a54a1dbf874dd9a275078a P c694ff83326940089c4a5de4f701da85 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3cfe532df476417a9a0b7d9c23aa32ea in term 2.
I20260709 13:13:01.135341  7139 consensus_queue.cc:237] T cb84490998a54a1dbf874dd9a275078a P 3cfe532df476417a9a0b7d9c23aa32ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:13:02.133113  7057 raft_consensus.cc:493] T 66e24fd8f1554aa9aaaa0b2459ca1461 P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cfe532df476417a9a0b7d9c23aa32ea)
I20260709 13:13:02.133788  7057 raft_consensus.cc:515] T 66e24fd8f1554aa9aaaa0b2459ca1461 P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:13:02.137801  7057 leader_election.cc:290] T 66e24fd8f1554aa9aaaa0b2459ca1461 P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:13:02.139048  6924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e24fd8f1554aa9aaaa0b2459ca1461" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac71a527733d4e97b26b7b7a7903045a" is_pre_election: true
I20260709 13:13:02.206123  6776 raft_consensus.cc:1275] T 4bba86af07534b5db67f5c4c214a7dd3 P c694ff83326940089c4a5de4f701da85 [term 2 FOLLOWER]: Refusing update from remote peer 3cfe532df476417a9a0b7d9c23aa32ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:02.208256  6851 raft_consensus.cc:1275] T bcdbcbb86a864c6eaab608b0e18a55b0 P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 FOLLOWER]: Refusing update from remote peer c694ff83326940089c4a5de4f701da85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:02.209946  6774 raft_consensus.cc:1275] T e0b1ea02768e411bb2b6341025336fa8 P c694ff83326940089c4a5de4f701da85 [term 2 FOLLOWER]: Refusing update from remote peer 3cfe532df476417a9a0b7d9c23aa32ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:02.210829  6846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e24fd8f1554aa9aaaa0b2459ca1461" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" is_pre_election: true
I20260709 13:13:02.203601  6922 raft_consensus.cc:1275] T bcdbcbb86a864c6eaab608b0e18a55b0 P ac71a527733d4e97b26b7b7a7903045a [term 2 FOLLOWER]: Refusing update from remote peer c694ff83326940089c4a5de4f701da85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:02.215176  7008 consensus_queue.cc:1048] T e0b1ea02768e411bb2b6341025336fa8 P 3cfe532df476417a9a0b7d9c23aa32ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:02.222255  7008 consensus_queue.cc:1048] T 4bba86af07534b5db67f5c4c214a7dd3 P 3cfe532df476417a9a0b7d9c23aa32ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:02.222961  7057 consensus_queue.cc:1048] T bcdbcbb86a864c6eaab608b0e18a55b0 P c694ff83326940089c4a5de4f701da85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:02.228547  6741 leader_election.cc:304] T 66e24fd8f1554aa9aaaa0b2459ca1461 P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c694ff83326940089c4a5de4f701da85; no voters: 3cfe532df476417a9a0b7d9c23aa32ea, ac71a527733d4e97b26b7b7a7903045a
I20260709 13:13:02.230046  7057 raft_consensus.cc:2749] T 66e24fd8f1554aa9aaaa0b2459ca1461 P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.234578  7057 consensus_queue.cc:1048] T bcdbcbb86a864c6eaab608b0e18a55b0 P c694ff83326940089c4a5de4f701da85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:02.261137  6921 raft_consensus.cc:1275] T e0b1ea02768e411bb2b6341025336fa8 P ac71a527733d4e97b26b7b7a7903045a [term 2 FOLLOWER]: Refusing update from remote peer 3cfe532df476417a9a0b7d9c23aa32ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:02.269245  6776 raft_consensus.cc:1275] T 4846b2cfc1c944acb68ffc05393ce201 P c694ff83326940089c4a5de4f701da85 [term 2 FOLLOWER]: Refusing update from remote peer ac71a527733d4e97b26b7b7a7903045a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:02.267681  6924 raft_consensus.cc:1275] T 4bba86af07534b5db67f5c4c214a7dd3 P ac71a527733d4e97b26b7b7a7903045a [term 2 FOLLOWER]: Refusing update from remote peer 3cfe532df476417a9a0b7d9c23aa32ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:02.272748  7148 raft_consensus.cc:493] T 7b83e790f03848a880d9e09194fb5384 P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3cfe532df476417a9a0b7d9c23aa32ea)
I20260709 13:13:02.274020  7148 raft_consensus.cc:515] T 7b83e790f03848a880d9e09194fb5384 P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:13:02.274888  7106 consensus_queue.cc:1048] T e0b1ea02768e411bb2b6341025336fa8 P 3cfe532df476417a9a0b7d9c23aa32ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:02.281702  6671 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:32826 (request call id 77) took 1214 ms. Trace:
I20260709 13:13:02.282285  6671 rpcz_store.cc:276] 0709 13:13:01.111354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:01.111908 (+   554us) service_pool.cc:224] Handling call
0709 13:13:02.281459 (+1169551us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 13:13:02.285111  7148 leader_election.cc:290] T 7b83e790f03848a880d9e09194fb5384 P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907), ac71a527733d4e97b26b7b7a7903045a (127.28.173.3:35281)
I20260709 13:13:02.295759  6924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b83e790f03848a880d9e09194fb5384" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ac71a527733d4e97b26b7b7a7903045a" is_pre_election: true
I20260709 13:13:02.299945  7154 consensus_queue.cc:1048] T 4846b2cfc1c944acb68ffc05393ce201 P ac71a527733d4e97b26b7b7a7903045a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:02.312594  6850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b83e790f03848a880d9e09194fb5384" candidate_uuid: "c694ff83326940089c4a5de4f701da85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" is_pre_election: true
I20260709 13:13:02.332829  6741 leader_election.cc:304] T 7b83e790f03848a880d9e09194fb5384 P c694ff83326940089c4a5de4f701da85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c694ff83326940089c4a5de4f701da85; no voters: 3cfe532df476417a9a0b7d9c23aa32ea, ac71a527733d4e97b26b7b7a7903045a
I20260709 13:13:02.340842  7095 raft_consensus.cc:2749] T 7b83e790f03848a880d9e09194fb5384 P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.346619  7154 raft_consensus.cc:493] T 4bba86af07534b5db67f5c4c214a7dd3 P ac71a527733d4e97b26b7b7a7903045a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.345512  6670 catalog_manager.cc:5697] T e0b1ea02768e411bb2b6341025336fa8 P c694ff83326940089c4a5de4f701da85 reported cstate change: term changed from 1 to 2, leader changed from c694ff83326940089c4a5de4f701da85 (127.28.173.1) to 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2). New cstate: current_term: 2 leader_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } } }
I20260709 13:13:02.347277  7154 raft_consensus.cc:515] T 4bba86af07534b5db67f5c4c214a7dd3 P ac71a527733d4e97b26b7b7a7903045a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:13:02.351099  7154 leader_election.cc:290] T 4bba86af07534b5db67f5c4c214a7dd3 P ac71a527733d4e97b26b7b7a7903045a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303), 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907)
I20260709 13:13:02.360790  6773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bba86af07534b5db67f5c4c214a7dd3" candidate_uuid: "ac71a527733d4e97b26b7b7a7903045a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c694ff83326940089c4a5de4f701da85" is_pre_election: true
W20260709 13:13:02.371057  6705 debug-util.cc:398] Leaking SignalData structure 0x7b0800089400 after lost signal to thread 29367
W20260709 13:13:02.372828  6705 debug-util.cc:398] Leaking SignalData structure 0x7b08001d4e20 after lost signal to thread 6708
W20260709 13:13:02.375022  6705 debug-util.cc:398] Leaking SignalData structure 0x7b08001922c0 after lost signal to thread 6800
W20260709 13:13:02.377163  6705 debug-util.cc:398] Leaking SignalData structure 0x7b0800190c60 after lost signal to thread 6875
W20260709 13:13:02.379345  6705 debug-util.cc:398] Leaking SignalData structure 0x7b080033e180 after lost signal to thread 6949
W20260709 13:13:02.387934  6815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:35281, user_credentials={real_user=slave}} blocked reactor thread for 121170us
I20260709 13:13:02.390288  6850 raft_consensus.cc:1275] T 4846b2cfc1c944acb68ffc05393ce201 P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 FOLLOWER]: Refusing update from remote peer ac71a527733d4e97b26b7b7a7903045a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:02.391377  7139 consensus_queue.cc:1048] T 4bba86af07534b5db67f5c4c214a7dd3 P 3cfe532df476417a9a0b7d9c23aa32ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:02.411566  6850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bba86af07534b5db67f5c4c214a7dd3" candidate_uuid: "ac71a527733d4e97b26b7b7a7903045a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" is_pre_election: true
I20260709 13:13:02.414958  7143 consensus_queue.cc:1048] T 4846b2cfc1c944acb68ffc05393ce201 P ac71a527733d4e97b26b7b7a7903045a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:02.423988  6890 leader_election.cc:304] T 4bba86af07534b5db67f5c4c214a7dd3 P ac71a527733d4e97b26b7b7a7903045a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ac71a527733d4e97b26b7b7a7903045a; no voters: 3cfe532df476417a9a0b7d9c23aa32ea, c694ff83326940089c4a5de4f701da85
I20260709 13:13:02.435914  7154 raft_consensus.cc:2749] T 4bba86af07534b5db67f5c4c214a7dd3 P ac71a527733d4e97b26b7b7a7903045a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:02.516597  6671 catalog_manager.cc:5697] T cb84490998a54a1dbf874dd9a275078a P 3cfe532df476417a9a0b7d9c23aa32ea reported cstate change: term changed from 1 to 2, leader changed from ac71a527733d4e97b26b7b7a7903045a (127.28.173.3) to 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2). New cstate: current_term: 2 leader_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:02.581174  6774 raft_consensus.cc:1275] T cb84490998a54a1dbf874dd9a275078a P c694ff83326940089c4a5de4f701da85 [term 2 FOLLOWER]: Refusing update from remote peer 3cfe532df476417a9a0b7d9c23aa32ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:02.581768  6920 raft_consensus.cc:1275] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a [term 2 FOLLOWER]: Refusing update from remote peer 3cfe532df476417a9a0b7d9c23aa32ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:02.582911  7147 consensus_queue.cc:1048] T cb84490998a54a1dbf874dd9a275078a P 3cfe532df476417a9a0b7d9c23aa32ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:02.583964  7146 consensus_queue.cc:1048] T cb84490998a54a1dbf874dd9a275078a P 3cfe532df476417a9a0b7d9c23aa32ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:03.564440  6670 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51722:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:13:03.591593  6670 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51722:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:13:03.696362 29364 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:13:03.818416  7218 tablet.cc:1724] T e0b1ea02768e411bb2b6341025336fa8 P 3cfe532df476417a9a0b7d9c23aa32ea: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:03.818760  7217 tablet.cc:1724] T 85b78641da93463f839211c9ecf098c1 P c694ff83326940089c4a5de4f701da85: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:03.907538  7215 log.cc:927] Time spent T 4bba86af07534b5db67f5c4c214a7dd3 P ac71a527733d4e97b26b7b7a7903045a: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:13:03.923666  7228 tablet.cc:1724] T e0b1ea02768e411bb2b6341025336fa8 P ac71a527733d4e97b26b7b7a7903045a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:03.953446  7229 tablet.cc:1724] T 85b78641da93463f839211c9ecf098c1 P ac71a527733d4e97b26b7b7a7903045a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:03.989043  6877 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:e0b1ea02768e411bb2b6341025336fa8)
I20260709 13:13:03.984704  7232 tablet.cc:1724] T 94f9e4eb8fc245078a0e84fff4103dd5 P c694ff83326940089c4a5de4f701da85: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:04.052102  7237 tablet.cc:1724] T 6fa4c8b2aef94cc6afb369b911954a95 P c694ff83326940089c4a5de4f701da85: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:04.032202  6771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "85b78641da93463f839211c9ecf098c1"
dest_uuid: "c694ff83326940089c4a5de4f701da85"
mode: GRACEFUL
new_leader_uuid: "ac71a527733d4e97b26b7b7a7903045a"
 from {username='slave'} at 127.0.0.1:38642
W20260709 13:13:04.055822  7234 log.cc:927] Time spent T 4846b2cfc1c944acb68ffc05393ce201 P c694ff83326940089c4a5de4f701da85: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:13:04.067896  7240 tablet.cc:1724] T cb84490998a54a1dbf874dd9a275078a P 3cfe532df476417a9a0b7d9c23aa32ea: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:04.096781  7241 tablet.cc:1724] T 94f9e4eb8fc245078a0e84fff4103dd5 P ac71a527733d4e97b26b7b7a7903045a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:03.977720  7231 tablet.cc:1724] T 85b78641da93463f839211c9ecf098c1 P 3cfe532df476417a9a0b7d9c23aa32ea: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:04.054816  6771 raft_consensus.cc:606] T 85b78641da93463f839211c9ecf098c1 P c694ff83326940089c4a5de4f701da85 [term 1 LEADER]: Received request to transfer leadership to TS ac71a527733d4e97b26b7b7a7903045a
W20260709 13:13:04.103729  6815 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.173.3:35281, user_credentials={real_user=slave}} blocked reactor thread for 53391.1us
W20260709 13:13:04.118517  6802 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:6fa4c8b2aef94cc6afb369b911954a95)
W20260709 13:13:04.120419  6802 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:6fa4c8b2aef94cc6afb369b911954a95)
I20260709 13:13:04.138914  7229 tablet.cc:1724] T 6fa4c8b2aef94cc6afb369b911954a95 P ac71a527733d4e97b26b7b7a7903045a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:04.140064  7238 tablet.cc:1724] T bcdbcbb86a864c6eaab608b0e18a55b0 P c694ff83326940089c4a5de4f701da85: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:04.140357  7245 tablet.cc:1724] T 42af7e00d58646a6b3a58a6fe0a4d155 P 3cfe532df476417a9a0b7d9c23aa32ea: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:04.141728  7228 tablet.cc:1724] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:04.149482  7244 tablet.cc:1724] T bcdbcbb86a864c6eaab608b0e18a55b0 P ac71a527733d4e97b26b7b7a7903045a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:04.156432  7239 log.cc:927] Time spent T 6fa4c8b2aef94cc6afb369b911954a95 P 3cfe532df476417a9a0b7d9c23aa32ea: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:13:04.181010  7217 tablet.cc:1724] T cb84490998a54a1dbf874dd9a275078a P c694ff83326940089c4a5de4f701da85: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:04.182971  7231 tablet.cc:1724] T bcdbcbb86a864c6eaab608b0e18a55b0 P 3cfe532df476417a9a0b7d9c23aa32ea: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:04.191457  7237 tablet.cc:1724] T e0b1ea02768e411bb2b6341025336fa8 P c694ff83326940089c4a5de4f701da85: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:04.194337  7232 tablet.cc:1724] T 4bba86af07534b5db67f5c4c214a7dd3 P c694ff83326940089c4a5de4f701da85: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:04.169191  7218 tablet.cc:1724] T 4bba86af07534b5db67f5c4c214a7dd3 P 3cfe532df476417a9a0b7d9c23aa32ea: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:04.199608  7241 tablet.cc:1724] T 4846b2cfc1c944acb68ffc05393ce201 P ac71a527733d4e97b26b7b7a7903045a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:04.202967  7237 tablet.cc:1724] T 42af7e00d58646a6b3a58a6fe0a4d155 P c694ff83326940089c4a5de4f701da85: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:04.207288  7240 tablet.cc:1724] T 4846b2cfc1c944acb68ffc05393ce201 P 3cfe532df476417a9a0b7d9c23aa32ea: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:04.214907  7228 tablet.cc:1724] T 42af7e00d58646a6b3a58a6fe0a4d155 P ac71a527733d4e97b26b7b7a7903045a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:04.217701  6850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb84490998a54a1dbf874dd9a275078a"
dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea"
mode: GRACEFUL
new_leader_uuid: "ac71a527733d4e97b26b7b7a7903045a"
 from {username='slave'} at 127.0.0.1:46214
I20260709 13:13:04.217928  7244 tablet.cc:1724] T 4bba86af07534b5db67f5c4c214a7dd3 P ac71a527733d4e97b26b7b7a7903045a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:04.227743  7245 tablet.cc:1724] T 6fa4c8b2aef94cc6afb369b911954a95 P 3cfe532df476417a9a0b7d9c23aa32ea: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:04.228590  6850 raft_consensus.cc:606] T cb84490998a54a1dbf874dd9a275078a P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 LEADER]: Received request to transfer leadership to TS ac71a527733d4e97b26b7b7a7903045a
I20260709 13:13:04.230607 29364 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:13:04.231232 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:04.243012  6771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "130cd9c0c9ae40db9d46446c69b7d38a"
dest_uuid: "c694ff83326940089c4a5de4f701da85"
mode: GRACEFUL
new_leader_uuid: "ac71a527733d4e97b26b7b7a7903045a"
 from {username='slave'} at 127.0.0.1:38642
I20260709 13:13:04.219461  7238 tablet.cc:1724] T 4846b2cfc1c944acb68ffc05393ce201 P c694ff83326940089c4a5de4f701da85: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:04.225826  7231 tablet.cc:1724] T 94f9e4eb8fc245078a0e84fff4103dd5 P 3cfe532df476417a9a0b7d9c23aa32ea: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:04.243680  6771 raft_consensus.cc:606] T 130cd9c0c9ae40db9d46446c69b7d38a P c694ff83326940089c4a5de4f701da85 [term 2 LEADER]: Received request to transfer leadership to TS ac71a527733d4e97b26b7b7a7903045a
I20260709 13:13:04.248943  6850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a33a71a76c3446bc81028e6088bb456f"
dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea"
mode: GRACEFUL
new_leader_uuid: "ac71a527733d4e97b26b7b7a7903045a"
 from {username='slave'} at 127.0.0.1:46214
I20260709 13:13:04.270195  6850 raft_consensus.cc:606] T a33a71a76c3446bc81028e6088bb456f P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 LEADER]: Received request to transfer leadership to TS ac71a527733d4e97b26b7b7a7903045a
I20260709 13:13:04.271871 29364 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:13:04.272487 29364 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:04.283589  7092 raft_consensus.cc:993] T 85b78641da93463f839211c9ecf098c1 P c694ff83326940089c4a5de4f701da85: : Instructing follower ac71a527733d4e97b26b7b7a7903045a to start an election
I20260709 13:13:04.284071  7092 raft_consensus.cc:1081] T 85b78641da93463f839211c9ecf098c1 P c694ff83326940089c4a5de4f701da85 [term 1 LEADER]: Signalling peer ac71a527733d4e97b26b7b7a7903045a to start an election
I20260709 13:13:04.289288  6916 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "85b78641da93463f839211c9ecf098c1"
dest_uuid: "ac71a527733d4e97b26b7b7a7903045a"
 from {username='slave'} at 127.0.0.1:33636
I20260709 13:13:04.289929  6916 raft_consensus.cc:493] T 85b78641da93463f839211c9ecf098c1 P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:04.290333  6916 raft_consensus.cc:3060] T 85b78641da93463f839211c9ecf098c1 P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:04.299717  6916 raft_consensus.cc:515] T 85b78641da93463f839211c9ecf098c1 P ac71a527733d4e97b26b7b7a7903045a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:13:04.306754  6771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85b78641da93463f839211c9ecf098c1" candidate_uuid: "ac71a527733d4e97b26b7b7a7903045a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "c694ff83326940089c4a5de4f701da85"
I20260709 13:13:04.307381  6771 raft_consensus.cc:3055] T 85b78641da93463f839211c9ecf098c1 P c694ff83326940089c4a5de4f701da85 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:04.307698  6771 raft_consensus.cc:740] T 85b78641da93463f839211c9ecf098c1 P c694ff83326940089c4a5de4f701da85 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c694ff83326940089c4a5de4f701da85, State: Running, Role: LEADER
I20260709 13:13:04.309237  6771 consensus_queue.cc:260] T 85b78641da93463f839211c9ecf098c1 P c694ff83326940089c4a5de4f701da85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:13:04.310570  6771 raft_consensus.cc:3060] T 85b78641da93463f839211c9ecf098c1 P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:04.312740  7147 raft_consensus.cc:993] T a33a71a76c3446bc81028e6088bb456f P 3cfe532df476417a9a0b7d9c23aa32ea: : Instructing follower ac71a527733d4e97b26b7b7a7903045a to start an election
I20260709 13:13:04.313395  7235 raft_consensus.cc:1081] T a33a71a76c3446bc81028e6088bb456f P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 LEADER]: Signalling peer ac71a527733d4e97b26b7b7a7903045a to start an election
I20260709 13:13:04.315519  6923 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a33a71a76c3446bc81028e6088bb456f"
dest_uuid: "ac71a527733d4e97b26b7b7a7903045a"
 from {username='slave'} at 127.0.0.1:33628
I20260709 13:13:04.316123  6923 raft_consensus.cc:493] T a33a71a76c3446bc81028e6088bb456f P ac71a527733d4e97b26b7b7a7903045a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:04.316489  6923 raft_consensus.cc:3060] T a33a71a76c3446bc81028e6088bb456f P ac71a527733d4e97b26b7b7a7903045a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:04.325484  6923 raft_consensus.cc:515] T a33a71a76c3446bc81028e6088bb456f P ac71a527733d4e97b26b7b7a7903045a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:13:04.332897  7159 raft_consensus.cc:993] T cb84490998a54a1dbf874dd9a275078a P 3cfe532df476417a9a0b7d9c23aa32ea: : Instructing follower ac71a527733d4e97b26b7b7a7903045a to start an election
I20260709 13:13:04.337821  6850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85b78641da93463f839211c9ecf098c1" candidate_uuid: "ac71a527733d4e97b26b7b7a7903045a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea"
I20260709 13:13:04.338188  7159 raft_consensus.cc:1081] T cb84490998a54a1dbf874dd9a275078a P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 LEADER]: Signalling peer ac71a527733d4e97b26b7b7a7903045a to start an election
I20260709 13:13:04.338531  6850 raft_consensus.cc:3060] T 85b78641da93463f839211c9ecf098c1 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:04.337276  6916 leader_election.cc:290] T 85b78641da93463f839211c9ecf098c1 P ac71a527733d4e97b26b7b7a7903045a [CANDIDATE]: Term 2 election: Requested vote from peers c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303), 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907)
I20260709 13:13:04.340617  6924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb84490998a54a1dbf874dd9a275078a"
dest_uuid: "ac71a527733d4e97b26b7b7a7903045a"
 from {username='slave'} at 127.0.0.1:33628
I20260709 13:13:04.341213  6924 raft_consensus.cc:493] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:04.341566  6924 raft_consensus.cc:3060] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:04.345261  6776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a33a71a76c3446bc81028e6088bb456f" candidate_uuid: "ac71a527733d4e97b26b7b7a7903045a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c694ff83326940089c4a5de4f701da85"
I20260709 13:13:04.345899  6776 raft_consensus.cc:3060] T a33a71a76c3446bc81028e6088bb456f P c694ff83326940089c4a5de4f701da85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:04.353525  6923 leader_election.cc:290] T a33a71a76c3446bc81028e6088bb456f P ac71a527733d4e97b26b7b7a7903045a [CANDIDATE]: Term 3 election: Requested vote from peers c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303), 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907)
I20260709 13:13:04.354104  6846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a33a71a76c3446bc81028e6088bb456f" candidate_uuid: "ac71a527733d4e97b26b7b7a7903045a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea"
I20260709 13:13:04.354803  6846 raft_consensus.cc:3055] T a33a71a76c3446bc81028e6088bb456f P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:04.355119  6846 raft_consensus.cc:740] T a33a71a76c3446bc81028e6088bb456f P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3cfe532df476417a9a0b7d9c23aa32ea, State: Running, Role: LEADER
I20260709 13:13:04.356068  6846 consensus_queue.cc:260] T a33a71a76c3446bc81028e6088bb456f P 3cfe532df476417a9a0b7d9c23aa32ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:13:04.357438  6846 raft_consensus.cc:3060] T a33a71a76c3446bc81028e6088bb456f P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:04.369443  6846 raft_consensus.cc:2468] T a33a71a76c3446bc81028e6088bb456f P 3cfe532df476417a9a0b7d9c23aa32ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac71a527733d4e97b26b7b7a7903045a in term 3.
I20260709 13:13:04.370939  6890 leader_election.cc:304] T a33a71a76c3446bc81028e6088bb456f P ac71a527733d4e97b26b7b7a7903045a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cfe532df476417a9a0b7d9c23aa32ea, ac71a527733d4e97b26b7b7a7903045a; no voters: 
I20260709 13:13:04.371932  7178 raft_consensus.cc:2804] T a33a71a76c3446bc81028e6088bb456f P ac71a527733d4e97b26b7b7a7903045a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:04.372500  7178 raft_consensus.cc:697] T a33a71a76c3446bc81028e6088bb456f P ac71a527733d4e97b26b7b7a7903045a [term 3 LEADER]: Becoming Leader. State: Replica: ac71a527733d4e97b26b7b7a7903045a, State: Running, Role: LEADER
I20260709 13:13:04.373504  7178 consensus_queue.cc:237] T a33a71a76c3446bc81028e6088bb456f P ac71a527733d4e97b26b7b7a7903045a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:13:04.381529  6924 raft_consensus.cc:515] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:13:04.389499  6776 raft_consensus.cc:2468] T a33a71a76c3446bc81028e6088bb456f P c694ff83326940089c4a5de4f701da85 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac71a527733d4e97b26b7b7a7903045a in term 3.
I20260709 13:13:04.382675  6670 catalog_manager.cc:6242] T 00000000000000000000000000000000 P db920ac05b3e46d6a9cb9539bad22704: soft_deleted_table [id=d21485e249a1421a96082e775276b6bd] alter complete (version 1)
I20260709 13:13:04.397197  6850 raft_consensus.cc:2468] T 85b78641da93463f839211c9ecf098c1 P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac71a527733d4e97b26b7b7a7903045a in term 2.
I20260709 13:13:04.398183  6771 raft_consensus.cc:2468] T 85b78641da93463f839211c9ecf098c1 P c694ff83326940089c4a5de4f701da85 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac71a527733d4e97b26b7b7a7903045a in term 2.
I20260709 13:13:04.399475  6924 leader_election.cc:290] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a [CANDIDATE]: Term 3 election: Requested vote from peers c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303), 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907)
I20260709 13:13:04.400383  6891 leader_election.cc:304] T 85b78641da93463f839211c9ecf098c1 P ac71a527733d4e97b26b7b7a7903045a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac71a527733d4e97b26b7b7a7903045a, c694ff83326940089c4a5de4f701da85; no voters: 
I20260709 13:13:04.400532  6773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb84490998a54a1dbf874dd9a275078a" candidate_uuid: "ac71a527733d4e97b26b7b7a7903045a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "c694ff83326940089c4a5de4f701da85"
I20260709 13:13:04.401130  6773 raft_consensus.cc:3060] T cb84490998a54a1dbf874dd9a275078a P c694ff83326940089c4a5de4f701da85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:04.401909  7178 raft_consensus.cc:2804] T 85b78641da93463f839211c9ecf098c1 P ac71a527733d4e97b26b7b7a7903045a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:04.402613  7178 raft_consensus.cc:697] T 85b78641da93463f839211c9ecf098c1 P ac71a527733d4e97b26b7b7a7903045a [term 2 LEADER]: Becoming Leader. State: Replica: ac71a527733d4e97b26b7b7a7903045a, State: Running, Role: LEADER
I20260709 13:13:04.403548  7178 consensus_queue.cc:237] T 85b78641da93463f839211c9ecf098c1 P ac71a527733d4e97b26b7b7a7903045a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:13:04.408378  6850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb84490998a54a1dbf874dd9a275078a" candidate_uuid: "ac71a527733d4e97b26b7b7a7903045a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea"
I20260709 13:13:04.406667  6670 catalog_manager.cc:5697] T a33a71a76c3446bc81028e6088bb456f P ac71a527733d4e97b26b7b7a7903045a reported cstate change: term changed from 2 to 3, leader changed from 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2) to ac71a527733d4e97b26b7b7a7903045a (127.28.173.3). New cstate: current_term: 3 leader_uuid: "ac71a527733d4e97b26b7b7a7903045a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:04.409582  6850 raft_consensus.cc:3055] T cb84490998a54a1dbf874dd9a275078a P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:04.410369  6773 raft_consensus.cc:2468] T cb84490998a54a1dbf874dd9a275078a P c694ff83326940089c4a5de4f701da85 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac71a527733d4e97b26b7b7a7903045a in term 3.
I20260709 13:13:04.410503  6850 raft_consensus.cc:740] T cb84490998a54a1dbf874dd9a275078a P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3cfe532df476417a9a0b7d9c23aa32ea, State: Running, Role: LEADER
I20260709 13:13:04.411702  6891 leader_election.cc:304] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac71a527733d4e97b26b7b7a7903045a, c694ff83326940089c4a5de4f701da85; no voters: 
I20260709 13:13:04.411623  6850 consensus_queue.cc:260] T cb84490998a54a1dbf874dd9a275078a P 3cfe532df476417a9a0b7d9c23aa32ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:13:04.412658  7178 raft_consensus.cc:2804] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:04.412967  6850 raft_consensus.cc:3060] T cb84490998a54a1dbf874dd9a275078a P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:04.413451  7178 raft_consensus.cc:697] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a [term 3 LEADER]: Becoming Leader. State: Replica: ac71a527733d4e97b26b7b7a7903045a, State: Running, Role: LEADER
I20260709 13:13:04.414371  7178 consensus_queue.cc:237] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:13:04.420295  6850 raft_consensus.cc:2468] T cb84490998a54a1dbf874dd9a275078a P 3cfe532df476417a9a0b7d9c23aa32ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac71a527733d4e97b26b7b7a7903045a in term 3.
I20260709 13:13:04.425268  6670 catalog_manager.cc:5697] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a reported cstate change: term changed from 2 to 3, leader changed from 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2) to ac71a527733d4e97b26b7b7a7903045a (127.28.173.3). New cstate: current_term: 3 leader_uuid: "ac71a527733d4e97b26b7b7a7903045a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:04.426431  6670 catalog_manager.cc:5697] T 85b78641da93463f839211c9ecf098c1 P ac71a527733d4e97b26b7b7a7903045a reported cstate change: term changed from 1 to 2, leader changed from c694ff83326940089c4a5de4f701da85 (127.28.173.1) to ac71a527733d4e97b26b7b7a7903045a (127.28.173.3). New cstate: current_term: 2 leader_uuid: "ac71a527733d4e97b26b7b7a7903045a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:04.694142  7212 raft_consensus.cc:993] T 130cd9c0c9ae40db9d46446c69b7d38a P c694ff83326940089c4a5de4f701da85: : Instructing follower ac71a527733d4e97b26b7b7a7903045a to start an election
I20260709 13:13:04.694635  7092 raft_consensus.cc:1081] T 130cd9c0c9ae40db9d46446c69b7d38a P c694ff83326940089c4a5de4f701da85 [term 2 LEADER]: Signalling peer ac71a527733d4e97b26b7b7a7903045a to start an election
I20260709 13:13:04.696058  6924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "130cd9c0c9ae40db9d46446c69b7d38a"
dest_uuid: "ac71a527733d4e97b26b7b7a7903045a"
 from {username='slave'} at 127.0.0.1:33636
I20260709 13:13:04.696602  6924 raft_consensus.cc:493] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:04.696967  6924 raft_consensus.cc:3060] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:04.702811  6924 raft_consensus.cc:515] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:13:04.705246  6924 leader_election.cc:290] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a [CANDIDATE]: Term 3 election: Requested vote from peers c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303), 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907)
I20260709 13:13:04.706239  6773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130cd9c0c9ae40db9d46446c69b7d38a" candidate_uuid: "ac71a527733d4e97b26b7b7a7903045a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c694ff83326940089c4a5de4f701da85"
I20260709 13:13:04.707165  6773 raft_consensus.cc:3055] T 130cd9c0c9ae40db9d46446c69b7d38a P c694ff83326940089c4a5de4f701da85 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:04.707506  6773 raft_consensus.cc:740] T 130cd9c0c9ae40db9d46446c69b7d38a P c694ff83326940089c4a5de4f701da85 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c694ff83326940089c4a5de4f701da85, State: Running, Role: LEADER
I20260709 13:13:04.707762  6846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "130cd9c0c9ae40db9d46446c69b7d38a" candidate_uuid: "ac71a527733d4e97b26b7b7a7903045a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3cfe532df476417a9a0b7d9c23aa32ea"
I20260709 13:13:04.708451  6846 raft_consensus.cc:3060] T 130cd9c0c9ae40db9d46446c69b7d38a P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:04.708604  6773 consensus_queue.cc:260] T 130cd9c0c9ae40db9d46446c69b7d38a P c694ff83326940089c4a5de4f701da85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:13:04.710183  6773 raft_consensus.cc:3060] T 130cd9c0c9ae40db9d46446c69b7d38a P c694ff83326940089c4a5de4f701da85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:04.714076  6846 raft_consensus.cc:2468] T 130cd9c0c9ae40db9d46446c69b7d38a P 3cfe532df476417a9a0b7d9c23aa32ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac71a527733d4e97b26b7b7a7903045a in term 3.
I20260709 13:13:04.717937  6773 raft_consensus.cc:2468] T 130cd9c0c9ae40db9d46446c69b7d38a P c694ff83326940089c4a5de4f701da85 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac71a527733d4e97b26b7b7a7903045a in term 3.
I20260709 13:13:04.718209  6890 leader_election.cc:304] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cfe532df476417a9a0b7d9c23aa32ea, ac71a527733d4e97b26b7b7a7903045a; no voters: 
I20260709 13:13:04.719172  7178 raft_consensus.cc:2804] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:04.719630  7178 raft_consensus.cc:697] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a [term 3 LEADER]: Becoming Leader. State: Replica: ac71a527733d4e97b26b7b7a7903045a, State: Running, Role: LEADER
I20260709 13:13:04.720629  7178 consensus_queue.cc:237] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } }
I20260709 13:13:04.731717  6670 catalog_manager.cc:5697] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a reported cstate change: term changed from 2 to 3, leader changed from c694ff83326940089c4a5de4f701da85 (127.28.173.1) to ac71a527733d4e97b26b7b7a7903045a (127.28.173.3). New cstate: current_term: 3 leader_uuid: "ac71a527733d4e97b26b7b7a7903045a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac71a527733d4e97b26b7b7a7903045a" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 35281 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:04.811681  6846 raft_consensus.cc:1275] T a33a71a76c3446bc81028e6088bb456f P 3cfe532df476417a9a0b7d9c23aa32ea [term 3 FOLLOWER]: Refusing update from remote peer ac71a527733d4e97b26b7b7a7903045a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:04.813017  7178 consensus_queue.cc:1048] T a33a71a76c3446bc81028e6088bb456f P ac71a527733d4e97b26b7b7a7903045a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:04.835373  6846 raft_consensus.cc:1275] T cb84490998a54a1dbf874dd9a275078a P 3cfe532df476417a9a0b7d9c23aa32ea [term 3 FOLLOWER]: Refusing update from remote peer ac71a527733d4e97b26b7b7a7903045a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:13:04.836772  6773 raft_consensus.cc:1275] T a33a71a76c3446bc81028e6088bb456f P c694ff83326940089c4a5de4f701da85 [term 3 FOLLOWER]: Refusing update from remote peer ac71a527733d4e97b26b7b7a7903045a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:04.837188  7230 consensus_queue.cc:1048] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:04.838459  7178 consensus_queue.cc:1048] T a33a71a76c3446bc81028e6088bb456f P ac71a527733d4e97b26b7b7a7903045a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:04.856658  6773 raft_consensus.cc:1275] T cb84490998a54a1dbf874dd9a275078a P c694ff83326940089c4a5de4f701da85 [term 3 FOLLOWER]: Refusing update from remote peer ac71a527733d4e97b26b7b7a7903045a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:13:04.859007  7178 consensus_queue.cc:1048] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:04.872406  6846 raft_consensus.cc:1275] T 85b78641da93463f839211c9ecf098c1 P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 FOLLOWER]: Refusing update from remote peer ac71a527733d4e97b26b7b7a7903045a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:13:04.873885  7257 consensus_queue.cc:1048] T 85b78641da93463f839211c9ecf098c1 P ac71a527733d4e97b26b7b7a7903045a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:04.884091  6773 raft_consensus.cc:1275] T 85b78641da93463f839211c9ecf098c1 P c694ff83326940089c4a5de4f701da85 [term 2 FOLLOWER]: Refusing update from remote peer ac71a527733d4e97b26b7b7a7903045a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:13:04.885638  7257 consensus_queue.cc:1048] T 85b78641da93463f839211c9ecf098c1 P ac71a527733d4e97b26b7b7a7903045a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:05.101385  6846 raft_consensus.cc:1275] T 130cd9c0c9ae40db9d46446c69b7d38a P 3cfe532df476417a9a0b7d9c23aa32ea [term 3 FOLLOWER]: Refusing update from remote peer ac71a527733d4e97b26b7b7a7903045a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:05.102752  7257 consensus_queue.cc:1048] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cfe532df476417a9a0b7d9c23aa32ea" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 40907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:05.116082  6773 raft_consensus.cc:1275] T 130cd9c0c9ae40db9d46446c69b7d38a P c694ff83326940089c4a5de4f701da85 [term 3 FOLLOWER]: Refusing update from remote peer ac71a527733d4e97b26b7b7a7903045a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:05.118019  7230 consensus_queue.cc:1048] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c694ff83326940089c4a5de4f701da85" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 41303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:05.345504 29364 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:13:05.353797 29364 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:13:05.354313 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:05.362123 29364 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:13:05.362668 29364 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:06.395941 29364 tablet_server.cc:179] TabletServer@127.28.173.1:0 shutting down...
W20260709 13:13:06.434229  6817 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
W20260709 13:13:06.437368  6817 consensus_peers.cc:597] T 4bba86af07534b5db67f5c4c214a7dd3 P 3cfe532df476417a9a0b7d9c23aa32ea -> Peer c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303): Couldn't send request to peer c694ff83326940089c4a5de4f701da85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:06.441479 29364 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:06.442359 29364 tablet_replica.cc:333] T bcdbcbb86a864c6eaab608b0e18a55b0 P c694ff83326940089c4a5de4f701da85: stopping tablet replica
I20260709 13:13:06.443137 29364 raft_consensus.cc:2243] T bcdbcbb86a864c6eaab608b0e18a55b0 P c694ff83326940089c4a5de4f701da85 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:06.444255 29364 raft_consensus.cc:2272] T bcdbcbb86a864c6eaab608b0e18a55b0 P c694ff83326940089c4a5de4f701da85 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.446519 29364 tablet_replica.cc:333] T 6fa4c8b2aef94cc6afb369b911954a95 P c694ff83326940089c4a5de4f701da85: stopping tablet replica
I20260709 13:13:06.447268 29364 raft_consensus.cc:2243] T 6fa4c8b2aef94cc6afb369b911954a95 P c694ff83326940089c4a5de4f701da85 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:06.448212 29364 raft_consensus.cc:2272] T 6fa4c8b2aef94cc6afb369b911954a95 P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.451267 29364 tablet_replica.cc:333] T 85b78641da93463f839211c9ecf098c1 P c694ff83326940089c4a5de4f701da85: stopping tablet replica
I20260709 13:13:06.452081 29364 raft_consensus.cc:2243] T 85b78641da93463f839211c9ecf098c1 P c694ff83326940089c4a5de4f701da85 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.452605 29364 raft_consensus.cc:2272] T 85b78641da93463f839211c9ecf098c1 P c694ff83326940089c4a5de4f701da85 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:06.452904  6891 consensus_peers.cc:597] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a -> Peer c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303): Couldn't send request to peer c694ff83326940089c4a5de4f701da85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:06.454846 29364 tablet_replica.cc:333] T e1d810c81d024c829b673c74b3cf6434 P c694ff83326940089c4a5de4f701da85: stopping tablet replica
I20260709 13:13:06.455615 29364 raft_consensus.cc:2243] T e1d810c81d024c829b673c74b3cf6434 P c694ff83326940089c4a5de4f701da85 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:06.456516 29364 raft_consensus.cc:2272] T e1d810c81d024c829b673c74b3cf6434 P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.459174 29364 tablet_replica.cc:333] T e0b1ea02768e411bb2b6341025336fa8 P c694ff83326940089c4a5de4f701da85: stopping tablet replica
W20260709 13:13:06.459630  6891 consensus_peers.cc:597] T a33a71a76c3446bc81028e6088bb456f P ac71a527733d4e97b26b7b7a7903045a -> Peer c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303): Couldn't send request to peer c694ff83326940089c4a5de4f701da85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:06.459915 29364 raft_consensus.cc:2243] T e0b1ea02768e411bb2b6341025336fa8 P c694ff83326940089c4a5de4f701da85 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.460520 29364 raft_consensus.cc:2272] T e0b1ea02768e411bb2b6341025336fa8 P c694ff83326940089c4a5de4f701da85 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.462725 29364 tablet_replica.cc:333] T 9fe8c15a65104cceaa416248b1f41a8f P c694ff83326940089c4a5de4f701da85: stopping tablet replica
I20260709 13:13:06.463312 29364 raft_consensus.cc:2243] T 9fe8c15a65104cceaa416248b1f41a8f P c694ff83326940089c4a5de4f701da85 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:06.464161 29364 raft_consensus.cc:2272] T 9fe8c15a65104cceaa416248b1f41a8f P c694ff83326940089c4a5de4f701da85 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.466215 29364 tablet_replica.cc:333] T 4bba86af07534b5db67f5c4c214a7dd3 P c694ff83326940089c4a5de4f701da85: stopping tablet replica
I20260709 13:13:06.466883 29364 raft_consensus.cc:2243] T 4bba86af07534b5db67f5c4c214a7dd3 P c694ff83326940089c4a5de4f701da85 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.467329 29364 raft_consensus.cc:2272] T 4bba86af07534b5db67f5c4c214a7dd3 P c694ff83326940089c4a5de4f701da85 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.469369 29364 tablet_replica.cc:333] T 42af7e00d58646a6b3a58a6fe0a4d155 P c694ff83326940089c4a5de4f701da85: stopping tablet replica
I20260709 13:13:06.469975 29364 raft_consensus.cc:2243] T 42af7e00d58646a6b3a58a6fe0a4d155 P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.470458 29364 raft_consensus.cc:2272] T 42af7e00d58646a6b3a58a6fe0a4d155 P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.472821 29364 tablet_replica.cc:333] T 7cfc24257c5a4819b7d004d3ba696c3f P c694ff83326940089c4a5de4f701da85: stopping tablet replica
I20260709 13:13:06.473348 29364 raft_consensus.cc:2243] T 7cfc24257c5a4819b7d004d3ba696c3f P c694ff83326940089c4a5de4f701da85 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.473803 29364 raft_consensus.cc:2272] T 7cfc24257c5a4819b7d004d3ba696c3f P c694ff83326940089c4a5de4f701da85 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.476089 29364 tablet_replica.cc:333] T 66e24fd8f1554aa9aaaa0b2459ca1461 P c694ff83326940089c4a5de4f701da85: stopping tablet replica
I20260709 13:13:06.476646 29364 raft_consensus.cc:2243] T 66e24fd8f1554aa9aaaa0b2459ca1461 P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.477066 29364 raft_consensus.cc:2272] T 66e24fd8f1554aa9aaaa0b2459ca1461 P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.479753 29364 tablet_replica.cc:333] T 4846b2cfc1c944acb68ffc05393ce201 P c694ff83326940089c4a5de4f701da85: stopping tablet replica
I20260709 13:13:06.480376 29364 raft_consensus.cc:2243] T 4846b2cfc1c944acb68ffc05393ce201 P c694ff83326940089c4a5de4f701da85 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.480820 29364 raft_consensus.cc:2272] T 4846b2cfc1c944acb68ffc05393ce201 P c694ff83326940089c4a5de4f701da85 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.482795 29364 tablet_replica.cc:333] T 7b83e790f03848a880d9e09194fb5384 P c694ff83326940089c4a5de4f701da85: stopping tablet replica
I20260709 13:13:06.483343 29364 raft_consensus.cc:2243] T 7b83e790f03848a880d9e09194fb5384 P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.483741 29364 raft_consensus.cc:2272] T 7b83e790f03848a880d9e09194fb5384 P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.486469 29364 tablet_replica.cc:333] T 94f9e4eb8fc245078a0e84fff4103dd5 P c694ff83326940089c4a5de4f701da85: stopping tablet replica
I20260709 13:13:06.486963 29364 raft_consensus.cc:2243] T 94f9e4eb8fc245078a0e84fff4103dd5 P c694ff83326940089c4a5de4f701da85 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:06.487721 29364 raft_consensus.cc:2272] T 94f9e4eb8fc245078a0e84fff4103dd5 P c694ff83326940089c4a5de4f701da85 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.489681 29364 tablet_replica.cc:333] T cb84490998a54a1dbf874dd9a275078a P c694ff83326940089c4a5de4f701da85: stopping tablet replica
I20260709 13:13:06.490203 29364 raft_consensus.cc:2243] T cb84490998a54a1dbf874dd9a275078a P c694ff83326940089c4a5de4f701da85 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.490633 29364 raft_consensus.cc:2272] T cb84490998a54a1dbf874dd9a275078a P c694ff83326940089c4a5de4f701da85 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.492681 29364 tablet_replica.cc:333] T 3e2cddf49d494674a2af001bacdd466f P c694ff83326940089c4a5de4f701da85: stopping tablet replica
I20260709 13:13:06.493224 29364 raft_consensus.cc:2243] T 3e2cddf49d494674a2af001bacdd466f P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.493638 29364 raft_consensus.cc:2272] T 3e2cddf49d494674a2af001bacdd466f P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.495987 29364 tablet_replica.cc:333] T a33a71a76c3446bc81028e6088bb456f P c694ff83326940089c4a5de4f701da85: stopping tablet replica
I20260709 13:13:06.496620 29364 raft_consensus.cc:2243] T a33a71a76c3446bc81028e6088bb456f P c694ff83326940089c4a5de4f701da85 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.497036 29364 raft_consensus.cc:2272] T a33a71a76c3446bc81028e6088bb456f P c694ff83326940089c4a5de4f701da85 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.499485 29364 tablet_replica.cc:333] T 5e798f66b3ee4250808a11df90a378da P c694ff83326940089c4a5de4f701da85: stopping tablet replica
I20260709 13:13:06.500238 29364 raft_consensus.cc:2243] T 5e798f66b3ee4250808a11df90a378da P c694ff83326940089c4a5de4f701da85 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:06.501293 29364 raft_consensus.cc:2272] T 5e798f66b3ee4250808a11df90a378da P c694ff83326940089c4a5de4f701da85 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:06.502139  6817 consensus_peers.cc:597] T 66e24fd8f1554aa9aaaa0b2459ca1461 P 3cfe532df476417a9a0b7d9c23aa32ea -> Peer c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303): Couldn't send request to peer c694ff83326940089c4a5de4f701da85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:06.503894 29364 tablet_replica.cc:333] T 130cd9c0c9ae40db9d46446c69b7d38a P c694ff83326940089c4a5de4f701da85: stopping tablet replica
I20260709 13:13:06.504495 29364 raft_consensus.cc:2243] T 130cd9c0c9ae40db9d46446c69b7d38a P c694ff83326940089c4a5de4f701da85 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.504889 29364 raft_consensus.cc:2272] T 130cd9c0c9ae40db9d46446c69b7d38a P c694ff83326940089c4a5de4f701da85 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:06.515866  6891 consensus_peers.cc:597] T 7cfc24257c5a4819b7d004d3ba696c3f P ac71a527733d4e97b26b7b7a7903045a -> Peer c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303): Couldn't send request to peer c694ff83326940089c4a5de4f701da85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:06.548353 29364 tablet_server.cc:196] TabletServer@127.28.173.1:0 shutdown complete.
W20260709 13:13:06.573765  6817 consensus_peers.cc:597] T 3e2cddf49d494674a2af001bacdd466f P 3cfe532df476417a9a0b7d9c23aa32ea -> Peer c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303): Couldn't send request to peer c694ff83326940089c4a5de4f701da85. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:41303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:06.600956 29364 tablet_server.cc:179] TabletServer@127.28.173.2:0 shutting down...
W20260709 13:13:06.608636  6890 consensus_peers.cc:597] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a -> Peer 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907): Couldn't send request to peer 3cfe532df476417a9a0b7d9c23aa32ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:06.639072 29364 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:06.640157 29364 tablet_replica.cc:333] T bcdbcbb86a864c6eaab608b0e18a55b0 P 3cfe532df476417a9a0b7d9c23aa32ea: stopping tablet replica
I20260709 13:13:06.640998 29364 raft_consensus.cc:2243] T bcdbcbb86a864c6eaab608b0e18a55b0 P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.641469 29364 raft_consensus.cc:2272] T bcdbcbb86a864c6eaab608b0e18a55b0 P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.643764 29364 tablet_replica.cc:333] T 85b78641da93463f839211c9ecf098c1 P 3cfe532df476417a9a0b7d9c23aa32ea: stopping tablet replica
I20260709 13:13:06.644472 29364 raft_consensus.cc:2243] T 85b78641da93463f839211c9ecf098c1 P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.644903 29364 raft_consensus.cc:2272] T 85b78641da93463f839211c9ecf098c1 P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.646842 29364 tablet_replica.cc:333] T e0b1ea02768e411bb2b6341025336fa8 P 3cfe532df476417a9a0b7d9c23aa32ea: stopping tablet replica
I20260709 13:13:06.647470 29364 raft_consensus.cc:2243] T e0b1ea02768e411bb2b6341025336fa8 P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:06.648340 29364 raft_consensus.cc:2272] T e0b1ea02768e411bb2b6341025336fa8 P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.650143 29364 tablet_replica.cc:333] T e1d810c81d024c829b673c74b3cf6434 P 3cfe532df476417a9a0b7d9c23aa32ea: stopping tablet replica
I20260709 13:13:06.650708 29364 raft_consensus.cc:2243] T e1d810c81d024c829b673c74b3cf6434 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.651113 29364 raft_consensus.cc:2272] T e1d810c81d024c829b673c74b3cf6434 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.653236 29364 tablet_replica.cc:333] T 130cd9c0c9ae40db9d46446c69b7d38a P 3cfe532df476417a9a0b7d9c23aa32ea: stopping tablet replica
I20260709 13:13:06.653801 29364 raft_consensus.cc:2243] T 130cd9c0c9ae40db9d46446c69b7d38a P 3cfe532df476417a9a0b7d9c23aa32ea [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.654314 29364 raft_consensus.cc:2272] T 130cd9c0c9ae40db9d46446c69b7d38a P 3cfe532df476417a9a0b7d9c23aa32ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.656500 29364 tablet_replica.cc:333] T 5e798f66b3ee4250808a11df90a378da P 3cfe532df476417a9a0b7d9c23aa32ea: stopping tablet replica
I20260709 13:13:06.657159 29364 raft_consensus.cc:2243] T 5e798f66b3ee4250808a11df90a378da P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.657598 29364 raft_consensus.cc:2272] T 5e798f66b3ee4250808a11df90a378da P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.659862 29364 tablet_replica.cc:333] T cb84490998a54a1dbf874dd9a275078a P 3cfe532df476417a9a0b7d9c23aa32ea: stopping tablet replica
I20260709 13:13:06.660387 29364 raft_consensus.cc:2243] T cb84490998a54a1dbf874dd9a275078a P 3cfe532df476417a9a0b7d9c23aa32ea [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.660771 29364 raft_consensus.cc:2272] T cb84490998a54a1dbf874dd9a275078a P 3cfe532df476417a9a0b7d9c23aa32ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.663020 29364 tablet_replica.cc:333] T 94f9e4eb8fc245078a0e84fff4103dd5 P 3cfe532df476417a9a0b7d9c23aa32ea: stopping tablet replica
I20260709 13:13:06.663805 29364 raft_consensus.cc:2243] T 94f9e4eb8fc245078a0e84fff4103dd5 P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.664444 29364 raft_consensus.cc:2272] T 94f9e4eb8fc245078a0e84fff4103dd5 P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.667004 29364 tablet_replica.cc:333] T 4bba86af07534b5db67f5c4c214a7dd3 P 3cfe532df476417a9a0b7d9c23aa32ea: stopping tablet replica
W20260709 13:13:06.667714  6891 consensus_peers.cc:597] T 4846b2cfc1c944acb68ffc05393ce201 P ac71a527733d4e97b26b7b7a7903045a -> Peer c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303): Couldn't send request to peer c694ff83326940089c4a5de4f701da85. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:41303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:06.667774 29364 raft_consensus.cc:2243] T 4bba86af07534b5db67f5c4c214a7dd3 P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:06.669238 29364 raft_consensus.cc:2272] T 4bba86af07534b5db67f5c4c214a7dd3 P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.672034 29364 tablet_replica.cc:333] T 42af7e00d58646a6b3a58a6fe0a4d155 P 3cfe532df476417a9a0b7d9c23aa32ea: stopping tablet replica
I20260709 13:13:06.672921 29364 raft_consensus.cc:2243] T 42af7e00d58646a6b3a58a6fe0a4d155 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:06.673880 29364 raft_consensus.cc:2272] T 42af7e00d58646a6b3a58a6fe0a4d155 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.676610 29364 tablet_replica.cc:333] T 7cfc24257c5a4819b7d004d3ba696c3f P 3cfe532df476417a9a0b7d9c23aa32ea: stopping tablet replica
I20260709 13:13:06.677382 29364 raft_consensus.cc:2243] T 7cfc24257c5a4819b7d004d3ba696c3f P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.677974 29364 raft_consensus.cc:2272] T 7cfc24257c5a4819b7d004d3ba696c3f P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.680914 29364 tablet_replica.cc:333] T 9fe8c15a65104cceaa416248b1f41a8f P 3cfe532df476417a9a0b7d9c23aa32ea: stopping tablet replica
I20260709 13:13:06.681603 29364 raft_consensus.cc:2243] T 9fe8c15a65104cceaa416248b1f41a8f P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.682160 29364 raft_consensus.cc:2272] T 9fe8c15a65104cceaa416248b1f41a8f P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.684892 29364 tablet_replica.cc:333] T 6fa4c8b2aef94cc6afb369b911954a95 P 3cfe532df476417a9a0b7d9c23aa32ea: stopping tablet replica
I20260709 13:13:06.685635 29364 raft_consensus.cc:2243] T 6fa4c8b2aef94cc6afb369b911954a95 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.686192 29364 raft_consensus.cc:2272] T 6fa4c8b2aef94cc6afb369b911954a95 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.688804 29364 tablet_replica.cc:333] T a33a71a76c3446bc81028e6088bb456f P 3cfe532df476417a9a0b7d9c23aa32ea: stopping tablet replica
I20260709 13:13:06.689520 29364 raft_consensus.cc:2243] T a33a71a76c3446bc81028e6088bb456f P 3cfe532df476417a9a0b7d9c23aa32ea [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.690024 29364 raft_consensus.cc:2272] T a33a71a76c3446bc81028e6088bb456f P 3cfe532df476417a9a0b7d9c23aa32ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.692866 29364 tablet_replica.cc:333] T 3e2cddf49d494674a2af001bacdd466f P 3cfe532df476417a9a0b7d9c23aa32ea: stopping tablet replica
I20260709 13:13:06.693632 29364 raft_consensus.cc:2243] T 3e2cddf49d494674a2af001bacdd466f P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:06.695129 29364 raft_consensus.cc:2272] T 3e2cddf49d494674a2af001bacdd466f P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:06.697340  6890 consensus_peers.cc:597] T 4846b2cfc1c944acb68ffc05393ce201 P ac71a527733d4e97b26b7b7a7903045a -> Peer 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907): Couldn't send request to peer 3cfe532df476417a9a0b7d9c23aa32ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:06.698060 29364 tablet_replica.cc:333] T 66e24fd8f1554aa9aaaa0b2459ca1461 P 3cfe532df476417a9a0b7d9c23aa32ea: stopping tablet replica
I20260709 13:13:06.698927 29364 raft_consensus.cc:2243] T 66e24fd8f1554aa9aaaa0b2459ca1461 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:06.699743 29364 raft_consensus.cc:2272] T 66e24fd8f1554aa9aaaa0b2459ca1461 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.701794 29364 tablet_replica.cc:333] T 4846b2cfc1c944acb68ffc05393ce201 P 3cfe532df476417a9a0b7d9c23aa32ea: stopping tablet replica
I20260709 13:13:06.702266 29364 raft_consensus.cc:2243] T 4846b2cfc1c944acb68ffc05393ce201 P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.702675 29364 raft_consensus.cc:2272] T 4846b2cfc1c944acb68ffc05393ce201 P 3cfe532df476417a9a0b7d9c23aa32ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.704584 29364 tablet_replica.cc:333] T 7b83e790f03848a880d9e09194fb5384 P 3cfe532df476417a9a0b7d9c23aa32ea: stopping tablet replica
I20260709 13:13:06.705029 29364 raft_consensus.cc:2243] T 7b83e790f03848a880d9e09194fb5384 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:06.705876 29364 raft_consensus.cc:2272] T 7b83e790f03848a880d9e09194fb5384 P 3cfe532df476417a9a0b7d9c23aa32ea [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:06.711071  6891 consensus_peers.cc:597] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a -> Peer c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303): Couldn't send request to peer c694ff83326940089c4a5de4f701da85. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:41303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:06.716073  6890 consensus_peers.cc:597] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a -> Peer 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907): Couldn't send request to peer 3cfe532df476417a9a0b7d9c23aa32ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:06.748732 29364 tablet_server.cc:196] TabletServer@127.28.173.2:0 shutdown complete.
W20260709 13:13:06.749320  6891 consensus_peers.cc:597] T 85b78641da93463f839211c9ecf098c1 P ac71a527733d4e97b26b7b7a7903045a -> Peer c694ff83326940089c4a5de4f701da85 (127.28.173.1:41303): Couldn't send request to peer c694ff83326940089c4a5de4f701da85. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:41303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:06.786491 29364 tablet_server.cc:179] TabletServer@127.28.173.3:0 shutting down...
I20260709 13:13:06.825749 29364 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:13:06.825734  6890 consensus_peers.cc:597] T 85b78641da93463f839211c9ecf098c1 P ac71a527733d4e97b26b7b7a7903045a -> Peer 3cfe532df476417a9a0b7d9c23aa32ea (127.28.173.2:40907): Couldn't send request to peer 3cfe532df476417a9a0b7d9c23aa32ea. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.2:40907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:06.826884 29364 tablet_replica.cc:333] T 6fa4c8b2aef94cc6afb369b911954a95 P ac71a527733d4e97b26b7b7a7903045a: stopping tablet replica
I20260709 13:13:06.827920 29364 raft_consensus.cc:2243] T 6fa4c8b2aef94cc6afb369b911954a95 P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.828560 29364 raft_consensus.cc:2272] T 6fa4c8b2aef94cc6afb369b911954a95 P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.830581 29364 tablet_replica.cc:333] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a: stopping tablet replica
I20260709 13:13:06.831207 29364 raft_consensus.cc:2243] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:06.832079 29364 raft_consensus.cc:2272] T cb84490998a54a1dbf874dd9a275078a P ac71a527733d4e97b26b7b7a7903045a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.834076 29364 tablet_replica.cc:333] T 94f9e4eb8fc245078a0e84fff4103dd5 P ac71a527733d4e97b26b7b7a7903045a: stopping tablet replica
I20260709 13:13:06.834667 29364 raft_consensus.cc:2243] T 94f9e4eb8fc245078a0e84fff4103dd5 P ac71a527733d4e97b26b7b7a7903045a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.835099 29364 raft_consensus.cc:2272] T 94f9e4eb8fc245078a0e84fff4103dd5 P ac71a527733d4e97b26b7b7a7903045a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.837203 29364 tablet_replica.cc:333] T bcdbcbb86a864c6eaab608b0e18a55b0 P ac71a527733d4e97b26b7b7a7903045a: stopping tablet replica
I20260709 13:13:06.838111 29364 raft_consensus.cc:2243] T bcdbcbb86a864c6eaab608b0e18a55b0 P ac71a527733d4e97b26b7b7a7903045a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.838850 29364 raft_consensus.cc:2272] T bcdbcbb86a864c6eaab608b0e18a55b0 P ac71a527733d4e97b26b7b7a7903045a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.841745 29364 tablet_replica.cc:333] T 3e2cddf49d494674a2af001bacdd466f P ac71a527733d4e97b26b7b7a7903045a: stopping tablet replica
I20260709 13:13:06.842538 29364 raft_consensus.cc:2243] T 3e2cddf49d494674a2af001bacdd466f P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.843148 29364 raft_consensus.cc:2272] T 3e2cddf49d494674a2af001bacdd466f P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.846565 29364 tablet_replica.cc:333] T a33a71a76c3446bc81028e6088bb456f P ac71a527733d4e97b26b7b7a7903045a: stopping tablet replica
I20260709 13:13:06.847676 29364 raft_consensus.cc:2243] T a33a71a76c3446bc81028e6088bb456f P ac71a527733d4e97b26b7b7a7903045a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:06.849520 29364 raft_consensus.cc:2272] T a33a71a76c3446bc81028e6088bb456f P ac71a527733d4e97b26b7b7a7903045a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.851624 29364 tablet_replica.cc:333] T 5e798f66b3ee4250808a11df90a378da P ac71a527733d4e97b26b7b7a7903045a: stopping tablet replica
I20260709 13:13:06.852259 29364 raft_consensus.cc:2243] T 5e798f66b3ee4250808a11df90a378da P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.852684 29364 raft_consensus.cc:2272] T 5e798f66b3ee4250808a11df90a378da P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.854720 29364 tablet_replica.cc:333] T 66e24fd8f1554aa9aaaa0b2459ca1461 P ac71a527733d4e97b26b7b7a7903045a: stopping tablet replica
I20260709 13:13:06.855248 29364 raft_consensus.cc:2243] T 66e24fd8f1554aa9aaaa0b2459ca1461 P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.855659 29364 raft_consensus.cc:2272] T 66e24fd8f1554aa9aaaa0b2459ca1461 P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.857620 29364 tablet_replica.cc:333] T 4bba86af07534b5db67f5c4c214a7dd3 P ac71a527733d4e97b26b7b7a7903045a: stopping tablet replica
I20260709 13:13:06.858124 29364 raft_consensus.cc:2243] T 4bba86af07534b5db67f5c4c214a7dd3 P ac71a527733d4e97b26b7b7a7903045a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.858548 29364 raft_consensus.cc:2272] T 4bba86af07534b5db67f5c4c214a7dd3 P ac71a527733d4e97b26b7b7a7903045a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.860476 29364 tablet_replica.cc:333] T 42af7e00d58646a6b3a58a6fe0a4d155 P ac71a527733d4e97b26b7b7a7903045a: stopping tablet replica
I20260709 13:13:06.861009 29364 raft_consensus.cc:2243] T 42af7e00d58646a6b3a58a6fe0a4d155 P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.861410 29364 raft_consensus.cc:2272] T 42af7e00d58646a6b3a58a6fe0a4d155 P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.863205 29364 tablet_replica.cc:333] T 7cfc24257c5a4819b7d004d3ba696c3f P ac71a527733d4e97b26b7b7a7903045a: stopping tablet replica
I20260709 13:13:06.863760 29364 raft_consensus.cc:2243] T 7cfc24257c5a4819b7d004d3ba696c3f P ac71a527733d4e97b26b7b7a7903045a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:06.864626 29364 raft_consensus.cc:2272] T 7cfc24257c5a4819b7d004d3ba696c3f P ac71a527733d4e97b26b7b7a7903045a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.866629 29364 tablet_replica.cc:333] T 9fe8c15a65104cceaa416248b1f41a8f P ac71a527733d4e97b26b7b7a7903045a: stopping tablet replica
I20260709 13:13:06.867166 29364 raft_consensus.cc:2243] T 9fe8c15a65104cceaa416248b1f41a8f P ac71a527733d4e97b26b7b7a7903045a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.867573 29364 raft_consensus.cc:2272] T 9fe8c15a65104cceaa416248b1f41a8f P ac71a527733d4e97b26b7b7a7903045a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.869669 29364 tablet_replica.cc:333] T 4846b2cfc1c944acb68ffc05393ce201 P ac71a527733d4e97b26b7b7a7903045a: stopping tablet replica
I20260709 13:13:06.870136 29364 raft_consensus.cc:2243] T 4846b2cfc1c944acb68ffc05393ce201 P ac71a527733d4e97b26b7b7a7903045a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:06.870849 29364 raft_consensus.cc:2272] T 4846b2cfc1c944acb68ffc05393ce201 P ac71a527733d4e97b26b7b7a7903045a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.872737 29364 tablet_replica.cc:333] T 7b83e790f03848a880d9e09194fb5384 P ac71a527733d4e97b26b7b7a7903045a: stopping tablet replica
I20260709 13:13:06.873203 29364 raft_consensus.cc:2243] T 7b83e790f03848a880d9e09194fb5384 P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.873641 29364 raft_consensus.cc:2272] T 7b83e790f03848a880d9e09194fb5384 P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.875528 29364 tablet_replica.cc:333] T 85b78641da93463f839211c9ecf098c1 P ac71a527733d4e97b26b7b7a7903045a: stopping tablet replica
I20260709 13:13:06.876077 29364 raft_consensus.cc:2243] T 85b78641da93463f839211c9ecf098c1 P ac71a527733d4e97b26b7b7a7903045a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:06.876781 29364 raft_consensus.cc:2272] T 85b78641da93463f839211c9ecf098c1 P ac71a527733d4e97b26b7b7a7903045a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.878643 29364 tablet_replica.cc:333] T e0b1ea02768e411bb2b6341025336fa8 P ac71a527733d4e97b26b7b7a7903045a: stopping tablet replica
I20260709 13:13:06.879110 29364 raft_consensus.cc:2243] T e0b1ea02768e411bb2b6341025336fa8 P ac71a527733d4e97b26b7b7a7903045a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.879523 29364 raft_consensus.cc:2272] T e0b1ea02768e411bb2b6341025336fa8 P ac71a527733d4e97b26b7b7a7903045a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.881342 29364 tablet_replica.cc:333] T e1d810c81d024c829b673c74b3cf6434 P ac71a527733d4e97b26b7b7a7903045a: stopping tablet replica
I20260709 13:13:06.881788 29364 raft_consensus.cc:2243] T e1d810c81d024c829b673c74b3cf6434 P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:06.882200 29364 raft_consensus.cc:2272] T e1d810c81d024c829b673c74b3cf6434 P ac71a527733d4e97b26b7b7a7903045a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.884241 29364 tablet_replica.cc:333] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a: stopping tablet replica
I20260709 13:13:06.884682 29364 raft_consensus.cc:2243] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:06.885416 29364 raft_consensus.cc:2272] T 130cd9c0c9ae40db9d46446c69b7d38a P ac71a527733d4e97b26b7b7a7903045a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:06.930521 29364 tablet_server.cc:196] TabletServer@127.28.173.3:0 shutdown complete.
I20260709 13:13:06.982123 29364 master.cc:562] Master@127.28.173.62:36439 shutting down...
I20260709 13:13:07.018061 29364 raft_consensus.cc:2243] T 00000000000000000000000000000000 P db920ac05b3e46d6a9cb9539bad22704 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:07.018599 29364 raft_consensus.cc:2272] T 00000000000000000000000000000000 P db920ac05b3e46d6a9cb9539bad22704 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:07.018944 29364 tablet_replica.cc:333] T 00000000000000000000000000000000 P db920ac05b3e46d6a9cb9539bad22704: stopping tablet replica
I20260709 13:13:07.249213 29364 master.cc:584] Master@127.28.173.62:36439 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12878 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:13:07.304512 29364 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.28.173.62:38425
I20260709 13:13:07.305639 29364 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:07.311173  7273 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:07.311463  7272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:07.312906  7275 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:07.313687 29364 server_base.cc:1061] running on GCE node
I20260709 13:13:07.314659 29364 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:07.314896 29364 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:07.315085 29364 hybrid_clock.cc:648] HybridClock initialized: now 1783602787315056 us; error 0 us; skew 500 ppm
I20260709 13:13:07.315668 29364 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:07.318105 29364 webserver.cc:533] Webserver started at http://127.28.173.62:36479/ using document root <none> and password file <none>
I20260709 13:13:07.318624 29364 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:07.318823 29364 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:07.319108 29364 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:07.320286 29364 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602443945700-29364-0/minicluster-data/master-0-root/instance:
uuid: "878e61842f66468cbc5b35262f4dbda7"
format_stamp: "Formatted at 2026-07-09 13:13:07 on dist-test-slave-x62b"
I20260709 13:13:07.324651 29364 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 13:13:07.327967  7280 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:07.328828 29364 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:13:07.329062 29364 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602443945700-29364-0/minicluster-data/master-0-root
uuid: "878e61842f66468cbc5b35262f4dbda7"
format_stamp: "Formatted at 2026-07-09 13:13:07 on dist-test-slave-x62b"
I20260709 13:13:07.329310 29364 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602443945700-29364-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602443945700-29364-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602443945700-29364-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:07.348115 29364 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:07.349308 29364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:07.386780 29364 rpc_server.cc:307] RPC server started. Bound to: 127.28.173.62:38425
I20260709 13:13:07.386894  7331 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.173.62:38425 every 8 connection(s)
I20260709 13:13:07.391151  7332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:07.401789  7332 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 878e61842f66468cbc5b35262f4dbda7: Bootstrap starting.
I20260709 13:13:07.406565  7332 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 878e61842f66468cbc5b35262f4dbda7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:07.410856  7332 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 878e61842f66468cbc5b35262f4dbda7: No bootstrap required, opened a new log
I20260709 13:13:07.412981  7332 raft_consensus.cc:359] T 00000000000000000000000000000000 P 878e61842f66468cbc5b35262f4dbda7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "878e61842f66468cbc5b35262f4dbda7" member_type: VOTER }
I20260709 13:13:07.413388  7332 raft_consensus.cc:385] T 00000000000000000000000000000000 P 878e61842f66468cbc5b35262f4dbda7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:07.413643  7332 raft_consensus.cc:740] T 00000000000000000000000000000000 P 878e61842f66468cbc5b35262f4dbda7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 878e61842f66468cbc5b35262f4dbda7, State: Initialized, Role: FOLLOWER
I20260709 13:13:07.414319  7332 consensus_queue.cc:260] T 00000000000000000000000000000000 P 878e61842f66468cbc5b35262f4dbda7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "878e61842f66468cbc5b35262f4dbda7" member_type: VOTER }
I20260709 13:13:07.414779  7332 raft_consensus.cc:399] T 00000000000000000000000000000000 P 878e61842f66468cbc5b35262f4dbda7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:13:07.414996  7332 raft_consensus.cc:493] T 00000000000000000000000000000000 P 878e61842f66468cbc5b35262f4dbda7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:13:07.415309  7332 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 878e61842f66468cbc5b35262f4dbda7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:07.419888  7332 raft_consensus.cc:515] T 00000000000000000000000000000000 P 878e61842f66468cbc5b35262f4dbda7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "878e61842f66468cbc5b35262f4dbda7" member_type: VOTER }
I20260709 13:13:07.420405  7332 leader_election.cc:304] T 00000000000000000000000000000000 P 878e61842f66468cbc5b35262f4dbda7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 878e61842f66468cbc5b35262f4dbda7; no voters: 
I20260709 13:13:07.421536  7332 leader_election.cc:290] T 00000000000000000000000000000000 P 878e61842f66468cbc5b35262f4dbda7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:13:07.422080  7335 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 878e61842f66468cbc5b35262f4dbda7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:07.423465  7335 raft_consensus.cc:697] T 00000000000000000000000000000000 P 878e61842f66468cbc5b35262f4dbda7 [term 1 LEADER]: Becoming Leader. State: Replica: 878e61842f66468cbc5b35262f4dbda7, State: Running, Role: LEADER
I20260709 13:13:07.424185  7335 consensus_queue.cc:237] T 00000000000000000000000000000000 P 878e61842f66468cbc5b35262f4dbda7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "878e61842f66468cbc5b35262f4dbda7" member_type: VOTER }
I20260709 13:13:07.424410  7332 sys_catalog.cc:565] T 00000000000000000000000000000000 P 878e61842f66468cbc5b35262f4dbda7 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:13:07.429049  7337 sys_catalog.cc:455] T 00000000000000000000000000000000 P 878e61842f66468cbc5b35262f4dbda7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 878e61842f66468cbc5b35262f4dbda7. Latest consensus state: current_term: 1 leader_uuid: "878e61842f66468cbc5b35262f4dbda7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "878e61842f66468cbc5b35262f4dbda7" member_type: VOTER } }
I20260709 13:13:07.429809  7337 sys_catalog.cc:458] T 00000000000000000000000000000000 P 878e61842f66468cbc5b35262f4dbda7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:07.430814  7336 sys_catalog.cc:455] T 00000000000000000000000000000000 P 878e61842f66468cbc5b35262f4dbda7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "878e61842f66468cbc5b35262f4dbda7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "878e61842f66468cbc5b35262f4dbda7" member_type: VOTER } }
I20260709 13:13:07.431406  7336 sys_catalog.cc:458] T 00000000000000000000000000000000 P 878e61842f66468cbc5b35262f4dbda7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:07.431708  7343 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:13:07.436476  7343 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:13:07.439713 29364 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:13:07.444705  7343 catalog_manager.cc:1383] Generated new cluster ID: 49084f5674234eb5a45f2386753c3c16
I20260709 13:13:07.444977  7343 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:13:07.466980  7343 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:13:07.468314  7343 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:13:07.478832  7343 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 878e61842f66468cbc5b35262f4dbda7: Generated new TSK 0
I20260709 13:13:07.479414  7343 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:13:07.506158 29364 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:07.512049  7353 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:07.513075  7354 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:07.515166 29364 server_base.cc:1061] running on GCE node
W20260709 13:13:07.515457  7356 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:07.516451 29364 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:07.516661 29364 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:07.516850 29364 hybrid_clock.cc:648] HybridClock initialized: now 1783602787516815 us; error 0 us; skew 500 ppm
I20260709 13:13:07.517382 29364 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:07.519621 29364 webserver.cc:533] Webserver started at http://127.28.173.1:35101/ using document root <none> and password file <none>
I20260709 13:13:07.520108 29364 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:07.520298 29364 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:07.520591 29364 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:07.521612 29364 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602443945700-29364-0/minicluster-data/ts-0-root/instance:
uuid: "6892fe946cc9442eb2e1e21f1024b355"
format_stamp: "Formatted at 2026-07-09 13:13:07 on dist-test-slave-x62b"
I20260709 13:13:07.526050 29364 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:13:07.529312  7361 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:07.530236 29364 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:13:07.530612 29364 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602443945700-29364-0/minicluster-data/ts-0-root
uuid: "6892fe946cc9442eb2e1e21f1024b355"
format_stamp: "Formatted at 2026-07-09 13:13:07 on dist-test-slave-x62b"
I20260709 13:13:07.530977 29364 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602443945700-29364-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602443945700-29364-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602443945700-29364-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:07.550957 29364 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:07.552189 29364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:07.553665 29364 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:07.555934 29364 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:07.556186 29364 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:07.556434 29364 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:07.556632 29364 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:07.597949 29364 rpc_server.cc:307] RPC server started. Bound to: 127.28.173.1:45637
I20260709 13:13:07.598054  7423 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.173.1:45637 every 8 connection(s)
I20260709 13:13:07.603080 29364 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:07.610357  7428 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:07.613436  7429 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:07.616089  7424 heartbeater.cc:344] Connected to a master server at 127.28.173.62:38425
I20260709 13:13:07.616436 29364 server_base.cc:1061] running on GCE node
I20260709 13:13:07.616727  7424 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:07.617584  7424 heartbeater.cc:507] Master 127.28.173.62:38425 requested a full tablet report, sending...
W20260709 13:13:07.617673  7431 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:07.618685 29364 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:07.618888 29364 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:07.619063 29364 hybrid_clock.cc:648] HybridClock initialized: now 1783602787619032 us; error 0 us; skew 500 ppm
I20260709 13:13:07.619624 29364 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:07.619730  7297 ts_manager.cc:194] Registered new tserver with Master: 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637)
I20260709 13:13:07.621622  7297 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47696
I20260709 13:13:07.622367 29364 webserver.cc:533] Webserver started at http://127.28.173.2:45217/ using document root <none> and password file <none>
I20260709 13:13:07.622968 29364 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:07.623162 29364 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:07.623425 29364 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:07.624616 29364 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602443945700-29364-0/minicluster-data/ts-1-root/instance:
uuid: "9fb730dfb9d64542b1125a9f8ca64272"
format_stamp: "Formatted at 2026-07-09 13:13:07 on dist-test-slave-x62b"
I20260709 13:13:07.628886 29364 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:13:07.632189  7436 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:07.633055 29364 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:13:07.633333 29364 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602443945700-29364-0/minicluster-data/ts-1-root
uuid: "9fb730dfb9d64542b1125a9f8ca64272"
format_stamp: "Formatted at 2026-07-09 13:13:07 on dist-test-slave-x62b"
I20260709 13:13:07.633598 29364 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602443945700-29364-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602443945700-29364-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602443945700-29364-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:07.653231 29364 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:07.654347 29364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:07.655776 29364 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:07.657985 29364 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:07.658205 29364 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:07.658471 29364 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:07.658689 29364 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:07.699340 29364 rpc_server.cc:307] RPC server started. Bound to: 127.28.173.2:45941
I20260709 13:13:07.699468  7498 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.173.2:45941 every 8 connection(s)
I20260709 13:13:07.704138 29364 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:07.711267  7502 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:07.713001  7503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:07.714352  7505 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:07.715590 29364 server_base.cc:1061] running on GCE node
I20260709 13:13:07.716427  7499 heartbeater.cc:344] Connected to a master server at 127.28.173.62:38425
I20260709 13:13:07.716701 29364 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:13:07.716812  7499 heartbeater.cc:461] Registering TS with master...
W20260709 13:13:07.717000 29364 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:07.717268 29364 hybrid_clock.cc:648] HybridClock initialized: now 1783602787717249 us; error 0 us; skew 500 ppm
I20260709 13:13:07.717690  7499 heartbeater.cc:507] Master 127.28.173.62:38425 requested a full tablet report, sending...
I20260709 13:13:07.717849 29364 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:07.720038  7297 ts_manager.cc:194] Registered new tserver with Master: 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941)
I20260709 13:13:07.720548 29364 webserver.cc:533] Webserver started at http://127.28.173.3:39457/ using document root <none> and password file <none>
I20260709 13:13:07.721215 29364 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:07.721460 29364 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:07.721788 29364 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:07.721899  7297 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47710
I20260709 13:13:07.723275 29364 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602443945700-29364-0/minicluster-data/ts-2-root/instance:
uuid: "d5b9feaa36ef49c386775798c7fbba58"
format_stamp: "Formatted at 2026-07-09 13:13:07 on dist-test-slave-x62b"
I20260709 13:13:07.727965 29364 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:13:07.731070  7510 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:07.731904 29364 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:13:07.732347 29364 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602443945700-29364-0/minicluster-data/ts-2-root
uuid: "d5b9feaa36ef49c386775798c7fbba58"
format_stamp: "Formatted at 2026-07-09 13:13:07 on dist-test-slave-x62b"
I20260709 13:13:07.732685 29364 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602443945700-29364-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602443945700-29364-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskDxMQO6/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602443945700-29364-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:07.749534 29364 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:07.750622 29364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:07.752033 29364 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:07.754103 29364 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:07.754326 29364 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:07.754558 29364 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:07.754729 29364 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:07.793996 29364 rpc_server.cc:307] RPC server started. Bound to: 127.28.173.3:37251
I20260709 13:13:07.794133  7572 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.173.3:37251 every 8 connection(s)
I20260709 13:13:07.807507  7573 heartbeater.cc:344] Connected to a master server at 127.28.173.62:38425
I20260709 13:13:07.808013  7573 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:07.808755  7573 heartbeater.cc:507] Master 127.28.173.62:38425 requested a full tablet report, sending...
I20260709 13:13:07.810678  7297 ts_manager.cc:194] Registered new tserver with Master: d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:07.811483 29364 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01443368s
I20260709 13:13:07.812114  7297 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47724
I20260709 13:13:07.835868  7297 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47738:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:07.838343  7297 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:07.907104  7464 tablet_service.cc:1511] Processing CreateTablet for tablet 7c2d9c7b2731498fbe0f7d715f98583f (DEFAULT_TABLE table=test-workload [id=156e87a33f294808936d2d547fa29c46]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:07.908658  7464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c2d9c7b2731498fbe0f7d715f98583f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:07.911692  7460 tablet_service.cc:1511] Processing CreateTablet for tablet 3e8d0f65b3564feea4ae78a34ede70f3 (DEFAULT_TABLE table=test-workload [id=156e87a33f294808936d2d547fa29c46]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:07.913167  7460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e8d0f65b3564feea4ae78a34ede70f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:07.912904  7461 tablet_service.cc:1511] Processing CreateTablet for tablet 730c1374419e417286fca4006acf11a9 (DEFAULT_TABLE table=test-workload [id=156e87a33f294808936d2d547fa29c46]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:07.911701  7462 tablet_service.cc:1511] Processing CreateTablet for tablet 79da21344c24485d8cac81393166ecb2 (DEFAULT_TABLE table=test-workload [id=156e87a33f294808936d2d547fa29c46]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:07.914256  7461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 730c1374419e417286fca4006acf11a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:07.911228  7463 tablet_service.cc:1511] Processing CreateTablet for tablet 4d86b1ddf8a64589876c14f28419c2b0 (DEFAULT_TABLE table=test-workload [id=156e87a33f294808936d2d547fa29c46]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:07.915983  7463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d86b1ddf8a64589876c14f28419c2b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:07.917608  7462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79da21344c24485d8cac81393166ecb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:07.927826  7536 tablet_service.cc:1511] Processing CreateTablet for tablet 79da21344c24485d8cac81393166ecb2 (DEFAULT_TABLE table=test-workload [id=156e87a33f294808936d2d547fa29c46]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:07.928570  7538 tablet_service.cc:1511] Processing CreateTablet for tablet 7c2d9c7b2731498fbe0f7d715f98583f (DEFAULT_TABLE table=test-workload [id=156e87a33f294808936d2d547fa29c46]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:07.929260  7536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79da21344c24485d8cac81393166ecb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:07.929911  7538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c2d9c7b2731498fbe0f7d715f98583f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:07.932936  7534 tablet_service.cc:1511] Processing CreateTablet for tablet 3e8d0f65b3564feea4ae78a34ede70f3 (DEFAULT_TABLE table=test-workload [id=156e87a33f294808936d2d547fa29c46]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:07.934319  7534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e8d0f65b3564feea4ae78a34ede70f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:07.937086  7537 tablet_service.cc:1511] Processing CreateTablet for tablet 4d86b1ddf8a64589876c14f28419c2b0 (DEFAULT_TABLE table=test-workload [id=156e87a33f294808936d2d547fa29c46]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:07.938371  7537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d86b1ddf8a64589876c14f28419c2b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:07.931166  7535 tablet_service.cc:1511] Processing CreateTablet for tablet 730c1374419e417286fca4006acf11a9 (DEFAULT_TABLE table=test-workload [id=156e87a33f294808936d2d547fa29c46]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:07.943701  7535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 730c1374419e417286fca4006acf11a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:07.945338  7459 tablet_service.cc:1511] Processing CreateTablet for tablet b30fe0c3d3034035bddf8837a6489448 (DEFAULT_TABLE table=test-workload [id=156e87a33f294808936d2d547fa29c46]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:07.946614  7459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b30fe0c3d3034035bddf8837a6489448. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:07.959357  7533 tablet_service.cc:1511] Processing CreateTablet for tablet b30fe0c3d3034035bddf8837a6489448 (DEFAULT_TABLE table=test-workload [id=156e87a33f294808936d2d547fa29c46]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:07.960728  7533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b30fe0c3d3034035bddf8837a6489448. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:07.976722  7588 tablet_bootstrap.cc:492] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58: Bootstrap starting.
I20260709 13:13:07.978102  7587 tablet_bootstrap.cc:492] T 7c2d9c7b2731498fbe0f7d715f98583f P 9fb730dfb9d64542b1125a9f8ca64272: Bootstrap starting.
I20260709 13:13:07.989621  7535 tablet_service.cc:1511] Processing CreateTablet for tablet 791e0ec1608242b19b64b46991228864 (DEFAULT_TABLE table=test-workload [id=156e87a33f294808936d2d547fa29c46]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:07.990784  7587 tablet_bootstrap.cc:654] T 7c2d9c7b2731498fbe0f7d715f98583f P 9fb730dfb9d64542b1125a9f8ca64272: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:07.991381  7535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 791e0ec1608242b19b64b46991228864. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:07.993520  7461 tablet_service.cc:1511] Processing CreateTablet for tablet 791e0ec1608242b19b64b46991228864 (DEFAULT_TABLE table=test-workload [id=156e87a33f294808936d2d547fa29c46]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:07.994796  7461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 791e0ec1608242b19b64b46991228864. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:07.996146  7385 tablet_service.cc:1511] Processing CreateTablet for tablet 3e8d0f65b3564feea4ae78a34ede70f3 (DEFAULT_TABLE table=test-workload [id=156e87a33f294808936d2d547fa29c46]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:07.997494  7385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e8d0f65b3564feea4ae78a34ede70f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:07.997403  7387 tablet_service.cc:1511] Processing CreateTablet for tablet 79da21344c24485d8cac81393166ecb2 (DEFAULT_TABLE table=test-workload [id=156e87a33f294808936d2d547fa29c46]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:07.998750  7387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79da21344c24485d8cac81393166ecb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:08.001034  7384 tablet_service.cc:1511] Processing CreateTablet for tablet b30fe0c3d3034035bddf8837a6489448 (DEFAULT_TABLE table=test-workload [id=156e87a33f294808936d2d547fa29c46]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:08.002432  7384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b30fe0c3d3034035bddf8837a6489448. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:08.003328  7588 tablet_bootstrap.cc:654] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:08.005195  7386 tablet_service.cc:1511] Processing CreateTablet for tablet 730c1374419e417286fca4006acf11a9 (DEFAULT_TABLE table=test-workload [id=156e87a33f294808936d2d547fa29c46]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:08.007050  7386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 730c1374419e417286fca4006acf11a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:08.006804  7382 tablet_service.cc:1511] Processing CreateTablet for tablet 23201718ad6845f79123a5c755b9657a (DEFAULT_TABLE table=test-workload [id=156e87a33f294808936d2d547fa29c46]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:08.009408  7388 tablet_service.cc:1511] Processing CreateTablet for tablet 4d86b1ddf8a64589876c14f28419c2b0 (DEFAULT_TABLE table=test-workload [id=156e87a33f294808936d2d547fa29c46]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:08.011299  7462 tablet_service.cc:1511] Processing CreateTablet for tablet 23201718ad6845f79123a5c755b9657a (DEFAULT_TABLE table=test-workload [id=156e87a33f294808936d2d547fa29c46]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:08.012962  7462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23201718ad6845f79123a5c755b9657a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:08.014804  7389 tablet_service.cc:1511] Processing CreateTablet for tablet 7c2d9c7b2731498fbe0f7d715f98583f (DEFAULT_TABLE table=test-workload [id=156e87a33f294808936d2d547fa29c46]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:08.016151  7533 tablet_service.cc:1511] Processing CreateTablet for tablet 23201718ad6845f79123a5c755b9657a (DEFAULT_TABLE table=test-workload [id=156e87a33f294808936d2d547fa29c46]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:08.005276  7383 tablet_service.cc:1511] Processing CreateTablet for tablet 791e0ec1608242b19b64b46991228864 (DEFAULT_TABLE table=test-workload [id=156e87a33f294808936d2d547fa29c46]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:08.017860  7533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23201718ad6845f79123a5c755b9657a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:08.020691  7382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23201718ad6845f79123a5c755b9657a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:08.023638  7389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c2d9c7b2731498fbe0f7d715f98583f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:08.027302  7388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d86b1ddf8a64589876c14f28419c2b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:08.028223  7381 tablet_service.cc:1511] Processing CreateTablet for tablet 39685c4581dc4bf4a7eb1065a07df99e (DEFAULT_TABLE table=test-workload [id=156e87a33f294808936d2d547fa29c46]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:08.029506  7381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39685c4581dc4bf4a7eb1065a07df99e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:08.032051  7536 tablet_service.cc:1511] Processing CreateTablet for tablet 39685c4581dc4bf4a7eb1065a07df99e (DEFAULT_TABLE table=test-workload [id=156e87a33f294808936d2d547fa29c46]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:08.033710  7536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39685c4581dc4bf4a7eb1065a07df99e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:08.029451  7460 tablet_service.cc:1511] Processing CreateTablet for tablet 39685c4581dc4bf4a7eb1065a07df99e (DEFAULT_TABLE table=test-workload [id=156e87a33f294808936d2d547fa29c46]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:08.036397  7460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39685c4581dc4bf4a7eb1065a07df99e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:08.043991  7383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 791e0ec1608242b19b64b46991228864. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:08.072741  7588 tablet_bootstrap.cc:492] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58: No bootstrap required, opened a new log
I20260709 13:13:08.073426  7588 ts_tablet_manager.cc:1403] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58: Time spent bootstrapping tablet: real 0.097s	user 0.017s	sys 0.052s
I20260709 13:13:08.076646  7588 raft_consensus.cc:359] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } } peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } }
I20260709 13:13:08.100214  7588 raft_consensus.cc:385] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:08.102849  7588 raft_consensus.cc:740] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5b9feaa36ef49c386775798c7fbba58, State: Initialized, Role: FOLLOWER
I20260709 13:13:08.104791  7587 tablet_bootstrap.cc:492] T 7c2d9c7b2731498fbe0f7d715f98583f P 9fb730dfb9d64542b1125a9f8ca64272: No bootstrap required, opened a new log
I20260709 13:13:08.105350  7587 ts_tablet_manager.cc:1403] T 7c2d9c7b2731498fbe0f7d715f98583f P 9fb730dfb9d64542b1125a9f8ca64272: Time spent bootstrapping tablet: real 0.128s	user 0.019s	sys 0.020s
I20260709 13:13:08.106410  7588 consensus_queue.cc:260] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } } peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } }
I20260709 13:13:08.117457  7587 raft_consensus.cc:359] T 7c2d9c7b2731498fbe0f7d715f98583f P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } } peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } }
I20260709 13:13:08.118630  7587 raft_consensus.cc:385] T 7c2d9c7b2731498fbe0f7d715f98583f P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:08.119060  7587 raft_consensus.cc:740] T 7c2d9c7b2731498fbe0f7d715f98583f P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fb730dfb9d64542b1125a9f8ca64272, State: Initialized, Role: FOLLOWER
I20260709 13:13:08.120245  7587 consensus_queue.cc:260] T 7c2d9c7b2731498fbe0f7d715f98583f P 9fb730dfb9d64542b1125a9f8ca64272 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } } peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } }
I20260709 13:13:08.131407  7591 tablet_bootstrap.cc:492] T 39685c4581dc4bf4a7eb1065a07df99e P 6892fe946cc9442eb2e1e21f1024b355: Bootstrap starting.
I20260709 13:13:08.136893  7587 ts_tablet_manager.cc:1434] T 7c2d9c7b2731498fbe0f7d715f98583f P 9fb730dfb9d64542b1125a9f8ca64272: Time spent starting tablet: real 0.031s	user 0.018s	sys 0.004s
I20260709 13:13:08.137698  7499 heartbeater.cc:499] Master 127.28.173.62:38425 was elected leader, sending a full tablet report...
I20260709 13:13:08.138010  7587 tablet_bootstrap.cc:492] T 3e8d0f65b3564feea4ae78a34ede70f3 P 9fb730dfb9d64542b1125a9f8ca64272: Bootstrap starting.
I20260709 13:13:08.141661  7573 heartbeater.cc:499] Master 127.28.173.62:38425 was elected leader, sending a full tablet report...
I20260709 13:13:08.144670  7587 tablet_bootstrap.cc:654] T 3e8d0f65b3564feea4ae78a34ede70f3 P 9fb730dfb9d64542b1125a9f8ca64272: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:08.146063  7588 ts_tablet_manager.cc:1434] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58: Time spent starting tablet: real 0.072s	user 0.013s	sys 0.019s
I20260709 13:13:08.147193  7588 tablet_bootstrap.cc:492] T 4d86b1ddf8a64589876c14f28419c2b0 P d5b9feaa36ef49c386775798c7fbba58: Bootstrap starting.
I20260709 13:13:08.155093  7591 tablet_bootstrap.cc:654] T 39685c4581dc4bf4a7eb1065a07df99e P 6892fe946cc9442eb2e1e21f1024b355: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:08.155434  7588 tablet_bootstrap.cc:654] T 4d86b1ddf8a64589876c14f28419c2b0 P d5b9feaa36ef49c386775798c7fbba58: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:08.159256  7592 raft_consensus.cc:493] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.160136  7592 raft_consensus.cc:515] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } } peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } }
I20260709 13:13:08.171252  7591 tablet_bootstrap.cc:492] T 39685c4581dc4bf4a7eb1065a07df99e P 6892fe946cc9442eb2e1e21f1024b355: No bootstrap required, opened a new log
I20260709 13:13:08.171737  7587 tablet_bootstrap.cc:492] T 3e8d0f65b3564feea4ae78a34ede70f3 P 9fb730dfb9d64542b1125a9f8ca64272: No bootstrap required, opened a new log
I20260709 13:13:08.172540  7587 ts_tablet_manager.cc:1403] T 3e8d0f65b3564feea4ae78a34ede70f3 P 9fb730dfb9d64542b1125a9f8ca64272: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.012s
I20260709 13:13:08.171794  7591 ts_tablet_manager.cc:1403] T 39685c4581dc4bf4a7eb1065a07df99e P 6892fe946cc9442eb2e1e21f1024b355: Time spent bootstrapping tablet: real 0.041s	user 0.009s	sys 0.005s
I20260709 13:13:08.169291  7592 leader_election.cc:290] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941), 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637)
I20260709 13:13:08.190068  7587 raft_consensus.cc:359] T 3e8d0f65b3564feea4ae78a34ede70f3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.196062  7587 raft_consensus.cc:385] T 3e8d0f65b3564feea4ae78a34ede70f3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:08.196511  7587 raft_consensus.cc:740] T 3e8d0f65b3564feea4ae78a34ede70f3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fb730dfb9d64542b1125a9f8ca64272, State: Initialized, Role: FOLLOWER
I20260709 13:13:08.197578  7587 consensus_queue.cc:260] T 3e8d0f65b3564feea4ae78a34ede70f3 P 9fb730dfb9d64542b1125a9f8ca64272 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.190775  7591 raft_consensus.cc:359] T 39685c4581dc4bf4a7eb1065a07df99e P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.201666  7591 raft_consensus.cc:385] T 39685c4581dc4bf4a7eb1065a07df99e P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:08.201994  7591 raft_consensus.cc:740] T 39685c4581dc4bf4a7eb1065a07df99e P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6892fe946cc9442eb2e1e21f1024b355, State: Initialized, Role: FOLLOWER
I20260709 13:13:08.202353  7587 ts_tablet_manager.cc:1434] T 3e8d0f65b3564feea4ae78a34ede70f3 P 9fb730dfb9d64542b1125a9f8ca64272: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.003s
I20260709 13:13:08.204835  7587 tablet_bootstrap.cc:492] T 79da21344c24485d8cac81393166ecb2 P 9fb730dfb9d64542b1125a9f8ca64272: Bootstrap starting.
I20260709 13:13:08.204342  7591 consensus_queue.cc:260] T 39685c4581dc4bf4a7eb1065a07df99e P 6892fe946cc9442eb2e1e21f1024b355 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.207520  7399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2d9c7b2731498fbe0f7d715f98583f" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6892fe946cc9442eb2e1e21f1024b355" is_pre_election: true
I20260709 13:13:08.208446  7588 tablet_bootstrap.cc:492] T 4d86b1ddf8a64589876c14f28419c2b0 P d5b9feaa36ef49c386775798c7fbba58: No bootstrap required, opened a new log
I20260709 13:13:08.209022  7588 ts_tablet_manager.cc:1403] T 4d86b1ddf8a64589876c14f28419c2b0 P d5b9feaa36ef49c386775798c7fbba58: Time spent bootstrapping tablet: real 0.062s	user 0.033s	sys 0.024s
I20260709 13:13:08.209945  7474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2d9c7b2731498fbe0f7d715f98583f" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272" is_pre_election: true
W20260709 13:13:08.211009  7511 leader_election.cc:343] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:08.211673  7474 raft_consensus.cc:2468] T 7c2d9c7b2731498fbe0f7d715f98583f P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5b9feaa36ef49c386775798c7fbba58 in term 0.
I20260709 13:13:08.212375  7587 tablet_bootstrap.cc:654] T 79da21344c24485d8cac81393166ecb2 P 9fb730dfb9d64542b1125a9f8ca64272: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:08.212886  7511 leader_election.cc:304] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fb730dfb9d64542b1125a9f8ca64272, d5b9feaa36ef49c386775798c7fbba58; no voters: 6892fe946cc9442eb2e1e21f1024b355
I20260709 13:13:08.213798  7592 raft_consensus.cc:2804] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:08.214160  7592 raft_consensus.cc:493] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:08.214468  7592 raft_consensus.cc:3060] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:08.216770  7424 heartbeater.cc:499] Master 127.28.173.62:38425 was elected leader, sending a full tablet report...
I20260709 13:13:08.217720  7591 ts_tablet_manager.cc:1434] T 39685c4581dc4bf4a7eb1065a07df99e P 6892fe946cc9442eb2e1e21f1024b355: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.002s
I20260709 13:13:08.219084  7591 tablet_bootstrap.cc:492] T 23201718ad6845f79123a5c755b9657a P 6892fe946cc9442eb2e1e21f1024b355: Bootstrap starting.
I20260709 13:13:08.223533  7588 raft_consensus.cc:359] T 4d86b1ddf8a64589876c14f28419c2b0 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.224856  7588 raft_consensus.cc:385] T 4d86b1ddf8a64589876c14f28419c2b0 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:08.225260  7588 raft_consensus.cc:740] T 4d86b1ddf8a64589876c14f28419c2b0 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5b9feaa36ef49c386775798c7fbba58, State: Initialized, Role: FOLLOWER
I20260709 13:13:08.226394  7588 consensus_queue.cc:260] T 4d86b1ddf8a64589876c14f28419c2b0 P d5b9feaa36ef49c386775798c7fbba58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.226868  7592 raft_consensus.cc:515] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } } peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } }
I20260709 13:13:08.229723  7592 leader_election.cc:290] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 election: Requested vote from peers 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941), 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637)
I20260709 13:13:08.231280  7474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2d9c7b2731498fbe0f7d715f98583f" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272"
I20260709 13:13:08.233008  7474 raft_consensus.cc:3060] T 7c2d9c7b2731498fbe0f7d715f98583f P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:08.232131  7399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2d9c7b2731498fbe0f7d715f98583f" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6892fe946cc9442eb2e1e21f1024b355"
W20260709 13:13:08.237072  7511 leader_election.cc:343] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:08.241120  7591 tablet_bootstrap.cc:654] T 23201718ad6845f79123a5c755b9657a P 6892fe946cc9442eb2e1e21f1024b355: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:08.241142  7587 tablet_bootstrap.cc:492] T 79da21344c24485d8cac81393166ecb2 P 9fb730dfb9d64542b1125a9f8ca64272: No bootstrap required, opened a new log
I20260709 13:13:08.241909  7587 ts_tablet_manager.cc:1403] T 79da21344c24485d8cac81393166ecb2 P 9fb730dfb9d64542b1125a9f8ca64272: Time spent bootstrapping tablet: real 0.037s	user 0.020s	sys 0.013s
I20260709 13:13:08.241954  7474 raft_consensus.cc:2468] T 7c2d9c7b2731498fbe0f7d715f98583f P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5b9feaa36ef49c386775798c7fbba58 in term 1.
I20260709 13:13:08.246593  7511 leader_election.cc:304] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fb730dfb9d64542b1125a9f8ca64272, d5b9feaa36ef49c386775798c7fbba58; no voters: 6892fe946cc9442eb2e1e21f1024b355
I20260709 13:13:08.248003  7592 raft_consensus.cc:2804] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:08.247332  7587 raft_consensus.cc:359] T 79da21344c24485d8cac81393166ecb2 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.248742  7592 raft_consensus.cc:697] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 [term 1 LEADER]: Becoming Leader. State: Replica: d5b9feaa36ef49c386775798c7fbba58, State: Running, Role: LEADER
I20260709 13:13:08.249706  7592 consensus_queue.cc:237] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } } peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } }
I20260709 13:13:08.250449  7588 ts_tablet_manager.cc:1434] T 4d86b1ddf8a64589876c14f28419c2b0 P d5b9feaa36ef49c386775798c7fbba58: Time spent starting tablet: real 0.041s	user 0.011s	sys 0.004s
I20260709 13:13:08.251477  7588 tablet_bootstrap.cc:492] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58: Bootstrap starting.
I20260709 13:13:08.252650  7591 tablet_bootstrap.cc:492] T 23201718ad6845f79123a5c755b9657a P 6892fe946cc9442eb2e1e21f1024b355: No bootstrap required, opened a new log
I20260709 13:13:08.253185  7591 ts_tablet_manager.cc:1403] T 23201718ad6845f79123a5c755b9657a P 6892fe946cc9442eb2e1e21f1024b355: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.005s
I20260709 13:13:08.254298  7587 raft_consensus.cc:385] T 79da21344c24485d8cac81393166ecb2 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:08.255005  7587 raft_consensus.cc:740] T 79da21344c24485d8cac81393166ecb2 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fb730dfb9d64542b1125a9f8ca64272, State: Initialized, Role: FOLLOWER
I20260709 13:13:08.256057  7591 raft_consensus.cc:359] T 23201718ad6845f79123a5c755b9657a P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.256867  7591 raft_consensus.cc:385] T 23201718ad6845f79123a5c755b9657a P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:08.257293  7591 raft_consensus.cc:740] T 23201718ad6845f79123a5c755b9657a P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6892fe946cc9442eb2e1e21f1024b355, State: Initialized, Role: FOLLOWER
I20260709 13:13:08.257982  7591 consensus_queue.cc:260] T 23201718ad6845f79123a5c755b9657a P 6892fe946cc9442eb2e1e21f1024b355 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.258761  7588 tablet_bootstrap.cc:654] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:08.259960  7591 ts_tablet_manager.cc:1434] T 23201718ad6845f79123a5c755b9657a P 6892fe946cc9442eb2e1e21f1024b355: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:13:08.260921  7591 tablet_bootstrap.cc:492] T 79da21344c24485d8cac81393166ecb2 P 6892fe946cc9442eb2e1e21f1024b355: Bootstrap starting.
I20260709 13:13:08.267175  7591 tablet_bootstrap.cc:654] T 79da21344c24485d8cac81393166ecb2 P 6892fe946cc9442eb2e1e21f1024b355: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:08.256763  7587 consensus_queue.cc:260] T 79da21344c24485d8cac81393166ecb2 P 9fb730dfb9d64542b1125a9f8ca64272 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.269436  7587 ts_tablet_manager.cc:1434] T 79da21344c24485d8cac81393166ecb2 P 9fb730dfb9d64542b1125a9f8ca64272: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:13:08.270412  7587 tablet_bootstrap.cc:492] T 730c1374419e417286fca4006acf11a9 P 9fb730dfb9d64542b1125a9f8ca64272: Bootstrap starting.
I20260709 13:13:08.274935  7587 tablet_bootstrap.cc:654] T 730c1374419e417286fca4006acf11a9 P 9fb730dfb9d64542b1125a9f8ca64272: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:08.273918  7295 catalog_manager.cc:5697] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 reported cstate change: term changed from 0 to 1, leader changed from <none> to d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3). New cstate: current_term: 1 leader_uuid: "d5b9feaa36ef49c386775798c7fbba58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:08.278733  7588 tablet_bootstrap.cc:492] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58: No bootstrap required, opened a new log
I20260709 13:13:08.279263  7588 ts_tablet_manager.cc:1403] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.007s
I20260709 13:13:08.282330  7588 raft_consensus.cc:359] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.283200  7588 raft_consensus.cc:385] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:08.283546  7588 raft_consensus.cc:740] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5b9feaa36ef49c386775798c7fbba58, State: Initialized, Role: FOLLOWER
I20260709 13:13:08.284456  7588 consensus_queue.cc:260] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.286850  7588 ts_tablet_manager.cc:1434] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:08.289249  7588 tablet_bootstrap.cc:492] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58: Bootstrap starting.
I20260709 13:13:08.289551  7593 raft_consensus.cc:493] T 3e8d0f65b3564feea4ae78a34ede70f3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.290055  7593 raft_consensus.cc:515] T 3e8d0f65b3564feea4ae78a34ede70f3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.291081  7587 tablet_bootstrap.cc:492] T 730c1374419e417286fca4006acf11a9 P 9fb730dfb9d64542b1125a9f8ca64272: No bootstrap required, opened a new log
I20260709 13:13:08.291589  7587 ts_tablet_manager.cc:1403] T 730c1374419e417286fca4006acf11a9 P 9fb730dfb9d64542b1125a9f8ca64272: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.011s
I20260709 13:13:08.294621  7587 raft_consensus.cc:359] T 730c1374419e417286fca4006acf11a9 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.295771  7588 tablet_bootstrap.cc:654] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:08.295719  7587 raft_consensus.cc:385] T 730c1374419e417286fca4006acf11a9 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:08.296506  7587 raft_consensus.cc:740] T 730c1374419e417286fca4006acf11a9 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fb730dfb9d64542b1125a9f8ca64272, State: Initialized, Role: FOLLOWER
I20260709 13:13:08.297575  7587 consensus_queue.cc:260] T 730c1374419e417286fca4006acf11a9 P 9fb730dfb9d64542b1125a9f8ca64272 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.302210  7591 tablet_bootstrap.cc:492] T 79da21344c24485d8cac81393166ecb2 P 6892fe946cc9442eb2e1e21f1024b355: No bootstrap required, opened a new log
I20260709 13:13:08.302878  7591 ts_tablet_manager.cc:1403] T 79da21344c24485d8cac81393166ecb2 P 6892fe946cc9442eb2e1e21f1024b355: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.007s
I20260709 13:13:08.292791  7593 leader_election.cc:290] T 3e8d0f65b3564feea4ae78a34ede70f3 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:08.305840  7588 tablet_bootstrap.cc:492] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58: No bootstrap required, opened a new log
I20260709 13:13:08.306388  7588 ts_tablet_manager.cc:1403] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.001s
I20260709 13:13:08.306915  7591 raft_consensus.cc:359] T 79da21344c24485d8cac81393166ecb2 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.309406  7588 raft_consensus.cc:359] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.312099  7587 ts_tablet_manager.cc:1434] T 730c1374419e417286fca4006acf11a9 P 9fb730dfb9d64542b1125a9f8ca64272: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.012s
I20260709 13:13:08.313702  7591 raft_consensus.cc:385] T 79da21344c24485d8cac81393166ecb2 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:08.313894  7588 raft_consensus.cc:385] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:08.314065  7591 raft_consensus.cc:740] T 79da21344c24485d8cac81393166ecb2 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6892fe946cc9442eb2e1e21f1024b355, State: Initialized, Role: FOLLOWER
I20260709 13:13:08.314303  7588 raft_consensus.cc:740] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5b9feaa36ef49c386775798c7fbba58, State: Initialized, Role: FOLLOWER
I20260709 13:13:08.314682  7587 tablet_bootstrap.cc:492] T 23201718ad6845f79123a5c755b9657a P 9fb730dfb9d64542b1125a9f8ca64272: Bootstrap starting.
I20260709 13:13:08.315135  7591 consensus_queue.cc:260] T 79da21344c24485d8cac81393166ecb2 P 6892fe946cc9442eb2e1e21f1024b355 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.315162  7588 consensus_queue.cc:260] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.318017  7588 ts_tablet_manager.cc:1434] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:13:08.318642  7592 raft_consensus.cc:493] T 4d86b1ddf8a64589876c14f28419c2b0 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.319133  7592 raft_consensus.cc:515] T 4d86b1ddf8a64589876c14f28419c2b0 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.319994  7591 ts_tablet_manager.cc:1434] T 79da21344c24485d8cac81393166ecb2 P 6892fe946cc9442eb2e1e21f1024b355: Time spent starting tablet: real 0.017s	user 0.011s	sys 0.001s
I20260709 13:13:08.321125  7591 tablet_bootstrap.cc:492] T 730c1374419e417286fca4006acf11a9 P 6892fe946cc9442eb2e1e21f1024b355: Bootstrap starting.
I20260709 13:13:08.321236  7592 leader_election.cc:290] T 4d86b1ddf8a64589876c14f28419c2b0 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941)
I20260709 13:13:08.323093  7399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d86b1ddf8a64589876c14f28419c2b0" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6892fe946cc9442eb2e1e21f1024b355" is_pre_election: true
I20260709 13:13:08.324806  7474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d86b1ddf8a64589876c14f28419c2b0" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272" is_pre_election: true
W20260709 13:13:08.325071  7511 leader_election.cc:343] T 4d86b1ddf8a64589876c14f28419c2b0 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:08.326236  7588 tablet_bootstrap.cc:492] T b30fe0c3d3034035bddf8837a6489448 P d5b9feaa36ef49c386775798c7fbba58: Bootstrap starting.
W20260709 13:13:08.326355  7511 leader_election.cc:343] T 4d86b1ddf8a64589876c14f28419c2b0 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:08.326838  7511 leader_election.cc:304] T 4d86b1ddf8a64589876c14f28419c2b0 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5b9feaa36ef49c386775798c7fbba58; no voters: 6892fe946cc9442eb2e1e21f1024b355, 9fb730dfb9d64542b1125a9f8ca64272
I20260709 13:13:08.327912  7592 raft_consensus.cc:2749] T 4d86b1ddf8a64589876c14f28419c2b0 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:08.330119  7587 tablet_bootstrap.cc:654] T 23201718ad6845f79123a5c755b9657a P 9fb730dfb9d64542b1125a9f8ca64272: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:08.332607  7591 tablet_bootstrap.cc:654] T 730c1374419e417286fca4006acf11a9 P 6892fe946cc9442eb2e1e21f1024b355: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:08.333823  7588 tablet_bootstrap.cc:654] T b30fe0c3d3034035bddf8837a6489448 P d5b9feaa36ef49c386775798c7fbba58: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:08.336649  7592 raft_consensus.cc:493] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.337136  7592 raft_consensus.cc:515] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.339160  7592 leader_election.cc:290] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941)
I20260709 13:13:08.340523  7548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8d0f65b3564feea4ae78a34ede70f3" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5b9feaa36ef49c386775798c7fbba58" is_pre_election: true
I20260709 13:13:08.342530  7399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "730c1374419e417286fca4006acf11a9" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6892fe946cc9442eb2e1e21f1024b355" is_pre_election: true
W20260709 13:13:08.343750  7437 leader_election.cc:343] T 3e8d0f65b3564feea4ae78a34ede70f3 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:08.344867  7511 leader_election.cc:343] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:08.345664  7587 tablet_bootstrap.cc:492] T 23201718ad6845f79123a5c755b9657a P 9fb730dfb9d64542b1125a9f8ca64272: No bootstrap required, opened a new log
I20260709 13:13:08.346382  7587 ts_tablet_manager.cc:1403] T 23201718ad6845f79123a5c755b9657a P 9fb730dfb9d64542b1125a9f8ca64272: Time spent bootstrapping tablet: real 0.032s	user 0.001s	sys 0.015s
I20260709 13:13:08.346204  7474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "730c1374419e417286fca4006acf11a9" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272" is_pre_election: true
I20260709 13:13:08.347067  7474 raft_consensus.cc:2468] T 730c1374419e417286fca4006acf11a9 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5b9feaa36ef49c386775798c7fbba58 in term 0.
I20260709 13:13:08.348753  7511 leader_election.cc:304] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fb730dfb9d64542b1125a9f8ca64272, d5b9feaa36ef49c386775798c7fbba58; no voters: 6892fe946cc9442eb2e1e21f1024b355
I20260709 13:13:08.350195  7592 raft_consensus.cc:2804] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:08.350598  7592 raft_consensus.cc:493] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:08.350631  7399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8d0f65b3564feea4ae78a34ede70f3" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6892fe946cc9442eb2e1e21f1024b355" is_pre_election: true
I20260709 13:13:08.351217  7592 raft_consensus.cc:3060] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:08.352626  7437 leader_election.cc:343] T 3e8d0f65b3564feea4ae78a34ede70f3 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:08.353195  7437 leader_election.cc:304] T 3e8d0f65b3564feea4ae78a34ede70f3 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fb730dfb9d64542b1125a9f8ca64272; no voters: 6892fe946cc9442eb2e1e21f1024b355, d5b9feaa36ef49c386775798c7fbba58
I20260709 13:13:08.354674  7593 raft_consensus.cc:2749] T 3e8d0f65b3564feea4ae78a34ede70f3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:08.361654  7588 tablet_bootstrap.cc:492] T b30fe0c3d3034035bddf8837a6489448 P d5b9feaa36ef49c386775798c7fbba58: No bootstrap required, opened a new log
I20260709 13:13:08.362157  7588 ts_tablet_manager.cc:1403] T b30fe0c3d3034035bddf8837a6489448 P d5b9feaa36ef49c386775798c7fbba58: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.010s
I20260709 13:13:08.362206  7592 raft_consensus.cc:515] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.364775  7588 raft_consensus.cc:359] T b30fe0c3d3034035bddf8837a6489448 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.365370  7588 raft_consensus.cc:385] T b30fe0c3d3034035bddf8837a6489448 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:08.365609  7588 raft_consensus.cc:740] T b30fe0c3d3034035bddf8837a6489448 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5b9feaa36ef49c386775798c7fbba58, State: Initialized, Role: FOLLOWER
I20260709 13:13:08.366374  7591 tablet_bootstrap.cc:492] T 730c1374419e417286fca4006acf11a9 P 6892fe946cc9442eb2e1e21f1024b355: No bootstrap required, opened a new log
I20260709 13:13:08.366284  7588 consensus_queue.cc:260] T b30fe0c3d3034035bddf8837a6489448 P d5b9feaa36ef49c386775798c7fbba58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.366915  7591 ts_tablet_manager.cc:1403] T 730c1374419e417286fca4006acf11a9 P 6892fe946cc9442eb2e1e21f1024b355: Time spent bootstrapping tablet: real 0.046s	user 0.022s	sys 0.014s
I20260709 13:13:08.366547  7587 raft_consensus.cc:359] T 23201718ad6845f79123a5c755b9657a P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.367384  7587 raft_consensus.cc:385] T 23201718ad6845f79123a5c755b9657a P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:08.367710  7587 raft_consensus.cc:740] T 23201718ad6845f79123a5c755b9657a P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fb730dfb9d64542b1125a9f8ca64272, State: Initialized, Role: FOLLOWER
I20260709 13:13:08.368129  7598 raft_consensus.cc:493] T 39685c4581dc4bf4a7eb1065a07df99e P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.368657  7598 raft_consensus.cc:515] T 39685c4581dc4bf4a7eb1065a07df99e P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.369832  7474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "730c1374419e417286fca4006acf11a9" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272"
I20260709 13:13:08.370412  7474 raft_consensus.cc:3060] T 730c1374419e417286fca4006acf11a9 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:08.371146  7598 leader_election.cc:290] T 39685c4581dc4bf4a7eb1065a07df99e P 6892fe946cc9442eb2e1e21f1024b355 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:08.371678  7598 raft_consensus.cc:493] T 23201718ad6845f79123a5c755b9657a P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.372634  7598 raft_consensus.cc:515] T 23201718ad6845f79123a5c755b9657a P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.373323  7399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "730c1374419e417286fca4006acf11a9" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6892fe946cc9442eb2e1e21f1024b355"
I20260709 13:13:08.374557  7598 leader_election.cc:290] T 23201718ad6845f79123a5c755b9657a P 6892fe946cc9442eb2e1e21f1024b355 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:08.368678  7587 consensus_queue.cc:260] T 23201718ad6845f79123a5c755b9657a P 9fb730dfb9d64542b1125a9f8ca64272 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
W20260709 13:13:08.375771  7511 leader_election.cc:343] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:08.377171  7587 ts_tablet_manager.cc:1434] T 23201718ad6845f79123a5c755b9657a P 9fb730dfb9d64542b1125a9f8ca64272: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.003s
I20260709 13:13:08.377667  7591 raft_consensus.cc:359] T 730c1374419e417286fca4006acf11a9 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.378130  7588 ts_tablet_manager.cc:1434] T b30fe0c3d3034035bddf8837a6489448 P d5b9feaa36ef49c386775798c7fbba58: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.006s
I20260709 13:13:08.378384  7587 tablet_bootstrap.cc:492] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272: Bootstrap starting.
I20260709 13:13:08.380591  7591 raft_consensus.cc:385] T 730c1374419e417286fca4006acf11a9 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:08.381462  7591 raft_consensus.cc:740] T 730c1374419e417286fca4006acf11a9 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6892fe946cc9442eb2e1e21f1024b355, State: Initialized, Role: FOLLOWER
I20260709 13:13:08.382519  7474 raft_consensus.cc:2468] T 730c1374419e417286fca4006acf11a9 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5b9feaa36ef49c386775798c7fbba58 in term 1.
I20260709 13:13:08.383440  7592 leader_election.cc:290] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 election: Requested vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941)
I20260709 13:13:08.383266  7591 consensus_queue.cc:260] T 730c1374419e417286fca4006acf11a9 P 6892fe946cc9442eb2e1e21f1024b355 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.387328  7591 ts_tablet_manager.cc:1434] T 730c1374419e417286fca4006acf11a9 P 6892fe946cc9442eb2e1e21f1024b355: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 13:13:08.387761  7587 tablet_bootstrap.cc:654] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:08.388705  7511 leader_election.cc:304] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fb730dfb9d64542b1125a9f8ca64272, d5b9feaa36ef49c386775798c7fbba58; no voters: 6892fe946cc9442eb2e1e21f1024b355
I20260709 13:13:08.390471  7588 tablet_bootstrap.cc:492] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58: Bootstrap starting.
I20260709 13:13:08.392566  7591 tablet_bootstrap.cc:492] T 4d86b1ddf8a64589876c14f28419c2b0 P 6892fe946cc9442eb2e1e21f1024b355: Bootstrap starting.
I20260709 13:13:08.399019  7591 tablet_bootstrap.cc:654] T 4d86b1ddf8a64589876c14f28419c2b0 P 6892fe946cc9442eb2e1e21f1024b355: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:08.399487  7592 raft_consensus.cc:2804] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:08.404217  7592 raft_consensus.cc:697] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58 [term 1 LEADER]: Becoming Leader. State: Replica: d5b9feaa36ef49c386775798c7fbba58, State: Running, Role: LEADER
I20260709 13:13:08.405143  7592 consensus_queue.cc:237] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.399788  7588 tablet_bootstrap.cc:654] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:08.402858  7587 tablet_bootstrap.cc:492] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272: No bootstrap required, opened a new log
I20260709 13:13:08.414669  7587 ts_tablet_manager.cc:1403] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.005s
I20260709 13:13:08.416100  7473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23201718ad6845f79123a5c755b9657a" candidate_uuid: "6892fe946cc9442eb2e1e21f1024b355" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272" is_pre_election: true
I20260709 13:13:08.416831  7473 raft_consensus.cc:2468] T 23201718ad6845f79123a5c755b9657a P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6892fe946cc9442eb2e1e21f1024b355 in term 0.
I20260709 13:13:08.416124  7474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39685c4581dc4bf4a7eb1065a07df99e" candidate_uuid: "6892fe946cc9442eb2e1e21f1024b355" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272" is_pre_election: true
I20260709 13:13:08.417778  7587 raft_consensus.cc:359] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.421407  7587 raft_consensus.cc:385] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:08.421728  7587 raft_consensus.cc:740] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fb730dfb9d64542b1125a9f8ca64272, State: Initialized, Role: FOLLOWER
I20260709 13:13:08.422453  7587 consensus_queue.cc:260] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.424758  7587 ts_tablet_manager.cc:1434] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 13:13:08.424551  7296 catalog_manager.cc:5697] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58 reported cstate change: term changed from 0 to 1, leader changed from <none> to d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3). New cstate: current_term: 1 leader_uuid: "d5b9feaa36ef49c386775798c7fbba58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:08.425954  7587 tablet_bootstrap.cc:492] T 39685c4581dc4bf4a7eb1065a07df99e P 9fb730dfb9d64542b1125a9f8ca64272: Bootstrap starting.
I20260709 13:13:08.417665  7591 tablet_bootstrap.cc:492] T 4d86b1ddf8a64589876c14f28419c2b0 P 6892fe946cc9442eb2e1e21f1024b355: No bootstrap required, opened a new log
I20260709 13:13:08.419234  7362 leader_election.cc:304] T 23201718ad6845f79123a5c755b9657a P 6892fe946cc9442eb2e1e21f1024b355 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6892fe946cc9442eb2e1e21f1024b355, 9fb730dfb9d64542b1125a9f8ca64272; no voters: 
I20260709 13:13:08.428459  7598 raft_consensus.cc:2804] T 23201718ad6845f79123a5c755b9657a P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:08.428894  7598 raft_consensus.cc:493] T 23201718ad6845f79123a5c755b9657a P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:08.429241  7598 raft_consensus.cc:3060] T 23201718ad6845f79123a5c755b9657a P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:08.431499  7588 tablet_bootstrap.cc:492] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58: No bootstrap required, opened a new log
I20260709 13:13:08.432053  7588 ts_tablet_manager.cc:1403] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58: Time spent bootstrapping tablet: real 0.042s	user 0.020s	sys 0.000s
I20260709 13:13:08.435218  7588 raft_consensus.cc:359] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
W20260709 13:13:08.435647  7345 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:08.435999  7588 raft_consensus.cc:385] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:08.436381  7588 raft_consensus.cc:740] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5b9feaa36ef49c386775798c7fbba58, State: Initialized, Role: FOLLOWER
W20260709 13:13:08.436507  7362 leader_election.cc:343] T 39685c4581dc4bf4a7eb1065a07df99e P 6892fe946cc9442eb2e1e21f1024b355 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:08.437258  7588 consensus_queue.cc:260] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.438314  7548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39685c4581dc4bf4a7eb1065a07df99e" candidate_uuid: "6892fe946cc9442eb2e1e21f1024b355" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5b9feaa36ef49c386775798c7fbba58" is_pre_election: true
I20260709 13:13:08.440407  7588 ts_tablet_manager.cc:1434] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:13:08.440975  7591 ts_tablet_manager.cc:1403] T 4d86b1ddf8a64589876c14f28419c2b0 P 6892fe946cc9442eb2e1e21f1024b355: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.011s
I20260709 13:13:08.441550  7598 raft_consensus.cc:515] T 23201718ad6845f79123a5c755b9657a P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
W20260709 13:13:08.442060  7362 leader_election.cc:343] T 39685c4581dc4bf4a7eb1065a07df99e P 6892fe946cc9442eb2e1e21f1024b355 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:08.442723  7362 leader_election.cc:304] T 39685c4581dc4bf4a7eb1065a07df99e P 6892fe946cc9442eb2e1e21f1024b355 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6892fe946cc9442eb2e1e21f1024b355; no voters: 9fb730dfb9d64542b1125a9f8ca64272, d5b9feaa36ef49c386775798c7fbba58
I20260709 13:13:08.443853  7613 raft_consensus.cc:2749] T 39685c4581dc4bf4a7eb1065a07df99e P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:08.443966  7591 raft_consensus.cc:359] T 4d86b1ddf8a64589876c14f28419c2b0 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.444689  7591 raft_consensus.cc:385] T 4d86b1ddf8a64589876c14f28419c2b0 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:08.444836  7598 leader_election.cc:290] T 23201718ad6845f79123a5c755b9657a P 6892fe946cc9442eb2e1e21f1024b355 [CANDIDATE]: Term 1 election: Requested vote from peers 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:08.445032  7591 raft_consensus.cc:740] T 4d86b1ddf8a64589876c14f28419c2b0 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6892fe946cc9442eb2e1e21f1024b355, State: Initialized, Role: FOLLOWER
I20260709 13:13:08.445897  7547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23201718ad6845f79123a5c755b9657a" candidate_uuid: "6892fe946cc9442eb2e1e21f1024b355" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5b9feaa36ef49c386775798c7fbba58" is_pre_election: true
I20260709 13:13:08.447427  7474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23201718ad6845f79123a5c755b9657a" candidate_uuid: "6892fe946cc9442eb2e1e21f1024b355" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272"
I20260709 13:13:08.447674  7588 tablet_bootstrap.cc:492] T 39685c4581dc4bf4a7eb1065a07df99e P d5b9feaa36ef49c386775798c7fbba58: Bootstrap starting.
I20260709 13:13:08.448053  7474 raft_consensus.cc:3060] T 23201718ad6845f79123a5c755b9657a P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:08.448202  7547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23201718ad6845f79123a5c755b9657a" candidate_uuid: "6892fe946cc9442eb2e1e21f1024b355" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5b9feaa36ef49c386775798c7fbba58"
W20260709 13:13:08.449540  7362 leader_election.cc:343] T 23201718ad6845f79123a5c755b9657a P 6892fe946cc9442eb2e1e21f1024b355 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:08.450417  7362 leader_election.cc:343] T 23201718ad6845f79123a5c755b9657a P 6892fe946cc9442eb2e1e21f1024b355 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:08.445940  7591 consensus_queue.cc:260] T 4d86b1ddf8a64589876c14f28419c2b0 P 6892fe946cc9442eb2e1e21f1024b355 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.451371  7587 tablet_bootstrap.cc:654] T 39685c4581dc4bf4a7eb1065a07df99e P 9fb730dfb9d64542b1125a9f8ca64272: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:08.454506  7588 tablet_bootstrap.cc:654] T 39685c4581dc4bf4a7eb1065a07df99e P d5b9feaa36ef49c386775798c7fbba58: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:08.457913  7474 raft_consensus.cc:2468] T 23201718ad6845f79123a5c755b9657a P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6892fe946cc9442eb2e1e21f1024b355 in term 1.
I20260709 13:13:08.459146  7362 leader_election.cc:304] T 23201718ad6845f79123a5c755b9657a P 6892fe946cc9442eb2e1e21f1024b355 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6892fe946cc9442eb2e1e21f1024b355, 9fb730dfb9d64542b1125a9f8ca64272; no voters: d5b9feaa36ef49c386775798c7fbba58
I20260709 13:13:08.459492  7591 ts_tablet_manager.cc:1434] T 4d86b1ddf8a64589876c14f28419c2b0 P 6892fe946cc9442eb2e1e21f1024b355: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:13:08.460598  7591 tablet_bootstrap.cc:492] T 791e0ec1608242b19b64b46991228864 P 6892fe946cc9442eb2e1e21f1024b355: Bootstrap starting.
I20260709 13:13:08.463690  7598 raft_consensus.cc:2804] T 23201718ad6845f79123a5c755b9657a P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:08.464305  7598 raft_consensus.cc:697] T 23201718ad6845f79123a5c755b9657a P 6892fe946cc9442eb2e1e21f1024b355 [term 1 LEADER]: Becoming Leader. State: Replica: 6892fe946cc9442eb2e1e21f1024b355, State: Running, Role: LEADER
I20260709 13:13:08.465191  7598 consensus_queue.cc:237] T 23201718ad6845f79123a5c755b9657a P 6892fe946cc9442eb2e1e21f1024b355 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.469321  7591 tablet_bootstrap.cc:654] T 791e0ec1608242b19b64b46991228864 P 6892fe946cc9442eb2e1e21f1024b355: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:08.469466  7588 tablet_bootstrap.cc:492] T 39685c4581dc4bf4a7eb1065a07df99e P d5b9feaa36ef49c386775798c7fbba58: No bootstrap required, opened a new log
I20260709 13:13:08.470049  7588 ts_tablet_manager.cc:1403] T 39685c4581dc4bf4a7eb1065a07df99e P d5b9feaa36ef49c386775798c7fbba58: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.001s
I20260709 13:13:08.473222  7588 raft_consensus.cc:359] T 39685c4581dc4bf4a7eb1065a07df99e P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.474038  7588 raft_consensus.cc:385] T 39685c4581dc4bf4a7eb1065a07df99e P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:08.474483  7588 raft_consensus.cc:740] T 39685c4581dc4bf4a7eb1065a07df99e P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5b9feaa36ef49c386775798c7fbba58, State: Initialized, Role: FOLLOWER
I20260709 13:13:08.475656  7588 consensus_queue.cc:260] T 39685c4581dc4bf4a7eb1065a07df99e P d5b9feaa36ef49c386775798c7fbba58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.478315  7588 ts_tablet_manager.cc:1434] T 39685c4581dc4bf4a7eb1065a07df99e P d5b9feaa36ef49c386775798c7fbba58: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:13:08.479790  7588 tablet_bootstrap.cc:492] T 23201718ad6845f79123a5c755b9657a P d5b9feaa36ef49c386775798c7fbba58: Bootstrap starting.
I20260709 13:13:08.481273  7587 tablet_bootstrap.cc:492] T 39685c4581dc4bf4a7eb1065a07df99e P 9fb730dfb9d64542b1125a9f8ca64272: No bootstrap required, opened a new log
I20260709 13:13:08.481869  7587 ts_tablet_manager.cc:1403] T 39685c4581dc4bf4a7eb1065a07df99e P 9fb730dfb9d64542b1125a9f8ca64272: Time spent bootstrapping tablet: real 0.056s	user 0.015s	sys 0.004s
I20260709 13:13:08.482118  7295 catalog_manager.cc:5697] T 23201718ad6845f79123a5c755b9657a P 6892fe946cc9442eb2e1e21f1024b355 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "6892fe946cc9442eb2e1e21f1024b355" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:08.484930  7587 raft_consensus.cc:359] T 39685c4581dc4bf4a7eb1065a07df99e P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.485671  7587 raft_consensus.cc:385] T 39685c4581dc4bf4a7eb1065a07df99e P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:08.485948  7587 raft_consensus.cc:740] T 39685c4581dc4bf4a7eb1065a07df99e P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fb730dfb9d64542b1125a9f8ca64272, State: Initialized, Role: FOLLOWER
I20260709 13:13:08.486797  7588 tablet_bootstrap.cc:654] T 23201718ad6845f79123a5c755b9657a P d5b9feaa36ef49c386775798c7fbba58: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:08.486654  7587 consensus_queue.cc:260] T 39685c4581dc4bf4a7eb1065a07df99e P 9fb730dfb9d64542b1125a9f8ca64272 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.493784  7591 tablet_bootstrap.cc:492] T 791e0ec1608242b19b64b46991228864 P 6892fe946cc9442eb2e1e21f1024b355: No bootstrap required, opened a new log
I20260709 13:13:08.494270  7588 tablet_bootstrap.cc:492] T 23201718ad6845f79123a5c755b9657a P d5b9feaa36ef49c386775798c7fbba58: No bootstrap required, opened a new log
I20260709 13:13:08.494328  7587 ts_tablet_manager.cc:1434] T 39685c4581dc4bf4a7eb1065a07df99e P 9fb730dfb9d64542b1125a9f8ca64272: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:13:08.495048  7588 ts_tablet_manager.cc:1403] T 23201718ad6845f79123a5c755b9657a P d5b9feaa36ef49c386775798c7fbba58: Time spent bootstrapping tablet: real 0.015s	user 0.005s	sys 0.009s
I20260709 13:13:08.494347  7591 ts_tablet_manager.cc:1403] T 791e0ec1608242b19b64b46991228864 P 6892fe946cc9442eb2e1e21f1024b355: Time spent bootstrapping tablet: real 0.034s	user 0.002s	sys 0.011s
I20260709 13:13:08.496276  7587 tablet_bootstrap.cc:492] T 4d86b1ddf8a64589876c14f28419c2b0 P 9fb730dfb9d64542b1125a9f8ca64272: Bootstrap starting.
I20260709 13:13:08.498121  7588 raft_consensus.cc:359] T 23201718ad6845f79123a5c755b9657a P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.498842  7588 raft_consensus.cc:385] T 23201718ad6845f79123a5c755b9657a P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:08.499212  7588 raft_consensus.cc:740] T 23201718ad6845f79123a5c755b9657a P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5b9feaa36ef49c386775798c7fbba58, State: Initialized, Role: FOLLOWER
I20260709 13:13:08.498904  7591 raft_consensus.cc:359] T 791e0ec1608242b19b64b46991228864 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.499928  7591 raft_consensus.cc:385] T 791e0ec1608242b19b64b46991228864 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:08.500299  7591 raft_consensus.cc:740] T 791e0ec1608242b19b64b46991228864 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6892fe946cc9442eb2e1e21f1024b355, State: Initialized, Role: FOLLOWER
I20260709 13:13:08.500105  7588 consensus_queue.cc:260] T 23201718ad6845f79123a5c755b9657a P d5b9feaa36ef49c386775798c7fbba58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.501232  7591 consensus_queue.cc:260] T 791e0ec1608242b19b64b46991228864 P 6892fe946cc9442eb2e1e21f1024b355 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.503252  7587 tablet_bootstrap.cc:654] T 4d86b1ddf8a64589876c14f28419c2b0 P 9fb730dfb9d64542b1125a9f8ca64272: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:08.504082  7591 ts_tablet_manager.cc:1434] T 791e0ec1608242b19b64b46991228864 P 6892fe946cc9442eb2e1e21f1024b355: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:13:08.505806  7588 ts_tablet_manager.cc:1434] T 23201718ad6845f79123a5c755b9657a P d5b9feaa36ef49c386775798c7fbba58: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:13:08.506855  7588 tablet_bootstrap.cc:492] T 791e0ec1608242b19b64b46991228864 P d5b9feaa36ef49c386775798c7fbba58: Bootstrap starting.
I20260709 13:13:08.512693  7588 tablet_bootstrap.cc:654] T 791e0ec1608242b19b64b46991228864 P d5b9feaa36ef49c386775798c7fbba58: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:08.516265  7591 tablet_bootstrap.cc:492] T 7c2d9c7b2731498fbe0f7d715f98583f P 6892fe946cc9442eb2e1e21f1024b355: Bootstrap starting.
I20260709 13:13:08.523872  7593 raft_consensus.cc:493] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.524469  7587 tablet_bootstrap.cc:492] T 4d86b1ddf8a64589876c14f28419c2b0 P 9fb730dfb9d64542b1125a9f8ca64272: No bootstrap required, opened a new log
I20260709 13:13:08.524475  7593 raft_consensus.cc:515] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.523729  7592 raft_consensus.cc:493] T b30fe0c3d3034035bddf8837a6489448 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.525108  7587 ts_tablet_manager.cc:1403] T 4d86b1ddf8a64589876c14f28419c2b0 P 9fb730dfb9d64542b1125a9f8ca64272: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.016s
I20260709 13:13:08.525348  7592 raft_consensus.cc:515] T b30fe0c3d3034035bddf8837a6489448 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.526500  7593 leader_election.cc:290] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:08.524847  7591 tablet_bootstrap.cc:654] T 7c2d9c7b2731498fbe0f7d715f98583f P 6892fe946cc9442eb2e1e21f1024b355: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:08.527396  7592 leader_election.cc:290] T b30fe0c3d3034035bddf8837a6489448 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941)
I20260709 13:13:08.527603  7399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30fe0c3d3034035bddf8837a6489448" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6892fe946cc9442eb2e1e21f1024b355" is_pre_election: true
I20260709 13:13:08.528023  7587 raft_consensus.cc:359] T 4d86b1ddf8a64589876c14f28419c2b0 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.528824  7587 raft_consensus.cc:385] T 4d86b1ddf8a64589876c14f28419c2b0 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:08.528534  7588 tablet_bootstrap.cc:492] T 791e0ec1608242b19b64b46991228864 P d5b9feaa36ef49c386775798c7fbba58: No bootstrap required, opened a new log
I20260709 13:13:08.528084  7547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30fe0c3d3034035bddf8837a6489448" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5b9feaa36ef49c386775798c7fbba58" is_pre_election: true
I20260709 13:13:08.529112  7587 raft_consensus.cc:740] T 4d86b1ddf8a64589876c14f28419c2b0 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fb730dfb9d64542b1125a9f8ca64272, State: Initialized, Role: FOLLOWER
I20260709 13:13:08.529378  7547 raft_consensus.cc:2468] T b30fe0c3d3034035bddf8837a6489448 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fb730dfb9d64542b1125a9f8ca64272 in term 0.
I20260709 13:13:08.529644  7474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30fe0c3d3034035bddf8837a6489448" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272" is_pre_election: true
I20260709 13:13:08.529862  7587 consensus_queue.cc:260] T 4d86b1ddf8a64589876c14f28419c2b0 P 9fb730dfb9d64542b1125a9f8ca64272 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.530308  7588 ts_tablet_manager.cc:1403] T 791e0ec1608242b19b64b46991228864 P d5b9feaa36ef49c386775798c7fbba58: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.006s
I20260709 13:13:08.530936  7437 leader_election.cc:304] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fb730dfb9d64542b1125a9f8ca64272, d5b9feaa36ef49c386775798c7fbba58; no voters: 
I20260709 13:13:08.531914  7587 ts_tablet_manager.cc:1434] T 4d86b1ddf8a64589876c14f28419c2b0 P 9fb730dfb9d64542b1125a9f8ca64272: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:13:08.530247  7474 raft_consensus.cc:2468] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5b9feaa36ef49c386775798c7fbba58 in term 0.
I20260709 13:13:08.532811  7587 tablet_bootstrap.cc:492] T 791e0ec1608242b19b64b46991228864 P 9fb730dfb9d64542b1125a9f8ca64272: Bootstrap starting.
I20260709 13:13:08.533157  7607 raft_consensus.cc:2804] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:13:08.531844  7437 leader_election.cc:343] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:08.533633  7607 raft_consensus.cc:493] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:08.534000  7607 raft_consensus.cc:3060] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:08.534371  7511 leader_election.cc:304] T b30fe0c3d3034035bddf8837a6489448 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fb730dfb9d64542b1125a9f8ca64272, d5b9feaa36ef49c386775798c7fbba58; no voters: 
I20260709 13:13:08.535256  7592 raft_consensus.cc:2804] T b30fe0c3d3034035bddf8837a6489448 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:08.535604  7592 raft_consensus.cc:493] T b30fe0c3d3034035bddf8837a6489448 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:08.535974  7592 raft_consensus.cc:3060] T b30fe0c3d3034035bddf8837a6489448 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:08.538935  7587 tablet_bootstrap.cc:654] T 791e0ec1608242b19b64b46991228864 P 9fb730dfb9d64542b1125a9f8ca64272: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:08.533649  7399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30fe0c3d3034035bddf8837a6489448" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6892fe946cc9442eb2e1e21f1024b355" is_pre_election: true
W20260709 13:13:08.541002  7511 leader_election.cc:343] T b30fe0c3d3034035bddf8837a6489448 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:08.542089  7607 raft_consensus.cc:515] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.545463  7399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30fe0c3d3034035bddf8837a6489448" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6892fe946cc9442eb2e1e21f1024b355"
I20260709 13:13:08.533183  7588 raft_consensus.cc:359] T 791e0ec1608242b19b64b46991228864 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.546481  7588 raft_consensus.cc:385] T 791e0ec1608242b19b64b46991228864 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:13:08.546770  7437 leader_election.cc:343] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:08.547794  7607 leader_election.cc:290] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 1 election: Requested vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:08.546836  7588 raft_consensus.cc:740] T 791e0ec1608242b19b64b46991228864 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5b9feaa36ef49c386775798c7fbba58, State: Initialized, Role: FOLLOWER
I20260709 13:13:08.548794  7547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30fe0c3d3034035bddf8837a6489448" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5b9feaa36ef49c386775798c7fbba58"
I20260709 13:13:08.548998  7588 consensus_queue.cc:260] T 791e0ec1608242b19b64b46991228864 P d5b9feaa36ef49c386775798c7fbba58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.546808  7592 raft_consensus.cc:515] T b30fe0c3d3034035bddf8837a6489448 P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.550318  7547 raft_consensus.cc:2393] T b30fe0c3d3034035bddf8837a6489448 P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fb730dfb9d64542b1125a9f8ca64272 in current term 1: Already voted for candidate d5b9feaa36ef49c386775798c7fbba58 in this term.
I20260709 13:13:08.550822  7587 tablet_bootstrap.cc:492] T 791e0ec1608242b19b64b46991228864 P 9fb730dfb9d64542b1125a9f8ca64272: No bootstrap required, opened a new log
I20260709 13:13:08.551384  7587 ts_tablet_manager.cc:1403] T 791e0ec1608242b19b64b46991228864 P 9fb730dfb9d64542b1125a9f8ca64272: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.007s
I20260709 13:13:08.553157  7437 leader_election.cc:304] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fb730dfb9d64542b1125a9f8ca64272; no voters: 6892fe946cc9442eb2e1e21f1024b355, d5b9feaa36ef49c386775798c7fbba58
I20260709 13:13:08.553167  7399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30fe0c3d3034035bddf8837a6489448" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6892fe946cc9442eb2e1e21f1024b355"
I20260709 13:13:08.554152  7588 ts_tablet_manager.cc:1434] T 791e0ec1608242b19b64b46991228864 P d5b9feaa36ef49c386775798c7fbba58: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
W20260709 13:13:08.554769  7511 leader_election.cc:343] T b30fe0c3d3034035bddf8837a6489448 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:08.554541  7607 raft_consensus.cc:2749] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:08.554316  7587 raft_consensus.cc:359] T 791e0ec1608242b19b64b46991228864 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.555469  7587 raft_consensus.cc:385] T 791e0ec1608242b19b64b46991228864 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:08.555800  7587 raft_consensus.cc:740] T 791e0ec1608242b19b64b46991228864 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fb730dfb9d64542b1125a9f8ca64272, State: Initialized, Role: FOLLOWER
I20260709 13:13:08.555864  7592 leader_election.cc:290] T b30fe0c3d3034035bddf8837a6489448 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 election: Requested vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941)
I20260709 13:13:08.556921  7474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30fe0c3d3034035bddf8837a6489448" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272"
I20260709 13:13:08.556751  7587 consensus_queue.cc:260] T 791e0ec1608242b19b64b46991228864 P 9fb730dfb9d64542b1125a9f8ca64272 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.557703  7474 raft_consensus.cc:2393] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d5b9feaa36ef49c386775798c7fbba58 in current term 1: Already voted for candidate 9fb730dfb9d64542b1125a9f8ca64272 in this term.
I20260709 13:13:08.558458  7591 tablet_bootstrap.cc:492] T 7c2d9c7b2731498fbe0f7d715f98583f P 6892fe946cc9442eb2e1e21f1024b355: No bootstrap required, opened a new log
I20260709 13:13:08.558771  7587 ts_tablet_manager.cc:1434] T 791e0ec1608242b19b64b46991228864 P 9fb730dfb9d64542b1125a9f8ca64272: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:08.559093  7511 leader_election.cc:304] T b30fe0c3d3034035bddf8837a6489448 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5b9feaa36ef49c386775798c7fbba58; no voters: 6892fe946cc9442eb2e1e21f1024b355, 9fb730dfb9d64542b1125a9f8ca64272
I20260709 13:13:08.559719  7592 raft_consensus.cc:493] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.560012  7600 raft_consensus.cc:2749] T b30fe0c3d3034035bddf8837a6489448 P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:08.560245  7592 raft_consensus.cc:515] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.559091  7591 ts_tablet_manager.cc:1403] T 7c2d9c7b2731498fbe0f7d715f98583f P 6892fe946cc9442eb2e1e21f1024b355: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.001s
I20260709 13:13:08.562417  7592 leader_election.cc:290] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941)
I20260709 13:13:08.562986  7399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79da21344c24485d8cac81393166ecb2" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6892fe946cc9442eb2e1e21f1024b355" is_pre_election: true
I20260709 13:13:08.563629  7399 raft_consensus.cc:2468] T 79da21344c24485d8cac81393166ecb2 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5b9feaa36ef49c386775798c7fbba58 in term 0.
I20260709 13:13:08.564811  7511 leader_election.cc:304] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6892fe946cc9442eb2e1e21f1024b355, d5b9feaa36ef49c386775798c7fbba58; no voters: 
I20260709 13:13:08.565438  7591 raft_consensus.cc:359] T 7c2d9c7b2731498fbe0f7d715f98583f P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } } peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } }
I20260709 13:13:08.565717  7474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79da21344c24485d8cac81393166ecb2" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272" is_pre_election: true
I20260709 13:13:08.566150  7591 raft_consensus.cc:385] T 7c2d9c7b2731498fbe0f7d715f98583f P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:08.566385  7474 raft_consensus.cc:2468] T 79da21344c24485d8cac81393166ecb2 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5b9feaa36ef49c386775798c7fbba58 in term 0.
I20260709 13:13:08.566764  7592 raft_consensus.cc:2804] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:08.567173  7592 raft_consensus.cc:493] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:08.567520  7592 raft_consensus.cc:3060] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:08.566499  7591 raft_consensus.cc:740] T 7c2d9c7b2731498fbe0f7d715f98583f P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6892fe946cc9442eb2e1e21f1024b355, State: Initialized, Role: FOLLOWER
I20260709 13:13:08.568593  7591 consensus_queue.cc:260] T 7c2d9c7b2731498fbe0f7d715f98583f P 6892fe946cc9442eb2e1e21f1024b355 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } } peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } }
I20260709 13:13:08.570704  7591 ts_tablet_manager.cc:1434] T 7c2d9c7b2731498fbe0f7d715f98583f P 6892fe946cc9442eb2e1e21f1024b355: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:13:08.572101  7591 tablet_bootstrap.cc:492] T b30fe0c3d3034035bddf8837a6489448 P 6892fe946cc9442eb2e1e21f1024b355: Bootstrap starting.
I20260709 13:13:08.574872  7592 raft_consensus.cc:515] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.577199  7592 leader_election.cc:290] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 election: Requested vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941)
I20260709 13:13:08.577836  7607 raft_consensus.cc:493] T 791e0ec1608242b19b64b46991228864 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.578349  7607 raft_consensus.cc:515] T 791e0ec1608242b19b64b46991228864 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.578874  7474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79da21344c24485d8cac81393166ecb2" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272"
I20260709 13:13:08.577864  7399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79da21344c24485d8cac81393166ecb2" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6892fe946cc9442eb2e1e21f1024b355"
I20260709 13:13:08.579599  7474 raft_consensus.cc:3060] T 79da21344c24485d8cac81393166ecb2 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:08.579669  7399 raft_consensus.cc:3060] T 79da21344c24485d8cac81393166ecb2 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:08.580441  7607 leader_election.cc:290] T 791e0ec1608242b19b64b46991228864 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:08.578723  7591 tablet_bootstrap.cc:654] T b30fe0c3d3034035bddf8837a6489448 P 6892fe946cc9442eb2e1e21f1024b355: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:08.581959  7547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791e0ec1608242b19b64b46991228864" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5b9feaa36ef49c386775798c7fbba58" is_pre_election: true
I20260709 13:13:08.582610  7547 raft_consensus.cc:2468] T 791e0ec1608242b19b64b46991228864 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fb730dfb9d64542b1125a9f8ca64272 in term 0.
I20260709 13:13:08.583611  7398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791e0ec1608242b19b64b46991228864" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6892fe946cc9442eb2e1e21f1024b355" is_pre_election: true
I20260709 13:13:08.584302  7398 raft_consensus.cc:2468] T 791e0ec1608242b19b64b46991228864 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fb730dfb9d64542b1125a9f8ca64272 in term 0.
I20260709 13:13:08.586267  7437 leader_election.cc:304] T 791e0ec1608242b19b64b46991228864 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fb730dfb9d64542b1125a9f8ca64272, d5b9feaa36ef49c386775798c7fbba58; no voters: 
I20260709 13:13:08.587039  7607 raft_consensus.cc:2804] T 791e0ec1608242b19b64b46991228864 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:08.587185  7474 raft_consensus.cc:2468] T 79da21344c24485d8cac81393166ecb2 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5b9feaa36ef49c386775798c7fbba58 in term 1.
I20260709 13:13:08.587435  7607 raft_consensus.cc:493] T 791e0ec1608242b19b64b46991228864 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:08.587795  7607 raft_consensus.cc:3060] T 791e0ec1608242b19b64b46991228864 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:08.588395  7511 leader_election.cc:304] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fb730dfb9d64542b1125a9f8ca64272, d5b9feaa36ef49c386775798c7fbba58; no voters: 
I20260709 13:13:08.589260  7592 raft_consensus.cc:2804] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:08.589218  7399 raft_consensus.cc:2468] T 79da21344c24485d8cac81393166ecb2 P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5b9feaa36ef49c386775798c7fbba58 in term 1.
I20260709 13:13:08.590031  7592 raft_consensus.cc:697] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 [term 1 LEADER]: Becoming Leader. State: Replica: d5b9feaa36ef49c386775798c7fbba58, State: Running, Role: LEADER
I20260709 13:13:08.590878  7592 consensus_queue.cc:237] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.591564  7598 raft_consensus.cc:493] T 4d86b1ddf8a64589876c14f28419c2b0 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.592036  7598 raft_consensus.cc:515] T 4d86b1ddf8a64589876c14f28419c2b0 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.594003  7598 leader_election.cc:290] T 4d86b1ddf8a64589876c14f28419c2b0 P 6892fe946cc9442eb2e1e21f1024b355 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:08.594615  7474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d86b1ddf8a64589876c14f28419c2b0" candidate_uuid: "6892fe946cc9442eb2e1e21f1024b355" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272" is_pre_election: true
I20260709 13:13:08.594934  7591 tablet_bootstrap.cc:492] T b30fe0c3d3034035bddf8837a6489448 P 6892fe946cc9442eb2e1e21f1024b355: No bootstrap required, opened a new log
I20260709 13:13:08.595135  7474 raft_consensus.cc:2468] T 4d86b1ddf8a64589876c14f28419c2b0 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6892fe946cc9442eb2e1e21f1024b355 in term 0.
I20260709 13:13:08.595423  7591 ts_tablet_manager.cc:1403] T b30fe0c3d3034035bddf8837a6489448 P 6892fe946cc9442eb2e1e21f1024b355: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.005s
I20260709 13:13:08.596359  7362 leader_election.cc:304] T 4d86b1ddf8a64589876c14f28419c2b0 P 6892fe946cc9442eb2e1e21f1024b355 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6892fe946cc9442eb2e1e21f1024b355, 9fb730dfb9d64542b1125a9f8ca64272; no voters: 
I20260709 13:13:08.597438  7547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d86b1ddf8a64589876c14f28419c2b0" candidate_uuid: "6892fe946cc9442eb2e1e21f1024b355" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5b9feaa36ef49c386775798c7fbba58" is_pre_election: true
I20260709 13:13:08.598272  7547 raft_consensus.cc:2468] T 4d86b1ddf8a64589876c14f28419c2b0 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6892fe946cc9442eb2e1e21f1024b355 in term 0.
I20260709 13:13:08.598701  7607 raft_consensus.cc:515] T 791e0ec1608242b19b64b46991228864 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.602037  7607 leader_election.cc:290] T 791e0ec1608242b19b64b46991228864 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 1 election: Requested vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:08.602180  7399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791e0ec1608242b19b64b46991228864" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6892fe946cc9442eb2e1e21f1024b355"
I20260709 13:13:08.602838  7399 raft_consensus.cc:3060] T 791e0ec1608242b19b64b46991228864 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:08.602059  7591 raft_consensus.cc:359] T b30fe0c3d3034035bddf8837a6489448 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.603479  7591 raft_consensus.cc:385] T b30fe0c3d3034035bddf8837a6489448 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:08.603773  7591 raft_consensus.cc:740] T b30fe0c3d3034035bddf8837a6489448 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6892fe946cc9442eb2e1e21f1024b355, State: Initialized, Role: FOLLOWER
I20260709 13:13:08.604044  7547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791e0ec1608242b19b64b46991228864" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5b9feaa36ef49c386775798c7fbba58"
I20260709 13:13:08.608099  7547 raft_consensus.cc:3060] T 791e0ec1608242b19b64b46991228864 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:08.607892  7591 consensus_queue.cc:260] T b30fe0c3d3034035bddf8837a6489448 P 6892fe946cc9442eb2e1e21f1024b355 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.610250  7591 ts_tablet_manager.cc:1434] T b30fe0c3d3034035bddf8837a6489448 P 6892fe946cc9442eb2e1e21f1024b355: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:13:08.611202  7591 tablet_bootstrap.cc:492] T 3e8d0f65b3564feea4ae78a34ede70f3 P 6892fe946cc9442eb2e1e21f1024b355: Bootstrap starting.
I20260709 13:13:08.611281  7399 raft_consensus.cc:2468] T 791e0ec1608242b19b64b46991228864 P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fb730dfb9d64542b1125a9f8ca64272 in term 1.
I20260709 13:13:08.600847  7598 raft_consensus.cc:2804] T 4d86b1ddf8a64589876c14f28419c2b0 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:08.611433  7295 catalog_manager.cc:5697] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 reported cstate change: term changed from 0 to 1, leader changed from <none> to d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3). New cstate: current_term: 1 leader_uuid: "d5b9feaa36ef49c386775798c7fbba58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:08.612437  7437 leader_election.cc:304] T 791e0ec1608242b19b64b46991228864 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6892fe946cc9442eb2e1e21f1024b355, 9fb730dfb9d64542b1125a9f8ca64272; no voters: 
I20260709 13:13:08.612617  7598 raft_consensus.cc:493] T 4d86b1ddf8a64589876c14f28419c2b0 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:08.613103  7598 raft_consensus.cc:3060] T 4d86b1ddf8a64589876c14f28419c2b0 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:08.613281  7607 raft_consensus.cc:2804] T 791e0ec1608242b19b64b46991228864 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:08.614570  7607 raft_consensus.cc:697] T 791e0ec1608242b19b64b46991228864 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 LEADER]: Becoming Leader. State: Replica: 9fb730dfb9d64542b1125a9f8ca64272, State: Running, Role: LEADER
I20260709 13:13:08.615401  7607 consensus_queue.cc:237] T 791e0ec1608242b19b64b46991228864 P 9fb730dfb9d64542b1125a9f8ca64272 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.617218  7591 tablet_bootstrap.cc:654] T 3e8d0f65b3564feea4ae78a34ede70f3 P 6892fe946cc9442eb2e1e21f1024b355: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:08.646214  7547 raft_consensus.cc:2468] T 791e0ec1608242b19b64b46991228864 P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fb730dfb9d64542b1125a9f8ca64272 in term 1.
I20260709 13:13:08.659469  7598 raft_consensus.cc:515] T 4d86b1ddf8a64589876c14f28419c2b0 P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.663900  7598 leader_election.cc:290] T 4d86b1ddf8a64589876c14f28419c2b0 P 6892fe946cc9442eb2e1e21f1024b355 [CANDIDATE]: Term 1 election: Requested vote from peers 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:08.690176  7591 tablet_bootstrap.cc:492] T 3e8d0f65b3564feea4ae78a34ede70f3 P 6892fe946cc9442eb2e1e21f1024b355: No bootstrap required, opened a new log
I20260709 13:13:08.690979  7591 ts_tablet_manager.cc:1403] T 3e8d0f65b3564feea4ae78a34ede70f3 P 6892fe946cc9442eb2e1e21f1024b355: Time spent bootstrapping tablet: real 0.080s	user 0.031s	sys 0.030s
I20260709 13:13:08.694130  7591 raft_consensus.cc:359] T 3e8d0f65b3564feea4ae78a34ede70f3 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.694885  7591 raft_consensus.cc:385] T 3e8d0f65b3564feea4ae78a34ede70f3 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:08.695240  7591 raft_consensus.cc:740] T 3e8d0f65b3564feea4ae78a34ede70f3 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6892fe946cc9442eb2e1e21f1024b355, State: Initialized, Role: FOLLOWER
I20260709 13:13:08.696009  7591 consensus_queue.cc:260] T 3e8d0f65b3564feea4ae78a34ede70f3 P 6892fe946cc9442eb2e1e21f1024b355 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.698372  7591 ts_tablet_manager.cc:1434] T 3e8d0f65b3564feea4ae78a34ede70f3 P 6892fe946cc9442eb2e1e21f1024b355: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:13:08.800729  7592 raft_consensus.cc:493] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.801620  7592 raft_consensus.cc:515] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.803879  7592 leader_election.cc:290] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941)
I20260709 13:13:08.810181  7592 consensus_queue.cc:1048] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:08.811357  7398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8d0f65b3564feea4ae78a34ede70f3" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6892fe946cc9442eb2e1e21f1024b355" is_pre_election: true
I20260709 13:13:08.812209  7398 raft_consensus.cc:2468] T 3e8d0f65b3564feea4ae78a34ede70f3 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5b9feaa36ef49c386775798c7fbba58 in term 0.
I20260709 13:13:08.813302  7511 leader_election.cc:304] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6892fe946cc9442eb2e1e21f1024b355, d5b9feaa36ef49c386775798c7fbba58; no voters: 
I20260709 13:13:08.813920  7600 raft_consensus.cc:493] T 39685c4581dc4bf4a7eb1065a07df99e P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.814342  7600 raft_consensus.cc:515] T 39685c4581dc4bf4a7eb1065a07df99e P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.816468  7600 leader_election.cc:290] T 39685c4581dc4bf4a7eb1065a07df99e P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941)
I20260709 13:13:08.816291  7592 raft_consensus.cc:2804] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:08.817205  7592 raft_consensus.cc:493] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:08.817608  7592 raft_consensus.cc:3060] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:08.817909  7399 raft_consensus.cc:3060] T 7c2d9c7b2731498fbe0f7d715f98583f P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:08.818077  7398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39685c4581dc4bf4a7eb1065a07df99e" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6892fe946cc9442eb2e1e21f1024b355" is_pre_election: true
I20260709 13:13:08.818284  7474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39685c4581dc4bf4a7eb1065a07df99e" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272" is_pre_election: true
I20260709 13:13:08.818784  7398 raft_consensus.cc:2468] T 39685c4581dc4bf4a7eb1065a07df99e P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5b9feaa36ef49c386775798c7fbba58 in term 0.
I20260709 13:13:08.818984  7474 raft_consensus.cc:2468] T 39685c4581dc4bf4a7eb1065a07df99e P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5b9feaa36ef49c386775798c7fbba58 in term 0.
I20260709 13:13:08.820642  7511 leader_election.cc:304] T 39685c4581dc4bf4a7eb1065a07df99e P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fb730dfb9d64542b1125a9f8ca64272, d5b9feaa36ef49c386775798c7fbba58; no voters: 
I20260709 13:13:08.826299  7592 raft_consensus.cc:515] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.829305  7592 leader_election.cc:290] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 election: Requested vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941)
I20260709 13:13:08.837428  7634 raft_consensus.cc:2804] T 39685c4581dc4bf4a7eb1065a07df99e P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:08.838312  7634 raft_consensus.cc:493] T 39685c4581dc4bf4a7eb1065a07df99e P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:08.838733  7634 raft_consensus.cc:3060] T 39685c4581dc4bf4a7eb1065a07df99e P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:08.844312  7598 raft_consensus.cc:493] T 730c1374419e417286fca4006acf11a9 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.844355  7399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8d0f65b3564feea4ae78a34ede70f3" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6892fe946cc9442eb2e1e21f1024b355"
I20260709 13:13:08.844489  7474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8d0f65b3564feea4ae78a34ede70f3" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272"
I20260709 13:13:08.844945  7598 raft_consensus.cc:515] T 730c1374419e417286fca4006acf11a9 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.845649  7474 raft_consensus.cc:3060] T 3e8d0f65b3564feea4ae78a34ede70f3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:08.847020  7598 leader_election.cc:290] T 730c1374419e417286fca4006acf11a9 P 6892fe946cc9442eb2e1e21f1024b355 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:08.848075  7399 raft_consensus.cc:3060] T 3e8d0f65b3564feea4ae78a34ede70f3 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:08.847863  7634 raft_consensus.cc:515] T 39685c4581dc4bf4a7eb1065a07df99e P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.849967  7634 leader_election.cc:290] T 39685c4581dc4bf4a7eb1065a07df99e P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 election: Requested vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941)
I20260709 13:13:08.852875  7474 raft_consensus.cc:2468] T 3e8d0f65b3564feea4ae78a34ede70f3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5b9feaa36ef49c386775798c7fbba58 in term 1.
I20260709 13:13:08.853998  7634 consensus_queue.cc:1048] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:08.854736  7399 raft_consensus.cc:2468] T 3e8d0f65b3564feea4ae78a34ede70f3 P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5b9feaa36ef49c386775798c7fbba58 in term 1.
I20260709 13:13:08.855014  7398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39685c4581dc4bf4a7eb1065a07df99e" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6892fe946cc9442eb2e1e21f1024b355"
I20260709 13:13:08.855633  7398 raft_consensus.cc:3060] T 39685c4581dc4bf4a7eb1065a07df99e P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:08.860476  7473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8d0f65b3564feea4ae78a34ede70f3" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272" is_pre_election: true
I20260709 13:13:08.860854  7511 leader_election.cc:304] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6892fe946cc9442eb2e1e21f1024b355, d5b9feaa36ef49c386775798c7fbba58; no voters: 
I20260709 13:13:08.861150  7473 raft_consensus.cc:2376] T 3e8d0f65b3564feea4ae78a34ede70f3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d5b9feaa36ef49c386775798c7fbba58 in term 1. Re-sending same reply.
I20260709 13:13:08.861706  7634 raft_consensus.cc:2804] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:08.862165  7634 raft_consensus.cc:697] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58 [term 1 LEADER]: Becoming Leader. State: Replica: d5b9feaa36ef49c386775798c7fbba58, State: Running, Role: LEADER
I20260709 13:13:08.862995  7634 consensus_queue.cc:237] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.871765  7473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39685c4581dc4bf4a7eb1065a07df99e" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272"
I20260709 13:13:08.872700  7473 raft_consensus.cc:3060] T 39685c4581dc4bf4a7eb1065a07df99e P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:08.880968  7296 catalog_manager.cc:5697] T 791e0ec1608242b19b64b46991228864 P 9fb730dfb9d64542b1125a9f8ca64272 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2). New cstate: current_term: 1 leader_uuid: "9fb730dfb9d64542b1125a9f8ca64272" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:08.895381  7598 raft_consensus.cc:493] T b30fe0c3d3034035bddf8837a6489448 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:08.895869  7598 raft_consensus.cc:515] T b30fe0c3d3034035bddf8837a6489448 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.896742  7473 raft_consensus.cc:2468] T 39685c4581dc4bf4a7eb1065a07df99e P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5b9feaa36ef49c386775798c7fbba58 in term 1.
I20260709 13:13:08.897157  7474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d86b1ddf8a64589876c14f28419c2b0" candidate_uuid: "6892fe946cc9442eb2e1e21f1024b355" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272"
I20260709 13:13:08.897789  7474 raft_consensus.cc:3060] T 4d86b1ddf8a64589876c14f28419c2b0 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:08.897841  7598 leader_election.cc:290] T b30fe0c3d3034035bddf8837a6489448 P 6892fe946cc9442eb2e1e21f1024b355 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:08.898658  7511 leader_election.cc:304] T 39685c4581dc4bf4a7eb1065a07df99e P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fb730dfb9d64542b1125a9f8ca64272, d5b9feaa36ef49c386775798c7fbba58; no voters: 
I20260709 13:13:08.899269  7472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "730c1374419e417286fca4006acf11a9" candidate_uuid: "6892fe946cc9442eb2e1e21f1024b355" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272" is_pre_election: true
I20260709 13:13:08.899474  7398 raft_consensus.cc:2468] T 39685c4581dc4bf4a7eb1065a07df99e P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5b9feaa36ef49c386775798c7fbba58 in term 1.
I20260709 13:13:08.900077  7472 raft_consensus.cc:2393] T 730c1374419e417286fca4006acf11a9 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6892fe946cc9442eb2e1e21f1024b355 in current term 1: Already voted for candidate d5b9feaa36ef49c386775798c7fbba58 in this term.
I20260709 13:13:08.900907  7600 raft_consensus.cc:2804] T 39685c4581dc4bf4a7eb1065a07df99e P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:08.901276  7547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d86b1ddf8a64589876c14f28419c2b0" candidate_uuid: "6892fe946cc9442eb2e1e21f1024b355" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5b9feaa36ef49c386775798c7fbba58"
I20260709 13:13:08.901464  7600 raft_consensus.cc:697] T 39685c4581dc4bf4a7eb1065a07df99e P d5b9feaa36ef49c386775798c7fbba58 [term 1 LEADER]: Becoming Leader. State: Replica: d5b9feaa36ef49c386775798c7fbba58, State: Running, Role: LEADER
I20260709 13:13:08.901949  7547 raft_consensus.cc:3060] T 4d86b1ddf8a64589876c14f28419c2b0 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:08.902534  7600 consensus_queue.cc:237] T 39685c4581dc4bf4a7eb1065a07df99e P d5b9feaa36ef49c386775798c7fbba58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.904218  7548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "730c1374419e417286fca4006acf11a9" candidate_uuid: "6892fe946cc9442eb2e1e21f1024b355" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5b9feaa36ef49c386775798c7fbba58" is_pre_election: true
I20260709 13:13:08.907001  7474 raft_consensus.cc:2468] T 4d86b1ddf8a64589876c14f28419c2b0 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6892fe946cc9442eb2e1e21f1024b355 in term 1.
I20260709 13:13:08.908183  7362 leader_election.cc:304] T 4d86b1ddf8a64589876c14f28419c2b0 P 6892fe946cc9442eb2e1e21f1024b355 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6892fe946cc9442eb2e1e21f1024b355, 9fb730dfb9d64542b1125a9f8ca64272; no voters: 
I20260709 13:13:08.908517  7472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30fe0c3d3034035bddf8837a6489448" candidate_uuid: "6892fe946cc9442eb2e1e21f1024b355" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272" is_pre_election: true
I20260709 13:13:08.909108  7598 raft_consensus.cc:2804] T 4d86b1ddf8a64589876c14f28419c2b0 P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:08.909301  7472 raft_consensus.cc:2393] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6892fe946cc9442eb2e1e21f1024b355 in current term 1: Already voted for candidate 9fb730dfb9d64542b1125a9f8ca64272 in this term.
I20260709 13:13:08.909874  7598 raft_consensus.cc:697] T 4d86b1ddf8a64589876c14f28419c2b0 P 6892fe946cc9442eb2e1e21f1024b355 [term 1 LEADER]: Becoming Leader. State: Replica: 6892fe946cc9442eb2e1e21f1024b355, State: Running, Role: LEADER
I20260709 13:13:08.911043  7548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30fe0c3d3034035bddf8837a6489448" candidate_uuid: "6892fe946cc9442eb2e1e21f1024b355" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5b9feaa36ef49c386775798c7fbba58" is_pre_election: true
I20260709 13:13:08.912474  7548 raft_consensus.cc:2393] T b30fe0c3d3034035bddf8837a6489448 P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6892fe946cc9442eb2e1e21f1024b355 in current term 1: Already voted for candidate d5b9feaa36ef49c386775798c7fbba58 in this term.
I20260709 13:13:08.912923  7362 leader_election.cc:304] T 730c1374419e417286fca4006acf11a9 P 6892fe946cc9442eb2e1e21f1024b355 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6892fe946cc9442eb2e1e21f1024b355; no voters: 9fb730dfb9d64542b1125a9f8ca64272, d5b9feaa36ef49c386775798c7fbba58
I20260709 13:13:08.914021  7613 raft_consensus.cc:3060] T 730c1374419e417286fca4006acf11a9 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:08.915547  7362 leader_election.cc:304] T b30fe0c3d3034035bddf8837a6489448 P 6892fe946cc9442eb2e1e21f1024b355 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6892fe946cc9442eb2e1e21f1024b355; no voters: 9fb730dfb9d64542b1125a9f8ca64272, d5b9feaa36ef49c386775798c7fbba58
I20260709 13:13:08.916815  7548 raft_consensus.cc:3060] T 23201718ad6845f79123a5c755b9657a P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:08.917563  7295 catalog_manager.cc:5697] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58 reported cstate change: term changed from 0 to 1, leader changed from <none> to d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3). New cstate: current_term: 1 leader_uuid: "d5b9feaa36ef49c386775798c7fbba58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:08.908932  7547 raft_consensus.cc:2468] T 4d86b1ddf8a64589876c14f28419c2b0 P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6892fe946cc9442eb2e1e21f1024b355 in term 1.
I20260709 13:13:08.913736  7598 consensus_queue.cc:237] T 4d86b1ddf8a64589876c14f28419c2b0 P 6892fe946cc9442eb2e1e21f1024b355 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:08.940984  7613 raft_consensus.cc:2749] T 730c1374419e417286fca4006acf11a9 P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:08.929656  7641 raft_consensus.cc:3060] T b30fe0c3d3034035bddf8837a6489448 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:08.946058  7634 consensus_queue.cc:1048] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:08.947336  7613 consensus_queue.cc:1048] T 23201718ad6845f79123a5c755b9657a P 6892fe946cc9442eb2e1e21f1024b355 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:08.953275  7641 raft_consensus.cc:2749] T b30fe0c3d3034035bddf8837a6489448 P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:08.957008  7296 catalog_manager.cc:5697] T 39685c4581dc4bf4a7eb1065a07df99e P d5b9feaa36ef49c386775798c7fbba58 reported cstate change: term changed from 0 to 1, leader changed from <none> to d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3). New cstate: current_term: 1 leader_uuid: "d5b9feaa36ef49c386775798c7fbba58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:08.963604  7600 consensus_queue.cc:1048] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:08.965168  7641 consensus_queue.cc:1048] T 23201718ad6845f79123a5c755b9657a P 6892fe946cc9442eb2e1e21f1024b355 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:08.970510  7295 catalog_manager.cc:5697] T 4d86b1ddf8a64589876c14f28419c2b0 P 6892fe946cc9442eb2e1e21f1024b355 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "6892fe946cc9442eb2e1e21f1024b355" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:09.137410  7600 consensus_queue.cc:1048] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:09.148030  7592 consensus_queue.cc:1048] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:09.160102  7607 consensus_queue.cc:1048] T 791e0ec1608242b19b64b46991228864 P 9fb730dfb9d64542b1125a9f8ca64272 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:09.174137  7607 consensus_queue.cc:1048] T 791e0ec1608242b19b64b46991228864 P 9fb730dfb9d64542b1125a9f8ca64272 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:09.298142  7592 consensus_queue.cc:1048] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:09.309084  7634 consensus_queue.cc:1048] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:09.387974  7634 consensus_queue.cc:1048] T 39685c4581dc4bf4a7eb1065a07df99e P d5b9feaa36ef49c386775798c7fbba58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:09.399673  7600 consensus_queue.cc:1048] T 39685c4581dc4bf4a7eb1065a07df99e P d5b9feaa36ef49c386775798c7fbba58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:09.408821  7641 consensus_queue.cc:1048] T 4d86b1ddf8a64589876c14f28419c2b0 P 6892fe946cc9442eb2e1e21f1024b355 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:09.420684  7661 consensus_queue.cc:1048] T 4d86b1ddf8a64589876c14f28419c2b0 P 6892fe946cc9442eb2e1e21f1024b355 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:13:09.440666  7345 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:13:09.835274  7569 debug-util.cc:398] Leaking SignalData structure 0x7b08001e8ea0 after lost signal to thread 29367
W20260709 13:13:09.836419  7569 debug-util.cc:398] Leaking SignalData structure 0x7b08000c2d20 after lost signal to thread 7331
W20260709 13:13:09.837713  7569 debug-util.cc:398] Leaking SignalData structure 0x7b080028ade0 after lost signal to thread 7423
W20260709 13:13:09.838793  7569 debug-util.cc:398] Leaking SignalData structure 0x7b0800114000 after lost signal to thread 7498
W20260709 13:13:09.839759  7569 debug-util.cc:398] Leaking SignalData structure 0x7b0800314480 after lost signal to thread 7572
I20260709 13:13:10.246475  7664 raft_consensus.cc:493] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.247061  7664 raft_consensus.cc:515] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:10.248931  7664 leader_election.cc:290] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:10.249771  7399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30fe0c3d3034035bddf8837a6489448" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6892fe946cc9442eb2e1e21f1024b355" is_pre_election: true
I20260709 13:13:10.250109  7548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30fe0c3d3034035bddf8837a6489448" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5b9feaa36ef49c386775798c7fbba58" is_pre_election: true
I20260709 13:13:10.250401  7399 raft_consensus.cc:2468] T b30fe0c3d3034035bddf8837a6489448 P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fb730dfb9d64542b1125a9f8ca64272 in term 1.
I20260709 13:13:10.250823  7548 raft_consensus.cc:2468] T b30fe0c3d3034035bddf8837a6489448 P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fb730dfb9d64542b1125a9f8ca64272 in term 1.
I20260709 13:13:10.251510  7437 leader_election.cc:304] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6892fe946cc9442eb2e1e21f1024b355, 9fb730dfb9d64542b1125a9f8ca64272; no voters: 
I20260709 13:13:10.252365  7664 raft_consensus.cc:2804] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:10.252738  7664 raft_consensus.cc:493] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:10.253072  7664 raft_consensus.cc:3060] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:10.260958  7664 raft_consensus.cc:515] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:10.263134  7664 leader_election.cc:290] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 2 election: Requested vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:10.263940  7399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30fe0c3d3034035bddf8837a6489448" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6892fe946cc9442eb2e1e21f1024b355"
I20260709 13:13:10.264222  7548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b30fe0c3d3034035bddf8837a6489448" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5b9feaa36ef49c386775798c7fbba58"
I20260709 13:13:10.264488  7399 raft_consensus.cc:3060] T b30fe0c3d3034035bddf8837a6489448 P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:10.264914  7548 raft_consensus.cc:3060] T b30fe0c3d3034035bddf8837a6489448 P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:10.269654  7399 raft_consensus.cc:2468] T b30fe0c3d3034035bddf8837a6489448 P 6892fe946cc9442eb2e1e21f1024b355 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fb730dfb9d64542b1125a9f8ca64272 in term 2.
I20260709 13:13:10.270668  7437 leader_election.cc:304] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6892fe946cc9442eb2e1e21f1024b355, 9fb730dfb9d64542b1125a9f8ca64272; no voters: 
I20260709 13:13:10.271329  7664 raft_consensus.cc:2804] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:10.272439  7664 raft_consensus.cc:697] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 LEADER]: Becoming Leader. State: Replica: 9fb730dfb9d64542b1125a9f8ca64272, State: Running, Role: LEADER
I20260709 13:13:10.272704  7548 raft_consensus.cc:2468] T b30fe0c3d3034035bddf8837a6489448 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fb730dfb9d64542b1125a9f8ca64272 in term 2.
I20260709 13:13:10.273765  7664 consensus_queue.cc:237] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:10.282245  7295 catalog_manager.cc:5697] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272 reported cstate change: term changed from 0 to 2, leader changed from <none> to 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2). New cstate: current_term: 2 leader_uuid: "9fb730dfb9d64542b1125a9f8ca64272" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:10.678411  7548 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c2d9c7b2731498fbe0f7d715f98583f"
dest_uuid: "d5b9feaa36ef49c386775798c7fbba58"
mode: GRACEFUL
new_leader_uuid: "6892fe946cc9442eb2e1e21f1024b355"
 from {username='slave'} at 127.0.0.1:58370
I20260709 13:13:10.678980  7548 raft_consensus.cc:606] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 [term 1 LEADER]: Received request to transfer leadership to TS 6892fe946cc9442eb2e1e21f1024b355
I20260709 13:13:10.687707  7548 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79da21344c24485d8cac81393166ecb2"
dest_uuid: "d5b9feaa36ef49c386775798c7fbba58"
mode: GRACEFUL
new_leader_uuid: "6892fe946cc9442eb2e1e21f1024b355"
 from {username='slave'} at 127.0.0.1:58370
I20260709 13:13:10.688278  7548 raft_consensus.cc:606] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 [term 1 LEADER]: Received request to transfer leadership to TS 6892fe946cc9442eb2e1e21f1024b355
I20260709 13:13:10.693336  7548 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "730c1374419e417286fca4006acf11a9"
dest_uuid: "d5b9feaa36ef49c386775798c7fbba58"
mode: GRACEFUL
new_leader_uuid: "6892fe946cc9442eb2e1e21f1024b355"
 from {username='slave'} at 127.0.0.1:58370
I20260709 13:13:10.693907  7548 raft_consensus.cc:606] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58 [term 1 LEADER]: Received request to transfer leadership to TS 6892fe946cc9442eb2e1e21f1024b355
I20260709 13:13:10.699079  7548 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e8d0f65b3564feea4ae78a34ede70f3"
dest_uuid: "d5b9feaa36ef49c386775798c7fbba58"
mode: GRACEFUL
new_leader_uuid: "9fb730dfb9d64542b1125a9f8ca64272"
 from {username='slave'} at 127.0.0.1:58370
I20260709 13:13:10.699543  7548 raft_consensus.cc:606] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58 [term 1 LEADER]: Received request to transfer leadership to TS 9fb730dfb9d64542b1125a9f8ca64272
I20260709 13:13:10.717993  7399 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23201718ad6845f79123a5c755b9657a"
dest_uuid: "6892fe946cc9442eb2e1e21f1024b355"
mode: GRACEFUL
new_leader_uuid: "9fb730dfb9d64542b1125a9f8ca64272"
 from {username='slave'} at 127.0.0.1:37168
I20260709 13:13:10.718514  7399 raft_consensus.cc:606] T 23201718ad6845f79123a5c755b9657a P 6892fe946cc9442eb2e1e21f1024b355 [term 1 LEADER]: Received request to transfer leadership to TS 9fb730dfb9d64542b1125a9f8ca64272
I20260709 13:13:10.848389  7548 raft_consensus.cc:1275] T b30fe0c3d3034035bddf8837a6489448 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Refusing update from remote peer 9fb730dfb9d64542b1125a9f8ca64272: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:13:10.849797  7664 consensus_queue.cc:1048] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:10.853245  7399 raft_consensus.cc:1275] T b30fe0c3d3034035bddf8837a6489448 P 6892fe946cc9442eb2e1e21f1024b355 [term 2 FOLLOWER]: Refusing update from remote peer 9fb730dfb9d64542b1125a9f8ca64272: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:13:10.854701  7664 consensus_queue.cc:1048] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:10.864473  7673 raft_consensus.cc:993] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58: : Instructing follower 6892fe946cc9442eb2e1e21f1024b355 to start an election
I20260709 13:13:10.864928  7673 raft_consensus.cc:1081] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58 [term 1 LEADER]: Signalling peer 6892fe946cc9442eb2e1e21f1024b355 to start an election
I20260709 13:13:10.871426  7399 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "730c1374419e417286fca4006acf11a9"
dest_uuid: "6892fe946cc9442eb2e1e21f1024b355"
 from {username='slave'} at 127.0.0.1:34692
I20260709 13:13:10.872141  7399 raft_consensus.cc:493] T 730c1374419e417286fca4006acf11a9 P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:10.872633  7399 raft_consensus.cc:3060] T 730c1374419e417286fca4006acf11a9 P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:10.883275  7600 raft_consensus.cc:993] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58: : Instructing follower 9fb730dfb9d64542b1125a9f8ca64272 to start an election
I20260709 13:13:10.883992  7673 raft_consensus.cc:1081] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58 [term 1 LEADER]: Signalling peer 9fb730dfb9d64542b1125a9f8ca64272 to start an election
I20260709 13:13:10.887159  7473 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e8d0f65b3564feea4ae78a34ede70f3"
dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272"
 from {username='slave'} at 127.0.0.1:52488
I20260709 13:13:10.887902  7473 raft_consensus.cc:493] T 3e8d0f65b3564feea4ae78a34ede70f3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:10.888567  7473 raft_consensus.cc:3060] T 3e8d0f65b3564feea4ae78a34ede70f3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:10.887663  7399 raft_consensus.cc:515] T 730c1374419e417286fca4006acf11a9 P 6892fe946cc9442eb2e1e21f1024b355 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:10.898795  7473 raft_consensus.cc:515] T 3e8d0f65b3564feea4ae78a34ede70f3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:10.900708  7399 leader_election.cc:290] T 730c1374419e417286fca4006acf11a9 P 6892fe946cc9442eb2e1e21f1024b355 [CANDIDATE]: Term 2 election: Requested vote from peers 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:10.901623  7398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8d0f65b3564feea4ae78a34ede70f3" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6892fe946cc9442eb2e1e21f1024b355"
I20260709 13:13:10.902393  7398 raft_consensus.cc:3060] T 3e8d0f65b3564feea4ae78a34ede70f3 P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:10.902823  7548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8d0f65b3564feea4ae78a34ede70f3" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5b9feaa36ef49c386775798c7fbba58"
I20260709 13:13:10.903447  7548 raft_consensus.cc:3055] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:10.903769  7548 raft_consensus.cc:740] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d5b9feaa36ef49c386775798c7fbba58, State: Running, Role: LEADER
I20260709 13:13:10.904126  7474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "730c1374419e417286fca4006acf11a9" candidate_uuid: "6892fe946cc9442eb2e1e21f1024b355" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272"
I20260709 13:13:10.904733  7474 raft_consensus.cc:3060] T 730c1374419e417286fca4006acf11a9 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:10.904780  7548 consensus_queue.cc:260] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:10.906004  7548 raft_consensus.cc:3060] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:10.907476  7473 leader_election.cc:290] T 3e8d0f65b3564feea4ae78a34ede70f3 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 2 election: Requested vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:10.910841  7398 raft_consensus.cc:2468] T 3e8d0f65b3564feea4ae78a34ede70f3 P 6892fe946cc9442eb2e1e21f1024b355 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fb730dfb9d64542b1125a9f8ca64272 in term 2.
I20260709 13:13:10.911691  7547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "730c1374419e417286fca4006acf11a9" candidate_uuid: "6892fe946cc9442eb2e1e21f1024b355" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5b9feaa36ef49c386775798c7fbba58"
I20260709 13:13:10.912348  7547 raft_consensus.cc:3055] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:10.912323  7437 leader_election.cc:304] T 3e8d0f65b3564feea4ae78a34ede70f3 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6892fe946cc9442eb2e1e21f1024b355, 9fb730dfb9d64542b1125a9f8ca64272; no voters: 
I20260709 13:13:10.912894  7547 raft_consensus.cc:740] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d5b9feaa36ef49c386775798c7fbba58, State: Running, Role: LEADER
I20260709 13:13:10.913445  7677 raft_consensus.cc:2804] T 3e8d0f65b3564feea4ae78a34ede70f3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:10.913961  7677 raft_consensus.cc:697] T 3e8d0f65b3564feea4ae78a34ede70f3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 LEADER]: Becoming Leader. State: Replica: 9fb730dfb9d64542b1125a9f8ca64272, State: Running, Role: LEADER
I20260709 13:13:10.913748  7547 consensus_queue.cc:260] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:10.914996  7547 raft_consensus.cc:3060] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:10.914921  7677 consensus_queue.cc:237] T 3e8d0f65b3564feea4ae78a34ede70f3 P 9fb730dfb9d64542b1125a9f8ca64272 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:10.924695  7547 raft_consensus.cc:2468] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6892fe946cc9442eb2e1e21f1024b355 in term 2.
I20260709 13:13:10.914134  7548 raft_consensus.cc:2468] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fb730dfb9d64542b1125a9f8ca64272 in term 2.
I20260709 13:13:10.926601  7362 leader_election.cc:304] T 730c1374419e417286fca4006acf11a9 P 6892fe946cc9442eb2e1e21f1024b355 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6892fe946cc9442eb2e1e21f1024b355, d5b9feaa36ef49c386775798c7fbba58; no voters: 
I20260709 13:13:10.927518  7661 raft_consensus.cc:2804] T 730c1374419e417286fca4006acf11a9 P 6892fe946cc9442eb2e1e21f1024b355 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:10.927443  7474 raft_consensus.cc:2468] T 730c1374419e417286fca4006acf11a9 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6892fe946cc9442eb2e1e21f1024b355 in term 2.
I20260709 13:13:10.935352  7661 raft_consensus.cc:697] T 730c1374419e417286fca4006acf11a9 P 6892fe946cc9442eb2e1e21f1024b355 [term 2 LEADER]: Becoming Leader. State: Replica: 6892fe946cc9442eb2e1e21f1024b355, State: Running, Role: LEADER
I20260709 13:13:10.936513  7661 consensus_queue.cc:237] T 730c1374419e417286fca4006acf11a9 P 6892fe946cc9442eb2e1e21f1024b355 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:10.937862  7297 catalog_manager.cc:5697] T 3e8d0f65b3564feea4ae78a34ede70f3 P 9fb730dfb9d64542b1125a9f8ca64272 reported cstate change: term changed from 1 to 2, leader changed from d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3) to 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2). New cstate: current_term: 2 leader_uuid: "9fb730dfb9d64542b1125a9f8ca64272" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:10.945590  7296 catalog_manager.cc:5697] T 730c1374419e417286fca4006acf11a9 P 6892fe946cc9442eb2e1e21f1024b355 reported cstate change: term changed from 1 to 2, leader changed from d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3) to 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1). New cstate: current_term: 2 leader_uuid: "6892fe946cc9442eb2e1e21f1024b355" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:10.964807  7685 raft_consensus.cc:993] T 23201718ad6845f79123a5c755b9657a P 6892fe946cc9442eb2e1e21f1024b355: : Instructing follower 9fb730dfb9d64542b1125a9f8ca64272 to start an election
I20260709 13:13:10.965262  7661 raft_consensus.cc:1081] T 23201718ad6845f79123a5c755b9657a P 6892fe946cc9442eb2e1e21f1024b355 [term 1 LEADER]: Signalling peer 9fb730dfb9d64542b1125a9f8ca64272 to start an election
I20260709 13:13:10.966735  7474 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23201718ad6845f79123a5c755b9657a"
dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272"
 from {username='slave'} at 127.0.0.1:52498
I20260709 13:13:10.967193  7474 raft_consensus.cc:493] T 23201718ad6845f79123a5c755b9657a P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:10.967478  7474 raft_consensus.cc:3060] T 23201718ad6845f79123a5c755b9657a P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:10.972796  7474 raft_consensus.cc:515] T 23201718ad6845f79123a5c755b9657a P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:10.974314  7474 leader_election.cc:290] T 23201718ad6845f79123a5c755b9657a P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 2 election: Requested vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:10.975209  7398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23201718ad6845f79123a5c755b9657a" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6892fe946cc9442eb2e1e21f1024b355"
I20260709 13:13:10.975582  7548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23201718ad6845f79123a5c755b9657a" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5b9feaa36ef49c386775798c7fbba58"
I20260709 13:13:10.975927  7398 raft_consensus.cc:3055] T 23201718ad6845f79123a5c755b9657a P 6892fe946cc9442eb2e1e21f1024b355 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:10.976272  7398 raft_consensus.cc:740] T 23201718ad6845f79123a5c755b9657a P 6892fe946cc9442eb2e1e21f1024b355 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6892fe946cc9442eb2e1e21f1024b355, State: Running, Role: LEADER
I20260709 13:13:10.976301  7548 raft_consensus.cc:3060] T 23201718ad6845f79123a5c755b9657a P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:10.977018  7398 consensus_queue.cc:260] T 23201718ad6845f79123a5c755b9657a P 6892fe946cc9442eb2e1e21f1024b355 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:10.978080  7398 raft_consensus.cc:3060] T 23201718ad6845f79123a5c755b9657a P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:10.983098  7398 raft_consensus.cc:2468] T 23201718ad6845f79123a5c755b9657a P 6892fe946cc9442eb2e1e21f1024b355 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fb730dfb9d64542b1125a9f8ca64272 in term 2.
I20260709 13:13:10.984252  7437 leader_election.cc:304] T 23201718ad6845f79123a5c755b9657a P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6892fe946cc9442eb2e1e21f1024b355, 9fb730dfb9d64542b1125a9f8ca64272; no voters: 
I20260709 13:13:10.984256  7548 raft_consensus.cc:2468] T 23201718ad6845f79123a5c755b9657a P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fb730dfb9d64542b1125a9f8ca64272 in term 2.
I20260709 13:13:10.985247  7677 raft_consensus.cc:2804] T 23201718ad6845f79123a5c755b9657a P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:10.988523  7677 raft_consensus.cc:697] T 23201718ad6845f79123a5c755b9657a P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 LEADER]: Becoming Leader. State: Replica: 9fb730dfb9d64542b1125a9f8ca64272, State: Running, Role: LEADER
I20260709 13:13:10.989488  7677 consensus_queue.cc:237] T 23201718ad6845f79123a5c755b9657a P 9fb730dfb9d64542b1125a9f8ca64272 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:10.997386  7296 catalog_manager.cc:5697] T 23201718ad6845f79123a5c755b9657a P 9fb730dfb9d64542b1125a9f8ca64272 reported cstate change: term changed from 1 to 2, leader changed from 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1) to 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2). New cstate: current_term: 2 leader_uuid: "9fb730dfb9d64542b1125a9f8ca64272" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:11.025238  7683 raft_consensus.cc:993] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58: : Instructing follower 6892fe946cc9442eb2e1e21f1024b355 to start an election
I20260709 13:13:11.025826  7600 raft_consensus.cc:1081] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 [term 1 LEADER]: Signalling peer 6892fe946cc9442eb2e1e21f1024b355 to start an election
I20260709 13:13:11.027355  7398 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c2d9c7b2731498fbe0f7d715f98583f"
dest_uuid: "6892fe946cc9442eb2e1e21f1024b355"
 from {username='slave'} at 127.0.0.1:34692
I20260709 13:13:11.027921  7398 raft_consensus.cc:493] T 7c2d9c7b2731498fbe0f7d715f98583f P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:11.028223  7398 raft_consensus.cc:3060] T 7c2d9c7b2731498fbe0f7d715f98583f P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.033973  7398 raft_consensus.cc:515] T 7c2d9c7b2731498fbe0f7d715f98583f P 6892fe946cc9442eb2e1e21f1024b355 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } } peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } }
I20260709 13:13:11.035878  7398 leader_election.cc:290] T 7c2d9c7b2731498fbe0f7d715f98583f P 6892fe946cc9442eb2e1e21f1024b355 [CANDIDATE]: Term 2 election: Requested vote from peers 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:11.036698  7474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2d9c7b2731498fbe0f7d715f98583f" candidate_uuid: "6892fe946cc9442eb2e1e21f1024b355" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272"
I20260709 13:13:11.037194  7548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2d9c7b2731498fbe0f7d715f98583f" candidate_uuid: "6892fe946cc9442eb2e1e21f1024b355" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5b9feaa36ef49c386775798c7fbba58"
I20260709 13:13:11.037437  7474 raft_consensus.cc:3060] T 7c2d9c7b2731498fbe0f7d715f98583f P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.037814  7548 raft_consensus.cc:3055] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:11.038175  7548 raft_consensus.cc:740] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d5b9feaa36ef49c386775798c7fbba58, State: Running, Role: LEADER
I20260709 13:13:11.038895  7548 consensus_queue.cc:260] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } } peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } }
I20260709 13:13:11.039889  7548 raft_consensus.cc:3060] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.044912  7548 raft_consensus.cc:2468] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6892fe946cc9442eb2e1e21f1024b355 in term 2.
I20260709 13:13:11.045377  7474 raft_consensus.cc:2468] T 7c2d9c7b2731498fbe0f7d715f98583f P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6892fe946cc9442eb2e1e21f1024b355 in term 2.
I20260709 13:13:11.045925  7362 leader_election.cc:304] T 7c2d9c7b2731498fbe0f7d715f98583f P 6892fe946cc9442eb2e1e21f1024b355 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6892fe946cc9442eb2e1e21f1024b355, d5b9feaa36ef49c386775798c7fbba58; no voters: 
I20260709 13:13:11.046734  7661 raft_consensus.cc:2804] T 7c2d9c7b2731498fbe0f7d715f98583f P 6892fe946cc9442eb2e1e21f1024b355 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:11.047217  7661 raft_consensus.cc:697] T 7c2d9c7b2731498fbe0f7d715f98583f P 6892fe946cc9442eb2e1e21f1024b355 [term 2 LEADER]: Becoming Leader. State: Replica: 6892fe946cc9442eb2e1e21f1024b355, State: Running, Role: LEADER
I20260709 13:13:11.048009  7661 consensus_queue.cc:237] T 7c2d9c7b2731498fbe0f7d715f98583f P 6892fe946cc9442eb2e1e21f1024b355 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } } peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } }
I20260709 13:13:11.055801  7296 catalog_manager.cc:5697] T 7c2d9c7b2731498fbe0f7d715f98583f P 6892fe946cc9442eb2e1e21f1024b355 reported cstate change: term changed from 1 to 2, leader changed from d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3) to 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1). New cstate: current_term: 2 leader_uuid: "6892fe946cc9442eb2e1e21f1024b355" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:11.059404  7683 raft_consensus.cc:993] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58: : Instructing follower 6892fe946cc9442eb2e1e21f1024b355 to start an election
I20260709 13:13:11.059964  7600 raft_consensus.cc:1081] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 [term 1 LEADER]: Signalling peer 6892fe946cc9442eb2e1e21f1024b355 to start an election
I20260709 13:13:11.061601  7398 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79da21344c24485d8cac81393166ecb2"
dest_uuid: "6892fe946cc9442eb2e1e21f1024b355"
 from {username='slave'} at 127.0.0.1:34692
I20260709 13:13:11.062052  7398 raft_consensus.cc:493] T 79da21344c24485d8cac81393166ecb2 P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:11.062428  7398 raft_consensus.cc:3060] T 79da21344c24485d8cac81393166ecb2 P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.067698  7398 raft_consensus.cc:515] T 79da21344c24485d8cac81393166ecb2 P 6892fe946cc9442eb2e1e21f1024b355 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:11.069475  7398 leader_election.cc:290] T 79da21344c24485d8cac81393166ecb2 P 6892fe946cc9442eb2e1e21f1024b355 [CANDIDATE]: Term 2 election: Requested vote from peers 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:11.070212  7474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79da21344c24485d8cac81393166ecb2" candidate_uuid: "6892fe946cc9442eb2e1e21f1024b355" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272"
I20260709 13:13:11.070519  7548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79da21344c24485d8cac81393166ecb2" candidate_uuid: "6892fe946cc9442eb2e1e21f1024b355" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5b9feaa36ef49c386775798c7fbba58"
I20260709 13:13:11.070899  7474 raft_consensus.cc:3060] T 79da21344c24485d8cac81393166ecb2 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.071172  7548 raft_consensus.cc:3055] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:11.071542  7548 raft_consensus.cc:740] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d5b9feaa36ef49c386775798c7fbba58, State: Running, Role: LEADER
I20260709 13:13:11.072269  7548 consensus_queue.cc:260] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:11.073189  7548 raft_consensus.cc:3060] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.078087  7548 raft_consensus.cc:2468] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6892fe946cc9442eb2e1e21f1024b355 in term 2.
I20260709 13:13:11.079047  7362 leader_election.cc:304] T 79da21344c24485d8cac81393166ecb2 P 6892fe946cc9442eb2e1e21f1024b355 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6892fe946cc9442eb2e1e21f1024b355, d5b9feaa36ef49c386775798c7fbba58; no voters: 
I20260709 13:13:11.079049  7474 raft_consensus.cc:2468] T 79da21344c24485d8cac81393166ecb2 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6892fe946cc9442eb2e1e21f1024b355 in term 2.
I20260709 13:13:11.079881  7661 raft_consensus.cc:2804] T 79da21344c24485d8cac81393166ecb2 P 6892fe946cc9442eb2e1e21f1024b355 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:11.080593  7661 raft_consensus.cc:697] T 79da21344c24485d8cac81393166ecb2 P 6892fe946cc9442eb2e1e21f1024b355 [term 2 LEADER]: Becoming Leader. State: Replica: 6892fe946cc9442eb2e1e21f1024b355, State: Running, Role: LEADER
I20260709 13:13:11.081387  7661 consensus_queue.cc:237] T 79da21344c24485d8cac81393166ecb2 P 6892fe946cc9442eb2e1e21f1024b355 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:11.089637  7296 catalog_manager.cc:5697] T 79da21344c24485d8cac81393166ecb2 P 6892fe946cc9442eb2e1e21f1024b355 reported cstate change: term changed from 1 to 2, leader changed from d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3) to 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1). New cstate: current_term: 2 leader_uuid: "6892fe946cc9442eb2e1e21f1024b355" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:11.366053  7548 raft_consensus.cc:1275] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Refusing update from remote peer 9fb730dfb9d64542b1125a9f8ca64272: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:11.367565  7677 consensus_queue.cc:1048] T 3e8d0f65b3564feea4ae78a34ede70f3 P 9fb730dfb9d64542b1125a9f8ca64272 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:11.381264  7398 raft_consensus.cc:1275] T 3e8d0f65b3564feea4ae78a34ede70f3 P 6892fe946cc9442eb2e1e21f1024b355 [term 2 FOLLOWER]: Refusing update from remote peer 9fb730dfb9d64542b1125a9f8ca64272: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:11.382854  7690 consensus_queue.cc:1048] T 3e8d0f65b3564feea4ae78a34ede70f3 P 9fb730dfb9d64542b1125a9f8ca64272 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:11.410653  7474 raft_consensus.cc:1275] T 730c1374419e417286fca4006acf11a9 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Refusing update from remote peer 6892fe946cc9442eb2e1e21f1024b355: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:11.412135  7661 consensus_queue.cc:1048] T 730c1374419e417286fca4006acf11a9 P 6892fe946cc9442eb2e1e21f1024b355 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:11.427278  7548 raft_consensus.cc:1275] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Refusing update from remote peer 6892fe946cc9442eb2e1e21f1024b355: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:11.428687  7661 consensus_queue.cc:1048] T 730c1374419e417286fca4006acf11a9 P 6892fe946cc9442eb2e1e21f1024b355 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:11.441937  7473 raft_consensus.cc:1275] T 7c2d9c7b2731498fbe0f7d715f98583f P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Refusing update from remote peer 6892fe946cc9442eb2e1e21f1024b355: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:11.443286  7661 consensus_queue.cc:1048] T 7c2d9c7b2731498fbe0f7d715f98583f P 6892fe946cc9442eb2e1e21f1024b355 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:11.457698  7548 raft_consensus.cc:1275] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Refusing update from remote peer 6892fe946cc9442eb2e1e21f1024b355: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:11.460798  7661 consensus_queue.cc:1048] T 7c2d9c7b2731498fbe0f7d715f98583f P 6892fe946cc9442eb2e1e21f1024b355 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:11.478864  7398 raft_consensus.cc:1275] T 23201718ad6845f79123a5c755b9657a P 6892fe946cc9442eb2e1e21f1024b355 [term 2 FOLLOWER]: Refusing update from remote peer 9fb730dfb9d64542b1125a9f8ca64272: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:11.480268  7690 consensus_queue.cc:1048] T 23201718ad6845f79123a5c755b9657a P 9fb730dfb9d64542b1125a9f8ca64272 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:11.490195  7548 raft_consensus.cc:1275] T 23201718ad6845f79123a5c755b9657a P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Refusing update from remote peer 9fb730dfb9d64542b1125a9f8ca64272: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:11.491742  7677 consensus_queue.cc:1048] T 23201718ad6845f79123a5c755b9657a P 9fb730dfb9d64542b1125a9f8ca64272 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:11.591363  7548 raft_consensus.cc:1275] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Refusing update from remote peer 6892fe946cc9442eb2e1e21f1024b355: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:11.592648  7700 consensus_queue.cc:1048] T 79da21344c24485d8cac81393166ecb2 P 6892fe946cc9442eb2e1e21f1024b355 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:11.602402  7473 raft_consensus.cc:1275] T 79da21344c24485d8cac81393166ecb2 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Refusing update from remote peer 6892fe946cc9442eb2e1e21f1024b355: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:11.604063  7661 consensus_queue.cc:1048] T 79da21344c24485d8cac81393166ecb2 P 6892fe946cc9442eb2e1e21f1024b355 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:13.758276  7297 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:32912:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:13.761142  7297 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:13.815362  7385 tablet_service.cc:1511] Processing CreateTablet for tablet 87d3c8dac44049b8ba431715dc8a5af6 (DEFAULT_TABLE table=soft_deleted_table [id=0a26cb3ee77542709beac2bab538efe1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:13.816425  7461 tablet_service.cc:1511] Processing CreateTablet for tablet 87d3c8dac44049b8ba431715dc8a5af6 (DEFAULT_TABLE table=soft_deleted_table [id=0a26cb3ee77542709beac2bab538efe1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:13.817291  7385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87d3c8dac44049b8ba431715dc8a5af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.818233  7461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87d3c8dac44049b8ba431715dc8a5af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.818262  7535 tablet_service.cc:1511] Processing CreateTablet for tablet 87d3c8dac44049b8ba431715dc8a5af6 (DEFAULT_TABLE table=soft_deleted_table [id=0a26cb3ee77542709beac2bab538efe1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:13.819551  7384 tablet_service.cc:1511] Processing CreateTablet for tablet 5a3ec2cf0baf4f99a5898f1dc93c0df3 (DEFAULT_TABLE table=soft_deleted_table [id=0a26cb3ee77542709beac2bab538efe1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:13.820147  7535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87d3c8dac44049b8ba431715dc8a5af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.823072  7533 tablet_service.cc:1511] Processing CreateTablet for tablet 5a3ec2cf0baf4f99a5898f1dc93c0df3 (DEFAULT_TABLE table=soft_deleted_table [id=0a26cb3ee77542709beac2bab538efe1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:13.824440  7533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a3ec2cf0baf4f99a5898f1dc93c0df3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.827029  7463 tablet_service.cc:1511] Processing CreateTablet for tablet 5a3ec2cf0baf4f99a5898f1dc93c0df3 (DEFAULT_TABLE table=soft_deleted_table [id=0a26cb3ee77542709beac2bab538efe1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:13.828585  7463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a3ec2cf0baf4f99a5898f1dc93c0df3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.832787  7460 tablet_service.cc:1511] Processing CreateTablet for tablet f57c9d84137e43f682ab95b85728a749 (DEFAULT_TABLE table=soft_deleted_table [id=0a26cb3ee77542709beac2bab538efe1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:13.834273  7460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f57c9d84137e43f682ab95b85728a749. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.835947  7536 tablet_service.cc:1511] Processing CreateTablet for tablet f57c9d84137e43f682ab95b85728a749 (DEFAULT_TABLE table=soft_deleted_table [id=0a26cb3ee77542709beac2bab538efe1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:13.835985  7389 tablet_service.cc:1511] Processing CreateTablet for tablet f57c9d84137e43f682ab95b85728a749 (DEFAULT_TABLE table=soft_deleted_table [id=0a26cb3ee77542709beac2bab538efe1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:13.837371  7536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f57c9d84137e43f682ab95b85728a749. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.838747  7459 tablet_service.cc:1511] Processing CreateTablet for tablet cd343cb8504a420385daa15f0d0f4f84 (DEFAULT_TABLE table=soft_deleted_table [id=0a26cb3ee77542709beac2bab538efe1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:13.839620  7383 tablet_service.cc:1511] Processing CreateTablet for tablet cd343cb8504a420385daa15f0d0f4f84 (DEFAULT_TABLE table=soft_deleted_table [id=0a26cb3ee77542709beac2bab538efe1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:13.840385  7459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd343cb8504a420385daa15f0d0f4f84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.846015  7384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a3ec2cf0baf4f99a5898f1dc93c0df3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.848989  7534 tablet_service.cc:1511] Processing CreateTablet for tablet cd343cb8504a420385daa15f0d0f4f84 (DEFAULT_TABLE table=soft_deleted_table [id=0a26cb3ee77542709beac2bab538efe1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:13.850409  7534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd343cb8504a420385daa15f0d0f4f84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.852296  7383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd343cb8504a420385daa15f0d0f4f84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.856215  7389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f57c9d84137e43f682ab95b85728a749. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.867384  7388 tablet_service.cc:1511] Processing CreateTablet for tablet b114fd1274ba4053a1d836e8d5f53f3b (DEFAULT_TABLE table=soft_deleted_table [id=0a26cb3ee77542709beac2bab538efe1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:13.868896  7388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b114fd1274ba4053a1d836e8d5f53f3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.875161  7462 tablet_service.cc:1511] Processing CreateTablet for tablet b114fd1274ba4053a1d836e8d5f53f3b (DEFAULT_TABLE table=soft_deleted_table [id=0a26cb3ee77542709beac2bab538efe1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:13.876646  7462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b114fd1274ba4053a1d836e8d5f53f3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.877372  7538 tablet_service.cc:1511] Processing CreateTablet for tablet b114fd1274ba4053a1d836e8d5f53f3b (DEFAULT_TABLE table=soft_deleted_table [id=0a26cb3ee77542709beac2bab538efe1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:13.878751  7538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b114fd1274ba4053a1d836e8d5f53f3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.881592  7386 tablet_service.cc:1511] Processing CreateTablet for tablet c050f90249fc477abf94ed50adc7b5e3 (DEFAULT_TABLE table=soft_deleted_table [id=0a26cb3ee77542709beac2bab538efe1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:13.882942  7386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c050f90249fc477abf94ed50adc7b5e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.886554  7720 tablet_bootstrap.cc:492] T 87d3c8dac44049b8ba431715dc8a5af6 P d5b9feaa36ef49c386775798c7fbba58: Bootstrap starting.
I20260709 13:13:13.890416  7464 tablet_service.cc:1511] Processing CreateTablet for tablet c050f90249fc477abf94ed50adc7b5e3 (DEFAULT_TABLE table=soft_deleted_table [id=0a26cb3ee77542709beac2bab538efe1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:13.891840  7464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c050f90249fc477abf94ed50adc7b5e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.899863  7720 tablet_bootstrap.cc:654] T 87d3c8dac44049b8ba431715dc8a5af6 P d5b9feaa36ef49c386775798c7fbba58: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:13.912624  7536 tablet_service.cc:1511] Processing CreateTablet for tablet c050f90249fc477abf94ed50adc7b5e3 (DEFAULT_TABLE table=soft_deleted_table [id=0a26cb3ee77542709beac2bab538efe1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:13.914304  7536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c050f90249fc477abf94ed50adc7b5e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.917652  7458 tablet_service.cc:1511] Processing CreateTablet for tablet f1ed065b6ee3472da798007ec76be525 (DEFAULT_TABLE table=soft_deleted_table [id=0a26cb3ee77542709beac2bab538efe1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:13.919117  7458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1ed065b6ee3472da798007ec76be525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.922403  7387 tablet_service.cc:1511] Processing CreateTablet for tablet f1ed065b6ee3472da798007ec76be525 (DEFAULT_TABLE table=soft_deleted_table [id=0a26cb3ee77542709beac2bab538efe1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:13.922866  7535 tablet_service.cc:1511] Processing CreateTablet for tablet f1ed065b6ee3472da798007ec76be525 (DEFAULT_TABLE table=soft_deleted_table [id=0a26cb3ee77542709beac2bab538efe1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:13.924197  7535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1ed065b6ee3472da798007ec76be525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.924468  7387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1ed065b6ee3472da798007ec76be525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.926905  7382 tablet_service.cc:1511] Processing CreateTablet for tablet 207f51796525408199723c1d30adca6e (DEFAULT_TABLE table=soft_deleted_table [id=0a26cb3ee77542709beac2bab538efe1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:13.928992  7382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 207f51796525408199723c1d30adca6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.929697  7457 tablet_service.cc:1511] Processing CreateTablet for tablet 207f51796525408199723c1d30adca6e (DEFAULT_TABLE table=soft_deleted_table [id=0a26cb3ee77542709beac2bab538efe1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:13.931280  7457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 207f51796525408199723c1d30adca6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.934583  7720 tablet_bootstrap.cc:492] T 87d3c8dac44049b8ba431715dc8a5af6 P d5b9feaa36ef49c386775798c7fbba58: No bootstrap required, opened a new log
I20260709 13:13:13.935195  7720 ts_tablet_manager.cc:1403] T 87d3c8dac44049b8ba431715dc8a5af6 P d5b9feaa36ef49c386775798c7fbba58: Time spent bootstrapping tablet: real 0.049s	user 0.016s	sys 0.013s
I20260709 13:13:13.940212  7456 tablet_service.cc:1511] Processing CreateTablet for tablet e5edb5aba6f548a189a2ecd96cf02b28 (DEFAULT_TABLE table=soft_deleted_table [id=0a26cb3ee77542709beac2bab538efe1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:13.941591  7456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5edb5aba6f548a189a2ecd96cf02b28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.938648  7720 raft_consensus.cc:359] T 87d3c8dac44049b8ba431715dc8a5af6 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:13.945729  7720 raft_consensus.cc:385] T 87d3c8dac44049b8ba431715dc8a5af6 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:13.945410  7381 tablet_service.cc:1511] Processing CreateTablet for tablet e5edb5aba6f548a189a2ecd96cf02b28 (DEFAULT_TABLE table=soft_deleted_table [id=0a26cb3ee77542709beac2bab538efe1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:13.928591  7534 tablet_service.cc:1511] Processing CreateTablet for tablet 207f51796525408199723c1d30adca6e (DEFAULT_TABLE table=soft_deleted_table [id=0a26cb3ee77542709beac2bab538efe1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:13.953192  7381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5edb5aba6f548a189a2ecd96cf02b28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.953323  7720 raft_consensus.cc:740] T 87d3c8dac44049b8ba431715dc8a5af6 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5b9feaa36ef49c386775798c7fbba58, State: Initialized, Role: FOLLOWER
I20260709 13:13:13.954311  7720 consensus_queue.cc:260] T 87d3c8dac44049b8ba431715dc8a5af6 P d5b9feaa36ef49c386775798c7fbba58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:13.953192  7534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 207f51796525408199723c1d30adca6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.960575  7720 ts_tablet_manager.cc:1434] T 87d3c8dac44049b8ba431715dc8a5af6 P d5b9feaa36ef49c386775798c7fbba58: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:13:13.961869  7720 tablet_bootstrap.cc:492] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58: Bootstrap starting.
I20260709 13:13:13.968851  7720 tablet_bootstrap.cc:654] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:13.972682  7535 tablet_service.cc:1511] Processing CreateTablet for tablet e5edb5aba6f548a189a2ecd96cf02b28 (DEFAULT_TABLE table=soft_deleted_table [id=0a26cb3ee77542709beac2bab538efe1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:13.973953  7535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5edb5aba6f548a189a2ecd96cf02b28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:13.977967  7708 raft_consensus.cc:493] T 87d3c8dac44049b8ba431715dc8a5af6 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:13.978525  7708 raft_consensus.cc:515] T 87d3c8dac44049b8ba431715dc8a5af6 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:13.981006  7708 leader_election.cc:290] T 87d3c8dac44049b8ba431715dc8a5af6 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941)
I20260709 13:13:13.983453  7720 tablet_bootstrap.cc:492] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58: No bootstrap required, opened a new log
I20260709 13:13:13.983543  7473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d3c8dac44049b8ba431715dc8a5af6" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272" is_pre_election: true
I20260709 13:13:13.983968  7720 ts_tablet_manager.cc:1403] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.011s
I20260709 13:13:13.988433  7720 raft_consensus.cc:359] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:13.989171  7720 raft_consensus.cc:385] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:13.989501  7720 raft_consensus.cc:740] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5b9feaa36ef49c386775798c7fbba58, State: Initialized, Role: FOLLOWER
I20260709 13:13:13.990373  7720 consensus_queue.cc:260] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
W20260709 13:13:13.990826  7511 leader_election.cc:343] T 87d3c8dac44049b8ba431715dc8a5af6 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:13.992246  7511 leader_election.cc:343] T 87d3c8dac44049b8ba431715dc8a5af6 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Not found: Tablet not found: 87d3c8dac44049b8ba431715dc8a5af6
I20260709 13:13:13.994618  7511 leader_election.cc:304] T 87d3c8dac44049b8ba431715dc8a5af6 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5b9feaa36ef49c386775798c7fbba58; no voters: 6892fe946cc9442eb2e1e21f1024b355, 9fb730dfb9d64542b1125a9f8ca64272
I20260709 13:13:13.995491  7708 raft_consensus.cc:2749] T 87d3c8dac44049b8ba431715dc8a5af6 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:13.996335  7720 ts_tablet_manager.cc:1434] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.002s
I20260709 13:13:13.997408  7720 tablet_bootstrap.cc:492] T cd343cb8504a420385daa15f0d0f4f84 P d5b9feaa36ef49c386775798c7fbba58: Bootstrap starting.
I20260709 13:13:14.018929  7720 tablet_bootstrap.cc:654] T cd343cb8504a420385daa15f0d0f4f84 P d5b9feaa36ef49c386775798c7fbba58: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:14.030395  7720 tablet_bootstrap.cc:492] T cd343cb8504a420385daa15f0d0f4f84 P d5b9feaa36ef49c386775798c7fbba58: No bootstrap required, opened a new log
I20260709 13:13:14.033478  7720 ts_tablet_manager.cc:1403] T cd343cb8504a420385daa15f0d0f4f84 P d5b9feaa36ef49c386775798c7fbba58: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.000s
I20260709 13:13:14.038177  7720 raft_consensus.cc:359] T cd343cb8504a420385daa15f0d0f4f84 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.043715  7720 raft_consensus.cc:385] T cd343cb8504a420385daa15f0d0f4f84 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:14.044672  7720 raft_consensus.cc:740] T cd343cb8504a420385daa15f0d0f4f84 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5b9feaa36ef49c386775798c7fbba58, State: Initialized, Role: FOLLOWER
I20260709 13:13:14.047343  7720 consensus_queue.cc:260] T cd343cb8504a420385daa15f0d0f4f84 P d5b9feaa36ef49c386775798c7fbba58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.050973  7720 ts_tablet_manager.cc:1434] T cd343cb8504a420385daa15f0d0f4f84 P d5b9feaa36ef49c386775798c7fbba58: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.003s
I20260709 13:13:14.052585  7720 tablet_bootstrap.cc:492] T b114fd1274ba4053a1d836e8d5f53f3b P d5b9feaa36ef49c386775798c7fbba58: Bootstrap starting.
I20260709 13:13:14.061558  7720 tablet_bootstrap.cc:654] T b114fd1274ba4053a1d836e8d5f53f3b P d5b9feaa36ef49c386775798c7fbba58: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:14.045616  7724 tablet_bootstrap.cc:492] T 207f51796525408199723c1d30adca6e P 6892fe946cc9442eb2e1e21f1024b355: Bootstrap starting.
I20260709 13:13:14.064987  7721 tablet_bootstrap.cc:492] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272: Bootstrap starting.
I20260709 13:13:14.073566  7721 tablet_bootstrap.cc:654] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:14.074471  7720 tablet_bootstrap.cc:492] T b114fd1274ba4053a1d836e8d5f53f3b P d5b9feaa36ef49c386775798c7fbba58: No bootstrap required, opened a new log
I20260709 13:13:14.075038  7720 ts_tablet_manager.cc:1403] T b114fd1274ba4053a1d836e8d5f53f3b P d5b9feaa36ef49c386775798c7fbba58: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.012s
I20260709 13:13:14.078611  7724 tablet_bootstrap.cc:654] T 207f51796525408199723c1d30adca6e P 6892fe946cc9442eb2e1e21f1024b355: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:14.081698  7720 raft_consensus.cc:359] T b114fd1274ba4053a1d836e8d5f53f3b P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.082787  7720 raft_consensus.cc:385] T b114fd1274ba4053a1d836e8d5f53f3b P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:14.083252  7720 raft_consensus.cc:740] T b114fd1274ba4053a1d836e8d5f53f3b P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5b9feaa36ef49c386775798c7fbba58, State: Initialized, Role: FOLLOWER
I20260709 13:13:14.084447  7720 consensus_queue.cc:260] T b114fd1274ba4053a1d836e8d5f53f3b P d5b9feaa36ef49c386775798c7fbba58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.087702  7720 ts_tablet_manager.cc:1434] T b114fd1274ba4053a1d836e8d5f53f3b P d5b9feaa36ef49c386775798c7fbba58: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:13:14.089136  7720 tablet_bootstrap.cc:492] T f1ed065b6ee3472da798007ec76be525 P d5b9feaa36ef49c386775798c7fbba58: Bootstrap starting.
I20260709 13:13:14.089236  7721 tablet_bootstrap.cc:492] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272: No bootstrap required, opened a new log
I20260709 13:13:14.090329  7721 ts_tablet_manager.cc:1403] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.006s
I20260709 13:13:14.093559  7721 raft_consensus.cc:359] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.094340  7721 raft_consensus.cc:385] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:14.094694  7721 raft_consensus.cc:740] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fb730dfb9d64542b1125a9f8ca64272, State: Initialized, Role: FOLLOWER
I20260709 13:13:14.094946  7724 tablet_bootstrap.cc:492] T 207f51796525408199723c1d30adca6e P 6892fe946cc9442eb2e1e21f1024b355: No bootstrap required, opened a new log
I20260709 13:13:14.095499  7724 ts_tablet_manager.cc:1403] T 207f51796525408199723c1d30adca6e P 6892fe946cc9442eb2e1e21f1024b355: Time spent bootstrapping tablet: real 0.050s	user 0.014s	sys 0.005s
I20260709 13:13:14.095599  7721 consensus_queue.cc:260] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.098528  7724 raft_consensus.cc:359] T 207f51796525408199723c1d30adca6e P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.099279  7724 raft_consensus.cc:385] T 207f51796525408199723c1d30adca6e P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:14.099608  7724 raft_consensus.cc:740] T 207f51796525408199723c1d30adca6e P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6892fe946cc9442eb2e1e21f1024b355, State: Initialized, Role: FOLLOWER
I20260709 13:13:14.100899  7721 ts_tablet_manager.cc:1434] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:13:14.100533  7724 consensus_queue.cc:260] T 207f51796525408199723c1d30adca6e P 6892fe946cc9442eb2e1e21f1024b355 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.102072  7721 tablet_bootstrap.cc:492] T f57c9d84137e43f682ab95b85728a749 P 9fb730dfb9d64542b1125a9f8ca64272: Bootstrap starting.
I20260709 13:13:14.103276  7724 ts_tablet_manager.cc:1434] T 207f51796525408199723c1d30adca6e P 6892fe946cc9442eb2e1e21f1024b355: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:14.104797  7720 tablet_bootstrap.cc:654] T f1ed065b6ee3472da798007ec76be525 P d5b9feaa36ef49c386775798c7fbba58: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:14.105546  7724 tablet_bootstrap.cc:492] T e5edb5aba6f548a189a2ecd96cf02b28 P 6892fe946cc9442eb2e1e21f1024b355: Bootstrap starting.
I20260709 13:13:14.110980  7721 tablet_bootstrap.cc:654] T f57c9d84137e43f682ab95b85728a749 P 9fb730dfb9d64542b1125a9f8ca64272: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:14.112470  7724 tablet_bootstrap.cc:654] T e5edb5aba6f548a189a2ecd96cf02b28 P 6892fe946cc9442eb2e1e21f1024b355: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:14.122818  7574 tablet.cc:2406] T 87d3c8dac44049b8ba431715dc8a5af6 P d5b9feaa36ef49c386775798c7fbba58: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:13:14.127532  7724 tablet_bootstrap.cc:492] T e5edb5aba6f548a189a2ecd96cf02b28 P 6892fe946cc9442eb2e1e21f1024b355: No bootstrap required, opened a new log
I20260709 13:13:14.128158  7724 ts_tablet_manager.cc:1403] T e5edb5aba6f548a189a2ecd96cf02b28 P 6892fe946cc9442eb2e1e21f1024b355: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.004s
I20260709 13:13:14.128872  7720 tablet_bootstrap.cc:492] T f1ed065b6ee3472da798007ec76be525 P d5b9feaa36ef49c386775798c7fbba58: No bootstrap required, opened a new log
I20260709 13:13:14.129387  7721 tablet_bootstrap.cc:492] T f57c9d84137e43f682ab95b85728a749 P 9fb730dfb9d64542b1125a9f8ca64272: No bootstrap required, opened a new log
I20260709 13:13:14.129458  7720 ts_tablet_manager.cc:1403] T f1ed065b6ee3472da798007ec76be525 P d5b9feaa36ef49c386775798c7fbba58: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.014s
I20260709 13:13:14.131376  7724 raft_consensus.cc:359] T e5edb5aba6f548a189a2ecd96cf02b28 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.129917  7721 ts_tablet_manager.cc:1403] T f57c9d84137e43f682ab95b85728a749 P 9fb730dfb9d64542b1125a9f8ca64272: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.011s
I20260709 13:13:14.132220  7724 raft_consensus.cc:385] T e5edb5aba6f548a189a2ecd96cf02b28 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:14.132661  7724 raft_consensus.cc:740] T e5edb5aba6f548a189a2ecd96cf02b28 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6892fe946cc9442eb2e1e21f1024b355, State: Initialized, Role: FOLLOWER
I20260709 13:13:14.133504  7720 raft_consensus.cc:359] T f1ed065b6ee3472da798007ec76be525 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.133375  7724 consensus_queue.cc:260] T e5edb5aba6f548a189a2ecd96cf02b28 P 6892fe946cc9442eb2e1e21f1024b355 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.134213  7720 raft_consensus.cc:385] T f1ed065b6ee3472da798007ec76be525 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:14.134534  7720 raft_consensus.cc:740] T f1ed065b6ee3472da798007ec76be525 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5b9feaa36ef49c386775798c7fbba58, State: Initialized, Role: FOLLOWER
I20260709 13:13:14.134950  7721 raft_consensus.cc:359] T f57c9d84137e43f682ab95b85728a749 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.135661  7721 raft_consensus.cc:385] T f57c9d84137e43f682ab95b85728a749 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:14.135453  7720 consensus_queue.cc:260] T f1ed065b6ee3472da798007ec76be525 P d5b9feaa36ef49c386775798c7fbba58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.135985  7721 raft_consensus.cc:740] T f57c9d84137e43f682ab95b85728a749 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fb730dfb9d64542b1125a9f8ca64272, State: Initialized, Role: FOLLOWER
I20260709 13:13:14.136358  7724 ts_tablet_manager.cc:1434] T e5edb5aba6f548a189a2ecd96cf02b28 P 6892fe946cc9442eb2e1e21f1024b355: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:13:14.137804  7724 tablet_bootstrap.cc:492] T c050f90249fc477abf94ed50adc7b5e3 P 6892fe946cc9442eb2e1e21f1024b355: Bootstrap starting.
I20260709 13:13:14.138025  7720 ts_tablet_manager.cc:1434] T f1ed065b6ee3472da798007ec76be525 P d5b9feaa36ef49c386775798c7fbba58: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:14.139014  7720 tablet_bootstrap.cc:492] T c050f90249fc477abf94ed50adc7b5e3 P d5b9feaa36ef49c386775798c7fbba58: Bootstrap starting.
I20260709 13:13:14.142541  7708 raft_consensus.cc:493] T f1ed065b6ee3472da798007ec76be525 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.143074  7708 raft_consensus.cc:515] T f1ed065b6ee3472da798007ec76be525 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.145289  7708 leader_election.cc:290] T f1ed065b6ee3472da798007ec76be525 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941)
I20260709 13:13:14.146552  7399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ed065b6ee3472da798007ec76be525" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6892fe946cc9442eb2e1e21f1024b355" is_pre_election: true
I20260709 13:13:14.146981  7720 tablet_bootstrap.cc:654] T c050f90249fc477abf94ed50adc7b5e3 P d5b9feaa36ef49c386775798c7fbba58: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:14.143873  7721 consensus_queue.cc:260] T f57c9d84137e43f682ab95b85728a749 P 9fb730dfb9d64542b1125a9f8ca64272 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.147565  7724 tablet_bootstrap.cc:654] T c050f90249fc477abf94ed50adc7b5e3 P 6892fe946cc9442eb2e1e21f1024b355: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:14.149250  7511 leader_election.cc:343] T f1ed065b6ee3472da798007ec76be525 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:14.150131  7473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ed065b6ee3472da798007ec76be525" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272" is_pre_election: true
I20260709 13:13:14.151294  7721 ts_tablet_manager.cc:1434] T f57c9d84137e43f682ab95b85728a749 P 9fb730dfb9d64542b1125a9f8ca64272: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:13:14.152300  7721 tablet_bootstrap.cc:492] T c050f90249fc477abf94ed50adc7b5e3 P 9fb730dfb9d64542b1125a9f8ca64272: Bootstrap starting.
W20260709 13:13:14.155417  7511 leader_election.cc:343] T f1ed065b6ee3472da798007ec76be525 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:14.155944  7511 leader_election.cc:304] T f1ed065b6ee3472da798007ec76be525 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5b9feaa36ef49c386775798c7fbba58; no voters: 6892fe946cc9442eb2e1e21f1024b355, 9fb730dfb9d64542b1125a9f8ca64272
I20260709 13:13:14.157050  7708 raft_consensus.cc:2749] T f1ed065b6ee3472da798007ec76be525 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:14.161090  7721 tablet_bootstrap.cc:654] T c050f90249fc477abf94ed50adc7b5e3 P 9fb730dfb9d64542b1125a9f8ca64272: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:14.173323  7721 tablet_bootstrap.cc:492] T c050f90249fc477abf94ed50adc7b5e3 P 9fb730dfb9d64542b1125a9f8ca64272: No bootstrap required, opened a new log
I20260709 13:13:14.173836  7721 ts_tablet_manager.cc:1403] T c050f90249fc477abf94ed50adc7b5e3 P 9fb730dfb9d64542b1125a9f8ca64272: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.006s
I20260709 13:13:14.177130  7720 tablet_bootstrap.cc:492] T c050f90249fc477abf94ed50adc7b5e3 P d5b9feaa36ef49c386775798c7fbba58: No bootstrap required, opened a new log
I20260709 13:13:14.177301  7724 tablet_bootstrap.cc:492] T c050f90249fc477abf94ed50adc7b5e3 P 6892fe946cc9442eb2e1e21f1024b355: No bootstrap required, opened a new log
I20260709 13:13:14.177760  7720 ts_tablet_manager.cc:1403] T c050f90249fc477abf94ed50adc7b5e3 P d5b9feaa36ef49c386775798c7fbba58: Time spent bootstrapping tablet: real 0.039s	user 0.021s	sys 0.015s
I20260709 13:13:14.177799  7724 ts_tablet_manager.cc:1403] T c050f90249fc477abf94ed50adc7b5e3 P 6892fe946cc9442eb2e1e21f1024b355: Time spent bootstrapping tablet: real 0.040s	user 0.024s	sys 0.013s
I20260709 13:13:14.177907  7721 raft_consensus.cc:359] T c050f90249fc477abf94ed50adc7b5e3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.178854  7721 raft_consensus.cc:385] T c050f90249fc477abf94ed50adc7b5e3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:14.179134  7721 raft_consensus.cc:740] T c050f90249fc477abf94ed50adc7b5e3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fb730dfb9d64542b1125a9f8ca64272, State: Initialized, Role: FOLLOWER
I20260709 13:13:14.180068  7721 consensus_queue.cc:260] T c050f90249fc477abf94ed50adc7b5e3 P 9fb730dfb9d64542b1125a9f8ca64272 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.181171  7720 raft_consensus.cc:359] T c050f90249fc477abf94ed50adc7b5e3 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.181425  7724 raft_consensus.cc:359] T c050f90249fc477abf94ed50adc7b5e3 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.181977  7720 raft_consensus.cc:385] T c050f90249fc477abf94ed50adc7b5e3 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:14.182125  7724 raft_consensus.cc:385] T c050f90249fc477abf94ed50adc7b5e3 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:14.182341  7720 raft_consensus.cc:740] T c050f90249fc477abf94ed50adc7b5e3 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5b9feaa36ef49c386775798c7fbba58, State: Initialized, Role: FOLLOWER
I20260709 13:13:14.182443  7724 raft_consensus.cc:740] T c050f90249fc477abf94ed50adc7b5e3 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6892fe946cc9442eb2e1e21f1024b355, State: Initialized, Role: FOLLOWER
I20260709 13:13:14.183414  7724 consensus_queue.cc:260] T c050f90249fc477abf94ed50adc7b5e3 P 6892fe946cc9442eb2e1e21f1024b355 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.183414  7720 consensus_queue.cc:260] T c050f90249fc477abf94ed50adc7b5e3 P d5b9feaa36ef49c386775798c7fbba58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.184204  7721 ts_tablet_manager.cc:1434] T c050f90249fc477abf94ed50adc7b5e3 P 9fb730dfb9d64542b1125a9f8ca64272: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 13:13:14.185299  7721 tablet_bootstrap.cc:492] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272: Bootstrap starting.
I20260709 13:13:14.185979  7724 ts_tablet_manager.cc:1434] T c050f90249fc477abf94ed50adc7b5e3 P 6892fe946cc9442eb2e1e21f1024b355: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:13:14.186153  7720 ts_tablet_manager.cc:1434] T c050f90249fc477abf94ed50adc7b5e3 P d5b9feaa36ef49c386775798c7fbba58: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:13:14.187000  7724 tablet_bootstrap.cc:492] T b114fd1274ba4053a1d836e8d5f53f3b P 6892fe946cc9442eb2e1e21f1024b355: Bootstrap starting.
I20260709 13:13:14.187250  7720 tablet_bootstrap.cc:492] T e5edb5aba6f548a189a2ecd96cf02b28 P d5b9feaa36ef49c386775798c7fbba58: Bootstrap starting.
I20260709 13:13:14.193717  7720 tablet_bootstrap.cc:654] T e5edb5aba6f548a189a2ecd96cf02b28 P d5b9feaa36ef49c386775798c7fbba58: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:14.193717  7724 tablet_bootstrap.cc:654] T b114fd1274ba4053a1d836e8d5f53f3b P 6892fe946cc9442eb2e1e21f1024b355: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:14.198855  7721 tablet_bootstrap.cc:654] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:14.223685  7720 tablet_bootstrap.cc:492] T e5edb5aba6f548a189a2ecd96cf02b28 P d5b9feaa36ef49c386775798c7fbba58: No bootstrap required, opened a new log
I20260709 13:13:14.223894  7721 tablet_bootstrap.cc:492] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272: No bootstrap required, opened a new log
I20260709 13:13:14.224225  7720 ts_tablet_manager.cc:1403] T e5edb5aba6f548a189a2ecd96cf02b28 P d5b9feaa36ef49c386775798c7fbba58: Time spent bootstrapping tablet: real 0.037s	user 0.004s	sys 0.031s
I20260709 13:13:14.224469  7721 ts_tablet_manager.cc:1403] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.016s
I20260709 13:13:14.226301  7724 tablet_bootstrap.cc:492] T b114fd1274ba4053a1d836e8d5f53f3b P 6892fe946cc9442eb2e1e21f1024b355: No bootstrap required, opened a new log
I20260709 13:13:14.226904  7724 ts_tablet_manager.cc:1403] T b114fd1274ba4053a1d836e8d5f53f3b P 6892fe946cc9442eb2e1e21f1024b355: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.016s
I20260709 13:13:14.227555  7720 raft_consensus.cc:359] T e5edb5aba6f548a189a2ecd96cf02b28 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.228364  7720 raft_consensus.cc:385] T e5edb5aba6f548a189a2ecd96cf02b28 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:14.228677  7720 raft_consensus.cc:740] T e5edb5aba6f548a189a2ecd96cf02b28 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5b9feaa36ef49c386775798c7fbba58, State: Initialized, Role: FOLLOWER
I20260709 13:13:14.229255  7720 consensus_queue.cc:260] T e5edb5aba6f548a189a2ecd96cf02b28 P d5b9feaa36ef49c386775798c7fbba58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.229965  7724 raft_consensus.cc:359] T b114fd1274ba4053a1d836e8d5f53f3b P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.230669  7724 raft_consensus.cc:385] T b114fd1274ba4053a1d836e8d5f53f3b P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:14.230934  7724 raft_consensus.cc:740] T b114fd1274ba4053a1d836e8d5f53f3b P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6892fe946cc9442eb2e1e21f1024b355, State: Initialized, Role: FOLLOWER
I20260709 13:13:14.231104  7720 ts_tablet_manager.cc:1434] T e5edb5aba6f548a189a2ecd96cf02b28 P d5b9feaa36ef49c386775798c7fbba58: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:13:14.227912  7721 raft_consensus.cc:359] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.231616  7721 raft_consensus.cc:385] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:14.231967  7721 raft_consensus.cc:740] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fb730dfb9d64542b1125a9f8ca64272, State: Initialized, Role: FOLLOWER
I20260709 13:13:14.231737  7724 consensus_queue.cc:260] T b114fd1274ba4053a1d836e8d5f53f3b P 6892fe946cc9442eb2e1e21f1024b355 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.232510  7720 tablet_bootstrap.cc:492] T 207f51796525408199723c1d30adca6e P d5b9feaa36ef49c386775798c7fbba58: Bootstrap starting.
I20260709 13:13:14.232920  7721 consensus_queue.cc:260] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.234794  7724 ts_tablet_manager.cc:1434] T b114fd1274ba4053a1d836e8d5f53f3b P 6892fe946cc9442eb2e1e21f1024b355: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:13:14.235450  7721 ts_tablet_manager.cc:1434] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:13:14.235885  7724 tablet_bootstrap.cc:492] T f57c9d84137e43f682ab95b85728a749 P 6892fe946cc9442eb2e1e21f1024b355: Bootstrap starting.
I20260709 13:13:14.236531  7721 tablet_bootstrap.cc:492] T e5edb5aba6f548a189a2ecd96cf02b28 P 9fb730dfb9d64542b1125a9f8ca64272: Bootstrap starting.
I20260709 13:13:14.241065  7664 raft_consensus.cc:493] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.241767  7720 tablet_bootstrap.cc:654] T 207f51796525408199723c1d30adca6e P d5b9feaa36ef49c386775798c7fbba58: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:14.241561  7664 raft_consensus.cc:515] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.243722  7664 leader_election.cc:290] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:14.243846  7721 tablet_bootstrap.cc:654] T e5edb5aba6f548a189a2ecd96cf02b28 P 9fb730dfb9d64542b1125a9f8ca64272: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:14.245990  7399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd343cb8504a420385daa15f0d0f4f84" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6892fe946cc9442eb2e1e21f1024b355" is_pre_election: true
I20260709 13:13:14.246434  7708 raft_consensus.cc:493] T b114fd1274ba4053a1d836e8d5f53f3b P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.246924  7708 raft_consensus.cc:515] T b114fd1274ba4053a1d836e8d5f53f3b P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.247360  7547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd343cb8504a420385daa15f0d0f4f84" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5b9feaa36ef49c386775798c7fbba58" is_pre_election: true
W20260709 13:13:14.248482  7437 leader_election.cc:343] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:14.249006  7708 leader_election.cc:290] T b114fd1274ba4053a1d836e8d5f53f3b P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941)
I20260709 13:13:14.249189  7547 raft_consensus.cc:2468] T cd343cb8504a420385daa15f0d0f4f84 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fb730dfb9d64542b1125a9f8ca64272 in term 0.
I20260709 13:13:14.250720  7437 leader_election.cc:304] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fb730dfb9d64542b1125a9f8ca64272, d5b9feaa36ef49c386775798c7fbba58; no voters: 6892fe946cc9442eb2e1e21f1024b355
I20260709 13:13:14.251607  7473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b114fd1274ba4053a1d836e8d5f53f3b" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272" is_pre_election: true
I20260709 13:13:14.252195  7399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b114fd1274ba4053a1d836e8d5f53f3b" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6892fe946cc9442eb2e1e21f1024b355" is_pre_election: true
I20260709 13:13:14.252848  7399 raft_consensus.cc:2468] T b114fd1274ba4053a1d836e8d5f53f3b P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5b9feaa36ef49c386775798c7fbba58 in term 0.
I20260709 13:13:14.254220  7511 leader_election.cc:304] T b114fd1274ba4053a1d836e8d5f53f3b P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6892fe946cc9442eb2e1e21f1024b355, d5b9feaa36ef49c386775798c7fbba58; no voters: 
I20260709 13:13:14.254913  7664 raft_consensus.cc:2804] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:13:14.255036  7511 leader_election.cc:343] T b114fd1274ba4053a1d836e8d5f53f3b P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:14.255331  7664 raft_consensus.cc:493] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:14.255671  7664 raft_consensus.cc:3060] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:14.263989  7708 raft_consensus.cc:2804] T b114fd1274ba4053a1d836e8d5f53f3b P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:14.264482  7708 raft_consensus.cc:493] T b114fd1274ba4053a1d836e8d5f53f3b P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:14.264858  7708 raft_consensus.cc:3060] T b114fd1274ba4053a1d836e8d5f53f3b P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:14.269181  7664 raft_consensus.cc:515] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.271167  7664 leader_election.cc:290] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 1 election: Requested vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:14.265182  7724 tablet_bootstrap.cc:654] T f57c9d84137e43f682ab95b85728a749 P 6892fe946cc9442eb2e1e21f1024b355: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:14.281327  7399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd343cb8504a420385daa15f0d0f4f84" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6892fe946cc9442eb2e1e21f1024b355"
I20260709 13:13:14.283398  7547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd343cb8504a420385daa15f0d0f4f84" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5b9feaa36ef49c386775798c7fbba58"
I20260709 13:13:14.283985  7547 raft_consensus.cc:3060] T cd343cb8504a420385daa15f0d0f4f84 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:14.285656  7708 raft_consensus.cc:515] T b114fd1274ba4053a1d836e8d5f53f3b P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.291153  7547 raft_consensus.cc:2468] T cd343cb8504a420385daa15f0d0f4f84 P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fb730dfb9d64542b1125a9f8ca64272 in term 1.
I20260709 13:13:14.292143  7399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b114fd1274ba4053a1d836e8d5f53f3b" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6892fe946cc9442eb2e1e21f1024b355"
I20260709 13:13:14.292752  7399 raft_consensus.cc:3060] T b114fd1274ba4053a1d836e8d5f53f3b P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:14.292794  7473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b114fd1274ba4053a1d836e8d5f53f3b" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272"
W20260709 13:13:14.294276  7511 leader_election.cc:343] T b114fd1274ba4053a1d836e8d5f53f3b P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:14.294863  7708 leader_election.cc:290] T b114fd1274ba4053a1d836e8d5f53f3b P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 election: Requested vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941)
I20260709 13:13:14.300621  7437 leader_election.cc:304] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fb730dfb9d64542b1125a9f8ca64272, d5b9feaa36ef49c386775798c7fbba58; no voters: 
I20260709 13:13:14.301280  7399 raft_consensus.cc:2468] T b114fd1274ba4053a1d836e8d5f53f3b P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5b9feaa36ef49c386775798c7fbba58 in term 1.
W20260709 13:13:14.301900  7437 leader_election.cc:343] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:14.302204  7720 tablet_bootstrap.cc:492] T 207f51796525408199723c1d30adca6e P d5b9feaa36ef49c386775798c7fbba58: No bootstrap required, opened a new log
I20260709 13:13:14.302742  7720 ts_tablet_manager.cc:1403] T 207f51796525408199723c1d30adca6e P d5b9feaa36ef49c386775798c7fbba58: Time spent bootstrapping tablet: real 0.071s	user 0.019s	sys 0.046s
I20260709 13:13:14.302651  7511 leader_election.cc:304] T b114fd1274ba4053a1d836e8d5f53f3b P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6892fe946cc9442eb2e1e21f1024b355, d5b9feaa36ef49c386775798c7fbba58; no voters: 9fb730dfb9d64542b1125a9f8ca64272
I20260709 13:13:14.302984  7740 raft_consensus.cc:2804] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:14.303645  7721 tablet_bootstrap.cc:492] T e5edb5aba6f548a189a2ecd96cf02b28 P 9fb730dfb9d64542b1125a9f8ca64272: No bootstrap required, opened a new log
I20260709 13:13:14.303893  7708 raft_consensus.cc:2804] T b114fd1274ba4053a1d836e8d5f53f3b P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:14.304318  7721 ts_tablet_manager.cc:1403] T e5edb5aba6f548a189a2ecd96cf02b28 P 9fb730dfb9d64542b1125a9f8ca64272: Time spent bootstrapping tablet: real 0.068s	user 0.020s	sys 0.043s
I20260709 13:13:14.306092  7720 raft_consensus.cc:359] T 207f51796525408199723c1d30adca6e P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.306897  7720 raft_consensus.cc:385] T 207f51796525408199723c1d30adca6e P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:14.307174  7720 raft_consensus.cc:740] T 207f51796525408199723c1d30adca6e P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5b9feaa36ef49c386775798c7fbba58, State: Initialized, Role: FOLLOWER
I20260709 13:13:14.308091  7720 consensus_queue.cc:260] T 207f51796525408199723c1d30adca6e P d5b9feaa36ef49c386775798c7fbba58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.310426  7721 raft_consensus.cc:359] T e5edb5aba6f548a189a2ecd96cf02b28 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.311267  7721 raft_consensus.cc:385] T e5edb5aba6f548a189a2ecd96cf02b28 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:14.311702  7721 raft_consensus.cc:740] T e5edb5aba6f548a189a2ecd96cf02b28 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fb730dfb9d64542b1125a9f8ca64272, State: Initialized, Role: FOLLOWER
I20260709 13:13:14.310774  7724 tablet_bootstrap.cc:492] T f57c9d84137e43f682ab95b85728a749 P 6892fe946cc9442eb2e1e21f1024b355: No bootstrap required, opened a new log
I20260709 13:13:14.312808  7721 consensus_queue.cc:260] T e5edb5aba6f548a189a2ecd96cf02b28 P 9fb730dfb9d64542b1125a9f8ca64272 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.314006  7724 ts_tablet_manager.cc:1403] T f57c9d84137e43f682ab95b85728a749 P 6892fe946cc9442eb2e1e21f1024b355: Time spent bootstrapping tablet: real 0.078s	user 0.009s	sys 0.003s
I20260709 13:13:14.316210  7721 ts_tablet_manager.cc:1434] T e5edb5aba6f548a189a2ecd96cf02b28 P 9fb730dfb9d64542b1125a9f8ca64272: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 13:13:14.317128  7720 ts_tablet_manager.cc:1434] T 207f51796525408199723c1d30adca6e P d5b9feaa36ef49c386775798c7fbba58: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.007s
I20260709 13:13:14.317345  7724 raft_consensus.cc:359] T f57c9d84137e43f682ab95b85728a749 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.317698  7721 tablet_bootstrap.cc:492] T 207f51796525408199723c1d30adca6e P 9fb730dfb9d64542b1125a9f8ca64272: Bootstrap starting.
I20260709 13:13:14.318750  7720 tablet_bootstrap.cc:492] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P d5b9feaa36ef49c386775798c7fbba58: Bootstrap starting.
I20260709 13:13:14.319366  7708 raft_consensus.cc:697] T b114fd1274ba4053a1d836e8d5f53f3b P d5b9feaa36ef49c386775798c7fbba58 [term 1 LEADER]: Becoming Leader. State: Replica: d5b9feaa36ef49c386775798c7fbba58, State: Running, Role: LEADER
I20260709 13:13:14.320361  7708 consensus_queue.cc:237] T b114fd1274ba4053a1d836e8d5f53f3b P d5b9feaa36ef49c386775798c7fbba58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.323935  7740 raft_consensus.cc:697] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 LEADER]: Becoming Leader. State: Replica: 9fb730dfb9d64542b1125a9f8ca64272, State: Running, Role: LEADER
I20260709 13:13:14.318066  7724 raft_consensus.cc:385] T f57c9d84137e43f682ab95b85728a749 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:14.324589  7724 raft_consensus.cc:740] T f57c9d84137e43f682ab95b85728a749 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6892fe946cc9442eb2e1e21f1024b355, State: Initialized, Role: FOLLOWER
I20260709 13:13:14.324944  7740 consensus_queue.cc:237] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.325861  7720 tablet_bootstrap.cc:654] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P d5b9feaa36ef49c386775798c7fbba58: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:14.325335  7724 consensus_queue.cc:260] T f57c9d84137e43f682ab95b85728a749 P 6892fe946cc9442eb2e1e21f1024b355 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.327962  7721 tablet_bootstrap.cc:654] T 207f51796525408199723c1d30adca6e P 9fb730dfb9d64542b1125a9f8ca64272: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:14.329649  7724 ts_tablet_manager.cc:1434] T f57c9d84137e43f682ab95b85728a749 P 6892fe946cc9442eb2e1e21f1024b355: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.004s
I20260709 13:13:14.331053  7724 tablet_bootstrap.cc:492] T f1ed065b6ee3472da798007ec76be525 P 6892fe946cc9442eb2e1e21f1024b355: Bootstrap starting.
I20260709 13:13:14.345490  7743 raft_consensus.cc:493] T e5edb5aba6f548a189a2ecd96cf02b28 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.346262  7743 raft_consensus.cc:515] T e5edb5aba6f548a189a2ecd96cf02b28 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.347005  7721 tablet_bootstrap.cc:492] T 207f51796525408199723c1d30adca6e P 9fb730dfb9d64542b1125a9f8ca64272: No bootstrap required, opened a new log
I20260709 13:13:14.347654  7721 ts_tablet_manager.cc:1403] T 207f51796525408199723c1d30adca6e P 9fb730dfb9d64542b1125a9f8ca64272: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.015s
I20260709 13:13:14.349977  7399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5edb5aba6f548a189a2ecd96cf02b28" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6892fe946cc9442eb2e1e21f1024b355" is_pre_election: true
I20260709 13:13:14.350878  7399 raft_consensus.cc:2468] T e5edb5aba6f548a189a2ecd96cf02b28 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5b9feaa36ef49c386775798c7fbba58 in term 0.
I20260709 13:13:14.351293  7721 raft_consensus.cc:359] T 207f51796525408199723c1d30adca6e P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.352389  7721 raft_consensus.cc:385] T 207f51796525408199723c1d30adca6e P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:14.352478  7511 leader_election.cc:304] T e5edb5aba6f548a189a2ecd96cf02b28 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6892fe946cc9442eb2e1e21f1024b355, d5b9feaa36ef49c386775798c7fbba58; no voters: 
I20260709 13:13:14.352749  7721 raft_consensus.cc:740] T 207f51796525408199723c1d30adca6e P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fb730dfb9d64542b1125a9f8ca64272, State: Initialized, Role: FOLLOWER
I20260709 13:13:14.353695  7744 raft_consensus.cc:2804] T e5edb5aba6f548a189a2ecd96cf02b28 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:14.354079  7744 raft_consensus.cc:493] T e5edb5aba6f548a189a2ecd96cf02b28 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:14.354645  7744 raft_consensus.cc:3060] T e5edb5aba6f548a189a2ecd96cf02b28 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:14.353960  7721 consensus_queue.cc:260] T 207f51796525408199723c1d30adca6e P 9fb730dfb9d64542b1125a9f8ca64272 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.355279  7473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5edb5aba6f548a189a2ecd96cf02b28" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272" is_pre_election: true
I20260709 13:13:14.354139  7743 leader_election.cc:290] T e5edb5aba6f548a189a2ecd96cf02b28 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941)
I20260709 13:13:14.356470  7473 raft_consensus.cc:2468] T e5edb5aba6f548a189a2ecd96cf02b28 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5b9feaa36ef49c386775798c7fbba58 in term 0.
I20260709 13:13:14.362591  7721 ts_tablet_manager.cc:1434] T 207f51796525408199723c1d30adca6e P 9fb730dfb9d64542b1125a9f8ca64272: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:13:14.363670  7721 tablet_bootstrap.cc:492] T b114fd1274ba4053a1d836e8d5f53f3b P 9fb730dfb9d64542b1125a9f8ca64272: Bootstrap starting.
I20260709 13:13:14.364488  7720 tablet_bootstrap.cc:492] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P d5b9feaa36ef49c386775798c7fbba58: No bootstrap required, opened a new log
I20260709 13:13:14.364974  7720 ts_tablet_manager.cc:1403] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P d5b9feaa36ef49c386775798c7fbba58: Time spent bootstrapping tablet: real 0.046s	user 0.018s	sys 0.018s
I20260709 13:13:14.366001  7295 catalog_manager.cc:5697] T b114fd1274ba4053a1d836e8d5f53f3b P d5b9feaa36ef49c386775798c7fbba58 reported cstate change: term changed from 0 to 1, leader changed from <none> to d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3). New cstate: current_term: 1 leader_uuid: "d5b9feaa36ef49c386775798c7fbba58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:14.367691  7720 raft_consensus.cc:359] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.368443  7720 raft_consensus.cc:385] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:14.368738  7720 raft_consensus.cc:740] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5b9feaa36ef49c386775798c7fbba58, State: Initialized, Role: FOLLOWER
I20260709 13:13:14.369654  7720 consensus_queue.cc:260] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P d5b9feaa36ef49c386775798c7fbba58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.372000  7744 raft_consensus.cc:515] T e5edb5aba6f548a189a2ecd96cf02b28 P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.374428  7297 catalog_manager.cc:5697] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2). New cstate: current_term: 1 leader_uuid: "9fb730dfb9d64542b1125a9f8ca64272" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:14.377627  7720 ts_tablet_manager.cc:1434] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P d5b9feaa36ef49c386775798c7fbba58: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:13:14.377375  7399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5edb5aba6f548a189a2ecd96cf02b28" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6892fe946cc9442eb2e1e21f1024b355"
I20260709 13:13:14.378190  7399 raft_consensus.cc:3060] T e5edb5aba6f548a189a2ecd96cf02b28 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:14.378336  7721 tablet_bootstrap.cc:654] T b114fd1274ba4053a1d836e8d5f53f3b P 9fb730dfb9d64542b1125a9f8ca64272: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:14.379554  7473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5edb5aba6f548a189a2ecd96cf02b28" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272"
I20260709 13:13:14.382316  7473 raft_consensus.cc:3060] T e5edb5aba6f548a189a2ecd96cf02b28 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:14.384881  7399 raft_consensus.cc:2468] T e5edb5aba6f548a189a2ecd96cf02b28 P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5b9feaa36ef49c386775798c7fbba58 in term 1.
I20260709 13:13:14.377466  7724 tablet_bootstrap.cc:654] T f1ed065b6ee3472da798007ec76be525 P 6892fe946cc9442eb2e1e21f1024b355: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:14.388504  7511 leader_election.cc:304] T e5edb5aba6f548a189a2ecd96cf02b28 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6892fe946cc9442eb2e1e21f1024b355, d5b9feaa36ef49c386775798c7fbba58; no voters: 
I20260709 13:13:14.389602  7708 raft_consensus.cc:2804] T e5edb5aba6f548a189a2ecd96cf02b28 P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:14.390250  7708 raft_consensus.cc:697] T e5edb5aba6f548a189a2ecd96cf02b28 P d5b9feaa36ef49c386775798c7fbba58 [term 1 LEADER]: Becoming Leader. State: Replica: d5b9feaa36ef49c386775798c7fbba58, State: Running, Role: LEADER
I20260709 13:13:14.391319  7708 consensus_queue.cc:237] T e5edb5aba6f548a189a2ecd96cf02b28 P d5b9feaa36ef49c386775798c7fbba58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.397956  7724 tablet_bootstrap.cc:492] T f1ed065b6ee3472da798007ec76be525 P 6892fe946cc9442eb2e1e21f1024b355: No bootstrap required, opened a new log
I20260709 13:13:14.398511  7724 ts_tablet_manager.cc:1403] T f1ed065b6ee3472da798007ec76be525 P 6892fe946cc9442eb2e1e21f1024b355: Time spent bootstrapping tablet: real 0.068s	user 0.005s	sys 0.014s
I20260709 13:13:14.408093  7724 raft_consensus.cc:359] T f1ed065b6ee3472da798007ec76be525 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.408911  7724 raft_consensus.cc:385] T f1ed065b6ee3472da798007ec76be525 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:14.401684  7744 leader_election.cc:290] T e5edb5aba6f548a189a2ecd96cf02b28 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 election: Requested vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941)
I20260709 13:13:14.409215  7724 raft_consensus.cc:740] T f1ed065b6ee3472da798007ec76be525 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6892fe946cc9442eb2e1e21f1024b355, State: Initialized, Role: FOLLOWER
I20260709 13:13:14.409991  7724 consensus_queue.cc:260] T f1ed065b6ee3472da798007ec76be525 P 6892fe946cc9442eb2e1e21f1024b355 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.411058  7473 raft_consensus.cc:2468] T e5edb5aba6f548a189a2ecd96cf02b28 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5b9feaa36ef49c386775798c7fbba58 in term 1.
I20260709 13:13:14.412423  7724 ts_tablet_manager.cc:1434] T f1ed065b6ee3472da798007ec76be525 P 6892fe946cc9442eb2e1e21f1024b355: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:13:14.413971  7724 tablet_bootstrap.cc:492] T 87d3c8dac44049b8ba431715dc8a5af6 P 6892fe946cc9442eb2e1e21f1024b355: Bootstrap starting.
I20260709 13:13:14.415335  7721 tablet_bootstrap.cc:492] T b114fd1274ba4053a1d836e8d5f53f3b P 9fb730dfb9d64542b1125a9f8ca64272: No bootstrap required, opened a new log
I20260709 13:13:14.415865  7721 ts_tablet_manager.cc:1403] T b114fd1274ba4053a1d836e8d5f53f3b P 9fb730dfb9d64542b1125a9f8ca64272: Time spent bootstrapping tablet: real 0.052s	user 0.027s	sys 0.009s
I20260709 13:13:14.419090  7721 raft_consensus.cc:359] T b114fd1274ba4053a1d836e8d5f53f3b P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.419782  7721 raft_consensus.cc:385] T b114fd1274ba4053a1d836e8d5f53f3b P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:14.420077  7721 raft_consensus.cc:740] T b114fd1274ba4053a1d836e8d5f53f3b P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fb730dfb9d64542b1125a9f8ca64272, State: Initialized, Role: FOLLOWER
I20260709 13:13:14.420933  7724 tablet_bootstrap.cc:654] T 87d3c8dac44049b8ba431715dc8a5af6 P 6892fe946cc9442eb2e1e21f1024b355: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:14.420789  7721 consensus_queue.cc:260] T b114fd1274ba4053a1d836e8d5f53f3b P 9fb730dfb9d64542b1125a9f8ca64272 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.423185  7721 ts_tablet_manager.cc:1434] T b114fd1274ba4053a1d836e8d5f53f3b P 9fb730dfb9d64542b1125a9f8ca64272: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 13:13:14.424170  7721 tablet_bootstrap.cc:492] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 9fb730dfb9d64542b1125a9f8ca64272: Bootstrap starting.
I20260709 13:13:14.426502  7744 raft_consensus.cc:493] T c050f90249fc477abf94ed50adc7b5e3 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.427165  7744 raft_consensus.cc:515] T c050f90249fc477abf94ed50adc7b5e3 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.429827  7744 leader_election.cc:290] T c050f90249fc477abf94ed50adc7b5e3 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941)
I20260709 13:13:14.430657  7721 tablet_bootstrap.cc:654] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 9fb730dfb9d64542b1125a9f8ca64272: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:14.432109  7399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c050f90249fc477abf94ed50adc7b5e3" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6892fe946cc9442eb2e1e21f1024b355" is_pre_election: true
I20260709 13:13:14.432742  7399 raft_consensus.cc:2468] T c050f90249fc477abf94ed50adc7b5e3 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5b9feaa36ef49c386775798c7fbba58 in term 0.
I20260709 13:13:14.433418  7744 raft_consensus.cc:493] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.433709  7473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c050f90249fc477abf94ed50adc7b5e3" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272" is_pre_election: true
I20260709 13:13:14.433986  7744 raft_consensus.cc:515] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.435389  7511 leader_election.cc:304] T c050f90249fc477abf94ed50adc7b5e3 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6892fe946cc9442eb2e1e21f1024b355, d5b9feaa36ef49c386775798c7fbba58; no voters: 
I20260709 13:13:14.436381  7744 leader_election.cc:290] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941)
I20260709 13:13:14.436923  7708 raft_consensus.cc:2804] T c050f90249fc477abf94ed50adc7b5e3 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:14.437336  7708 raft_consensus.cc:493] T c050f90249fc477abf94ed50adc7b5e3 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:14.437654  7708 raft_consensus.cc:3060] T c050f90249fc477abf94ed50adc7b5e3 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:14.440665  7474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57c9d84137e43f682ab95b85728a749" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272" is_pre_election: true
I20260709 13:13:14.441313  7474 raft_consensus.cc:2468] T f57c9d84137e43f682ab95b85728a749 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5b9feaa36ef49c386775798c7fbba58 in term 0.
I20260709 13:13:14.442368  7399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57c9d84137e43f682ab95b85728a749" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6892fe946cc9442eb2e1e21f1024b355" is_pre_election: true
I20260709 13:13:14.442986  7399 raft_consensus.cc:2468] T f57c9d84137e43f682ab95b85728a749 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5b9feaa36ef49c386775798c7fbba58 in term 0.
I20260709 13:13:14.444216  7511 leader_election.cc:304] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6892fe946cc9442eb2e1e21f1024b355, d5b9feaa36ef49c386775798c7fbba58; no voters: 
I20260709 13:13:14.434391  7473 raft_consensus.cc:2468] T c050f90249fc477abf94ed50adc7b5e3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5b9feaa36ef49c386775798c7fbba58 in term 0.
I20260709 13:13:14.443351  7295 catalog_manager.cc:5697] T e5edb5aba6f548a189a2ecd96cf02b28 P d5b9feaa36ef49c386775798c7fbba58 reported cstate change: term changed from 0 to 1, leader changed from <none> to d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3). New cstate: current_term: 1 leader_uuid: "d5b9feaa36ef49c386775798c7fbba58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:14.449530  7744 raft_consensus.cc:2804] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:14.451939  7721 tablet_bootstrap.cc:492] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 9fb730dfb9d64542b1125a9f8ca64272: No bootstrap required, opened a new log
I20260709 13:13:14.452142  7708 raft_consensus.cc:515] T c050f90249fc477abf94ed50adc7b5e3 P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.455120  7399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c050f90249fc477abf94ed50adc7b5e3" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6892fe946cc9442eb2e1e21f1024b355"
I20260709 13:13:14.455710  7399 raft_consensus.cc:3060] T c050f90249fc477abf94ed50adc7b5e3 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:14.451941  7744 raft_consensus.cc:493] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:14.456350  7744 raft_consensus.cc:3060] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:14.457234  7724 tablet_bootstrap.cc:492] T 87d3c8dac44049b8ba431715dc8a5af6 P 6892fe946cc9442eb2e1e21f1024b355: No bootstrap required, opened a new log
I20260709 13:13:14.457696  7708 leader_election.cc:290] T c050f90249fc477abf94ed50adc7b5e3 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 election: Requested vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941)
I20260709 13:13:14.457748  7724 ts_tablet_manager.cc:1403] T 87d3c8dac44049b8ba431715dc8a5af6 P 6892fe946cc9442eb2e1e21f1024b355: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.011s
I20260709 13:13:14.461211  7724 raft_consensus.cc:359] T 87d3c8dac44049b8ba431715dc8a5af6 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.461921  7724 raft_consensus.cc:385] T 87d3c8dac44049b8ba431715dc8a5af6 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:14.462212  7724 raft_consensus.cc:740] T 87d3c8dac44049b8ba431715dc8a5af6 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6892fe946cc9442eb2e1e21f1024b355, State: Initialized, Role: FOLLOWER
I20260709 13:13:14.462940  7724 consensus_queue.cc:260] T 87d3c8dac44049b8ba431715dc8a5af6 P 6892fe946cc9442eb2e1e21f1024b355 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.464921  7473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c050f90249fc477abf94ed50adc7b5e3" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272"
I20260709 13:13:14.465482  7473 raft_consensus.cc:3060] T c050f90249fc477abf94ed50adc7b5e3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:14.467021  7724 ts_tablet_manager.cc:1434] T 87d3c8dac44049b8ba431715dc8a5af6 P 6892fe946cc9442eb2e1e21f1024b355: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:13:14.468037  7724 tablet_bootstrap.cc:492] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 6892fe946cc9442eb2e1e21f1024b355: Bootstrap starting.
I20260709 13:13:14.472071  7740 raft_consensus.cc:493] T 207f51796525408199723c1d30adca6e P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.472570  7740 raft_consensus.cc:515] T 207f51796525408199723c1d30adca6e P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.452673  7721 ts_tablet_manager.cc:1403] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 9fb730dfb9d64542b1125a9f8ca64272: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.012s
I20260709 13:13:14.474587  7740 leader_election.cc:290] T 207f51796525408199723c1d30adca6e P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:14.475586  7547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207f51796525408199723c1d30adca6e" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5b9feaa36ef49c386775798c7fbba58" is_pre_election: true
I20260709 13:13:14.476667  7721 raft_consensus.cc:359] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.477080  7398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207f51796525408199723c1d30adca6e" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6892fe946cc9442eb2e1e21f1024b355" is_pre_election: true
I20260709 13:13:14.477351  7721 raft_consensus.cc:385] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:14.477751  7721 raft_consensus.cc:740] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fb730dfb9d64542b1125a9f8ca64272, State: Initialized, Role: FOLLOWER
I20260709 13:13:14.477778  7724 tablet_bootstrap.cc:654] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 6892fe946cc9442eb2e1e21f1024b355: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:14.477809  7398 raft_consensus.cc:2468] T 207f51796525408199723c1d30adca6e P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fb730dfb9d64542b1125a9f8ca64272 in term 0.
I20260709 13:13:14.478615  7721 consensus_queue.cc:260] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 9fb730dfb9d64542b1125a9f8ca64272 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.463645  7399 raft_consensus.cc:2468] T c050f90249fc477abf94ed50adc7b5e3 P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5b9feaa36ef49c386775798c7fbba58 in term 1.
I20260709 13:13:14.479308  7437 leader_election.cc:304] T 207f51796525408199723c1d30adca6e P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6892fe946cc9442eb2e1e21f1024b355, 9fb730dfb9d64542b1125a9f8ca64272; no voters: 
I20260709 13:13:14.476697  7547 raft_consensus.cc:2468] T 207f51796525408199723c1d30adca6e P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fb730dfb9d64542b1125a9f8ca64272 in term 0.
I20260709 13:13:14.480335  7740 raft_consensus.cc:2804] T 207f51796525408199723c1d30adca6e P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:14.480700  7740 raft_consensus.cc:493] T 207f51796525408199723c1d30adca6e P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:14.481024  7740 raft_consensus.cc:3060] T 207f51796525408199723c1d30adca6e P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:14.490526  7511 leader_election.cc:304] T c050f90249fc477abf94ed50adc7b5e3 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6892fe946cc9442eb2e1e21f1024b355, d5b9feaa36ef49c386775798c7fbba58; no voters: 
I20260709 13:13:14.490914  7721 ts_tablet_manager.cc:1434] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 9fb730dfb9d64542b1125a9f8ca64272: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.003s
I20260709 13:13:14.491984  7708 raft_consensus.cc:2804] T c050f90249fc477abf94ed50adc7b5e3 P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:14.492563  7708 raft_consensus.cc:697] T c050f90249fc477abf94ed50adc7b5e3 P d5b9feaa36ef49c386775798c7fbba58 [term 1 LEADER]: Becoming Leader. State: Replica: d5b9feaa36ef49c386775798c7fbba58, State: Running, Role: LEADER
I20260709 13:13:14.493120  7721 tablet_bootstrap.cc:492] T f1ed065b6ee3472da798007ec76be525 P 9fb730dfb9d64542b1125a9f8ca64272: Bootstrap starting.
I20260709 13:13:14.491493  7473 raft_consensus.cc:2468] T c050f90249fc477abf94ed50adc7b5e3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5b9feaa36ef49c386775798c7fbba58 in term 1.
I20260709 13:13:14.495260  7744 raft_consensus.cc:515] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.498102  7398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57c9d84137e43f682ab95b85728a749" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6892fe946cc9442eb2e1e21f1024b355"
I20260709 13:13:14.498757  7398 raft_consensus.cc:3060] T f57c9d84137e43f682ab95b85728a749 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:14.498974  7473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57c9d84137e43f682ab95b85728a749" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272"
I20260709 13:13:14.499644  7473 raft_consensus.cc:3060] T f57c9d84137e43f682ab95b85728a749 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:14.500275  7724 tablet_bootstrap.cc:492] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 6892fe946cc9442eb2e1e21f1024b355: No bootstrap required, opened a new log
I20260709 13:13:14.500758  7724 ts_tablet_manager.cc:1403] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 6892fe946cc9442eb2e1e21f1024b355: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.006s
I20260709 13:13:14.493340  7708 consensus_queue.cc:237] T c050f90249fc477abf94ed50adc7b5e3 P d5b9feaa36ef49c386775798c7fbba58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
W20260709 13:13:14.501616  7345 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:14.502687  7721 tablet_bootstrap.cc:654] T f1ed065b6ee3472da798007ec76be525 P 9fb730dfb9d64542b1125a9f8ca64272: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:14.503695  7724 raft_consensus.cc:359] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.504410  7724 raft_consensus.cc:385] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:14.504695  7724 raft_consensus.cc:740] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6892fe946cc9442eb2e1e21f1024b355, State: Initialized, Role: FOLLOWER
I20260709 13:13:14.505330  7724 consensus_queue.cc:260] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 6892fe946cc9442eb2e1e21f1024b355 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.508044  7724 ts_tablet_manager.cc:1434] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 6892fe946cc9442eb2e1e21f1024b355: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:13:14.509238  7724 tablet_bootstrap.cc:492] T cd343cb8504a420385daa15f0d0f4f84 P 6892fe946cc9442eb2e1e21f1024b355: Bootstrap starting.
I20260709 13:13:14.510031  7473 raft_consensus.cc:2468] T f57c9d84137e43f682ab95b85728a749 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5b9feaa36ef49c386775798c7fbba58 in term 1.
I20260709 13:13:14.511168  7511 leader_election.cc:304] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fb730dfb9d64542b1125a9f8ca64272, d5b9feaa36ef49c386775798c7fbba58; no voters: 
I20260709 13:13:14.511952  7743 raft_consensus.cc:2804] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:14.511955  7744 leader_election.cc:290] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 1 election: Requested vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941)
I20260709 13:13:14.523277  7724 tablet_bootstrap.cc:654] T cd343cb8504a420385daa15f0d0f4f84 P 6892fe946cc9442eb2e1e21f1024b355: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:14.527485  7743 raft_consensus.cc:697] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58 [term 1 LEADER]: Becoming Leader. State: Replica: d5b9feaa36ef49c386775798c7fbba58, State: Running, Role: LEADER
I20260709 13:13:14.528252  7398 raft_consensus.cc:2468] T f57c9d84137e43f682ab95b85728a749 P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5b9feaa36ef49c386775798c7fbba58 in term 1.
I20260709 13:13:14.529469  7743 consensus_queue.cc:237] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.536978  7721 tablet_bootstrap.cc:492] T f1ed065b6ee3472da798007ec76be525 P 9fb730dfb9d64542b1125a9f8ca64272: No bootstrap required, opened a new log
I20260709 13:13:14.537462  7721 ts_tablet_manager.cc:1403] T f1ed065b6ee3472da798007ec76be525 P 9fb730dfb9d64542b1125a9f8ca64272: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.016s
I20260709 13:13:14.538465  7296 catalog_manager.cc:5697] T c050f90249fc477abf94ed50adc7b5e3 P d5b9feaa36ef49c386775798c7fbba58 reported cstate change: term changed from 0 to 1, leader changed from <none> to d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3). New cstate: current_term: 1 leader_uuid: "d5b9feaa36ef49c386775798c7fbba58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:14.544559  7740 raft_consensus.cc:515] T 207f51796525408199723c1d30adca6e P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.545744  7721 raft_consensus.cc:359] T f1ed065b6ee3472da798007ec76be525 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.546437  7721 raft_consensus.cc:385] T f1ed065b6ee3472da798007ec76be525 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:14.546695  7721 raft_consensus.cc:740] T f1ed065b6ee3472da798007ec76be525 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fb730dfb9d64542b1125a9f8ca64272, State: Initialized, Role: FOLLOWER
I20260709 13:13:14.547148  7398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207f51796525408199723c1d30adca6e" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6892fe946cc9442eb2e1e21f1024b355"
I20260709 13:13:14.547338  7547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "207f51796525408199723c1d30adca6e" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5b9feaa36ef49c386775798c7fbba58"
I20260709 13:13:14.547844  7398 raft_consensus.cc:3060] T 207f51796525408199723c1d30adca6e P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:14.548154  7547 raft_consensus.cc:3060] T 207f51796525408199723c1d30adca6e P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:14.547333  7721 consensus_queue.cc:260] T f1ed065b6ee3472da798007ec76be525 P 9fb730dfb9d64542b1125a9f8ca64272 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.550030  7721 ts_tablet_manager.cc:1434] T f1ed065b6ee3472da798007ec76be525 P 9fb730dfb9d64542b1125a9f8ca64272: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:13:14.556381  7547 raft_consensus.cc:2468] T 207f51796525408199723c1d30adca6e P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fb730dfb9d64542b1125a9f8ca64272 in term 1.
I20260709 13:13:14.557801  7437 leader_election.cc:304] T 207f51796525408199723c1d30adca6e P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fb730dfb9d64542b1125a9f8ca64272, d5b9feaa36ef49c386775798c7fbba58; no voters: 
I20260709 13:13:14.558736  7742 raft_consensus.cc:2804] T 207f51796525408199723c1d30adca6e P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:14.559187  7742 raft_consensus.cc:697] T 207f51796525408199723c1d30adca6e P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 LEADER]: Becoming Leader. State: Replica: 9fb730dfb9d64542b1125a9f8ca64272, State: Running, Role: LEADER
I20260709 13:13:14.559975  7742 consensus_queue.cc:237] T 207f51796525408199723c1d30adca6e P 9fb730dfb9d64542b1125a9f8ca64272 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.560650  7296 catalog_manager.cc:5697] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58 reported cstate change: term changed from 0 to 1, leader changed from <none> to d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3). New cstate: current_term: 1 leader_uuid: "d5b9feaa36ef49c386775798c7fbba58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:14.564330  7740 leader_election.cc:290] T 207f51796525408199723c1d30adca6e P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 1 election: Requested vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:14.567797  7724 tablet_bootstrap.cc:492] T cd343cb8504a420385daa15f0d0f4f84 P 6892fe946cc9442eb2e1e21f1024b355: No bootstrap required, opened a new log
I20260709 13:13:14.568352  7724 ts_tablet_manager.cc:1403] T cd343cb8504a420385daa15f0d0f4f84 P 6892fe946cc9442eb2e1e21f1024b355: Time spent bootstrapping tablet: real 0.059s	user 0.011s	sys 0.014s
I20260709 13:13:14.570851  7398 raft_consensus.cc:2468] T 207f51796525408199723c1d30adca6e P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fb730dfb9d64542b1125a9f8ca64272 in term 1.
I20260709 13:13:14.571064  7724 raft_consensus.cc:359] T cd343cb8504a420385daa15f0d0f4f84 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.571779  7724 raft_consensus.cc:385] T cd343cb8504a420385daa15f0d0f4f84 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:14.572054  7724 raft_consensus.cc:740] T cd343cb8504a420385daa15f0d0f4f84 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6892fe946cc9442eb2e1e21f1024b355, State: Initialized, Role: FOLLOWER
I20260709 13:13:14.572672  7724 consensus_queue.cc:260] T cd343cb8504a420385daa15f0d0f4f84 P 6892fe946cc9442eb2e1e21f1024b355 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.574689  7724 ts_tablet_manager.cc:1434] T cd343cb8504a420385daa15f0d0f4f84 P 6892fe946cc9442eb2e1e21f1024b355: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:14.574640  7296 catalog_manager.cc:5697] T 207f51796525408199723c1d30adca6e P 9fb730dfb9d64542b1125a9f8ca64272 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2). New cstate: current_term: 1 leader_uuid: "9fb730dfb9d64542b1125a9f8ca64272" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:14.593811  7740 raft_consensus.cc:493] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.594192  7740 raft_consensus.cc:515] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.595783  7740 leader_election.cc:290] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:14.596406  7398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d3c8dac44049b8ba431715dc8a5af6" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6892fe946cc9442eb2e1e21f1024b355" is_pre_election: true
I20260709 13:13:14.596643  7547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d3c8dac44049b8ba431715dc8a5af6" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5b9feaa36ef49c386775798c7fbba58" is_pre_election: true
I20260709 13:13:14.597055  7398 raft_consensus.cc:2468] T 87d3c8dac44049b8ba431715dc8a5af6 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fb730dfb9d64542b1125a9f8ca64272 in term 0.
I20260709 13:13:14.597239  7547 raft_consensus.cc:2468] T 87d3c8dac44049b8ba431715dc8a5af6 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fb730dfb9d64542b1125a9f8ca64272 in term 0.
I20260709 13:13:14.597993  7437 leader_election.cc:304] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6892fe946cc9442eb2e1e21f1024b355, 9fb730dfb9d64542b1125a9f8ca64272; no voters: 
I20260709 13:13:14.598618  7740 raft_consensus.cc:2804] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:14.598927  7740 raft_consensus.cc:493] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:14.599202  7740 raft_consensus.cc:3060] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:14.604187  7740 raft_consensus.cc:515] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.605683  7740 leader_election.cc:290] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 1 election: Requested vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:14.606350  7398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d3c8dac44049b8ba431715dc8a5af6" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6892fe946cc9442eb2e1e21f1024b355"
I20260709 13:13:14.606571  7547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d3c8dac44049b8ba431715dc8a5af6" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5b9feaa36ef49c386775798c7fbba58"
I20260709 13:13:14.606868  7398 raft_consensus.cc:3060] T 87d3c8dac44049b8ba431715dc8a5af6 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:14.607132  7547 raft_consensus.cc:3060] T 87d3c8dac44049b8ba431715dc8a5af6 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:14.611804  7547 raft_consensus.cc:2468] T 87d3c8dac44049b8ba431715dc8a5af6 P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fb730dfb9d64542b1125a9f8ca64272 in term 1.
I20260709 13:13:14.611868  7398 raft_consensus.cc:2468] T 87d3c8dac44049b8ba431715dc8a5af6 P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fb730dfb9d64542b1125a9f8ca64272 in term 1.
I20260709 13:13:14.612805  7437 leader_election.cc:304] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fb730dfb9d64542b1125a9f8ca64272, d5b9feaa36ef49c386775798c7fbba58; no voters: 
I20260709 13:13:14.613498  7740 raft_consensus.cc:2804] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:14.613927  7740 raft_consensus.cc:697] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 LEADER]: Becoming Leader. State: Replica: 9fb730dfb9d64542b1125a9f8ca64272, State: Running, Role: LEADER
I20260709 13:13:14.614699  7740 consensus_queue.cc:237] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.622949  7294 catalog_manager.cc:5697] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2). New cstate: current_term: 1 leader_uuid: "9fb730dfb9d64542b1125a9f8ca64272" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:14.632365  7661 raft_consensus.cc:493] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.632897  7661 raft_consensus.cc:515] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.634812  7661 leader_election.cc:290] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 6892fe946cc9442eb2e1e21f1024b355 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:14.635445  7473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a3ec2cf0baf4f99a5898f1dc93c0df3" candidate_uuid: "6892fe946cc9442eb2e1e21f1024b355" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272" is_pre_election: true
I20260709 13:13:14.635756  7547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a3ec2cf0baf4f99a5898f1dc93c0df3" candidate_uuid: "6892fe946cc9442eb2e1e21f1024b355" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5b9feaa36ef49c386775798c7fbba58" is_pre_election: true
I20260709 13:13:14.636114  7473 raft_consensus.cc:2468] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6892fe946cc9442eb2e1e21f1024b355 in term 0.
I20260709 13:13:14.636386  7547 raft_consensus.cc:2468] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6892fe946cc9442eb2e1e21f1024b355 in term 0.
I20260709 13:13:14.637279  7362 leader_election.cc:304] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 6892fe946cc9442eb2e1e21f1024b355 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6892fe946cc9442eb2e1e21f1024b355, 9fb730dfb9d64542b1125a9f8ca64272; no voters: 
I20260709 13:13:14.637996  7661 raft_consensus.cc:2804] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:14.638278  7661 raft_consensus.cc:493] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:14.638543  7661 raft_consensus.cc:3060] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:14.645120  7661 raft_consensus.cc:515] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.647080  7661 leader_election.cc:290] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 6892fe946cc9442eb2e1e21f1024b355 [CANDIDATE]: Term 1 election: Requested vote from peers 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:14.647727  7473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a3ec2cf0baf4f99a5898f1dc93c0df3" candidate_uuid: "6892fe946cc9442eb2e1e21f1024b355" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272"
I20260709 13:13:14.648013  7547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a3ec2cf0baf4f99a5898f1dc93c0df3" candidate_uuid: "6892fe946cc9442eb2e1e21f1024b355" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5b9feaa36ef49c386775798c7fbba58"
I20260709 13:13:14.648306  7473 raft_consensus.cc:3060] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:14.648602  7547 raft_consensus.cc:3060] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:14.653163  7473 raft_consensus.cc:2468] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6892fe946cc9442eb2e1e21f1024b355 in term 1.
I20260709 13:13:14.653292  7547 raft_consensus.cc:2468] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6892fe946cc9442eb2e1e21f1024b355 in term 1.
I20260709 13:13:14.654247  7362 leader_election.cc:304] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 6892fe946cc9442eb2e1e21f1024b355 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6892fe946cc9442eb2e1e21f1024b355, 9fb730dfb9d64542b1125a9f8ca64272; no voters: 
I20260709 13:13:14.654956  7661 raft_consensus.cc:2804] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:14.655752  7661 raft_consensus.cc:697] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 6892fe946cc9442eb2e1e21f1024b355 [term 1 LEADER]: Becoming Leader. State: Replica: 6892fe946cc9442eb2e1e21f1024b355, State: Running, Role: LEADER
I20260709 13:13:14.656463  7661 consensus_queue.cc:237] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 6892fe946cc9442eb2e1e21f1024b355 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.663163  7294 catalog_manager.cc:5697] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 6892fe946cc9442eb2e1e21f1024b355 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "6892fe946cc9442eb2e1e21f1024b355" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:14.668661  7740 raft_consensus.cc:493] T b114fd1274ba4053a1d836e8d5f53f3b P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.669229  7740 raft_consensus.cc:515] T b114fd1274ba4053a1d836e8d5f53f3b P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.671344  7740 leader_election.cc:290] T b114fd1274ba4053a1d836e8d5f53f3b P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:14.672422  7398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b114fd1274ba4053a1d836e8d5f53f3b" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6892fe946cc9442eb2e1e21f1024b355" is_pre_election: true
I20260709 13:13:14.672454  7547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b114fd1274ba4053a1d836e8d5f53f3b" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5b9feaa36ef49c386775798c7fbba58" is_pre_election: true
I20260709 13:13:14.673148  7398 raft_consensus.cc:2393] T b114fd1274ba4053a1d836e8d5f53f3b P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fb730dfb9d64542b1125a9f8ca64272 in current term 1: Already voted for candidate d5b9feaa36ef49c386775798c7fbba58 in this term.
I20260709 13:13:14.674136  7437 leader_election.cc:304] T b114fd1274ba4053a1d836e8d5f53f3b P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fb730dfb9d64542b1125a9f8ca64272; no voters: 6892fe946cc9442eb2e1e21f1024b355, d5b9feaa36ef49c386775798c7fbba58
I20260709 13:13:14.674688  7740 raft_consensus.cc:3060] T b114fd1274ba4053a1d836e8d5f53f3b P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:14.679931  7740 raft_consensus.cc:2749] T b114fd1274ba4053a1d836e8d5f53f3b P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:14.725531  7398 raft_consensus.cc:3060] T cd343cb8504a420385daa15f0d0f4f84 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:14.733551  7740 consensus_queue.cc:1048] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:14.747731  7740 consensus_queue.cc:1048] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:14.800263  7743 consensus_queue.cc:1048] T b114fd1274ba4053a1d836e8d5f53f3b P d5b9feaa36ef49c386775798c7fbba58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:14.810928  7766 raft_consensus.cc:493] T f1ed065b6ee3472da798007ec76be525 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:14.811885  7708 consensus_queue.cc:1048] T b114fd1274ba4053a1d836e8d5f53f3b P d5b9feaa36ef49c386775798c7fbba58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:14.813504  7766 raft_consensus.cc:515] T f1ed065b6ee3472da798007ec76be525 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.816051  7766 leader_election.cc:290] T f1ed065b6ee3472da798007ec76be525 P 6892fe946cc9442eb2e1e21f1024b355 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:14.816507  7473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ed065b6ee3472da798007ec76be525" candidate_uuid: "6892fe946cc9442eb2e1e21f1024b355" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272" is_pre_election: true
I20260709 13:13:14.817221  7473 raft_consensus.cc:2468] T f1ed065b6ee3472da798007ec76be525 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6892fe946cc9442eb2e1e21f1024b355 in term 0.
I20260709 13:13:14.818172  7362 leader_election.cc:304] T f1ed065b6ee3472da798007ec76be525 P 6892fe946cc9442eb2e1e21f1024b355 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6892fe946cc9442eb2e1e21f1024b355, 9fb730dfb9d64542b1125a9f8ca64272; no voters: 
I20260709 13:13:14.821552  7766 raft_consensus.cc:2804] T f1ed065b6ee3472da798007ec76be525 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:14.821945  7766 raft_consensus.cc:493] T f1ed065b6ee3472da798007ec76be525 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:14.822312  7766 raft_consensus.cc:3060] T f1ed065b6ee3472da798007ec76be525 P 6892fe946cc9442eb2e1e21f1024b355 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:14.822739  7548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ed065b6ee3472da798007ec76be525" candidate_uuid: "6892fe946cc9442eb2e1e21f1024b355" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5b9feaa36ef49c386775798c7fbba58" is_pre_election: true
I20260709 13:13:14.823454  7548 raft_consensus.cc:2468] T f1ed065b6ee3472da798007ec76be525 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6892fe946cc9442eb2e1e21f1024b355 in term 0.
I20260709 13:13:14.831244  7766 raft_consensus.cc:515] T f1ed065b6ee3472da798007ec76be525 P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.833385  7766 leader_election.cc:290] T f1ed065b6ee3472da798007ec76be525 P 6892fe946cc9442eb2e1e21f1024b355 [CANDIDATE]: Term 1 election: Requested vote from peers 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:14.833930  7473 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ed065b6ee3472da798007ec76be525" candidate_uuid: "6892fe946cc9442eb2e1e21f1024b355" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272"
I20260709 13:13:14.834599  7473 raft_consensus.cc:3060] T f1ed065b6ee3472da798007ec76be525 P 9fb730dfb9d64542b1125a9f8ca64272 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:14.834646  7548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ed065b6ee3472da798007ec76be525" candidate_uuid: "6892fe946cc9442eb2e1e21f1024b355" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5b9feaa36ef49c386775798c7fbba58"
I20260709 13:13:14.835421  7548 raft_consensus.cc:3060] T f1ed065b6ee3472da798007ec76be525 P d5b9feaa36ef49c386775798c7fbba58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:14.840729  7473 raft_consensus.cc:2468] T f1ed065b6ee3472da798007ec76be525 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6892fe946cc9442eb2e1e21f1024b355 in term 1.
I20260709 13:13:14.841466  7548 raft_consensus.cc:2468] T f1ed065b6ee3472da798007ec76be525 P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6892fe946cc9442eb2e1e21f1024b355 in term 1.
I20260709 13:13:14.841741  7362 leader_election.cc:304] T f1ed065b6ee3472da798007ec76be525 P 6892fe946cc9442eb2e1e21f1024b355 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6892fe946cc9442eb2e1e21f1024b355, 9fb730dfb9d64542b1125a9f8ca64272; no voters: 
I20260709 13:13:14.842578  7766 raft_consensus.cc:2804] T f1ed065b6ee3472da798007ec76be525 P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:14.843037  7766 raft_consensus.cc:697] T f1ed065b6ee3472da798007ec76be525 P 6892fe946cc9442eb2e1e21f1024b355 [term 1 LEADER]: Becoming Leader. State: Replica: 6892fe946cc9442eb2e1e21f1024b355, State: Running, Role: LEADER
I20260709 13:13:14.843782  7766 consensus_queue.cc:237] T f1ed065b6ee3472da798007ec76be525 P 6892fe946cc9442eb2e1e21f1024b355 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:14.850235  7296 catalog_manager.cc:5697] T f1ed065b6ee3472da798007ec76be525 P 6892fe946cc9442eb2e1e21f1024b355 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1). New cstate: current_term: 1 leader_uuid: "6892fe946cc9442eb2e1e21f1024b355" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:14.856709  7708 consensus_queue.cc:1048] T e5edb5aba6f548a189a2ecd96cf02b28 P d5b9feaa36ef49c386775798c7fbba58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:14.868158  7761 consensus_queue.cc:1048] T e5edb5aba6f548a189a2ecd96cf02b28 P d5b9feaa36ef49c386775798c7fbba58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:14.936733  7761 consensus_queue.cc:1048] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:14.950510  7743 consensus_queue.cc:1048] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:14.958283  7474 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87d3c8dac44049b8ba431715dc8a5af6"
dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272"
mode: GRACEFUL
new_leader_uuid: "6892fe946cc9442eb2e1e21f1024b355"
 from {username='slave'} at 127.0.0.1:52396
I20260709 13:13:14.958984  7474 raft_consensus.cc:606] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 LEADER]: Received request to transfer leadership to TS 6892fe946cc9442eb2e1e21f1024b355
I20260709 13:13:14.963351  7743 consensus_queue.cc:1048] T c050f90249fc477abf94ed50adc7b5e3 P d5b9feaa36ef49c386775798c7fbba58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:14.973467  7548 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f57c9d84137e43f682ab95b85728a749"
dest_uuid: "d5b9feaa36ef49c386775798c7fbba58"
mode: GRACEFUL
new_leader_uuid: "6892fe946cc9442eb2e1e21f1024b355"
 from {username='slave'} at 127.0.0.1:58370
I20260709 13:13:14.974534  7548 raft_consensus.cc:606] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58 [term 1 LEADER]: Received request to transfer leadership to TS 6892fe946cc9442eb2e1e21f1024b355
I20260709 13:13:14.980436  7761 consensus_queue.cc:1048] T c050f90249fc477abf94ed50adc7b5e3 P d5b9feaa36ef49c386775798c7fbba58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:14.983973  7473 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd343cb8504a420385daa15f0d0f4f84"
dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272"
mode: GRACEFUL
new_leader_uuid: "6892fe946cc9442eb2e1e21f1024b355"
 from {username='slave'} at 127.0.0.1:52396
I20260709 13:13:14.984493  7473 raft_consensus.cc:606] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 LEADER]: Received request to transfer leadership to TS 6892fe946cc9442eb2e1e21f1024b355
I20260709 13:13:14.987238  7740 consensus_queue.cc:1048] T 207f51796525408199723c1d30adca6e P 9fb730dfb9d64542b1125a9f8ca64272 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:14.991699  7547 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b114fd1274ba4053a1d836e8d5f53f3b"
dest_uuid: "d5b9feaa36ef49c386775798c7fbba58"
mode: GRACEFUL
new_leader_uuid: "9fb730dfb9d64542b1125a9f8ca64272"
 from {username='slave'} at 127.0.0.1:58370
I20260709 13:13:14.992252  7547 raft_consensus.cc:606] T b114fd1274ba4053a1d836e8d5f53f3b P d5b9feaa36ef49c386775798c7fbba58 [term 1 LEADER]: Received request to transfer leadership to TS 9fb730dfb9d64542b1125a9f8ca64272
I20260709 13:13:15.001941  7742 consensus_queue.cc:1048] T 207f51796525408199723c1d30adca6e P 9fb730dfb9d64542b1125a9f8ca64272 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:15.010697  7547 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c050f90249fc477abf94ed50adc7b5e3"
dest_uuid: "d5b9feaa36ef49c386775798c7fbba58"
mode: GRACEFUL
new_leader_uuid: "9fb730dfb9d64542b1125a9f8ca64272"
 from {username='slave'} at 127.0.0.1:58370
I20260709 13:13:15.011381  7547 raft_consensus.cc:606] T c050f90249fc477abf94ed50adc7b5e3 P d5b9feaa36ef49c386775798c7fbba58 [term 1 LEADER]: Received request to transfer leadership to TS 9fb730dfb9d64542b1125a9f8ca64272
I20260709 13:13:15.022200  7399 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1ed065b6ee3472da798007ec76be525"
dest_uuid: "6892fe946cc9442eb2e1e21f1024b355"
mode: GRACEFUL
new_leader_uuid: "9fb730dfb9d64542b1125a9f8ca64272"
 from {username='slave'} at 127.0.0.1:37168
I20260709 13:13:15.022740  7399 raft_consensus.cc:606] T f1ed065b6ee3472da798007ec76be525 P 6892fe946cc9442eb2e1e21f1024b355 [term 1 LEADER]: Received request to transfer leadership to TS 9fb730dfb9d64542b1125a9f8ca64272
I20260709 13:13:15.051344  7742 consensus_queue.cc:1048] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:15.062592  7742 consensus_queue.cc:1048] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:15.066716  7766 consensus_queue.cc:1048] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 6892fe946cc9442eb2e1e21f1024b355 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:15.071240  7742 raft_consensus.cc:993] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272: : Instructing follower 6892fe946cc9442eb2e1e21f1024b355 to start an election
I20260709 13:13:15.071696  7742 raft_consensus.cc:1081] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 LEADER]: Signalling peer 6892fe946cc9442eb2e1e21f1024b355 to start an election
I20260709 13:13:15.073799  7399 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "87d3c8dac44049b8ba431715dc8a5af6"
dest_uuid: "6892fe946cc9442eb2e1e21f1024b355"
 from {username='slave'} at 127.0.0.1:34700
I20260709 13:13:15.074473  7399 raft_consensus.cc:493] T 87d3c8dac44049b8ba431715dc8a5af6 P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:15.074813  7399 raft_consensus.cc:3060] T 87d3c8dac44049b8ba431715dc8a5af6 P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:15.080022  7661 consensus_queue.cc:1048] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 6892fe946cc9442eb2e1e21f1024b355 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:15.083796  7399 raft_consensus.cc:515] T 87d3c8dac44049b8ba431715dc8a5af6 P 6892fe946cc9442eb2e1e21f1024b355 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:15.088012  7399 leader_election.cc:290] T 87d3c8dac44049b8ba431715dc8a5af6 P 6892fe946cc9442eb2e1e21f1024b355 [CANDIDATE]: Term 2 election: Requested vote from peers 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:15.088639  7474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d3c8dac44049b8ba431715dc8a5af6" candidate_uuid: "6892fe946cc9442eb2e1e21f1024b355" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272"
I20260709 13:13:15.089272  7474 raft_consensus.cc:3055] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:15.089578  7474 raft_consensus.cc:740] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9fb730dfb9d64542b1125a9f8ca64272, State: Running, Role: LEADER
I20260709 13:13:15.089653  7548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d3c8dac44049b8ba431715dc8a5af6" candidate_uuid: "6892fe946cc9442eb2e1e21f1024b355" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5b9feaa36ef49c386775798c7fbba58"
I20260709 13:13:15.090240  7548 raft_consensus.cc:3060] T 87d3c8dac44049b8ba431715dc8a5af6 P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:15.090394  7474 consensus_queue.cc:260] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:15.091713  7474 raft_consensus.cc:3060] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:15.097162  7548 raft_consensus.cc:2468] T 87d3c8dac44049b8ba431715dc8a5af6 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6892fe946cc9442eb2e1e21f1024b355 in term 2.
I20260709 13:13:15.098377  7362 leader_election.cc:304] T 87d3c8dac44049b8ba431715dc8a5af6 P 6892fe946cc9442eb2e1e21f1024b355 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6892fe946cc9442eb2e1e21f1024b355, d5b9feaa36ef49c386775798c7fbba58; no voters: 
I20260709 13:13:15.098970  7474 raft_consensus.cc:2468] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6892fe946cc9442eb2e1e21f1024b355 in term 2.
I20260709 13:13:15.099344  7766 raft_consensus.cc:2804] T 87d3c8dac44049b8ba431715dc8a5af6 P 6892fe946cc9442eb2e1e21f1024b355 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:15.100051  7766 raft_consensus.cc:697] T 87d3c8dac44049b8ba431715dc8a5af6 P 6892fe946cc9442eb2e1e21f1024b355 [term 2 LEADER]: Becoming Leader. State: Replica: 6892fe946cc9442eb2e1e21f1024b355, State: Running, Role: LEADER
I20260709 13:13:15.100806  7766 consensus_queue.cc:237] T 87d3c8dac44049b8ba431715dc8a5af6 P 6892fe946cc9442eb2e1e21f1024b355 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:15.112318  7295 catalog_manager.cc:5697] T 87d3c8dac44049b8ba431715dc8a5af6 P 6892fe946cc9442eb2e1e21f1024b355 reported cstate change: term changed from 1 to 2, leader changed from 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2) to 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1). New cstate: current_term: 2 leader_uuid: "6892fe946cc9442eb2e1e21f1024b355" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:15.128803  7740 raft_consensus.cc:993] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272: : Instructing follower 6892fe946cc9442eb2e1e21f1024b355 to start an election
I20260709 13:13:15.129240  7742 raft_consensus.cc:1081] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 LEADER]: Signalling peer 6892fe946cc9442eb2e1e21f1024b355 to start an election
I20260709 13:13:15.130715  7399 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd343cb8504a420385daa15f0d0f4f84"
dest_uuid: "6892fe946cc9442eb2e1e21f1024b355"
 from {username='slave'} at 127.0.0.1:34700
I20260709 13:13:15.131196  7399 raft_consensus.cc:493] T cd343cb8504a420385daa15f0d0f4f84 P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:15.131484  7399 raft_consensus.cc:3060] T cd343cb8504a420385daa15f0d0f4f84 P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:15.136438  7399 raft_consensus.cc:515] T cd343cb8504a420385daa15f0d0f4f84 P 6892fe946cc9442eb2e1e21f1024b355 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:15.137971  7399 leader_election.cc:290] T cd343cb8504a420385daa15f0d0f4f84 P 6892fe946cc9442eb2e1e21f1024b355 [CANDIDATE]: Term 2 election: Requested vote from peers 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:15.138963  7474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd343cb8504a420385daa15f0d0f4f84" candidate_uuid: "6892fe946cc9442eb2e1e21f1024b355" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272"
I20260709 13:13:15.139091  7547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd343cb8504a420385daa15f0d0f4f84" candidate_uuid: "6892fe946cc9442eb2e1e21f1024b355" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5b9feaa36ef49c386775798c7fbba58"
I20260709 13:13:15.139767  7474 raft_consensus.cc:3055] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:15.139866  7547 raft_consensus.cc:3060] T cd343cb8504a420385daa15f0d0f4f84 P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:15.140122  7474 raft_consensus.cc:740] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9fb730dfb9d64542b1125a9f8ca64272, State: Running, Role: LEADER
I20260709 13:13:15.140820  7474 consensus_queue.cc:260] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:15.141678  7474 raft_consensus.cc:3060] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:15.145350  7547 raft_consensus.cc:2468] T cd343cb8504a420385daa15f0d0f4f84 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6892fe946cc9442eb2e1e21f1024b355 in term 2.
I20260709 13:13:15.146060  7474 raft_consensus.cc:2468] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6892fe946cc9442eb2e1e21f1024b355 in term 2.
I20260709 13:13:15.146384  7362 leader_election.cc:304] T cd343cb8504a420385daa15f0d0f4f84 P 6892fe946cc9442eb2e1e21f1024b355 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6892fe946cc9442eb2e1e21f1024b355, d5b9feaa36ef49c386775798c7fbba58; no voters: 
I20260709 13:13:15.147264  7766 raft_consensus.cc:2804] T cd343cb8504a420385daa15f0d0f4f84 P 6892fe946cc9442eb2e1e21f1024b355 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:15.147656  7766 raft_consensus.cc:697] T cd343cb8504a420385daa15f0d0f4f84 P 6892fe946cc9442eb2e1e21f1024b355 [term 2 LEADER]: Becoming Leader. State: Replica: 6892fe946cc9442eb2e1e21f1024b355, State: Running, Role: LEADER
I20260709 13:13:15.148413  7766 consensus_queue.cc:237] T cd343cb8504a420385daa15f0d0f4f84 P 6892fe946cc9442eb2e1e21f1024b355 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:15.155148  7295 catalog_manager.cc:5697] T cd343cb8504a420385daa15f0d0f4f84 P 6892fe946cc9442eb2e1e21f1024b355 reported cstate change: term changed from 1 to 2, leader changed from 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2) to 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1). New cstate: current_term: 2 leader_uuid: "6892fe946cc9442eb2e1e21f1024b355" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:15.233093  7708 raft_consensus.cc:993] T b114fd1274ba4053a1d836e8d5f53f3b P d5b9feaa36ef49c386775798c7fbba58: : Instructing follower 9fb730dfb9d64542b1125a9f8ca64272 to start an election
I20260709 13:13:15.233811  7761 raft_consensus.cc:1081] T b114fd1274ba4053a1d836e8d5f53f3b P d5b9feaa36ef49c386775798c7fbba58 [term 1 LEADER]: Signalling peer 9fb730dfb9d64542b1125a9f8ca64272 to start an election
I20260709 13:13:15.235392  7474 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b114fd1274ba4053a1d836e8d5f53f3b"
dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272"
 from {username='slave'} at 127.0.0.1:52488
I20260709 13:13:15.235924  7474 raft_consensus.cc:493] T b114fd1274ba4053a1d836e8d5f53f3b P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:15.236217  7474 raft_consensus.cc:3060] T b114fd1274ba4053a1d836e8d5f53f3b P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:15.242547  7474 raft_consensus.cc:515] T b114fd1274ba4053a1d836e8d5f53f3b P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:15.244397  7474 leader_election.cc:290] T b114fd1274ba4053a1d836e8d5f53f3b P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 2 election: Requested vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:15.245349  7399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b114fd1274ba4053a1d836e8d5f53f3b" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6892fe946cc9442eb2e1e21f1024b355"
I20260709 13:13:15.245977  7399 raft_consensus.cc:3060] T b114fd1274ba4053a1d836e8d5f53f3b P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:15.246273  7547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b114fd1274ba4053a1d836e8d5f53f3b" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5b9feaa36ef49c386775798c7fbba58"
I20260709 13:13:15.247216  7661 consensus_queue.cc:1048] T f1ed065b6ee3472da798007ec76be525 P 6892fe946cc9442eb2e1e21f1024b355 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:15.247484  7547 raft_consensus.cc:3055] T b114fd1274ba4053a1d836e8d5f53f3b P d5b9feaa36ef49c386775798c7fbba58 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:15.247953  7547 raft_consensus.cc:740] T b114fd1274ba4053a1d836e8d5f53f3b P d5b9feaa36ef49c386775798c7fbba58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d5b9feaa36ef49c386775798c7fbba58, State: Running, Role: LEADER
I20260709 13:13:15.248752  7547 consensus_queue.cc:260] T b114fd1274ba4053a1d836e8d5f53f3b P d5b9feaa36ef49c386775798c7fbba58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:15.249951  7547 raft_consensus.cc:3060] T b114fd1274ba4053a1d836e8d5f53f3b P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:15.252781  7399 raft_consensus.cc:2468] T b114fd1274ba4053a1d836e8d5f53f3b P 6892fe946cc9442eb2e1e21f1024b355 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fb730dfb9d64542b1125a9f8ca64272 in term 2.
I20260709 13:13:15.254148  7437 leader_election.cc:304] T b114fd1274ba4053a1d836e8d5f53f3b P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6892fe946cc9442eb2e1e21f1024b355, 9fb730dfb9d64542b1125a9f8ca64272; no voters: 
I20260709 13:13:15.254912  7742 raft_consensus.cc:2804] T b114fd1274ba4053a1d836e8d5f53f3b P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:15.255391  7742 raft_consensus.cc:697] T b114fd1274ba4053a1d836e8d5f53f3b P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 LEADER]: Becoming Leader. State: Replica: 9fb730dfb9d64542b1125a9f8ca64272, State: Running, Role: LEADER
I20260709 13:13:15.256208  7742 consensus_queue.cc:237] T b114fd1274ba4053a1d836e8d5f53f3b P 9fb730dfb9d64542b1125a9f8ca64272 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:15.256924  7547 raft_consensus.cc:2468] T b114fd1274ba4053a1d836e8d5f53f3b P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fb730dfb9d64542b1125a9f8ca64272 in term 2.
I20260709 13:13:15.259255  7766 consensus_queue.cc:1048] T f1ed065b6ee3472da798007ec76be525 P 6892fe946cc9442eb2e1e21f1024b355 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:15.267264  7295 catalog_manager.cc:5697] T b114fd1274ba4053a1d836e8d5f53f3b P 9fb730dfb9d64542b1125a9f8ca64272 reported cstate change: term changed from 1 to 2, leader changed from d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3) to 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2). New cstate: current_term: 2 leader_uuid: "9fb730dfb9d64542b1125a9f8ca64272" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:15.268064  7661 raft_consensus.cc:993] T f1ed065b6ee3472da798007ec76be525 P 6892fe946cc9442eb2e1e21f1024b355: : Instructing follower 9fb730dfb9d64542b1125a9f8ca64272 to start an election
I20260709 13:13:15.268631  7661 raft_consensus.cc:1081] T f1ed065b6ee3472da798007ec76be525 P 6892fe946cc9442eb2e1e21f1024b355 [term 1 LEADER]: Signalling peer 9fb730dfb9d64542b1125a9f8ca64272 to start an election
I20260709 13:13:15.270179  7474 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1ed065b6ee3472da798007ec76be525"
dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272"
 from {username='slave'} at 127.0.0.1:52498
I20260709 13:13:15.270648  7474 raft_consensus.cc:493] T f1ed065b6ee3472da798007ec76be525 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:15.270946  7474 raft_consensus.cc:3060] T f1ed065b6ee3472da798007ec76be525 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:15.276759  7474 raft_consensus.cc:515] T f1ed065b6ee3472da798007ec76be525 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:15.278131  7474 leader_election.cc:290] T f1ed065b6ee3472da798007ec76be525 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 2 election: Requested vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:15.278854  7399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ed065b6ee3472da798007ec76be525" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6892fe946cc9442eb2e1e21f1024b355"
I20260709 13:13:15.279254  7548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1ed065b6ee3472da798007ec76be525" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5b9feaa36ef49c386775798c7fbba58"
I20260709 13:13:15.279415  7399 raft_consensus.cc:3055] T f1ed065b6ee3472da798007ec76be525 P 6892fe946cc9442eb2e1e21f1024b355 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:15.279764  7548 raft_consensus.cc:3060] T f1ed065b6ee3472da798007ec76be525 P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:15.279800  7399 raft_consensus.cc:740] T f1ed065b6ee3472da798007ec76be525 P 6892fe946cc9442eb2e1e21f1024b355 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6892fe946cc9442eb2e1e21f1024b355, State: Running, Role: LEADER
I20260709 13:13:15.280691  7399 consensus_queue.cc:260] T f1ed065b6ee3472da798007ec76be525 P 6892fe946cc9442eb2e1e21f1024b355 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:15.282759  7399 raft_consensus.cc:3060] T f1ed065b6ee3472da798007ec76be525 P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:15.289829  7548 raft_consensus.cc:2468] T f1ed065b6ee3472da798007ec76be525 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fb730dfb9d64542b1125a9f8ca64272 in term 2.
I20260709 13:13:15.290704  7399 raft_consensus.cc:2468] T f1ed065b6ee3472da798007ec76be525 P 6892fe946cc9442eb2e1e21f1024b355 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fb730dfb9d64542b1125a9f8ca64272 in term 2.
I20260709 13:13:15.290943  7437 leader_election.cc:304] T f1ed065b6ee3472da798007ec76be525 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fb730dfb9d64542b1125a9f8ca64272, d5b9feaa36ef49c386775798c7fbba58; no voters: 
I20260709 13:13:15.291915  7742 raft_consensus.cc:2804] T f1ed065b6ee3472da798007ec76be525 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:15.292371  7742 raft_consensus.cc:697] T f1ed065b6ee3472da798007ec76be525 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 LEADER]: Becoming Leader. State: Replica: 9fb730dfb9d64542b1125a9f8ca64272, State: Running, Role: LEADER
I20260709 13:13:15.293180  7742 consensus_queue.cc:237] T f1ed065b6ee3472da798007ec76be525 P 9fb730dfb9d64542b1125a9f8ca64272 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:15.299948  7295 catalog_manager.cc:5697] T f1ed065b6ee3472da798007ec76be525 P 9fb730dfb9d64542b1125a9f8ca64272 reported cstate change: term changed from 1 to 2, leader changed from 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1) to 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2). New cstate: current_term: 2 leader_uuid: "9fb730dfb9d64542b1125a9f8ca64272" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:15.498562  7548 raft_consensus.cc:1275] T 87d3c8dac44049b8ba431715dc8a5af6 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Refusing update from remote peer 6892fe946cc9442eb2e1e21f1024b355: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:15.499827  7661 consensus_queue.cc:1048] T 87d3c8dac44049b8ba431715dc8a5af6 P 6892fe946cc9442eb2e1e21f1024b355 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:15.508520  7474 raft_consensus.cc:1275] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Refusing update from remote peer 6892fe946cc9442eb2e1e21f1024b355: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:15.510489  7766 consensus_queue.cc:1048] T 87d3c8dac44049b8ba431715dc8a5af6 P 6892fe946cc9442eb2e1e21f1024b355 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:15.520816  7708 raft_consensus.cc:993] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58: : Instructing follower 6892fe946cc9442eb2e1e21f1024b355 to start an election
I20260709 13:13:15.521299  7761 raft_consensus.cc:1081] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58 [term 1 LEADER]: Signalling peer 6892fe946cc9442eb2e1e21f1024b355 to start an election
I20260709 13:13:15.522786  7399 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f57c9d84137e43f682ab95b85728a749"
dest_uuid: "6892fe946cc9442eb2e1e21f1024b355"
 from {username='slave'} at 127.0.0.1:34692
I20260709 13:13:15.523231  7399 raft_consensus.cc:493] T f57c9d84137e43f682ab95b85728a749 P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:15.523487  7399 raft_consensus.cc:3060] T f57c9d84137e43f682ab95b85728a749 P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:15.528391  7399 raft_consensus.cc:515] T f57c9d84137e43f682ab95b85728a749 P 6892fe946cc9442eb2e1e21f1024b355 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:15.529667  7399 leader_election.cc:290] T f57c9d84137e43f682ab95b85728a749 P 6892fe946cc9442eb2e1e21f1024b355 [CANDIDATE]: Term 2 election: Requested vote from peers 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:15.530366  7474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57c9d84137e43f682ab95b85728a749" candidate_uuid: "6892fe946cc9442eb2e1e21f1024b355" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272"
I20260709 13:13:15.530608  7548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57c9d84137e43f682ab95b85728a749" candidate_uuid: "6892fe946cc9442eb2e1e21f1024b355" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5b9feaa36ef49c386775798c7fbba58"
I20260709 13:13:15.530901  7474 raft_consensus.cc:3060] T f57c9d84137e43f682ab95b85728a749 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:15.531288  7548 raft_consensus.cc:3055] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:15.531569  7548 raft_consensus.cc:740] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d5b9feaa36ef49c386775798c7fbba58, State: Running, Role: LEADER
I20260709 13:13:15.532212  7548 consensus_queue.cc:260] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:15.533032  7548 raft_consensus.cc:3060] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:15.536089  7474 raft_consensus.cc:2468] T f57c9d84137e43f682ab95b85728a749 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6892fe946cc9442eb2e1e21f1024b355 in term 2.
I20260709 13:13:15.537045  7362 leader_election.cc:304] T f57c9d84137e43f682ab95b85728a749 P 6892fe946cc9442eb2e1e21f1024b355 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6892fe946cc9442eb2e1e21f1024b355, 9fb730dfb9d64542b1125a9f8ca64272; no voters: 
I20260709 13:13:15.537794  7661 raft_consensus.cc:2804] T f57c9d84137e43f682ab95b85728a749 P 6892fe946cc9442eb2e1e21f1024b355 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:15.537801  7548 raft_consensus.cc:2468] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6892fe946cc9442eb2e1e21f1024b355 in term 2.
I20260709 13:13:15.538245  7661 raft_consensus.cc:697] T f57c9d84137e43f682ab95b85728a749 P 6892fe946cc9442eb2e1e21f1024b355 [term 2 LEADER]: Becoming Leader. State: Replica: 6892fe946cc9442eb2e1e21f1024b355, State: Running, Role: LEADER
I20260709 13:13:15.539144  7661 consensus_queue.cc:237] T f57c9d84137e43f682ab95b85728a749 P 6892fe946cc9442eb2e1e21f1024b355 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:15.545269  7295 catalog_manager.cc:5697] T f57c9d84137e43f682ab95b85728a749 P 6892fe946cc9442eb2e1e21f1024b355 reported cstate change: term changed from 1 to 2, leader changed from d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3) to 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1). New cstate: current_term: 2 leader_uuid: "6892fe946cc9442eb2e1e21f1024b355" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:15.590714  7761 raft_consensus.cc:993] T c050f90249fc477abf94ed50adc7b5e3 P d5b9feaa36ef49c386775798c7fbba58: : Instructing follower 9fb730dfb9d64542b1125a9f8ca64272 to start an election
I20260709 13:13:15.591182  7761 raft_consensus.cc:1081] T c050f90249fc477abf94ed50adc7b5e3 P d5b9feaa36ef49c386775798c7fbba58 [term 1 LEADER]: Signalling peer 9fb730dfb9d64542b1125a9f8ca64272 to start an election
I20260709 13:13:15.592757  7474 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c050f90249fc477abf94ed50adc7b5e3"
dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272"
 from {username='slave'} at 127.0.0.1:52488
I20260709 13:13:15.593250  7474 raft_consensus.cc:493] T c050f90249fc477abf94ed50adc7b5e3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:15.593567  7474 raft_consensus.cc:3060] T c050f90249fc477abf94ed50adc7b5e3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:15.598899  7474 raft_consensus.cc:515] T c050f90249fc477abf94ed50adc7b5e3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:15.600276  7474 leader_election.cc:290] T c050f90249fc477abf94ed50adc7b5e3 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 2 election: Requested vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:15.601061  7399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c050f90249fc477abf94ed50adc7b5e3" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6892fe946cc9442eb2e1e21f1024b355"
I20260709 13:13:15.601423  7548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c050f90249fc477abf94ed50adc7b5e3" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5b9feaa36ef49c386775798c7fbba58"
I20260709 13:13:15.601670  7399 raft_consensus.cc:3060] T c050f90249fc477abf94ed50adc7b5e3 P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:15.602018  7548 raft_consensus.cc:3055] T c050f90249fc477abf94ed50adc7b5e3 P d5b9feaa36ef49c386775798c7fbba58 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:15.602267  7548 raft_consensus.cc:740] T c050f90249fc477abf94ed50adc7b5e3 P d5b9feaa36ef49c386775798c7fbba58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d5b9feaa36ef49c386775798c7fbba58, State: Running, Role: LEADER
I20260709 13:13:15.602833  7548 consensus_queue.cc:260] T c050f90249fc477abf94ed50adc7b5e3 P d5b9feaa36ef49c386775798c7fbba58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:15.603668  7548 raft_consensus.cc:3060] T c050f90249fc477abf94ed50adc7b5e3 P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:15.606238  7399 raft_consensus.cc:2468] T c050f90249fc477abf94ed50adc7b5e3 P 6892fe946cc9442eb2e1e21f1024b355 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fb730dfb9d64542b1125a9f8ca64272 in term 2.
I20260709 13:13:15.607256  7437 leader_election.cc:304] T c050f90249fc477abf94ed50adc7b5e3 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6892fe946cc9442eb2e1e21f1024b355, 9fb730dfb9d64542b1125a9f8ca64272; no voters: 
I20260709 13:13:15.607992  7742 raft_consensus.cc:2804] T c050f90249fc477abf94ed50adc7b5e3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:15.608218  7548 raft_consensus.cc:2468] T c050f90249fc477abf94ed50adc7b5e3 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fb730dfb9d64542b1125a9f8ca64272 in term 2.
I20260709 13:13:15.608383  7742 raft_consensus.cc:697] T c050f90249fc477abf94ed50adc7b5e3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 LEADER]: Becoming Leader. State: Replica: 9fb730dfb9d64542b1125a9f8ca64272, State: Running, Role: LEADER
I20260709 13:13:15.609248  7742 consensus_queue.cc:237] T c050f90249fc477abf94ed50adc7b5e3 P 9fb730dfb9d64542b1125a9f8ca64272 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:15.615401  7294 catalog_manager.cc:5697] T c050f90249fc477abf94ed50adc7b5e3 P 9fb730dfb9d64542b1125a9f8ca64272 reported cstate change: term changed from 1 to 2, leader changed from d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3) to 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2). New cstate: current_term: 2 leader_uuid: "9fb730dfb9d64542b1125a9f8ca64272" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:15.737857  7548 raft_consensus.cc:1275] T b114fd1274ba4053a1d836e8d5f53f3b P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Refusing update from remote peer 9fb730dfb9d64542b1125a9f8ca64272: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:15.739161  7742 consensus_queue.cc:1048] T b114fd1274ba4053a1d836e8d5f53f3b P 9fb730dfb9d64542b1125a9f8ca64272 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:15.745059  7474 raft_consensus.cc:1275] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Refusing update from remote peer 6892fe946cc9442eb2e1e21f1024b355: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:15.747328  7399 raft_consensus.cc:1275] T b114fd1274ba4053a1d836e8d5f53f3b P 6892fe946cc9442eb2e1e21f1024b355 [term 2 FOLLOWER]: Refusing update from remote peer 9fb730dfb9d64542b1125a9f8ca64272: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:15.749198  7664 consensus_queue.cc:1048] T b114fd1274ba4053a1d836e8d5f53f3b P 9fb730dfb9d64542b1125a9f8ca64272 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:15.746609  7661 consensus_queue.cc:1048] T cd343cb8504a420385daa15f0d0f4f84 P 6892fe946cc9442eb2e1e21f1024b355 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:13:15.762816  7548 raft_consensus.cc:1275] T cd343cb8504a420385daa15f0d0f4f84 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Refusing update from remote peer 6892fe946cc9442eb2e1e21f1024b355: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:15.764202  7766 consensus_queue.cc:1048] T cd343cb8504a420385daa15f0d0f4f84 P 6892fe946cc9442eb2e1e21f1024b355 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:15.772672  7399 raft_consensus.cc:1275] T f1ed065b6ee3472da798007ec76be525 P 6892fe946cc9442eb2e1e21f1024b355 [term 2 FOLLOWER]: Refusing update from remote peer 9fb730dfb9d64542b1125a9f8ca64272: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:15.774119  7793 consensus_queue.cc:1048] T f1ed065b6ee3472da798007ec76be525 P 9fb730dfb9d64542b1125a9f8ca64272 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:15.783334  7548 raft_consensus.cc:1275] T f1ed065b6ee3472da798007ec76be525 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Refusing update from remote peer 9fb730dfb9d64542b1125a9f8ca64272: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:15.784518  7740 consensus_queue.cc:1048] T f1ed065b6ee3472da798007ec76be525 P 9fb730dfb9d64542b1125a9f8ca64272 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:15.975302  7548 raft_consensus.cc:1275] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Refusing update from remote peer 6892fe946cc9442eb2e1e21f1024b355: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:15.976516  7661 consensus_queue.cc:1048] T f57c9d84137e43f682ab95b85728a749 P 6892fe946cc9442eb2e1e21f1024b355 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:15.984654  7474 raft_consensus.cc:1275] T f57c9d84137e43f682ab95b85728a749 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Refusing update from remote peer 6892fe946cc9442eb2e1e21f1024b355: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:15.986317  7661 consensus_queue.cc:1048] T f57c9d84137e43f682ab95b85728a749 P 6892fe946cc9442eb2e1e21f1024b355 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:16.041246  7399 raft_consensus.cc:1275] T c050f90249fc477abf94ed50adc7b5e3 P 6892fe946cc9442eb2e1e21f1024b355 [term 2 FOLLOWER]: Refusing update from remote peer 9fb730dfb9d64542b1125a9f8ca64272: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:16.042476  7740 consensus_queue.cc:1048] T c050f90249fc477abf94ed50adc7b5e3 P 9fb730dfb9d64542b1125a9f8ca64272 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:16.050592  7548 raft_consensus.cc:1275] T c050f90249fc477abf94ed50adc7b5e3 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Refusing update from remote peer 9fb730dfb9d64542b1125a9f8ca64272: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:16.051954  7742 consensus_queue.cc:1048] T c050f90249fc477abf94ed50adc7b5e3 P 9fb730dfb9d64542b1125a9f8ca64272 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:18.031322  7296 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:32912:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:13:18.052841  7296 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:32912:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:13:18.145177 29364 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:18.181762  7829 tablet.cc:1724] T c050f90249fc477abf94ed50adc7b5e3 P 9fb730dfb9d64542b1125a9f8ca64272: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:18.308351  7845 tablet.cc:1724] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:18.270269  7838 tablet.cc:1724] T 87d3c8dac44049b8ba431715dc8a5af6 P 6892fe946cc9442eb2e1e21f1024b355: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:18.323837  7851 tablet.cc:1724] T c050f90249fc477abf94ed50adc7b5e3 P d5b9feaa36ef49c386775798c7fbba58: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:18.385135  7855 tablet.cc:1724] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 6892fe946cc9442eb2e1e21f1024b355: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:18.382990  7848 tablet.cc:1724] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 9fb730dfb9d64542b1125a9f8ca64272: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:18.394585  7858 tablet.cc:1724] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P d5b9feaa36ef49c386775798c7fbba58: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:18.392124  7859 tablet.cc:1724] T cd343cb8504a420385daa15f0d0f4f84 P d5b9feaa36ef49c386775798c7fbba58: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:18.420776  7470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e8d0f65b3564feea4ae78a34ede70f3"
dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272"
mode: GRACEFUL
new_leader_uuid: "d5b9feaa36ef49c386775798c7fbba58"
 from {username='slave'} at 127.0.0.1:52398
I20260709 13:13:18.372210  7829 tablet.cc:1724] T f1ed065b6ee3472da798007ec76be525 P 9fb730dfb9d64542b1125a9f8ca64272: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:18.428647  7470 raft_consensus.cc:606] T 3e8d0f65b3564feea4ae78a34ede70f3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 LEADER]: Received request to transfer leadership to TS d5b9feaa36ef49c386775798c7fbba58
W20260709 13:13:18.428524  7853 log.cc:927] Time spent T f57c9d84137e43f682ab95b85728a749 P 9fb730dfb9d64542b1125a9f8ca64272: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:13:18.412892  7854 tablet.cc:1724] T c050f90249fc477abf94ed50adc7b5e3 P 6892fe946cc9442eb2e1e21f1024b355: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:18.449059  7838 tablet.cc:1724] T cd343cb8504a420385daa15f0d0f4f84 P 6892fe946cc9442eb2e1e21f1024b355: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:18.456063  7847 log.cc:927] Time spent T 207f51796525408199723c1d30adca6e P 9fb730dfb9d64542b1125a9f8ca64272: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:13:18.462363  7864 tablet.cc:1724] T b114fd1274ba4053a1d836e8d5f53f3b P 9fb730dfb9d64542b1125a9f8ca64272: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:18.423950  7857 tablet.cc:1724] T f1ed065b6ee3472da798007ec76be525 P 6892fe946cc9442eb2e1e21f1024b355: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:18.462443  7862 log.cc:927] Time spent T f1ed065b6ee3472da798007ec76be525 P d5b9feaa36ef49c386775798c7fbba58: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:13:18.511803  7848 tablet.cc:1724] T e5edb5aba6f548a189a2ecd96cf02b28 P 9fb730dfb9d64542b1125a9f8ca64272: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:18.512110  7867 tablet.cc:1724] T 87d3c8dac44049b8ba431715dc8a5af6 P d5b9feaa36ef49c386775798c7fbba58: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:18.512600  7838 tablet.cc:1724] T b114fd1274ba4053a1d836e8d5f53f3b P 6892fe946cc9442eb2e1e21f1024b355: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:18.510944  7845 tablet.cc:1724] T 207f51796525408199723c1d30adca6e P 9fb730dfb9d64542b1125a9f8ca64272: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:18.524184  7849 log.cc:927] Time spent T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272: Append to log took a long time: real 0.159s	user 0.003s	sys 0.000s
W20260709 13:13:18.528573  7865 log.cc:927] Time spent T 207f51796525408199723c1d30adca6e P 6892fe946cc9442eb2e1e21f1024b355: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:13:18.532589  7858 tablet.cc:1724] T b114fd1274ba4053a1d836e8d5f53f3b P d5b9feaa36ef49c386775798c7fbba58: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:18.543689  7859 tablet.cc:1724] T e5edb5aba6f548a189a2ecd96cf02b28 P d5b9feaa36ef49c386775798c7fbba58: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:18.545429  7867 tablet.cc:1724] T f1ed065b6ee3472da798007ec76be525 P d5b9feaa36ef49c386775798c7fbba58: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:18.678922  7855 tablet.cc:1724] T 207f51796525408199723c1d30adca6e P 6892fe946cc9442eb2e1e21f1024b355: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:18.690497  7855 tablet.cc:1724] T e5edb5aba6f548a189a2ecd96cf02b28 P 6892fe946cc9442eb2e1e21f1024b355: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:18.703384  7824 raft_consensus.cc:993] T 3e8d0f65b3564feea4ae78a34ede70f3 P 9fb730dfb9d64542b1125a9f8ca64272: : Instructing follower d5b9feaa36ef49c386775798c7fbba58 to start an election
I20260709 13:13:18.704107  7824 raft_consensus.cc:1081] T 3e8d0f65b3564feea4ae78a34ede70f3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 LEADER]: Signalling peer d5b9feaa36ef49c386775798c7fbba58 to start an election
I20260709 13:13:18.704078  7838 tablet.cc:1724] T f57c9d84137e43f682ab95b85728a749 P 6892fe946cc9442eb2e1e21f1024b355: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:18.706207  7543 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e8d0f65b3564feea4ae78a34ede70f3"
dest_uuid: "d5b9feaa36ef49c386775798c7fbba58"
 from {username='slave'} at 127.0.0.1:49520
I20260709 13:13:18.706815  7543 raft_consensus.cc:493] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:18.707228  7543 raft_consensus.cc:3060] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:18.715070  7543 raft_consensus.cc:515] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:18.717170  7543 leader_election.cc:290] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 3 election: Requested vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941)
I20260709 13:13:18.553638  7858 tablet.cc:1724] T 207f51796525408199723c1d30adca6e P d5b9feaa36ef49c386775798c7fbba58: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:18.728417  7398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8d0f65b3564feea4ae78a34ede70f3" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6892fe946cc9442eb2e1e21f1024b355"
I20260709 13:13:18.729034  7398 raft_consensus.cc:3060] T 3e8d0f65b3564feea4ae78a34ede70f3 P 6892fe946cc9442eb2e1e21f1024b355 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:18.730181  7845 tablet.cc:1724] T f57c9d84137e43f682ab95b85728a749 P 9fb730dfb9d64542b1125a9f8ca64272: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:18.733033  7867 tablet.cc:1724] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:18.736449  7471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8d0f65b3564feea4ae78a34ede70f3" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272"
I20260709 13:13:18.737100  7471 raft_consensus.cc:3055] T 3e8d0f65b3564feea4ae78a34ede70f3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:18.737413  7471 raft_consensus.cc:740] T 3e8d0f65b3564feea4ae78a34ede70f3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9fb730dfb9d64542b1125a9f8ca64272, State: Running, Role: LEADER
I20260709 13:13:18.738255  7471 consensus_queue.cc:260] T 3e8d0f65b3564feea4ae78a34ede70f3 P 9fb730dfb9d64542b1125a9f8ca64272 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:18.739523  7471 raft_consensus.cc:3060] T 3e8d0f65b3564feea4ae78a34ede70f3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:18.746357  7471 raft_consensus.cc:2468] T 3e8d0f65b3564feea4ae78a34ede70f3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5b9feaa36ef49c386775798c7fbba58 in term 3.
I20260709 13:13:18.749680  7511 leader_election.cc:304] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fb730dfb9d64542b1125a9f8ca64272, d5b9feaa36ef49c386775798c7fbba58; no voters: 
I20260709 13:13:18.750640  7866 raft_consensus.cc:2804] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:18.751078  7866 raft_consensus.cc:697] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58 [term 3 LEADER]: Becoming Leader. State: Replica: d5b9feaa36ef49c386775798c7fbba58, State: Running, Role: LEADER
I20260709 13:13:18.751945  7866 consensus_queue.cc:237] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:18.756268  7398 raft_consensus.cc:2468] T 3e8d0f65b3564feea4ae78a34ede70f3 P 6892fe946cc9442eb2e1e21f1024b355 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5b9feaa36ef49c386775798c7fbba58 in term 3.
I20260709 13:13:18.765769  7397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c2d9c7b2731498fbe0f7d715f98583f"
dest_uuid: "6892fe946cc9442eb2e1e21f1024b355"
mode: GRACEFUL
new_leader_uuid: "d5b9feaa36ef49c386775798c7fbba58"
 from {username='slave'} at 127.0.0.1:36516
I20260709 13:13:18.766367  7397 raft_consensus.cc:606] T 7c2d9c7b2731498fbe0f7d715f98583f P 6892fe946cc9442eb2e1e21f1024b355 [term 2 LEADER]: Received request to transfer leadership to TS d5b9feaa36ef49c386775798c7fbba58
I20260709 13:13:18.771306  7845 tablet.cc:1724] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:18.785780 29364 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:13:18.786509 29364 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:18.790670  7295 catalog_manager.cc:5789] TS 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941) does not have the latest schema for tablet 207f51796525408199723c1d30adca6e (table soft_deleted_table [id=0a26cb3ee77542709beac2bab538efe1]). Expected version 1 got 0
I20260709 13:13:18.784346  7294 catalog_manager.cc:5789] TS 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637) does not have the latest schema for tablet cd343cb8504a420385daa15f0d0f4f84 (table soft_deleted_table [id=0a26cb3ee77542709beac2bab538efe1]). Expected version 1 got 0
I20260709 13:13:18.794714  7294 catalog_manager.cc:5789] TS 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637) does not have the latest schema for tablet f57c9d84137e43f682ab95b85728a749 (table soft_deleted_table [id=0a26cb3ee77542709beac2bab538efe1]). Expected version 1 got 0
I20260709 13:13:18.806105  7295 catalog_manager.cc:5697] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58 reported cstate change: term changed from 2 to 3, leader changed from 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2) to d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3). New cstate: current_term: 3 leader_uuid: "d5b9feaa36ef49c386775798c7fbba58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:18.825392  7295 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 878e61842f66468cbc5b35262f4dbda7: soft_deleted_table [id=0a26cb3ee77542709beac2bab538efe1] alter complete (version 1)
I20260709 13:13:18.836236  7813 raft_consensus.cc:993] T 7c2d9c7b2731498fbe0f7d715f98583f P 6892fe946cc9442eb2e1e21f1024b355: : Instructing follower d5b9feaa36ef49c386775798c7fbba58 to start an election
I20260709 13:13:18.836668  7813 raft_consensus.cc:1081] T 7c2d9c7b2731498fbe0f7d715f98583f P 6892fe946cc9442eb2e1e21f1024b355 [term 2 LEADER]: Signalling peer d5b9feaa36ef49c386775798c7fbba58 to start an election
I20260709 13:13:18.837980  7543 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c2d9c7b2731498fbe0f7d715f98583f"
dest_uuid: "d5b9feaa36ef49c386775798c7fbba58"
 from {username='slave'} at 127.0.0.1:49534
I20260709 13:13:18.838474  7543 raft_consensus.cc:493] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:18.838819  7543 raft_consensus.cc:3060] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:18.844048  7543 raft_consensus.cc:515] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } } peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } }
I20260709 13:13:18.845708  7543 leader_election.cc:290] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 3 election: Requested vote from peers 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941), 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637)
I20260709 13:13:18.846237  7471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2d9c7b2731498fbe0f7d715f98583f" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272"
I20260709 13:13:18.846652  7397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2d9c7b2731498fbe0f7d715f98583f" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6892fe946cc9442eb2e1e21f1024b355"
I20260709 13:13:18.846882  7471 raft_consensus.cc:3060] T 7c2d9c7b2731498fbe0f7d715f98583f P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:18.847250  7397 raft_consensus.cc:3055] T 7c2d9c7b2731498fbe0f7d715f98583f P 6892fe946cc9442eb2e1e21f1024b355 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:18.847560  7397 raft_consensus.cc:740] T 7c2d9c7b2731498fbe0f7d715f98583f P 6892fe946cc9442eb2e1e21f1024b355 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6892fe946cc9442eb2e1e21f1024b355, State: Running, Role: LEADER
I20260709 13:13:18.848443  7397 consensus_queue.cc:260] T 7c2d9c7b2731498fbe0f7d715f98583f P 6892fe946cc9442eb2e1e21f1024b355 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } } peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } }
I20260709 13:13:18.849692  7397 raft_consensus.cc:3060] T 7c2d9c7b2731498fbe0f7d715f98583f P 6892fe946cc9442eb2e1e21f1024b355 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:18.853797  7471 raft_consensus.cc:2468] T 7c2d9c7b2731498fbe0f7d715f98583f P 9fb730dfb9d64542b1125a9f8ca64272 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5b9feaa36ef49c386775798c7fbba58 in term 3.
I20260709 13:13:18.855161  7511 leader_election.cc:304] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fb730dfb9d64542b1125a9f8ca64272, d5b9feaa36ef49c386775798c7fbba58; no voters: 
I20260709 13:13:18.855923  7866 raft_consensus.cc:2804] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:18.856323  7866 raft_consensus.cc:697] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 [term 3 LEADER]: Becoming Leader. State: Replica: d5b9feaa36ef49c386775798c7fbba58, State: Running, Role: LEADER
I20260709 13:13:18.857127  7866 consensus_queue.cc:237] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } } peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } }
I20260709 13:13:18.857764  7397 raft_consensus.cc:2468] T 7c2d9c7b2731498fbe0f7d715f98583f P 6892fe946cc9442eb2e1e21f1024b355 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5b9feaa36ef49c386775798c7fbba58 in term 3.
I20260709 13:13:18.864953  7294 catalog_manager.cc:5697] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 reported cstate change: term changed from 2 to 3, leader changed from 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1) to d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3). New cstate: current_term: 3 leader_uuid: "d5b9feaa36ef49c386775798c7fbba58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:19.213438  7397 raft_consensus.cc:1275] T 3e8d0f65b3564feea4ae78a34ede70f3 P 6892fe946cc9442eb2e1e21f1024b355 [term 3 FOLLOWER]: Refusing update from remote peer d5b9feaa36ef49c386775798c7fbba58: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:19.214600  7866 consensus_queue.cc:1048] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:19.224486  7471 raft_consensus.cc:1275] T 3e8d0f65b3564feea4ae78a34ede70f3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 3 FOLLOWER]: Refusing update from remote peer d5b9feaa36ef49c386775798c7fbba58: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:19.227413  7868 consensus_queue.cc:1048] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:19.457347  7471 raft_consensus.cc:1275] T 7c2d9c7b2731498fbe0f7d715f98583f P 9fb730dfb9d64542b1125a9f8ca64272 [term 3 FOLLOWER]: Refusing update from remote peer d5b9feaa36ef49c386775798c7fbba58: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:19.458835  7878 consensus_queue.cc:1048] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:19.463505  7397 raft_consensus.cc:1275] T 7c2d9c7b2731498fbe0f7d715f98583f P 6892fe946cc9442eb2e1e21f1024b355 [term 3 FOLLOWER]: Refusing update from remote peer d5b9feaa36ef49c386775798c7fbba58: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:19.464885  7878 consensus_queue.cc:1048] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:13:19.588032  7420 debug-util.cc:398] Leaking SignalData structure 0x7b08000d01a0 after lost signal to thread 29367
W20260709 13:13:19.589368  7420 debug-util.cc:398] Leaking SignalData structure 0x7b08000cbe80 after lost signal to thread 7331
W20260709 13:13:19.591116  7420 debug-util.cc:398] Leaking SignalData structure 0x7b08000eacc0 after lost signal to thread 7498
W20260709 13:13:19.592150  7420 debug-util.cc:398] Leaking SignalData structure 0x7b080011a3c0 after lost signal to thread 7572
W20260709 13:13:19.592630  7420 debug-util.cc:398] Leaking SignalData structure 0x7b0800124f80 after lost signal to thread 7806
I20260709 13:13:19.851475 29364 tablet_server.cc:179] TabletServer@127.28.173.1:0 shutting down...
I20260709 13:13:19.891860 29364 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:19.892762 29364 tablet_replica.cc:333] T 87d3c8dac44049b8ba431715dc8a5af6 P 6892fe946cc9442eb2e1e21f1024b355: stopping tablet replica
I20260709 13:13:19.893563 29364 raft_consensus.cc:2243] T 87d3c8dac44049b8ba431715dc8a5af6 P 6892fe946cc9442eb2e1e21f1024b355 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:19.894585 29364 raft_consensus.cc:2272] T 87d3c8dac44049b8ba431715dc8a5af6 P 6892fe946cc9442eb2e1e21f1024b355 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.897023 29364 tablet_replica.cc:333] T f1ed065b6ee3472da798007ec76be525 P 6892fe946cc9442eb2e1e21f1024b355: stopping tablet replica
I20260709 13:13:19.897607 29364 raft_consensus.cc:2243] T f1ed065b6ee3472da798007ec76be525 P 6892fe946cc9442eb2e1e21f1024b355 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:19.898082 29364 raft_consensus.cc:2272] T f1ed065b6ee3472da798007ec76be525 P 6892fe946cc9442eb2e1e21f1024b355 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.899912 29364 tablet_replica.cc:333] T cd343cb8504a420385daa15f0d0f4f84 P 6892fe946cc9442eb2e1e21f1024b355: stopping tablet replica
I20260709 13:13:19.900401 29364 raft_consensus.cc:2243] T cd343cb8504a420385daa15f0d0f4f84 P 6892fe946cc9442eb2e1e21f1024b355 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:19.901218 29364 raft_consensus.cc:2272] T cd343cb8504a420385daa15f0d0f4f84 P 6892fe946cc9442eb2e1e21f1024b355 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.903364 29364 tablet_replica.cc:333] T f57c9d84137e43f682ab95b85728a749 P 6892fe946cc9442eb2e1e21f1024b355: stopping tablet replica
W20260709 13:13:19.903889  7437 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 13 similar messages]
I20260709 13:13:19.904088 29364 raft_consensus.cc:2243] T f57c9d84137e43f682ab95b85728a749 P 6892fe946cc9442eb2e1e21f1024b355 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:19.905174 29364 raft_consensus.cc:2272] T f57c9d84137e43f682ab95b85728a749 P 6892fe946cc9442eb2e1e21f1024b355 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.907651 29364 tablet_replica.cc:333] T b114fd1274ba4053a1d836e8d5f53f3b P 6892fe946cc9442eb2e1e21f1024b355: stopping tablet replica
I20260709 13:13:19.908545 29364 raft_consensus.cc:2243] T b114fd1274ba4053a1d836e8d5f53f3b P 6892fe946cc9442eb2e1e21f1024b355 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:19.908629  7437 consensus_peers.cc:597] T f1ed065b6ee3472da798007ec76be525 P 9fb730dfb9d64542b1125a9f8ca64272 -> Peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Couldn't send request to peer 6892fe946cc9442eb2e1e21f1024b355. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:19.908977 29364 raft_consensus.cc:2272] T b114fd1274ba4053a1d836e8d5f53f3b P 6892fe946cc9442eb2e1e21f1024b355 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.910975 29364 tablet_replica.cc:333] T c050f90249fc477abf94ed50adc7b5e3 P 6892fe946cc9442eb2e1e21f1024b355: stopping tablet replica
I20260709 13:13:19.911533 29364 raft_consensus.cc:2243] T c050f90249fc477abf94ed50adc7b5e3 P 6892fe946cc9442eb2e1e21f1024b355 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:19.911988 29364 raft_consensus.cc:2272] T c050f90249fc477abf94ed50adc7b5e3 P 6892fe946cc9442eb2e1e21f1024b355 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.913779 29364 tablet_replica.cc:333] T 3e8d0f65b3564feea4ae78a34ede70f3 P 6892fe946cc9442eb2e1e21f1024b355: stopping tablet replica
I20260709 13:13:19.914639 29364 raft_consensus.cc:2243] T 3e8d0f65b3564feea4ae78a34ede70f3 P 6892fe946cc9442eb2e1e21f1024b355 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:19.915220 29364 raft_consensus.cc:2272] T 3e8d0f65b3564feea4ae78a34ede70f3 P 6892fe946cc9442eb2e1e21f1024b355 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.917766 29364 tablet_replica.cc:333] T 730c1374419e417286fca4006acf11a9 P 6892fe946cc9442eb2e1e21f1024b355: stopping tablet replica
I20260709 13:13:19.918378 29364 raft_consensus.cc:2243] T 730c1374419e417286fca4006acf11a9 P 6892fe946cc9442eb2e1e21f1024b355 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:19.919232 29364 raft_consensus.cc:2272] T 730c1374419e417286fca4006acf11a9 P 6892fe946cc9442eb2e1e21f1024b355 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.921386 29364 tablet_replica.cc:333] T b30fe0c3d3034035bddf8837a6489448 P 6892fe946cc9442eb2e1e21f1024b355: stopping tablet replica
I20260709 13:13:19.921953 29364 raft_consensus.cc:2243] T b30fe0c3d3034035bddf8837a6489448 P 6892fe946cc9442eb2e1e21f1024b355 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:19.922423 29364 raft_consensus.cc:2272] T b30fe0c3d3034035bddf8837a6489448 P 6892fe946cc9442eb2e1e21f1024b355 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.924512 29364 tablet_replica.cc:333] T 7c2d9c7b2731498fbe0f7d715f98583f P 6892fe946cc9442eb2e1e21f1024b355: stopping tablet replica
I20260709 13:13:19.925056 29364 raft_consensus.cc:2243] T 7c2d9c7b2731498fbe0f7d715f98583f P 6892fe946cc9442eb2e1e21f1024b355 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:19.925544 29364 raft_consensus.cc:2272] T 7c2d9c7b2731498fbe0f7d715f98583f P 6892fe946cc9442eb2e1e21f1024b355 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.928910 29364 tablet_replica.cc:333] T 791e0ec1608242b19b64b46991228864 P 6892fe946cc9442eb2e1e21f1024b355: stopping tablet replica
I20260709 13:13:19.929713 29364 raft_consensus.cc:2243] T 791e0ec1608242b19b64b46991228864 P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:19.930239 29364 raft_consensus.cc:2272] T 791e0ec1608242b19b64b46991228864 P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.933110 29364 tablet_replica.cc:333] T e5edb5aba6f548a189a2ecd96cf02b28 P 6892fe946cc9442eb2e1e21f1024b355: stopping tablet replica
I20260709 13:13:19.933846 29364 raft_consensus.cc:2243] T e5edb5aba6f548a189a2ecd96cf02b28 P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:19.934397 29364 raft_consensus.cc:2272] T e5edb5aba6f548a189a2ecd96cf02b28 P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.936915 29364 tablet_replica.cc:333] T 207f51796525408199723c1d30adca6e P 6892fe946cc9442eb2e1e21f1024b355: stopping tablet replica
I20260709 13:13:19.937657 29364 raft_consensus.cc:2243] T 207f51796525408199723c1d30adca6e P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:19.938197 29364 raft_consensus.cc:2272] T 207f51796525408199723c1d30adca6e P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.940871 29364 tablet_replica.cc:333] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 6892fe946cc9442eb2e1e21f1024b355: stopping tablet replica
I20260709 13:13:19.941615 29364 raft_consensus.cc:2243] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 6892fe946cc9442eb2e1e21f1024b355 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:19.942724 29364 raft_consensus.cc:2272] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.945276 29364 tablet_replica.cc:333] T 79da21344c24485d8cac81393166ecb2 P 6892fe946cc9442eb2e1e21f1024b355: stopping tablet replica
I20260709 13:13:19.946029 29364 raft_consensus.cc:2243] T 79da21344c24485d8cac81393166ecb2 P 6892fe946cc9442eb2e1e21f1024b355 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:19.947173 29364 raft_consensus.cc:2272] T 79da21344c24485d8cac81393166ecb2 P 6892fe946cc9442eb2e1e21f1024b355 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.950233 29364 tablet_replica.cc:333] T 4d86b1ddf8a64589876c14f28419c2b0 P 6892fe946cc9442eb2e1e21f1024b355: stopping tablet replica
I20260709 13:13:19.950997 29364 raft_consensus.cc:2243] T 4d86b1ddf8a64589876c14f28419c2b0 P 6892fe946cc9442eb2e1e21f1024b355 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:19.952127 29364 raft_consensus.cc:2272] T 4d86b1ddf8a64589876c14f28419c2b0 P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.955000 29364 tablet_replica.cc:333] T 23201718ad6845f79123a5c755b9657a P 6892fe946cc9442eb2e1e21f1024b355: stopping tablet replica
I20260709 13:13:19.955675 29364 raft_consensus.cc:2243] T 23201718ad6845f79123a5c755b9657a P 6892fe946cc9442eb2e1e21f1024b355 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:19.956218 29364 raft_consensus.cc:2272] T 23201718ad6845f79123a5c755b9657a P 6892fe946cc9442eb2e1e21f1024b355 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:19.958946 29364 tablet_replica.cc:333] T 39685c4581dc4bf4a7eb1065a07df99e P 6892fe946cc9442eb2e1e21f1024b355: stopping tablet replica
I20260709 13:13:19.959611 29364 raft_consensus.cc:2243] T 39685c4581dc4bf4a7eb1065a07df99e P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:19.960183 29364 raft_consensus.cc:2272] T 39685c4581dc4bf4a7eb1065a07df99e P 6892fe946cc9442eb2e1e21f1024b355 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:19.993142  7437 consensus_peers.cc:597] T b114fd1274ba4053a1d836e8d5f53f3b P 9fb730dfb9d64542b1125a9f8ca64272 -> Peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Couldn't send request to peer 6892fe946cc9442eb2e1e21f1024b355. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:20.001748  7511 consensus_peers.cc:597] T e5edb5aba6f548a189a2ecd96cf02b28 P d5b9feaa36ef49c386775798c7fbba58 -> Peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Couldn't send request to peer 6892fe946cc9442eb2e1e21f1024b355. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:20.048365  7437 consensus_peers.cc:597] T c050f90249fc477abf94ed50adc7b5e3 P 9fb730dfb9d64542b1125a9f8ca64272 -> Peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Couldn't send request to peer 6892fe946cc9442eb2e1e21f1024b355. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:20.049933  7511 consensus_peers.cc:597] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 -> Peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Couldn't send request to peer 6892fe946cc9442eb2e1e21f1024b355. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:20.146535  7437 consensus_peers.cc:597] T 791e0ec1608242b19b64b46991228864 P 9fb730dfb9d64542b1125a9f8ca64272 -> Peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Couldn't send request to peer 6892fe946cc9442eb2e1e21f1024b355. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:20.173177  7511 consensus_peers.cc:597] T 39685c4581dc4bf4a7eb1065a07df99e P d5b9feaa36ef49c386775798c7fbba58 -> Peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Couldn't send request to peer 6892fe946cc9442eb2e1e21f1024b355. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:20.179667  7437 consensus_peers.cc:597] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272 -> Peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Couldn't send request to peer 6892fe946cc9442eb2e1e21f1024b355. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:20.204718  7437 consensus_peers.cc:597] T 23201718ad6845f79123a5c755b9657a P 9fb730dfb9d64542b1125a9f8ca64272 -> Peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Couldn't send request to peer 6892fe946cc9442eb2e1e21f1024b355. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:20.221347  7511 consensus_peers.cc:597] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58 -> Peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Couldn't send request to peer 6892fe946cc9442eb2e1e21f1024b355. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:20.319877  7437 consensus_peers.cc:597] T 207f51796525408199723c1d30adca6e P 9fb730dfb9d64542b1125a9f8ca64272 -> Peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Couldn't send request to peer 6892fe946cc9442eb2e1e21f1024b355. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:20.958562  7891 raft_consensus.cc:493] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6892fe946cc9442eb2e1e21f1024b355)
I20260709 13:13:20.959079  7891 raft_consensus.cc:515] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:20.960805  7891 leader_election.cc:290] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:20.962541  7544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d3c8dac44049b8ba431715dc8a5af6" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d5b9feaa36ef49c386775798c7fbba58" is_pre_election: true
W20260709 13:13:20.964653  7437 leader_election.cc:336] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111)
I20260709 13:13:20.965018  7437 leader_election.cc:304] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fb730dfb9d64542b1125a9f8ca64272; no voters: 6892fe946cc9442eb2e1e21f1024b355, d5b9feaa36ef49c386775798c7fbba58
I20260709 13:13:20.965577  7891 raft_consensus.cc:2749] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:13:21.006932 29364 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 7420)
I20260709 13:13:21.040141  7889 raft_consensus.cc:493] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6892fe946cc9442eb2e1e21f1024b355)
I20260709 13:13:21.040879  7889 raft_consensus.cc:515] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:21.043205  7889 leader_election.cc:290] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941)
I20260709 13:13:21.044821  7471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57c9d84137e43f682ab95b85728a749" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272" is_pre_election: true
W20260709 13:13:21.046958  7511 leader_election.cc:336] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111)
I20260709 13:13:21.047449  7511 leader_election.cc:304] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5b9feaa36ef49c386775798c7fbba58; no voters: 6892fe946cc9442eb2e1e21f1024b355, 9fb730dfb9d64542b1125a9f8ca64272
I20260709 13:13:21.048190  7889 raft_consensus.cc:2749] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:21.064659  7891 raft_consensus.cc:493] T 4d86b1ddf8a64589876c14f28419c2b0 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6892fe946cc9442eb2e1e21f1024b355)
I20260709 13:13:21.065306  7891 raft_consensus.cc:515] T 4d86b1ddf8a64589876c14f28419c2b0 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:21.069869  7891 leader_election.cc:290] T 4d86b1ddf8a64589876c14f28419c2b0 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:21.071799  7544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d86b1ddf8a64589876c14f28419c2b0" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d5b9feaa36ef49c386775798c7fbba58" is_pre_election: true
W20260709 13:13:21.073426  7437 leader_election.cc:336] T 4d86b1ddf8a64589876c14f28419c2b0 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111)
I20260709 13:13:21.073764  7437 leader_election.cc:304] T 4d86b1ddf8a64589876c14f28419c2b0 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fb730dfb9d64542b1125a9f8ca64272; no voters: 6892fe946cc9442eb2e1e21f1024b355, d5b9feaa36ef49c386775798c7fbba58
I20260709 13:13:21.074339  7891 raft_consensus.cc:2749] T 4d86b1ddf8a64589876c14f28419c2b0 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:21.098837  7889 raft_consensus.cc:493] T 4d86b1ddf8a64589876c14f28419c2b0 P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6892fe946cc9442eb2e1e21f1024b355)
I20260709 13:13:21.099459  7889 raft_consensus.cc:515] T 4d86b1ddf8a64589876c14f28419c2b0 P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:21.101290  7889 leader_election.cc:290] T 4d86b1ddf8a64589876c14f28419c2b0 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941)
I20260709 13:13:21.101527  7891 raft_consensus.cc:493] T 79da21344c24485d8cac81393166ecb2 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6892fe946cc9442eb2e1e21f1024b355)
I20260709 13:13:21.102216  7891 raft_consensus.cc:515] T 79da21344c24485d8cac81393166ecb2 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:21.103327  7471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d86b1ddf8a64589876c14f28419c2b0" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272" is_pre_election: true
I20260709 13:13:21.104151  7471 raft_consensus.cc:2468] T 4d86b1ddf8a64589876c14f28419c2b0 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5b9feaa36ef49c386775798c7fbba58 in term 1.
I20260709 13:13:21.104482  7891 leader_election.cc:290] T 79da21344c24485d8cac81393166ecb2 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:21.105434  7511 leader_election.cc:304] T 4d86b1ddf8a64589876c14f28419c2b0 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fb730dfb9d64542b1125a9f8ca64272, d5b9feaa36ef49c386775798c7fbba58; no voters: 
I20260709 13:13:21.106256  7889 raft_consensus.cc:2804] T 4d86b1ddf8a64589876c14f28419c2b0 P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:21.106676  7889 raft_consensus.cc:493] T 4d86b1ddf8a64589876c14f28419c2b0 P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6892fe946cc9442eb2e1e21f1024b355)
I20260709 13:13:21.107091  7889 raft_consensus.cc:3060] T 4d86b1ddf8a64589876c14f28419c2b0 P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:21.107211  7544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79da21344c24485d8cac81393166ecb2" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d5b9feaa36ef49c386775798c7fbba58" is_pre_election: true
W20260709 13:13:21.109277  7511 leader_election.cc:336] T 4d86b1ddf8a64589876c14f28419c2b0 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111)
W20260709 13:13:21.110029  7437 leader_election.cc:336] T 79da21344c24485d8cac81393166ecb2 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111)
I20260709 13:13:21.110512  7437 leader_election.cc:304] T 79da21344c24485d8cac81393166ecb2 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fb730dfb9d64542b1125a9f8ca64272; no voters: 6892fe946cc9442eb2e1e21f1024b355, d5b9feaa36ef49c386775798c7fbba58
I20260709 13:13:21.111227  7891 raft_consensus.cc:2749] T 79da21344c24485d8cac81393166ecb2 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:21.114154  7889 raft_consensus.cc:515] T 4d86b1ddf8a64589876c14f28419c2b0 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:21.115939  7889 leader_election.cc:290] T 4d86b1ddf8a64589876c14f28419c2b0 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 2 election: Requested vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941)
I20260709 13:13:21.117125  7471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d86b1ddf8a64589876c14f28419c2b0" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272"
I20260709 13:13:21.117774  7471 raft_consensus.cc:3060] T 4d86b1ddf8a64589876c14f28419c2b0 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:21.119952  7511 leader_election.cc:336] T 4d86b1ddf8a64589876c14f28419c2b0 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111)
I20260709 13:13:21.123224  7471 raft_consensus.cc:2468] T 4d86b1ddf8a64589876c14f28419c2b0 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5b9feaa36ef49c386775798c7fbba58 in term 2.
I20260709 13:13:21.124253  7511 leader_election.cc:304] T 4d86b1ddf8a64589876c14f28419c2b0 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fb730dfb9d64542b1125a9f8ca64272, d5b9feaa36ef49c386775798c7fbba58; no voters: 6892fe946cc9442eb2e1e21f1024b355
I20260709 13:13:21.125016  7889 raft_consensus.cc:2804] T 4d86b1ddf8a64589876c14f28419c2b0 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:21.125422  7889 raft_consensus.cc:697] T 4d86b1ddf8a64589876c14f28419c2b0 P d5b9feaa36ef49c386775798c7fbba58 [term 2 LEADER]: Becoming Leader. State: Replica: d5b9feaa36ef49c386775798c7fbba58, State: Running, Role: LEADER
I20260709 13:13:21.126212  7889 consensus_queue.cc:237] T 4d86b1ddf8a64589876c14f28419c2b0 P d5b9feaa36ef49c386775798c7fbba58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:21.135187  7294 catalog_manager.cc:5697] T 4d86b1ddf8a64589876c14f28419c2b0 P d5b9feaa36ef49c386775798c7fbba58 reported cstate change: term changed from 1 to 2, leader changed from 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1) to d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3). New cstate: current_term: 2 leader_uuid: "d5b9feaa36ef49c386775798c7fbba58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:21.152078  7889 raft_consensus.cc:493] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6892fe946cc9442eb2e1e21f1024b355)
I20260709 13:13:21.152534  7889 raft_consensus.cc:515] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:21.154307  7889 leader_election.cc:290] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941)
I20260709 13:13:21.155553  7471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a3ec2cf0baf4f99a5898f1dc93c0df3" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272" is_pre_election: true
W20260709 13:13:21.158020  7511 leader_election.cc:336] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111)
I20260709 13:13:21.158378  7511 leader_election.cc:304] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5b9feaa36ef49c386775798c7fbba58; no voters: 6892fe946cc9442eb2e1e21f1024b355, 9fb730dfb9d64542b1125a9f8ca64272
I20260709 13:13:21.158936  7889 raft_consensus.cc:2749] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:21.215075  7889 raft_consensus.cc:493] T cd343cb8504a420385daa15f0d0f4f84 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6892fe946cc9442eb2e1e21f1024b355)
I20260709 13:13:21.215850  7889 raft_consensus.cc:515] T cd343cb8504a420385daa15f0d0f4f84 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:21.218405  7889 leader_election.cc:290] T cd343cb8504a420385daa15f0d0f4f84 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941)
I20260709 13:13:21.219712  7471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd343cb8504a420385daa15f0d0f4f84" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272" is_pre_election: true
I20260709 13:13:21.222168  7742 raft_consensus.cc:493] T f57c9d84137e43f682ab95b85728a749 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6892fe946cc9442eb2e1e21f1024b355)
I20260709 13:13:21.222730  7742 raft_consensus.cc:515] T f57c9d84137e43f682ab95b85728a749 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:21.224485  7742 leader_election.cc:290] T f57c9d84137e43f682ab95b85728a749 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:21.226020  7544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57c9d84137e43f682ab95b85728a749" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d5b9feaa36ef49c386775798c7fbba58" is_pre_election: true
I20260709 13:13:21.226722  7544 raft_consensus.cc:2468] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fb730dfb9d64542b1125a9f8ca64272 in term 2.
I20260709 13:13:21.227792  7891 raft_consensus.cc:493] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6892fe946cc9442eb2e1e21f1024b355)
I20260709 13:13:21.228744  7889 raft_consensus.cc:493] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6892fe946cc9442eb2e1e21f1024b355)
I20260709 13:13:21.228385  7742 raft_consensus.cc:493] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6892fe946cc9442eb2e1e21f1024b355)
W20260709 13:13:21.229143  7437 leader_election.cc:336] T f57c9d84137e43f682ab95b85728a749 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111)
I20260709 13:13:21.229352  7889 raft_consensus.cc:515] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:21.229977  7437 leader_election.cc:304] T f57c9d84137e43f682ab95b85728a749 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fb730dfb9d64542b1125a9f8ca64272, d5b9feaa36ef49c386775798c7fbba58; no voters: 6892fe946cc9442eb2e1e21f1024b355
I20260709 13:13:21.228924  7891 raft_consensus.cc:515] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:21.231046  7890 raft_consensus.cc:2804] T f57c9d84137e43f682ab95b85728a749 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:21.231418  7890 raft_consensus.cc:493] T f57c9d84137e43f682ab95b85728a749 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6892fe946cc9442eb2e1e21f1024b355)
I20260709 13:13:21.229460  7742 raft_consensus.cc:515] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:21.231767  7890 raft_consensus.cc:3060] T f57c9d84137e43f682ab95b85728a749 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:21.232112  7889 leader_election.cc:290] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941)
W20260709 13:13:21.230175  7511 leader_election.cc:336] T cd343cb8504a420385daa15f0d0f4f84 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111)
I20260709 13:13:21.232755  7511 leader_election.cc:304] T cd343cb8504a420385daa15f0d0f4f84 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5b9feaa36ef49c386775798c7fbba58; no voters: 6892fe946cc9442eb2e1e21f1024b355, 9fb730dfb9d64542b1125a9f8ca64272
I20260709 13:13:21.233295  7742 leader_election.cc:290] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:21.234248  7891 leader_election.cc:290] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:21.236742  7889 raft_consensus.cc:2749] T cd343cb8504a420385daa15f0d0f4f84 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:21.237762  7544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a3ec2cf0baf4f99a5898f1dc93c0df3" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d5b9feaa36ef49c386775798c7fbba58" is_pre_election: true
I20260709 13:13:21.237052  7471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "730c1374419e417286fca4006acf11a9" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272" is_pre_election: true
I20260709 13:13:21.238564  7544 raft_consensus.cc:2468] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fb730dfb9d64542b1125a9f8ca64272 in term 1.
W20260709 13:13:21.240537  7511 leader_election.cc:336] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111)
I20260709 13:13:21.240584  7544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd343cb8504a420385daa15f0d0f4f84" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d5b9feaa36ef49c386775798c7fbba58" is_pre_election: true
I20260709 13:13:21.241496  7544 raft_consensus.cc:2468] T cd343cb8504a420385daa15f0d0f4f84 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fb730dfb9d64542b1125a9f8ca64272 in term 2.
I20260709 13:13:21.241662  7511 leader_election.cc:304] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d5b9feaa36ef49c386775798c7fbba58; no voters: 6892fe946cc9442eb2e1e21f1024b355, 9fb730dfb9d64542b1125a9f8ca64272
I20260709 13:13:21.242817  7889 raft_consensus.cc:2749] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:21.242834  7890 raft_consensus.cc:515] T f57c9d84137e43f682ab95b85728a749 P 9fb730dfb9d64542b1125a9f8ca64272 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:21.244792  7437 leader_election.cc:304] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fb730dfb9d64542b1125a9f8ca64272, d5b9feaa36ef49c386775798c7fbba58; no voters: 
I20260709 13:13:21.246301  7891 raft_consensus.cc:2804] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:21.246433  7437 leader_election.cc:304] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fb730dfb9d64542b1125a9f8ca64272, d5b9feaa36ef49c386775798c7fbba58; no voters: 
I20260709 13:13:21.246824  7891 raft_consensus.cc:493] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6892fe946cc9442eb2e1e21f1024b355)
I20260709 13:13:21.247313  7742 raft_consensus.cc:2804] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:21.247380  7891 raft_consensus.cc:3060] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:21.249498  7437 leader_election.cc:336] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111)
I20260709 13:13:21.247730  7742 raft_consensus.cc:493] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6892fe946cc9442eb2e1e21f1024b355)
W20260709 13:13:21.250243  7437 leader_election.cc:336] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111)
I20260709 13:13:21.250392  7742 raft_consensus.cc:3060] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:21.260035  7544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f57c9d84137e43f682ab95b85728a749" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d5b9feaa36ef49c386775798c7fbba58"
I20260709 13:13:21.260768  7544 raft_consensus.cc:3060] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:21.254535  7890 leader_election.cc:290] T f57c9d84137e43f682ab95b85728a749 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 3 election: Requested vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:21.273489  7544 raft_consensus.cc:2468] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fb730dfb9d64542b1125a9f8ca64272 in term 3.
W20260709 13:13:21.273504  7437 leader_election.cc:336] T f57c9d84137e43f682ab95b85728a749 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111)
I20260709 13:13:21.276566  7437 leader_election.cc:304] T f57c9d84137e43f682ab95b85728a749 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fb730dfb9d64542b1125a9f8ca64272, d5b9feaa36ef49c386775798c7fbba58; no voters: 6892fe946cc9442eb2e1e21f1024b355
I20260709 13:13:21.273645  7742 raft_consensus.cc:515] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:21.279219  7890 raft_consensus.cc:2804] T f57c9d84137e43f682ab95b85728a749 P 9fb730dfb9d64542b1125a9f8ca64272 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:21.279305  7891 raft_consensus.cc:515] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:21.279757  7742 leader_election.cc:290] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 3 election: Requested vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:21.279799  7890 raft_consensus.cc:697] T f57c9d84137e43f682ab95b85728a749 P 9fb730dfb9d64542b1125a9f8ca64272 [term 3 LEADER]: Becoming Leader. State: Replica: 9fb730dfb9d64542b1125a9f8ca64272, State: Running, Role: LEADER
I20260709 13:13:21.281354  7890 consensus_queue.cc:237] T f57c9d84137e43f682ab95b85728a749 P 9fb730dfb9d64542b1125a9f8ca64272 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:21.282037  7891 leader_election.cc:290] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 2 election: Requested vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:21.286927  7544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd343cb8504a420385daa15f0d0f4f84" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d5b9feaa36ef49c386775798c7fbba58"
I20260709 13:13:21.287763  7544 raft_consensus.cc:3060] T cd343cb8504a420385daa15f0d0f4f84 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:21.294164  7543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a3ec2cf0baf4f99a5898f1dc93c0df3" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d5b9feaa36ef49c386775798c7fbba58"
I20260709 13:13:21.294829  7543 raft_consensus.cc:3060] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:21.300045  7294 catalog_manager.cc:5697] T f57c9d84137e43f682ab95b85728a749 P 9fb730dfb9d64542b1125a9f8ca64272 reported cstate change: term changed from 2 to 3, leader changed from 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1) to 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2). New cstate: current_term: 3 leader_uuid: "9fb730dfb9d64542b1125a9f8ca64272" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:21.302656  7544 raft_consensus.cc:2468] T cd343cb8504a420385daa15f0d0f4f84 P d5b9feaa36ef49c386775798c7fbba58 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fb730dfb9d64542b1125a9f8ca64272 in term 3.
I20260709 13:13:21.303920  7437 leader_election.cc:304] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fb730dfb9d64542b1125a9f8ca64272, d5b9feaa36ef49c386775798c7fbba58; no voters: 
I20260709 13:13:21.305435  7891 raft_consensus.cc:2804] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:21.305898  7891 raft_consensus.cc:697] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [term 3 LEADER]: Becoming Leader. State: Replica: 9fb730dfb9d64542b1125a9f8ca64272, State: Running, Role: LEADER
I20260709 13:13:21.306702  7891 consensus_queue.cc:237] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:21.307420  7543 raft_consensus.cc:2468] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fb730dfb9d64542b1125a9f8ca64272 in term 2.
I20260709 13:13:21.308790  7889 raft_consensus.cc:493] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6892fe946cc9442eb2e1e21f1024b355)
I20260709 13:13:21.309379  7889 raft_consensus.cc:515] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
W20260709 13:13:21.310189  7437 leader_election.cc:336] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111)
W20260709 13:13:21.310874  7437 leader_election.cc:336] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111)
I20260709 13:13:21.311447  7889 leader_election.cc:290] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941)
I20260709 13:13:21.319307  7471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79da21344c24485d8cac81393166ecb2" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272" is_pre_election: true
I20260709 13:13:21.328979  7471 raft_consensus.cc:2468] T 79da21344c24485d8cac81393166ecb2 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5b9feaa36ef49c386775798c7fbba58 in term 2.
I20260709 13:13:21.313571  7437 leader_election.cc:304] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fb730dfb9d64542b1125a9f8ca64272, d5b9feaa36ef49c386775798c7fbba58; no voters: 6892fe946cc9442eb2e1e21f1024b355
W20260709 13:13:21.328073  7511 leader_election.cc:336] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111)
I20260709 13:13:21.330140  7511 leader_election.cc:304] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fb730dfb9d64542b1125a9f8ca64272, d5b9feaa36ef49c386775798c7fbba58; no voters: 6892fe946cc9442eb2e1e21f1024b355
I20260709 13:13:21.330720  7889 raft_consensus.cc:2804] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:21.331074  7889 raft_consensus.cc:493] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6892fe946cc9442eb2e1e21f1024b355)
I20260709 13:13:21.331455  7889 raft_consensus.cc:3060] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:21.330888  7294 catalog_manager.cc:5697] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 reported cstate change: term changed from 2 to 3, leader changed from 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1) to 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2). New cstate: current_term: 3 leader_uuid: "9fb730dfb9d64542b1125a9f8ca64272" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:21.333052  7891 raft_consensus.cc:2804] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:21.333504  7891 raft_consensus.cc:697] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 LEADER]: Becoming Leader. State: Replica: 9fb730dfb9d64542b1125a9f8ca64272, State: Running, Role: LEADER
I20260709 13:13:21.334651  7891 consensus_queue.cc:237] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 9fb730dfb9d64542b1125a9f8ca64272 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:21.339221  7889 raft_consensus.cc:515] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:21.342658  7889 leader_election.cc:290] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 3 election: Requested vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941)
I20260709 13:13:21.343662  7471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79da21344c24485d8cac81393166ecb2" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272"
I20260709 13:13:21.344532  7471 raft_consensus.cc:3060] T 79da21344c24485d8cac81393166ecb2 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:21.347121  7511 leader_election.cc:336] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111)
I20260709 13:13:21.352937  7471 raft_consensus.cc:2468] T 79da21344c24485d8cac81393166ecb2 P 9fb730dfb9d64542b1125a9f8ca64272 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5b9feaa36ef49c386775798c7fbba58 in term 3.
I20260709 13:13:21.354285  7511 leader_election.cc:304] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fb730dfb9d64542b1125a9f8ca64272, d5b9feaa36ef49c386775798c7fbba58; no voters: 6892fe946cc9442eb2e1e21f1024b355
I20260709 13:13:21.354995  7889 raft_consensus.cc:2804] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:21.355546  7889 raft_consensus.cc:697] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 [term 3 LEADER]: Becoming Leader. State: Replica: d5b9feaa36ef49c386775798c7fbba58, State: Running, Role: LEADER
I20260709 13:13:21.356407  7889 consensus_queue.cc:237] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:21.364570  7294 catalog_manager.cc:5697] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 9fb730dfb9d64542b1125a9f8ca64272 reported cstate change: term changed from 1 to 2, leader changed from 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1) to 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2). New cstate: current_term: 2 leader_uuid: "9fb730dfb9d64542b1125a9f8ca64272" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:21.365345  7295 catalog_manager.cc:5697] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 reported cstate change: term changed from 2 to 3, leader changed from 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1) to d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3). New cstate: current_term: 3 leader_uuid: "d5b9feaa36ef49c386775798c7fbba58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:21.368114  7889 raft_consensus.cc:493] T 87d3c8dac44049b8ba431715dc8a5af6 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6892fe946cc9442eb2e1e21f1024b355)
I20260709 13:13:21.368716  7889 raft_consensus.cc:515] T 87d3c8dac44049b8ba431715dc8a5af6 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:21.370903  7889 leader_election.cc:290] T 87d3c8dac44049b8ba431715dc8a5af6 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941)
W20260709 13:13:21.374586  7511 leader_election.cc:336] T 87d3c8dac44049b8ba431715dc8a5af6 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111)
I20260709 13:13:21.374425  7471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d3c8dac44049b8ba431715dc8a5af6" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272" is_pre_election: true
I20260709 13:13:21.375932  7471 raft_consensus.cc:2468] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5b9feaa36ef49c386775798c7fbba58 in term 2.
I20260709 13:13:21.377403  7511 leader_election.cc:304] T 87d3c8dac44049b8ba431715dc8a5af6 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fb730dfb9d64542b1125a9f8ca64272, d5b9feaa36ef49c386775798c7fbba58; no voters: 6892fe946cc9442eb2e1e21f1024b355
I20260709 13:13:21.379276  7889 raft_consensus.cc:2804] T 87d3c8dac44049b8ba431715dc8a5af6 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:21.379586  7889 raft_consensus.cc:493] T 87d3c8dac44049b8ba431715dc8a5af6 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6892fe946cc9442eb2e1e21f1024b355)
I20260709 13:13:21.379899  7889 raft_consensus.cc:3060] T 87d3c8dac44049b8ba431715dc8a5af6 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:21.384560  7889 raft_consensus.cc:515] T 87d3c8dac44049b8ba431715dc8a5af6 P d5b9feaa36ef49c386775798c7fbba58 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:21.385987  7889 leader_election.cc:290] T 87d3c8dac44049b8ba431715dc8a5af6 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 3 election: Requested vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941)
I20260709 13:13:21.387494  7471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d3c8dac44049b8ba431715dc8a5af6" candidate_uuid: "d5b9feaa36ef49c386775798c7fbba58" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9fb730dfb9d64542b1125a9f8ca64272"
I20260709 13:13:21.388180  7471 raft_consensus.cc:3060] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:21.389967  7511 leader_election.cc:336] T 87d3c8dac44049b8ba431715dc8a5af6 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111)
I20260709 13:13:21.395593  7471 raft_consensus.cc:2468] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5b9feaa36ef49c386775798c7fbba58 in term 3.
I20260709 13:13:21.396706  7511 leader_election.cc:304] T 87d3c8dac44049b8ba431715dc8a5af6 P d5b9feaa36ef49c386775798c7fbba58 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fb730dfb9d64542b1125a9f8ca64272, d5b9feaa36ef49c386775798c7fbba58; no voters: 6892fe946cc9442eb2e1e21f1024b355
I20260709 13:13:21.397423  7889 raft_consensus.cc:2804] T 87d3c8dac44049b8ba431715dc8a5af6 P d5b9feaa36ef49c386775798c7fbba58 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:21.397835  7889 raft_consensus.cc:697] T 87d3c8dac44049b8ba431715dc8a5af6 P d5b9feaa36ef49c386775798c7fbba58 [term 3 LEADER]: Becoming Leader. State: Replica: d5b9feaa36ef49c386775798c7fbba58, State: Running, Role: LEADER
I20260709 13:13:21.398537  7889 consensus_queue.cc:237] T 87d3c8dac44049b8ba431715dc8a5af6 P d5b9feaa36ef49c386775798c7fbba58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:21.405920  7891 raft_consensus.cc:493] T 730c1374419e417286fca4006acf11a9 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6892fe946cc9442eb2e1e21f1024b355)
I20260709 13:13:21.406411  7891 raft_consensus.cc:515] T 730c1374419e417286fca4006acf11a9 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:21.408258  7891 leader_election.cc:290] T 730c1374419e417286fca4006acf11a9 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:21.407696  7295 catalog_manager.cc:5697] T 87d3c8dac44049b8ba431715dc8a5af6 P d5b9feaa36ef49c386775798c7fbba58 reported cstate change: term changed from 2 to 3, leader changed from 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1) to d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3). New cstate: current_term: 3 leader_uuid: "d5b9feaa36ef49c386775798c7fbba58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:21.409641  7543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "730c1374419e417286fca4006acf11a9" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d5b9feaa36ef49c386775798c7fbba58" is_pre_election: true
I20260709 13:13:21.410305  7543 raft_consensus.cc:2468] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fb730dfb9d64542b1125a9f8ca64272 in term 2.
I20260709 13:13:21.412716  7437 leader_election.cc:304] T 730c1374419e417286fca4006acf11a9 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fb730dfb9d64542b1125a9f8ca64272, d5b9feaa36ef49c386775798c7fbba58; no voters: 
W20260709 13:13:21.413429  7437 leader_election.cc:336] T 730c1374419e417286fca4006acf11a9 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111)
I20260709 13:13:21.414136  7891 raft_consensus.cc:2804] T 730c1374419e417286fca4006acf11a9 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:21.414497  7891 raft_consensus.cc:493] T 730c1374419e417286fca4006acf11a9 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6892fe946cc9442eb2e1e21f1024b355)
I20260709 13:13:21.414793  7891 raft_consensus.cc:3060] T 730c1374419e417286fca4006acf11a9 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:21.420478  7891 raft_consensus.cc:515] T 730c1374419e417286fca4006acf11a9 P 9fb730dfb9d64542b1125a9f8ca64272 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:21.422089  7891 leader_election.cc:290] T 730c1374419e417286fca4006acf11a9 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 3 election: Requested vote from peers 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637), d5b9feaa36ef49c386775798c7fbba58 (127.28.173.3:37251)
I20260709 13:13:21.423337  7543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "730c1374419e417286fca4006acf11a9" candidate_uuid: "9fb730dfb9d64542b1125a9f8ca64272" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d5b9feaa36ef49c386775798c7fbba58"
I20260709 13:13:21.423944  7543 raft_consensus.cc:3060] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:21.426343  7437 leader_election.cc:336] T 730c1374419e417286fca4006acf11a9 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111)
I20260709 13:13:21.430716  7543 raft_consensus.cc:2468] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fb730dfb9d64542b1125a9f8ca64272 in term 3.
I20260709 13:13:21.431669  7437 leader_election.cc:304] T 730c1374419e417286fca4006acf11a9 P 9fb730dfb9d64542b1125a9f8ca64272 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fb730dfb9d64542b1125a9f8ca64272, d5b9feaa36ef49c386775798c7fbba58; no voters: 6892fe946cc9442eb2e1e21f1024b355
I20260709 13:13:21.432312  7891 raft_consensus.cc:2804] T 730c1374419e417286fca4006acf11a9 P 9fb730dfb9d64542b1125a9f8ca64272 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:21.432783  7891 raft_consensus.cc:697] T 730c1374419e417286fca4006acf11a9 P 9fb730dfb9d64542b1125a9f8ca64272 [term 3 LEADER]: Becoming Leader. State: Replica: 9fb730dfb9d64542b1125a9f8ca64272, State: Running, Role: LEADER
I20260709 13:13:21.433588  7891 consensus_queue.cc:237] T 730c1374419e417286fca4006acf11a9 P 9fb730dfb9d64542b1125a9f8ca64272 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } }
I20260709 13:13:21.442662  7295 catalog_manager.cc:5697] T 730c1374419e417286fca4006acf11a9 P 9fb730dfb9d64542b1125a9f8ca64272 reported cstate change: term changed from 2 to 3, leader changed from 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1) to 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2). New cstate: current_term: 3 leader_uuid: "9fb730dfb9d64542b1125a9f8ca64272" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6892fe946cc9442eb2e1e21f1024b355" member_type: VOTER last_known_addr { host: "127.28.173.1" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:21.649653  7471 raft_consensus.cc:1275] T 4d86b1ddf8a64589876c14f28419c2b0 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Refusing update from remote peer d5b9feaa36ef49c386775798c7fbba58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:21.650902  7889 consensus_queue.cc:1048] T 4d86b1ddf8a64589876c14f28419c2b0 P d5b9feaa36ef49c386775798c7fbba58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:21.674844  7511 consensus_peers.cc:597] T 4d86b1ddf8a64589876c14f28419c2b0 P d5b9feaa36ef49c386775798c7fbba58 -> Peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Couldn't send request to peer 6892fe946cc9442eb2e1e21f1024b355. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:21.742444  7543 raft_consensus.cc:1275] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58 [term 3 FOLLOWER]: Refusing update from remote peer 9fb730dfb9d64542b1125a9f8ca64272: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:13:21.744163  7891 consensus_queue.cc:1048] T f57c9d84137e43f682ab95b85728a749 P 9fb730dfb9d64542b1125a9f8ca64272 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:13:21.759722  7437 consensus_peers.cc:597] T f57c9d84137e43f682ab95b85728a749 P 9fb730dfb9d64542b1125a9f8ca64272 -> Peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Couldn't send request to peer 6892fe946cc9442eb2e1e21f1024b355. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:21.772346  7437 consensus_peers.cc:597] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 9fb730dfb9d64542b1125a9f8ca64272 -> Peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Couldn't send request to peer 6892fe946cc9442eb2e1e21f1024b355. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:21.781761  7511 consensus_peers.cc:597] T 87d3c8dac44049b8ba431715dc8a5af6 P d5b9feaa36ef49c386775798c7fbba58 -> Peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Couldn't send request to peer 6892fe946cc9442eb2e1e21f1024b355. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:21.807126  7437 consensus_peers.cc:597] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 -> Peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Couldn't send request to peer 6892fe946cc9442eb2e1e21f1024b355. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:21.831477  7543 raft_consensus.cc:1275] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Refusing update from remote peer 9fb730dfb9d64542b1125a9f8ca64272: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:13:21.832799  7891 consensus_queue.cc:1048] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 9fb730dfb9d64542b1125a9f8ca64272 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:13:21.894124  7511 consensus_peers.cc:597] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 -> Peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Couldn't send request to peer 6892fe946cc9442eb2e1e21f1024b355. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:21.895129  7543 raft_consensus.cc:1275] T cd343cb8504a420385daa15f0d0f4f84 P d5b9feaa36ef49c386775798c7fbba58 [term 3 FOLLOWER]: Refusing update from remote peer 9fb730dfb9d64542b1125a9f8ca64272: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:13:21.896484  7897 consensus_queue.cc:1048] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:21.942701  7471 raft_consensus.cc:1275] T 79da21344c24485d8cac81393166ecb2 P 9fb730dfb9d64542b1125a9f8ca64272 [term 3 FOLLOWER]: Refusing update from remote peer d5b9feaa36ef49c386775798c7fbba58: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:21.944326  7889 consensus_queue.cc:1048] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:13:21.950129  7437 consensus_peers.cc:597] T 730c1374419e417286fca4006acf11a9 P 9fb730dfb9d64542b1125a9f8ca64272 -> Peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Couldn't send request to peer 6892fe946cc9442eb2e1e21f1024b355. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:21.989933  7544 raft_consensus.cc:1275] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58 [term 3 FOLLOWER]: Refusing update from remote peer 9fb730dfb9d64542b1125a9f8ca64272: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:21.991205  7891 consensus_queue.cc:1048] T 730c1374419e417286fca4006acf11a9 P 9fb730dfb9d64542b1125a9f8ca64272 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5b9feaa36ef49c386775798c7fbba58" member_type: VOTER last_known_addr { host: "127.28.173.3" port: 37251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:21.997788  7471 raft_consensus.cc:1275] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272 [term 3 FOLLOWER]: Refusing update from remote peer d5b9feaa36ef49c386775798c7fbba58: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:13:21.999495  7888 consensus_queue.cc:1048] T 87d3c8dac44049b8ba431715dc8a5af6 P d5b9feaa36ef49c386775798c7fbba58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fb730dfb9d64542b1125a9f8ca64272" member_type: VOTER last_known_addr { host: "127.28.173.2" port: 45941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:13:22.007390 29364 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 7420)
W20260709 13:13:22.148748  7511 consensus_peers.cc:597] T e5edb5aba6f548a189a2ecd96cf02b28 P d5b9feaa36ef49c386775798c7fbba58 -> Peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Couldn't send request to peer 6892fe946cc9442eb2e1e21f1024b355. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:22.441783  7511 consensus_peers.cc:597] T 39685c4581dc4bf4a7eb1065a07df99e P d5b9feaa36ef49c386775798c7fbba58 -> Peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Couldn't send request to peer 6892fe946cc9442eb2e1e21f1024b355. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:22.514849  7511 consensus_peers.cc:597] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 -> Peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Couldn't send request to peer 6892fe946cc9442eb2e1e21f1024b355. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:22.548465  7437 consensus_peers.cc:597] T f1ed065b6ee3472da798007ec76be525 P 9fb730dfb9d64542b1125a9f8ca64272 -> Peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Couldn't send request to peer 6892fe946cc9442eb2e1e21f1024b355. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:22.647838  7437 consensus_peers.cc:597] T b114fd1274ba4053a1d836e8d5f53f3b P 9fb730dfb9d64542b1125a9f8ca64272 -> Peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Couldn't send request to peer 6892fe946cc9442eb2e1e21f1024b355. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:22.663568  7437 consensus_peers.cc:597] T c050f90249fc477abf94ed50adc7b5e3 P 9fb730dfb9d64542b1125a9f8ca64272 -> Peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Couldn't send request to peer 6892fe946cc9442eb2e1e21f1024b355. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:22.727375  7437 consensus_peers.cc:597] T 207f51796525408199723c1d30adca6e P 9fb730dfb9d64542b1125a9f8ca64272 -> Peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Couldn't send request to peer 6892fe946cc9442eb2e1e21f1024b355. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:22.729753  7437 consensus_peers.cc:597] T 23201718ad6845f79123a5c755b9657a P 9fb730dfb9d64542b1125a9f8ca64272 -> Peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Couldn't send request to peer 6892fe946cc9442eb2e1e21f1024b355. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:22.733129  7437 consensus_peers.cc:597] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272 -> Peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Couldn't send request to peer 6892fe946cc9442eb2e1e21f1024b355. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:22.785758  7437 consensus_peers.cc:597] T 791e0ec1608242b19b64b46991228864 P 9fb730dfb9d64542b1125a9f8ca64272 -> Peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Couldn't send request to peer 6892fe946cc9442eb2e1e21f1024b355. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:22.817021  7511 consensus_peers.cc:597] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58 -> Peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Couldn't send request to peer 6892fe946cc9442eb2e1e21f1024b355. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:23.008062 29364 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 7420)
I20260709 13:13:23.952673 29364 tablet_server.cc:196] TabletServer@127.28.173.1:0 shutdown complete.
I20260709 13:13:24.013573 29364 tablet_server.cc:179] TabletServer@127.28.173.2:0 shutting down...
W20260709 13:13:24.020956  7511 consensus_peers.cc:597] T e5edb5aba6f548a189a2ecd96cf02b28 P d5b9feaa36ef49c386775798c7fbba58 -> Peer 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941): Couldn't send request to peer 9fb730dfb9d64542b1125a9f8ca64272. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:24.053181 29364 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:24.054109 29364 tablet_replica.cc:333] T f1ed065b6ee3472da798007ec76be525 P 9fb730dfb9d64542b1125a9f8ca64272: stopping tablet replica
I20260709 13:13:24.054993 29364 raft_consensus.cc:2243] T f1ed065b6ee3472da798007ec76be525 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.056061 29364 raft_consensus.cc:2272] T f1ed065b6ee3472da798007ec76be525 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.058440 29364 tablet_replica.cc:333] T b114fd1274ba4053a1d836e8d5f53f3b P 9fb730dfb9d64542b1125a9f8ca64272: stopping tablet replica
I20260709 13:13:24.059077 29364 raft_consensus.cc:2243] T b114fd1274ba4053a1d836e8d5f53f3b P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.059983 29364 raft_consensus.cc:2272] T b114fd1274ba4053a1d836e8d5f53f3b P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.062367 29364 tablet_replica.cc:333] T 207f51796525408199723c1d30adca6e P 9fb730dfb9d64542b1125a9f8ca64272: stopping tablet replica
I20260709 13:13:24.062959 29364 raft_consensus.cc:2243] T 207f51796525408199723c1d30adca6e P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.063782 29364 raft_consensus.cc:2272] T 207f51796525408199723c1d30adca6e P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.066048 29364 tablet_replica.cc:333] T e5edb5aba6f548a189a2ecd96cf02b28 P 9fb730dfb9d64542b1125a9f8ca64272: stopping tablet replica
I20260709 13:13:24.066606 29364 raft_consensus.cc:2243] T e5edb5aba6f548a189a2ecd96cf02b28 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.067179 29364 raft_consensus.cc:2272] T e5edb5aba6f548a189a2ecd96cf02b28 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.070417 29364 tablet_replica.cc:333] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272: stopping tablet replica
I20260709 13:13:24.071053 29364 raft_consensus.cc:2243] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:24.071894  7511 consensus_peers.cc:597] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58 -> Peer 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941): Couldn't send request to peer 9fb730dfb9d64542b1125a9f8ca64272. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:24.071970 29364 raft_consensus.cc:2272] T 87d3c8dac44049b8ba431715dc8a5af6 P 9fb730dfb9d64542b1125a9f8ca64272 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.074558 29364 tablet_replica.cc:333] T c050f90249fc477abf94ed50adc7b5e3 P 9fb730dfb9d64542b1125a9f8ca64272: stopping tablet replica
I20260709 13:13:24.075145 29364 raft_consensus.cc:2243] T c050f90249fc477abf94ed50adc7b5e3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.076076 29364 raft_consensus.cc:2272] T c050f90249fc477abf94ed50adc7b5e3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.078454 29364 tablet_replica.cc:333] T 791e0ec1608242b19b64b46991228864 P 9fb730dfb9d64542b1125a9f8ca64272: stopping tablet replica
I20260709 13:13:24.079067 29364 raft_consensus.cc:2243] T 791e0ec1608242b19b64b46991228864 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.080181 29364 raft_consensus.cc:2272] T 791e0ec1608242b19b64b46991228864 P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.083448 29364 tablet_replica.cc:333] T 23201718ad6845f79123a5c755b9657a P 9fb730dfb9d64542b1125a9f8ca64272: stopping tablet replica
I20260709 13:13:24.084300 29364 raft_consensus.cc:2243] T 23201718ad6845f79123a5c755b9657a P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.085244 29364 raft_consensus.cc:2272] T 23201718ad6845f79123a5c755b9657a P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.087467 29364 tablet_replica.cc:333] T 39685c4581dc4bf4a7eb1065a07df99e P 9fb730dfb9d64542b1125a9f8ca64272: stopping tablet replica
I20260709 13:13:24.088068 29364 raft_consensus.cc:2243] T 39685c4581dc4bf4a7eb1065a07df99e P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.088551 29364 raft_consensus.cc:2272] T 39685c4581dc4bf4a7eb1065a07df99e P 9fb730dfb9d64542b1125a9f8ca64272 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.090636 29364 tablet_replica.cc:333] T 730c1374419e417286fca4006acf11a9 P 9fb730dfb9d64542b1125a9f8ca64272: stopping tablet replica
I20260709 13:13:24.091235 29364 raft_consensus.cc:2243] T 730c1374419e417286fca4006acf11a9 P 9fb730dfb9d64542b1125a9f8ca64272 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.092182 29364 raft_consensus.cc:2272] T 730c1374419e417286fca4006acf11a9 P 9fb730dfb9d64542b1125a9f8ca64272 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.094555 29364 tablet_replica.cc:333] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272: stopping tablet replica
I20260709 13:13:24.095109 29364 raft_consensus.cc:2243] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.096005 29364 raft_consensus.cc:2272] T b30fe0c3d3034035bddf8837a6489448 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.098168 29364 tablet_replica.cc:333] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272: stopping tablet replica
I20260709 13:13:24.098702 29364 raft_consensus.cc:2243] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.099711 29364 raft_consensus.cc:2272] T cd343cb8504a420385daa15f0d0f4f84 P 9fb730dfb9d64542b1125a9f8ca64272 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.101900 29364 tablet_replica.cc:333] T f57c9d84137e43f682ab95b85728a749 P 9fb730dfb9d64542b1125a9f8ca64272: stopping tablet replica
I20260709 13:13:24.102402 29364 raft_consensus.cc:2243] T f57c9d84137e43f682ab95b85728a749 P 9fb730dfb9d64542b1125a9f8ca64272 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.103291 29364 raft_consensus.cc:2272] T f57c9d84137e43f682ab95b85728a749 P 9fb730dfb9d64542b1125a9f8ca64272 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.105587 29364 tablet_replica.cc:333] T 3e8d0f65b3564feea4ae78a34ede70f3 P 9fb730dfb9d64542b1125a9f8ca64272: stopping tablet replica
I20260709 13:13:24.106278 29364 raft_consensus.cc:2243] T 3e8d0f65b3564feea4ae78a34ede70f3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.107028 29364 raft_consensus.cc:2272] T 3e8d0f65b3564feea4ae78a34ede70f3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.109673 29364 tablet_replica.cc:333] T 4d86b1ddf8a64589876c14f28419c2b0 P 9fb730dfb9d64542b1125a9f8ca64272: stopping tablet replica
I20260709 13:13:24.110193 29364 raft_consensus.cc:2243] T 4d86b1ddf8a64589876c14f28419c2b0 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.110605 29364 raft_consensus.cc:2272] T 4d86b1ddf8a64589876c14f28419c2b0 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.112660 29364 tablet_replica.cc:333] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 9fb730dfb9d64542b1125a9f8ca64272: stopping tablet replica
I20260709 13:13:24.113257 29364 raft_consensus.cc:2243] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.114539 29364 raft_consensus.cc:2272] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P 9fb730dfb9d64542b1125a9f8ca64272 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:24.116590  7511 consensus_peers.cc:597] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 -> Peer 9fb730dfb9d64542b1125a9f8ca64272 (127.28.173.2:45941): Couldn't send request to peer 9fb730dfb9d64542b1125a9f8ca64272. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:24.117209 29364 tablet_replica.cc:333] T 79da21344c24485d8cac81393166ecb2 P 9fb730dfb9d64542b1125a9f8ca64272: stopping tablet replica
I20260709 13:13:24.117789 29364 raft_consensus.cc:2243] T 79da21344c24485d8cac81393166ecb2 P 9fb730dfb9d64542b1125a9f8ca64272 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.118306 29364 raft_consensus.cc:2272] T 79da21344c24485d8cac81393166ecb2 P 9fb730dfb9d64542b1125a9f8ca64272 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.120474 29364 tablet_replica.cc:333] T 7c2d9c7b2731498fbe0f7d715f98583f P 9fb730dfb9d64542b1125a9f8ca64272: stopping tablet replica
I20260709 13:13:24.120939 29364 raft_consensus.cc:2243] T 7c2d9c7b2731498fbe0f7d715f98583f P 9fb730dfb9d64542b1125a9f8ca64272 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.121452 29364 raft_consensus.cc:2272] T 7c2d9c7b2731498fbe0f7d715f98583f P 9fb730dfb9d64542b1125a9f8ca64272 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.165548 29364 tablet_server.cc:196] TabletServer@127.28.173.2:0 shutdown complete.
I20260709 13:13:24.206535 29364 tablet_server.cc:179] TabletServer@127.28.173.3:0 shutting down...
I20260709 13:13:24.235675 29364 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:24.236478 29364 tablet_replica.cc:333] T 207f51796525408199723c1d30adca6e P d5b9feaa36ef49c386775798c7fbba58: stopping tablet replica
I20260709 13:13:24.237555 29364 raft_consensus.cc:2243] T 207f51796525408199723c1d30adca6e P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.238318 29364 raft_consensus.cc:2272] T 207f51796525408199723c1d30adca6e P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:24.241447  7511 consensus_peers.cc:597] T 4d86b1ddf8a64589876c14f28419c2b0 P d5b9feaa36ef49c386775798c7fbba58 -> Peer 6892fe946cc9442eb2e1e21f1024b355 (127.28.173.1:45637): Couldn't send request to peer 6892fe946cc9442eb2e1e21f1024b355. Status: Network error: Client connection negotiation failed: client connection to 127.28.173.1:45637: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:24.241703 29364 tablet_replica.cc:333] T e5edb5aba6f548a189a2ecd96cf02b28 P d5b9feaa36ef49c386775798c7fbba58: stopping tablet replica
I20260709 13:13:24.242487 29364 raft_consensus.cc:2243] T e5edb5aba6f548a189a2ecd96cf02b28 P d5b9feaa36ef49c386775798c7fbba58 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.243333 29364 raft_consensus.cc:2272] T e5edb5aba6f548a189a2ecd96cf02b28 P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.245654 29364 tablet_replica.cc:333] T c050f90249fc477abf94ed50adc7b5e3 P d5b9feaa36ef49c386775798c7fbba58: stopping tablet replica
I20260709 13:13:24.246249 29364 raft_consensus.cc:2243] T c050f90249fc477abf94ed50adc7b5e3 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.246737 29364 raft_consensus.cc:2272] T c050f90249fc477abf94ed50adc7b5e3 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.249023 29364 tablet_replica.cc:333] T f1ed065b6ee3472da798007ec76be525 P d5b9feaa36ef49c386775798c7fbba58: stopping tablet replica
I20260709 13:13:24.249558 29364 raft_consensus.cc:2243] T f1ed065b6ee3472da798007ec76be525 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.250023 29364 raft_consensus.cc:2272] T f1ed065b6ee3472da798007ec76be525 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.252202 29364 tablet_replica.cc:333] T b114fd1274ba4053a1d836e8d5f53f3b P d5b9feaa36ef49c386775798c7fbba58: stopping tablet replica
I20260709 13:13:24.252791 29364 raft_consensus.cc:2243] T b114fd1274ba4053a1d836e8d5f53f3b P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.253288 29364 raft_consensus.cc:2272] T b114fd1274ba4053a1d836e8d5f53f3b P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.255345 29364 tablet_replica.cc:333] T 87d3c8dac44049b8ba431715dc8a5af6 P d5b9feaa36ef49c386775798c7fbba58: stopping tablet replica
I20260709 13:13:24.255934 29364 raft_consensus.cc:2243] T 87d3c8dac44049b8ba431715dc8a5af6 P d5b9feaa36ef49c386775798c7fbba58 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.256805 29364 raft_consensus.cc:2272] T 87d3c8dac44049b8ba431715dc8a5af6 P d5b9feaa36ef49c386775798c7fbba58 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.258921 29364 tablet_replica.cc:333] T 791e0ec1608242b19b64b46991228864 P d5b9feaa36ef49c386775798c7fbba58: stopping tablet replica
I20260709 13:13:24.259488 29364 raft_consensus.cc:2243] T 791e0ec1608242b19b64b46991228864 P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.259999 29364 raft_consensus.cc:2272] T 791e0ec1608242b19b64b46991228864 P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.262024 29364 tablet_replica.cc:333] T cd343cb8504a420385daa15f0d0f4f84 P d5b9feaa36ef49c386775798c7fbba58: stopping tablet replica
I20260709 13:13:24.262534 29364 raft_consensus.cc:2243] T cd343cb8504a420385daa15f0d0f4f84 P d5b9feaa36ef49c386775798c7fbba58 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.263049 29364 raft_consensus.cc:2272] T cd343cb8504a420385daa15f0d0f4f84 P d5b9feaa36ef49c386775798c7fbba58 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.265192 29364 tablet_replica.cc:333] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58: stopping tablet replica
I20260709 13:13:24.265723 29364 raft_consensus.cc:2243] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.266283 29364 raft_consensus.cc:2272] T f57c9d84137e43f682ab95b85728a749 P d5b9feaa36ef49c386775798c7fbba58 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.268424 29364 tablet_replica.cc:333] T 23201718ad6845f79123a5c755b9657a P d5b9feaa36ef49c386775798c7fbba58: stopping tablet replica
I20260709 13:13:24.268944 29364 raft_consensus.cc:2243] T 23201718ad6845f79123a5c755b9657a P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.269405 29364 raft_consensus.cc:2272] T 23201718ad6845f79123a5c755b9657a P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.271427 29364 tablet_replica.cc:333] T 39685c4581dc4bf4a7eb1065a07df99e P d5b9feaa36ef49c386775798c7fbba58: stopping tablet replica
I20260709 13:13:24.271987 29364 raft_consensus.cc:2243] T 39685c4581dc4bf4a7eb1065a07df99e P d5b9feaa36ef49c386775798c7fbba58 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.272806 29364 raft_consensus.cc:2272] T 39685c4581dc4bf4a7eb1065a07df99e P d5b9feaa36ef49c386775798c7fbba58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.274888 29364 tablet_replica.cc:333] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58: stopping tablet replica
I20260709 13:13:24.275389 29364 raft_consensus.cc:2243] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.276273 29364 raft_consensus.cc:2272] T 3e8d0f65b3564feea4ae78a34ede70f3 P d5b9feaa36ef49c386775798c7fbba58 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.278347 29364 tablet_replica.cc:333] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58: stopping tablet replica
I20260709 13:13:24.278899 29364 raft_consensus.cc:2243] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.279418 29364 raft_consensus.cc:2272] T 730c1374419e417286fca4006acf11a9 P d5b9feaa36ef49c386775798c7fbba58 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.281438 29364 tablet_replica.cc:333] T b30fe0c3d3034035bddf8837a6489448 P d5b9feaa36ef49c386775798c7fbba58: stopping tablet replica
I20260709 13:13:24.281953 29364 raft_consensus.cc:2243] T b30fe0c3d3034035bddf8837a6489448 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.282390 29364 raft_consensus.cc:2272] T b30fe0c3d3034035bddf8837a6489448 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.284482 29364 tablet_replica.cc:333] T 4d86b1ddf8a64589876c14f28419c2b0 P d5b9feaa36ef49c386775798c7fbba58: stopping tablet replica
I20260709 13:13:24.285030 29364 raft_consensus.cc:2243] T 4d86b1ddf8a64589876c14f28419c2b0 P d5b9feaa36ef49c386775798c7fbba58 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.285894 29364 raft_consensus.cc:2272] T 4d86b1ddf8a64589876c14f28419c2b0 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.287957 29364 tablet_replica.cc:333] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P d5b9feaa36ef49c386775798c7fbba58: stopping tablet replica
I20260709 13:13:24.288453 29364 raft_consensus.cc:2243] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:24.288946 29364 raft_consensus.cc:2272] T 5a3ec2cf0baf4f99a5898f1dc93c0df3 P d5b9feaa36ef49c386775798c7fbba58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.290994 29364 tablet_replica.cc:333] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58: stopping tablet replica
I20260709 13:13:24.291463 29364 raft_consensus.cc:2243] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.292361 29364 raft_consensus.cc:2272] T 79da21344c24485d8cac81393166ecb2 P d5b9feaa36ef49c386775798c7fbba58 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.294283 29364 tablet_replica.cc:333] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58: stopping tablet replica
I20260709 13:13:24.294723 29364 raft_consensus.cc:2243] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.295495 29364 raft_consensus.cc:2272] T 7c2d9c7b2731498fbe0f7d715f98583f P d5b9feaa36ef49c386775798c7fbba58 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.360868 29364 tablet_server.cc:196] TabletServer@127.28.173.3:0 shutdown complete.
I20260709 13:13:24.398269 29364 master.cc:562] Master@127.28.173.62:38425 shutting down...
I20260709 13:13:24.422190 29364 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 878e61842f66468cbc5b35262f4dbda7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:24.422775 29364 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 878e61842f66468cbc5b35262f4dbda7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:24.423061 29364 tablet_replica.cc:333] T 00000000000000000000000000000000 P 878e61842f66468cbc5b35262f4dbda7: stopping tablet replica
I20260709 13:13:24.443974 29364 master.cc:584] Master@127.28.173.62:38425 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (17193 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (30071 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (360390 ms total)
[  PASSED  ] 8 tests.
I20260709 13:13:24.499703 29364 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 687 messages since previous log ~20 seconds ago
I20260709 13:13:24.499940 29364 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 685 messages since previous log ~20 seconds ago
I20260709 13:13:24.500080 29364 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 672 messages since previous log ~20 seconds ago
I20260709 13:13:24.500232 29364 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~38 seconds ago
I20260709 13:13:24.500381 29364 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~38 seconds ago
I20260709 13:13:24.500547 29364 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 3 messages since previous log ~195 seconds ago
I20260709 13:13:24.500695 29364 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 1 messages since previous log ~209 seconds ago
I20260709 13:13:24.500834 29364 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 1 messages since previous log ~210 seconds ago
I20260709 13:13:24.501029 29364 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 152 messages since previous log ~4 seconds ago
I20260709 13:13:24.501319 29364 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 26 messages since previous log ~10 seconds ago
